logo资料库

最新MATLAB分布式仿真平台搭建官方文档.pdf

第1页 / 共148页
第2页 / 共148页
第3页 / 共148页
第4页 / 共148页
第5页 / 共148页
第6页 / 共148页
第7页 / 共148页
第8页 / 共148页
资料共148页,剩余部分请下载后查看
MATLAB® Distributed Computing Server™ System Administrator's Guide R2018a
How to Contact MathWorks Latest news: www.mathworks.com Sales and services: www.mathworks.com/sales_and_services User community: Technical support: Phone: www.mathworks.com/matlabcentral www.mathworks.com/support/contact_us 508-647-7000 The MathWorks, Inc. 3 Apple Hill Drive Natick, MA 01760-2098 MATLAB® Distributed Computing Server™ System Administrator's Guide © COPYRIGHT 2005–2018 by The MathWorks, Inc. The software described in this document is furnished under a license agreement. The software may be used or copied only under the terms of the license agreement. No part of this manual may be photocopied or reproduced in any form without prior written consent from The MathWorks, Inc. FEDERAL ACQUISITION: This provision applies to all acquisitions of the Program and Documentation by, for, or through the federal government of the United States. By accepting delivery of the Program or Documentation, the government hereby agrees that this software or documentation qualifies as commercial computer software or commercial computer software documentation as such terms are used or defined in FAR 12.212, DFARS Part 227.72, and DFARS 252.227-7014. Accordingly, the terms and conditions of this Agreement and only those rights specified in this Agreement, shall pertain to and govern the use, modification, reproduction, release, performance, display, and disclosure of the Program and Documentation by the federal government (or other entity acquiring for or through the federal government) and shall supersede any conflicting contractual terms or conditions. If this License fails to meet the government's needs or is inconsistent in any respect with federal procurement law, the government agrees to return the Program and Documentation, unused, to The MathWorks, Inc. Trademarks MATLAB and Simulink are registered trademarks of The MathWorks, Inc. See www.mathworks.com/trademarks for a list of additional trademarks. Other product or brand names may be trademarks or registered trademarks of their respective holders. Patents MathWorks products are protected by one or more U.S. patents. Please see www.mathworks.com/patents for more information.
Revision History November 2005 Online only December 2005 Online only March 2006 Online only September 2006 Online only March 2007 Online only September 2007 Online only March 2008 Online only Online only October 2008 March 2009 Online only September 2009 Online only March 2010 Online only September 2010 Online only April 2011 Online only September 2011 Online only March 2012 Online only September 2012 Online only March 2013 Online only September 2013 Online only Online only March 2014 Online only October 2014 March 2015 Online only September 2015 Online only March 2016 Online only September 2016 Online only March 2017 Online only September 2017 Online only Online only March 2018 New for Version 2.0 (Release 14SP3+) Revised for Version 2.0 (Release 14SP3+) Revised for Version 2.0.1 (Release 2006a) Revised for Version 3.0 (Release 2006b) Revised for Version 3.1 (Release 2007a) Revised for Version 3.2 (Release 2007b) Revised for Version 3.3 (Release 2008a) Revised for Version 4.0 (Release 2008b) Revised for Version 4.1 (Release 2009a) Revised for Version 4.2 (Release 2009b) Revised for Version 4.3 (Release 2010a) Revised for Version 5.0 (Release 2010b) Revised for Version 5.1 (Release 2011a) Revised for Version 5.2 (Release 2011b) Revised for Version 6.0 (Release 2012a) Revised for Version 6.1 (Release 2012b) Revised for Version 6.2 (Release 2013a) Revised for Version 6.3 (Release 2013b) Revised for Version 6.4 (Release 2014a) Revised for Version 6.5 (Release 2014b) Revised for Version 6.6 (Release 2015a) Revised for Version 6.7 (Release 2015b) Revised for Version 6.8 (Release 2016a) Revised for Version 6.9 (Release 2016b) Revised for Version 6.10 (Release 2017a) Revised for Version 6.11 (Release 2017b) Revised for Version 6.12 (Release 2018a)
1 2 Contents Introduction MATLAB Distributed Computing Server Product Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Key Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Product Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Parallel Computing Concepts . . . . . . . . . . . . . . . . . . . . . . . . . Determining Product Installation and Versions . . . . . . . . . . . . Toolbox and Server Components . . . . . . . . . . . . . . . . . . . . . . . . Schedulers, Workers, and Clients . . . . . . . . . . . . . . . . . . . . . . Third-Party Schedulers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Components on Mixed Platforms or Heterogeneous Clusters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . mdce Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Using Parallel Computing Toolbox Software . . . . . . . . . . . . . . . 1-2 1-2 1-3 1-3 1-4 1-5 1-5 1-7 1-8 1-8 1-9 Network Administration Prepare for Parallel Computing . . . . . . . . . . . . . . . . . . . . . . . . . Plan Your Network Layout . . . . . . . . . . . . . . . . . . . . . . . . . . . Network Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Fully Qualified Domain Names . . . . . . . . . . . . . . . . . . . . . . . . Security Considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Use Different MPI Builds on UNIX Systems . . . . . . . . . . . . . . . Build MPI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Use Your MPI Build . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-2 2-2 2-3 2-3 2-3 2-5 2-5 2-5 v
Shut Down a Job Manager Cluster . . . . . . . . . . . . . . . . . . . . . . . Linux and Macintosh Operating Systems . . . . . . . . . . . . . . . . Microsoft Windows Operating Systems . . . . . . . . . . . . . . . . . . Customize Startup Parameters . . . . . . . . . . . . . . . . . . . . . . . . . Define Script Defaults . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Override Script Defaults . . . . . . . . . . . . . . . . . . . . . . . . . . . . Access Service Record Files . . . . . . . . . . . . . . . . . . . . . . . . . . . Locate Log Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Locate Checkpoint Folders . . . . . . . . . . . . . . . . . . . . . . . . . . Set MJS Cluster Security . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Set the Security Level . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Local, MJS, and Network Passwords . . . . . . . . . . . . . . . . . . . Set Secure Communication . . . . . . . . . . . . . . . . . . . . . . . . . . Troubleshoot Common Problems . . . . . . . . . . . . . . . . . . . . . . . License Errors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Memory Errors on UNIX Operating Systems . . . . . . . . . . . . . Run Server Processes on Windows Network Installation . . . . Required Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ephemeral TCP Ports with Job Manager . . . . . . . . . . . . . . . . Host Communications Problems . . . . . . . . . . . . . . . . . . . . . . Verify Network Communications for Cluster Discovery . . . . . 2-8 2-8 2-9 2-11 2-11 2-13 2-15 2-15 2-15 2-17 2-17 2-19 2-20 2-22 2-22 2-24 2-24 2-24 2-25 2-25 2-26 3 Product Installation Install Products and Choose Cluster Configuration . . . . . . . . . Cluster Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Install Products . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Configure Your Cluster . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Configure for an MJS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Configure Cluster to Use a MATLAB Job Scheduler (MJS) . . . . Configure Windows Firewalls on Client . . . . . . . . . . . . . . . . . Configure Firewalls on Server . . . . . . . . . . . . . . . . . . . . . . . Validate Installation with MJS . . . . . . . . . . . . . . . . . . . . . . . . 3-2 3-2 3-3 3-4 3-5 3-5 3-21 3-21 3-22 vi Contents
Configure for HPC Pack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Configure Cluster for Microsoft HPC Pack . . . . . . . . . . . . . . Configure Client Computer for HPC Pack . . . . . . . . . . . . . . . Validate Installation Using Microsoft HPC Pack . . . . . . . . . . Configure for Slurm, PBS Pro, Platform LSF, TORQUE . . . . . Configure Platform LSF Scheduler on Windows Cluster . . . . Configure Windows Firewalls on Client . . . . . . . . . . . . . . . . . Validate Installation Using a Slurm, LSF, PBS Pro, or TORQUE Scheduler . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Configure for a Generic Scheduler . . . . . . . . . . . . . . . . . . . . . . Interfacing with Generic Schedulers . . . . . . . . . . . . . . . . . . . Creating a Generic Cluster Profile . . . . . . . . . . . . . . . . . . . . Special Configurations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Distribute a Generic Cluster Profile and Integration Scripts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Decide How Users Access the Integration Scripts . . . . . . . . . Shared IntegrationScriptsLocation Folder . . . . . . . . . . . . . . . Distribute Copies of the IntegrationScriptsLocation Folder . . Further Considerations for Clusters with Shared File Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Configure a Hadoop Cluster . . . . . . . . . . . . . . . . . . . . . . . . . . . Hadoop Version Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-26 3-26 3-27 3-28 3-32 3-32 3-34 3-35 3-38 3-38 3-39 3-46 3-48 3-48 3-48 3-49 3-50 3-51 3-52 4 Admin Center Start Admin Center . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Set Up Resources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Add Hosts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Start mdce Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Start an MJS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Start Workers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Stop, Destroy, Resume, Restart Processes . . . . . . . . . . . . . . . . Move a Worker . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Update the Display . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-2 4-3 4-3 4-4 4-5 4-7 4-8 4-8 4-9 vii
Test Connectivity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Export and Import Sessions . . . . . . . . . . . . . . . . . . . . . . . . . . . Prepare for Cluster Profiles . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-10 4-13 4-14 Control Scripts — Alphabetical List Glossary 5 viii Contents
分享到:
收藏