Table of Contents
What is CMC CAD Compute Cluster?
The CAD Compute Cluster is a dedicated group of servers enabling researchers to improve the performance of large computational tasks. For a full description of the CMC Compute Cluster, go to https://www.cmc.ca/cad-compute-cluster/.
Who Can Use It?
A CMC account holder with a research subscription can use the CAD Compute Cluster.How to Use It?
You must create an instance of “CAD Compute Cluster”. Follow these steps:
- Go to https://vcad.cmc.ca.
- Select the tab Create My Instance, and then click Create Instance.
Connecting to Your Instance
Enter the command:
$ ssh -p port_number uwhpc.cmc.ca -l your_cmc_register_name
Initializing Your Environment in CMC CAD Compute Cluster
After you login to CMC CAD Compute Cluster Login Nodes, run a script to create SSH key pair and temporary space for you. It will allow you to submit job to the cluster and specify your simulation temporary space. Enter the following command:
To use temporary space for your simulation, for example:
If you run COMSOL simulation, please add “-tmpdir /scratch/$USER” to your command or scripts.
Note: Save your projects to your home directory, which is kept permanently. The home directory has disk quota of 50 GBs. When the usage approaches the quota limit, you need to backup the content to your local machine and clean the home directory.
To Complete a Design in CMC Cloud Design Environments and Transfer Files
- From https://vcad.cmc.ca, create an instance and name it My Linux CAD Workstation.
- If you project file is in your local system, you can use the command scp or sftp to copy it to the folder mydata in My Linux CAD Workstation.
- Once you complete the design, copy it to CMC CAD Compute Cluster by entering the following command:
$ scp -P 223 your_design_file_name firstname.lastname@example.org:~
To Complete a Design on Your Workstation and Transfer Files
Use Secure Copy (scp) or FileZilla (sftp) to upload your design and download simulation results. For instructions, see Uploading a Simulation File to the CAD Compute Cluster.
Connection information, i.e., host name and port number, are displayed in https://vcad.cmc.ca in Connection Method under Connect Using SSH for Linux & UNIX.
To Get and Open Your Simulation Results
Because CMC CAD Compute Cluster is batch-job-based (no GUI desktop), if you need GUI desktop, you have to use other systems(i.e., your own desktop or CMC cloud instance) to open your simulation results.You can transfer the results by following these steps.
Transferring Results to Your Desktop
Use any sftp client software (e.g., FileZilla, Windows 10 also has built-in scp command) installed in your desktop, and the connection information of your instance of “CAD Compute Cluster”. Figure 1 gives an example to use Windows 10 command scp to copy the simulation result file /home/xxxx/comsol/Output_148.out from CAD Compute Cluster to desktop:
Figure 1: Using scp to Copy a Simulation Result File
Transferring Results to Your CMC Cloud Instance
From your CMC Cloud Instance, i.e., “My Linux CAD Workstation (Centos 7)”, open a terminal from the instance, then run the command scp as example below:.
$ scp -P 223 email@example.com:/home/xxxx/comsol/Output_148.out .
For job scheduling, use the IBM Spectrum Load Sharing Facility (LSF) Suite for HPC.
To Submit a Job to Cluster
$ bsub -I “hostname; date”
Job <1627> is submitted to default queue .
Mon Aug 26 12:02:46 EDT 2019
To find out how much computer resources are available
HOST_NAME STATUS JL/U MAX NJOBS RUN SSUSP USUSP RSV
uwmhpc01 ok – 32 24 24 0 0 0
uwmhpc02 ok – 32 16 16 0 0 0
uwmhpc03 ok – 32 0 0 0 0 0
This output tells computer uwmhpc01 has 8 cores uwmhpc02 has 16 cores and uwmhpc03 has 32 cores available for job submission.
To Display and Filter LSF Job Information
$ bjobs 1627
JOBID USER STAT QUEUE FROM_HOST EXEC_HOST JOB_NAME SUBMIT_TIME
1627 v32925@ DONE adept login3 uwmhpc03 *ame; date Aug 26 12:02
To Displays Historical JSF Job Information
$ bhist 1627
Summary of time in seconds spent in various states:
JOBID USER JOB_NAME PEND PSUSP RUN USUSP SSUSP UNKWN TOTAL
1627 v32925@ *e; date 0 0 6 0 0 0 6
For more information about the LSF job scheduler, see Load Share Facility (LSF) Job Scheduler: Commands to set up your Environment.
CMC uses Environment Modules to set up system and environment for running CAD related tools.
To Check Available Modules
$ module available
To Load a Module
$ module load ansys/19.4
To Check Loaded Modules
$ module list
Currently loaded module files:
To Unload an Existing Module
$ module unload ansys/19.4
Supported CAD Tools
License usage agreements are available for review. For more information, contact at firstname.lastname@example.org.