Overview

In addition to submitting jobs through Marketplace applications, IEC allows users to run customized HPC workloads by preparing job definitions and executing them through the command line. This approach is suitable for advanced workflows that require custom commands, YAML-based job definitions, MPI execution, or direct control over scheduling behavior.

Customized jobs can be prepared and submitted in environments such as HPC Desktop, where users can access a terminal session and execute job-related commands directly.

The overall process is divided into three main steps:

1. Deploy MPI Desktop and prepare to execute scripts.
2. Connect to the Master Desktop via VNC.
3. Compile and execute Job Scripts in the terminal.

Procedure

Deploy MPI Desktop and prepare to execute scripts

1. Go to EonKube > Apps > Marketplace
2. Find the HPC Desktop application and click on it to enter the next page.
3. Click Submit in the upper right corner to enter the deployment setting page.
4. Configure Job Settings
   • Job Name: Enter the name of the task (e.g., mpi-test-job).
   • Namespace: Select the target namespace.
5. Click the Upload File button to open the File Explorer for external storage.
6. In the default path /home/user, perform the following actions:
   • Click New Folder to create a folder named mpi_test.
   • Enter the mpi_test folder.
   • Click New test file to create a file named my_mpi_app.c.
   • Similarly, create a file named job.sh.
7. Edit my_mpi_app.c by right-clicking and selecting the Edit file, then enter the following content and save.

   #include <mpi.h>
   #include <stdio.h>
   
   int main(int argc, char** argv) {
       int world_size, world_rank;
   
       MPI_Init(&argc, &argv);
       MPI_Comm_size(MPI_COMM_WORLD, &world_size);
       MPI_Comm_rank(MPI_COMM_WORLD, &world_rank);
   
       printf("Hello from process %d out of %d\n", world_rank, world_size);
   
       MPI_Finalize();
       return 0;
   }
       

8. Edit job.sh by right-clicking and selecting the Edit file, then enter the following content and save.

   #!/bin/bash
   # Specify the number of processors to use (e.g., 4)
   NUM_PROCS=4
   
   # Execute the MPI program
   mpirun -np $NUM_PROCS ./my_mpi_app

   • Click Save & Close to save file.
9. Close the File Explorer and return to the deployment page, then click the Create button to start the deployment.

Connecting to the HPC Desktop via VNC

1. Go to EonKube > HPC > Volcano Job
2. Find the Desktop you just deployed in the Job List, confirming that the Job Name matches what you specified earlier.
3. Click on the Console button for that Job.
4. Click on Open in Web VNC to open the VNC window.
5. Click the noVNC Full Client link on the page.
6. Click Connect and enter your username and password to log into the HPC Desktop UI. (Remember to add the cluster's DNS IP to your local DNS.)

Compiling and Executing the MPI Job Script

1. Open the terminal in the HPC Desktop UI.
2. Navigate to the directory you just created:

   cd /home/user/mpi_test

3. Load the MPI compilation module and compile the MPI program:

   mpicc -o my_mpi_app my_mpi_app.c

4. Grant execution permissions to the script and run it:

   chmod +x job.sh
   ./job.sh

5. Expected Output:

   Hello from process 0 out of 4
   Hello from process 1 out of 4
   Hello from process 2 out of 4
   Hello from process 3 out of 4