Overview

If a job fails, remains pending, or produces unexpected output, use the available logs, job details, and related files to identify the cause of the issue. Troubleshooting typically involves checking execution logs, verifying resource allocation, reviewing input data, and confirming that commands and configuration settings are correct.

Common Errors Encountered

1. Resource Allocation Errors: Insufficient memory or CPU allocation can cause jobs to fail.
2. File Access Problems: Missing input files or incorrect paths can lead to execution issues.
3. Timeout Errors: Jobs may exceed the allocated time limits.
4. Permission Denied Errors: Insufficient permissions on files or directories can prevent job execution.

Prerequisites

1. Access Job Logs
   To begin troubleshooting, you need to access the job logs, which provide detailed information about the job execution.
   • Go to EonKube > HPC > Volcano Jobs
   • In the job list right, click ⋮ > View Logs to check the process log.
2. Review Log Files
   Once you have accessed the logs, review them for any error messages or warnings.
   Look for:
   • Error messages that indicate what went wrong.
   • Warnings that might suggest potential issues.
   • Timestamps that can help correlate events in the job execution.
3. Identify and Analyze Errors

   Based on the log entries, identify the type of error encountered.

   • Resource Allocation Errors:
     • Check if the job requested more resources than available. Adjust resource parameters as needed.
   • File Access Problems:
     • Ensure that all input files are present in the specified directories. Verify file paths in your job command or script.
   • Timeout Errors:
     • If the job exceeds time limits, try optimizing the code or requesting more time in the job script.
   • Permission Denied Errors:
     • Check file and directory permissions. Ensure the job has the necessary access rights.
4. Modify Job Parameters
   After diagnosing the issue, modify the job parameters accordingly.
   • For Resource Allocation: Adjust memory and CPU settings in the job submission script.
   • For File Paths: Correct any incorrect paths in the input file declarations.
5. Re-run the Job
   Once adjustments are made, re-submit the job for execution.
   • Monitor the job status and logs again to ensure that the issues have been resolved.
6. Seek Further Assistance
   If issues persist after troubleshooting:
   • Consult documentation or user forums for the IEC platform.
   • Reach out to technical support for assistance.