JH UniScheduler

https://www.jhinno.com/jhunischeduler.htm#/manual
Admin
JH UniScheduler is a general-purpose resource management and scheduling platform designed to...
Tokens:4,607
Snippets:85
Trust Score:5.8
Update:3 months ago
Show doc for...
Tokens:
Raw
### Start Job on Multiple Hosts

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use 'jctrl start -m' with a space-separated list of hostnames to run a pending job on multiple hosts.

```bash
jctrl start -m "hostname1 hostname2" jobID
```

--------------------------------

### Start Job on Single Host

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use 'jctrl start -m' to force a pending job to run on a specific host.

```bash
jctrl start -m hostname jobID
```

--------------------------------

### Initialize Cluster Master Node

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Initializes the master node for a new cluster. This is a setup operation for the cluster management.

```bash
jcluster init
```

--------------------------------

### Force Start Job

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use 'jctrl start -f' to allow a job to run without being suspended again by run-window or suspend conditions.

```bash
jctrl start -f -m host_name jobId | jobId[index]
```

--------------------------------

### Update Configuration Item

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use 'jconfig update' to modify specific configuration parameters in files such as jhds.conf or scheduler.conf. For example, update 'max_connections' or 'CLUSTER_NAME'.

```bash
# jconfig update jhds.conf max_connections=10
```

```bash
# jconfig update scheduler.conf CLUSTER_NAME='jhadmin user1'
```

--------------------------------

### Use Path Variables for Input, Output, Error, and Working Directory

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Demonstrates using environment variables or path specifications for input files, output files, error files, and the current working directory.

```bash
$ jsub -i /apps/dir_input/input.sh -o /apps/dir_output/output.log -e /apps/dir_output/error.log -cwd /apps/dir_output "hhh;sleep 10;hostname"
```

--------------------------------

### Join Node to Cluster

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Initializes a non-master node and integrates it into an existing cluster. Use this command on nodes that will join the cluster.

```bash
jcluster join
```

--------------------------------

### Request CPUs with Processors Per Tile Constraint

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Request a minimum number of CPUs and specify the maximum number of processors allowed per host using 'span[ptile=2]'.

```bash
$ jsub -n 4 -R "span[ptile=2]" my_job
```

--------------------------------

### Show Queue Information for Specific Host and User

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Displays queue information relevant to a particular host and user. Use '-m' for the host and '-u' for the user.

```bash
jqueues -m host1 -u user1
```

--------------------------------

### Display Host Static Resource Information

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Retrieves static resource information for hosts. Use the 'attrib' subcommand with optional '-l' or '-w' for format.

```bash
jhosts attrib -w host_name
```

--------------------------------

### Show Job Information for All Users

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Retrieves job information for all users and user groups in the cluster. Use the 'all' argument.

```bash
jusers all
```

--------------------------------

### Display All User Jobs in a Specific Queue

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Retrieves all jobs for any user within a particular queue. Use '-q' for the queue name, '-P' for the project, and '-u all' to include all users.

```bash
jjobs -q short -P my_project -u all
```

--------------------------------

### Dispatch Job by Resource Selection Rules

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Submit a job based on complex resource selection rules, such as specifying operating system type and memory requirements.

```bash
$ jsub -R "select[((type==NTX64 && mem > 50)||(type==LINUX64&& mem> 100))]" my_job
```

--------------------------------

### Show Hosts Satisfying Resource Requirements

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Lists hosts that meet specific resource criteria, such as memory availability. Use the '-R' flag with a resource requirement string.

```bash
jhosts -R "select[mem>600]"
```

--------------------------------

### Display Host Load Information

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Shows current load information for specified hosts. Use the 'stat' subcommand with optional '-l' or '-w' for format.

```bash
jhosts stat -l host_name
```

--------------------------------

### Request CPUs with Host Span Constraint

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Request a minimum number of CPUs and ensure they are all on a single host using the 'span[hosts=1]' resource requirement.

```bash
$ jsub -n 4 -R "span[hosts=1]" my_job
```

--------------------------------

### Set Configuration Item

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use 'jconfig set' to configure specific parameters like 'MASTER_CANDIDATES' or 'REDIS_PORT'. After setting, configuration changes may require restarting services.

```bash
$ jconfig set MASTER_CANDIDATES='host1 host2 host3' jadmin schedreconfig jadmin jhdsreconfig
```

```bash
$ jconfig set REDIS_PORT=9322 unischeduler stop all unischeduler start
```

--------------------------------

### Display Pending Jobs with Reasons

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Shows pending jobs for a specific user and their reasons. Use the '-p' flag for pending jobs and '-u' to specify the user.

```bash
jjobs -p -u user1
```

--------------------------------

### Display All Running Jobs on a Host

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Lists all currently running jobs on a specified host. The '-r' flag filters for running jobs, and '-m' specifies the host.

```bash
jjobs -r -m host1
```

--------------------------------

### Submit Job to Specific Host and Queue

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use 'jsub' to submit a job to a specified host and queue. This is a basic job submission command.

```bash
$ jsub -m host1 -q short my_job
```

--------------------------------

### Show Job Information for a Specific User

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Displays job-related information for a single user. Provide the user's name as an argument.

```bash
jusers user1
```

--------------------------------

### View Job Output

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use 'jctrl peek' to view execution output from a running job. Use -f to stream output in real time.

```bash
jctrl peek [-h] [-f] [-t [task_id]] jobId | jobId[index]
```

--------------------------------

### Show Host Status and Job Resource Information

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Displays detailed status and job resource information for a specific host. The '-l' flag requests long format output.

```bash
jhosts -l host1
```

--------------------------------

### Set Minimum and Maximum CPU Counts for a Job

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Specify a range for the number of processors for a job submission, from a minimum to a maximum count.

```bash
$ jsub -n 2,4 my_job
```

--------------------------------

### Reserve Memory and Swap Resources for a Job

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

When submitting a job, you can reserve specific amounts of memory and swap space using the -R option.

```bash
$ jsub -R "rusage[mem=50&swap=100]" my_job
```

--------------------------------

### List Editable Items in Configuration

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use 'jconfig list' to view configurable items in specified configuration files like jhds.conf. This command helps identify settings that can be modified.

```bash
# jconfig list jhds.conf
```

--------------------------------

### Set Host Preference Levels for Job Submission

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

When submitting a job, you can specify preference levels for candidate execution hosts or host groups. Higher numbers indicate higher preference.

```bash
$ jsub -m "host1+2 host2+1 host3" my_job
```

--------------------------------

### Transfer Files Between Submit and Execution Hosts

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use the '-f' option to transfer files or directories between the submission host and the execution host. The operator '>' transfers from submit to execute, and '<' transfers from execute to submit.

```bash
$ jsub -f '/files/abc.conf > abc.conf' -f '/tmp/ < test.conf' 'mv $JH_STAGE_DIR/abc.conf $JH_STAGE_DIR/test.conf'
```

--------------------------------

### Customize Job Output Format

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Allows custom formatting of job output, specifying fields, widths, and delimiters. Use the '-o' flag followed by the format string.

```bash
jjobs -o "jobid:4 stat:-10 from_host delimiter=';'"
```

--------------------------------

### Query Error Code Descriptions

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use 'jcode' to retrieve explanations for job error codes, GUI job error codes, or pending-reason error codes. Set 'LANG=zh_CN' to view Chinese descriptions.

```bash
export LANG=zh_CN $ jcode -e 10036
```

```bash
$ jcode -r 2001 2002 2006 2009
```

--------------------------------

### Requeue All Jobs

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use 'jctrl requeue -a' to requeue all jobs for all users.

```bash
jctrl requeue -a -u all 0
```

--------------------------------

### Redirect Job Output to a File

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Specify a file path using the '-o' option to save the standard output of the job. Environment variables can be used in the path.

```bash
$ jsub -o ~/output.sh my_job
```

--------------------------------

### Display Detailed Job Information

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Shows comprehensive details for a specific job ID. The '-l' flag requests long format output.

```bash
jjobs -l job_id
```

--------------------------------

### Resume Jobs

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use 'jctrl resume' to resume suspended jobs. Filter by user.

```bash
jctrl resume -u user1 0
```

--------------------------------

### Display JH UniScheduler Version

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Prints the release version information for JH UniScheduler. Use the '-V' flag to display the version.

```bash
jversion -V
```

--------------------------------

### Move Jobs to Top of Queue

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use 'jctrl top -p' to move pending jobs to a specific position from the top of the queue.

```bash
jctrl top -p 1 241 242 243
```

--------------------------------

### Move Jobs to Bottom of Queue

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use 'jctrl bot -p' to move pending jobs to a specific position from the bottom of the queue.

```bash
jctrl bot -p 2 241 243 242
```

--------------------------------

### Attach to Interactive Service-Mode Job

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use 'jattach' with a jobId to connect to an interactive job that was submitted with 'jsub -Is'. This allows re-connecting if the frontend terminal exits.

```bash
$ jsub -Is bash Job <13> is submitted to default queue <normal> and default application <default> <<Waiting for dispatch ...>> <<Starting on host1>> << To escape to local shell, press 'Ctrl + q'. The job will keep running at server side. >> << output from stdout >> $ jattach 13 Job <13> is running on host1 <<Waiting for attach ...>> <<Attaching on host1>> << output from stdout >>
```

--------------------------------

### Change Job Queue

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use the -q option to change the execution queue for a specific job. This command modifies the queue setting for the provided jobID.

```bash
jmod -q test1 jobID
```

--------------------------------

### Clean Completed Jobs

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use 'jctrl clean' to manually clean completed jobs. Filter by user.

```bash
jctrl clean -u user1 0
```

--------------------------------

### Clean Cluster Node

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Removes initialization data from a cluster node. Use this to reset a node's cluster status.

```bash
jcluster clean
```

--------------------------------

### Terminate Jobs

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use 'jctrl kill' to terminate jobs. Filter by queue and user.

```bash
jctrl kill -q short -u all 0
```

--------------------------------

### Prevent Job Scheduling on a Specific Host

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use the '~' prefix with the '-m' option to exclude a specific host from the list of candidate execution hosts.

```bash
$ jsub -m ~host1 my_job
```

--------------------------------

### Remove Failed Host Information

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Deletes information about a failed host from the cluster. Use the 'remove' subcommand followed by the host name(s).

```bash
jhosts remove failed_host1
```

--------------------------------

### Requeue Jobs in Specific States

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use 'jctrl requeue' with flags like -d, -e, -r, or -a to requeue jobs in DONE, EXIT, RUN, or all states respectively.

```bash
jctrl requeue [-h] [-u user_name | -u all] [-J job_name] [-d] [-e] [-r] [-a] [-H] 0 | jobId | jobId[index] ...
```

--------------------------------

### Add Runtime Limit

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Modify the runtime limit of a job by adding minutes or hours. The format can be in minutes (+50) or hours and minutes (+00:50).

```bash
jmod -W +50 jobID
```

```bash
jmod -W +00:50 jobID
```

--------------------------------

### Clear Job Queue

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use the -qn option to clear or reset the execution queue for a specific job. This command removes any previously set queue for the provided jobID.

```bash
jmod -qn jobID
```

--------------------------------

### Suspend Jobs

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Use 'jctrl stop' to suspend jobs. You can filter by queue and user.

```bash
jctrl stop -q short -u user1 0
```

--------------------------------

### Reduce Runtime Limit

Source: https://www.jhinno.com/jhunischeduler.htm#/manual

Modify the runtime limit of a job by subtracting hours. The format can be in total minutes (-120) or hours and minutes (-02:00).

```bash
jmod -W -120 jobID
```

```bash
jmod -W -02:00 jobID
```
Tokens:
Raw