TransWikia.com

Job Scheduler for Local Machine

Computational Science Asked by kskinnerx16 on October 3, 2021

I am used to running calculations on a server/cluster, and we have used both PBS and SLURM. However, I am looking to run some calculations on my local machine. I would like to be able to schedule my jobs so that they run more efficiently. Does such software exist for macOS? Ideally it would be free. Please let me know if you need any additional information, or if this question is more appropriate on another stack exchange.

2 Answers

Task spooler has worked great for me in the past. It does everything you requested.

Correct answer by Spencer Bryngelson on October 3, 2021

I would guess that it is possible to deploy PBS and SLURM on your local machine, but I'd personally say that's a bit overkill.

I tend to use simple bash scripts. You can then list the execution commands like a to-do list, it is possible to run multiple jobs in parallel, and place a wait signal for them to finish, before continuing down the list. You can also easily pipe the individual program outputs to output files. Chances are that your local machine has 4/8/16 cores, so the decision of how many jobs you want to start at the same time is not that hard.

example:

#!/bin/sh
echo "starting first batch of jobs"
job1 &> job1_output.txt &&
job2 &> job2_output.txt &&

wait
echo "first two jobs finished"

job3 &> job3_output.txt &&
job4 &> job4_output.txt &&

wait
echo "all jobs finished"

Answered by MPIchael on October 3, 2021

Add your own answers!

Ask a Question

Get help from others!

© 2024 TransWikia.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP