We have made some improvements to the Slurm scheduler on the Balena HPC service.\u00a0These changes will help free up resource for GPU jobs and provide more resources for jobs with short run times (<6 hours).<\/p>\n
The new Slurm partition (or job queue) is\u00a0called batch-short<\/b><\/em>\u00a0and can be used\u00a0for submitting jobs which will require 6hours or less. This partition will have more Ivybridge nodes available to run these short wall time jobs\u00a0across, which should help these jobs get through the batch system quicker.<\/p>\n The GPU and NVMe\u00a0accelerator nodes have been removed from the standard Ivybridge batch partitions, which will\u00a0prevent these accelerator\u00a0nodes from being used by long-running CPU-only workloads, thus blocking these nodes for those who need the GPUs. Jobs which will require\u00a0a GPU node (either NIVIDIA\u00a0k20x or P100) these should be submit directly to the batch-acc<\/em> partition with the appropriate SBATCH GPU\u00a0options\u00a0(see\u00a0HPC Wiki - Slurm scheduler<\/a>).\u00a0The GPU partition, batch-acc<\/em>, has been prioritised for jobs which require GPUs\u00a0over those which don't.<\/p>\n Any questions about this please contact hpc-support@bath.ac.uk.<\/p>\n","protected":false},"excerpt":{"rendered":" We have made some improvements to the Slurm scheduler on the Balena HPC service.\u00a0These changes will help free up resource for GPU jobs and provide more resources for jobs with short run times (<6 hours). The new Slurm partition (or...<\/p>\n","protected":false},"author":192,"featured_media":1530,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[3,5],"tags":[49,497,249,86,6,498,104,499],"class_list":["post-1529","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-arc","category-hpc","tag-balena","tag-batch-short","tag-gpu","tag-high-performance-computing","tag-hpc","tag-sbatch","tag-scheduler","tag-slum"],"acf":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/pd4PAv-oF","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/blogs.bath.ac.uk\/arc\/wp-json\/wp\/v2\/posts\/1529","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.bath.ac.uk\/arc\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.bath.ac.uk\/arc\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/arc\/wp-json\/wp\/v2\/users\/192"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/arc\/wp-json\/wp\/v2\/comments?post=1529"}],"version-history":[{"count":0,"href":"https:\/\/blogs.bath.ac.uk\/arc\/wp-json\/wp\/v2\/posts\/1529\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.bath.ac.uk\/arc\/wp-json\/wp\/v2\/media?parent=1529"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/arc\/wp-json\/wp\/v2\/categories?post=1529"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/arc\/wp-json\/wp\/v2\/tags?post=1529"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}