{"id":792,"date":"2020-11-09T10:45:55","date_gmt":"2020-11-09T09:45:55","guid":{"rendered":"http:\/\/calculs.univ-cotedazur.fr\/?page_id=792"},"modified":"2025-06-11T16:43:50","modified_gmt":"2025-06-11T14:43:50","slug":"display-the-current-utilization-of-resources","status":"publish","type":"page","link":"https:\/\/calculs.univ-cotedazur.fr\/?page_id=792&lang=en","title":{"rendered":"Display the current utilization of resources"},"content":{"rendered":"\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_11 counter-hierarchy counter-decimal ez-toc-grey\">\n<nav><ul class=\"ez-toc-list ez-toc-list-level-1\"><li class=\"ez-toc-page-1 ez-toc-heading-level-3\"><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/calculs.univ-cotedazur.fr\/?page_id=792&amp;lang=en#Idle_vs_allocated_resources\" title=\"Idle vs. allocated resources\">Idle vs. allocated resources<\/a><ul class=\"ez-toc-list-level-4\"><li class=\"ez-toc-heading-level-4\"><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/calculs.univ-cotedazur.fr\/?page_id=792&amp;lang=en#CPU_nodes\" title=\"CPU nodes\">CPU nodes<\/a><\/li><li class=\"ez-toc-page-1 ez-toc-heading-level-4\"><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/calculs.univ-cotedazur.fr\/?page_id=792&amp;lang=en#GPU_nodes\" title=\"GPU nodes\">GPU nodes<\/a><\/li><\/ul><\/li><li class=\"ez-toc-page-1 ez-toc-heading-level-3\"><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/calculs.univ-cotedazur.fr\/?page_id=792&amp;lang=en#Current_CPU_load_for_every_node\" title=\"Current CPU load for every node\">Current CPU load for every node<\/a><\/li><li class=\"ez-toc-page-1 ez-toc-heading-level-3\"><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/calculs.univ-cotedazur.fr\/?page_id=792&amp;lang=en#Nodes_information\" title=\"Nodes information\">Nodes information<\/a><\/li><\/ul><\/nav><\/div>\n<h3><span class=\"ez-toc-section\" id=\"Idle_vs_allocated_resources\"><\/span>Idle vs. allocated resources<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>To display the list of idle nodes:<\/p>\n\n\n\n<pre class=\"wp-block-verse\">sinfo --state=idle<\/pre>\n\n\n\n<h4><span class=\"ez-toc-section\" id=\"CPU_nodes\"><\/span>CPU nodes<span class=\"ez-toc-section-end\"><\/span><\/h4>\n\n\n\n<pre class=\"wp-block-verse\">sinfo --Format Partition,NodeList,NodeAI,CPUsState -p cpucourt,cpulong,smp,visu<\/pre>\n\n\n\n<p>A=allocated, I=idle, O=other, T=total.<\/p>\n\n\n\n<h4><span class=\"ez-toc-section\" id=\"GPU_nodes\"><\/span>GPU nodes<span class=\"ez-toc-section-end\"><\/span><\/h4>\n\n\n\n<pre class=\"wp-block-verse\">sinfo -NO \"CPUsState:30,Gres:30,GresUsed:30,NodeList:30\" -p gpu<\/pre>\n\n\n\n<p>Example:<\/p>\n\n\n\n<pre class=\"wp-block-verse\">[user@login-hpc ~]# sinfo -NO \"CPUsState:30,Gres:30,GresUsed:30,NodeList:30\" -p gpu\n CPUS(A\/I\/O\/T)           GRES                                 GRES_USED              NODELIST\n 0\/32\/0\/32          gpu:v100:4(S:0-1)            gpu:v100:0(IDX:N\/A),mic:0           gpu01\n 18\/14\/0\/32         gpu:v100:4(S:0-1)            gpu:v100:1(IDX:3),mic:0             gpu02\n 47\/5\/0\/52          gpu:a100:4(S:0-1)            gpu:a100:2(IDX:0-1),mic:0           gpu03<\/pre>\n\n\n\n<p>This shows one card is being used on node gpu02 which has 4 V100 cards. gpu01 is idle while 2 A100 GPU cards and 47 CPU cores are being used on gpu03. This means that if you want to use gpu03 for a job that requires 1 GPU card and 10 CPU cores, your job will be pending until at least 5 CPU cores are released.<\/p>\n\n\n\n<h3><span class=\"ez-toc-section\" id=\"Current_CPU_load_for_every_node\"><\/span>Current CPU load for every node<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<pre class=\"wp-block-verse\">sinfo --Format NodeHost,CPUsState,CPUsLoad -p cpucourt,cpulong,smp,gpu,visu<\/pre>\n\n\n\n<p>A=allocated, I=idle, O=other, T=total.<\/p>\n\n\n\n<p>The load is normal as long as it is equal or lower than the amount of allocated cores on the node. <\/p>\n\n\n\n<h3><span class=\"ez-toc-section\" id=\"Nodes_information\"><\/span>Nodes information<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p>Retrieve information about all the nodes and their current load: <\/p>\n\n\n\n<pre class=\"wp-block-verse\">scontrol show nodes<\/pre>\n\n\n\n<p>Information about a particular node (compute01):<\/p>\n\n\n\n<pre class=\"wp-block-verse\">scontrol show node compute01<\/pre>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Idle vs. allocated resources To display the list of idle nodes: sinfo &#8211;state=idle CPU nodes sinfo &#8211;Format Partition,NodeList,NodeAI,CPUsState -p cpucourt,cpulong,smp,visu A=allocated, I=idle, O=other, T=total. GPU nodes sinfo -NO \u00ab\u00a0CPUsState:30,Gres:30,GresUsed:30,NodeList:30\u00a0\u00bb -p gpu Example: [user@login-hpc ~]# sinfo -NO \u00ab\u00a0CPUsState:30,Gres:30,GresUsed:30,NodeList:30\u00a0\u00bb -p gpu CPUS(A\/I\/O\/T) &hellip; <\/p>\n","protected":false},"author":1,"featured_media":0,"parent":580,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":[],"_links":{"self":[{"href":"https:\/\/calculs.univ-cotedazur.fr\/index.php?rest_route=\/wp\/v2\/pages\/792"}],"collection":[{"href":"https:\/\/calculs.univ-cotedazur.fr\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/calculs.univ-cotedazur.fr\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/calculs.univ-cotedazur.fr\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/calculs.univ-cotedazur.fr\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=792"}],"version-history":[{"count":17,"href":"https:\/\/calculs.univ-cotedazur.fr\/index.php?rest_route=\/wp\/v2\/pages\/792\/revisions"}],"predecessor-version":[{"id":3072,"href":"https:\/\/calculs.univ-cotedazur.fr\/index.php?rest_route=\/wp\/v2\/pages\/792\/revisions\/3072"}],"up":[{"embeddable":true,"href":"https:\/\/calculs.univ-cotedazur.fr\/index.php?rest_route=\/wp\/v2\/pages\/580"}],"wp:attachment":[{"href":"https:\/\/calculs.univ-cotedazur.fr\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=792"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}