{"id":96971,"date":"2025-02-11T08:53:55","date_gmt":"2025-02-11T05:23:55","guid":{"rendered":"https:\/\/nabfollower.com\/blog\/%d9%86%d8%ad%d9%88%d9%87-%d8%ae%d8%af%d9%85%d8%aa-deepseek-r1-v3-%d8%af%d8%b1-gh200s-400-tok-sec-%d8%aa%d9%88%d8%a7%d9%86-%d8%8c-10-tok-sec-%d9%be%d8%b1%d8%b3-%d9%88-%d8%ac%d9%88\/"},"modified":"2025-02-11T08:53:55","modified_gmt":"2025-02-11T05:23:55","slug":"%d9%86%d8%ad%d9%88%d9%87-%d8%ae%d8%af%d9%85%d8%aa-deepseek-r1-v3-%d8%af%d8%b1-gh200s-400-tok-sec-%d8%aa%d9%88%d8%a7%d9%86-%d8%8c-10-tok-sec-%d9%be%d8%b1%d8%b3-%d9%88-%d8%ac%d9%88","status":"publish","type":"post","link":"https:\/\/nabfollower.com\/blog\/%d9%86%d8%ad%d9%88%d9%87-%d8%ae%d8%af%d9%85%d8%aa-deepseek-r1-v3-%d8%af%d8%b1-gh200s-400-tok-sec-%d8%aa%d9%88%d8%a7%d9%86-%d8%8c-10-tok-sec-%d9%be%d8%b1%d8%b3-%d9%88-%d8%ac%d9%88\/","title":{"rendered":"\u0646\u062d\u0648\u0647 \u062e\u062f\u0645\u062a Deepseek R1 &#038; V3 \u062f\u0631 GH200S (400 TOK\/SEC \u062a\u0648\u0627\u0646 \u060c 10 TOK\/SEC\/\u067e\u0631\u0633 \u0648 \u062c\u0648)"},"content":{"rendered":"<div data-article-id=\"2270478\" id=\"article-body\">\n<p>Lambda Labs \u0647\u0646\u0648\u0632 \u0647\u0645 \u062f\u0627\u0631\u0627\u06cc \u0646\u06cc\u0645\u0647 \u062e\u0627\u0645\u0648\u0634 (\u06cc\u0639\u0646\u06cc 1.50 \u062f\u0644\u0627\u0631) GH200 \u0628\u0647 \u0639\u0646\u0648\u0627\u0646 \u0627\u0631\u062a\u0642\u0627\u0621 \u0628\u0631\u0627\u06cc \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u0628\u06cc\u0634\u062a\u0631 \u0627\u0641\u0631\u0627\u062f \u0628\u0647 \u0627\u0628\u0632\u0627\u0631 \u0628\u0627\u0632\u0648 \u0627\u0633\u062a. \u0645\u0646 \u0642\u0628\u0644\u0627\u064b \u06cc\u06a9 \u0622\u0645\u0648\u0632\u0634 \u0628\u0631\u0627\u06cc \u0627\u062c\u0631\u0627\u06cc Llama 405b \u0646\u0648\u0634\u062a\u0645 \u060c \u0627\u0645\u0627 Deepseek R1 \u0628\u0647 \u0648\u0636\u0648\u062d \u06cc\u06a9 \u0645\u062f\u0644 \u0628\u0647\u062a\u0631 \u0627\u0633\u062a \u060c \u0628\u0646\u0627\u0628\u0631\u0627\u06cc\u0646 \u0628\u06cc\u0627\u06cc\u06cc\u062f \u0628\u0647 \u062c\u0627\u06cc \u0622\u0646 \u062e\u062f\u0645\u062a \u06a9\u0646\u06cc\u0645. \u062a\u0641\u0627\u0648\u062a \u0686\u0646\u062f \u062a\u0641\u0627\u0648\u062a \u0627\u0632 \u062e\u062f\u0645\u062a \u0628\u0647 \u0644\u0627\u0645\u0627 \u0648\u062c\u0648\u062f \u062f\u0627\u0631\u062f:<\/p>\n<ul>\n<li>\u0628\u0631\u0627\u06cc \u062f\u0627\u0634\u062a\u0646 \u062a\u0648\u0627\u0646 \u0645\u0646\u0627\u0633\u0628 \u0628\u0647 12 \u06cc\u0627 16 GPU \u0646\u06cc\u0627\u0632 \u062f\u0627\u0631\u06cc\u062f. \u0627\u06af\u0631 \u0628\u0647 \u062a\u0648\u0627\u0646 \u0632\u06cc\u0627\u062f\u06cc \u0627\u062d\u062a\u06cc\u0627\u062c \u0646\u062f\u0627\u0631\u06cc\u062f \u060c \u0647\u0646\u0648\u0632 \u0647\u0645 \u0645\u06cc \u062a\u0648\u0627\u0646\u06cc\u062f \u0627\u0632 8 \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u06a9\u0646\u06cc\u062f.<\/li>\n<li>VLLM \u062f\u0631 \u062d\u0627\u0644 \u062d\u0627\u0636\u0631 \u0628\u0647\u062a\u0631 \u0627\u0632 \u0622\u0641\u0631\u0648\u062f\u06cc\u062a \u0628\u0631\u0627\u06cc Deepseek \u06a9\u0627\u0631 \u0645\u06cc \u06a9\u0646\u062f. \u062f\u0631 \u0648\u0627\u0642\u0639 \u0622\u0646\u0647\u0627 \u0628\u0647 \u062a\u0627\u0632\u06af\u06cc \u0628\u0647 \u0631\u0648\u0632\u0631\u0633\u0627\u0646\u06cc \u0631\u0627 \u0645\u0646\u062a\u0634\u0631 \u06a9\u0631\u062f\u0646\u062f \u06a9\u0647 \u0627\u0633\u062a\u0646\u062a\u0627\u062c Deepseek \u0631\u0627 \u06a9\u0645\u06cc \u0633\u0631\u06cc\u0639\u062a\u0631 \u0645\u06cc \u06a9\u0646\u062f. \u062a\u0642\u0631\u06cc\u0628\u0627\u064b 40 \u066a \u0628\u0647\u0628\u0648\u062f \u062a\u0648\u0627\u0646.\n<ul>\n<li>\u0628\u0647 \u0637\u0648\u0631 \u0645\u0639\u0645\u0648\u0644 \u06cc\u06a9 \u062e\u0648\u0634\u0647 GPU 16x 1x \u0628\u0631\u0627\u06cc \u0627\u0633\u062a\u0646\u062a\u0627\u062c \u0628\u0633\u06cc\u0627\u0631 \u06a9\u0646\u062f \u062e\u0648\u0627\u0647\u062f \u0628\u0648\u062f \u0627\u0645\u0627 \u0628\u0647 \u062f\u0644\u0627\u06cc\u0644\u06cc \u0627\u06cc\u0646 \u062f\u0631 \u0648\u0627\u0642\u0639 \u0628\u0633\u06cc\u0627\u0631 \u062e\u0648\u0628 \u06a9\u0627\u0631 \u0645\u06cc \u06a9\u0646\u062f.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>\u0631\u0627\u0647\u0646\u0645\u0627 \u062f\u0631 \u0645\u0648\u0631\u062f repo github \u0628\u0647 \u0631\u0648\u0632 \u0645\u06cc \u0634\u0648\u062f.<\/p>\n<p>\u0641\u06cc\u0644\u0645 \u0646\u0634\u0627\u0646 \u0645\u06cc \u062f\u0647\u062f \u0633\u0631\u0639\u062a \u0627\u0633\u062a\u0646\u0628\u0627\u0637 \u0628\u0627 64 \u0646\u0645\u0627\u06cc\u0634 \u062f\u0627\u062f\u0647 \u0645\u0648\u0627\u0632\u06cc. \u0627\u06cc\u0646 \u06cc\u06a9 \u0628\u0627\u0631 \u062f\u0631 \u0647\u0631 \u062b\u0627\u0646\u06cc\u0647 \u0686\u0627\u067e \u0645\u06cc \u0634\u0648\u062f \u0648 \u0647\u0631 \u0628\u0627\u0631 \u06a9\u0647 \u0686\u0627\u067e \u0645\u06cc \u0634\u0648\u062f \u062d\u062f\u0627\u0642\u0644 5 \u06a9\u0644\u0645\u0647 \u062c\u062f\u06cc\u062f \u062f\u0631\u06cc\u0627\u0641\u062a \u0645\u06cc \u06a9\u0646\u06cc\u062f:<\/p>\n<p>https:\/\/github.com\/user-attachments\/assets\/5c27abe9-9168-4f6a-88aa-8ffa22c348b1<\/p>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_85 counter-hierarchy ez-toc-counter-rtl ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">\u0641\u0647\u0631\u0633\u062a \u0645\u0637\u0627\u0644\u0628<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/nabfollower.com\/blog\/%d9%86%d8%ad%d9%88%d9%87-%d8%ae%d8%af%d9%85%d8%aa-deepseek-r1-v3-%d8%af%d8%b1-gh200s-400-tok-sec-%d8%aa%d9%88%d8%a7%d9%86-%d8%8c-10-tok-sec-%d9%be%d8%b1%d8%b3-%d9%88-%d8%ac%d9%88\/#%D9%85%D9%88%D8%A7%D8%B1%D8%AF_%D8%A7%DB%8C%D8%AC%D8%A7%D8%AF_%DA%A9%D9%86%DB%8C%D8%AF\" >\u0645\u0648\u0627\u0631\u062f \u0627\u06cc\u062c\u0627\u062f \u06a9\u0646\u06cc\u062f<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/nabfollower.com\/blog\/%d9%86%d8%ad%d9%88%d9%87-%d8%ae%d8%af%d9%85%d8%aa-deepseek-r1-v3-%d8%af%d8%b1-gh200s-400-tok-sec-%d8%aa%d9%88%d8%a7%d9%86-%d8%8c-10-tok-sec-%d9%be%d8%b1%d8%b3-%d9%88-%d8%ac%d9%88\/#%DB%8C%D8%A7%D8%B1%D8%A7%D9%86_%D8%A7%D8%AA%D8%B5%D8%A7%D9%84_SSH_%D9%81%D9%84%D9%87\" >\u06cc\u0627\u0631\u0627\u0646 \u0627\u062a\u0635\u0627\u0644 SSH \u0641\u0644\u0647<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/nabfollower.com\/blog\/%d9%86%d8%ad%d9%88%d9%87-%d8%ae%d8%af%d9%85%d8%aa-deepseek-r1-v3-%d8%af%d8%b1-gh200s-400-tok-sec-%d8%aa%d9%88%d8%a7%d9%86-%d8%8c-10-tok-sec-%d9%be%d8%b1%d8%b3-%d9%88-%d8%ac%d9%88\/#NFS_Cache_%D8%B1%D8%A7_%D8%AA%D9%86%D8%B8%DB%8C%D9%85_%DA%A9%D9%86%DB%8C%D8%AF\" >NFS Cache \u0631\u0627 \u062a\u0646\u0638\u06cc\u0645 \u06a9\u0646\u06cc\u062f<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/nabfollower.com\/blog\/%d9%86%d8%ad%d9%88%d9%87-%d8%ae%d8%af%d9%85%d8%aa-deepseek-r1-v3-%d8%af%d8%b1-gh200s-400-tok-sec-%d8%aa%d9%88%d8%a7%d9%86-%d8%8c-10-tok-sec-%d9%be%d8%b1%d8%b3-%d9%88-%d8%ac%d9%88\/#%D9%BE%DB%8C%D8%AA%D9%88%D9%86_311_%D8%B1%D8%A7_%D9%86%D8%B5%D8%A8_%DA%A9%D9%86%DB%8C%D8%AF\" >\u067e\u06cc\u062a\u0648\u0646 3.11 \u0631\u0627 \u0646\u0635\u0628 \u06a9\u0646\u06cc\u062f<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/nabfollower.com\/blog\/%d9%86%d8%ad%d9%88%d9%87-%d8%ae%d8%af%d9%85%d8%aa-deepseek-r1-v3-%d8%af%d8%b1-gh200s-400-tok-sec-%d8%aa%d9%88%d8%a7%d9%86-%d8%8c-10-tok-sec-%d9%be%d8%b1%d8%b3-%d9%88-%d8%ac%d9%88\/#VirtualEnv_%D8%A7%DB%8C%D8%AC%D8%A7%D8%AF_%DA%A9%D9%86%DB%8C%D8%AF\" >VirtualEnv \u0627\u06cc\u062c\u0627\u062f \u06a9\u0646\u06cc\u062f<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/nabfollower.com\/blog\/%d9%86%d8%ad%d9%88%d9%87-%d8%ae%d8%af%d9%85%d8%aa-deepseek-r1-v3-%d8%af%d8%b1-gh200s-400-tok-sec-%d8%aa%d9%88%d8%a7%d9%86-%d8%8c-10-tok-sec-%d9%be%d8%b1%d8%b3-%d9%88-%d8%ac%d9%88\/#%D9%85%D8%AF%D9%84_%D9%87%D8%A7%DB%8C_%D8%A8%D8%A7%D8%B1%DA%AF%DB%8C%D8%B1%DB%8C\" >\u0645\u062f\u0644 \u0647\u0627\u06cc \u0628\u0627\u0631\u06af\u06cc\u0631\u06cc<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/nabfollower.com\/blog\/%d9%86%d8%ad%d9%88%d9%87-%d8%ae%d8%af%d9%85%d8%aa-deepseek-r1-v3-%d8%af%d8%b1-gh200s-400-tok-sec-%d8%aa%d9%88%d8%a7%d9%86-%d8%8c-10-tok-sec-%d9%be%d8%b1%d8%b3-%d9%88-%d8%ac%d9%88\/#%D9%86%D8%B5%D8%A8_VLLM\" >\u0646\u0635\u0628 VLLM<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/nabfollower.com\/blog\/%d9%86%d8%ad%d9%88%d9%87-%d8%ae%d8%af%d9%85%d8%aa-deepseek-r1-v3-%d8%af%d8%b1-gh200s-400-tok-sec-%d8%aa%d9%88%d8%a7%d9%86-%d8%8c-10-tok-sec-%d9%be%d8%b1%d8%b3-%d9%88-%d8%ac%d9%88\/#%D9%87%D9%85%D9%87_%DA%86%DB%8C%D8%B2_%D8%B1%D8%A7_%D8%A7%D8%B2_%DA%86%D8%B1%D8%AE_%D9%87%D8%A7_%D9%86%D8%B5%D8%A8_%DA%A9%D9%86%DB%8C%D8%AF\" >\u0647\u0645\u0647 \u0686\u06cc\u0632 \u0631\u0627 \u0627\u0632 \u0686\u0631\u062e \u0647\u0627 \u0646\u0635\u0628 \u06a9\u0646\u06cc\u062f<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/nabfollower.com\/blog\/%d9%86%d8%ad%d9%88%d9%87-%d8%ae%d8%af%d9%85%d8%aa-deepseek-r1-v3-%d8%af%d8%b1-gh200s-400-tok-sec-%d8%aa%d9%88%d8%a7%d9%86-%d8%8c-10-tok-sec-%d9%be%d8%b1%d8%b3-%d9%88-%d8%ac%d9%88\/#%D8%AA%D8%B1%DB%8C%D8%AA%D9%88%D9%86_%D8%A7%D8%B2_%D9%85%D9%86%D8%A8%D8%B9\" >\u062a\u0631\u06cc\u062a\u0648\u0646 \u0627\u0632 \u0645\u0646\u0628\u0639<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/nabfollower.com\/blog\/%d9%86%d8%ad%d9%88%d9%87-%d8%ae%d8%af%d9%85%d8%aa-deepseek-r1-v3-%d8%af%d8%b1-gh200s-400-tok-sec-%d8%aa%d9%88%d8%a7%d9%86-%d8%8c-10-tok-sec-%d9%be%d8%b1%d8%b3-%d9%88-%d8%ac%d9%88\/#VLLM_%D8%A7%D8%B2_%D9%85%D9%86%D8%A8%D8%B9\" >VLLM \u0627\u0632 \u0645\u0646\u0628\u0639<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/nabfollower.com\/blog\/%d9%86%d8%ad%d9%88%d9%87-%d8%ae%d8%af%d9%85%d8%aa-deepseek-r1-v3-%d8%af%d8%b1-gh200s-400-tok-sec-%d8%aa%d9%88%d8%a7%d9%86-%d8%8c-10-tok-sec-%d9%be%d8%b1%d8%b3-%d9%88-%d8%ac%d9%88\/#%D9%86%D8%B5%D8%A8_%D8%B1%D8%A7_%D8%A8%D8%B1%D8%B1%D8%B3%DB%8C_%DA%A9%D9%86%DB%8C%D8%AF\" >\u0646\u0635\u0628 \u0631\u0627 \u0628\u0631\u0631\u0633\u06cc \u06a9\u0646\u06cc\u062f<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/nabfollower.com\/blog\/%d9%86%d8%ad%d9%88%d9%87-%d8%ae%d8%af%d9%85%d8%aa-deepseek-r1-v3-%d8%af%d8%b1-gh200s-400-tok-sec-%d8%aa%d9%88%d8%a7%d9%86-%d8%8c-10-tok-sec-%d9%be%d8%b1%d8%b3-%d9%88-%d8%ac%d9%88\/#%D8%AE%D8%AF%D9%85%D8%AA_%DA%A9%D9%86%DB%8C%D8%AF\" >\u062e\u062f\u0645\u062a \u06a9\u0646\u06cc\u062f!<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-13\" href=\"https:\/\/nabfollower.com\/blog\/%d9%86%d8%ad%d9%88%d9%87-%d8%ae%d8%af%d9%85%d8%aa-deepseek-r1-v3-%d8%af%d8%b1-gh200s-400-tok-sec-%d8%aa%d9%88%d8%a7%d9%86-%d8%8c-10-tok-sec-%d9%be%d8%b1%d8%b3-%d9%88-%d8%ac%d9%88\/#%D8%AA%D8%B3%D8%AA_%D8%A8%D8%A7%D8%B1\" >\u062a\u0633\u062a \u0628\u0627\u0631<\/a><\/li><\/ul><\/nav><\/div>\n<h2><span class=\"ez-toc-section\" id=\"%D9%85%D9%88%D8%A7%D8%B1%D8%AF_%D8%A7%DB%8C%D8%AC%D8%A7%D8%AF_%DA%A9%D9%86%DB%8C%D8%AF\"><\/span>\n<p>  \u0645\u0648\u0627\u0631\u062f \u0627\u06cc\u062c\u0627\u062f \u06a9\u0646\u06cc\u062f<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u0627\u06cc\u0646 \u0628\u0627\u0631 \u0628\u0647 \u062c\u0627\u06cc \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u0627\u0632 \u0648\u0628 \u0633\u0627\u06cc\u062a \u060c \u0627\u062c\u0627\u0632\u0647 \u062f\u0647\u06cc\u062f \u0627\u0632 API \u0628\u0631\u0627\u06cc \u062a\u0647\u06cc\u0647 \u0646\u0645\u0648\u0646\u0647 \u0647\u0627 \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u06a9\u0646\u06cc\u0645.<\/p>\n<p>\u06cc\u06a9 \u0633\u06cc\u0633\u062a\u0645 \u0641\u0627\u06cc\u0644 \u0628\u0647 \u0646\u0627\u0645 &#8220;\u0628\u0647 \u0627\u0634\u062a\u0631\u0627\u06a9 \u06af\u0630\u0627\u0634\u062a\u0647 \u0634\u062f\u0647&#8221; \u062f\u0631 \u0648\u0627\u0634\u0646\u06af\u062a\u0646 \u060c \u062f\u06cc \u0633\u06cc \u0627\u06cc\u062c\u0627\u062f \u06a9\u0646\u06cc\u062f \u0648 \u0646\u0627\u0645 \u06a9\u0644\u06cc\u062f SSH \u062e\u0648\u062f \u0631\u0627 \u0628\u0646\u0648\u06cc\u0633\u06cc\u062f. \u0647\u0645\u0686\u0646\u06cc\u0646 \u06cc\u06a9 \u06a9\u0644\u06cc\u062f API \u0627\u06cc\u062c\u0627\u062f \u06a9\u0631\u062f\u0647 \u0648 \u0622\u0646 \u0631\u0627 \u0630\u062e\u06cc\u0631\u0647 \u06a9\u0646\u06cc\u062f.<\/p>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight shell\"><code><span class=\"nb\">export <\/span><span class=\"nv\">sshkey_name<\/span><span class=\"o\">=<\/span>my-key\n<span class=\"nb\">export <\/span><span class=\"nv\">shared_fs_name<\/span><span class=\"o\">=<\/span>shared\n<span class=\"nb\">export <\/span><span class=\"nv\">LAMBDA_API_KEY<\/span><span class=\"o\">=<\/span><span class=\"s2\">\"...\"<\/span>\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<p>\u0627\u06cc\u0646 \u0627\u0633\u06a9\u0631\u06cc\u067e\u062a 16 \u0646\u0645\u0648\u0646\u0647 GH200 \u0631\u0627 \u0627\u06cc\u062c\u0627\u062f \u0645\u06cc \u06a9\u0646\u062f. \u062e\u0637\u0627\u0647\u0627\u06cc \u0645\u062d\u062f\u0648\u062f\u06cc\u062a \u0646\u0631\u062e \u0631\u0627 \u0646\u0627\u062f\u06cc\u062f\u0647 \u0628\u06af\u06cc\u0631\u06cc\u062f \u060c \u062a\u0627 \u0632\u0645\u0627\u0646\u06cc \u06a9\u0647 16 \u0633\u0627\u062e\u062a\u0647 \u0634\u0648\u062f \u060c \u062f\u0648\u0628\u0627\u0631\u0647 \u0633\u0639\u06cc \u0645\u06cc \u0634\u0648\u062f.<\/p>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight shell\"><code><span class=\"k\">function <\/span>lambda-api <span class=\"o\">{<\/span>\n    <span class=\"nb\">local <\/span><span class=\"nv\">method<\/span><span class=\"o\">=<\/span><span class=\"nv\">$1<\/span>\n    <span class=\"nb\">local <\/span><span class=\"nv\">route<\/span><span class=\"o\">=<\/span><span class=\"nv\">$2<\/span>\n    <span class=\"nb\">shift <\/span>2\n    curl <span class=\"nt\">--fail<\/span> <span class=\"nt\">-q<\/span> <span class=\"nt\">-X<\/span> <span class=\"s2\">\"<\/span><span class=\"nv\">$method<\/span><span class=\"s2\">\"<\/span> <span class=\"se\">\\<\/span>\n        <span class=\"nt\">-H<\/span> <span class=\"s2\">\"Authorization: Bearer <\/span><span class=\"nv\">$LAMBDA_API_KEY<\/span><span class=\"s2\">\"<\/span> <span class=\"se\">\\<\/span>\n        <span class=\"s2\">\"https:\/\/cloud.lambdalabs.com\/api\/v1\/<\/span><span class=\"nv\">$route<\/span><span class=\"s2\">\"<\/span> <span class=\"se\">\\<\/span>\n        <span class=\"nt\">-H<\/span> <span class=\"s2\">\"Content-Type: application\/json\"<\/span> <span class=\"se\">\\<\/span>\n        <span class=\"s2\">\"<\/span><span class=\"nv\">$@<\/span><span class=\"s2\">\"<\/span>\n<span class=\"o\">}<\/span>\n<span class=\"nb\">export<\/span> <span class=\"nt\">-f<\/span> lambda-api\n\n<span class=\"nv\">num_want<\/span><span class=\"o\">=<\/span>16\n<span class=\"nv\">num_got<\/span><span class=\"o\">=<\/span>0\n<span class=\"k\">while<\/span> <span class=\"o\">[[<\/span> <span class=\"nv\">$num_got<\/span> <span class=\"nt\">-lt<\/span> <span class=\"nv\">$num_want<\/span> <span class=\"o\">]]<\/span><span class=\"p\">;<\/span> <span class=\"k\">do\n    <\/span>lambda-api POST instance-operations\/launch <span class=\"nt\">-d<\/span> <span class=\"s1\">'{\n        \"region_name\": \"us-east-3\",\n        \"instance_type_name\": \"gpu_1x_gh200\",\n        \"sshkey_names\": [\"'<\/span><span class=\"nv\">$sshkey_name<\/span><span class=\"s1\">'\"],\n        \"file_system_names\": [\"'<\/span><span class=\"nv\">$shared_fs_name<\/span><span class=\"s1\">'\"],\n        \"quantity\": 1,\n        \"name\": \"node_'<\/span><span class=\"nv\">$num_got<\/span><span class=\"s1\">'\"\n    }'<\/span> <span class=\"o\">&amp;&amp;<\/span> <span class=\"o\">((<\/span>num_got++<span class=\"o\">))<\/span>\n    <span class=\"nb\">echo <\/span><span class=\"nv\">num_got<\/span><span class=\"o\">=<\/span><span class=\"nv\">$num_got<\/span>\n    <span class=\"nb\">sleep <\/span>3\n<span class=\"k\">done<\/span>\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<p>\u067e\u0633 \u0627\u0632 \u0627\u06cc\u062c\u0627\u062f \u0647\u0645\u0647 \u0645\u0648\u0627\u0631\u062f \u060c \u062a\u0645\u0627\u0645 \u0622\u062f\u0631\u0633 \u0647\u0627\u06cc IP \u0631\u0627 \u0627\u0632 \u0635\u0641\u062d\u0647 \u0645\u0648\u0627\u0631\u062f \u06a9\u067e\u06cc \u06a9\u0631\u062f\u0647 \u0648 \u0622\u0646 \u0631\u0627 \u0630\u062e\u06cc\u0631\u0647 \u06a9\u0646\u06cc\u062f <code>~\/ips.txt<\/code>\u0628\u0634\u0631<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/media2.dev.to\/dynamic\/image\/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto\/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2F6okkog8mutobdjc7aopv.png\" alt=\"\u0634\u0631\u062d \u062a\u0635\u0648\u06cc\u0631\" loading=\"lazy\" width=\"800\" height=\"447\" title=\"\"><\/p>\n<h2><span class=\"ez-toc-section\" id=\"%DB%8C%D8%A7%D8%B1%D8%A7%D9%86_%D8%A7%D8%AA%D8%B5%D8%A7%D9%84_SSH_%D9%81%D9%84%D9%87\"><\/span>\n<p>  \u06cc\u0627\u0631\u0627\u0646 \u0627\u062a\u0635\u0627\u0644 SSH \u0641\u0644\u0647<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u0645\u0646 Bash &#038; SSH \u0631\u0627 \u0628\u06cc\u0634 \u0627\u0632 \u0647\u0631 \u0686\u06cc\u0632 \u0641\u0627\u0646\u062a\u0632\u06cc \u0645\u0627\u0646\u0646\u062f Kubernetes \u06cc\u0627 Slurm \u062a\u0631\u062c\u06cc\u062d \u0645\u06cc \u062f\u0647\u0645. \u0627\u06cc\u0646 \u0628\u0627 \u0628\u0631\u062e\u06cc \u0627\u0632 \u06cc\u0627\u0631\u0627\u0646 \u0642\u0627\u0628\u0644 \u06a9\u0646\u062a\u0631\u0644 \u0627\u0633\u062a.<\/p>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight shell\"><code><span class=\"c\"># save all the ssh fingerprints now to skip confirmation later<\/span>\n<span class=\"k\">for <\/span>ip <span class=\"k\">in<\/span> <span class=\"si\">$(<\/span><span class=\"nb\">cat<\/span> ~\/ips.txt<span class=\"si\">)<\/span><span class=\"p\">;<\/span> <span class=\"k\">do\n    <\/span><span class=\"nb\">echo<\/span> <span class=\"s2\">\"doing <\/span><span class=\"nv\">$ip<\/span><span class=\"s2\">\"<\/span>\n    ssh-keyscan <span class=\"nv\">$ip<\/span> <span class=\"o\">&gt;&gt;<\/span> ~\/.ssh\/known_hosts\n<span class=\"k\">done\n\n<\/span><span class=\"nb\">export <\/span><span class=\"nv\">runprefix<\/span><span class=\"o\">=<\/span><span class=\"s2\">\"\"<\/span>\n<span class=\"k\">function <\/span>runip<span class=\"o\">()<\/span> <span class=\"o\">{<\/span>\n    ssh <span class=\"nt\">-i<\/span> ~\/.ssh\/lambda_id_ed25519 ubuntu@<span class=\"nv\">$ip<\/span> <span class=\"nt\">--<\/span> <span class=\"nb\">stdbuf<\/span> <span class=\"nt\">-oL<\/span> <span class=\"nt\">-eL<\/span> bash <span class=\"nt\">-l<\/span> <span class=\"nt\">-c<\/span> <span class=\"s2\">\"<\/span><span class=\"si\">$(<\/span><span class=\"nb\">printf<\/span> <span class=\"s2\">\"%q\"<\/span> <span class=\"s2\">\"<\/span><span class=\"nv\">$runprefix<\/span><span class=\"s2\">\"\"<\/span><span class=\"nv\">$*<\/span><span class=\"s2\">\"<\/span><span class=\"si\">)<\/span><span class=\"s2\">\"<\/span> &lt; \/dev\/null\n<span class=\"o\">}<\/span>\n<span class=\"k\">function <\/span>runk<span class=\"o\">()<\/span> <span class=\"o\">{<\/span> <span class=\"nv\">ip<\/span><span class=\"o\">=<\/span><span class=\"si\">$(<\/span><span class=\"nb\">sed<\/span> <span class=\"nt\">-n<\/span> <span class=\"s2\">\"<\/span><span class=\"k\">$((<\/span>k <span class=\"o\">+<\/span> <span class=\"m\">1<\/span><span class=\"k\">))<\/span><span class=\"s2\">\"<\/span>p ~\/ips.txt<span class=\"si\">)<\/span> runip <span class=\"s2\">\"<\/span><span class=\"nv\">$@<\/span><span class=\"s2\">\"<\/span><span class=\"p\">;<\/span> <span class=\"o\">}<\/span>\n<span class=\"k\">function <\/span>runhead<span class=\"o\">()<\/span> <span class=\"o\">{<\/span> <span class=\"nv\">ip<\/span><span class=\"o\">=<\/span><span class=\"s2\">\"<\/span><span class=\"si\">$(<\/span><span class=\"nb\">head<\/span> <span class=\"nt\">-n1<\/span> ~\/ips.txt<span class=\"si\">)<\/span><span class=\"s2\">\"<\/span> runip <span class=\"s2\">\"<\/span><span class=\"nv\">$@<\/span><span class=\"s2\">\"<\/span><span class=\"p\">;<\/span> <span class=\"o\">}<\/span>\n<span class=\"k\">function <\/span>runips<span class=\"o\">()<\/span> <span class=\"o\">{<\/span>\n    <span class=\"nb\">local <\/span><span class=\"nv\">pids<\/span><span class=\"o\">=()<\/span>\n    <span class=\"k\">for <\/span>ip <span class=\"k\">in<\/span> <span class=\"nv\">$ips<\/span><span class=\"p\">;<\/span> <span class=\"k\">do\n        <\/span><span class=\"nv\">ip<\/span><span class=\"o\">=<\/span><span class=\"nv\">$ip<\/span> runip <span class=\"s2\">\"<\/span><span class=\"nv\">$@<\/span><span class=\"s2\">\"<\/span> |&amp; <span class=\"nb\">sed<\/span> <span class=\"s2\">\"s\/^\/<\/span><span class=\"nv\">$ip<\/span><span class=\"se\">\\t<\/span><span class=\"s2\"> \/\"<\/span> &amp;\n        pids+<span class=\"o\">=(<\/span><span class=\"nv\">$!<\/span><span class=\"o\">)<\/span>\n    <span class=\"k\">done\n    <\/span><span class=\"nb\">wait<\/span> <span class=\"s2\">\"<\/span><span class=\"k\">${<\/span><span class=\"nv\">pids<\/span><span class=\"p\">[@]<\/span><span class=\"k\">}<\/span><span class=\"s2\">\"<\/span> &amp;&gt;\/dev\/null\n<span class=\"o\">}<\/span>\n<span class=\"k\">function <\/span>runall<span class=\"o\">()<\/span> <span class=\"o\">{<\/span> <span class=\"nv\">ips<\/span><span class=\"o\">=<\/span><span class=\"s2\">\"<\/span><span class=\"si\">$(<\/span><span class=\"nb\">cat<\/span> ~\/ips.txt<span class=\"si\">)<\/span><span class=\"s2\">\"<\/span> runips <span class=\"s2\">\"<\/span><span class=\"nv\">$@<\/span><span class=\"s2\">\"<\/span><span class=\"p\">;<\/span> <span class=\"o\">}<\/span>\n<span class=\"k\">function <\/span>runrest<span class=\"o\">()<\/span> <span class=\"o\">{<\/span> <span class=\"nv\">ips<\/span><span class=\"o\">=<\/span><span class=\"s2\">\"<\/span><span class=\"si\">$(<\/span><span class=\"nb\">tail<\/span> <span class=\"nt\">-n<\/span>+2 ~\/ips.txt<span class=\"si\">)<\/span><span class=\"s2\">\"<\/span> runips <span class=\"s2\">\"<\/span><span class=\"nv\">$@<\/span><span class=\"s2\">\"<\/span><span class=\"p\">;<\/span> <span class=\"o\">}<\/span>\n\n<span class=\"k\">function <\/span>sshk<span class=\"o\">()<\/span> <span class=\"o\">{<\/span>\n    <span class=\"nv\">ip<\/span><span class=\"o\">=<\/span><span class=\"si\">$(<\/span><span class=\"nb\">sed<\/span> <span class=\"nt\">-n<\/span> <span class=\"s2\">\"<\/span><span class=\"k\">$((<\/span>k <span class=\"o\">+<\/span> <span class=\"m\">1<\/span><span class=\"k\">))<\/span><span class=\"s2\">\"<\/span>p ~\/ips.txt<span class=\"si\">)<\/span>\n    ssh <span class=\"nt\">-i<\/span> ~\/.ssh\/lambda_id_ed25519 ubuntu@<span class=\"nv\">$ip<\/span>\n<span class=\"o\">}<\/span>\n<span class=\"nb\">alias <\/span><span class=\"nv\">ssh_head<\/span><span class=\"o\">=<\/span><span class=\"s1\">'k=0 sshk'<\/span>\n\n<span class=\"k\">function <\/span>killall<span class=\"o\">()<\/span> <span class=\"o\">{<\/span>\n    pkill <span class=\"nt\">-ife<\/span> 192.222\n<span class=\"o\">}<\/span>\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<p>\u0628\u06cc\u0627\u06cc\u06cc\u062f \u0628\u0631\u0631\u0633\u06cc \u06a9\u0646\u06cc\u0645 \u06a9\u0647 \u06a9\u0627\u0631 \u0645\u06cc \u06a9\u0646\u062f<\/p>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight shell\"><code>runall <span class=\"nb\">echo <\/span>ok\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<h2><span class=\"ez-toc-section\" id=\"NFS_Cache_%D8%B1%D8%A7_%D8%AA%D9%86%D8%B8%DB%8C%D9%85_%DA%A9%D9%86%DB%8C%D8%AF\"><\/span>\n<p>  NFS Cache \u0631\u0627 \u062a\u0646\u0638\u06cc\u0645 \u06a9\u0646\u06cc\u062f<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u0645\u0627 \u0645\u062d\u06cc\u0637 \u067e\u0627\u06cc\u062a\u0648\u0646 \u0631\u0627 \u062f\u0631 NFS \u0642\u0631\u0627\u0631 \u062e\u0648\u0627\u0647\u06cc\u0645 \u062f\u0627\u062f. \u0627\u06af\u0631 \u0622\u0646 \u0631\u0627 \u0630\u062e\u06cc\u0631\u0647 \u06a9\u0646\u06cc\u0645 \u060c \u0628\u0633\u06cc\u0627\u0631 \u0633\u0631\u06cc\u0639\u062a\u0631 \u0628\u0627\u0631\u06af\u06cc\u0631\u06cc \u0645\u06cc \u0634\u0648\u062f.<\/p>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight shell\"><code><span class=\"c\"># First, check the NFS works.<\/span>\n<span class=\"c\"># runall ln -s my_other_fs_name shared<\/span>\nrunhead <span class=\"s1\">'echo world &gt; shared\/hello'<\/span>\nrunall <span class=\"nb\">cat <\/span>shared\/hello\n\n\n<span class=\"c\"># Install and enable cachefilesd<\/span>\nrunall <span class=\"nb\">sudo <\/span>apt-get update\nrunall <span class=\"nb\">sudo <\/span>apt-get <span class=\"nb\">install<\/span> <span class=\"nt\">-y<\/span> cachefilesd\nrunall <span class=\"s2\">\"echo '\nRUN=yes\nCACHE_TAG=mycache\nCACHE_BACKEND=Path=\/var\/cache\/fscache\nCACHEFS_RECLAIM=0\n' | sudo tee -a \/etc\/default\/cachefilesd\"<\/span>\nrunall <span class=\"nb\">sudo <\/span>systemctl restart cachefilesd\nrunall <span class=\"s1\">'sudo journalctl -u cachefilesd | tail -n2'<\/span>\n\n<span class=\"c\"># Set the \"fsc\" option on the NFS mount<\/span>\nrunhead <span class=\"nb\">cat<\/span> \/etc\/fstab <span class=\"c\"># should have mount to ~\/shared<\/span>\nrunall <span class=\"nb\">cp<\/span> \/etc\/fstab etc-fstab-bak.txt\nrunall <span class=\"nb\">sudo sed<\/span> <span class=\"nt\">-i<\/span> <span class=\"s1\">'s\/,proto=tcp,\/,proto=tcp,fsc,\/g'<\/span> \/etc\/fstab\nrunall <span class=\"nb\">cat<\/span> \/etc\/fstab\n\n<span class=\"c\"># Remount<\/span>\nrunall <span class=\"nb\">sudo <\/span>umount \/home\/ubuntu\/shared\nrunall <span class=\"nb\">sudo <\/span>mount \/home\/ubuntu\/shared\nrunall <span class=\"nb\">cat<\/span> \/proc\/fs\/nfsfs\/volumes <span class=\"c\"># FSC column should say \"yes\"<\/span>\n\n<span class=\"c\"># Test cache speedup<\/span>\nrunhead <span class=\"nb\">dd <\/span><span class=\"k\">if<\/span><span class=\"o\">=<\/span>\/dev\/urandom <span class=\"nv\">of<\/span><span class=\"o\">=<\/span>shared\/bigfile <span class=\"nv\">bs<\/span><span class=\"o\">=<\/span>1M <span class=\"nv\">count<\/span><span class=\"o\">=<\/span>8192\nrunall <span class=\"nb\">dd <\/span><span class=\"k\">if<\/span><span class=\"o\">=<\/span>shared\/bigfile <span class=\"nv\">of<\/span><span class=\"o\">=<\/span>\/dev\/null <span class=\"nv\">bs<\/span><span class=\"o\">=<\/span>1M <span class=\"c\"># First one takes 8 seconds<\/span>\nrunall <span class=\"nb\">dd <\/span><span class=\"k\">if<\/span><span class=\"o\">=<\/span>shared\/bigfile <span class=\"nv\">of<\/span><span class=\"o\">=<\/span>\/dev\/null <span class=\"nv\">bs<\/span><span class=\"o\">=<\/span>1M <span class=\"c\"># Seond takes 0.6 seconds<\/span>\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<h2><span class=\"ez-toc-section\" id=\"%D9%BE%DB%8C%D8%AA%D9%88%D9%86_311_%D8%B1%D8%A7_%D9%86%D8%B5%D8%A8_%DA%A9%D9%86%DB%8C%D8%AF\"><\/span>\n<p>  \u067e\u06cc\u062a\u0648\u0646 3.11 \u0631\u0627 \u0646\u0635\u0628 \u06a9\u0646\u06cc\u062f<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u0645\u0646 \u0628\u0627 \u0627\u0648 \u0634\u0627\u0646\u0633 \u0628\u0647\u062a\u0631\u06cc \u062f\u0627\u0634\u062a\u0645 <code>apt<\/code> \u0628\u0633\u062a\u0647 \u0647\u0627 \u0627\u0632 <code>conda<\/code> \u0622\u0646\u0647\u0627\u06cc\u06cc \u060c \u0628\u0646\u0627\u0628\u0631\u0627\u06cc\u0646 \u0645\u0646 \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u062e\u0648\u0627\u0647\u0645 \u06a9\u0631\u062f <code>apt<\/code> \u062f\u0631 \u0627\u06cc\u0646 \u0622\u0645\u0648\u0632\u0634<\/p>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight shell\"><code>runall <span class=\"nb\">sudo <\/span>add-apt-repository ppa:deadsnakes\/ppa <span class=\"nt\">-y<\/span>\nrunall <span class=\"nb\">sudo <\/span>apt-get <span class=\"nb\">install<\/span> <span class=\"nt\">-y<\/span> <span class=\"se\">\\<\/span>\n    python3.11 python3.11-dev python3.11-venv python3.11-distutils\nrunall python3.11 <span class=\"nt\">--version<\/span>\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<h2><span class=\"ez-toc-section\" id=\"VirtualEnv_%D8%A7%DB%8C%D8%AC%D8%A7%D8%AF_%DA%A9%D9%86%DB%8C%D8%AF\"><\/span>\n<p>  VirtualEnv \u0627\u06cc\u062c\u0627\u062f \u06a9\u0646\u06cc\u062f<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u0628\u0647 \u062c\u0627\u06cc \u0627\u06cc\u0646\u06a9\u0647 \u0628\u0627 \u062f\u0642\u062a \u062f\u0642\u06cc\u0642\u0627\u064b \u0647\u0645\u0627\u0646 \u062f\u0633\u062a\u0648\u0631\u0627\u062a \u0631\u0627 \u062f\u0631 \u0647\u0631 \u062f\u0633\u062a\u06af\u0627\u0647 \u0627\u0646\u062c\u0627\u0645 \u062f\u0647\u06cc\u0645 \u060c \u0645\u06cc \u062a\u0648\u0627\u0646\u06cc\u0645 \u0627\u0632 \u06cc\u06a9 \u0645\u062d\u06cc\u0637 \u0645\u062c\u0627\u0632\u06cc \u062f\u0631 NFS \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u06a9\u0646\u06cc\u0645 \u0648 \u0641\u0642\u0637 \u0622\u0646 \u0631\u0627 \u0628\u0627 \u06af\u0631\u0647 \u0633\u0631 \u06a9\u0646\u062a\u0631\u0644 \u06a9\u0646\u06cc\u0645. \u0627\u06cc\u0646 \u0627\u0645\u0631 \u0627\u0635\u0644\u0627\u062d \u0627\u0634\u062a\u0628\u0627\u0647\u0627\u062a \u0631\u0627 \u0628\u0633\u06cc\u0627\u0631 \u0633\u0627\u062f\u0647 \u062a\u0631 \u0645\u06cc \u06a9\u0646\u062f.<\/p>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight shell\"><code>runhead python3.11 <span class=\"nt\">-m<\/span> venv <span class=\"nt\">--copies<\/span> shared\/myvenv\nrunhead <span class=\"s1\">'source shared\/myvenv\/bin\/activate; which python'<\/span>\n<span class=\"nb\">export <\/span><span class=\"nv\">runprefix<\/span><span class=\"o\">=<\/span><span class=\"s1\">'source shared\/myvenv\/bin\/activate ; '<\/span> <span class=\"c\"># this is used by runip()<\/span>\nrunall which python\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<h2><span class=\"ez-toc-section\" id=\"%D9%85%D8%AF%D9%84_%D9%87%D8%A7%DB%8C_%D8%A8%D8%A7%D8%B1%DA%AF%DB%8C%D8%B1%DB%8C\"><\/span>\n<p>  \u0645\u062f\u0644 \u0647\u0627\u06cc \u0628\u0627\u0631\u06af\u06cc\u0631\u06cc<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u0645\u0646 \u0648\u0642\u062a\u06cc \u0627\u0632 \u06a9\u0627\u0631\u06af\u0631\u0627\u0646 \u0628\u06cc\u0634\u062a\u0631\u06cc \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u06a9\u0631\u062f\u0645 \u060c \u0628\u0647 \u0646\u0648\u0639\u06cc \u0645\u0633\u0626\u0644\u0647 \u0634\u0628\u06a9\u0647 \u0633\u0627\u0632\u06cc \u0631\u0633\u06cc\u062f\u0645 \u060c \u0627\u0645\u0627 \u0634\u0645\u0627 \u0645\u06cc \u062a\u0648\u0627\u0646\u06cc\u062f R1 \u0648 V3 \u0631\u0627 \u062f\u0631 \u062d\u062f\u0648\u062f 20 \u062f\u0642\u06cc\u0642\u0647 \u0627\u0632 \u0627\u06cc\u0646 \u0637\u0631\u06cc\u0642 \u0628\u0627\u0631\u06af\u06cc\u0631\u06cc \u06a9\u0646\u06cc\u062f. \u062f\u0631 \u062d\u0627\u0644\u06cc \u06a9\u0647 \u0645\u0631\u062d\u0644\u0647 \u0628\u0639\u062f\u06cc \u0631\u0627 \u062f\u0631 \u06cc\u06a9 \u062a\u0631\u0645\u06cc\u0646\u0627\u0644 \u062c\u062f\u0627\u06af\u0627\u0646\u0647 \u0627\u0646\u062c\u0627\u0645 \u0645\u06cc \u062f\u0647\u06cc\u062f \u060c \u0645\u06cc \u062a\u0648\u0627\u0646\u06cc\u062f \u0627\u06cc\u0646 \u06a9\u0627\u0631 \u0631\u0627 \u062f\u0631 \u067e\u0633 \u0632\u0645\u06cc\u0646\u0647 \u0627\u062c\u0631\u0627 \u06a9\u0646\u06cc\u062f. \u0645\u0646 \u0641\u06a9\u0631 \u0645\u06cc \u06a9\u0646\u0645 \u0627\u06af\u0631 \u0627\u0632 \u06cc\u06a9 \u0646\u0634\u0627\u0646\u0647 Huggingface \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u0645\u06cc \u06a9\u0646\u06cc\u062f \u060c \u0628\u0627\u0631\u06af\u06cc\u0631\u06cc \u0633\u0631\u06cc\u0639\u062a\u0631 \u0645\u06cc \u06a9\u0646\u06cc\u062f.<\/p>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight shell\"><code>runhead <span class=\"s2\">\"pip install hf_transfer 'huggingface_hub[hf_transfer]'\"<\/span>\nrunall <span class=\"s2\">\"huggingface-cli login --token ...\"<\/span>\nrunall <span class=\"s2\">\"export HF_HUB_ENABLE_HF_TRANSFER=1\n    huggingface-cli download --max-workers=1 --local-dir ~\/dsr1 deepseek-ai\/DeepSeek-R1\n    huggingface-cli download --max-workers=1 --local-dir ~\/dsv3 deepseek-ai\/DeepSeek-V3\"<\/span>\n<span class=\"c\"># if you need to restart:<\/span>\npkill <span class=\"nt\">-ife<\/span> 192.222\nrunall pkill <span class=\"nt\">-ife<\/span> hugg\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<p>\u0645\u0646 \u0686\u0646\u062f \u0633\u0627\u0639\u062a \u0631\u0627 \u0635\u0631\u0641 \u0646\u0648\u0634\u062a\u0646 \u06cc\u06a9 \u0627\u0633\u06a9\u0631\u06cc\u067e\u062a \u06a9\u0631\u062f\u0645 \u062a\u0627 \u0647\u0631 \u0633\u0631\u0648\u0631 \u0628\u062e\u0634\u06cc \u0627\u0632 \u0645\u062f\u0644 \u0631\u0627 \u0628\u0627\u0631\u06af\u06cc\u0631\u06cc \u06a9\u0646\u062f \u060c \u0633\u067e\u0633 \u0622\u0646 \u0631\u0627 \u0628\u06cc\u0646 \u0647\u0645\u0647 \u0633\u0631\u0648\u0631\u0647\u0627 \u0647\u0645\u06af\u0627\u0645 \u0633\u0627\u0632\u06cc \u06a9\u0646\u0645 \u060c \u0627\u0645\u0627 \u062f\u0631 \u0648\u0627\u0642\u0639 \u062e\u06cc\u0644\u06cc \u0633\u0631\u06cc\u0639\u062a\u0631 \u0646\u0628\u0648\u062f. \u0641\u0642\u0637 \u0645\u0633\u062a\u0642\u06cc\u0645\u0627\u064b \u0627\u0632 HF \u0628\u0627\u0631\u06af\u06cc\u0631\u06cc \u06a9\u0646\u06cc\u062f.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"%D9%86%D8%B5%D8%A8_VLLM\"><\/span>\n<p>  \u0646\u0635\u0628 VLLM<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u062f\u0631 \u0635\u0648\u0631\u062a \u062a\u0645\u0627\u06cc\u0644 \u0645\u06cc \u062a\u0648\u0627\u0646\u06cc\u062f \u0627\u0632 \u0645\u0646\u0628\u0639 \u0628\u0633\u0627\u0632\u06cc\u062f \u06cc\u0627 \u0627\u0632 \u0686\u0631\u062e \u0647\u0627\u06cc \u0645\u0646 \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u06a9\u0646\u06cc\u062f. \u062f\u0631 \u0647\u0631 \u0635\u0648\u0631\u062a \u0627\u0628\u062a\u062f\u0627 \u0628\u0647 Pytorch \u0646\u06cc\u0627\u0632 \u062f\u0627\u0631\u06cc\u062f:<\/p>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight shell\"><code>runhead <span class=\"s2\">\"pip install --force-reinstall <\/span><span class=\"se\">\\<\/span><span class=\"s2\">\n    'numpy&lt;2' torch==2.5.1 torchvision <\/span><span class=\"se\">\\<\/span><span class=\"s2\">\n    --index-url 'https:\/\/download.pytorch.org\/whl\/cu124'\"<\/span>\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<h3><span class=\"ez-toc-section\" id=\"%D9%87%D9%85%D9%87_%DA%86%DB%8C%D8%B2_%D8%B1%D8%A7_%D8%A7%D8%B2_%DA%86%D8%B1%D8%AE_%D9%87%D8%A7_%D9%86%D8%B5%D8%A8_%DA%A9%D9%86%DB%8C%D8%AF\"><\/span>\n<p>  \u0647\u0645\u0647 \u0686\u06cc\u0632 \u0631\u0627 \u0627\u0632 \u0686\u0631\u062e \u0647\u0627 \u0646\u0635\u0628 \u06a9\u0646\u06cc\u062f<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight shell\"><code>pip <span class=\"nb\">install<\/span> <span class=\"nt\">-v<\/span> <span class=\"s1\">'https:\/\/github.com\/qpwo\/deepseek-gh200-tutorial\/releases\/download\/v0\/triton-3.1.0-cp311-cp311-linux_aarch64.whl'<\/span>\npip <span class=\"nb\">install<\/span> <span class=\"nt\">-v<\/span> <span class=\"s1\">'https:\/\/github.com\/qpwo\/deepseek-gh200-tutorial\/releases\/download\/v0\/vllm-0.7.2+cu124-cp311-cp311-linux_aarch64.whl'<\/span>\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<h3><span class=\"ez-toc-section\" id=\"%D8%AA%D8%B1%DB%8C%D8%AA%D9%88%D9%86_%D8%A7%D8%B2_%D9%85%D9%86%D8%A8%D8%B9\"><\/span>\n<p>  \u062a\u0631\u06cc\u062a\u0648\u0646 \u0627\u0632 \u0645\u0646\u0628\u0639<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>\u0648\u0642\u062a \u062e\u0648\u062f \u0631\u0627 \u0628\u0631\u0627\u06cc \u067e\u06cc\u06a9\u0631\u0628\u0646\u062f\u06cc \u0633\u0627\u062e\u062a\u0647\u0627\u06cc \u0645\u0648\u0627\u0632\u06cc \u062a\u0644\u0641 \u0646\u06a9\u0646\u06cc\u062f \u060c \u067e\u06cc\u0634 \u0641\u0631\u0636 \u0647\u0627\u06cc \u0646\u06cc\u0646\u062c\u0627 \u0627\u0633\u0627\u0633\u0627\u064b \u0628\u0647\u06cc\u0646\u0647 \u0647\u0633\u062a\u0646\u062f.<\/p>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight shell\"><code>runhead git clone https:\/\/github.com\/triton-lang\/triton.git ~\/git\/triton\nrunhead <span class=\"s2\">\"cd ~\/git\/triton &amp;&amp; git checkout release\/3.1.x\"<\/span>\n<span class=\"c\"># about 5 minutes:<\/span>\nrunhead <span class=\"s2\">\"cd ~\/git\/triton &amp;&amp; python -m build --no-isolation --wheel --verbose .\/python\"<\/span>\nrunhead <span class=\"s2\">\"cd ~\/git\/triton &amp;&amp; pip install -v python\/dist\/*.whl\"<\/span>\n\n<span class=\"c\"># It's a good idea to save the wheel for next time.<\/span>\nscp <span class=\"nt\">-i<\/span> ~\/.ssh\/lambda_id_ed25519 ubuntu@<span class=\"si\">$(<\/span><span class=\"nb\">head<\/span> <span class=\"nt\">-n1<\/span> ~\/ips.txt<span class=\"si\">)<\/span>:\/home\/ubuntu\/git\/triton\/python\/dist\/<span class=\"k\">*<\/span>.whl ~\/Downloads\/\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<h3><span class=\"ez-toc-section\" id=\"VLLM_%D8%A7%D8%B2_%D9%85%D9%86%D8%A8%D8%B9\"><\/span>\n<p>  VLLM \u0627\u0632 \u0645\u0646\u0628\u0639<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight shell\"><code>runhead pip <span class=\"nb\">install <\/span>ninja setuptools build setuptools_scm wheel bindings build cmake\nrunhead git clone https:\/\/github.com\/vllm-project\/vllm ~\/git\/vllm\nrunhead <span class=\"s1\">'cd ~\/git\/vllm &amp;&amp; git checkout v0.7.2'<\/span>\n<span class=\"c\"># this will take about 20 minutes:<\/span>\nrunhead <span class=\"s1\">'cd ~\/git\/vllm &amp;&amp; python -m build --no-isolation --wheel --verbose .'<\/span>\nrunhead <span class=\"s1\">'pip install -v ~\/git\/vllm\/dist\/*.whl'<\/span>\n<span class=\"c\"># ((You may have to run torch install command again))<\/span>\n\n<span class=\"c\"># save the wheel for next time:<\/span>\nscp <span class=\"nt\">-i<\/span> ~\/.ssh\/lambda_id_ed25519 ubuntu@<span class=\"si\">$(<\/span><span class=\"nb\">head<\/span> <span class=\"nt\">-n1<\/span> ~\/ips.txt<span class=\"si\">)<\/span>:\/home\/ubuntu\/git\/vllm\/dist\/<span class=\"k\">*<\/span>.whl ~\/Downloads\/\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<h3><span class=\"ez-toc-section\" id=\"%D9%86%D8%B5%D8%A8_%D8%B1%D8%A7_%D8%A8%D8%B1%D8%B1%D8%B3%DB%8C_%DA%A9%D9%86%DB%8C%D8%AF\"><\/span>\n<p>  \u0646\u0635\u0628 \u0631\u0627 \u0628\u0631\u0631\u0633\u06cc \u06a9\u0646\u06cc\u062f<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight shell\"><code>runall <span class=\"s2\">\"python -c 'import triton; print(<\/span><span class=\"se\">\\\"<\/span><span class=\"s2\">triton ok<\/span><span class=\"se\">\\\"<\/span><span class=\"s2\">)'\"<\/span>\nrunall <span class=\"s2\">\"python -c 'import torch; print(torch.tensor(2).cuda() + 2)'\"<\/span>\nrunall <span class=\"s2\">\"vllm --help | tail -n1\"<\/span> <span class=\"c\"># slow first time, fast second time<\/span>\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<h2><span class=\"ez-toc-section\" id=\"%D8%AE%D8%AF%D9%85%D8%AA_%DA%A9%D9%86%DB%8C%D8%AF\"><\/span>\n<p>  \u062e\u062f\u0645\u062a \u06a9\u0646\u06cc\u062f!<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u06af\u0631\u0647 \u0647\u0627 \u0628\u0627 \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u0627\u0632 Ray \u0627\u0631\u062a\u0628\u0627\u0637 \u0628\u0631\u0642\u0631\u0627\u0631 \u0645\u06cc \u06a9\u0646\u0646\u062f \u060c \u0628\u0646\u0627\u0628\u0631\u0627\u06cc\u0646 \u0627\u0628\u062a\u062f\u0627 \u06cc\u06a9 \u062e\u0648\u0634\u0647 \u0627\u0634\u0639\u0647 \u0631\u0627 \u0634\u0631\u0648\u0639 \u062e\u0648\u0627\u0647\u06cc\u0645 \u06a9\u0631\u062f.<\/p>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight shell\"><code>runall <span class=\"s2\">\"ray stop; ray stop; pkill -ife py\"<\/span>\nrunall <span class=\"s1\">'nvidia-smi --query-gpu=index,power.draw,memory.used,memory.free --format=csv,noheader'<\/span>\n<span class=\"c\"># This will give you the private\/LAN IP address you use to connect the other nodes:<\/span>\nrunhead ray start <span class=\"nt\">--head<\/span>\n<span class=\"c\"># Use the output from above:<\/span>\nrunrest ray start <span class=\"nt\">--address<\/span><span class=\"o\">=<\/span><span class=\"s1\">'...'<\/span>\nrunall <span class=\"s2\">\"ray status | grep GPU\"<\/span> <span class=\"c\"># should see \"0.0\/16.0 GPU\" 16 times<\/span>\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<p>\u0648 \u0627\u06a9\u0646\u0648\u0646 \u0645\u06cc \u062a\u0648\u0627\u0646\u06cc\u0645 VLLM \u0631\u0627 \u0622\u062a\u0634 \u0628\u0632\u0646\u06cc\u0645. \u0627\u0648\u0644\u06cc\u0646 \u0627\u062c\u0631\u0627\u06cc \u0628\u0627\u0639\u062b \u0645\u06cc \u0634\u0648\u062f \u0648\u0632\u0646\u0647 \u0647\u0627 \u062f\u0631 RAM \u0630\u062e\u06cc\u0631\u0647 \u0634\u0648\u0646\u062f \u060c \u0628\u0646\u0627\u0628\u0631\u0627\u06cc\u0646 \u0628\u0627\u0631 \u062f\u0648\u0645 \u06a9\u0647 VLLM \u0631\u0627 \u0634\u0631\u0648\u0639 \u0645\u06cc \u06a9\u0646\u06cc\u062f \u0633\u0631\u06cc\u0639\u062a\u0631 \u062e\u0648\u0627\u0647\u062f \u0628\u0648\u062f.<\/p>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight shell\"><code><span class=\"c\"># 2-8 minutes to start:<\/span>\n<span class=\"nv\">model<\/span><span class=\"o\">=<\/span>dsr1\n<span class=\"c\"># model=dsv3<\/span>\nrunhead <span class=\"s2\">\"vllm serve ~\/<\/span><span class=\"nv\">$model<\/span><span class=\"s2\"> <\/span><span class=\"se\">\\<\/span><span class=\"s2\">\n    --api-key asdf1234 <\/span><span class=\"se\">\\<\/span><span class=\"s2\">\n    --served-model-name <\/span><span class=\"nv\">$model<\/span><span class=\"s2\"> <\/span><span class=\"se\">\\<\/span><span class=\"s2\">\n    --trust-remote-code <\/span><span class=\"se\">\\<\/span><span class=\"s2\">\n    --pipeline-parallel-size=4 <\/span><span class=\"se\">\\<\/span><span class=\"s2\">\n    --tensor-parallel-size=4 <\/span><span class=\"se\">\\<\/span><span class=\"s2\">\n    --enable-prefix-caching <\/span><span class=\"se\">\\<\/span><span class=\"s2\">\n    --uvicorn-log-level=info <\/span><span class=\"se\">\\<\/span><span class=\"s2\">\n    --max-num-seqs=64 <\/span><span class=\"se\">\\<\/span><span class=\"s2\">\n    --max-model-len=8000\"<\/span>\n<span class=\"c\"># wait until you see:<\/span>\n<span class=\"c\"># INFO:     Uvicorn running on http:\/\/0.0.0.0:8000 (Press CTRL+C to quit)<\/span>\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<h2><span class=\"ez-toc-section\" id=\"%D8%AA%D8%B3%D8%AA_%D8%A8%D8%A7%D8%B1\"><\/span>\n<p>  \u062a\u0633\u062a \u0628\u0627\u0631<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u0645\u0646 \u06cc\u06a9 \u0645\u0648\u0631\u062f \u0645\u0631\u0648\u0631\u06af\u0631 \u06a9\u0648\u0686\u06a9 \u062f\u0631\u0633\u062a \u06a9\u0631\u062f\u0645 \u06a9\u0647 \u0645\u06cc \u062a\u0648\u0627\u0646\u06cc\u062f \u0633\u0631\u0648\u0631 \u0631\u0627 \u062a\u0633\u062a \u06a9\u0646\u06cc\u062f. \u0646\u062d\u0648\u0647 \u0627\u062c\u0631\u0627\u06cc \u0622\u0646:<\/p>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight shell\"><code>ssh <span class=\"se\">\\<\/span>\n    <span class=\"nt\">-L<\/span> 1234:localhost:1234 <span class=\"se\">\\<\/span>\n    <span class=\"nt\">-L<\/span> 8000:localhost:8000 <span class=\"se\">\\<\/span>\n    <span class=\"nt\">-L<\/span> 8265:localhost:8265 <span class=\"se\">\\<\/span>\n    <span class=\"nt\">-i<\/span> ~\/.ssh\/lambda_id_ed25519 <span class=\"se\">\\<\/span>\n    ubuntu@<span class=\"si\">$(<\/span><span class=\"nb\">head<\/span> <span class=\"nt\">-n1<\/span> ~\/ips.txt<span class=\"si\">)<\/span>\ngit clone https:\/\/github.com\/qpwo\/deepseek-gh200-tutorial ~\/git\/tut\n<span class=\"nb\">cd<\/span> ~\/git\/tut\npython3 <span class=\"nt\">-m<\/span> http.server 1234\n\n<span class=\"c\"># on your desktop:<\/span>\nopen http:\/\/localhost:1234\/load-test.html\n\n<span class=\"c\"># check if api is up:<\/span>\ncurl http:\/\/localhost:8000\/v1\/models <span class=\"nt\">-H<\/span> <span class=\"s2\">\"Authorization: Bearer asdf1234\"<\/span>\n\n<span class=\"c\"># ray dashboard to view VRAM utilization:<\/span>\nopen http:\/\/localhost:8265\/#\/cluster\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Lambda Labs \u0647\u0646\u0648\u0632 \u0647\u0645 \u062f\u0627\u0631\u0627\u06cc \u0646\u06cc\u0645\u0647 \u062e\u0627\u0645\u0648\u0634 (\u06cc\u0639\u0646\u06cc 1.50 \u062f\u0644\u0627\u0631) GH200 \u0628\u0647 \u0639\u0646\u0648\u0627\u0646 \u0627\u0631\u062a\u0642\u0627\u0621 \u0628\u0631\u0627\u06cc \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u0628\u06cc\u0634\u062a\u0631 \u0627\u0641\u0631\u0627\u062f \u0628\u0647 \u0627\u0628\u0632\u0627\u0631 \u0628\u0627\u0632\u0648 \u0627\u0633\u062a. \u0645\u0646 \u0642\u0628\u0644\u0627\u064b \u06cc\u06a9 \u0622\u0645\u0648\u0632\u0634 \u0628\u0631\u0627\u06cc \u0627\u062c\u0631\u0627\u06cc Llama 405b \u0646\u0648\u0634\u062a\u0645 \u060c \u0627\u0645\u0627 Deepseek R1 \u0628\u0647 \u0648\u0636\u0648\u062d \u06cc\u06a9 \u0645\u062f\u0644 \u0628\u0647\u062a\u0631 \u0627\u0633\u062a \u060c \u0628\u0646\u0627\u0628\u0631\u0627\u06cc\u0646 \u0628\u06cc\u0627\u06cc\u06cc\u062f \u0628\u0647 \u062c\u0627\u06cc \u0622\u0646 \u062e\u062f\u0645\u062a \u06a9\u0646\u06cc\u0645. \u062a\u0641\u0627\u0648\u062a \u0686\u0646\u062f \u062a\u0641\u0627\u0648\u062a \u0627\u0632 \u062e\u062f\u0645\u062a \u0628\u0647 &hellip;<\/p>\n","protected":false},"author":2,"featured_media":96973,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"https:\/\/media2.dev.to\/dynamic\/image\/width=1000,height=500,fit=cover,gravity=auto,format=auto\/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fd6i2nacjw5hqlztcqspj.png","fifu_image_alt":"","footnotes":""},"categories":[339],"tags":[],"class_list":["post-96971","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-dev"],"_links":{"self":[{"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/posts\/96971","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/comments?post=96971"}],"version-history":[{"count":0,"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/posts\/96971\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/media\/96973"}],"wp:attachment":[{"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/media?parent=96971"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/categories?post=96971"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/tags?post=96971"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}