{"id":110570,"date":"2025-05-25T23:34:58","date_gmt":"2025-05-25T19:04:58","guid":{"rendered":"https:\/\/nabfollower.com\/blog\/build-a-local-genai-api-with-docker-model-runner-and-fastapi-part-3-29ka\/"},"modified":"2025-05-25T23:34:58","modified_gmt":"2025-05-25T19:04:58","slug":"build-a-local-genai-api-with-docker-model-runner-and-fastapi-part-3-29ka","status":"publish","type":"post","link":"https:\/\/nabfollower.com\/blog\/build-a-local-genai-api-with-docker-model-runner-and-fastapi-part-3-29ka\/","title":{"rendered":"\u0633\u0627\u062e\u062a \u06cc\u06a9 API \u0645\u062d\u0644\u06cc Genai \u0628\u0627 Docker Model Runner \u0648 Fastapi (\u0642\u0633\u0645\u062a 3)"},"content":{"rendered":"<div data-article-id=\"2525920\" id=\"article-body\">\n<p>\u062f\u0631 \u0642\u0633\u0645\u062a 2 \u060c \u0645\u0646 LLM \u0631\u0627 \u0628\u0647 \u0635\u0648\u0631\u062a \u0645\u062d\u0644\u06cc \u0628\u0627 \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u0627\u0632 Docker Model Runner \u0627\u062c\u0631\u0627 \u06a9\u0631\u062f\u0645 \u0648 \u0627\u0632 \u0637\u0631\u06cc\u0642 \u06cc\u06a9 \u0627\u0633\u06a9\u0631\u06cc\u067e\u062a \u067e\u0627\u06cc\u062a\u0648\u0646 \u0628\u0647 \u0622\u0646 \u0648\u0635\u0644 \u0634\u062f\u0645. \u062f\u0631 \u062d\u0627\u0644 \u062d\u0627\u0636\u0631 <strong>\u0642\u0633\u0645\u062a 3<\/strong>\u060c \u0645\u0627 \u0622\u0646 \u0645\u0646\u0637\u0642 \u0631\u0627 \u062f\u0631\u0648\u0646 \u06cc\u06a9 \u0645\u06cc \u0628\u0646\u062f\u06cc\u0645 <strong>API REST FASTAPI<\/strong> &#8211; \u0628\u0647 \u0645\u0627 \u06cc\u06a9 \u067e\u0634\u062a\u06cc\u0628\u0627\u0646 \u0648\u0627\u0642\u0639\u06cc \u0648 \u0645\u062d\u0644\u06cc Genai \u0645\u06cc \u062f\u0647\u06cc\u0645 \u06a9\u0647 \u0645\u06cc \u062a\u0648\u0627\u0646\u06cc\u0645 \u0627\u0632 \u067e\u0633\u062a \u0647\u0627\u06cc \u067e\u0633\u062a\u0686\u06cc \u060c \u0628\u0631\u0646\u0627\u0645\u0647 \u0647\u0627\u06cc \u0648\u0628 \u06cc\u0627 \u0627\u0628\u0632\u0627\u0631 CLI \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u06a9\u0646\u06cc\u0645.<\/p>\n<p>\u0628\u06cc\u0627\u06cc\u06cc\u062f \u0634\u06cc\u0631\u062c\u0647 \u0628\u0632\u0646\u06cc\u0645.<\/p>\n<hr\/>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_84 counter-hierarchy ez-toc-counter-rtl ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">\u0641\u0647\u0631\u0633\u062a \u0645\u0637\u0627\u0644\u0628<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/nabfollower.com\/blog\/build-a-local-genai-api-with-docker-model-runner-and-fastapi-part-3-29ka\/#%D9%87%D8%AF%D9%81\" >\u0647\u062f\u0641<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/nabfollower.com\/blog\/build-a-local-genai-api-with-docker-model-runner-and-fastapi-part-3-29ka\/#%D8%A2%D9%86%DA%86%D9%87_%D9%85%D8%A7_%D8%B3%D8%A7%D8%AE%D8%AA%DB%8C%D9%85\" >\u0622\u0646\u0686\u0647 \u0645\u0627 \u0633\u0627\u062e\u062a\u06cc\u0645<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/nabfollower.com\/blog\/build-a-local-genai-api-with-docker-model-runner-and-fastapi-part-3-29ka\/#%D8%B3%D8%A7%D8%AE%D8%AA%D8%A7%D8%B1_%D9%BE%D8%B1%D9%88%DA%98%D9%87\" >\u0633\u0627\u062e\u062a\u0627\u0631 \u067e\u0631\u0648\u0698\u0647<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/nabfollower.com\/blog\/build-a-local-genai-api-with-docker-model-runner-and-fastapi-part-3-29ka\/#%DA%86%DA%AF%D9%88%D9%86%D9%87_%D8%A2%D9%86_%D8%B1%D8%A7_%D8%A7%D8%AC%D8%B1%D8%A7_%DA%A9%D9%86%DB%8C%D9%85\" >\u0686\u06af\u0648\u0646\u0647 \u0622\u0646 \u0631\u0627 \u0627\u062c\u0631\u0627 \u06a9\u0646\u06cc\u0645<\/a><ul class='ez-toc-list-level-4' ><li class='ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/nabfollower.com\/blog\/build-a-local-genai-api-with-docker-model-runner-and-fastapi-part-3-29ka\/#1_%D9%85%D8%AF%D9%84_%D8%B1%D8%A7_%D8%A8%DA%A9%D8%B4%DB%8C%D8%AF_%D9%88_%D8%B4%D8%B1%D9%88%D8%B9_%DA%A9%D9%86%DB%8C%D8%AF\" >1. \u0645\u062f\u0644 \u0631\u0627 \u0628\u06a9\u0634\u06cc\u062f \u0648 \u0634\u0631\u0648\u0639 \u06a9\u0646\u06cc\u062f<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/nabfollower.com\/blog\/build-a-local-genai-api-with-docker-model-runner-and-fastapi-part-3-29ka\/#2_%D8%B3%D8%B1%D9%88%D8%B1_FastAPI_%D8%B1%D8%A7_%D8%B4%D8%B1%D9%88%D8%B9_%DA%A9%D9%86%DB%8C%D8%AF\" >2. \u0633\u0631\u0648\u0631 FastAPI \u0631\u0627 \u0634\u0631\u0648\u0639 \u06a9\u0646\u06cc\u062f<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/nabfollower.com\/blog\/build-a-local-genai-api-with-docker-model-runner-and-fastapi-part-3-29ka\/#%D8%A8%D8%A7_%D9%86%D9%82%D8%B7%D9%87_%D9%BE%D8%A7%DB%8C%D8%A7%D9%86%DB%8C_%D8%AA%D9%85%D8%A7%D8%B3_%D8%A8%DA%AF%DB%8C%D8%B1%DB%8C%D8%AF\" >\u0628\u0627 \u0646\u0642\u0637\u0647 \u067e\u0627\u06cc\u0627\u0646\u06cc \u062a\u0645\u0627\u0633 \u0628\u06af\u06cc\u0631\u06cc\u062f<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/nabfollower.com\/blog\/build-a-local-genai-api-with-docker-model-runner-and-fastapi-part-3-29ka\/#%DA%86%DB%8C%D8%B2%D9%87%D8%A7%DB%8C%DB%8C_%DA%A9%D9%87_%D9%85%D9%86_%DB%8C%D8%A7%D8%AF_%DA%AF%D8%B1%D9%81%D8%AA%D9%85\" >\u0686\u06cc\u0632\u0647\u0627\u06cc\u06cc \u06a9\u0647 \u0645\u0646 \u06cc\u0627\u062f \u06af\u0631\u0641\u062a\u0645<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/nabfollower.com\/blog\/build-a-local-genai-api-with-docker-model-runner-and-fastapi-part-3-29ka\/#1_%D8%AD%D8%A7%D9%84%D8%AA_%D8%AA%D8%B9%D8%A7%D9%85%D9%84%DB%8C_%D9%87%D9%86%D9%88%D8%B2_API_%D8%B1%D8%A7_%D9%82%D8%A7%D8%AF%D8%B1_%D9%85%DB%8C_%D8%B3%D8%A7%D8%B2%D8%AF\" >1. \u062d\u0627\u0644\u062a \u062a\u0639\u0627\u0645\u0644\u06cc \u0647\u0646\u0648\u0632 API \u0631\u0627 \u0642\u0627\u062f\u0631 \u0645\u06cc \u0633\u0627\u0632\u062f<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/nabfollower.com\/blog\/build-a-local-genai-api-with-docker-model-runner-and-fastapi-part-3-29ka\/#2_%D8%AA%D9%85%D8%A7%D8%B3_%D8%A7%D9%88%D9%84_%DA%A9%D9%86%D8%AF_%D8%A7%D8%B3%D8%AA\" >2 \u062a\u0645\u0627\u0633 \u0627\u0648\u0644 \u06a9\u0646\u062f \u0627\u0633\u062a<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/nabfollower.com\/blog\/build-a-local-genai-api-with-docker-model-runner-and-fastapi-part-3-29ka\/#%DA%86%D9%87_%D8%A8%D8%B9%D8%AF%DB%8C_%D8%A7%D8%B3%D8%AA\" >\u0686\u0647 \u0628\u0639\u062f\u06cc \u0627\u0633\u062a<\/a><\/li><\/ul><\/nav><\/div>\n<h3><span class=\"ez-toc-section\" id=\"%D9%87%D8%AF%D9%81\"><\/span>\n<p>  \u0647\u062f\u0641<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<ul>\n<li>\u06cc\u06a9 \u0633\u0631\u0648\u0631 FastAPI \u0628\u0633\u0627\u0632\u06cc\u062f \u06a9\u0647 \u0628\u0647 \u06cc\u06a9 LLM \u0645\u062d\u0644\u06cc \u062f\u0631 \u062d\u0627\u0644 \u0627\u062c\u0631\u0627 (AI\/MISTRAL) \u0627\u0631\u0633\u0627\u0644 \u0645\u06cc \u06a9\u0646\u062f<\/li>\n<li>\u0627\u0641\u0634\u0627\u06cc <code>\/generate<\/code> \u0646\u0642\u0637\u0647 \u067e\u0627\u06cc\u0627\u0646\u06cc<\/li>\n<li>\u06a9\u0627\u0646\u062a\u06cc\u0646\u0631 API \u0648 Docker Model Runner \u0631\u0627 \u0627\u062c\u0631\u0627 \u06a9\u0646\u06cc\u062f <strong>\u062f\u0631 \u06a9\u0646\u0627\u0631 \u0647\u0645<\/strong>\n<\/li>\n<\/ul>\n<hr\/>\n<h3><span class=\"ez-toc-section\" id=\"%D8%A2%D9%86%DA%86%D9%87_%D9%85%D8%A7_%D8%B3%D8%A7%D8%AE%D8%AA%DB%8C%D9%85\"><\/span>\n<p>  \u0622\u0646\u0686\u0647 \u0645\u0627 \u0633\u0627\u062e\u062a\u06cc\u0645<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>API REST (\u062f\u0631 \u062d\u0627\u0644 \u0627\u062c\u0631\u0627 \u062f\u0631 Docker) \u06a9\u0647 \u0627\u0632 \u0637\u0631\u06cc\u0642 \u06cc\u06a9 Docker Model Runner \u0635\u062d\u0628\u062a \u0645\u06cc \u06a9\u0646\u062f <strong>\u0633\u0627\u0632\u06af\u0627\u0631 \u0628\u0627 \u0627\u0648\u067e\u0627\u06cc<\/strong> \u0646\u0642\u0637\u0647 \u067e\u0627\u06cc\u0627\u0646\u06cc \u0634\u0645\u0627 \u0633\u0631\u06cc\u0639 \u0627\u0631\u0633\u0627\u0644 \u0645\u06cc \u06a9\u0646\u06cc\u062f:<\/p>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight json\"><code><span class=\"p\">{<\/span><span class=\"w\">\n  <\/span><span class=\"nl\">\"prompt\"<\/span><span class=\"p\">:<\/span><span class=\"w\"> <\/span><span class=\"s2\">\"\"<\/span><span class=\"err\">Explain<\/span><span class=\"w\"> <\/span><span class=\"err\">what<\/span><span class=\"w\"> <\/span><span class=\"err\">is<\/span><span class=\"w\"> <\/span><span class=\"err\">docker<\/span><span class=\"w\"> <\/span><span class=\"err\">model<\/span><span class=\"w\"> <\/span><span class=\"err\">runner<\/span><span class=\"w\"> <\/span><span class=\"err\">in<\/span><span class=\"w\"> <\/span><span class=\"mi\">3<\/span><span class=\"w\"> <\/span><span class=\"err\">points<\/span><span class=\"s2\">\"\n}\n<\/span><\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<p>\u2026 \u0648 \u0628\u0627 \u06cc\u06a9 \u067e\u0627\u0633\u062e \u062a\u0648\u0644\u06cc\u062f \u0634\u062f\u0647 \u062a\u0648\u0633\u0637 AI \u0627\u0632 \u06cc\u06a9 \u0645\u062f\u0644 \u06a9\u0647 100 \u066a \u0631\u0648\u06cc \u062f\u0633\u062a\u06af\u0627\u0647 \u0634\u0645\u0627 \u0627\u062c\u0631\u0627 \u0645\u06cc \u0634\u0648\u062f \u067e\u0627\u0633\u062e \u0645\u06cc \u062f\u0647\u062f.<\/p>\n<hr\/>\n<h3><span class=\"ez-toc-section\" id=\"%D8%B3%D8%A7%D8%AE%D8%AA%D8%A7%D8%B1_%D9%BE%D8%B1%D9%88%DA%98%D9%87\"><\/span>\n<p>  \u0633\u0627\u062e\u062a\u0627\u0631 \u067e\u0631\u0648\u0698\u0647<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight plaintext\"><code>docker-llm-fastapi-app\/\n\u251c\u2500\u2500 app\/\n\u2502   \u2514\u2500\u2500 main.py         \u2190 FastAPI logic\n\u251c\u2500\u2500 Dockerfile          \u2190 API container\n\u251c\u2500\u2500 docker-compose.yml  \u2190 Orchestration\n\u251c\u2500\u2500 README.md\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<p>\u06a9\u062f \u0627\u06cc\u0646\u062c\u0627 \u0631\u0627 \u0628\u0631\u0631\u0633\u06cc \u06a9\u0646\u06cc\u062f Part3-Code<\/p>\n<hr\/>\n<h3><span class=\"ez-toc-section\" id=\"%DA%86%DA%AF%D9%88%D9%86%D9%87_%D8%A2%D9%86_%D8%B1%D8%A7_%D8%A7%D8%AC%D8%B1%D8%A7_%DA%A9%D9%86%DB%8C%D9%85\"><\/span>\n<p>  \u0686\u06af\u0648\u0646\u0647 \u0622\u0646 \u0631\u0627 \u0627\u062c\u0631\u0627 \u06a9\u0646\u06cc\u0645<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<h4><span class=\"ez-toc-section\" id=\"1_%D9%85%D8%AF%D9%84_%D8%B1%D8%A7_%D8%A8%DA%A9%D8%B4%DB%8C%D8%AF_%D9%88_%D8%B4%D8%B1%D9%88%D8%B9_%DA%A9%D9%86%DB%8C%D8%AF\"><\/span>\n<p>  1. \u0645\u062f\u0644 \u0631\u0627 \u0628\u06a9\u0634\u06cc\u062f \u0648 \u0634\u0631\u0648\u0639 \u06a9\u0646\u06cc\u062f<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h4>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight shell\"><code>docker model pull ai\/mistral\ndocker model run ai\/mistral\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<blockquote>\n<p>\u0627\u06af\u0631 \u0642\u0628\u0644\u0627\u064b \u0645\u062f\u0644 \u0631\u0627 \u0627\u0632 \u0622\u0645\u0648\u0632\u0634 \u0642\u0628\u0644\u06cc \u0628\u06cc\u0631\u0648\u0646 \u0622\u0648\u0631\u062f\u0647 \u0627\u06cc\u062f \u060c \u062f\u0631 \u062d\u0627\u0644 \u0627\u062c\u0631\u0627 \u062f\u0648\u0628\u0627\u0631\u0647 \u0644\u0627\u0632\u0645 \u0646\u06cc\u0633\u062a.<br \/>\u0645\u0645\u06a9\u0646 \u0627\u0633\u062a \u0628\u0628\u06cc\u0646\u06cc\u062f: <code>Interactive chat mode started. Type '\/bye' to exit.<\/code><\/p>\n<p>\u0627\u0634\u06a9\u0627\u0644\u06cc \u0646\u062f\u0627\u0631\u062f &#8211; \u0627\u06af\u0631 TCP \u062f\u0633\u062a\u0631\u0633\u06cc \u0641\u0639\u0627\u0644 \u0628\u0627\u0634\u062f \u060c API \u0647\u0646\u0648\u0632 \u062f\u0631 \u067e\u0634\u062a \u0635\u062d\u0646\u0647 \u0641\u0639\u0627\u0644 \u0627\u0633\u062a.<\/p>\n<\/blockquote>\n<h4><span class=\"ez-toc-section\" id=\"2_%D8%B3%D8%B1%D9%88%D8%B1_FastAPI_%D8%B1%D8%A7_%D8%B4%D8%B1%D9%88%D8%B9_%DA%A9%D9%86%DB%8C%D8%AF\"><\/span>\n<p>  2. \u0633\u0631\u0648\u0631 FastAPI \u0631\u0627 \u0634\u0631\u0648\u0639 \u06a9\u0646\u06cc\u062f<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h4>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight shell\"><code>docker compose up <span class=\"nt\">--build<\/span>\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<p>\u062e\u0648\u0627\u0647\u06cc\u062f \u062f\u06cc\u062f:<\/p>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight plaintext\"><code>Uvicorn running on http:\/\/0.0.0.0:8000\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<hr\/>\n<h3><span class=\"ez-toc-section\" id=\"%D8%A8%D8%A7_%D9%86%D9%82%D8%B7%D9%87_%D9%BE%D8%A7%DB%8C%D8%A7%D9%86%DB%8C_%D8%AA%D9%85%D8%A7%D8%B3_%D8%A8%DA%AF%DB%8C%D8%B1%DB%8C%D8%AF\"><\/span>\n<p>  \u0628\u0627 \u0646\u0642\u0637\u0647 \u067e\u0627\u06cc\u0627\u0646\u06cc \u062a\u0645\u0627\u0633 \u0628\u06af\u06cc\u0631\u06cc\u062f<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>\u062f\u0631\u062e\u0648\u0627\u0633\u062a \u0627\u0631\u0633\u0627\u0644 \u0627\u0632 \u067e\u0633\u062a\u0686\u06cc \u06cc\u0627 CURL:<\/p>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight http\"><code><span class=\"err\">POST http:\/\/localhost:8000\/generate\nContent-Type: application\/json\n\n{\n  \"prompt\": \"What is MLOps in simple terms?\"\n}\n<\/span><\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<p>\u062e\u0631\u0648\u062c\u06cc:<\/p>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight json\"><code><span class=\"p\">{<\/span><span class=\"w\">\n  <\/span><span class=\"nl\">\"response\"<\/span><span class=\"p\">:<\/span><span class=\"w\"> <\/span><span class=\"s2\">\"MLOps, short for Machine Learning Operations, is a practice for collaboration and...\"<\/span><span class=\"w\">\n<\/span><span class=\"p\">}<\/span><span class=\"w\">\n<\/span><\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<p><\/p>\n<hr\/>\n<h2><span class=\"ez-toc-section\" id=\"%DA%86%DB%8C%D8%B2%D9%87%D8%A7%DB%8C%DB%8C_%DA%A9%D9%87_%D9%85%D9%86_%DB%8C%D8%A7%D8%AF_%DA%AF%D8%B1%D9%81%D8%AA%D9%85\"><\/span>\n<p>  \u0686\u06cc\u0632\u0647\u0627\u06cc\u06cc \u06a9\u0647 \u0645\u0646 \u06cc\u0627\u062f \u06af\u0631\u0641\u062a\u0645<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<h3><span class=\"ez-toc-section\" id=\"1_%D8%AD%D8%A7%D9%84%D8%AA_%D8%AA%D8%B9%D8%A7%D9%85%D9%84%DB%8C_%D9%87%D9%86%D9%88%D8%B2_API_%D8%B1%D8%A7_%D9%82%D8%A7%D8%AF%D8%B1_%D9%85%DB%8C_%D8%B3%D8%A7%D8%B2%D8%AF\"><\/span>\n<p>  1. \u062d\u0627\u0644\u062a \u062a\u0639\u0627\u0645\u0644\u06cc \u0647\u0646\u0648\u0632 API \u0631\u0627 \u0642\u0627\u062f\u0631 \u0645\u06cc \u0633\u0627\u0632\u062f<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>\u062d\u062a\u06cc \u0627\u06af\u0631 \u062f\u0627\u06a9\u0631 \u0645\u06cc \u06af\u0648\u06cc\u062f:<\/p>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight plaintext\"><code>Interactive chat mode started. Type '\/bye' to exit.\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<p>\u2026 API HTTP \u0647\u0646\u0648\u0632 \u062f\u0631 \u062f\u0633\u062a\u0631\u0633 \u0627\u0633\u062a <code>localhost:12434<\/code>\u0628\u0634\u0631 \u062a\u0627 \u0632\u0645\u0627\u0646\u06cc \u06a9\u0647 \u067e\u0634\u062a\u06cc\u0628\u0627\u0646\u06cc TCP \u062f\u0631 \u062f\u0633\u06a9 \u062a\u0627\u067e Docker \u0641\u0639\u0627\u0644 \u0634\u0648\u062f \u060c \u062e\u0648\u0628 \u06a9\u0627\u0631 \u0645\u06cc \u06a9\u0646\u062f.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"2_%D8%AA%D9%85%D8%A7%D8%B3_%D8%A7%D9%88%D9%84_%DA%A9%D9%86%D8%AF_%D8%A7%D8%B3%D8%AA\"><\/span>\n<p>  2 \u062a\u0645\u0627\u0633 \u0627\u0648\u0644 \u06a9\u0646\u062f \u0627\u0633\u062a<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>\u062f\u0631\u062e\u0648\u0627\u0633\u062a \u0627\u0648\u0644 2 \u062f\u0642\u06cc\u0642\u0647 \u067e\u0648\u0646\u062f \u0637\u0648\u0644 \u06a9\u0634\u06cc\u062f. \u0686\u0631\u0627\u061f<\/p>\n<ul>\n<li>\u0645\u062f\u0644 \u062f\u0631 \u062d\u0627\u0641\u0638\u0647 \u0628\u0627\u0631\u06af\u0630\u0627\u0631\u06cc \u0645\u06cc \u0634\u0648\u062f<\/li>\n<li>\u06af\u0631\u0645 \u06a9\u0631\u062f\u0646 \u0632\u0645\u0627\u0646 \u0627\u062c\u0631\u0627 \u0628\u0647 \u0632\u0645\u0627\u0646 \u0646\u06cc\u0627\u0632 \u062f\u0627\u0631\u062f<\/li>\n<\/ul>\n<p>\u0627\u0645\u0627 \u067e\u0633 \u0627\u0632 \u0622\u0646 \u060c \u0627\u0639\u0644\u0627\u0646 \u0647\u0627\u06cc \u0622\u06cc\u0646\u062f\u0647 \u06a9\u0645\u06cc \u0628\u0647\u062a\u0631 \u0627\u0633\u062a.<\/p>\n<hr\/>\n<h2><span class=\"ez-toc-section\" id=\"%DA%86%D9%87_%D8%A8%D8%B9%D8%AF%DB%8C_%D8%A7%D8%B3%D8%AA\"><\/span>\n<p>  \u0686\u0647 \u0628\u0639\u062f\u06cc \u0627\u0633\u062a<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u062f\u0631 <strong>\u0642\u0633\u0645\u062a 4<\/strong> \u0645\u0646 \u0642\u0635\u062f \u062f\u0627\u0631\u0645 \u06cc\u06a9 \u0627\u0644\u06af\u0648\u0647\u0627\u06cc \u0633\u0631\u06cc\u0639 + \u06af\u0632\u06cc\u0646\u0647 \u0647\u0627\u06cc \u0646\u0642\u0634 \u0631\u0627 \u0628\u0633\u0627\u0632\u0645 \u06a9\u0647 \u06cc\u06a9 \u0644\u0627\u06cc\u0647 \u0639\u0645\u0644\u06cc \u0627\u0632 \u0645\u0647\u0646\u062f\u0633\u06cc \u0633\u0631\u06cc\u0639 \u0628\u0647 \u0628\u0631\u0646\u0627\u0645\u0647 Genai \u0634\u0645\u0627 \u0627\u0636\u0627\u0641\u0647 \u0645\u06cc \u06a9\u0646\u062f.<\/p>\n<p>\u0628\u0627 \u0645\u0627 \u0647\u0645\u0631\u0627\u0647 \u0628\u0627\u0634\u06cc\u062f!<\/p>\n<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"<p>\u062f\u0631 \u0642\u0633\u0645\u062a 2 \u060c \u0645\u0646 LLM \u0631\u0627 \u0628\u0647 \u0635\u0648\u0631\u062a \u0645\u062d\u0644\u06cc \u0628\u0627 \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u0627\u0632 Docker Model Runner \u0627\u062c\u0631\u0627 \u06a9\u0631\u062f\u0645 \u0648 \u0627\u0632 \u0637\u0631\u06cc\u0642 \u06cc\u06a9 \u0627\u0633\u06a9\u0631\u06cc\u067e\u062a \u067e\u0627\u06cc\u062a\u0648\u0646 \u0628\u0647 \u0622\u0646 \u0648\u0635\u0644 \u0634\u062f\u0645. \u062f\u0631 \u062d\u0627\u0644 \u062d\u0627\u0636\u0631 \u0642\u0633\u0645\u062a 3\u060c \u0645\u0627 \u0622\u0646 \u0645\u0646\u0637\u0642 \u0631\u0627 \u062f\u0631\u0648\u0646 \u06cc\u06a9 \u0645\u06cc \u0628\u0646\u062f\u06cc\u0645 API REST FASTAPI &#8211; \u0628\u0647 \u0645\u0627 \u06cc\u06a9 \u067e\u0634\u062a\u06cc\u0628\u0627\u0646 \u0648\u0627\u0642\u0639\u06cc \u0648 \u0645\u062d\u0644\u06cc Genai \u0645\u06cc \u062f\u0647\u06cc\u0645 &hellip;<\/p>\n","protected":false},"author":2,"featured_media":110571,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"","fifu_image_alt":"","footnotes":""},"categories":[339],"tags":[],"class_list":["post-110570","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-dev"],"_links":{"self":[{"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/posts\/110570","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/comments?post=110570"}],"version-history":[{"count":0,"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/posts\/110570\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/media\/110571"}],"wp:attachment":[{"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/media?parent=110570"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/categories?post=110570"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/tags?post=110570"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}