{"id":111282,"date":"2025-05-30T22:34:20","date_gmt":"2025-05-30T18:04:20","guid":{"rendered":"https:\/\/nabfollower.com\/blog\/the-context-window-illusion-why-your-128k-tokens-arent-working-4ica\/"},"modified":"2025-05-30T22:34:20","modified_gmt":"2025-05-30T18:04:20","slug":"the-context-window-illusion-why-your-128k-tokens-arent-working-4ica","status":"publish","type":"post","link":"https:\/\/nabfollower.com\/blog\/the-context-window-illusion-why-your-128k-tokens-arent-working-4ica\/","title":{"rendered":"\u062a\u0648\u0647\u0645 \u067e\u0646\u062c\u0631\u0647 \u0632\u0645\u06cc\u0646\u0647: \u0686\u0631\u0627 \u0646\u0634\u0627\u0646\u0647 \u0647\u0627\u06cc 128K \u0634\u0645\u0627 \u06a9\u0627\u0631 \u0646\u0645\u06cc \u06a9\u0646\u0646\u062f"},"content":{"rendered":"<div data-article-id=\"2545920\" id=\"article-body\">\n<blockquote>\n<p>&#8220;\u0634\u0645\u0627 128\u060c000 \u0646\u0634\u0627\u0646\u0647 \u0645\u062a\u0646 \u0631\u0627 \u067e\u0631\u062f\u0627\u062e\u062a \u06a9\u0631\u062f\u0647 \u0627\u06cc\u062f. \u0645\u0645\u06a9\u0646 \u0627\u0633\u062a 30\u060c000 \u0628\u0647 \u0637\u0648\u0631 \u0645\u0624\u062b\u0631 \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u06a9\u0646\u06cc\u062f. \u0628\u0642\u06cc\u0647\u061f \u0645\u062f\u0644 \u0634\u0645\u0627 \u0622\u0646\u0647\u0627 \u0631\u0627 \u0646\u0627\u062f\u06cc\u062f\u0647 \u0645\u06cc \u06af\u06cc\u0631\u062f &#8211; \u0648 \u0628\u0647 \u0647\u0631 \u062d\u0627\u0644 \u0634\u0645\u0627 \u0631\u0627 \u0634\u0627\u0631\u0698 \u0645\u06cc \u06a9\u0646\u062f.&#8221;<\/p>\n<\/blockquote>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_84 counter-hierarchy ez-toc-counter-rtl ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">\u0641\u0647\u0631\u0633\u062a \u0645\u0637\u0627\u0644\u0628<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/nabfollower.com\/blog\/the-context-window-illusion-why-your-128k-tokens-arent-working-4ica\/#%D9%82%D8%B3%D9%85%D8%AA_1_%D8%B4%DA%A9%D8%A7%D9%81_%D8%A7%D8%B3%D8%AA%D9%81%D8%A7%D8%AF%D9%87\" >\u0642\u0633\u0645\u062a 1: \u0634\u06a9\u0627\u0641 \u0627\u0633\u062a\u0641\u0627\u062f\u0647<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/nabfollower.com\/blog\/the-context-window-illusion-why-your-128k-tokens-arent-working-4ica\/#%D9%82%D8%B3%D9%85%D8%AA_2_%D8%A7%D9%86%D8%AF%D8%A7%D8%B2%D9%87_%DA%AF%DB%8C%D8%B1%DB%8C_%D8%B2%D8%A8%D8%A7%D9%84%D9%87_%D9%87%D8%A7\" >\u0642\u0633\u0645\u062a 2: \u0627\u0646\u062f\u0627\u0632\u0647 \u06af\u06cc\u0631\u06cc \u0632\u0628\u0627\u0644\u0647 \u0647\u0627<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/nabfollower.com\/blog\/the-context-window-illusion-why-your-128k-tokens-arent-working-4ica\/#%D9%82%D8%B3%D9%85%D8%AA_3_%D9%85%D8%A7%D9%84%DB%8C%D8%A7%D8%AA_%D9%85%D9%88%D9%82%D8%B9%DB%8C%D8%AA\" >\u0642\u0633\u0645\u062a 3: \u0645\u0627\u0644\u06cc\u0627\u062a \u0645\u0648\u0642\u0639\u06cc\u062a<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/nabfollower.com\/blog\/the-context-window-illusion-why-your-128k-tokens-arent-working-4ica\/#%D9%82%D8%B3%D9%85%D8%AA_%DA%86%D9%87%D8%A7%D8%B1%D9%85_%D9%85%D9%88%D9%82%D8%B9%DB%8C%D8%AA_%DB%8C%D8%A7%D8%A8%DB%8C_%D8%A7%D8%B3%D8%AA%D8%B1%D8%A7%D8%AA%DA%98%DB%8C%DA%A9\" >\u0642\u0633\u0645\u062a \u0686\u0647\u0627\u0631\u0645: \u0645\u0648\u0642\u0639\u06cc\u062a \u06cc\u0627\u0628\u06cc \u0627\u0633\u062a\u0631\u0627\u062a\u0698\u06cc\u06a9<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/nabfollower.com\/blog\/the-context-window-illusion-why-your-128k-tokens-arent-working-4ica\/#%D8%A7%D8%B3%D8%AA%D8%B1%D8%A7%D8%AA%DA%98%DB%8C_Bookend\" >\u0627\u0633\u062a\u0631\u0627\u062a\u0698\u06cc Bookend<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/nabfollower.com\/blog\/the-context-window-illusion-why-your-128k-tokens-arent-working-4ica\/#chunking_%D8%AF%D8%B1_%D9%85%D9%82%D8%A7%D8%A8%D9%84_%D9%81%D8%B4%D8%B1%D8%AF%D9%87_%D8%B3%D8%A7%D8%B2%DB%8C\" >chunking \u062f\u0631 \u0645\u0642\u0627\u0628\u0644 \u0641\u0634\u0631\u062f\u0647 \u0633\u0627\u0632\u06cc<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/nabfollower.com\/blog\/the-context-window-illusion-why-your-128k-tokens-arent-working-4ica\/#%D8%A7%D9%84%DA%AF%D9%88%D9%87%D8%A7%DB%8C_%D9%85%D9%87%D9%86%D8%AF%D8%B3%DB%8C_%D8%B3%D8%B1%DB%8C%D8%B9\" >\u0627\u0644\u06af\u0648\u0647\u0627\u06cc \u0645\u0647\u0646\u062f\u0633\u06cc \u0633\u0631\u06cc\u0639<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/nabfollower.com\/blog\/the-context-window-illusion-why-your-128k-tokens-arent-working-4ica\/#%DA%86%D9%87_%D8%B2%D9%85%D8%A7%D9%86%DB%8C_%D8%A8%D8%B1%D8%A7%DB%8C_128K_%D9%BE%D8%B1%D8%AF%D8%A7%D8%AE%D8%AA_%DA%A9%D9%86%DB%8C%D8%AF\" >\u0686\u0647 \u0632\u0645\u0627\u0646\u06cc \u0628\u0631\u0627\u06cc 128K \u067e\u0631\u062f\u0627\u062e\u062a \u06a9\u0646\u06cc\u062f<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/nabfollower.com\/blog\/the-context-window-illusion-why-your-128k-tokens-arent-working-4ica\/#%D9%82%D8%B3%D9%85%D8%AA_5_%D8%A7%D8%A8%D8%B2%D8%A7%D8%B1_%D9%88_%D8%AA%D8%B4%D8%AE%DB%8C%D8%B5\" >\u0642\u0633\u0645\u062a 5: \u0627\u0628\u0632\u0627\u0631 \u0648 \u062a\u0634\u062e\u06cc\u0635<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/nabfollower.com\/blog\/the-context-window-illusion-why-your-128k-tokens-arent-working-4ica\/#%D9%82%D8%B7%D8%B9%D9%87_%DA%A9%D8%AF_%D8%A7%D9%86%D8%AF%D8%A7%D8%B2%D9%87_%DA%AF%DB%8C%D8%B1%DB%8C_%D8%AD%D8%B3%D8%A7%D8%B3%DB%8C%D8%AA_%D8%A8%D9%87_%D9%85%D9%88%D9%82%D8%B9%DB%8C%D8%AA\" >\u0642\u0637\u0639\u0647 \u06a9\u062f: \u0627\u0646\u062f\u0627\u0632\u0647 \u06af\u06cc\u0631\u06cc \u062d\u0633\u0627\u0633\u06cc\u062a \u0628\u0647 \u0645\u0648\u0642\u0639\u06cc\u062a<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/nabfollower.com\/blog\/the-context-window-illusion-why-your-128k-tokens-arent-working-4ica\/#%D8%A8%D8%A7%D8%B2%D8%B3%D8%A7%D8%B2%DB%8C_%D8%B3%D8%B1%DB%8C%D8%B9_%D8%AF%D8%B1_%D8%AF%D9%86%DB%8C%D8%A7%DB%8C_%D9%88%D8%A7%D9%82%D8%B9%DB%8C\" >\u0628\u0627\u0632\u0633\u0627\u0632\u06cc \u0633\u0631\u06cc\u0639 \u062f\u0631 \u062f\u0646\u06cc\u0627\u06cc \u0648\u0627\u0642\u0639\u06cc<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/nabfollower.com\/blog\/the-context-window-illusion-why-your-128k-tokens-arent-working-4ica\/#%DA%86%DA%AF%D9%88%D9%86%D9%87_%D9%85%DB%8C_%D8%AA%D9%88%D8%A7%D9%86_%D8%A2%D9%86%DA%86%D9%87_%D8%B1%D8%A7_%DA%A9%D9%87_%DA%A9%D8%A7%D8%B1_%D9%85%DB%8C_%DA%A9%D9%86%D8%AF_%D8%A7%D9%86%D8%AF%D8%A7%D8%B2%D9%87_%DA%AF%DB%8C%D8%B1%DB%8C_%DA%A9%D9%86%DB%8C%D9%85\" >\u0686\u06af\u0648\u0646\u0647 \u0645\u06cc \u062a\u0648\u0627\u0646 \u0622\u0646\u0686\u0647 \u0631\u0627 \u06a9\u0647 \u06a9\u0627\u0631 \u0645\u06cc \u06a9\u0646\u062f \u0627\u0646\u062f\u0627\u0632\u0647 \u06af\u06cc\u0631\u06cc \u06a9\u0646\u06cc\u0645<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-13\" href=\"https:\/\/nabfollower.com\/blog\/the-context-window-illusion-why-your-128k-tokens-arent-working-4ica\/#%D8%AF%D8%B1_%D9%87%D8%B1_%D8%A8%D8%A7%D8%B1\" >\u062f\u0631 \u0647\u0631 \u0628\u0627\u0631<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-14\" href=\"https:\/\/nabfollower.com\/blog\/the-context-window-illusion-why-your-128k-tokens-arent-working-4ica\/#%D9%86%D8%AA%DB%8C%D8%AC%D9%87_%DA%AF%DB%8C%D8%B1%DB%8C_%D9%85%D9%87%D9%86%D8%AF%D8%B3%DB%8C_%D8%A8%D8%B1%D8%A7%DB%8C_%D8%AA%D9%88%D8%AC%D9%87\" >\u0646\u062a\u06cc\u062c\u0647 \u06af\u06cc\u0631\u06cc: \u0645\u0647\u0646\u062f\u0633\u06cc \u0628\u0631\u0627\u06cc \u062a\u0648\u062c\u0647<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-15\" href=\"https:\/\/nabfollower.com\/blog\/the-context-window-illusion-why-your-128k-tokens-arent-working-4ica\/#%D9%85%D9%84%D8%A7%D8%AD%D8%B8%D8%A7%D8%AA_%D8%AC%D8%B2%D8%A6%DB%8C_%D9%88_%D8%A7%D9%81%DA%A9%D8%A7%D8%B1_%D8%A8%DB%8C%D8%B4%D8%AA%D8%B1\" >\u0645\u0644\u0627\u062d\u0638\u0627\u062a \u062c\u0632\u0626\u06cc \u0648 \u0627\u0641\u06a9\u0627\u0631 \u0628\u06cc\u0634\u062a\u0631<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-16\" href=\"https:\/\/nabfollower.com\/blog\/the-context-window-illusion-why-your-128k-tokens-arent-working-4ica\/#%D9%85%D8%AD%D8%AF%D9%88%D8%AF%DB%8C%D8%AA_%D9%87%D8%A7%DB%8C_%D9%85%D8%B9%D9%85%D8%A7%D8%B1%DB%8C\" >\u0645\u062d\u062f\u0648\u062f\u06cc\u062a \u0647\u0627\u06cc \u0645\u0639\u0645\u0627\u0631\u06cc<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-17\" href=\"https:\/\/nabfollower.com\/blog\/the-context-window-illusion-why-your-128k-tokens-arent-working-4ica\/#%D9%85%D8%AF%D9%84_%D9%87%D8%A7%DB%8C_%D8%AA%D9%88%D8%AC%D9%87_%D9%BE%D9%88%DB%8C%D8%A7\" >\u0645\u062f\u0644 \u0647\u0627\u06cc \u062a\u0648\u062c\u0647 \u067e\u0648\u06cc\u0627<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-18\" href=\"https:\/\/nabfollower.com\/blog\/the-context-window-illusion-why-your-128k-tokens-arent-working-4ica\/#%D8%A7%D8%AB%D8%B1%D8%A8%D8%AE%D8%B4%DB%8C_%D8%AA%D9%88%DA%A9%D9%86_%D8%AE%D8%A7%D8%B5_%DA%A9%D8%A7%D8%B1\" >\u0627\u062b\u0631\u0628\u062e\u0634\u06cc \u062a\u0648\u06a9\u0646 \u062e\u0627\u0635 \u06a9\u0627\u0631<\/a><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n<h2><span class=\"ez-toc-section\" id=\"%D9%82%D8%B3%D9%85%D8%AA_1_%D8%B4%DA%A9%D8%A7%D9%81_%D8%A7%D8%B3%D8%AA%D9%81%D8%A7%D8%AF%D9%87\"><\/span>\n<p>  \u0642\u0633\u0645\u062a 1: \u0634\u06a9\u0627\u0641 \u0627\u0633\u062a\u0641\u0627\u062f\u0647<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u0628\u0631\u0627\u06cc \u062f\u06cc\u062f\u0646 \u0627\u06cc\u0646 \u06a9\u0627\u0631 \u062f\u0631 \u0639\u0645\u0644 \u060c \u062f\u0631 \u0627\u06cc\u0646\u062c\u0627 \u06cc\u06a9 \u0645\u0642\u0627\u06cc\u0633\u0647 \u0646\u0642\u0634\u0647 \u0628\u0627 \u06af\u0631\u0645\u0627 \u062f\u0631 \u06a9\u0646\u0627\u0631 \u0647\u0645 \u0642\u0631\u0627\u0631 \u06af\u0631\u0641\u062a\u0647 \u0627\u0633\u062a:<\/p>\n<ul>\n<li>\n<strong>GPT-4O (128K)<\/strong>: \u062a\u0642\u062f\u0645 \u0642\u0648\u06cc \u0648 recency \u060c \u0646\u0634\u0627\u0646\u0647 \u0647\u0627\u06cc \u0645\u0624\u062b\u0631 8K.<\/li>\n<li>\n<strong>\u06a9\u0644\u0648\u062f 2.1 (100K)<\/strong>: \u06cc\u0627\u062f\u0622\u0648\u0631\u06cc \u062f\u0644\u062e\u0648\u0627\u0647 \u0645\u0646\u0627\u0633\u0628 \u060c \u0639\u062f\u0645 \u0645\u0648\u0641\u0642\u06cc\u062a \u062f\u0631 \u0627\u0648\u0627\u0633\u0637 \u0645\u062f\u0644 \u0641\u0631\u0627\u062a\u0631 \u0627\u0632 40k.<\/li>\n<li>\n<strong>\u062c\u0645\u06cc\u0646\u06cc 1.5 (1m)<\/strong>: \u062a\u0648\u0632\u06cc\u0639 \u0646\u0631\u0645 \u062a\u0631 \u060c \u0627\u0645\u0627 50 \u06a9\u06cc\u0644\u0648\u06af\u0631\u0645 \u06af\u0630\u0634\u062a\u0647 \u0631\u0627 \u0627\u0632 \u0628\u06cc\u0646 \u0645\u06cc \u0628\u0631\u062f.<\/li>\n<li>\n<strong>\u0628\u0627 3 \u062a\u0645\u0627\u0633 \u0628\u06af\u06cc\u0631\u06cc\u062f (70b)<\/strong>: \u0641\u0631\u0648\u067e\u0627\u0634\u06cc \u062a\u0648\u062c\u0647 \u0645\u06cc\u0627\u0646\u0647 \u062f\u0631 \u0646\u0632\u062f\u06cc\u06a9\u06cc 16K \u0622\u063a\u0627\u0632 \u0645\u06cc \u0634\u0648\u062f.<\/li>\n<li>\n<strong>\u062f\u0631 \u0627\u0639\u0645\u0627\u0642<\/strong>: \u0622\u06af\u0627\u0647\u06cc \u067e\u0631\u0627\u06a9\u0646\u062f\u0647 \u0637\u0648\u0644\u0627\u0646\u06cc.<\/li>\n<\/ul>\n<p>\u0627\u06cc\u0646 \u062e\u0637\u0627\u0647\u0627\u06cc \u06af\u0631\u0645\u0627 \u0628\u0647 \u0648\u0636\u0648\u062d &#8220;\u0633\u0648\u0631\u0627\u062e \u067e\u06cc\u0631\u0627\u0634\u06a9\u06cc&#8221; \u0631\u0627 \u0646\u0634\u0627\u0646 \u0645\u06cc \u062f\u0647\u062f: \u062d\u062a\u06cc \u0628\u0627 \u0627\u0641\u0632\u0627\u06cc\u0634 \u0638\u0631\u0641\u06cc\u062a \u060c \u062a\u0648\u062c\u0647 \u0648 \u062f\u0642\u062a \u0628\u0647 \u0634\u062f\u062a \u062f\u0631 70-80 \u066a \u0627\u0632 \u0633\u0631\u06cc\u0639.<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/media2.dev.to\/dynamic\/image\/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto\/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fntzy271muprb1gfqd36b.png\" alt=\"\u067e\u0648\u0633\u06cc\u062f\u06af\u06cc \u062a\u0648\u062c\u0647 \u06a9\u0627\u0645\u067e\u0648\u0632\u06cc\u062a \u062f\u0631 \u0628\u06cc\u0646 \u0645\u062f\u0644 \u0647\u0627\" loading=\"lazy\" width=\"800\" height=\"525\" title=\"\"><\/p>\n<p>\u0648\u06cc\u0646\u062f\u0648\u0632\u0647\u0627\u06cc \u0632\u0645\u06cc\u0646\u0647 \u0637\u0648\u0644\u0627\u0646\u06cc \u0631\u0648\u06cc \u06a9\u0627\u063a\u0630 \u0639\u0627\u0644\u06cc \u0628\u0647 \u0646\u0638\u0631 \u0645\u06cc \u0631\u0633\u0646\u062f. \u0627\u0645\u0627 \u062f\u0631 \u0648\u0627\u0642\u0639\u06cc\u062a \u060c \u0627\u06a9\u062b\u0631 \u0645\u062f\u0644 \u0647\u0627 \u06cc\u06a9 \u0627\u0644\u06af\u0648\u06cc \u062a\u0648\u062c\u0647 U \u0634\u06a9\u0644 \u0631\u0627 \u0646\u0634\u0627\u0646 \u0645\u06cc \u062f\u0647\u0646\u062f: \u0622\u0646\u0647\u0627 \u0628\u0647 \u0634\u062f\u062a \u0634\u0631\u0648\u0639 \u0648 \u067e\u0627\u06cc\u0627\u0646 \u0645\u062a\u0646 \u0631\u0627 \u0648\u0632\u0646 \u0645\u06cc \u06a9\u0646\u0646\u062f \u0648 \u062a\u0627 \u062d\u062f \u0632\u06cc\u0627\u062f\u06cc \u0648\u0633\u0637 \u0631\u0627 \u0646\u0627\u062f\u06cc\u062f\u0647 \u0645\u06cc \u06af\u06cc\u0631\u0646\u062f. \u0627\u06cc\u0646 \u0645\u0634\u06a9\u0644 &#8220;\u0633\u0648\u0631\u0627\u062e \u062f\u0648\u0646\u0627\u062a&#8221; \u0627\u0633\u062a.<\/p>\n<blockquote>\n<p>\u0645\u062b\u0627\u0644 \u0648\u0627\u0642\u0639\u06cc: \u06cc\u06a9 \u0631\u06af 50\u060c000 \u062a\u0648\u0646 \u0641\u0648\u0631\u06cc \u067e\u0627\u0633\u062e \u062e\u0648\u062f \u0631\u0627 \u0628\u0627 25\u060c000 \u0646\u0641\u0631 \u062f\u0641\u0646 \u06a9\u0631\u062f\u0647 \u0627\u0633\u062a. \u0645\u062f\u0644 \u0622\u0646 \u0631\u0627 \u0627\u0632 \u062f\u0633\u062a \u0645\u06cc \u062f\u0647\u062f. \u0622\u0646 \u0631\u0627 \u0628\u0647 \u0633\u0645\u062a 1000 \u06cc\u0627 49\u060c000 \u0645\u0646\u062a\u0642\u0644 \u06a9\u0646\u06cc\u062f\u061f \u0645\u062f\u0644 \u0622\u0646 \u0631\u0627 \u0645\u06cc\u062e\u06a9\u0648\u0628 \u0645\u06cc \u06a9\u0646\u062f.<\/p>\n<\/blockquote>\n<p>Heatmaps \u0622\u0646 \u0631\u0627 \u062a\u0623\u06cc\u06cc\u062f \u0645\u06cc \u06a9\u0646\u062f: \u062a\u062c\u0633\u0645 \u062a\u0648\u062c\u0647 \u0646\u0634\u0627\u0646 \u0645\u06cc \u062f\u0647\u062f \u06a9\u0647 \u0645\u062f\u0644 \u0647\u0627 \u0631\u0648\u06cc \u062a\u0642\u062f\u0645 (\u0634\u0631\u0648\u0639) \u0648 recency (\u067e\u0627\u06cc\u0627\u0646) \u062a\u0645\u0631\u06a9\u0632 \u0645\u06cc \u06a9\u0646\u0646\u062f \u060c \u0628\u0627 \u062a\u0648\u062c\u0647 \u0628\u0647 \u067e\u0627\u06cc\u06cc\u0646 \u062f\u0631 \u0648\u0633\u0637.<\/p>\n<p><strong>\u0646\u062a\u06cc\u062c\u0647 \u0647\u0632\u06cc\u0646\u0647<\/strong>: \u0634\u0645\u0627 \u0628\u0631\u0627\u06cc \u0647\u0631 50\u060c000 \u0646\u0634\u0627\u0646\u0647 \u067e\u0631\u062f\u0627\u062e\u062a \u0645\u06cc \u06a9\u0646\u06cc\u062f \u060c \u0627\u0645\u0627 \u0641\u0642\u0637 10\u060c000-15\u060c000 \u0628\u0647 \u0637\u0648\u0631 \u0641\u0639\u0627\u0644 \u0645\u0648\u0631\u062f \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u0642\u0631\u0627\u0631 \u0645\u06cc \u06af\u06cc\u0631\u062f. \u0627\u06cc\u0646 \u06cc\u06a9 \u0632\u0628\u0627\u0644\u0647 70 \u066a \u067e\u0648\u0646\u062f \u0627\u0633\u062a.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"%D9%82%D8%B3%D9%85%D8%AA_2_%D8%A7%D9%86%D8%AF%D8%A7%D8%B2%D9%87_%DA%AF%DB%8C%D8%B1%DB%8C_%D8%B2%D8%A8%D8%A7%D9%84%D9%87_%D9%87%D8%A7\"><\/span>\n<p>  \u0642\u0633\u0645\u062a 2: \u0627\u0646\u062f\u0627\u0632\u0647 \u06af\u06cc\u0631\u06cc \u0632\u0628\u0627\u0644\u0647 \u0647\u0627<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u062f\u0631 \u0627\u06cc\u0646\u062c\u0627 \u06cc\u06a9 \u067e\u06cc\u0686\u0634 \u0634\u06af\u0641\u062a \u0622\u0648\u0631 \u0648\u062c\u0648\u062f \u062f\u0627\u0631\u062f: \u062f\u0631 \u0628\u0631\u062e\u06cc \u0627\u0632 \u0686\u062a \u0647\u0627\u06cc \u062e\u062f\u0645\u0627\u062a \u0645\u0634\u062a\u0631\u06cc \u060c \u0627\u0641\u0632\u0627\u06cc\u0634 \u067e\u0646\u062c\u0631\u0647 \u0632\u0645\u06cc\u0646\u0647 \u062f\u0631 \u0648\u0627\u0642\u0639 \u0646\u0645\u0631\u0627\u062a \u06a9\u0645\u06a9 \u0631\u0627 \u06a9\u0627\u0647\u0634 \u0645\u06cc \u062f\u0647\u062f. \u0686\u0631\u0627\u061f \u0627\u0632 \u0622\u0646\u062c\u0627 \u06a9\u0647 \u067e\u06cc\u0627\u0645 \u0647\u0627\u06cc \u06af\u0630\u0634\u062a\u0647 \u0628\u06cc \u0631\u0628\u0637 \u0628\u0647 \u0642\u06cc\u0645\u062a \u067e\u06cc\u0627\u0645 \u0647\u0627\u06cc \u0627\u062e\u06cc\u0631 \u0628\u0647 \u06cc\u0627\u062f \u0645\u06cc \u0622\u0645\u062f. \u0627\u06cc\u0646 \u0646\u0634\u0627\u0646 \u0645\u06cc \u062f\u0647\u062f \u06a9\u0647 \u0628\u0647 \u0633\u0627\u062f\u06af\u06cc \u0627\u0641\u0632\u0627\u06cc\u0634 \u0632\u0645\u06cc\u0646\u0647 \u0645\u06cc \u062a\u0648\u0627\u0646\u062f \u0628\u0627\u0639\u062b \u0627\u06cc\u062c\u0627\u062f \u062f\u0631\u0647\u0645 \u0648 \u0628\u0631\u0647\u0645\u06cc \u0645\u062a\u0646 \u0634\u0648\u062f-\u062c\u0627\u06cc\u06cc \u06a9\u0647 \u062d\u0627\u0641\u0638\u0647 \u0633\u06cc\u06af\u0646\u0627\u0644 \u0628\u06cc\u0634 \u0627\u0632 \u062d\u062f \u062a\u0648\u0627\u0646\u0627\u06cc\u06cc \u062a\u0645\u0631\u06a9\u0632 \u0645\u062f\u0644 \u0631\u0627 \u062a\u062e\u0631\u06cc\u0628 \u0645\u06cc \u06a9\u0646\u062f.<\/p>\n<p>\u0627\u0645\u0627 \u062f\u0631 \u0627\u06cc\u0646\u062c\u0627 \u06cc\u06a9 \u0645\u06a9\u0627\u0646\u06cc\u06a9 \u0639\u0645\u06cc\u0642 \u062a\u0631 \u0648 \u067e\u0646\u0647\u0627\u0646 \u0648\u062c\u0648\u062f \u062f\u0627\u0631\u062f: \u062a\u0648\u0631\u0645 \u0645\u062a\u0646 \u0641\u0642\u0637 \u0628\u06cc \u0641\u0627\u06cc\u062f\u0647 \u0646\u06cc\u0633\u062a &#8211; \u0627\u06cc\u0646 \u062a\u062e\u0635\u06cc\u0635 \u062a\u0648\u062c\u0647 \u0631\u0627 \u062a\u063a\u06cc\u06cc\u0631 \u0645\u06cc \u062f\u0647\u062f. \u0647\u0646\u06af\u0627\u0645 \u0645\u0642\u0627\u06cc\u0633\u0647 \u0647\u0645\u0627\u0646 \u0633\u0631\u06cc\u0639 \u062a\u063a\u0630\u06cc\u0647 \u0634\u062f\u0647 \u0628\u0627 GPT-4O \u0648 Claude 2.1 \u060c \u0645\u0627 \u0645\u0634\u0627\u0647\u062f\u0647 \u06a9\u0631\u062f\u06cc\u0645 \u06a9\u0647 \u06a9\u0644\u0648\u062f \u067e\u0633 \u0627\u0632 \u0639\u0628\u0648\u0631 \u0627\u0632 60 \u06a9\u06cc\u0644\u0648\u06af\u0631\u0645 \u060c \u062a\u0645\u0631\u06a9\u0632 \u062e\u0648\u062f \u0631\u0627 \u062f\u0631 \u0627\u0648\u0627\u06cc\u0644 \u0632\u0645\u06cc\u0646\u0647 \u0634\u0631\u0648\u0639 \u06a9\u0631\u062f. \u0627\u06cc\u0646 \u0641\u0631\u0648\u067e\u0627\u0634\u06cc \u0628\u0627\u0632\u067e\u0631\u062f\u0627\u062e\u062a \u0633\u06a9\u0648\u062a \u0627\u062a\u0641\u0627\u0642 \u0645\u06cc \u0627\u0641\u062a\u062f \u060c \u0648 \u0645\u0645\u06a9\u0646 \u0627\u0633\u062a \u062e\u0631\u0648\u062c\u06cc \u0647\u0627\u06cc \u063a\u06cc\u0631\u0642\u0627\u0628\u0644 \u067e\u06cc\u0634 \u0628\u06cc\u0646\u06cc \u062f\u0631 \u06af\u0631\u062f\u0634 \u06a9\u0627\u0631 \u0628\u0627 \u0632\u0646\u062c\u06cc\u0631\u0647 \u0637\u0648\u0644\u0627\u0646\u06cc \u0631\u0627 \u062a\u0648\u0636\u06cc\u062d \u062f\u0647\u062f.<\/p>\n<p>\u062f\u0631 \u0645\u0642\u0627\u0628\u0644 \u060c \u062f\u0631 \u062a\u062c\u0632\u06cc\u0647 \u0648 \u062a\u062d\u0644\u06cc\u0644 \u0627\u0633\u0646\u0627\u062f \u062d\u0642\u0648\u0642\u06cc \u060c \u0627\u06af\u0631 \u0628\u0646\u062f\u0647\u0627\u06cc \u06a9\u0644\u06cc\u062f\u06cc \u062f\u0631 \u062c\u0644\u0648 \u0628\u0627\u0631\u06af\u0630\u0627\u0631\u06cc \u0634\u0648\u0646\u062f \u060c \u067e\u0648\u0633\u06cc\u062f\u06af\u06cc \u062a\u0648\u062c\u0647 \u06a9\u0645\u062a\u0631 \u0645\u0636\u0631 \u0627\u0633\u062a-\u062a\u0642\u0648\u06cc\u062a \u0646\u06cc\u0627\u0632 \u0628\u0647 \u0627\u0633\u062a\u0631\u0627\u062a\u0698\u06cc \u0647\u0627\u06cc \u0633\u0631\u06cc\u0639 \u06a9\u0627\u0631.<\/p>\n<p>\u062f\u0631 \u0633\u06cc\u0633\u062a\u0645 \u0647\u0627\u06cc \u062a\u06a9\u0645\u06cc\u0644 \u06a9\u062f \u060c \u0645\u062f\u0644\u0647\u0627\u06cc\u06cc \u0645\u0627\u0646\u0646\u062f Claude \u0648 Gemini \u0645\u06cc \u062a\u0648\u0627\u0646\u0646\u062f \u062f\u0631 \u0635\u0648\u0631\u062a \u0642\u0631\u0627\u0631 \u062f\u0627\u062f\u0646 \u0627\u062e\u062a\u0644\u0627\u0641\u0627\u062a \u0637\u0648\u0644\u0627\u0646\u06cc \u06cc\u0627 \u0647\u062f\u0631 \u067e\u0631\u0648\u0646\u062f\u0647 \u062f\u0631 \u0627\u0648\u0627\u06cc\u0644 \u0633\u0631\u06cc\u0639 \u060c \u0628\u062f\u062a\u0631 \u0634\u0648\u0646\u062f. \u0645\u062a\u0646 \u0645\u0631\u062a\u0628 \u0633\u0627\u0632\u06cc \u0628\u0631\u0627\u06cc \u0642\u0631\u0627\u0631 \u062f\u0627\u062f\u0646 \u0645\u0646\u0627\u0633\u0628 \u062a\u0631\u06cc\u0646 \u0639\u0645\u0644\u06a9\u0631\u062f \u06cc\u0627 \u062a\u0633\u062a \u062f\u0631 \u0627\u0646\u062a\u0647\u0627 \u0646\u0631\u062e \u067e\u0627\u0633@1 \u0631\u0627 \u0627\u0641\u0632\u0627\u06cc\u0634 \u0645\u06cc \u062f\u0647\u062f.<\/p>\n<p>\u0645\u0639\u06cc\u0627\u0631\u0647\u0627\u06cc\u06cc \u0645\u0627\u0646\u0646\u062f Nolima \u0648 Lost in the Middle Lost \u0627\u06cc\u0646 \u0641\u0642\u0637 \u06cc\u06a9 \u0634\u06a9\u0627\u0631 \u0646\u06cc\u0633\u062a &#8211; \u0642\u0627\u0628\u0644 \u0627\u0646\u062f\u0627\u0632\u0647 \u06af\u06cc\u0631\u06cc \u0627\u0633\u062a.<\/p>\n<ul>\n<li>\u0637\u0648\u0644 \u0632\u0645\u06cc\u0646\u0647 \u0645\u0624\u062b\u0631: GPT-4O \u062a\u0627 8K ~ \u0646\u0634\u0627\u0646 \u0645\u06cc \u062f\u0647\u062f. \u0641\u0631\u0627\u062a\u0631 \u0627\u0632 \u0622\u0646 \u060c \u062f\u0642\u062a \u06a9\u0627\u0647\u0634 \u0645\u06cc \u06cc\u0627\u0628\u062f.\n<\/li>\n<li>\u0645\u0642\u0627\u06cc\u0633\u0647 \u0686\u0646\u062f \u0645\u062f\u0644: Claude 2.1 \u060c Gemini 1.5 \u060c Llama 3 \u060c Deepseek \u0648 Mistral \u0647\u0645\u0647 \u0642\u0637\u0631\u0647 \u0647\u0627\u06cc \u0645\u0634\u0627\u0628\u0647 \u0631\u0627 \u0646\u0634\u0627\u0646 \u0645\u06cc \u062f\u0647\u0646\u062f.\n<\/li>\n<li>\u062a\u0623\u062b\u06cc\u0631 \u0642\u06cc\u0645\u062a \u06af\u0630\u0627\u0631\u06cc: 200 \u062f\u0644\u0627\u0631 \u0646\u0634\u0627\u0646\u0647 \u0648\u0631\u0648\u062f\u06cc \u0641\u0642\u0637 \u0645\u0645\u06a9\u0646 \u0627\u0633\u062a 60 \u062f\u0644\u0627\u0631 \u0627\u0632 \u062e\u0631\u0648\u062c\u06cc \u0645\u0641\u06cc\u062f \u0628\u0627\u0634\u062f. \u0627\u06cc\u0646 \u06cc\u06a9 \u0636\u0631\u0628 \u0647\u0632\u06cc\u0646\u0647 3 \u0628\u0631\u0627\u0628\u0631 \u0628\u0631\u0627\u06cc \u0632\u0628\u0627\u0644\u0647 \u0627\u0633\u062a.<\/li>\n<\/ul>\n<p><img decoding=\"async\" src=\"https:\/\/media2.dev.to\/dynamic\/image\/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto\/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fa4uop4idiv0oolihjqcf.png\" alt=\"\u0647\u0632\u06cc\u0646\u0647 \u0647\u0631 \u062a\u0648\u06a9\u0646 \u0645\u0624\u062b\u0631 \u062f\u0631 \u0645\u0642\u0627\u0628\u0644 \u0637\u0648\u0644 \u0632\u0645\u06cc\u0646\u0647\" loading=\"lazy\" width=\"800\" height=\"521\" title=\"\"><\/p>\n<p>\u0634\u0627\u06cc\u0627\u0646 \u0630\u06a9\u0631 \u0627\u0633\u062a \u06a9\u0647 \u0622\u0646\u0686\u0647 \u0628\u0647 \u0639\u0646\u0648\u0627\u0646 \u06cc\u06a9 \u0646\u0634\u0627\u0646\u0647 &#8220;\u0645\u0624\u062b\u0631&#8221; \u062d\u0633\u0627\u0628 \u0645\u06cc \u0634\u0648\u062f \u060c \u0645\u06cc \u062a\u0648\u0627\u0646\u062f \u062e\u0627\u0635 \u06a9\u0627\u0631 \u0628\u0627\u0634\u062f. \u062f\u0631 \u0627\u06cc\u0646 \u0645\u0642\u0627\u0644\u0647 \u060c \u0645\u0627 \u0627\u0632 \u06cc\u06a9 \u062a\u0639\u0631\u06cc\u0641 \u0639\u0645\u0644\u06cc \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u0645\u06cc \u06a9\u0646\u06cc\u0645: \u0646\u0634\u0627\u0646\u0647 \u0647\u0627\u06cc\u06cc \u06a9\u0647 \u0628\u0647 \u0637\u0648\u0631 \u0622\u0634\u06a9\u0627\u0631 \u0628\u0631 \u062e\u0631\u0648\u062c\u06cc \u0645\u062f\u0644 \u062a\u0623\u062b\u06cc\u0631 \u0645\u06cc \u06af\u0630\u0627\u0631\u0646\u062f (\u0647\u0645\u0627\u0646\u0637\u0648\u0631 \u06a9\u0647 \u0628\u0627 \u062f\u0642\u062a \u060c \u0627\u0631\u062a\u0628\u0627\u0637 \u06cc\u0627 \u0645\u0646\u0628\u0639 \u0630\u06a9\u0631 \u0634\u062f\u0647 \u0627\u0646\u062f\u0627\u0632\u0647 \u06af\u06cc\u0631\u06cc \u0645\u06cc \u0634\u0648\u062f).<\/p>\n<h2><span class=\"ez-toc-section\" id=\"%D9%82%D8%B3%D9%85%D8%AA_3_%D9%85%D8%A7%D9%84%DB%8C%D8%A7%D8%AA_%D9%85%D9%88%D9%82%D8%B9%DB%8C%D8%AA\"><\/span>\n<p>  \u0642\u0633\u0645\u062a 3: \u0645\u0627\u0644\u06cc\u0627\u062a \u0645\u0648\u0642\u0639\u06cc\u062a<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u062c\u0627\u06cc\u06cc \u06a9\u0647 \u0645\u062d\u062a\u0648\u0627 \u062f\u0631 \u0633\u0631\u06cc\u0639 \u0634\u0645\u0627 \u0638\u0627\u0647\u0631 \u0645\u06cc \u0634\u0648\u062f \u0628\u0647 \u0637\u0631\u0632 \u0686\u0634\u0645\u06af\u06cc\u0631\u06cc \u0628\u0631 \u0639\u0645\u0644\u06a9\u0631\u062f \u062a\u0623\u062b\u06cc\u0631 \u0645\u06cc \u06af\u0630\u0627\u0631\u062f.<\/p>\n<ul>\n<li>\u0686\u0646\u062f \u0639\u06a9\u0633 \u0634\u0627\u062a: \u0645\u062f\u0644 \u0647\u0627 \u0627\u0632 \u0646\u0645\u0648\u0646\u0647 \u0647\u0627\u06cc\u06cc \u06a9\u0647 \u062f\u0631 \u0646\u0632\u062f\u06cc\u06a9\u06cc \u0627\u0646\u062a\u0647\u0627 \u0642\u0631\u0627\u0631 \u062f\u0627\u0631\u0646\u062f \u0628\u0647\u062a\u0631 \u0627\u0632 \u0648\u0633\u0637 \u0645\u06cc \u0622\u0645\u0648\u0632\u0646\u062f.\n<\/li>\n<li>\u0632\u0646\u062c\u06cc\u0631\u0647 \u0627\u06cc \u0627\u0632 \u0641\u06a9\u0631: \u0642\u0637\u0639\u0627\u062a \u0645\u0646\u0637\u0642 \u06af\u0627\u0645 \u0628\u0647 \u06af\u0627\u0645 \u0648\u0642\u062a\u06cc \u062f\u0648\u0631 \u0627\u0632 \u06a9\u0627\u0631 \u0646\u0647\u0627\u06cc\u06cc \u0642\u0631\u0627\u0631 \u0645\u06cc \u06af\u06cc\u0631\u0646\u062f.<\/li>\n<li>\u0633\u0641\u0627\u0631\u0634 RAG: \u0628\u0627\u0632\u06cc\u0627\u0628\u06cc \u0627\u0633\u0646\u0627\u062f \u06a9\u0627\u0641\u06cc \u0646\u06cc\u0633\u062a &#8211; \u0642\u0631\u0627\u0631 \u062f\u0627\u062f\u0646 \u0622\u0646\u0647\u0627 \u0628\u0647 \u062e\u0648\u0628\u06cc \u0628\u0633\u06cc\u0627\u0631 \u0645\u0647\u0645 \u0627\u0633\u062a.<\/li>\n<\/ul>\n<p><strong>\u063a\u0630\u0627\u06cc \u0627\u0635\u0644\u06cc<\/strong>: \u062f\u0631 \u0632\u0645\u06cc\u0646\u0647 \u0647\u0627\u06cc \u0637\u0648\u0644\u0627\u0646\u06cc \u060c \u0633\u0641\u0627\u0631\u0634 \u0647\u0645\u0647 \u0686\u06cc\u0632 \u0627\u0633\u062a. \u0633\u0648\u0621\u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u0627\u0632 \u062d\u0642\u0627\u06cc\u0642 \u06cc\u0627 \u0646\u0645\u0648\u0646\u0647 \u0647\u0627 \u0645\u0645\u06a9\u0646 \u0627\u0633\u062a \u0622\u0646\u0647\u0627 \u0631\u0627 \u0646\u0627\u0645\u0631\u0626\u06cc \u06a9\u0646\u062f.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"%D9%82%D8%B3%D9%85%D8%AA_%DA%86%D9%87%D8%A7%D8%B1%D9%85_%D9%85%D9%88%D9%82%D8%B9%DB%8C%D8%AA_%DB%8C%D8%A7%D8%A8%DB%8C_%D8%A7%D8%B3%D8%AA%D8%B1%D8%A7%D8%AA%DA%98%DB%8C%DA%A9\"><\/span>\n<p>  \u0642\u0633\u0645\u062a \u0686\u0647\u0627\u0631\u0645: \u0645\u0648\u0642\u0639\u06cc\u062a \u06cc\u0627\u0628\u06cc \u0627\u0633\u062a\u0631\u0627\u062a\u0698\u06cc\u06a9<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<h3><span class=\"ez-toc-section\" id=\"%D8%A7%D8%B3%D8%AA%D8%B1%D8%A7%D8%AA%DA%98%DB%8C_Bookend\"><\/span>\n<p>  \u0627\u0633\u062a\u0631\u0627\u062a\u0698\u06cc Bookend<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>\u0627\u06cc\u0646 \u0627\u0633\u062a\u0631\u0627\u062a\u0698\u06cc \u0627\u0632 \u062a\u0639\u0635\u0628 \u062a\u0648\u062c\u0647 \u0633\u0648\u0621 \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u0645\u06cc \u06a9\u0646\u062f: \u0645\u0647\u0645\u062a\u0631\u06cc\u0646 \u0632\u0645\u06cc\u0646\u0647 \u062e\u0648\u062f \u0631\u0627 \u062f\u0631 \u0647\u0645\u0627\u0646 \u0627\u0628\u062a\u062f\u0627 \u0648 \u062f\u0648\u0628\u0627\u0631\u0647 \u062f\u0631 \u067e\u0627\u06cc\u0627\u0646 \u0633\u0631\u06cc\u0639 \u062e\u0648\u062f \u0642\u0631\u0627\u0631 \u062f\u0647\u06cc\u062f.<\/p>\n<p><strong>\u0645\u062b\u0627\u0644:<\/strong><\/p>\n<p>\u0634\u0645\u0627 \u06cc\u06a9 \u062c\u0645\u0639 \u06a9\u0646\u0646\u062f\u0647 \u0642\u0631\u0627\u0631\u062f\u0627\u062f \u0647\u0633\u062a\u06cc\u062f. \u062a\u0627\u0631\u06cc\u062e \u0647\u0627\u06cc \u06a9\u0644\u06cc\u062f\u06cc \u0648 \u062a\u062d\u0648\u06cc\u0644 \u0631\u0627 \u0628\u0631\u062c\u0633\u062a\u0647 \u06a9\u0646\u06cc\u062f.<\/p>\n[Full contract text \u2013 40K tokens]\n<p>\u06cc\u0627\u062f\u0622\u0648\u0631\u06cc: \u0647\u062f\u0641 \u0634\u0645\u0627 \u0627\u0633\u062a\u062e\u0631\u0627\u062c \u06a9\u0644\u06cc\u0647 \u062a\u0627\u0631\u06cc\u062e \u0647\u0627\u06cc \u0645\u0647\u0645 \u0648 \u062a\u062d\u0648\u06cc\u0644 \u0627\u0633\u062a.<\/p>\n<p><strong>\u067e\u06cc\u0634\u0631\u0641\u062a \u0627\u0646\u062f\u0627\u0632\u0647 \u06af\u06cc\u0631\u06cc \u0634\u062f\u0647:<\/strong><\/p>\n<ul>\n<li>\u0628\u062f\u0648\u0646 \u06a9\u062a\u0627\u0628: 58 \u066a \u0627\u0633\u062a\u062e\u0631\u0627\u062c \u0635\u062d\u06cc\u062d<\/li>\n<li>\u0628\u0627 Bookend: 87 \u066a \u0627\u0633\u062a\u062e\u0631\u0627\u062c \u0635\u062d\u06cc\u062d<\/li>\n<\/ul>\n<p><img decoding=\"async\" src=\"https:\/\/media2.dev.to\/dynamic\/image\/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto\/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2Fjqd6nkz1z84egvcgp50l.png\" alt=\"\u062a\u0623\u062b\u06cc\u0631 \u0628\u0627\u0632\u0633\u0627\u0632\u06cc \u0633\u0631\u06cc\u0639 \u0628\u0631 \u062f\u0642\u062a QA\" loading=\"lazy\" width=\"800\" height=\"493\" title=\"\"><\/p>\n<p><strong>\u062a\u06a9\u0631\u0627\u0631 \u0627\u0636\u0627\u0641\u06cc \u0646\u06cc\u0633\u062a &#8211; \u0627\u06cc\u0646 \u062a\u0642\u0648\u06cc\u062a \u0627\u0633\u062a.<\/strong><\/p>\n<h3><span class=\"ez-toc-section\" id=\"chunking_%D8%AF%D8%B1_%D9%85%D9%82%D8%A7%D8%A8%D9%84_%D9%81%D8%B4%D8%B1%D8%AF%D9%87_%D8%B3%D8%A7%D8%B2%DB%8C\"><\/span>\n<p>  chunking \u062f\u0631 \u0645\u0642\u0627\u0628\u0644 \u0641\u0634\u0631\u062f\u0647 \u0633\u0627\u0632\u06cc<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<ul>\n<li>chunking: \u0648\u0631\u0648\u062f\u06cc \u0647\u0627\u06cc \u0628\u0632\u0631\u06af \u0631\u0627 \u0628\u0647 \u0642\u0637\u0639\u0627\u062a \u0642\u0627\u0628\u0644 \u067e\u0631\u062f\u0627\u0632\u0634 \u062a\u0642\u0633\u06cc\u0645 \u06a9\u0646\u06cc\u062f.<\/li>\n<li>\u0641\u0634\u0631\u062f\u0647 \u0633\u0627\u0632\u06cc: \u062e\u0644\u0627\u0635\u0647 \u0648 \u0641\u0642\u0637 \u0645\u0648\u0627\u0631\u062f \u0636\u0631\u0648\u0631\u06cc \u0631\u0627 \u0645\u0646\u062a\u0642\u0644 \u06a9\u0646\u06cc\u062f.<\/li>\n<\/ul>\n<h3><span class=\"ez-toc-section\" id=\"%D8%A7%D9%84%DA%AF%D9%88%D9%87%D8%A7%DB%8C_%D9%85%D9%87%D9%86%D8%AF%D8%B3%DB%8C_%D8%B3%D8%B1%DB%8C%D8%B9\"><\/span>\n<p>  \u0627\u0644\u06af\u0648\u0647\u0627\u06cc \u0645\u0647\u0646\u062f\u0633\u06cc \u0633\u0631\u06cc\u0639<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<ul>\n<li>\u0627\u0632 \u0647\u062f\u0631\u0647\u0627 \u060c \u062a\u0639\u06cc\u06cc\u0646 \u06a9\u0646\u0646\u062f\u0647 \u0647\u0627 \u0648 \u0646\u0634\u0627\u0646\u0647 \u0647\u0627\u06cc \u0642\u0627\u0644\u0628 \u0628\u0646\u062f\u06cc \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u06a9\u0646\u06cc\u062f.<\/li>\n<li>\u0633\u0627\u062e\u062a\u0627\u0631 \u0645\u0627\u0646\u0646\u062f \u0637\u0631\u062d \u0647\u0627.<\/li>\n<li>\u0627\u0647\u062f\u0627\u0641 \u0631\u0627 \u0642\u0628\u0644 \u0648 \u0628\u0639\u062f \u0627\u0632 \u0632\u0645\u06cc\u0646\u0647 \u0637\u0648\u0644\u0627\u0646\u06cc \u062a\u0642\u0648\u06cc\u062a \u06a9\u0646\u06cc\u062f.<\/li>\n<\/ul>\n<h3><span class=\"ez-toc-section\" id=\"%DA%86%D9%87_%D8%B2%D9%85%D8%A7%D9%86%DB%8C_%D8%A8%D8%B1%D8%A7%DB%8C_128K_%D9%BE%D8%B1%D8%AF%D8%A7%D8%AE%D8%AA_%DA%A9%D9%86%DB%8C%D8%AF\"><\/span>\n<p>  \u0686\u0647 \u0632\u0645\u0627\u0646\u06cc \u0628\u0631\u0627\u06cc 128K \u067e\u0631\u062f\u0627\u062e\u062a \u06a9\u0646\u06cc\u062f<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<ul>\n<li>\u0647\u0646\u06af\u0627\u0645\u06cc \u06a9\u0647 \u062e\u0648\u0627\u0646\u062f\u0646 \u062e\u0637\u06cc \u0645\u0633\u0627\u0626\u0644 \u0627\u0633\u062a (\u0628\u0647 \u0639\u0646\u0648\u0627\u0646 \u0645\u062b\u0627\u0644 \u060c \u0627\u0633\u0646\u0627\u062f \u062d\u0642\u0648\u0642\u06cc).<\/li>\n<li>\u0647\u0646\u06af\u0627\u0645\u06cc \u06a9\u0647 \u0634\u0645\u0627 \u0646\u0645\u06cc \u062a\u0648\u0627\u0646\u06cc\u062f \u0627\u0631\u062a\u0628\u0627\u0637 \u0631\u0627 \u067e\u06cc\u0634 \u0628\u06cc\u0646\u06cc \u06a9\u0646\u06cc\u062f \u0648 \u0628\u0627\u06cc\u062f \u0646\u06cc\u0631\u0648\u06cc \u0628\u06cc \u0631\u062d\u0645\u0627\u0646\u0647 \u062f\u0627\u0634\u062a\u0647 \u0628\u0627\u0634\u06cc\u062f.<\/li>\n<\/ul>\n<p>\u062f\u0631 \u063a\u06cc\u0631 \u0627\u06cc\u0646 \u0635\u0648\u0631\u062a\u061f \u0628\u0631\u0627\u06cc 32K \u06cc\u0627 \u06a9\u0645\u062a\u0631 \u0628\u0647\u06cc\u0646\u0647 \u0633\u0627\u0632\u06cc \u06a9\u0646\u06cc\u062f.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"%D9%82%D8%B3%D9%85%D8%AA_5_%D8%A7%D8%A8%D8%B2%D8%A7%D8%B1_%D9%88_%D8%AA%D8%B4%D8%AE%DB%8C%D8%B5\"><\/span>\n<p>  \u0642\u0633\u0645\u062a 5: \u0627\u0628\u0632\u0627\u0631 \u0648 \u062a\u0634\u062e\u06cc\u0635<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<h3><span class=\"ez-toc-section\" id=\"%D9%82%D8%B7%D8%B9%D9%87_%DA%A9%D8%AF_%D8%A7%D9%86%D8%AF%D8%A7%D8%B2%D9%87_%DA%AF%DB%8C%D8%B1%DB%8C_%D8%AD%D8%B3%D8%A7%D8%B3%DB%8C%D8%AA_%D8%A8%D9%87_%D9%85%D9%88%D9%82%D8%B9%DB%8C%D8%AA\"><\/span>\n<p>  \u0642\u0637\u0639\u0647 \u06a9\u062f: \u0627\u0646\u062f\u0627\u0632\u0647 \u06af\u06cc\u0631\u06cc \u062d\u0633\u0627\u0633\u06cc\u062a \u0628\u0647 \u0645\u0648\u0642\u0639\u06cc\u062a<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight python\"><code><span class=\"kn\">import<\/span> <span class=\"n\">openai<\/span>\n\n<span class=\"n\">TEMPLATE<\/span> <span class=\"o\">=<\/span> <span class=\"sh\">\"\"\"<\/span><span class=\"s\">\nContext:\n{text}\n\nQuestion: {question}\nAnswer:\n<\/span><span class=\"sh\">\"\"\"<\/span>\n\n<span class=\"k\">def<\/span> <span class=\"nf\">generate_response<\/span><span class=\"p\">(<\/span><span class=\"n\">text_block<\/span><span class=\"p\">,<\/span> <span class=\"n\">question<\/span><span class=\"p\">):<\/span>\n    <span class=\"n\">prompt<\/span> <span class=\"o\">=<\/span> <span class=\"n\">TEMPLATE<\/span><span class=\"p\">.<\/span><span class=\"nf\">format<\/span><span class=\"p\">(<\/span><span class=\"n\">text<\/span><span class=\"o\">=<\/span><span class=\"n\">text_block<\/span><span class=\"p\">,<\/span> <span class=\"n\">question<\/span><span class=\"o\">=<\/span><span class=\"n\">question<\/span><span class=\"p\">)<\/span>\n    <span class=\"n\">response<\/span> <span class=\"o\">=<\/span> <span class=\"n\">openai<\/span><span class=\"p\">.<\/span><span class=\"n\">ChatCompletion<\/span><span class=\"p\">.<\/span><span class=\"nf\">create<\/span><span class=\"p\">(<\/span>\n        <span class=\"n\">model<\/span><span class=\"o\">=<\/span><span class=\"sh\">\"<\/span><span class=\"s\">gpt-4-1106-preview<\/span><span class=\"sh\">\"<\/span><span class=\"p\">,<\/span>\n        <span class=\"n\">messages<\/span><span class=\"o\">=<\/span><span class=\"p\">[{<\/span><span class=\"sh\">\"<\/span><span class=\"s\">role<\/span><span class=\"sh\">\"<\/span><span class=\"p\">:<\/span> <span class=\"sh\">\"<\/span><span class=\"s\">user<\/span><span class=\"sh\">\"<\/span><span class=\"p\">,<\/span> <span class=\"sh\">\"<\/span><span class=\"s\">content<\/span><span class=\"sh\">\"<\/span><span class=\"p\">:<\/span> <span class=\"n\">prompt<\/span><span class=\"p\">}],<\/span>\n        <span class=\"n\">temperature<\/span><span class=\"o\">=<\/span><span class=\"mi\">0<\/span>\n    <span class=\"p\">)<\/span>\n    <span class=\"k\">return<\/span> <span class=\"n\">response<\/span><span class=\"p\">.<\/span><span class=\"n\">choices<\/span><span class=\"p\">[<\/span><span class=\"mi\">0<\/span><span class=\"p\">].<\/span><span class=\"n\">message<\/span><span class=\"p\">[<\/span><span class=\"sh\">'<\/span><span class=\"s\">content<\/span><span class=\"sh\">'<\/span><span class=\"p\">]<\/span>\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<p>\u0627\u06cc\u0646 \u06a9\u0627\u0631 \u0631\u0627 \u0628\u0627 \u062a\u0639\u0628\u06cc\u0647 \u0648\u0627\u0642\u0639\u06cc\u062a \u0647\u062f\u0641 \u062e\u0648\u062f \u062f\u0631 \u0645\u0648\u0642\u0639\u06cc\u062a \u0647\u0627\u06cc \u0645\u062e\u062a\u0644\u0641 \u0646\u0634\u0627\u0646\u0647 \u0648 \u0648\u0631\u0648\u062f \u0628\u0647 \u0633\u06cc\u0633\u062a\u0645 \u0622\u06cc\u0627 \u067e\u0627\u0633\u062e \u0635\u062d\u06cc\u062d \u0628\u0627\u0642\u06cc \u0645\u0627\u0646\u062f\u0647 \u0627\u0633\u062a. \u0628\u0631\u0627\u06cc \u062a\u062c\u0633\u0645 \u062a\u062e\u0631\u06cc\u0628 \u060c \u062f\u0642\u062a \u062f\u0631 \u0628\u0631\u0627\u0628\u0631 \u062a\u0648\u06a9\u0646 \u062c\u0628\u0631\u0627\u0646 \u06a9\u0646\u06cc\u062f.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"%D8%A8%D8%A7%D8%B2%D8%B3%D8%A7%D8%B2%DB%8C_%D8%B3%D8%B1%DB%8C%D8%B9_%D8%AF%D8%B1_%D8%AF%D9%86%DB%8C%D8%A7%DB%8C_%D9%88%D8%A7%D9%82%D8%B9%DB%8C\"><\/span>\n<p>  \u0628\u0627\u0632\u0633\u0627\u0632\u06cc \u0633\u0631\u06cc\u0639 \u062f\u0631 \u062f\u0646\u06cc\u0627\u06cc \u0648\u0627\u0642\u0639\u06cc<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<ul>\n<li>\u0642\u0628\u0644 \u0627\u0632 \u0627\u06cc\u0646: \u06cc\u06a9 QA \u0641\u0648\u0631\u06cc \u067e\u0631 \u0627\u0632 \u0646\u0634\u0627\u0646\u0647 \u0647\u0627\u06cc 50K \u060c \u062f\u0631 24\u060c000 \u0628\u0647 \u0646\u0634\u0627\u0646\u0647 \u067e\u0627\u0633\u062e \u062f\u0647\u06cc\u062f. \u0646\u062a\u06cc\u062c\u0647: \u0627\u0634\u062a\u0628\u0627\u0647\n<\/li>\n<li>\u067e\u0633 \u0627\u0632: \u0647\u0645\u0627\u0646 \u067e\u0627\u0633\u062e \u0628\u0647 1000 \u0627\u0634\u0627\u0631\u0647 \u0634\u062f \u060c \u0633\u067e\u0633 \u062f\u0631 \u067e\u0627\u06cc\u0627\u0646 \u062f\u0648\u0628\u0627\u0631\u0647 \u062f\u0648\u0628\u0627\u0631\u0647 \u0627\u0636\u0627\u0641\u0647 \u0634\u062f. \u0646\u062a\u06cc\u062c\u0647: \u062f\u0631\u0633\u062a \u0627\u0633\u062a.<\/li>\n<\/ul>\n<p>\u0633\u0648\u062f: \u062f\u0642\u062a \u0627\u0632 42 \u066a \u0628\u0647 91 \u066a \u062f\u0631 50 \u0633\u0624\u0627\u0644 \u0622\u0632\u0645\u0648\u0646 \u0628\u0647\u0628\u0648\u062f \u06cc\u0627\u0641\u062a\u0647 \u0627\u0633\u062a. \u0647\u0632\u06cc\u0646\u0647 \u0647\u0631 \u067e\u0627\u0633\u062e \u0645\u0624\u062b\u0631 \u0627\u0632 0.78 \u062f\u0644\u0627\u0631 \u0628\u0647 0.26 \u062f\u0644\u0627\u0631 \u06a9\u0627\u0647\u0634 \u06cc\u0627\u0641\u062a\u0647 \u0627\u0633\u062a.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"%DA%86%DA%AF%D9%88%D9%86%D9%87_%D9%85%DB%8C_%D8%AA%D9%88%D8%A7%D9%86_%D8%A2%D9%86%DA%86%D9%87_%D8%B1%D8%A7_%DA%A9%D9%87_%DA%A9%D8%A7%D8%B1_%D9%85%DB%8C_%DA%A9%D9%86%D8%AF_%D8%A7%D9%86%D8%AF%D8%A7%D8%B2%D9%87_%DA%AF%DB%8C%D8%B1%DB%8C_%DA%A9%D9%86%DB%8C%D9%85\"><\/span>\n<p>  \u0686\u06af\u0648\u0646\u0647 \u0645\u06cc \u062a\u0648\u0627\u0646 \u0622\u0646\u0686\u0647 \u0631\u0627 \u06a9\u0647 \u06a9\u0627\u0631 \u0645\u06cc \u06a9\u0646\u062f \u0627\u0646\u062f\u0627\u0632\u0647 \u06af\u06cc\u0631\u06cc \u06a9\u0646\u06cc\u0645<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>\u0622\u06cc\u0627 \u0645\u06cc \u062e\u0648\u0627\u0647\u06cc\u062f \u0627\u0644\u06af\u0648\u0647\u0627\u06cc \u062a\u0648\u062c\u0647 \u0631\u0627 \u062f\u0631 \u0627\u0639\u0644\u0627\u0646 \u0647\u0627\u06cc \u062e\u0648\u062f \u062a\u062c\u0633\u0645 \u06a9\u0646\u06cc\u062f\u061f \u0628\u0627 \u0631\u0648\u06cc\u06a9\u0631\u062f \u0632\u06cc\u0631 \u0627\u0632 Bertviz \u06cc\u0627 \u0628\u063a\u0644 \u06a9\u0631\u062f\u0646 \u062a\u0631\u0627\u0646\u0633\u0641\u0648\u0631\u0645\u0627\u062a\u0648\u0631\u0647\u0627\u06cc Face \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u06a9\u0646\u06cc\u062f:<\/p>\n<div class=\"highlight js-code-highlight\">\n<pre class=\"highlight python\"><code><span class=\"kn\">from<\/span> <span class=\"n\">transformers<\/span> <span class=\"kn\">import<\/span> <span class=\"n\">AutoTokenizer<\/span><span class=\"p\">,<\/span> <span class=\"n\">AutoModel<\/span><span class=\"p\">,<\/span> <span class=\"n\">BertModel<\/span>\n<span class=\"kn\">from<\/span> <span class=\"n\">bertviz<\/span> <span class=\"kn\">import<\/span> <span class=\"n\">head_view<\/span>\n\n<span class=\"n\">model_name<\/span> <span class=\"o\">=<\/span> <span class=\"sh\">'<\/span><span class=\"s\">bert-base-uncased<\/span><span class=\"sh\">'<\/span>\n<span class=\"n\">tokenizer<\/span> <span class=\"o\">=<\/span> <span class=\"n\">AutoTokenizer<\/span><span class=\"p\">.<\/span><span class=\"nf\">from_pretrained<\/span><span class=\"p\">(<\/span><span class=\"n\">model_name<\/span><span class=\"p\">)<\/span>\n<span class=\"n\">model<\/span> <span class=\"o\">=<\/span> <span class=\"n\">AutoModel<\/span><span class=\"p\">.<\/span><span class=\"nf\">from_pretrained<\/span><span class=\"p\">(<\/span><span class=\"n\">model_name<\/span><span class=\"p\">,<\/span> <span class=\"n\">output_attentions<\/span><span class=\"o\">=<\/span><span class=\"bp\">True<\/span><span class=\"p\">)<\/span>\n\n<span class=\"n\">sentence<\/span> <span class=\"o\">=<\/span> <span class=\"sh\">\"<\/span><span class=\"s\">Your long-context example here.<\/span><span class=\"sh\">\"<\/span>\n<span class=\"n\">inputs<\/span> <span class=\"o\">=<\/span> <span class=\"n\">tokenizer<\/span><span class=\"p\">.<\/span><span class=\"nf\">encode_plus<\/span><span class=\"p\">(<\/span><span class=\"n\">sentence<\/span><span class=\"p\">,<\/span> <span class=\"n\">return_tensors<\/span><span class=\"o\">=<\/span><span class=\"sh\">'<\/span><span class=\"s\">pt<\/span><span class=\"sh\">'<\/span><span class=\"p\">)<\/span>\n<span class=\"n\">outputs<\/span> <span class=\"o\">=<\/span> <span class=\"nf\">model<\/span><span class=\"p\">(<\/span><span class=\"o\">**<\/span><span class=\"n\">inputs<\/span><span class=\"p\">)<\/span>\n<span class=\"n\">attention<\/span> <span class=\"o\">=<\/span> <span class=\"n\">outputs<\/span><span class=\"p\">.<\/span><span class=\"n\">attentions<\/span>\n\n<span class=\"nf\">head_view<\/span><span class=\"p\">(<\/span><span class=\"n\">attention<\/span><span class=\"p\">,<\/span> <span class=\"n\">tokens<\/span><span class=\"o\">=<\/span><span class=\"n\">tokenizer<\/span><span class=\"p\">.<\/span><span class=\"nf\">convert_ids_to_tokens<\/span><span class=\"p\">(<\/span><span class=\"n\">inputs<\/span><span class=\"p\">[<\/span><span class=\"sh\">'<\/span><span class=\"s\">input_ids<\/span><span class=\"sh\">'<\/span><span class=\"p\">][<\/span><span class=\"mi\">0<\/span><span class=\"p\">]))<\/span>\n<\/code><\/pre>\n<div class=\"highlight__panel js-actions-panel\">\n<div class=\"highlight__panel-action js-fullscreen-code-action\">\n    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-on\"><title>\u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u0631\u0627 \u0648\u0627\u0631\u062f \u06a9\u0646\u06cc\u062f<\/title>\n    <path d=\"M16 3h6v6h-2V5h-4V3zM2 3h6v2H4v4H2V3zm18 16v-4h2v6h-6v-2h4zM4 19h4v2H2v-6h2v4z\"\/>\n<\/svg><\/p>\n<p>    <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"20px\" height=\"20px\" viewbox=\"0 0 24 24\" class=\"highlight-action crayons-icon highlight-action--fullscreen-off\"><title>\u0627\u0632 \u062d\u0627\u0644\u062a \u062a\u0645\u0627\u0645 \u0635\u0641\u062d\u0647 \u062e\u0627\u0631\u062c \u0634\u0648\u06cc\u062f<\/title>\n    <path d=\"M18 7h4v2h-6V3h2v4zM8 9H2V7h4V3h2v6zm10 8v4h-2v-6h6v2h-4zM8 15v6H6v-4H2v-2h6z\"\/>\n<\/svg><\/p>\n<\/div>\n<\/div>\n<\/div>\n<p>\u0627\u06cc\u0646 \u0628\u0647 \u0637\u0648\u0631 \u0645\u0633\u062a\u0642\u06cc\u0645 \u0628\u0627 GPT-4 \u06a9\u0627\u0631 \u0646\u0645\u06cc \u06a9\u0646\u062f \u060c \u0627\u0645\u0627 \u0628\u0631\u0627\u06cc \u0627\u0634\u06a9\u0627\u0644 \u0632\u062f\u0627\u06cc\u06cc \u062a\u0639\u0635\u0628 \u0645\u0648\u0642\u0639\u06cc\u062a\u06cc \u062f\u0631 \u0645\u062f\u0644 \u0647\u0627\u06cc \u0628\u0627\u0632 \u06cc\u0627 \u0639\u0648\u0627\u0645\u0644 \u062a\u0646\u0638\u06cc\u0645 \u0634\u062f\u0647 \u062e\u0648\u0628 \u0627\u0631\u0632\u0634\u0645\u0646\u062f \u0627\u0633\u062a. \u0627\u0628\u0632\u0627\u0631\u0647\u0627\u06cc \u0645\u0634\u0627\u0628\u0647\u06cc \u0628\u0631\u0627\u06cc \u0627\u0646\u0648\u0627\u0639 Llama \u0648 mistral \u0648\u062c\u0648\u062f \u062f\u0627\u0631\u062f.<\/p>\n<p><strong>\u0627\u0628\u0632\u0627\u0631\u0647\u0627\u06cc \u0627\u0636\u0627\u0641\u06cc:<\/strong><\/p>\n<ul>\n<li>\n<code>bertviz<\/code>\u060c \u0646\u0642\u0634\u0647 \u0647\u0627\u06cc \u06af\u0631\u0645\u0627\u06cc \u062a\u0648\u062c\u0647<\/li>\n<li>\u0641\u0631\u0633\u0627\u06cc\u0634 \u0633\u0631\u06cc\u0639: \u0628\u062e\u0634 \u0647\u0627 \u0631\u0627 \u062d\u0630\u0641 \u06a9\u0631\u062f\u0647 \u0648 \u062e\u0631\u0648\u062c\u06cc \u0647\u0627 \u0631\u0627 \u0645\u0642\u0627\u06cc\u0633\u0647 \u06a9\u0646\u06cc\u062f<\/li>\n<li>\u0645\u0648\u0642\u0639\u06cc\u062a \u0648\u0631\u0648\u062f \u0628\u0647 \u0633\u06cc\u0633\u062a\u0645: \u062f\u0642\u062a \u067e\u0627\u0633\u062e \u0636\u0628\u0637 \u062f\u0631 \u0645\u0642\u0627\u0628\u0644 \u0645\u0648\u0642\u0639\u06cc\u062a \u062a\u0648\u06a9\u0646<\/li>\n<\/ul>\n<p><strong>\u062a\u062c\u0633\u0645 \u0648 \u0648\u0631\u0648\u062f \u0628\u0647 \u0633\u06cc\u0633\u062a\u0645:<\/strong><\/p>\n<ul>\n<li>\u0627\u0632 \u0627\u0633\u06a9\u0631\u06cc\u067e\u062a \u0647\u0627\u06cc Openai Evals \u060c \u0631\u062f\u06cc\u0627\u0628\u06cc Langchain \u06cc\u0627 RAG \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u06a9\u0646\u06cc\u062f<\/li>\n<li>\u0627\u06cc\u062c\u0627\u062f \u062f\u0627\u0634\u0628\u0648\u0631\u062f \u06a9\u0627\u0631\u0627\u06cc\u06cc \u062a\u0648\u06a9\u0646: \u0647\u0632\u06cc\u0646\u0647 \u062f\u0631 \u0645\u0642\u0627\u0628\u0644 \u067e\u0627\u0633\u062e \u0648\u0641\u0627\u062f\u0627\u0631\u06cc<\/li>\n<\/ul>\n<h3><span class=\"ez-toc-section\" id=\"%D8%AF%D8%B1_%D9%87%D8%B1_%D8%A8%D8%A7%D8%B1\"><\/span>\n<p>  \u062f\u0631 \u0647\u0631 \u0628\u0627\u0631<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>\u0647\u0632\u06cc\u0646\u0647 \u067e\u06cc\u06af\u06cc\u0631\u06cc \u062f\u0631 \u0647\u0631 \u0646\u0634\u0627\u0646\u0647 \u062e\u0631\u0648\u062c\u06cc \u0645\u0641\u06cc\u062f \u060c \u0646\u0647 \u06a9\u0644 \u0646\u0634\u0627\u0646\u0647 \u0647\u0627\u06cc \u0645\u0648\u0631\u062f \u0627\u0633\u062a\u0641\u0627\u062f\u0647.<\/p>\n<p><strong>\u0627\u06cc\u0646 \u0645\u062a\u0631\u06cc\u06a9 ROI \u0648\u0627\u0642\u0639\u06cc \u0634\u0645\u0627\u0633\u062a.<\/strong><\/p>\n<h2><span class=\"ez-toc-section\" id=\"%D9%86%D8%AA%DB%8C%D8%AC%D9%87_%DA%AF%DB%8C%D8%B1%DB%8C_%D9%85%D9%87%D9%86%D8%AF%D8%B3%DB%8C_%D8%A8%D8%B1%D8%A7%DB%8C_%D8%AA%D9%88%D8%AC%D9%87\"><\/span>\n<p>  \u0646\u062a\u06cc\u062c\u0647 \u06af\u06cc\u0631\u06cc: \u0645\u0647\u0646\u062f\u0633\u06cc \u0628\u0631\u0627\u06cc \u062a\u0648\u062c\u0647<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>\u0634\u0645\u0627 \u0628\u0631\u0627\u06cc \u06cc\u06a9 \u0635\u0641\u062d\u0647 \u06a9\u0627\u0645\u0644 \u067e\u0631\u062f\u0627\u062e\u062a \u06a9\u0631\u062f\u06cc\u062f. \u0645\u062f\u0644 \u0639\u0646\u0648\u0627\u0646 \u0648 PS \u0631\u0627 \u062e\u0648\u0627\u0646\u062f\u0647 \u0627\u0633\u062a<\/p>\n<p>\u0641\u0648\u0631\u06cc \u0645\u062f\u0631\u0646 \u0628\u0627\u06cc\u062f \u0645\u0647\u0646\u062f\u0633\u06cc \u0622\u06af\u0627\u0647 \u062a\u0648\u062c\u0647 \u0634\u0648\u062f:<\/p>\n<ul>\n<li>\u0627\u0637\u0644\u0627\u0639\u0627\u062a \u0628\u062d\u0631\u0627\u0646\u06cc \u0631\u0627 \u062f\u0631 \u062c\u0627\u06cc\u06cc \u06a9\u0647 \u0645\u062f\u0644 \u0647\u0627 \u0645\u06cc \u062a\u0648\u0627\u0646\u0646\u062f \u0622\u0646 \u0631\u0627 \u0645\u0634\u0627\u0647\u062f\u0647 \u06a9\u0646\u0646\u062f \u0642\u0631\u0627\u0631 \u062f\u0647\u06cc\u062f. <\/li>\n<li>\u0633\u0627\u062e\u062a\u0627\u0631 \u0645\u0627\u0646\u0646\u062f \u0627\u0633\u0646\u0627\u062f: \u0639\u0646\u0648\u0627\u0646 \u060c \u0628\u062e\u0634 \u060c \u062e\u0644\u0627\u0635\u0647.<\/li>\n<li>\u0628\u0631\u0627\u06cc \u0641\u06cc\u0644\u062a\u0631 \u06a9\u0631\u062f\u0646 \u0646\u0648\u06cc\u0632 \u0627\u0632 \u0628\u0627\u0632\u06cc\u0627\u0628\u06cc \u0648 \u062e\u0644\u0627\u0635\u0647 \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u06a9\u0646\u06cc\u062f.<\/li>\n<li>\u0622\u0646\u0686\u0647 \u0631\u0627 \u06a9\u0647 \u0646\u0634\u0627\u0646\u0647 \u0647\u0627\u06cc \u0634\u0645\u0627 \u0627\u0646\u062c\u0627\u0645 \u0645\u06cc \u062f\u0647\u0646\u062f \u060c \u0627\u0646\u062f\u0627\u0632\u0647 \u06af\u06cc\u0631\u06cc \u06a9\u0646\u06cc\u062f \u060c \u0646\u0647 \u0641\u0642\u0637 \u0622\u0646\u0686\u0647 \u0647\u0633\u062a\u0646\u062f.<\/li>\n<\/ul>\n<blockquote>\n<p>\u0632\u0645\u06cc\u0646\u0647 \u0637\u0648\u0644\u0627\u0646\u06cc \u062c\u0627\u062f\u0648\u06cc\u06cc \u0646\u06cc\u0633\u062a. \u0627\u06cc\u0646 \u062d\u0627\u0641\u0638\u0647 \u0628\u0627 \u0627\u062d\u062a\u06cc\u0627\u0637 \u0627\u0633\u062a. \u0628\u0631 \u0647\u0645\u06cc\u0646 \u0627\u0633\u0627\u0633 \u0628\u0647\u06cc\u0646\u0647 \u0633\u0627\u0632\u06cc \u06a9\u0646\u06cc\u062f.<\/p>\n<\/blockquote>\n<h2><span class=\"ez-toc-section\" id=\"%D9%85%D9%84%D8%A7%D8%AD%D8%B8%D8%A7%D8%AA_%D8%AC%D8%B2%D8%A6%DB%8C_%D9%88_%D8%A7%D9%81%DA%A9%D8%A7%D8%B1_%D8%A8%DB%8C%D8%B4%D8%AA%D8%B1\"><\/span>\n<p>  \u0645\u0644\u0627\u062d\u0638\u0627\u062a \u062c\u0632\u0626\u06cc \u0648 \u0627\u0641\u06a9\u0627\u0631 \u0628\u06cc\u0634\u062a\u0631<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<h3><span class=\"ez-toc-section\" id=\"%D9%85%D8%AD%D8%AF%D9%88%D8%AF%DB%8C%D8%AA_%D9%87%D8%A7%DB%8C_%D9%85%D8%B9%D9%85%D8%A7%D8%B1%DB%8C\"><\/span>\n<p>  \u0645\u062d\u062f\u0648\u062f\u06cc\u062a \u0647\u0627\u06cc \u0645\u0639\u0645\u0627\u0631\u06cc<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>\u062f\u0631 \u062d\u0627\u0644\u06cc \u06a9\u0647 \u0627\u06cc\u0646 \u0631\u0627\u0647\u0646\u0645\u0627 \u0628\u0631 \u0631\u0648\u06cc \u063a\u0630\u0627\u0647\u0627\u06cc \u0639\u0645\u0644\u06cc \u0645\u062a\u0645\u0631\u06a9\u0632 \u0627\u0633\u062a \u060c \u0645\u0648\u0636\u0648\u0639\u0627\u062a \u0627\u0633\u0627\u0633\u06cc \u0646\u0627\u0634\u06cc \u0627\u0632 \u0646\u062d\u0648\u0647 \u0645\u0639\u0645\u0627\u0631\u06cc \u062a\u0631\u0627\u0646\u0633\u0641\u0648\u0631\u0645\u0627\u062a\u0648\u0631\u0647\u0627 \u0627\u0633\u062a. \u062a\u0639\u0628\u06cc\u0647 \u0647\u0627\u06cc \u0645\u0648\u0642\u0639\u06cc\u062a \u062b\u0627\u0628\u062a \u060c \u0645\u06a9\u0627\u0646\u06cc\u0633\u0645 \u0647\u0627\u06cc \u062a\u0648\u062c\u0647 \u0646\u0627\u06a9\u0627\u0631\u0622\u0645\u062f \u0648 \u062a\u0639\u0635\u0628\u0627\u062a \u0622\u0645\u0648\u0632\u0634 \u0647\u0645\u0647 \u062f\u0631 \u0627\u0644\u06af\u0648\u06cc \u062a\u0648\u062c\u0647 U \u0634\u06a9\u0644 \u0646\u0642\u0634 \u062f\u0627\u0631\u0646\u062f. \u0628\u0631\u062e\u06cc \u0627\u0632 \u0645\u062f\u0644 \u0647\u0627 \u0633\u0639\u06cc \u062f\u0631 \u067e\u0631\u062f\u0627\u062e\u062a\u0646 \u0628\u0647 \u0627\u06cc\u0646 \u0627\u0645\u0631 \u0628\u0627 \u0631\u0645\u0632\u06af\u0630\u0627\u0631\u06cc \u0645\u0648\u0642\u0639\u06cc\u062a \u0647\u0627\u06cc \u0622\u0645\u0648\u062e\u062a\u0647 \u0634\u062f\u0647 \u06cc\u0627 \u0627\u0644\u06af\u0648\u0647\u0627\u06cc \u062a\u0648\u062c\u0647 \u067e\u0631\u0627\u06a9\u0646\u062f\u0647 \u062f\u0627\u0631\u0646\u062f \u060c \u0627\u0645\u0627 \u0647\u0645\u0686\u0646\u0627\u0646 \u06cc\u06a9 \u06a9\u0627\u0631 \u062f\u0631 \u062d\u0627\u0644 \u0627\u0646\u062c\u0627\u0645 \u0627\u0633\u062a.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"%D9%85%D8%AF%D9%84_%D9%87%D8%A7%DB%8C_%D8%AA%D9%88%D8%AC%D9%87_%D9%BE%D9%88%DB%8C%D8%A7\"><\/span>\n<p>  \u0645\u062f\u0644 \u0647\u0627\u06cc \u062a\u0648\u062c\u0647 \u067e\u0648\u06cc\u0627<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>\u0645\u0639\u0645\u0627\u0631\u06cc \u0647\u0627\u06cc \u062c\u062f\u06cc\u062f\u062a\u0631 \u062f\u0631 \u062d\u0627\u0644 \u0628\u0631\u0631\u0633\u06cc \u062a\u062e\u0635\u06cc\u0635 \u062a\u0648\u062c\u0647 \u067e\u0648\u06cc\u0627 \u062a\u0631 \u0647\u0633\u062a\u0646\u062f \u0648 \u0686\u0646\u062f\u06cc\u0646 \u0631\u0648\u06cc\u06a9\u0631\u062f \u0627\u0645\u06cc\u062f\u0648\u0627\u0631 \u06a9\u0646\u0646\u062f\u0647 \u062f\u0631 \u062d\u0627\u0644 \u0638\u0647\u0648\u0631 \u0627\u0633\u062a:<\/p>\n<ul>\n<li>\u0645\u0627\u0645\u0628\u0627 \u0645\u062f\u0644 \u0633\u0627\u0632\u06cc \u0641\u0636\u0627\u06cc \u062d\u0627\u0644\u062a \u0631\u0627 \u0628\u0631\u0627\u06cc \u067e\u0631\u062f\u0627\u0632\u0634 \u062f\u0646\u0628\u0627\u0644\u0647 \u0637\u0648\u0644\u0627\u0646\u06cc \u0645\u0639\u0631\u0641\u06cc \u0645\u06cc \u06a9\u0646\u062f \u060c \u067e\u06cc\u0686\u06cc\u062f\u06af\u06cc \u0632\u0645\u0627\u0646 \u062e\u0637\u06cc \u0648 \u062d\u0641\u0638 \u0628\u0647\u062a\u0631 \u062f\u0631 \u062f\u0647\u0627\u0646\u0647 \u0647\u0627\u06cc \u0637\u0648\u0644\u0627\u0646\u06cc \u062a\u0631 \u0631\u0627 \u0627\u0631\u0627\u0626\u0647 \u0645\u06cc \u062f\u0647\u062f.<\/li>\n<li>RETNET \u0627\u0632 \u062a\u0648\u062c\u0647 \u0645\u06a9\u0631\u0631 \u0648 \u0648\u0632\u0646\u0647\u0627\u06cc \u0645\u0634\u062a\u0631\u06a9 \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u0645\u06cc \u06a9\u0646\u062f \u062a\u0627 \u0636\u0645\u0646 \u06a9\u0627\u0647\u0634 \u0645\u062d\u0627\u0633\u0628\u0627\u062a \u060c \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u0627\u0632 \u0645\u062a\u0646 \u0637\u0648\u0644\u0627\u0646\u06cc \u06a9\u0627\u0631\u0622\u0645\u062f \u0631\u0627 \u0627\u0646\u062c\u0627\u0645 \u062f\u0647\u062f.<\/li>\n<li>Flashattion 2 \u0628\u0627\u0639\u062b \u0627\u0641\u0632\u0627\u06cc\u0634 \u0631\u0627\u0646\u062f\u0645\u0627\u0646 \u0648 \u0633\u0631\u0639\u062a \u062d\u0627\u0641\u0638\u0647 \u0645\u06cc \u0634\u0648\u062f \u0648 \u0628\u0647 \u062a\u0631\u0627\u0646\u0633\u0641\u0648\u0631\u0645\u0627\u062a\u0648\u0631\u0647\u0627 \u0627\u062c\u0627\u0632\u0647 \u0645\u06cc \u062f\u0647\u062f \u062a\u0627 \u0628\u0627 \u0648\u0631\u0648\u062f\u06cc \u0647\u0627\u06cc \u0637\u0648\u0644\u0627\u0646\u06cc \u0628\u0647\u062a\u0631 \u0645\u0642\u06cc\u0627\u0633 \u06a9\u0646\u0646\u062f.<\/li>\n<\/ul>\n<p>\u0627\u06cc\u0646 \u0645\u0645\u06a9\u0646 \u0627\u0633\u062a \u0633\u0631\u0627\u0646\u062c\u0627\u0645 \u0628\u0627 \u062a\u0648\u062c\u0647 \u0628\u0647 \u0647\u062f\u0641 \u0628\u06cc\u0634\u062a\u0631 \u0648 \u0622\u06af\u0627\u0647 \u062a\u0631 \u060c \u0627\u062b\u0631 \u0633\u0648\u0631\u0627\u062e \u067e\u06cc\u0631\u0627\u0634\u06a9\u06cc \u0631\u0627 \u06a9\u0627\u0647\u0634 \u062f\u0647\u062f. \u0628\u0627 \u0627\u06cc\u0646 \u062d\u0627\u0644 \u060c \u0627\u06a9\u062b\u0631 \u0645\u062f\u0644 \u0647\u0627\u06cc \u062a\u0648\u0644\u06cc\u062f\u06cc \u0647\u0646\u0648\u0632 \u0627\u06cc\u0646 \u0646\u0648\u0622\u0648\u0631\u06cc \u0647\u0627 \u0631\u0627 \u0628\u0647 \u0637\u0648\u0631 \u06a9\u0627\u0645\u0644 \u06cc\u06a9\u067e\u0627\u0631\u0686\u0647 \u0646\u06a9\u0631\u062f\u0647 \u0627\u0646\u062f \u060c \u0628\u0646\u0627\u0628\u0631\u0627\u06cc\u0646 \u062f\u0631 \u062d\u0627\u0644 \u062d\u0627\u0636\u0631 \u060c \u0627\u0642\u062f\u0627\u0645\u0627\u062a \u0639\u0645\u0644\u06cc \u0647\u0646\u0648\u0632 \u0628\u0647\u062a\u0631\u06cc\u0646 \u062f\u0641\u0627\u0639 \u0634\u0645\u0627 \u0627\u0633\u062a.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"%D8%A7%D8%AB%D8%B1%D8%A8%D8%AE%D8%B4%DB%8C_%D8%AA%D9%88%DA%A9%D9%86_%D8%AE%D8%A7%D8%B5_%DA%A9%D8%A7%D8%B1\"><\/span>\n<p>  \u0627\u062b\u0631\u0628\u062e\u0634\u06cc \u062a\u0648\u06a9\u0646 \u062e\u0627\u0635 \u06a9\u0627\u0631<br \/>\n<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>\u0647\u0645\u0647 \u0646\u0634\u0627\u0646\u0647 \u0647\u0627\u06cc &#8220;\u0647\u062f\u0631 \u0631\u0641\u062a\u0647&#8221; \u0628\u0631\u0627\u0628\u0631 \u0646\u06cc\u0633\u062a\u0646\u062f. \u06cc\u06a9 \u0646\u0634\u0627\u0646\u0647 \u0645\u0645\u06a9\u0646 \u0627\u0633\u062a \u0628\u0631\u0627\u06cc \u062e\u0644\u0627\u0635\u0647 \u0634\u062f\u0646 \u0646\u0627\u062f\u06cc\u062f\u0647 \u06af\u0631\u0641\u062a\u0647 \u0634\u0648\u062f \u0627\u0645\u0627 \u0628\u0631\u0627\u06cc \u062a\u0634\u062e\u06cc\u0635 \u0627\u062d\u0633\u0627\u0633\u0627\u062a \u0628\u0633\u06cc\u0627\u0631 \u0645\u0647\u0645 \u0627\u0633\u062a. \u0627\u0646\u062f\u0627\u0632\u0647 \u06af\u06cc\u0631\u06cc \u0627\u062b\u0631\u0628\u062e\u0634\u06cc \u062a\u0648\u06a9\u0646 \u0647\u0645\u06cc\u0634\u0647 \u0628\u0627\u06cc\u062f \u0628\u0627 \u0627\u0647\u062f\u0627\u0641 \u062e\u0627\u0635 \u06a9\u0627\u0631 \u06af\u0631\u0647 \u062e\u0648\u0631\u062f\u0647 \u0628\u0627\u0634\u062f.<\/p>\n<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"<p>&#8220;\u0634\u0645\u0627 128\u060c000 \u0646\u0634\u0627\u0646\u0647 \u0645\u062a\u0646 \u0631\u0627 \u067e\u0631\u062f\u0627\u062e\u062a \u06a9\u0631\u062f\u0647 \u0627\u06cc\u062f. \u0645\u0645\u06a9\u0646 \u0627\u0633\u062a 30\u060c000 \u0628\u0647 \u0637\u0648\u0631 \u0645\u0624\u062b\u0631 \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u06a9\u0646\u06cc\u062f. \u0628\u0642\u06cc\u0647\u061f \u0645\u062f\u0644 \u0634\u0645\u0627 \u0622\u0646\u0647\u0627 \u0631\u0627 \u0646\u0627\u062f\u06cc\u062f\u0647 \u0645\u06cc \u06af\u06cc\u0631\u062f &#8211; \u0648 \u0628\u0647 \u0647\u0631 \u062d\u0627\u0644 \u0634\u0645\u0627 \u0631\u0627 \u0634\u0627\u0631\u0698 \u0645\u06cc \u06a9\u0646\u062f.&#8221; \u0642\u0633\u0645\u062a 1: \u0634\u06a9\u0627\u0641 \u0627\u0633\u062a\u0641\u0627\u062f\u0647 \u0628\u0631\u0627\u06cc \u062f\u06cc\u062f\u0646 \u0627\u06cc\u0646 \u06a9\u0627\u0631 \u062f\u0631 \u0639\u0645\u0644 \u060c \u062f\u0631 \u0627\u06cc\u0646\u062c\u0627 \u06cc\u06a9 \u0645\u0642\u0627\u06cc\u0633\u0647 \u0646\u0642\u0634\u0647 \u0628\u0627 \u06af\u0631\u0645\u0627 \u062f\u0631 \u06a9\u0646\u0627\u0631 \u0647\u0645 &hellip;<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"fifu_image_url":"","fifu_image_alt":"","footnotes":""},"categories":[339],"tags":[],"class_list":["post-111282","post","type-post","status-publish","format-standard","hentry","category-dev"],"_links":{"self":[{"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/posts\/111282","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/comments?post=111282"}],"version-history":[{"count":0,"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/posts\/111282\/revisions"}],"wp:attachment":[{"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/media?parent=111282"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/categories?post=111282"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nabfollower.com\/blog\/wp-json\/wp\/v2\/tags?post=111282"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}