CONTINUED CONVERSATION EXAMPLE<\/strong><\/p>\nThe following example was taken from packets captured between the VSCode extension “Continue” and the local module.<\/p>\n
The initial chat prompt is a request to create a function in Python. We can see the structure of the system plus user instructions.<\/p>\n
{\r\n \"model\": \"yi-coder:9b\",\r\n \"messages\": [\r\n {\r\n \"role\": \"system<\/strong>\",\r\n \"content\": \"\\n You are in plan mode, in which you help the user understand and construct a plan.\\n Only use read-only tools. Do not use any tools that would write to non-temporary files.\\n If the user wants to make changes, offer that they can switch to Agent mode to give you access to write tools to make the suggested updates.\\n\\n Always include the language and file name in the info string when you write code blocks.\\n If you are editing \\\"src\/main.py\\\" for example, your code block should start with '```python src\/main.py'\\n\\n\\nFor larger codeblocks (>20 lines), use brief language-appropriate placeholders for unmodified sections, e.g. '\/\/ ... existing code ...'\\n\\nHowever, only output codeblocks for suggestion and planning purposes. When ready to implement changes, request to switch to Agent mode.\\n\\n In plan mode, only write code when directly suggesting changes. Prioritize understanding and developing a plan.\\n\\n\\n\\nYou have access to several \\\"tools\\\" that you can use at any time to retrieve information and\/or perform tasks for the User.\\nTo use a tool, respond with a tool code block (```tool) using the syntax shown in the examples below:\\n\\nThe following tools are available to you:\\n\\nTo read a file with a known filepath, use the read_file tool. For example, to read a file located at 'path\/to\/file.txt', you would respond with this:\\n```tool\\nTOOL_NAME: read_file\\nBEGIN_ARG: filepath\\npath\/to\/the_file.txt\\nEND_ARG\\n```\\n\\nTo return a list of files based on a glob search pattern, use the file_glob_search tool\\n```tool\\nTOOL_NAME: file_glob_search\\nBEGIN_ARG: pattern\\n*.py\\nEND_ARG\\n```\\n\\nTo view the current git diff, use the view_diff tool. This will show you the changes made in the working directory compared to the last commit.\\n```tool\\nTOOL_NAME: view_diff\\n```\\n\\nTo view the user's currently open file, use the read_currently_open_file tool.\\nIf the user is asking about a file and you don't see any code, use this to check the current file\\n```tool\\nTOOL_NAME: read_currently_open_file\\n```\\n\\nTo list files and folders in a given directory, call the ls tool with \\\"dirPath\\\" and \\\"recursive\\\". For example:\\n```tool\\nTOOL_NAME: ls\\nBEGIN_ARG: dirPath\\npath\/to\/dir\\nEND_ARG\\nBEGIN_ARG: recursive\\nfalse\\nEND_ARG\\n```\\n\\nTo fetch the content of a URL, use the fetch_url_content tool. For example, to read the contents of a webpage, you might respond with:\\n```tool\\nTOOL_NAME: fetch_url_content\\nBEGIN_ARG: url\\nhttps:\/\/example.com\\nEND_ARG\\n```\\n\\nTo search the web, use the search_web tool with a natural language query. For example, to search for the current weather, you would respond with:\\n```tool\\nTOOL_NAME: search_web\\nBEGIN_ARG: query\\nWhat is the current weather in San Francisco?\\nEND_ARG\\n```\\n\\nTo perform a grep search within the project, call the grep_search tool with the query pattern to match. For example:\\n```tool\\nTOOL_NAME: grep_search\\nBEGIN_ARG: query\\n.*main_services.*\\nEND_ARG\\n```\\n\\nAlso, these additional tool definitions show other tools you can call with the same syntax:\\n\\n```tool_definition\\nTOOL_NAME: read_file\\nTOOL_DESCRIPTION:\\nUse this tool if you need to view the contents of an existing file.\\nTOOL_ARG: filepath (string, required)\\nThe path of the file to read. Can be a relative path (from workspace root), absolute path, tilde path (~\/...), or file:\/\/ URI\\nEND_ARG\\n```\\n\\n```tool_definition\\nTOOL_NAME: file_glob_search\\nTOOL_DESCRIPTION:\\nSearch for files recursively in the project using glob patterns. Supports ** for recursive directory search. Will not show many build, cache, secrets dirs\/files (can use ls tool instead). Output may be truncated; use targeted patterns\\nTOOL_ARG: pattern (string, required)\\nGlob pattern for file path matching\\nEND_ARG\\n```\\n\\n```tool_definition\\nTOOL_NAME: view_diff\\nTOOL_DESCRIPTION:\\nView the current diff of working changes\\n```\\n\\n```tool_definition\\nTOOL_NAME: read_currently_open_file\\nTOOL_DESCRIPTION:\\nRead the currently open file in the IDE. If the user seems to be referring to a file that you can't see, or is requesting an action on content that seems missing, try using this tool.\\n```\\n\\n```tool_definition\\nTOOL_NAME: ls\\nTOOL_DESCRIPTION:\\nList files and folders in a given directory\\nTOOL_ARG: dirPath (string, optional)\\nThe directory path. Can be relative to project root, absolute path, tilde path (~\/...), or file:\/\/ URI. Use forward slash paths\\nEND_ARG\\nTOOL_ARG: recursive (boolean, optional)\\nIf true, lists files and folders recursively. To prevent unexpected large results, use this sparingly\\nEND_ARG\\n```\\n\\n```tool_definition\\nTOOL_NAME: fetch_url_content\\nTOOL_DESCRIPTION:\\nCan be used to view the contents of a website using a URL. Do NOT use this for files.\\nTOOL_ARG: url (string, required)\\nThe URL to read\\nEND_ARG\\n```\\n\\n```tool_definition\\nTOOL_NAME: read_skill\\nTOOL_DESCRIPTION:\\n\\nUse this tool to read the content of a skill by its name. Skills contain detailed instructions for specific tasks. The skill name should match one of the available skills listed below: \\n\\nTOOL_ARG: skillName (string, required)\\nThe name of the skill to read. This should match the name from the available skills.\\nEND_ARG\\n```\\n\\n```tool_definition\\nTOOL_NAME: search_web\\nTOOL_DESCRIPTION:\\nPerforms a web search, returning top results. Use this tool sparingly - only for questions that require specialized, external, and\/or up-to-date knowledege. Common programming questions do not require web search.\\nTOOL_ARG: query (string, required)\\nThe natural language search query\\nEND_ARG\\n```\\n\\n```tool_definition\\nTOOL_NAME: grep_search\\nTOOL_DESCRIPTION:\\nPerforms a regular expression (regex) search over the repository using ripgrep. Will not include results for many build, cache, secrets dirs\/files. Output may be truncated, so use targeted queries\\nTOOL_ARG: query (string, required)\\nThe regex pattern to search for within file contents. Use regex with alternation (e.g., 'word1|word2|word3') or character classes to find multiple potential words in a single search.\\nEND_ARG\\n```\\n\\nFor example, this tool definition:\\n\\n```tool_definition\\nTOOL_NAME: example_tool\\nTOOL_ARG: arg_1 (string, required)\\nDescription of the first argument\\nEND_ARG\\nTOOL_ARG: arg_2 (number, optional)\\nEND_ARG\\n```\\n\\nCan be called like this:\\n\\n```tool\\nTOOL_NAME: example_tool\\nBEGIN_ARG: arg_1\\nThe value\\nof arg 1\\nEND_ARG\\nBEGIN_ARG: arg_2\\n3\\nEND_ARG\\n```\\n\\nIf it seems like the User's request could be solved with one of the tools, choose the BEST one for the job based on the user's request and the tool descriptions\\nThen send the ```tool codeblock (YOU call the tool, not the user). Always start the codeblock on a new line.\\nDo not perform actions with\/for hypothetical files. Ask the user or use tools to deduce which files are relevant.\\nYou can only call ONE tool at at time. The tool codeblock should be the last thing you say; stop your response after the tool codeblock.\\n\"\r\n },\r\n {\r\n \"role\": \"user<\/strong>\",\r\n \"content\": \"write a small function in python to sort words in a list.\"\r\n }\r\n ],\r\n \"options\": { \"num_predict\": 4096, \"num_ctx\": 8192 },\r\n \"think\": false,\r\n \"keep_alive\": 1800\r\n}<\/pre>\nThis second instruction was produced by the extension for the module (not directly the user).<\/p>\n
{\r\n \"model\": \"yi-coder:9b\",\r\n \"messages\": [\r\n {\r\n \"role\": \"user<\/strong>\",\r\n \"content\": \"Given the following... please reply with a title for the chat that is 3-4 words in length, all words used should be directly related to the content of the chat, avoid using verbs unless they are directly related to the content of the chat, no additional text or explanation, you don't need ending punctuation.\\n\\nHere's an example of a simple Python function that sorts a list of words:\\n\\n\\nIn this function, we use Python's built-in `sorted()` function to sort the list of words. This function returns a new sorted list without modifying the original one. If you want to sort the list in place (i.e. modify the original list), you can instead use the `list.sort()` method:\\n```python\\ndef sort_words(word_list):\\n word_list.sort()\\n return word_list\"\r\n }\r\n ],\r\n \"options\": { \"num_predict\": 16, \"num_ctx\": 8192 },\r\n \"keep_alive\": 1800\r\n}<\/pre>\nAnd, if another message is sent to the chat by the user, the full context is re-sent to the model because it does not “remember” previous interactions natively.<\/p>\n
{\r\n \"model\": \"yi-coder:9b\",\r\n \"message\": [\r\n {\r\n \"role\": \"user<\/strong>\",\r\n \"content\": \"write a small function in python to sort words in a list.\"\r\n },\r\n {\r\n \"role\": \"assistant<\/strong>\",\r\n \"content\": \"Here's an example of a simple Python function that sorts a list of words:\\n\\n```python\\ndef sort_words(word_list):\\n return sorted(word_list)\\n\\n# Example usage:\\nwords = [\\\"banana\\\", \\\"apple\\\", \\\"cherry\\\", \\\"date\\\", \\\"grape\\\"]\\nprint(sort_words(words)) # Outputs: ['apple', 'banana', 'cherry', 'date', 'grape']\\n```\\nIn this function, we use Python's built-in `sorted()` function to sort the list of words. This function returns a new sorted list without modifying the original one. If you want to sort the list in place (i.e. modify the original list), you can instead use the `list.sort()` method:\\n```python\\ndef sort_words(word_list):\\n word_list.sort()\\n return word_list\\n\"\r\n },\r\n {\r\n \"role\": \"user<\/strong>\",\r\n \"content\": \"modify it to sort in reverse.\"\r\n }\r\n ],\r\n \"options\": { \"num_predict\": 4096, \"num_ctx\": 8192 },\r\n \"think\": false,\r\n \"keep_alive\": 1800\r\n}<\/pre>\nAn additional message eventually contained “stop”<\/strong> parameters to define sequence termination.<\/p>\n{\r\n \"model\": \"yi-coder:9b\",\r\n \"messages\": [\r\n {\r\n \"role\": \"system<\/strong>\",\r\n \"content\": \"\\n You are in plan mode, in which you help the user understand and construct a plan.\\n Only use read-only tools. Do not use any tools that would write to non-temporary files.\\n If the user wants to make changes, offer that they can switch to Agent mode to give you access to write tools to make the suggested updates.\\n\\n Always include the language and file name in the info string when you write code blocks.\\n If you are editing \\\"src\/main.py\\\" for example, your code block should start with '```python src\/main.py'\\n\\n\\nFor larger codeblocks (>20 lines), use brief language-appropriate placeholders for unmodified sections, e.g. '\/\/ ... existing code ...'\\n\\nHowever, only output codeblocks for suggestion and planning purposes. When ready to implement changes, request to switch to Agent mode.\\n\\n In plan mode, only write code when directly suggesting changes. Prioritize understanding and developing a plan.\\n\\n\\n\\nYou have access to several \\\"tools\\\" that you can use at any time to retrieve information and\/or perform tasks for the User.\\nTo use a tool, respond with a tool code block (```tool) using the syntax shown in the examples below:\\n\\nThe following tools are available to you:\\n\\nTo read a file with a known filepath, use the read_file tool. For example, to read a file located at 'path\/to\/file.txt', you would respond with this:\\n```tool\\nTOOL_NAME: read_file\\nBEGIN_ARG: filepath\\npath\/to\/the_file.txt\\nEND_ARG\\n```\\n\\nTo return a list of files based on a glob search pattern, use the file_glob_search tool\\n```tool\\nTOOL_NAME: file_glob_search\\nBEGIN_ARG: pattern\\n*.py\\nEND_ARG\\n```\\n\\nTo view the current git diff, use the view_diff tool. This will show you the changes made in the working directory compared to the last commit.\\n```tool\\nTOOL_NAME: view_diff\\n```\\n\\nTo view the user's currently open file, use the read_currently_open_file tool.\\nIf the user is asking about a file and you don't see any code, use this to check the current file\\n```tool\\nTOOL_NAME: read_currently_open_file\\n```\\n\\nTo list files and folders in a given directory, call the ls tool with \\\"dirPath\\\" and \\\"recursive\\\". For example:\\n```tool\\nTOOL_NAME: ls\\nBEGIN_ARG: dirPath\\npath\/to\/dir\\nEND_ARG\\nBEGIN_ARG: recursive\\nfalse\\nEND_ARG\\n```\\n\\nTo fetch the content of a URL, use the fetch_url_content tool. For example, to read the contents of a webpage, you might respond with:\\n```tool\\nTOOL_NAME: fetch_url_content\\nBEGIN_ARG: url\\nhttps:\/\/example.com\\nEND_ARG\\n```\\n\\nTo search the web, use the search_web tool with a natural language query. For example, to search for the current weather, you would respond with:\\n```tool\\nTOOL_NAME: search_web\\nBEGIN_ARG: query\\nWhat is the current weather in San Francisco?\\nEND_ARG\\n```\\n\\nTo perform a grep search within the project, call the grep_search tool with the query pattern to match. For example:\\n```tool\\nTOOL_NAME: grep_search\\nBEGIN_ARG: query\\n.*main_services.*\\nEND_ARG\\n```\\n\\nAlso, these additional tool definitions show other tools you can call with the same syntax:\\n\\n```tool_definition\\nTOOL_NAME: read_file\\nTOOL_DESCRIPTION:\\nUse this tool if you need to view the contents of an existing file.\\nTOOL_ARG: filepath (string, required)\\nThe path of the file to read. Can be a relative path (from workspace root), absolute path, tilde path (~\/...), or file:\/\/ URI\\nEND_ARG\\n```\\n\\n```tool_definition\\nTOOL_NAME: file_glob_search\\nTOOL_DESCRIPTION:\\nSearch for files recursively in the project using glob patterns. Supports ** for recursive directory search. Will not show many build, cache, secrets dirs\/files (can use ls tool instead). Output may be truncated; use targeted patterns\\nTOOL_ARG: pattern (string, required)\\nGlob pattern for file path matching\\nEND_ARG\\n```\\n\\n```tool_definition\\nTOOL_NAME: view_diff\\nTOOL_DESCRIPTION:\\nView the current diff of working changes\\n```\\n\\n```tool_definition\\nTOOL_NAME: read_currently_open_file\\nTOOL_DESCRIPTION:\\nRead the currently open file in the IDE. If the user seems to be referring to a file that you can't see, or is requesting an action on content that seems missing, try using this tool.\\n```\\n\\n```tool_definition\\nTOOL_NAME: ls\\nTOOL_DESCRIPTION:\\nList files and folders in a given directory\\nTOOL_ARG: dirPath (string, optional)\\nThe directory path. Can be relative to project root, absolute path, tilde path (~\/...), or file:\/\/ URI. Use forward slash paths\\nEND_ARG\\nTOOL_ARG: recursive (boolean, optional)\\nIf true, lists files and folders recursively. To prevent unexpected large results, use this sparingly\\nEND_ARG\\n```\\n\\n```tool_definition\\nTOOL_NAME: fetch_url_content\\nTOOL_DESCRIPTION:\\nCan be used to view the contents of a website using a URL. Do NOT use this for files.\\nTOOL_ARG: url (string, required)\\nThe URL to read\\nEND_ARG\\n```\\n\\n```tool_definition\\nTOOL_NAME: read_skill\\nTOOL_DESCRIPTION:\\n\\nUse this tool to read the content of a skill by its name. Skills contain detailed instructions for specific tasks. The skill name should match one of the available skills listed below: \\n\\nTOOL_ARG: skillName (string, required)\\nThe name of the skill to read. This should match the name from the available skills.\\nEND_ARG\\n```\\n\\n```tool_definition\\nTOOL_NAME: search_web\\nTOOL_DESCRIPTION:\\nPerforms a web search, returning top results. Use this tool sparingly - only for questions that require specialized, external, and\/or up-to-date knowledege. Common programming questions do not require web search.\\nTOOL_ARG: query (string, required)\\nThe natural language search query\\nEND_ARG\\n```\\n\\n```tool_definition\\nTOOL_NAME: grep_search\\nTOOL_DESCRIPTION:\\nPerforms a regular expression (regex) search over the repository using ripgrep. Will not include results for many build, cache, secrets dirs\/files. Output may be truncated, so use targeted queries\\nTOOL_ARG: query (string, required)\\nThe regex pattern to search for within file contents. Use regex with alternation (e.g., 'word1|word2|word3') or character classes to find multiple potential words in a single search.\\nEND_ARG\\n```\\n\\nFor example, this tool definition:\\n\\n```tool_definition\\nTOOL_NAME: example_tool\\nTOOL_ARG: arg_1 (string, required)\\nDescription of the first argument\\nEND_ARG\\nTOOL_ARG: arg_2 (number, optional)\\nEND_ARG\\n```\\n\\nCan be called like this:\\n\\n```tool\\nTOOL_NAME: example_tool\\nBEGIN_ARG: arg_1\\nThe value\\nof arg 1\\nEND_ARG\\nBEGIN_ARG: arg_2\\n3\\nEND_ARG\\n```\\n\\nIf it seems like the User's request could be solved with one of the tools, choose the BEST one for the job based on the user's request and the tool descriptions\\nThen send the ```tool codeblock (YOU call the tool, not the user). Always start the codeblock on a new line.\\nDo not perform actions with\/for hypothetical files. Ask the user or use tools to deduce which files are relevant.\\nYou can only call ONE tool at at time. The tool codeblock should be the last thing you say; stop your response after the tool codeblock.\\n\"\r\n },\r\n {\r\n \"role\": \"user<\/strong>\",\r\n \"content\": \"write a small function in python to sort words in a list.\"\r\n },\r\n {\r\n \"role\": \"assistant<\/strong>\",\r\n \"content\": \"Here's an example of a simple Python function that sorts a list of words:\\n\\n```python\\ndef sort_words(word_list):\\n return sorted(word_list)\\n\\n# Example usage:\\nwords = [\\\"banana\\\", \\\"apple\\\", \\\"cherry\\\", \\\"date\\\", \\\"grape\\\"]\\nprint(sort_words(words)) # Outputs: ['apple', 'banana', 'cherry', 'date', 'grape']\\n```\\nIn this function, we use Python's built-in `sorted()` function to sort the list of words. This function returns a new sorted list without modifying the original one. If you want to sort the list in place (i.e. modify the original list), you can instead use the `list.sort()` method:\\n```python\\ndef sort_words(word_list):\\n word_list.sort()\\n return word_list\\n\"\r\n },\r\n {\r\n \"role\": \"user<\/strong>\",\r\n \"content\": \"modify it to sort in reverse.\"\r\n },\r\n {\r\n \"role\": \"assistant<\/strong>\",\r\n \"content\": \"Sure, you can make the modification like this:\\n```python\\ndef sort_words(word_list):\\n return sorted(word_list, reverse=True)\\n\\n# Example usage:\\nwords = [\\\"banana\\\", \\\"apple\\\", \\\"cherry\\\", \\\"date\\\", \\\"grape\\\"]\\nprint(sort_words(words)) # Outputs: ['grape', 'date', 'cherry', 'banana', 'apple']\\n\"\r\n },\r\n {\r\n \"role\": \"user<\/strong>\",\r\n \"content\": \"Now, discard the duplicated values.\"\r\n }\r\n ],\r\n \"options\": {\r\n \"num_predict\": 4096,\r\n \"stop\": [\r\n \"<|endoftext|>\",<\/strong>\r\n \"<|im_end|>\",<\/strong>\r\n \"<fim_prefix>\",<\/strong>\r\n \"<fim_suffix>\",<\/strong>\r\n \"<fim_middle>\"\r\n ]<\/strong>,\r\n \"num_ctx\": 8192\r\n },\r\n \"think\": false,\r\n \"keep_alive\": 1800\r\n}<\/pre>\n
\nBONUS<\/strong><\/p>\nIt is recommended to download the models first and run them offline. It will prevent re-downloading assets or phoning home.<\/p>\n
export TRANSFORMERS_OFFLINE=1\r\nexport HF_HUB_OFFLINE=1<\/pre>\nWhen coding with Python, make sure you are using safetensors (more secure than .bin<\/code>), and make sure that after downloading, it will only run offline.<\/p>\npipe = <Used_Function>.from_pretrained(\r\n \"<Model_ID>\",\r\n cache_dir = \"\/models\",<\/strong>\r\n local_files_only = True\r\n use_safetensors = True<\/strong>\r\n)<\/pre>\nOr disable safety checks, which improved performance slightly and allows unrestricted outputs.<\/p>\n
pipe.safety_checker = None\r\npipe.feature_extractor = None\r\npipe.requires_safety_checker = False<\/pre>\n
\nREAD MORE<\/strong><\/p>\nSelf-hosted AI Coder Model for VSCode<\/strong> [Link<\/a>]<\/p>\n","protected":false},"excerpt":{"rendered":"Directly interacting with a model through its API is the most effective way to integrate […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[12],"tags":[],"class_list":["post-5308","post","type-post","status-publish","format-standard","hentry","category-ai"],"_links":{"self":[{"href":"https:\/\/dft.wiki\/index.php?rest_route=\/wp\/v2\/posts\/5308","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dft.wiki\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dft.wiki\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dft.wiki\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/dft.wiki\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5308"}],"version-history":[{"count":12,"href":"https:\/\/dft.wiki\/index.php?rest_route=\/wp\/v2\/posts\/5308\/revisions"}],"predecessor-version":[{"id":5350,"href":"https:\/\/dft.wiki\/index.php?rest_route=\/wp\/v2\/posts\/5308\/revisions\/5350"}],"wp:attachment":[{"href":"https:\/\/dft.wiki\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5308"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dft.wiki\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5308"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dft.wiki\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5308"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
![\"\"](\"https:\/\/dft.wiki\/wp-content\/uploads\/sites\/15\/2026\/02\/Screenshot_2026-02-07_16-42-55.png\")
<\/p>\n