New Qwen FIM multi file template

[tomasz-stefaniak]

Validations

• I believe this is a way to improve. I'll try to join the Continue Discord for questions
• I'm not able to find an open issue that requests the same enhancement

Problem

Pasted from Discord:

Hi, a few days ago I implemented a template in my local Continue clone which correctly uses repository-level autocompletion for Qwen templates, a bit like the Codestral template.
Snippet: https://gist.github.com/DanielusG/ff4c2d008673e75bdd31bba6a81c6f07
Insert the snippet in AutocompleteTemplate.ts and replace the template in the funciton getTemplateForModel

I have used it daily for several days and it seems to work quite well. I think it's not the best way to implement it since I used a special token created by me and then did a split, but I did it in a short time, and I honestly wouldn't want to create a pull request to implement a ‘’janky‘’ code

However, I wanted to share it in case anyone wanted to improve or implement it as it is.
Source to FIM repository level template for Qwen: QwenLM/Qwen2.5-Coder#25 (comment)

Solution

const qwenMultifileFimTemplate: AutocompleteTemplate = {
  compilePrefixSuffix: (
    prefix: string,
    suffix: string,
    filepath: string,
    reponame: string,
    snippets: AutocompleteSnippet[],
  ): [string, string] => {
    if (snippets.length === 0) {
      return [prefix, suffix];
    }

    const relativePaths = shortestRelativePaths([
      ...snippets.map((snippet) =>
        "filepath" in snippet ? snippet.filepath : "Untitled.txt",
      ),
      filepath,
    ]);

    const fileContents = snippets
      .map((snippet, i) => {
        if (snippet.type === AutocompleteSnippetType.Diff) {
          return `<|file_sep|>${relativePaths[i]}\n${snippet.content}`;
        }
        return `<|file_sep|>${relativePaths[i]}\n${snippet.content}`;
      })
      .join("\n");

    const fullPrefix = `<|repo_name|>${reponame}\n${fileContents}\n<|file_sep|>${
      relativePaths[relativePaths.length - 1]
    }<|system_separator_istruction_repository_level|>${prefix}`;

    return [fullPrefix, suffix];
  },
  template: (prefix: string, suffix: string): string => {
    if(prefix.includes("<|system_separator_istruction_repository_level|>")){
      const [beforeSeparator, ...afterSeparator] = prefix.split(
        "<|system_separator_istruction_repository_level|>"
      );
      const combinedAfterSeparator = afterSeparator.join(
        ""
      );
      return `${beforeSeparator}\n<|fim_prefix|>${combinedAfterSeparator}<|fim_suffix|>${suffix}<|fim_middle|>`;
    }
    return `<|fim_prefix|>${prefix}<|fim_suffix|>${suffix}<|fim_middle|>`;
  },
  completionOptions: {
    stop: [
      "<|endoftext|>",
      "<|fim_prefix|>",
      "<|fim_middle|>",
      "<|fim_suffix|>",
      "<|fim_pad|>",
      "<|repo_name|>",
      "<|file_sep|>",
      "<|im_start|>",
      "<|im_end|>",
    ],
  },
};