Cloudflare Workers AI

Cloudflare Workers AI 可用于 Continue 的聊天和标签自动补全。以下是 Cloudflare Workers AI 的配置示例

YAML

config.yaml

models:
  - name: Llama 3 8B
    provider: cloudflare
    apiKey: <YOUR_CLOUDFARE_API_KEY>
    model: "@cf/meta/llama-3-8b-instruct"
    contextLength: 2400
    defaultCompletionOptions:
      maxTokens: 500
    roles:
      - chat
    env:
      accountId: YOUR CLOUDFLARE ACCOUNT ID 
  - name: DeepSeek Coder 6.7b Instruct
    provider: cloudflare
    apiKey: <YOUR_CLOUDFARE_API_KEY>
    model: "@hf/thebloke/deepseek-coder-6.7b-instruct-awq"
    contextLength: 2400
    defaultCompletionOptions:
      maxTokens: 500
    roles:
      - chat
    env:
      accountId: YOUR CLOUDFLARE ACCOUNT ID
  - name: DeepSeek 7b
    provider: cloudflare
    apiKey: <YOUR_CLOUDFARE_API_KEY>
    model: "@hf/thebloke/deepseek-coder-6.7b-base-awq"
    roles:
      - autocomplete
    env:
      accountId: YOUR CLOUDFLARE ACCOUNT ID

JSON

config.json

{
  "models": [
    {
      "title": "Llama 3 8B",
      "provider": "cloudflare",
      "accountId": "YOUR CLOUDFLARE ACCOUNT ID",
      "apiKey": "YOUR CLOUDFLARE API KEY",
      "contextLength": 2400,
      "completionOptions": {
        "maxTokens": 500
      },
      "model": "@cf/meta/llama-3-8b-instruct"
    },
    {
      "title": "DeepSeek Coder 6.7b Instruct",
      "provider": "cloudflare",
      "accountId": "YOUR CLOUDFLARE ACCOUNT ID",
      "apiKey": "YOUR CLOUDFLARE API KEY",
      "contextLength": 2400,
      "completionOptions": {
        "maxTokens": 500
      },
      "model": "@hf/thebloke/deepseek-coder-6.7b-instruct-awq"
    }
  ],
  "tabAutocompleteModel": {
    "title": "DeepSeek 7b",
    "provider": "cloudflare",
    "accountId": "YOUR CLOUDFLARE ACCOUNT ID",
    "apiKey": "YOUR CLOUDFLARE API KEY",
    "model": "@hf/thebloke/deepseek-coder-6.7b-base-awq"
  }
}

访问 Cloudflare 控制面板以创建 API 密钥。

查看 Workers AI 上可用的模型

查看源代码