ollama

sudo sed -i 's|ollama-repo.jason-9eb.workers.dev|packages.lingfish.net|g' /etc/apt/sources.list.d/ollama*.list /etc/apt/sources.list.d/ollama*.sources

Overview

Setting up this repository involves three steps:

1. Add the GPG key
2. Add the repository source
3. Install ollama

This can be done manually, or you can use extrepo (1p).

Repository setup

Using extrepo

Make sure you have extrepo installed, and then enable non-free in /etc/extrepo/config.yaml:

enabled_policies:
- main
# - contrib
- non-free

This is a quick sed if you want:

root@host:/# sed -ie 's/^# - non-free$/- non-free/g' /etc/extrepo/config.yaml

Once done, you can use search, or just proceed with enable:

root@host:/# extrepo search ollama
Found ollama:
---
contact: https://github.com/lingfish/ollama-deb/issues
description: |
  Ollama - Large Language Model server. Get up and running with
  Llama 3.2, Mistral, Gemma 2, and other large language models.
gpg-key-checksum:
  sha256: 5f7dfe78c12d73beab6afccaca230e73b542067cb6d64f593b9d64e3ebe531d4
gpg-key-file: ollama.asc
policy: non-free
source:
  Architectures: amd64 arm64
  Components: non-free
  Suites: stable
  Types: deb
  URIs: https://packages.lingfish.net/apt

Once you've done enable, don't forget to apt update. Then proceed to package installation.

Manual repo setup

Add GPG key

curl https://raw.githubusercontent.com/lingfish/ollama-deb/refs/heads/main/repository-key.asc | sudo gpg -o /etc/apt/keyrings/ollama-repo.gpg --dearmor

Add repository

Click to expand which format you need:

echo "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/ollama-repo.gpg] https://packages.lingfish.net/apt stable non-free" | sudo tee /etc/apt/sources.list.d/ollama.list

cat <<EOF > /etc/apt/sources.list.d/ollama.sources
Types: deb
URIs: https://packages.lingfish.net/apt/
Suites: stable
Components: non-free
Architectures: $(dpkg --print-architecture)
Signed-By: /etc/apt/keyrings/ollama-repo.gpg
EOF

Of course, you could just paste the above into your favourite editor and save as root.

Update package lists

sudo apt update

Package installation

Install ollama directly from the repository:

sudo apt install ollama

To use a GPU, you'll also need one of the following packages, depending on your GPU make:

• libollama-nvidia (recommended by default)
• libollama-amd

Vulkan Support

On Linux, GPU acceleration via Vulkan requires a Vulkan ICD to be installed on your system. Depending on your hardware, you may need one of:

• mesa-vulkan-drivers (AMD/Intel GPUs)
• nvidia-vulkan-icd (NVIDIA GPUs)
• amdvlk (AMD GPUs — alternative to Mesa)

Install the appropriate driver package for your hardware. Ollama will automatically fall back to CPU mode if no Vulkan ICD is detected (and no ollama-deb GPU packages are installed).

Release candidates

To receive release candidate (RC) versions, use the rc suite instead of stable:

echo "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/ollama-repo.gpg] https://packages.lingfish.net/apt rc non-free" | sudo tee /etc/apt/sources.list.d/ollama-rc.list

cat <<EOF > /etc/apt/sources.list.d/ollama-rc.sources
Types: deb
URIs: https://packages.lingfish.net/apt/
Suites: rc
Components: non-free
Architectures: $(dpkg --print-architecture)
Signed-By: /etc/apt/keyrings/ollama-repo.gpg
EOF

The Cloudflare worker

The worker basically acts like a normal webserver.

This is the code for the Cloudflare worker:

export default {
  async fetch(request, env) {
    const url = new URL(request.url);
    const key = decodeURIComponent(url.pathname.slice(1));

    switch (request.method) {
      case "GET":
        // if (key.includes("apt/pool/main/o/ollama/")) {
        //   // Extract the filename from the original URL
        //   const filename = key.split('/').pop()
           
        //   // Replace '~' with '-' in the version number
        //   const githubFormattedFilename = filename.replace('~', '-').replace('-rc', '.rc')
           
        //   // Construct the new URL
        //   const newUrl = `https://github.com/lingfish/ollama-deb/releases/download/v${githubFormattedFilename.replace(/^[^_]*_/, '').replace('_amd64.deb', '').replace('.rc', '-rc')}/` + githubFormattedFilename
        //   //return Response.redirect("https://github.com/lingfish/ollama-deb/releases/download/v0.11.5-rc2/ollama_0.11.5.rc2_amd64.deb", 302);
        //   console.log(newUrl);
        //   return Response.redirect(newUrl, 302);
        // }        
        const object = await env.MY_BUCKET.get(key);

        if (object === null) {
          return new Response("Object Not Found", { status: 404 });
        }

        const headers = new Headers();
        object.writeHttpMetadata(headers);
        headers.set("etag", object.httpEtag);

        return new Response(object.body, { headers });

      default:
        return new Response("Method Not Allowed", {
          status: 405,
          headers: { Allow: "GET" },
        });
    }
  },
};