fedorariscv/ollama repository overview

⁠Ollama for Fedora RISC-V (ollama-riscv)

This repository provides a Docker setup for running Ollama on RISC-V architecture. The containerized deployment ensures ease of use and portability while leveraging Fedora RISC-V images.

Docker is not available on Fedora RISC-V yet, so use podman here (install it by sudo dnf install -y podman podman-compose) or use docker on others distro.

⁠Quick Start

⁠Running with Podman Compose

Use the following podman-compose configuration to start the Ollama container:

version: '3'

services:
    ollama:
        container_name: ollama-riscv
        volumes:
            - ./ollama_data:/root/.ollama
        ports:
            - 11434:11434
        image: docker.io/fedorariscv/ollama:latest

Run the container using:

podman-compose up -d

⁠Running with Podman

Alternatively, you can use Podman to start Ollama:

podman run --name "ollama-riscv" --rm -v $HOME/ollama_data:/root/.ollama -p 11434:11434 docker.io/fedorariscv/ollama:latest serve

⁠Testing Deepseek Model

Once the container is running, you can test if Deepseek is working by executing:

podman exec -it ollama-riscv ollama run deepseek-r1:1.5b

or run extra instance:

podman run --rm -it --network=host run deepseek-r1:1.5b

⁠Running an Additional Instance

If you need another Ollama instance using host networking mode, you can run:

podman run --rm --network=host -v $HOME/ollama_data:/root/.ollama docker.io/fedorariscv/ollama:41 serve