Common Python tools used at Meetup

ollama-amd-vulkan built from https://github.com/whyvl/ollama-vulkan/issues/7#issuecomment-2660836871

The Llama 3.2 instruction-tuned text only models are optimized for multilingual dialogue use cases,

A base image I use to process the llama2 model. Model is NOT included in the image.

Llama2 7B OpenVINO Model based Chatbot

arm32v5/python

arm32v5

Python is an interpreted, interactive, object-oriented, open-source programming language.

Containerized models, tested and ready for production, focused on smaller LLMs.

I have no idea what is going on

docker run -d -p 11434:11434 --name mistral yashbhesaniya/ollama_mistral

A small, more complete, Python Docker image based on Alpine Linux.

shopify-slate

Containerized models served with llama optimized for 6GB VRAM NVidia GPUs using CUDA

RnDnet platform execution container. Use python python:3.7-slim and BFJ.py