Positronick
← Catalog
Docker @docker
CLI

Docker Model Runner CLI

The 'docker model' CLI plugin for pulling, running, packaging, and serving local LLMs and AI models as OCI artifacts with an OpenAI-compatible API.

Type
CLI
Updated
2026-08-26
Install

Install

via Positronick CLI

$positronick cli install docker-model-runner-cli --run

Official

$docker model run ai/gemma3

Docker Model Runner pulls, runs, and serves LLMs locally via the docker model CLI, sourcing models from Docker Hub, OCI registries, or Hugging Face and exposing them through OpenAI- and Ollama-compatible APIs. It can package GGUF and Safetensors files as OCI artifacts, and lets you tune settings like context size. Models are cached, loaded only at runtime, and unloaded when idle. Use it for local inference without a cloud provider.

Docker CLI
CLI

The official Docker command-line interface for building, running, and managing containers, images, networks, and volumes against the Docker daemon.

DevOps & Cloud @docker
Docker Compose
CLI

Docker CLI plugin to define and run multi-container applications from a single declarative YAML file with one command.

DevOps & Cloud @docker
Docker Scout CLI
CLI

The 'docker scout' CLI plugin for software supply chain security: generating SBOMs, matching components against vulnerability databases, and evaluating image policy compliance.

Security @docker
AWS CLI
CLI

The unified command line interface for managing and automating all AWS services from your terminal.

DevOps & Cloud @aws
Theme