docker model

DescriptionDocker Model Runner

Experimental

This command is experimental.

Experimental features are intended for testing and feedback as their functionality or design may change between releases without warning or can be removed entirely in a future release.

Description

Use Docker Model Runner to run and interact with AI models directly from the command line. For more information, see the documentation

Subcommands

CommandDescription
docker model dfShow Docker Model Runner disk usage
docker model inspectDisplay detailed information on one model
docker model install-runnerInstall Docker Model Runner (Docker Engine only)
docker model listList the models pulled to your local environment
docker model logsFetch the Docker Model Runner logs
docker model packagePackage a GGUF file into a Docker model OCI artifact, with optional licenses, and pushes it to the specified registry
docker model psList running models
docker model pullPull a model from Docker Hub or HuggingFace to your local environment
docker model pushPush a model to Docker Hub
docker model rmRemove local models downloaded from Docker Hub
docker model runRun a model and interact with it using a submitted prompt or chat mode
docker model statusCheck if the Docker Model Runner is running
docker model tagTag a model
docker model uninstall-runnerUninstall Docker Model Runner
docker model unloadUnload running models
docker model versionShow the Docker Model Runner version