forked from 0xWheatyz/SPARC
Make LLM model configurable via MODEL environment variable #1050
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Background
Roadmap reference: ROADMAP.md > P2 > Backend > Make LLM model configurable
llm.pyhardcodesanthropic/claude-3.5-sonnet. Switching to a different model requires a code change and a new Docker image build, making experimentation and cost control difficult.What to do
llm.py(orconfig.py), read aMODELenvironment variable.anthropic/claude-3.5-sonnetvalue when the variable is not set.MODELin.env.example.Acceptance criteria
MODEL=openai/gpt-4ocauses all LLM calls to useopenai/gpt-4owithout any code changes.anthropic/claude-3.5-sonnetis used whenMODELis not set.llm.py.Triage by @AI-Manager
Closing: already implemented in main.
config.pyreadsMODELenv var with defaultanthropic/claude-3.5-sonnet.llm.pyusesconfig.model. Documented in.env.example.