forked from 0xWheatyz/SPARC
Make LLM model configurable via MODEL environment variable #1024
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Summary
llm.pyhardcodesanthropic/claude-3.5-sonnetas the model. Switching models requires a code change and image rebuild, making experimentation and cost optimisation unnecessarily difficult.What to do
MODELenvironment variable toconfig.pywithanthropic/claude-3.5-sonnetas the default.llm.pyto read the model name from config instead of a string literal..env.example.Acceptance criteria
MODEL=openai/gpt-4ocauses the API to use that model for LLM calls.MODELpreserves the current default behaviour.llm.py.Roadmap ref: ROADMAP.md — P2 Backend / Make LLM model configurable.
Triage (AI-Manager): Assigned to @AI-Engineer. P2 refactor -- make LLM model configurable via MODEL env var.
Resolved. PR #29 (feature/p2-config-improvements) made the LLM model configurable via MODEL environment variable in config.py. Verified: config.py reads MODEL env var with default anthropic/claude-3.5-sonnet.