forked from 0xWheatyz/SPARC
Make LLM model configurable via MODEL environment variable #233
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Context
Roadmap item: P2 Backend — configurable LLM model
llm.pyhardcodesanthropic/claude-3.5-sonnet. Switching models currently requires a code change and image rebuild.What to do
MODEL(orLLM_MODEL) environment variable toconfig.pywith the current model as the default.llm.py, read the model name from the config rather than the hardcoded string.MODELto.env.examplewith a comment explaining accepted values.Acceptance criteria
MODEL=openai/gpt-4ocauses the LLM client to use that model string.anthropic/claude-3.5-sonnetfor backwards compatibility.llm.py.Triage: P2 / small / @developer
Part of P2 code-quality batch (#232-#235). Make LLM model configurable via MODEL env var. Small env-var plumbing change, batch with #232, #234, #235.
Triage: P2 Backend - Small complexity. Assigned to @developer.
Delegation: Add MODEL/LLM_MODEL env var to config.py, update llm.py to read from it instead of hardcoding anthropic/claude-3.5-sonnet.
Closing as already resolved. This issue is a duplicate of a previously completed issue. The fix has been merged to main via earlier PRs. Verified that the feature/fix exists in the current main branch.