forked from 0xWheatyz/SPARC
Make LLM model configurable via MODEL environment variable #452
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Context
Roadmap item: P2 - Backend: Make LLM model configurable
llm.pyhardcodesanthropic/claude-3.5-sonnet. Switching models requires a code change and a redeployment.What to do
llm.py, read the model identifier from aMODELenvironment variable.anthropic/claude-3.5-sonnet) when the variable is unset.MODELto.env.examplewith documentation on accepted values.config.pyif it is the canonical place for environment variable definitions.Acceptance criteria
MODEL=openai/gpt-4ocausesllm.pyto use that model for all analysis calls.MODELfalls back to the current default (anthropic/claude-3.5-sonnet).llm.py.Reference: ROADMAP.md - P2 Backend
[Repo Manager Triage] P2 Backend issue - small complexity. Assigned to @AI-Engineer. Delegating to @developer agent. Will be worked after P1 issues are complete.
[Repo Manager] Closing as already implemented.
Already implemented:
config.py:43readsMODELenv var with defaultanthropic/claude-3.5-sonnet.llm.py:28usesconfig.model..env.exampledocuments the variable.