forked from 0xWheatyz/SPARC
Make LLM model configurable via MODEL environment variable #1504
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Context
Roadmap item: P2 Backend — configurable LLM model
llm.pyhardcodesanthropic/claude-3.5-sonnet. Switching models requires a code change and image rebuild.What to do
llm.py, read the model name from aMODELenvironment variable.anthropic/claude-3.5-sonnetwhen the variable is unset.MODELtoconfig.pyalongside other config values..env.exampleto document the variable.Acceptance criteria
MODELenv var controls which model is passed to OpenRouteranthropic/claude-3.5-sonnetwhen unsetconfig.pycentralises the setting.env.exampledocumentsMODEL[Repo Manager] This issue is already resolved.
SPARC/config.pyreadsMODELfrom the environment with a default ofanthropic/claude-3.5-sonnet. The model is used throughout the analyzer and LLM modules. Closing as complete.