forked from 0xWheatyz/SPARC
Backend: make LLM model configurable via MODEL environment variable #524
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Context
Roadmap item: P2 Backend — configurable LLM model
llm.pyhardcodesanthropic/claude-3.5-sonnet. Switching models requires a code change and redeploy.Task
MODEL(orLLM_MODEL) environment variable inconfig.pyanthropic/claude-3.5-sonnetfor backward compatibilityllm.py.env.exampleand docker-compose.ymlAcceptance Criteria
MODELenv var is read from config with a sensible defaultllm.pyuses the configured model at runtimeMODELwithout code changes selects a different model.env.exampleVerified complete:
config.pyreadsMODELenv var with defaultanthropic/claude-3.5-sonnet. Frontend model picker wired through API. Closing as implemented.