forked from 0xWheatyz/SPARC
Make LLM model configurable via MODEL environment variable #691
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Context
Roadmap item: P2 Backend - configurable LLM model
llm.pyhardcodesanthropic/claude-3.5-sonnet. Changing the model requires a code edit and redeploy.Work to do
MODELenvironment variable inllm.py(orconfig.py)anthropic/claude-3.5-sonnetif the variable is unsetMODELto.env.examplewith the current default value as the exampleAcceptance criteria
MODEL=openai/gpt-4ocauses the LLM client to use that modelClosing as already implemented. LLM model is now configurable via the MODEL environment variable, defaulting to anthropic/claude-3.5-sonnet. See SPARC/config.py. Done in PR #29.