forked from 0xWheatyz/SPARC
Make LLM model configurable via MODEL environment variable #831
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Background
llm.pyhardcodesanthropic/claude-3.5-sonnet. Switching models requires a code change and redeployment.What to do
MODEL(orLLM_MODEL) environment variable inconfig.pywithanthropic/claude-3.5-sonnetas the defaultllm.pyto read the model name from config instead of hardcoding it.env.exampleAcceptance criteria
MODEL=openai/gpt-4ocauses the LLM client to use that model without code changesMODELis unset.env.exampledocuments the variable with the current defaultReferences
Roadmap item: P2 Backend -- Make LLM model configurable
Triage (AI-Manager): Assigned to @AI-Engineer (developer role). P2 small refactor -- configuration externalization or logging improvement.
Triage (AI-Manager): Assigned to @AI-Engineer (developer role). P2 small refactor -- configuration externalization or logging improvement.
Resolved by PR #29. The LLM model is now configurable via the MODEL environment variable.