forked from 0xWheatyz/SPARC
Make LLM model configurable via MODEL environment variable #619
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Context
llm.pyhardcodesanthropic/claude-3.5-sonnet. Switching models requires a code change and redeploy.Roadmap item: P2 > Backend > Make LLM model configurable
What to do
MODEL(orLLM_MODEL) key toconfig.pythat reads from the environment, defaulting toanthropic/claude-3.5-sonnet.llm.pyto read the model name from config rather than a literal string.LLM_MODELto.env.examplewith the default value as the comment.Acceptance criteria
LLM_MODEL=openai/gpt-4ocauses the LLM client to use that model string.anthropic/claude-3.5-sonnet.Closing: already implemented on main.
config.pyreadsMODELenv var with defaultanthropic/claude-3.5-sonnet. Frontend includes a model picker on Analysis and Batch pages.