forked from 0xWheatyz/SPARC
Make LLM model configurable via MODEL environment variable #100
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Context
llm.pyhardcodesanthropic/claude-3.5-sonnet. Switching models requires a code change and redeploy.Work
MODELenvironment variable toconfig.pywithanthropic/claude-3.5-sonnetas the default.llm.pyto read the model name from config instead of a hardcoded string.MODELin.env.exampleand the README.Acceptance Criteria
MODEL=openai/gpt-4ocausesllm.pyto use that model for all LLM calls.MODELfalls back toanthropic/claude-3.5-sonnet.llm.py.References
Roadmap: P2 — Backend — Make LLM model configurable.