I tried to fire my LLM API. Open models passed one task and failed the other.
This is a submission for the Hacktoberfest Open-Source AI Challenge Week 2: Side Hustle What I Built Open-Switch answers one question: can an open model replace your closed LLM API on YOUR data? It runs your workflow through open-weight models, scores them with bootstrap 95% CIs, and gives a verdic
Hacktoberfest Open-Source AI Challenge Week 2: Side Hustle Submission 馃捀
This is a submission for the Hacktoberfest Open-Source AI Challenge Week 2: Side Hustle
Open-Switch answers one question: can an open model replace your closed LLM API on YOUR data?
It runs your workflow through open-weight models, scores them with bootstrap 95% CIs, and gives a verdict: Safe Switch or No Safe Switch. It also tells you if a LoRA fine-tune pays for itself.
Who pays: B2B SaaS teams cutting LLM bills, and consultants selling migration audits. Hypothesis: $49/mo self-serve, $199/mo agency.
Runs fully local (no hosted link, by design: your data never leaves your machine):
git clone https://github.com/SynthReaper/ghw-hacktoberfest26.git cd ghw-hacktoberfest26/switchable && pip install -e. openswitch run --models gemma-2b-local,gemma-9b-local --task specs/task.yaml Enter fullscreen mode Exit fullscreen mode Code SynthReaper / ghw-hacktoberfest26 MLH x Hacktoberfest Challenge Projects (2026) Workspace containing hackathon projects for DEV Hacktoberfest Challenges.