LocalLens — Let On-Device AI Do the Browsing Grunt Work for You
This is a submission for the Hacktoberfest Open-Source AI Challenge Week 3: Slow and Steady What I Built I built LocalLens , a privacy-first, on-device AI browser extension (MV3) that automates tedious, multi-step web browsing tasks using natural language—so you can sit back, relax, and let your la
Hacktoberfest Open-Source AI Challenge Week 3: Slow and Steady Submission 🦥
This is a submission for the Hacktoberfest Open-Source AI Challenge Week 3: Slow and Steady
I built LocalLens, a privacy-first, on-device AI browser extension (MV3) that automates tedious, multi-step web browsing tasks using natural language—so you can sit back, relax, and let your laptop handle the manual clicking.
Navigating complex web portals, filling out repetitive multi-page forms, copying structured tables, and sifting through dense administrative panels is draining work. LocalLens turns natural language instructions into precise browser actions (clicks, form inputs, scrolling, table extractions) right inside active browser tabs.
Anyone tired of manual browser grunt work! I originally built it for my friend Ankit, a developer who spends hours managing internal student portals, staging dashboards, and administrative forms. With LocalLens, Ankit types what he needs done once, hands off the execution to the local agent, and sits back while LocalLens handles the clicks and inputs automatically.
LocalLens is a privacy-first, locally-deployable browser automation agent. It bridges a Chrome MV3 extension with a Vision-Language Model (VLM) backend to autonomously execute natural language tasks on any webpage (e.g., "Submit the login form").
The system is split into a robust frontend extension and an intelligent Python backend: