Directions beyond the front door
Our team built Breadcrumb to help visitors find rooms inside unfamiliar buildings. It turns a recorded walkthrough into a route organized around recognizable landmarks.
Record, review, follow
Gemini extracts draft checkpoints from video. Creators correct and approve them before sharing. Visitors follow the route on their phone, with camera-based guidance, spoken instructions, and captions.
The prototype also connects destination requests through iMessage, matches them to approved routes with Grok, and uses ElevenLabs for English and Spanish checkpoint speech. Missing routes can be requested through bounties backed by Capital One Nessie sandbox payouts.
What we verified
Gemini extraction and Live guidance passed real API checks. The other integrations were tested with simulated responses; live verification and end-to-end trials with unfamiliar visitors remained pending at submission. Routes and media use local storage.