JETSON

is a novel system that leverages augmented reality and AI to make you superhuman. The aim of this project was to develop a seamless, natural, and efficient interface to communicate with artificial intelligence.

Imagine being able to understand and speak in dozens of languages using AR glasses that not only translate in real-time into your peripheral vision but also learn languages much faster.

Imagine an AI assistant that listens to what is being said, and automatically fact-checks, generates useful ideas, or allows you to understand or look up any term or concept known by the human race in less than 500ms.

Imagine a device that can identify any product brand or thing in front of you using computer vision, in real-time.

Me holding the AR monocle

Me holding the AR monocle

After running a hackathon with the founders of Brilliant Labs and their super cool AR monocle, my friends and I spent months building on the platform.

Results:

Built an iOS app in Swift with the following features

See some demo videos below:

JETSON Demo Clips


Hacking the Meta Ray Bans

https://www.linkedin.com/embed/feed/update/urn:li:ugcPost:7138319742422974464?compact=1

We moved on to Meta’s ray bans, which were a sleeker and more powerful interface for audio and visual data collection.

Problem: We needed glasses that took images every 10 seconds to feed to our perfect memory system on Meta Ray Bans, but they have no SDK.