Skip to content

Latest commit

 

History

History

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 

readme.md

A small creative studio building playful, slightly over-engineered software.
AI companions, real-time audio, computer vision, VRChat tools, and the odd web app that started as a joke.

Website Discord X VRChat group Email


Hey, we're HoppouAI

We make AI companions, real-time audio systems, computer vision experiments, VRChat tools, and a few web apps that escaped the lab. Gabriel, our open source companion that lives in VRChat, is the project we're best known for, but he's one of many. Most of what we make is open source, because the fun part is watching people take it apart and build their own version.

We care about shipping things that actually work, not slideware. If a project makes someone laugh, saves them an afternoon, or does something nobody asked for but everyone enjoys, that counts as a win. Pull up a chair.


Table of contents


What we build

🤖 AI companions and agents
Characters that talk, listen, remember and act on their own. Gabriel is the flagship, and the tooling behind him is open for anyone.
🎵 Real-time audio and music
Synchronized performance systems, MIDI orchestras, and low latency audio routing that has to stay perfectly in time.
👁️ Computer vision and tracking
Screen capture, person and face tracking, and spatial awareness so our projects can actually see what is going on.
🕹️ VRChat tools and worlds
OSC automation, avatar control, group performances, and assets that push what a single VRChat account can do.
🛠️ Creator tools and utilities
Small, sharp tools that save creators an afternoon. Format converters, sync helpers, and pipeline glue.
🧩 Open frameworks and plugins
Reusable building blocks and plugin systems so other people can extend our work instead of starting from scratch.

Projects

🤖 Project Gabriel   a real-time AI companion for VRChat

Gabriel walks around, talks to people out loud, remembers who they are, and has his own personality. He listens through Gemini Live native audio, sees through computer vision, and drives his avatar over OSC. VRChat is optional, since he also runs through Discord, a WebUI, or on his own.

He runs two ways: on Gemini Live by default, or fully local with LM Studio, Moonshine speech recognition, and your own TTS so nothing leaves your machine. Free, open source, and yours to reshape.

Quick links

🎵 The Bird Band   a synchronized in-game orchestra

Multiple accounts each play a different MIDI instrument in perfect sync to perform full arrangements live. The whole thing is an exercise in timing, conductor control, and squeezing real musical expression out of VRChat.

Quick links

🛠️ GIF Converter   GIFs to sprite sheets

A lightweight tool that turns GIFs into sprite sheets and metadata for games and virtual content. Handy for rapid prototyping and asset pipelines when you just need it done.

Quick links

🗄️ Project Gabriel Framework   archived

The original open source Python framework Gabriel was built on, with components for sensor input, vision processing, and conversational flow. Archived on January 6, 2026, and replaced by the rewrite linked above. The code and docs are still around for reference.

Quick links


Tools and utilities

All tools and small projects

We publish little utilities that save creators time: format converters, performance monitors, sync helpers, and other glue. They are usually open and easy to drop into your own setup.

Visit: https://hoppou.ai/tools


Tech we use

Python PyTorch FastAPI OpenCV Gemini JavaScript Node.js Unity

  • Python for almost everything: PyTorch, FastAPI, OpenCV, and friends
  • Real-time audio and MIDI systems where timing actually matters
  • Computer vision with YOLO and MediaPipe
  • Modern web stacks for dashboards and tools
  • Open source models (LLMs, TTS, STT) for voice, conversation, and embeddings

FAQ

"Who's behind all this?"

A small crew of builders who like creative coding and shipping weird, useful things. HoppouAI is part studio, part community. If you hang around the Discord long enough, you might end up on a project.

"Is everything free and open source?"

Most of it, yes. Gabriel and a lot of our tools are open source and free to run yourself. A few things are hosted services on the website, but the core stuff you can clone, read, and rebuild.

"Can I build on top of your projects?"

Please do. That's the whole point. Check each repo for its license before you ship something commercial, since Gabriel is AGPL-3.0, but forking, remixing, and learning from any of it is always welcome.

"Do I need VRChat to use Gabriel?"

No. VRChat is where he shines, but he runs fine standalone. Talk to him through Discord, the WebUI, or any voice app. The OSC, vision, and navigation features are the VRChat specific parts, and nothing forces you to use them.

"Found a bug or have an idea?"

Open an issue or a discussion on the relevant repo, or drop it in the Discord. We read everything, and a surprising number of features started as someone's random idea in chat.

"Can I contribute or join in?"

Absolutely. Pick a repo, open a discussion, and tell us what you are into. Code, art, music, testing, docs, it all helps. Not sure where to start? Say hi in the Discord and we'll point you somewhere.

"Do you do collabs?"

Sometimes. If you have something fun in mind, email hello@hoppou.ai or poke us on Discord. We are more into interesting ideas than formal pitches.


Get involved

We welcome help at any level, whether that's a one line typo fix or a whole new tool. Easiest way in:

  • Browse the repos and grab anything that looks interesting
  • Open a discussion if you are not sure where to start
  • Hop in the Discord and introduce yourself

Find us

Discord   Website   X

Thanks for stopping by. If you want to collaborate or just ask a question, open a discussion or say hi in the Discord.