Skip to main content
uGAME runs a Game Boy emulator inside uOS and lets the uOS Assistant play for you. Today it’s set up for Pokémon, and you can either play manually with the on-screen controls (or your keyboard) or hand control to the agent and watch it think and act in real time.
uGAME wraps the open-source GameBoy-Online emulator by Grant Galitz. Your progress can be saved to the cloud when your wallet is connected.

​
How AI play works

When you ask the Assistant to play (for example, “play pokemon”), uGAME opens and the agent starts a loop roughly once per second: Each cycle it:
  1. Captures the screen: grabs a frame from the emulator canvas.
  2. Reads the state: sends the frame to Claude (vision) to extract on-screen text, and optionally reads Game Boy RAM for things like the player’s position and party.
  3. Decides an action: a rule-based engine picks a move based on the current screen type (overworld, battle, menu, or dialogue).
  4. Presses a button: sends a synthetic key press to the emulator, just like a human would.
In Agent Mode, the Assistant streams its reasoning (what it sees, where it thinks it is, and what it’s doing next) so you can follow along.

​
What you can ask

The Assistant recognizes gameplay requests and opens uGAME for you. Useful prompts:
  • Start playing: “play pokemon”, “play the game”, “explore”
  • Stop: “stop” ends the current task and turns off Agent Mode
Exploration is best-effort: the agent moves around, advances dialogue, and handles menus and battles with built-in heuristics. It’s a fun, transparent demo of an agent driving a real app, not a speedrunning bot.

​
Good to know

  • Game: Currently tuned for Pokémon (Game Boy). Other titles aren’t wired up yet.
  • Decision-making: Rule-based today. Vision is used to read the screen, not to choose every button.
  • Saves: Cloud save/restore is available when your wallet is connected.
Pathfinding to named locations, item-hunting, and full task planning are on the roadmap. The current agent focuses on perceive → decide → act with simple, readable rules.