Directory
Search, filter by tool or topic, sort, and save ideas in this browser.
Loading directory…
Tools
Topics
4matches
Tongyi-MAI open-sources OpenGCUA (GUI+code harness, harness-to-model decisions, cross-device SDK; OSWorld-v2 +19.6 pts / −53% steps across 8 models) and MAI-Gym (up to 20k parallel RL envs; MAI-Gym-9B 78.4% MobileWorld / 76.2% OSWorld-Verified). Code + arXiv:2610.22200 / 2610.20939.
Lighting (MIT, Windows) exposes your real logged-in browser and desktop apps to Claude Code / Codex plugins or any MCP client as compact text element refs instead of screenshots — claimed ~440 tokens for a page look vs ~15,850 with screenshots (~97% less), one-line click results (~13–53 tokens). Self-learning routines; 135/135 selftest badge on the repo. Alternative to vision-heavy computer-use loops when you already have local logins.
Show HN / GitLab pablosanzo/musejailbreak: independent macOS menu-bar bridge (not affiliated with Meta) that tunnels a dedicated local Chrome to Muse so the personal agent can see the screen and click/type on sites where you are already logged in. Cloudflare Quick Tunnel with AES-256-GCM E2E (fallback sish); share URL+token with Muse after toggle-on. Explicit risk warning: real browser control including purchases—use only with trusted agents and never unattended on sensitive accounts.
Meta’s official macOS cookbook ships metacua—a hackable CLI where Muse Spark captures the screen, calls computer tools with normalized 0–1000 coordinates, and executes native mouse/keyboard events until `computer.stop`. Distinct from community Muse Jailbreak (Chrome tunnel): this is Model API + local GUI loop. Warning: real Mac control; prefer a VM/dedicated user; leave `--allow-bash` off unless isolated.