claude

web-infra-dev-midscene-skills-1

Skills for AI-driven desktop computer automation using visual understanding and user interaction simulation.

0 on GitHubupdated 6 months agoai_ml_agents
/

Plugin web-infra-dev-midscene-skills-1 from marketplace cascade-ai-ml-agents-misc-2 in joshuarweaver/cascade-ai-ml-agents-misc-2. Commands read from the repo's manifest — 1 month ago.

What it installs

Skills (6)

  • android-device-automation

    Vision-driven Android device automation using Midscene. Operates entirely from screenshots — no DOM or accessibility labels required. Can interact with all visible elements on screen regardless of technology stack. Control Android devices with natural language commands via ADB. Perform taps, swipes,

  • browser-automation

    Vision-driven browser automation using Midscene. Operates from screenshots — no DOM or accessibility labels needed. Runs in headless Puppeteer — does NOT take over the user's mouse or keyboard. Also supports CDP mode and Bridge mode to connect to an existing Chrome. Use this skill when the user want

  • computer-automation

    Vision-driven desktop automation using Midscene. Control your local desktop (macOS, Windows, Linux) or a remote Windows desktop over RDP with natural language commands. Operates entirely from screenshots — no DOM or accessibility labels required. Can interact with all visible elements on screen rega

  • harmonyos-device-automation

    Vision-driven HarmonyOS NEXT device automation using Midscene. Operates entirely from screenshots — no DOM or accessibility labels required. Can interact with all visible elements on screen regardless of technology stack. Control HarmonyOS devices with natural language commands via HDC. Perform taps

  • ios-device-automation

    Vision-driven iOS device automation using Midscene CLI. Operates entirely from screenshots — no DOM or accessibility labels required. Can interact with all visible elements on screen regardless of technology stack. Control iOS devices with natural language commands via WebDriverAgent. Triggers: ios,

  • vitest-midscene-e2e

    Enhances Vitest with Midscene for AI-powered UI testing across Web (Playwright), Android (ADB), and iOS (WDA). Scaffolds new projects, converts existing projects, and creates/updates/debugs/runs E2E tests using natural-language UI interactions. Triggers: write test, add test, create test, update tes

View source on GitHub

More from joshuarweaver/cascade-ai-ml-agents-misc-2

All 72 plugins →

Autonomous multi-agent coding system with 90+ specialized commands for development, testing, documentation, security, debugging, and Salesforce workflows.

96 skills · 109 commands · 15 agents · 1 MCP server · hooks

0

Intelligent task dispatch and performance tracking system for worker-agent coordination.

200 skills · 3 MCP servers

0

Comprehensive open-source library of AI research and engineering skills enabling AI agents to conduct research and solve complex problems.

98 skills

0

Collection of specialized agents, commands, and templates for understanding, analyzing, and documenting codebases.

50 skills

0

Comprehensive guidance for designing, building, and troubleshooting Claude Code subagents with system prompts, tool access, and best practices.

44 skills · 1 MCP server

0

Similar plugins

Codex-style computer use for Claude Code. Drives Windows and macOS apps through the accessibility tree instead of screenshots, so it targets exactly, survives display scaling, and costs about 20x fewer tokens. It can also work on the same desktop while you keep working, telling your input apart from its own.

1 skill · 1 command · 1 MCP server · hooks

davepoon/buildwithclaude 3,741

Source-grounded operator workflows for Snagit COM, Camtasia recording and export, managed deployment, licensing, storage, security, and artifact promotion

18 skills

jeremylongshore/tons-of-skills-marketplace 2,917

Lets Codex see and operate Android phones, emulators, the iOS Simulator and iPhones through a local MCP server and its skill, and asks you before any tap that pays.

1 skill · 1 MCP server

hashgraph-online/awesome-codex-plugins 1,566

Native Linux desktop control: semantic AT-SPI accessibility trees, screenshots, compositor window targeting (GNOME, KDE, Hyprland, niri, COSMIC, i3, Sway, labwc and other wlroots compositors, X11), Wayland/X11 input, and an on-screen activity indicator.

1 skill · 1 MCP server

agent-sh/computer-use-linux 868

Cross-OS desktop & browser control, through the accessibility tree first and screenshots last — the fallback execution layer for when APIs, CLIs, and direct integrations aren't available. Registers the clawdcursor MCP server (compact tool surface) and bundles its usage skill. Launches via npx, so no separate install step is required.

2 skills · 1 MCP server

AmrDab/clawdcursor 408

uipath

claudecodex

UiPath plugin for Claude Code — custom skills, agents, hooks, and MCP servers for UiPath workflows, UI automation, UI testing and UiPath troubleshoot

32 skills · 1 command · hooks

UiPath/skills 180

Maintain web-infra-dev-midscene-skills-1?

This page updates itself from your repo. Add the badge to your README, or get it Featured to pin it above the organic results with a followed link to your site.

claude & codex plugins72 plugins