codex

Kreuzcrawl

Web crawling and scraping for Codex with skills for single-page scraping, site crawls, URL mapping, and headless browser fallback.

0 on GitHubby Kreuzberg, Inc.v0.2.2MITupdated 4 months agoCommunity / Tools & Integrations

Plugin kreuzcrawl in ConcertoNotes/codex-plugins. Commands read from the repo's manifest — 1 month ago.

What it installs

Skills (7)

  • automating-the-browser

    Use when extracting a page needs scripted interaction first — click, type, press a key, scroll, wait, screenshot, or run JS before capturing the DOM. Covers `kreuzcrawl interact <url> --actions` with the real action schema, result shape, limits, and external-CDP options.

  • crawling-a-site

    Use when the user wants to follow links across a domain and capture every reachable page as Markdown. Covers `kreuzcrawl crawl` with depth, page caps, concurrency, rate limiting, domain scoping, robots, and output selection.

  • headless-fallback

    Use when a static fetch returns nothing useful and the page needs a real browser. Covers `--browser-mode auto|always|never`, external CDP via `--browser-endpoint`, symptoms of JS-only pages and WAF blocks, and the performance cost.

  • kreuzcrawl

    Crawl, scrape, and convert websites to Markdown using the local kreuzcrawl CLI and its MCP server. Use when the user wants to fetch a page, follow links across a domain, enumerate URLs, or drive a real browser. Covers installation, the subcommands (scrape, crawl, map, interact, mcp, serve), output f

  • mapping-urls

    Use when the user wants the list of URLs on a site rather than the page content — sitemap analysis, link planning, or seeding another tool. Covers `kreuzcrawl map <url>` with `--limit`, `--search`, robots, output, and how it differs from a full crawl.

  • scraping-html-to-markdown

    Use when the user wants a single page rendered as clean Markdown plus structured metadata. Covers `kreuzcrawl scrape <url>`, JSON vs Markdown output, what metadata is returned, and how to handle JS-heavy pages.

  • serving-the-api

    Use when the user wants a long-running HTTP service for scrape/crawl/map instead of one-shot CLI calls or the MCP server — for example wiring kreuzcrawl into other apps over REST. Covers `kreuzcrawl serve`, the Firecrawl-v1-compatible endpoints, `--host`/`--port`, and when to prefer it.

View source on GitHub kreuzberg.dev

More from ConcertoNotes/codex-plugins

All 321 plugins →

Role-based team delivery framework — Tech Lead-orchestrated 8-role system with 195+ skills, 27 specialist agents, 80+ commands, hooks, and ECC harness for Claude Code, Codex, and OpenCode.

200 skills

0

131 evidence-based education skills for curriculum design, lesson planning, and assessment, with transparent evidence ratings and MCP server.

164 skills

0

Reusable Agent Skills for Codex, Claude Code, and compatible clients, covering Django, Rust, Cookiecutter, SEO, traction, product marketing, and nonfiction publishing workflows.

123 skills

0

DevOps layer for coding agents with flow, feedback, and memory that compounds between sessions.

74 skills

0

Zoom

codex

把 Codex 连接到 Zoom 会议上下文,并构建 Zoom 应用、机器人、API 集成、SDK 工作流、Webhook 和自动化。

40 skills · 26 commands · 2 agents · app connector

0

13 skills for image, video, and audio generation using 100+ models - FLUX, Midjourney v7, Veo3, Kling 3.0, Suno, and HunyuanVideo via muapi.ai.

57 skills

0

Similar plugins

Web scraping, Google search, structured data extraction, and MCP server integration powered by Bright Data. Includes 7 skills: scrape any webpage as markdown (with bot detection/CAPTCHA bypass), search Google with structured JSON results, extract data from 40+ websites (Amazon, LinkedIn, Instagram, TikTok, YouTube, and more), orchestrate Bright Data's 60+ MCP tools, built-in best practices for Web Unlocker, SERP API, Web Scraper API, and Browser API, Python SDK best practices for the brightda...

21 skills

anthropics/claude-plugins-official 47,076

Web scraping, Google search, structured data extraction, and MCP server integration powered by Bright Data. Includes 7 skills: scrape any webpage as markdown (with bot detection/CAPTCHA bypass), search Google with structured JSON results, extract data from 40+ websites (Amazon, LinkedIn, Instagram, TikTok, YouTube, and more), orchestrate Bright Data's 60+ MCP tools, built-in best practices for Web Unlocker, SERP API, Web Scraper API, and Browser API, Python SDK best practices for the brightda...

21 skills

anthropics/knowledge-work-plugins 35,601

Thirteen slash commands wrapping the designlang CLI: /extract (full design language → DTCG, Tailwind, Figma), /site (crawl a whole site → one canonical design system + consistency grade), /grade (shareable HTML report card + SVG badge), /battle (head-to-head graded comparison), /remix (restyle in 6 vocabularies — brutalist, swiss, art-deco, cyberpunk, soft-ui, editorial), /pack (one downloadable design-system bundle), /theme-swap (OKLCH-correct recolour around a new brand primary), /brand (full editorial brand-guidelines book — 13 chapters, hand-off-ready), /pair (fuse two designs across configurable axes — colours from one site, typography from another), /studio (live token-editor with component preview + export), /verify (rebuild from tokens and pixel-diff vs live for a fidelity score), /fidelity (score a clone vs the original — visual pixel-diff + motion fidelity — with a ranked correction plan), /gallery (build a shareable static gallery of measured clones).

2 skills · 14 commands

Manavarya09/design-extract 5,068

browse

claude

Automate web browser interactions using natural language. Use when the user asks to browse websites, navigate web pages, extract data from websites, take screenshots, fill forms, click buttons, or interact with web applications.

18 skills

browserbase/skills 3,757

skyvern

claude

Browser automation in Claude Code through Skyvern Cloud: open pages, fill forms, extract structured data, take screenshots, and run repeatable workflows. Sign in with OAuth from /mcp. Runs can use Skyvern credits.

1 skill · 1 MCP server

davepoon/buildwithclaude 3,741

Operator-grade Firecrawl v2 skill pack with 30 governed acquisition, security, reliability, and production workflows

30 skills

jeremylongshore/tons-of-skills-marketplace 2,917

Maintain Kreuzcrawl?

This page updates itself from your repo. Add the badge to your README, or get it Featured to pin it above the organic results with a followed link to your site.

claude & codex plugins321 plugins