Skip to content

leobrival/rcrawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

25 Commits
 
 
 
 
 
 
 
 
 
 

Web Crawler Plugin

High-performance web crawler plugin for Claude Code.

Structure

This plugin uses a git submodule-based skill architecture:

web-crawler/
├── .claude-plugin/
│   └── plugin.json              ← Plugin configuration
└── skills/
    └── website-crawler/         ← Submodule (rcrawler)
        ├── SKILL.md             ← Skill for Claude Code
        ├── reference.md         ← Command reference
        ├── README.md            ← Submodule documentation
        ├── src/                 ← Rust source code
        ├── Cargo.toml           ← Rust configuration
        └── ...

Installation

The plugin automatically loads the website-crawler skill from the submodule.

For detailed documentation, see skills/website-crawler/README.md.

License

MIT

About

High-performance web crawler built in Rust with async runtime and interactive reporting

Topics

Resources

Code of conduct

Contributing

Security policy

Stars

Watchers

Forks

Releases

No releases published

Contributors