github.com
Crawl4AI
A web crawling and extraction toolkit for preparing website content for AI applications.
https://github.com/unclecode/crawl4aiAbout This Resource
A web crawling and extraction toolkit for preparing website content for AI applications. It converts pages into formats such as Markdown and supports configurable crawling workflows.
Saved Notes
Original notes saved with this link. They may describe an earlier version.
GitHub - unclecode/crawl4ai: 🔥🕷️ Crawl4AI: Open-source LLM Friendly Web Crawler & Scrapper
https://github.com/unclecode/crawl4ai
Crawl4AI is an open-source Python library designed to simplify web crawling and extract useful information from web pages.