{"user":"unclecode","name":"crawl4ai","namespace":"unclecode","repository_type":"image","status":1,"status_description":"active","description":"🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler \u0026 Scraper. ","is_private":false,"is_automated":false,"star_count":32,"pull_count":3772071,"last_updated":"2026-09-23T12:41:49.753412Z","last_modified":"2025-04-23T11:06:26.656447Z","date_registered":"2024-08-01T10:43:32.848311Z","collaborator_count":0,"affiliation":null,"hub_user":"unclecode","has_starred":false,"full_description":"# 🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler \u0026 Scraper.\n\n\u003ca href=\"https://trendshift.io/repositories/11716\" target=\"_blank\"\u003e\u003cimg src=\"https://trendshift.io/api/badge/repositories/11716\" alt=\"unclecode%2Fcrawl4ai | Trendshift\" style=\"width: 250px; height: 55px;\" width=\"250\" height=\"55\"/\u003e\u003c/a\u003e\n\n[![GitHub Stars](https://img.shields.io/github/stars/unclecode/crawl4ai?style=social)](https://github.com/unclecode/crawl4ai)\n[![Downloads](https://static.pepy.tech/badge/crawl4ai/month)](https://pepy.tech/project/crawl4ai)\n[![Join Discord](https://img.shields.io/badge/Join-Discord-7289.svg?\u0026style=flat\u0026logo=discord\u0026logoColor=white)](https://discord.gg/jP8KfhDhyN)\n[![Twitter Follow](https://img.shields.io/twitter/follow/unclecode?style=social)](https://x.com/unclecode)\n\nCrawl4AI is the #1 trending GitHub repository, actively maintained by a vibrant community. It delivers blazing-fast, AI-ready web crawling tailored for LLMs, AI agents, and data pipelines. Open source, flexible, and built for real-time performance, Crawl4AI empowers developers with unmatched speed, precision, and deployment ease.\n\n---\n\n## 🧪 Try It \n\n```bash\ndocker run -d \\\n  -p 11235:11235 \\\n  --name crawl4ai \\\n  --shm-size=3g \\\n  unclecode/crawl4ai:latest\n```\n\nNow open [http://localhost:11235/playground](http://localhost:11235/playground) a UI for testing crawls, tweaking configs, and generating JSON for your agents.\n\n---\n\n## 🔥 Sample API Call\n\n```bash\ncurl -X POST http://localhost:11235/crawl \\\n  -H \"Content-Type: application/json\" \\\n  -d '{\"urls\": [\"https://example.com\"]}'\n```\n\nOr stream results:\n\n```bash\ncurl -N -X POST http://localhost:11235/crawl/stream \\\n  -H \"Content-Type: application/json\" \\\n  -d '{\"urls\": [\"https://example.com\"], \"crawler_config\": {\"type\": \"CrawlerRunConfig\", \"params\": {\"stream\": true}}}'\n```\n\n---\n\n## 📦 From Docker Hub\n\n```bash\ndocker pull unclecode/crawl4ai:latest\n# Or specific version\ndocker pull unclecode/crawl4ai:0.6.0rc1-r1\n```\n\nMulti-arch support (`amd64`, `arm64`), `.llm.env` support for OpenAI, Claude, Groq, and others.\n\n---\n\n## 📚 Docs\n\nFull docs at **[docs.crawl4ai.com](https://docs.crawl4ai.com)** – learn how to tweak configs, use browser profiles, write custom filters, or deploy at scale.\n\n---\n\n## ❤️ Support the Project\n\n- ⭐ [Star on GitHub](https://github.com/unclecode/crawl4ai)\n- 🧠 [Follow @unclecode on X](https://x.com/unclecode)\n- 💬 [Join our Discord](https://discord.gg/jP8KfhDhyN)\n\n🖖 Live Long and `import Crawl4ai` \n","permissions":{"read":true,"write":false,"admin":false},"media_types":["application/vnd.docker.container.image.v1+json","application/vnd.oci.image.index.v1+json"],"content_types":["image"],"categories":[{"name":"Machine learning \u0026 AI","slug":"machine-learning-and-ai"},{"name":"Developer tools","slug":"developer-tools"},{"name":"Data science","slug":"data-science"}],"immutable_tags_settings":{"enabled":false,"rules":[".*"]},"storage_size":124861346088,"source":null}