Norconex

Norconex Web Crawler with Playwright and Chromium bundled, as an alternative to WebDriver.

Open-source web crawler: collect, parse and commit website content to your repository.

Open-source file system crawler: collect, parse and commit local or remote files.