Sign inSign up

bootjp/crawler

By bootjp

•Updated over 8 years ago

Web pages 404 and soft 404 checker

Image
0

3.2K

bootjp/crawler repository overview

⁠OreTokuCrawler

Build Status Scrutinizer Code Quality

⁠Now Beta2 Version relese.

⁠Makeing now...
⁠How To Use
⁠Introduction
$ curl -s http://getcomposer.org/installer | php
$ php composer.phar install
or
$ composer install
⁠Use Ex.
$ php wrapper.php --url=https://bootjp.me
or
$  php wrapper.php --url=https://bootjp.me --recursion=false

-> https://bootjp.me/⁠ is root on the contents link check

$ php wrapper.php --url=https://bootjp.me --recursion=true

-> https://bootjp.me/⁠ is on the contents link all check

⁠Use docker images

dockerImage is hire -> https://hub.docker.com/r/bootjp/crawler⁠

docker pull bootjp/crawler
docker run bootjp/crawler php wrapper.php --url=https://bootjp.me --recursion=false --auth=username:password
⁠Basic Auth
$ php wrapper.php --url=https://bootjp.me --recursion=false --auth=username:password

LICENSE⁠

日本語での解説記事(ちょっと古い)⁠

Tag summary

Content type

Image

Digest

sha256:58337c487…

Size

147.1 MB

Last updated

over 8 years ago

docker pull bootjp/crawler