Public | Automated Build

Last pushed: 7 days ago
Short Description
Flask app that uses beautiful soup to validate all links on your websites
Full Description

web-link-tester





Flask App to scrape and validate links via GUI or API

Usage

Why use the web-link-tester?

1) Test your production site via GUI or programmatically to ensure no bad page routes or forgotten references.
2) It's free.

To deploy the Web App/API


Docker

docker run -d --name link-tester -p 80:80 circa10a/web-link-tester

Access via http://localhost

Python

python main.py

Note This method may require to run as root unless you change the port number in main.py

Access via http://localhost

API Usage

curl -X POST --data "https://www.github.com" http://localhost/api

Example JSON Output

$ curl -X POST --data "http://caleblemoine.me" http://localhost/api
{
  "links": [
    {
      "code": 200,
      "url": "https://github.com/circa10a/"
    },
    {
      "code": 200,
      "url": "https://hub.docker.com/r/circa10a/"
    },
    {
      "code": 200,
      "url": "https://circa10a.github.io/monitor/"
    },
    {
      "code": 200,
      "url": "https://circa10a.github.io/smart-mirror/"
    },
    {
      "code": 200,
      "url": "http://scrapeyour.site"
    }
  ]
}

Bonus CLI utility

Can be found in my python-fun repo.

Stack

  • Utilizes gunicorn for multiple workers/threading.
  • Python 3
  • BeautifulSoup4
  • Jquery

Screenshots


Docker Pull Command
Owner
circa10a
Source Repository