A link checker written in Python that can crawl a web site and identify broken links
Go to file
Gergely Polonkai 1af6eee3d3 Add README file 2015-09-02 09:31:05 +00:00
COPYING Initial commit 2015-08-31 14:50:56 +00:00
README.md Add README file 2015-09-02 09:31:05 +00:00
link-checker.py Rename crawler.py, as it better suites the script 2015-09-02 09:14:26 +00:00

README.md

Link checker

This is a small link checker script intended for checking and listing all links that can be found on the specified pages, and all other pages linked from that site.

The script also crawls the site, checking all links on the same server. External links are checked but not crawled.

A site is considered external if its hostname or even its scheme (http:// instead of https://) doesnt match with the base URL (specified on the command line).