A link checker written in Python that can crawl a web site and identify broken links
You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
Gergely Polonkai 1af6eee3d3 Add README file 8 years ago
COPYING Initial commit 8 years ago
README.md Add README file 8 years ago
link-checker.py Rename crawler.py, as it better suites the script 8 years ago

README.md

Link checker

This is a small link checker script intended for checking and listing all links that can be found on the specified pages, and all other pages linked from that site.

The script also crawls the site, checking all links on the same server. External links are checked but not crawled.

A site is considered external if its hostname or even its scheme (http:// instead of https://) doesnt match with the base URL (specified on the command line).