Skip to content

A python web crawler that downloads content from specified sites. The supported sites are in the sites file.

License

Notifications You must be signed in to change notification settings

benevolent0377/Wanderer

Repository files navigation

__      __            _                 
\ \    / /_ _ _ _  __| |___ _ _ ___ _ _ 
 \ \/\/ / _\` | ' \/ _` / -_) '_/ -_) '_|
  \_/\_/\__,_|_||_\__,_\___|_| \___|_|  

Developed by: Benevolent0377

Start date: April 19, 2024

First stable release date: N/A

End date: N/A

==============================================

The Wanderer is a python web crawler designed to be a mulit-use web tool.

It will be expected to do the following:

  • Fetch HTML from a site or webpage

  • Fetch links from a webpage through HTML

  • Download video, image, and files from websites.

  • Index sites and write the data to a file.

The dependecies are currently unknown, but as development continues, I will list them here.

About

A python web crawler that downloads content from specified sites. The supported sites are in the sites file.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages