Skip to content
philouvbPublic

About

WebCrawler

Resources

Stars

0 stars

Watchers

1 watching

Forks

Latest commit

 

History

12 Commits

Folders and files

Repository files navigation

Web Spider

Web crawler

Configuration

Put the project name and the homepage of the site to crawl into the lines below in the main.py file

PROJECT_NAME = ''
HOMEPAGE = ''

Running the Crawler

Type the following code into the terminal

python3 main.py

Results of the crawling

The software will create a directory of the name you defined into the main.py file. Into this directory will be created a crawled.txt file whitch contain all the links found.

About

WebCrawler

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages