Skip to content
This repository was archived by the owner on Mar 31, 2018. It is now read-only.

edwardleoni/devourer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 

Repository files navigation

devourer

NodeJS application capable of scraping the whole internet, the only limit is how much information you can store

All you need to do is insert the first website on the scrapping queue, the application will search the website for links and will do the same to the found links, as internet is literally a web (all connected by links), the scrapper won't stop (or will if you feed it with a website that's got no links to other websites lol).

About

NodeJS application capable of scraping the whole internet, the only limit is how much information you can store

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors