WebCrawler

Java Multi-Threaded WebCrawler

Getting Started:

On windows environment run the run.bat file.

Otherwise run:

java -jar -Dthreads=NUMBER-OF-THREADS -DbaseURL=BASE-LINK -Dlimit=PAGE-LIMIT -Dlog4j.configurationFile=log4j.xml WebCrawler-0.1-edeng.jar

Built With:

Maven - Dependency Management

Author:

Eden Gabay

License:

This project is licensed under the MIT License - see the LICENSE.md file for details