The repository contains the code for web crawler.
SUMMARY
- The project is a maven project.
- It uses Spring Dependency Injection to inject various beans.
- The max number of links to be visited is 50.
- If due to any reason , any link cannot be visited, the link is not counted as visited.
STEPS to build:
- Navigate to project directory.
- Run command "mvn clean package"
- The above command create an executable jar for the project.
- Then navigate to target directory.
- Run command "java -jar webcrawler-1.0-jar-with-dependencies.jar"