This is a very basic indexing project.

It uses Jsoup library and I just have uploaded the library in $JAVA_HOME/jre/lib/ext.

For compiling or re-compiling the project do next thing: javac crawler/*.java

In order to run indexing do command below: java crawler.Execute <Number of threads (50 recommended)>