This is the first of a two part series of articles that will focus on Open Source web crawlers implemented in Java programming language. The goal is familiarize user in some basic concepts of crawling and also dig deeper into some implementations such as Apache Nutch and Apache Droids. This first part covers the generic part as well as Apache Nutch. More data: click here.