Apache Nutch is an open source web-search software project. Stemming from Apache Lucene, it now builds on Apache Solr adding web-specifics, such as a crawler, a link-graph database and parsing support handled by Apache Tika for HTML and array other document formats.
Nutch can run on a single machine, but gains a lot of its strength from running in a Hadoop cluster
© 2016 Laliwala IT. All rights reserved.