CSIRO Arch README

For a high level overview of what is Arch and what it can do for you, please read ArchWhitePaper.pdf.

For instructions on Arch deployment, read DeployingArch.pdf.

It is also strongly recommended to read NUTCH README.txt

New in Arch 1.43

1. Last minute improvements to faceting and minor bug fixes.

New in Arch 1.42

1. Added easy to customize faceted search. See section 5.10 of the deployment manual. 
2. Added remote log processing. Read more in section 4.7.1 of the deployment manual.
3. Added an option to delete logs after processing.
4. Added an option to switch security OFF (e.g. for debugging).
5. Added a DB plugin that uses Apache Derby instead of MySQL.
6. Removed jars that were conflicting with Tomcat in some setups.
7. Changed the default protocol plugin from protocol-httpclient to protocol-http.

New in Arch 1.41

1. Introduced a GUI based configuration management tool (at beta stage now). Read more in section 4.9 
of the deployment manual.
2. Small bug fixes.

New in Arch 1.4

1. Fixed locale specific differences in writing and reading area indexing time.
2. Tuned Solr query processing parameters to optimise search precision.
3. Limited Solr Porter stemmer to performing just the first two stages of the algorithm.
4. Implemented a fix to Solr suboptimal porocessing of tokenizable strings.
5. Other small bug fixes. 

New in Arch 1.4b2

1. Removed obsolete cleanup.on.fail parameter from configuration files.
2. Added a couple of examples to httpclient-auth.xml.
3. Cleaned core-site.xml.
4. Corrected the deployment manual: arch seach form is not available before first crawl is done.
5. Fixed comment lines in Arch config files. They were causing problems.
6. Added bad config line reporting.
7. Fixed a Nutch bug in removing duplicates.
8. Added admin IP based authenticator.
8. Updated solrconfig: secured all unsecured request handlers with admin IP based authentication.
9. Added default admin request handler.

New in Arch 1.4b

1. Ported to Nutch 1.4 - a completely new architecture. See Arch White Paper. 
2. Added parallel crawling of multiple sites.
3. Simplified configuration and restructured configuration data.
4. Optimized use of RDB connections.
5. Fixed many bugs caused by the big move, and very likely, added new ones.

New in Arch 1.23

1. Added compatibility with Windows and Cygwin.

New in Arch 1.22

1. Added a "hot switch" to the new index after crawl using a HTTP request.
2. Fixed a bug in reuse of old index segment. 

New in Arch 1.21

1. Ported to the latest release of Nutch 1.2.
2. Added bookmarks as a special area. This allows indexing sets of third party pages.
3. Added email notifications. 
4. Fixed a few minor bugs and issues.




 


