Skip to content
bnewport edited this page Sep 13, 2010 · 28 revisions

Client side jar list (lucene side list)
Lucene and all its dependencies

  • wxslucene.jar
  • wxsutils.jar
  • ogclient.jar or objectgrid.jar

Grid side jar list

  • wxsutils.jar
  • wxslucene.jar
  • objectgrid.jar and all its dependencies

The objectgrid.xml and deployment.xml files in the test/resources should be used with appropriate modifications for partition counts and replication strategy.

The wxsutils.properties file in test/resources should be configured to attach to the grid in which to store the indexes. There is no need to add maps and so on for additional indexes. The map definitions are constant. I may break each directory to its own maps purely so that metrics on map sizes etc can be easily made specific to a particular directory.

The wxslucene.properties file in test/resources allows the directory to be customized. The main things to modify here if required are the block size and the compression. We recommend async_put to always be on, it’s MUCH faster when copying disk based directories in to a grid based directory, possible 6-10x faster. The compression can significantly reduce the memory required for the index and reduces the network bandwidth required between the lucene JVMs and the grid. There is a CPU cost and this cost needs to be weighed against the advantages. Index files are broken in to chunks or blocks of a fixed size when stored in the grid. The blockSize parameter specifies how big those blocks are. 4k seems a common value for these kinds of system.

Both these property files need to be in a folder on the lucene JVM classpath for them to be found.

Clone this wiki locally