osirrc2019/solrini repository overview

⁠OSIRRC Docker Image for Solrini

Ryan Clancy⁠ and Jimmy Lin⁠

This is the docker image for the Anserini⁠ toolkit (v0.5.1), with Solr indexing, conforming to the OSIRRC jig⁠ for the Open-Source IR Replicability Challenge (OSIRRC) at SIGIR 2019⁠. This image is available on Docker Hub⁠. The OSIRRC 2019 image library⁠ contains a log of successful executions of this image.

• Supported test collections: robust04, core17, core18 (newswire); gov2, cw09b, cw12b (web)
• Supported hooks: init, index, interact

The search results are the same Anserini, thus we use those results.

⁠Quick Start

The following jig command can be used to index TREC disks 4/5 for robust04:

python run.py prepare \
  --repo osirrc2019/solrini \
  --tag v0.1.0 \
  --collections robust04=/path/to/disk45=trectext \
  --opts solr_memory=8G solr_version 8.0.0

The following jig command can be used to perform a retrieval run on the collection with the robust04 test collection.

python run.py interact \
  --repo osirrc2019/solrini \
  --tag v0.1.0

Use docker ps to see the container running with a port mapping that looks like 0.0.0.0:[port]->8983/tcp. Navigate to 0.0.0.0:[port] in your web browser to view Solr.

⁠Retrieval Methods

The Anserini image supports the following retrieval methods:

• BM25: k1=0.9, b=0.4 (Robertson et al., 1995)
• QL (query likelihood with Dirichlet smooth): mu=1000 (Zhai and Lafferty, 2001)
• +RM3 (RM3 variant of relevance models, applied on top of initial BM25 or QL results): exact parameter settings⁠ (Abdul-Jaleel et al., 2004)
• +Ax (Semantic term matching in the axiomatic framework, applied on top of initial BM25 or QL results): exact parameter settings⁠ (Fang and Zhai, 2006)

⁠Expected Results

The following numbers should be able to be re-produced using the scripts provided in the bin⁠ directory.

⁠robust04

⁠core17

⁠core18

⁠gov2

⁠cw09b

⁠cw12b

⁠Implementation

The following is a quick breakdown of what happens in each of the scripts in this repo.

⁠Dockerfile

The Dockerfile installs dependencies, copies scripts to the root dir, exposes port 8983, and sets the working dir to /work.

⁠init

The init script⁠ clones Anserini, installs Solr, and bootstraps Solr with Anserini configs.

⁠index

The index script⁠ indexes the collection with Solr.

⁠References

• Stephen E. Robertson, Steve Walker, Micheline Hancock-Beaulieu, Mike Gatford, and A. Payne. (1995) Okapi at TREC-4. TREC
• ChengXiang Zhai and John Lafferty. (2001) A Study of Smoothing Methods for Language Models Applied to Ad Hoc Information Retrieval. SIGIR.
• Nasreen Abdul-Jaleel, James Allan, W. Bruce Croft, Fernando Diaz, Leah Larkey, Xiaoyan Li, Donald Metzler, Mark D. Smucker, Trevor Strohman, Howard Turtle, and Courtney Wade. (2004) UMass at TREC 2004: Novelty and HARD. TREC.
• Hui Fang and ChengXiang Zhai. (2006) Semantic Term Matching in Axiomatic Approaches to Information Retrieval. SIGIR.

⁠Reviews

• Documentation reviewed at commit xxxxx⁠ (xx/xx/xxxx) by xxxxx⁠.