Public | Automated Build

Last pushed: a year ago
Short Description
used to be
Full Description


BTS is a platform to test various peer prediction mechanisms on crowdsourcing platforms.

Researchers wishing to use the platform can supply a list of questions, create small HTML templates for the UI and specify the payment mechanism. BTS does the rest.


  • Each agent sees a different random permutation of the questions
  • Multiple agents may work on the same question. Payment mechanism may rely on all answers in that round
  • GUI to set up the experiment (beta feature)
  • Built using the Meteor framework with MongoDB
  • Export data from the experiments in a CSV format.

Getting Started

To install a local copy of the platform, follow these instructions:

  1. Install Meteor.
  2. Install Docker
  3. Clone the directory:

     git clone bts/
  4. Start your app with the docker run command.

  5. Navigate to /setup to configure the experiment

Remote deployment

It is possible to deploy the platform via Amazon AWS. Once you provision a Ubuntu instance (14.04 LTS), follow the instructions above.


Multiple experiments have been deployed with this platform:


Feel free to open pull requests or issues on GitHub should you notice any bugs.


This platform is licensed under the GPL 3.0 license.

Docker Pull Command
Source Repository