micahflee/blueleaks-explorer repository overview

⁠BlueLeaks Explorer

BlueLeaks Explorer is open source software for journalists to investigate all of the data in the BlueLeaks dataset⁠. You must have a copy of the BlueLeaks dataset (250GB to download, 271GB once extracted) in order to use it.

For in-depth instructions, read Chapter 10 of Hacks, Leaks, and Revelations. Also, check out the project on GitHub at https://github.com/micahflee/blueleaks-explorer⁠.

⁠Docker Compose

Here's a sample docker-compose.yaml:

version: "3.9"
    
services:
  app:
    image: micahflee/blueleaks-explorer:latest
    ports:
      - "8000:80"
    volumes:
      - /Volumes/datasets/BlueLeaks-extracted:/data/blueleaks
      - ./databases:/data/databases
      - ./structures:/data/structures

Under volumes, replace /Volumes/datasets/BlueLeaks-extracted with the path to the extracted BlueLeaks dataset.

Bring the container up:

docker-compose up

The first time you use BlueLeaks Explorer you must run the initialize script. This will import data from all of the CSV files into SQLite databases.

docker-compose exec app poetry run python ./initialize.py

it will create 4.7GB of SQLite3 databases in your databases folder. You only need to do this step once.

You can access BlueLeaks Explorer at http://localhost:8000/⁠.