Sign inSign up

philterd/philter-scope

By philterd

•Updated about 2 months ago

Audit PII redaction quality against a golden dataset and score policies on precision and recall.

Image
0

308

philterd/philter-scope repository overview

⁠PhilterScope

PhilterScope measures how well PII and PHI redaction is working. It compares redaction output against a golden dataset of labeled PII and scores it on precision, recall and F1, so a redaction policy change can be evaluated rather than guessed at. It audits Philter⁠ and reports per-entity recall, a confusion matrix, per-document results and suggested policy changes.

PhilterScope is open source and self-hosted. Your text and your golden data stay inside your own environment.

⁠Quick start

Serve a report produced by a previous audit:

docker run --rm -p 5000:5000 \
  -v "$PWD/report.json:/data/report.json:ro" \
  philterd/philter-scope:latest

Then open http://localhost:5000⁠.

Serve from MongoDB instead, which takes precedence over the report file:

docker run --rm -p 5000:5000 \
  -e PHILTERSCOPE_MONGODB_CONNECTION_STRING=mongodb://mongo:27017/philterscope \
  philterd/philter-scope:latest

Run an audit by overriding the command. --user lets the non-root container write the reports back to a bind-mounted directory:

docker run --rm --user "$(id -u):$(id -g)" \
  -v "$PWD/data:/data" \
  philterd/philter-scope:latest \
  philterscope-audit --golden /data/golden/ --input /data/raw/ --output /data/ --threshold 0.75

⁠License

Copyright 2026 Philterd, LLC. "Philter" is a registered trademark of Philterd, LLC.

Licensed under the Apache License, Version 2.0.

Tag summary

Content type

Image

Digest

sha256:5c897515b…

Size

16.3 MB

Last updated

about 2 months ago

docker pull philterd/philter-scope