Audit PII redaction quality against a golden dataset and score policies on precision and recall.
225
PhilterScope measures how well PII and PHI redaction is working. It compares redaction output against a golden dataset of labeled PII and scores it on precision, recall and F1, so a redaction policy change can be evaluated rather than guessed at. It audits Philter and reports per-entity recall, a confusion matrix, per-document results and suggested policy changes.
PhilterScope is open source and self-hosted. Your text and your golden data stay inside your own environment.
Serve a report produced by a previous audit:
docker run --rm -p 5000:5000 \
-v "$PWD/report.json:/data/report.json:ro" \
philterd/philter-scope:latest
Then open http://localhost:5000.
Serve from MongoDB instead, which takes precedence over the report file:
docker run --rm -p 5000:5000 \
-e PHILTERSCOPE_MONGODB_CONNECTION_STRING=mongodb://mongo:27017/philterscope \
philterd/philter-scope:latest
Run an audit by overriding the command. --user lets the non-root container write the reports back to a bind-mounted directory:
docker run --rm --user "$(id -u):$(id -g)" \
-v "$PWD/data:/data" \
philterd/philter-scope:latest \
philterscope-audit --golden /data/golden/ --input /data/raw/ --output /data/ --threshold 0.75
Copyright 2026 Philterd, LLC. "Philter" is a registered trademark of Philterd, LLC.
Licensed under the Apache License, Version 2.0.
Content type
Image
Digest
sha256:5c897515b…
Size
16.3 MB
Last updated
25 days ago
docker pull philterd/philter-scope