catwhisperingninja/striatica repository overview

⁠striatica — a geometric atlas for machine intelligence

⁠3D visualization of neural network interpretability features from sparse autoencoders. Processes any model on Neuronpedia.

⁠Transcoder processing has some major bugs and is not perfectly reproducible with UMAP. Debugging is on-going; underlying architecture is sound with the exception of the number of connections assessed (per-feature) in any given circuit.

Currently, density is over-estimated due to some bugs in the distribution-processing phase.

A highly-detailed correction plan exists; update expected to ship within weeks. Until then, please consider the renderings a bit over-dense.

⁠Quick start

docker run -t -v $(pwd)/output:/app/output catwhisperingninja/striatica model --np-id gpt2-small/6-res-jb

⁠GPU Processing

docker run -t --gpus all -v $(pwd)/output:/app/output catwhisperingninja/striatica model --np-id gemma-2-2b/12-gemmascope-res-16k --device cuda