Sign inSign up

blacktop/nsrl

By blacktop

•Updated about 10 years ago

NSRL Database Hash Search

Image
4

7.4K

blacktop/nsrl repository overview

NSRL logo

⁠NSRL Dockerfile

CircleCI License Docker Stars Docker Pulls ![Docker Image](https://img.shields.io/badge/docker image-141.7 MB-blue.svg)⁠

This takes the 5.43GB NSRL minimal set and converts it into a 96M bloom filter⁠.

This repository contains a Dockerfile of the NSRL Database⁠.

⁠Dependencies
⁠Image Tags
$ docker images

REPOSITORY          TAG                 VIRTUAL SIZE
blacktop/nsrl       latest              142 MB
blacktop/nsrl       sha1                142 MB
blacktop/nsrl       name                142 MB
blacktop/nsrl       error_0.001         192 MB

NOTE: There are 3 other versions of this image:

  • sha1⁠ tag allows you to search the NSRL DB by sha-1 hash
  • name⁠ tag allows you to search the NSRL DB by filename
  • error_0.001⁠ tag searches by md5 hash and has a much lower error_rate threshold. It does, however, grow the size of the bloomfilter by 50MB.
⁠Installation
  1. Install Docker⁠.
  2. Download trusted build⁠ from public Docker Registry⁠: docker pull blacktop/nsrl
⁠Getting Started
$ docker run --rm blacktop/nsrl
usage: blacktop/nsrl [-h] [-v] MD5 [MD5 ...]

positional arguments:
  MD5            a md5 hash to search for.

optional arguments:
  -h, --help     show this help message and exit
  -v, --verbose  Display verbose output message
⁠Documentation
⁠Usage Example (with -v option):
$ docker run --rm blacktop/nsrl -v 60B7C0FEAD45F2066E5B805A91F4F0FC
Hash 60B7C0FEAD45F2066E5B805A91F4F0FC found in NSRL Database.
⁠To read from a hash-list file:
$ cat hash-list.txt
60B7C0FEAD45F2066E5B805A91F4F0FC
AABCA0896728846A9D5B841617EBE746
AABCA0896728846A9D5B841617EBE745

$ cat hash-list.txt | xargs docker run --rm blacktop/nsrl
True
True
False
⁠Optional Build Options

You can use different NSRL databases or error-rates for the bloomfilter (which will increase it's accuracy)

  1. To use your own NSRL⁠ database simply download the ZIP and place it in the nsrl folder and build the image like so: docker build -t my_nsrl .
  2. To decrease the error-rate of the bloomfilter simply change the value of ERROR_RATE in the file nsrl/shrink_nsrl.sh and build as above.
⁠Use blacktop/nsrl like a host binary

Add the following to your bash or zsh profile

alias nsrl='docker run --rm blacktop/nsrl $@'
⁠Issues

Find a bug? Want more features? Find something missing in the documentation? Let me know! Please don't hesitate to file an issue⁠

⁠Credits

Inspired by https://github.com/bigsnarfdude/Malware-Probabilistic-Data-Structres⁠

⁠CHANGELOG

See CHANGELOG.md⁠

⁠Contributing

See all contributors on GitHub⁠.

Please update the CHANGELOG.md⁠ and submit a Pull Request on GitHub⁠.

⁠License

MIT Copyright (c) 2014-2016 blacktop

Tag summary

Content type

Image

Digest

sha256:c2ddeeb05…

Size

110.5 MB

Last updated

about 10 years ago

docker pull blacktop/nsrl