This repository contains two branches:
- The main, which contains the original
NET-SDimplmentation. - The
NCF-NET-SDimplementation, which is removes common blocks.
This tool is an adaptation of MRSH-NET, a similarity search tool based on MRSH-V2. This implementation changes the feature extraction tool, which is originally MRSH-V2's to sdhash's, aiming to improve its perfomance.
- Velho, J. P. B., Moia, V. H. G., and Henriques, M. A. A. (2020). Entendendo e melhorando
a capacidade de detecçao de estrategias de busca de similaridade em investigações
forenses. XX Brazilian Symposium on information and computational systems security,
Brazilian Computer Society (SB).
- Breitinger, F., Baier, H., and White, D. (2014a). On the database lookup problem of
approximate matching. Digital Investigation, 11:S1–S9
- Boost
- OpenSSL (for sha1 hash)
- CMake
-
Extract the library folder onto
NET-SD's main folder -
Inside boost folder Run:
$ ./bootstrap.sh --prefix = /usr/local/
$ ./b2 install
- The setup is complete!
- Run:
$ cmake .
$ make
File ./header/config.h
#define MIN_RUN <number>
File ./header/config.h
#define BF_SIZE_IN_BYTES <number>
Obs.: The size must be power of two and expressed in bytes.
There are two main options:
- Create BF
- Search the given bf for files
And there are two ways of making such operations:
- With a list
- With a dir/file name
-
To create:
- a bf with a dir/filename:
./net_sd -g DIR/FILE > filter.sdbf- a bf with a list:
./net_sd -d LIST.TXT > filter.sdbf -
To search:
- a file/dir into a given bf digest:
./net_sd -c filter.sdbf DIR/FILE > resultados.txt- a list of files into a given bf digest:
./net_sd -i filter.sdbf list.txt > resultados.txt
Obs.: I have not tested using a dir inside the given dir, so if you are going to use it please check for possible errors.