Commit 4e7586f6 authored by Thibault Allançon's avatar Thibault Allançon

bench: bitstate: automate benchmarking with scripts

* bench/bitstate/.gitignore,
  bench/bitstate/Makefile.am,
  bench/bitstate/README,
  bench/bitstate/bitstate.cc,
  bench/bitstate/bootstrap.sh,
  bench/bitstate/run.sh: implementation here
parent fc17dd05
Pipeline #17148 failed with stage
in 69 minutes and 38 seconds
# Benchmark binary
bitstate
# Input/output generated files
data/
log/
# Divine files
*.dve*
......@@ -31,3 +31,5 @@ LDADD = \
bin_PROGRAMS = bitstate
bitstate_SOURCES = bitstate.cc
CLEANFILES = *.dve *.dve2C *.dve.cpp
This directory contains benchmarking tools used to compute various statistics on
the bitstate hashing technique.
To retrieve model datasets, use the bootstrap.sh script. To run all the
downloaded datasets, use the run.sh script.
To benchmark individual model, you can directly use the bitstate binary:
$ make
$ ./bitstate input_model.dve log_file.csv 1000,10000,100000
# Optional (to remove generated files)
$ make clean
......@@ -85,6 +85,9 @@ int main(int argc, char** argv)
std::cerr << e.what() << '\n';
}
if (!modelcube)
return 2;
run<spot::ltsmin_kripkecube_ptr,
spot::cspins_state,
spot::cspins_iterator,
......
#!/bin/sh
# Retrieve BEEM dataset
curl -O "http://paradise.fi.muni.cz/data/beem_models_data.tar.gz"
tar xfz beem_models_data.tar.gz
#!/bin/bash
if [ $# -ne 2 ]; then
echo "Usage: ./run.sh DATA_DIRECTORY LOG_DIRECTORY"
exit 1
fi
data_dir="$1"
log_dir="$2"
# Memory size samples
mem_sizes=$((10**6)),$((10**7)),$((10**8))
mkdir -p "$log_dir"
for model in $(find $data_dir -name "*.dve"); do
model_name=$(basename "$model" .dve)
log_file="$log_dir"/"$model_name".log.csv
echo -n "Running model $model_name "
./bitstate "$model" "$log_file" "$mem_sizes" 2> /dev/null
if [ $? -eq 0 ]; then
echo -e "\e[1m\e[32mOK\e[0m"
else
echo -e "\e[1m\e[31mNOT OK\e[0m"
fi
done
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment