hohn/sarif-cli
1
0
Fork 0
mirror of https://github.com/hohn/sarif-cli.git synced 2025-12-16 09:13:04 +01:00
Code Issues Packages Projects Releases Wiki Activity

Add simple timing run information

Browse Source
This commit is contained in:
Michael Hohn
2022-05-16 11:43:05 -07:00
committed by =Michael Hohn
parent 154b0bdc56
commit 3dd8522b7f
1 changed files with 142 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

142
scripts/timing-runs.org Normal file
View File

@@ -0,0 +1,142 @@
* Timing Runs
These are simple, manual timing runs intended to get a general idea of the speed
of the =sarif-extract-multi= script. The special cases enumerated were run via
simple modifications of =sarif-extract-multi= itself, on a 2.4 GHz Intel i9
Macbook Pro running Mac OS 10.15.
Starting from the shell. Includes python library loading.
#+BEGIN_SRC sh
source ~/local/sarif-cli/.venv/bin/activate
pushd ~/local/sarif-cli/data/treeio
for i in `seq 1 6`; do
echo "Run $i"
time sarif-extract-multi multi-sarif-01.json test-multi-table
done
#+END_SRC
Resulted in
#+BEGIN_SRC text
Run 1
real 0m1.031s
user 0m1.522s
sys 0m0.374s
Run 2
real 0m0.998s
user 0m1.608s
sys 0m0.271s
Run 3
real 0m1.010s
user 0m1.538s
sys 0m0.346s
Run 4
real 0m0.995s
user 0m1.603s
sys 0m0.270s
Run 5
real 0m1.003s
user 0m1.614s
sys 0m0.269s
Run 6
real 0m1.019s
user 0m1.622s
sys 0m0.279s
#+END_SRC
Starting from a "warmed up" process: python and libraries loaded.
#+BEGIN_SRC sh
source ~/local/sarif-cli/.venv/bin/activate
cd ~/local/sarif-cli/data/treeio
sarif-extract-multi multi-sarif-01.json test-multi-table
#+END_SRC
Results (equivalent to the =user= time from =time=)
#+BEGIN_SRC text
Run 0: 0.542348s
Run 1: 0.546161s
Run 2: 0.54764s
Run 3: 0.518991s
Run 4: 0.557537s
Run 5: 0.536539s
Run 6: 0.529583s
#+END_SRC
Without writing CSV output
#+BEGIN_SRC text
Run 0: 0.511462s
Run 1: 0.518179s
Run 2: 0.523012s
Run 3: 0.489899s
Run 4: 0.496991s
Run 5: 0.513001s
Run 6: 0.507116s
#+END_SRC
Without snowflake replacement
#+BEGIN_SRC text
Run 0: 0.335577s
Run 1: 0.341613s
Run 2: 0.312449s
Run 3: 0.326661s
Run 4: 0.338642s
Run 5: 0.335792s
Run 6: 0.337349s
#+END_SRC
Only load files
#+BEGIN_SRC text
Run 0: 0.020657s
Run 1: 0.019108s
Run 2: 0.020074s
Run 3: 0.031301s
Run 4: 0.02231s
Run 5: 0.02153s
Run 6: 0.020675s
#+END_SRC
Load and destructure
#+BEGIN_SRC text
Run 0: 0.177665s
Run 1: 0.16471s
Run 2: 0.173436s
Run 3: 0.177363s
Run 4: 0.172343s
Run 5: 0.167929s
Run 6: 0.171293s
#+END_SRC
Load, destructure, attach tables
#+BEGIN_SRC text
Run 0: 0.211985s
Run 1: 0.213316s
Run 2: 0.195308s
Run 3: 0.200123s
Run 4: 0.201668s
Run 5: 0.209793s
Run 6: 0.203792s
#+END_SRC
# # Use files downloaded via sarif-download-projects.py
# cd ~/local/sarif
# find g -type f -name "*.sarif" -maxdepth 3 | head -2
# ( find g -type f -name "*.sarif" -maxdepth 3 | while read sarfile ; do
# echo "summarizing $sarfile"
# if [ ! -f "${sarfile%.sarif}.summary" ] ; then
# sarif-results-summary $sarfile > ${sarfile}.summary-tmp && \
# mv ${sarfile}.summary-tmp ${sarfile%.sarif}.summary
# fi
# done ) > log.2 2>&1