sarif-cli/scripts/timing-runs.org

• Timing Runs

Timing Runs

These are simple, manual timing runs intended to get a general idea of the speed of the sarif-extract-multi script. The special cases enumerated were run via simple modifications of sarif-extract-multi itself, on a 2.4 GHz Intel i9 Macbook Pro running Mac OS 10.15.

Starting from the shell. Includes python library loading.

  source ~/local/sarif-cli/.venv/bin/activate

  pushd ~/local/sarif-cli/data/treeio

  for i in `seq 1 6`; do
      echo "Run $i"
      time sarif-extract-multi multi-sarif-01.json test-multi-table 
  done

Resulted in

  Run 1

  real	0m1.031s
  user	0m1.522s
  sys	0m0.374s
  Run 2

  real	0m0.998s
  user	0m1.608s
  sys	0m0.271s
  Run 3

  real	0m1.010s
  user	0m1.538s
  sys	0m0.346s
  Run 4

  real	0m0.995s
  user	0m1.603s
  sys	0m0.270s
  Run 5

  real	0m1.003s
  user	0m1.614s
  sys	0m0.269s
  Run 6

  real	0m1.019s
  user	0m1.622s
  sys	0m0.279s

Starting from a "warmed up" process: python and libraries loaded.

  source ~/local/sarif-cli/.venv/bin/activate
  cd ~/local/sarif-cli/data/treeio
  sarif-extract-multi multi-sarif-01.json test-multi-table

Results (equivalent to the user time from time)

  Run 0: 0.542348s
  Run 1: 0.546161s
  Run 2: 0.54764s
  Run 3: 0.518991s
  Run 4: 0.557537s
  Run 5: 0.536539s
  Run 6: 0.529583s

Without writing CSV output

  Run 0: 0.511462s
  Run 1: 0.518179s
  Run 2: 0.523012s
  Run 3: 0.489899s
  Run 4: 0.496991s
  Run 5: 0.513001s
  Run 6: 0.507116s

Without snowflake replacement

  Run 0: 0.335577s
  Run 1: 0.341613s
  Run 2: 0.312449s
  Run 3: 0.326661s
  Run 4: 0.338642s
  Run 5: 0.335792s
  Run 6: 0.337349s

Only load files

  Run 0: 0.020657s
  Run 1: 0.019108s
  Run 2: 0.020074s
  Run 3: 0.031301s
  Run 4: 0.02231s
  Run 5: 0.02153s
  Run 6: 0.020675s

Load and destructure

  Run 0: 0.177665s
  Run 1: 0.16471s
  Run 2: 0.173436s
  Run 3: 0.177363s
  Run 4: 0.172343s
  Run 5: 0.167929s
  Run 6: 0.171293s

Load, destructure, attach tables

  Run 0: 0.211985s
  Run 1: 0.213316s
  Run 2: 0.195308s
  Run 3: 0.200123s
  Run 4: 0.201668s
  Run 5: 0.209793s
  Run 6: 0.203792s