mirror of
https://github.com/hohn/codeql-cli-end-to-end.git
synced 2025-12-16 13:13:03 +01:00
Smallest query suite to largest
This commit is contained in:
committed by
=Michael Hohn
parent
fa76851f13
commit
abece44924
@@ -1,4 +1,4 @@
|
|||||||
-*- mode: org; org-confirm-babel-evaluate: nil; coding: utf-8 -*-
|
# -*- mode: org; org-confirm-babel-evaluate: nil; coding: utf-8 -*-
|
||||||
#+OPTIONS: H:3 num:t \n:nil @:t ::t |:t ^:{} f:t *:t TeX:t LaTeX:t skip:nil p:nil
|
#+OPTIONS: H:3 num:t \n:nil @:t ::t |:t ^:{} f:t *:t TeX:t LaTeX:t skip:nil p:nil
|
||||||
#+OPTIONS: org-confirm-babel-evaluate:nil
|
#+OPTIONS: org-confirm-babel-evaluate:nil
|
||||||
|
|
||||||
@@ -876,12 +876,44 @@ git checkout 203343df
|
|||||||
# #+END_SRC
|
# #+END_SRC
|
||||||
|
|
||||||
** Running sequence
|
** Running sequence
|
||||||
*** Smallest query suite (security suite).
|
*** Smallest query suite to largest
|
||||||
*** Check results.
|
A short script to show us how many queries the standard suites have:
|
||||||
**** Lots of result (> 5000) -> cli review via compiler-style dump.
|
|
||||||
**** Medium result sets (~ 2000) (sarif review plugin, can only load 5000
|
#+BEGIN_SRC sh :exports both :results output
|
||||||
results)
|
export PATH=$HOME/local/codeql-cli-end-to-end/codeql:"$PATH"
|
||||||
**** Few results (sarif review plugin, can only load 5000 results)
|
|
||||||
|
queries=`codeql resolve queries 2>&1 | grep cpp | awk '{print($1)}'`
|
||||||
|
(
|
||||||
|
for suite in $queries
|
||||||
|
do
|
||||||
|
len=`codeql resolve queries $suite | wc -l`
|
||||||
|
echo "Suite $suite has $len queries"
|
||||||
|
done
|
||||||
|
) 2>/dev/null
|
||||||
|
#+END_SRC
|
||||||
|
|
||||||
|
#+RESULTS:
|
||||||
|
: Suite cpp-code-scanning.qls has 47 queries
|
||||||
|
: Suite cpp-lgtm-full.qls has 169 queries
|
||||||
|
: Suite cpp-lgtm.qls has 100 queries
|
||||||
|
: Suite cpp-security-and-quality.qls has 167 queries
|
||||||
|
: Suite cpp-security-experimental.qls has 118 queries
|
||||||
|
: Suite cpp-security-extended.qls has 83 queries
|
||||||
|
|
||||||
|
If we want to gradually increase coverage using the standard suites, we would
|
||||||
|
thus use them in this order:
|
||||||
|
- cpp-code-scanning.qls, 47 queries
|
||||||
|
- cpp-security-extended.qls, 83 queries
|
||||||
|
- cpp-lgtm.qls, 100 queries
|
||||||
|
- cpp-security-experimental.qls, 118 queries
|
||||||
|
- cpp-security-and-quality.qls, 167 queries
|
||||||
|
- cpp-lgtm-full.qls, 169 queries
|
||||||
|
|
||||||
|
*** Check result counts
|
||||||
|
- Lots of result (> 5000) -> cli review via compiler-style dump.
|
||||||
|
- Medium result sets (~ 2000) (sarif review plugin, can only load 5000
|
||||||
|
results)
|
||||||
|
- Few results (sarif review plugin, can only load 5000 results)
|
||||||
*** Expand query
|
*** Expand query
|
||||||
** Compare results.
|
** Compare results.
|
||||||
*** sarif-cli using compiler-style dump
|
*** sarif-cli using compiler-style dump
|
||||||
|
|||||||
Reference in New Issue
Block a user