Tom Hvitved
|
4099d1318f
|
Data flow: Tweak two join-orders
Before
```
[2022-04-06 13:19:29] (96s) Tuple counts for DataFlowImpl2::Stage1::revFlowConsCand#7ad53399#ff/2@i14#aa10f2wi after 4.4s:
10681 ~0% {2} r1 = SCAN DataFlowImpl2::Stage1::revFlow#7ad53399#fff#prev_delta OUTPUT In.0, In.2 'config'
982 ~1% {3} r2 = JOIN r1 WITH DataFlowImpl2::readSet#7ad53399#ffff_2301#join_rhs ON FIRST 2 OUTPUT Rhs.3, Lhs.1 'config', Rhs.2
83691528 ~2% {3} r3 = JOIN r2 WITH DataFlowPublic::ContentSet::getAReadContent#dispred#f0820431#ff ON FIRST 1 OUTPUT Lhs.1 'config', Lhs.2, Rhs.1 'c'
83581763 ~2% {3} r4 = r3 AND NOT DataFlowImpl2::Stage1::revFlowConsCand#7ad53399#ff#prev(Lhs.2 'c', Lhs.0 'config')
83581763 ~0% {3} r5 = SCAN r4 OUTPUT In.2 'c', In.0 'config', In.1
0 ~0% {3} r6 = JOIN r5 WITH DataFlowImpl2::Stage1::fwdFlowConsCand#7ad53399#ff ON FIRST 2 OUTPUT Lhs.2, Lhs.1 'config', Lhs.0 'c'
0 ~0% {2} r7 = JOIN r6 WITH DataFlowImpl2::Stage1::fwdFlow#7ad53399#2#fff_02#join_rhs ON FIRST 2 OUTPUT Lhs.2 'c', Lhs.1 'config'
return r7
```
After
```
[2022-04-06 13:44:38] (6s) Tuple counts for DataFlowImpl2::Stage1::revFlowConsCand#7ad53399#ff/2@i14#5abbf2wn after 6ms:
10681 ~0% {2} r1 = SCAN DataFlowImpl2::Stage1::revFlow#7ad53399#fff#prev_delta OUTPUT In.0, In.2 'config'
982 ~1% {3} r2 = JOIN r1 WITH DataFlowImpl2::readSet#7ad53399#ffff_2301#join_rhs ON FIRST 2 OUTPUT Rhs.3, Lhs.1 'config', Rhs.2
109765 ~0% {3} r3 = JOIN r2 WITH DataFlowImpl2::Stage1::fwdFlowConsCandSet#7ad53399#fff#reorder_0_2_1 ON FIRST 2 OUTPUT Lhs.1 'config', Lhs.2, Rhs.2 'c'
0 ~0% {3} r4 = r3 AND NOT DataFlowImpl2::Stage1::revFlowConsCand#7ad53399#ff#prev(Lhs.2 'c', Lhs.0 'config')
0 ~0% {3} r5 = SCAN r4 OUTPUT In.1, In.0 'config', In.2 'c'
0 ~0% {2} r6 = JOIN r5 WITH DataFlowImpl2::Stage1::fwdFlow#7ad53399#2#fff_02#join_rhs ON FIRST 2 OUTPUT Lhs.2 'c', Lhs.1 'config'
return r6
```
|
2022-04-06 13:52:30 +02:00 |
|
Rasmus Wriedt Larsen
|
23637fd691
|
Merge branch 'main' into promote-xxe
|
2022-04-06 12:56:31 +02:00 |
|
Rasmus Wriedt Larsen
|
b99767ef52
|
Merge pull request #8668 from RasmusWL/use-instanceof
Python: Rewrite concepts to use `extends ... instanceof ...`
|
2022-04-06 12:09:12 +02:00 |
|
Rasmus Wriedt Larsen
|
4d2a3b38d2
|
Merge pull request #8511 from RasmusWL/use-query-suffix
Python: Use `Query.qll` suffix for dataflow configuration definitions
|
2022-04-06 11:59:29 +02:00 |
|
Ahmed Farid
|
29f69bde75
|
Update zipslip_bad.py
|
2022-04-05 12:46:51 +00:00 |
|
Ahmed Farid
|
dfe7f532ac
|
Update CopyFile.qll
|
2022-04-05 12:42:05 +00:00 |
|
Ahmed Farid
|
0d6d07886b
|
Rename Zip.qll to CopyFile.qll
|
2022-04-05 12:37:14 +00:00 |
|
Ahmed Farid
|
8882bc1533
|
Update Frameworks.qll
|
2022-04-05 12:32:10 +00:00 |
|
Ahmed Farid
|
68bfe38529
|
Update Zip.qll
|
2022-04-05 12:31:30 +00:00 |
|
Rasmus Wriedt Larsen
|
5b96db26b3
|
Python: Rewrite concepts to use extends ... instanceof ...
This solved performance problems experienced in
https://github.com/github/codeql/pull/8634, and this commit+PR is to
ensure we get this change in as fast as possible.
|
2022-04-05 12:34:15 +02:00 |
|
Rasmus Wriedt Larsen
|
b7f56dd17e
|
Python: Rewrite concepts to use extends ... instanceof ...
This caused compilation time for `ConceptsTest.ql` to go from 1m24s to
7s
|
2022-04-05 12:31:09 +02:00 |
|
Rasmus Wriedt Larsen
|
a7dab53ed2
|
Python: Add change-note
|
2022-04-05 11:46:49 +02:00 |
|
Rasmus Wriedt Larsen
|
1f285b8983
|
Python: Rename to XmlParsingVulnerabilityKind
To keep up with style guide
|
2022-04-05 11:07:12 +02:00 |
|
Rasmus Wriedt Larsen
|
ab59d5c786
|
Python: Rename to XmlParsing
To follow our style guide
|
2022-04-05 11:06:22 +02:00 |
|
Tom Hvitved
|
57f2a74636
|
Python: Implement ContentSet
|
2022-04-04 13:51:44 +02:00 |
|
Tom Hvitved
|
c4fbc618a9
|
Data flow: Sync files
|
2022-04-04 13:51:44 +02:00 |
|
Tom Hvitved
|
50dc3820c6
|
Merge pull request #8589 from hvitved/regex/speedup-concretise
|
2022-04-03 17:56:07 +02:00 |
|
github-actions[bot]
|
6af568b16d
|
Post-release preparation for codeql-cli-2.8.5
|
2022-04-01 16:22:14 +00:00 |
|
Chris Smowton
|
3119885a9b
|
Merge pull request #8638 from smowton/smowton/docs/additional-flow-step-description
Improve wording of isAdditionalFlow/TaintStep qldoc
|
2022-04-01 16:41:04 +01:00 |
|
Chris Smowton
|
28fa49dcd6
|
dataflow -> data-flow
|
2022-04-01 13:22:58 +01:00 |
|
Rasmus Wriedt Larsen
|
ba011fb13f
|
Merge pull request #8601 from zbazztian/recognize-flask-named-body-param
Python: Flask: Identify body contents passed via named response parameter in invocations of Response constructor
|
2022-04-01 14:19:28 +02:00 |
|
Sebastian Bauersfeld
|
504e7e4a55
|
Update python/ql/lib/change-notes/2022-03-30-flask-recognize-body-param.md
Co-authored-by: Rasmus Wriedt Larsen <rasmuswriedtlarsen@gmail.com>
|
2022-04-01 18:41:27 +07:00 |
|
Erik Krogh Kristensen
|
eae2a6af36
|
update expected output for Locations.ql
|
2022-04-01 12:58:00 +02:00 |
|
Erik Krogh Kristensen
|
ed7e1206ff
|
rename isBeforeCode to isCommentAfterCode
|
2022-04-01 12:55:00 +02:00 |
|
github-actions[bot]
|
ee746d20df
|
Release preparation for version 2.8.5
|
2022-04-01 10:39:31 +00:00 |
|
Chris Smowton
|
3b0bd3bc0f
|
Improve wording
|
2022-04-01 11:31:31 +01:00 |
|
Chris Smowton
|
99026a6071
|
Improve wording of isAdditionalFlow/TaintStep qldoc
|
2022-04-01 11:07:27 +01:00 |
|
Rasmus Wriedt Larsen
|
d2b03bb480
|
Python: Fix SimpleXmlRpcServer.ql
|
2022-03-31 20:37:28 +02:00 |
|
Rasmus Wriedt Larsen
|
4abab22066
|
Python: Promote XXE and XML-bomb queries
Need to write a change-note as well, but will do that tomorrow
|
2022-03-31 18:47:50 +02:00 |
|
Rasmus Wriedt Larsen
|
b8d3c5e96f
|
Python: Remove last bits of experimental XML modeling
|
2022-03-31 18:40:26 +02:00 |
|
Rasmus Wriedt Larsen
|
5083023aa8
|
Python: Move XML parsing PoC
Since the folder where it used to live is now empty otherwise :O
|
2022-03-31 18:37:47 +02:00 |
|
Rasmus Wriedt Larsen
|
673220b231
|
Python: Minor cleanup of XmlParsingTest
|
2022-03-31 18:18:35 +02:00 |
|
Rasmus Wriedt Larsen
|
b4c0065aeb
|
Python: Extend FileSystemAccess for xml.sax and xml.dom.* parsing
|
2022-03-31 18:08:47 +02:00 |
|
Rasmus Wriedt Larsen
|
1d7cec60ae
|
Python: xml.sax.parse is not a method call
And it's not possible to provide a parser argument either
|
2022-03-31 17:50:23 +02:00 |
|
Rasmus Wriedt Larsen
|
e11269715d
|
Python: Promote xml.sax and xml.dom.* modeling
|
2022-03-31 17:44:00 +02:00 |
|
Rasmus Wriedt Larsen
|
05bb0ef976
|
Python: Align xml.etree.ElementTree modeling
I didn't find a good way to actually share the stuff, so we kinda just
have 2 things that look very similar :|
|
2022-03-31 17:24:16 +02:00 |
|
Rasmus Wriedt Larsen
|
70b3eecdd5
|
Python: Merge xml.etree.ElementTree models
I forgot about the existing ones when I promoted it
|
2022-03-31 17:13:11 +02:00 |
|
Tom Hvitved
|
46d69cf544
|
Regex: Further tweaks to concretise computations
|
2022-03-31 12:52:43 +02:00 |
|
Tom Hvitved
|
5181544790
|
Sync shared files
|
2022-03-31 12:52:42 +02:00 |
|
Tom Hvitved
|
0fb28f4bc9
|
Sync shared files
|
2022-03-31 12:52:42 +02:00 |
|
Rasmus Wriedt Larsen
|
db43d043c4
|
Python: Add test showing misalignment of xml.etree modeling
|
2022-03-31 11:55:46 +02:00 |
|
Rasmus Wriedt Larsen
|
543454eff2
|
Python: Model file access from XML parsing
|
2022-03-31 11:47:29 +02:00 |
|
Rasmus Wriedt Larsen
|
386ff53614
|
Python: Model lxml.iterparse
|
2022-03-31 11:32:22 +02:00 |
|
Rasmus Wriedt Larsen
|
12cbdcde28
|
Python: Model lxml.etree.XMLID
|
2022-03-31 11:21:24 +02:00 |
|
Rasmus Wriedt Larsen
|
6774085e7a
|
Python: Add note about parseid/XMLID
|
2022-03-31 11:19:25 +02:00 |
|
Rasmus Wriedt Larsen
|
a315aa84b2
|
Python: Add some links in QLDocs
|
2022-03-31 11:16:50 +02:00 |
|
Rasmus Wriedt Larsen
|
64aa503cc3
|
Python: Promote xml.etree modeling
|
2022-03-31 11:12:02 +02:00 |
|
Rasmus Wriedt Larsen
|
7f5f7679f8
|
Python: Promote xmltodict modeling
|
2022-03-31 10:28:34 +02:00 |
|
Rasmus Wriedt Larsen
|
80b5cde3a2
|
Python: Promote lxml parsing modeling
|
2022-03-31 10:19:08 +02:00 |
|
Rasmus Wriedt Larsen
|
3040adfd9b
|
Python: Handle XMLParser().close() for XPath
|
2022-03-31 10:08:26 +02:00 |
|