Rasmus Lerchedahl Petersen
f668453d01
Python: move things around
2023-12-15 13:48:50 +01:00
Rasmus Lerchedahl Petersen
739b839628
Python: use updated names
2023-12-15 13:48:28 +01:00
yoff
b07316f4ae
Update python/ql/lib/semmle/python/dataflow/new/internal/DataFlowPrivate.qll
...
Co-authored-by: Rasmus Wriedt Larsen <rasmuswriedtlarsen@gmail.com >
2023-12-15 13:41:04 +01:00
Rasmus Lerchedahl Petersen
a311582285
Python: Bring back (now simplified) exclusion
2023-12-15 13:28:16 +01:00
yoff
4b89a412c6
Update python/ql/lib/semmle/python/dataflow/new/internal/DataFlowDispatch.qll
...
Co-authored-by: Rasmus Wriedt Larsen <rasmuswriedtlarsen@gmail.com >
2023-12-15 12:59:01 +01:00
Rasmus Lerchedahl Petersen
d3b237bf7e
Python: rename synthetic lambda nodes
2023-12-15 12:55:26 +01:00
Rasmus Lerchedahl Petersen
5b6ea15028
Python: remove unneeded consistency exclusion
2023-12-15 11:09:37 +01:00
Rasmus Lerchedahl Petersen
bfdcae4538
Python : P -> PY
2023-12-15 10:43:02 +01:00
Rasmus Lerchedahl Petersen
262d43abcf
Python: Make compile and add comment
2023-12-15 10:28:51 +01:00
Rasmus Lerchedahl Petersen
2051ba3395
Python: hide synthesized capture nodes
2023-12-15 10:26:56 +01:00
Rasmus Lerchedahl Petersen
f96c52ed3b
Python: make compile again
...
also improve comment
2023-12-15 10:25:49 +01:00
yoff
c395d2d957
Apply suggestions from code review
...
Co-authored-by: Rasmus Wriedt Larsen <rasmuswriedtlarsen@gmail.com >
2023-12-15 09:58:27 +01:00
Rasmus Lerchedahl Petersen
abd544d96c
Python: consistency failure gone
2023-12-15 00:38:58 +01:00
Rasmus Lerchedahl Petersen
b6123de518
Python: simplify assignments to captured variables
2023-12-15 00:34:52 +01:00
Rasmus Lerchedahl Petersen
2a5736e73d
Python: add consistency exception
...
this must have been lost in my
clean-up rebase.
2023-12-14 11:50:09 +01:00
Rasmus Lerchedahl Petersen
479d81fb75
Python: fix nonlocal captured variables
...
This depends on the extractor fix
2023-12-14 10:37:27 +01:00
Rasmus Lerchedahl Petersen
38e03216f6
Python: allow CaptureArgumentNodes as multiple arguemnts
...
These are the labmda self references. This is similar to
how `BlockParameterArgumentNode` is excluded for Ruby.
It is important that we restrict `call` in this logic.
Otherwise, we get a cartesian product and the consistency
check runs for a very long time...
2023-12-14 10:32:29 +01:00
Rasmus Lerchedahl Petersen
f32d5e422d
Python: typo
2023-12-14 10:28:26 +01:00
Rasmus Lerchedahl Petersen
efcdb3e67e
Python: filter local flow from a node to itself
2023-12-14 10:28:26 +01:00
Rasmus Lerchedahl Petersen
5471c92e9f
Python: exclusion for summary nodes
...
as in Ruby
2023-12-14 10:28:26 +01:00
Rasmus Lerchedahl Petersen
061fd014a6
Python: further restrict LibraryLambdaMethod
...
On the small test project, this reduces the number
of instances from 285 to 22.
2023-12-14 10:27:15 +01:00
Rasmus Lerchedahl Petersen
453ab9ca7b
Python: restrict LibraryLambdaMethod
2023-12-14 10:27:15 +01:00
Rasmus Lerchedahl Petersen
17a0029585
Python: support callbacks to library calls
...
TODO:
The member predicate `LibraryLambdaMethod::getACall` is
currently too permissive.
Ideally, we would have `libraryCallHasLambdaArg`
as in Ruby. But even a more precise
`libraryCall` predicate might be fine.
2023-12-14 10:27:15 +01:00
Rasmus Lerchedahl Petersen
7565873e83
Python: test callbacks to library calls
2023-12-14 10:27:15 +01:00
Rasmus Lerchedahl Petersen
797deebcdd
Python: exclude CaptureNodes
2023-12-14 10:27:15 +01:00
Rasmus Lerchedahl Petersen
b513871b9b
Python: add consistency exclusions
2023-12-14 10:27:15 +01:00
Rasmus Lerchedahl Petersen
c054ba6a97
python: instantiate module for variable capture
...
This provides variable capture in standard situations:
- nested functions
- lambdas
There are some deficiencies:
- we do not yet handle objects capturing variables.
- we do not handle variables captured via the `nonlocal` keyword.
This should be solved at the AST level, though, and then it
should "just work".
There are still inconsistencies in the case where
a `SynthesizedCaptureNode` has a comprehensions
as its enclosing callable. In this case,
`TFunction(cn.getEnclosingCallable())` is not
defined and so getEnclosingCallable does not exist
for the `CaptureNode`.
2023-12-14 10:25:39 +01:00
Rasmus Lerchedahl Petersen
6db55cd12f
Python: add missing annotation
2023-12-14 10:20:49 +01:00
fossilet
1cc2f073c4
Fix typo in qll.
2023-12-14 16:05:14 +08:00
Jeroen Ketema
99e65df6ce
Merge remote-tracking branch 'upstream/rc/3.12' into mb12
2023-12-13 15:43:39 +01:00
yoff
a39eb5efc9
Merge pull request #15051 from yoff/python/slightly-improve-tarslip
...
Python: slightly improve tarslip logic
2023-12-12 14:43:43 +01:00
Rasmus Wriedt Larsen
419130be21
Merge pull request #15030 from yoff/python/remove-module-entry-definitions
...
Python: Remove control flow nodes for module entry definitions from the dataflow graph.
2023-12-11 11:40:17 +01:00
Rasmus Lerchedahl Petersen
d9c0c8c26d
Python: Update comment.
2023-12-08 17:32:23 +01:00
Rasmus Lerchedahl Petersen
2539e2ec1a
Python: slightly improve tarslip logic
2023-12-08 17:18:25 +01:00
Anders Schack-Mulligen
64eb4ff753
Merge pull request #14983 from aschackmull/dataflow/deprecate-old-api
...
Data Flow: Deprecate old data flow api.
2023-12-08 14:27:25 +01:00
github-actions[bot]
92af5f5386
Post-release preparation for codeql-cli-2.15.4
2023-12-06 22:59:22 +00:00
Rasmus Lerchedahl Petersen
263c0aade7
Python: adjust test expectations
...
mostly removing of nodes from the graph.
One result lost:
```
check("submodule.submodule_attr", submodule.submodule_attr, "submodule_attr", globals()) #$ MISSING:prints=submodule_attr
```
2023-12-06 23:00:51 +01:00
github-actions[bot]
c04457e9e7
Release preparation for version 2.15.4
2023-12-06 21:11:50 +00:00
Rasmus Lerchedahl Petersen
8c5ca3f564
Python: remove control flow nodes
...
for module entry definitions from the dataflow graph.
2023-12-06 21:47:03 +01:00
Rasmus Lerchedahl Petersen
9e1c818db6
Python: address review comments
2023-12-04 17:49:26 +01:00
yoff
f5c176bd12
Apply suggestions from code review
...
Co-authored-by: Taus <tausbn@github.com >
2023-12-04 17:41:00 +01:00
Rasmus Wriedt Larsen
c952f6a648
Python: Update rest of tests to new dataflow lib
...
I had missed these originally, since I had just fixed the ones that were
highlighted in the actions logs, thinking they had covered everything :(
2023-12-04 14:49:40 +01:00
Rasmus Lerchedahl Petersen
e091ae84ab
Merge branch 'main' of https://github.com/github/codeql into python/remove-ssa-nodes-from-dataflow-graph
2023-12-04 14:05:40 +01:00
Rasmus Wriedt Larsen
2fed0adde7
Merge pull request #8457 from RasmusWL/add-dataflow-consistency-query
...
Python: Add dataflow consistency query
2023-12-04 12:50:46 +01:00
Rasmus Wriedt Larsen
4dd3ea3798
Python: Update tests to new dataflow lib
...
Avoids some deprecation warnings :)
2023-12-04 12:36:57 +01:00
Anders Schack-Mulligen
67f0529cda
Dataflow: Sync.
2023-12-04 12:36:57 +01:00
Taus
4ef1fe49e3
Merge pull request #14918 from github/tausbn/python-support-tarslip-extraction-filters
...
Python: Add support for extraction filters
2023-11-30 22:55:09 +01:00
Taus
6e279183d9
Python: Remove unused unsafeFilter predicates
2023-11-28 13:54:17 +00:00
Taus
91643ad08f
Python: Update hasUnsafeFilter to use API graph
...
This will probably break the tests in the short run. I'll fix the remaining issues in a follow-up commit.
Co-authored-by: Rasmus Wriedt Larsen <rasmuswl@github.com >
2023-11-28 14:48:26 +01:00
Rasmus Wriedt Larsen
2c10160ad4
Python: Highlight we actually want post-update nodes for *args and **kwargs arguments
2023-11-28 14:07:03 +01:00