AlexDenisov
2db77a7c08
Merge pull request #11607 from github/redsun82/swift-integration-test-timeout
...
Swift: add timeout to integration tests on macOS
2022-12-09 08:38:51 +01:00
Henry Mercer
3036b15af2
Merge branch 'main' into henrymercer/check-query-ids
2022-12-08 13:05:46 +00:00
Paolo Tranquilli
0058bf4443
Swift: add timeout to inetgration tests on macOS
2022-12-08 08:44:29 +01:00
Erik Krogh Kristensen
be168901d6
Merge pull request #11085 from dbartol/dbartol/ql-for-ql-latest
...
Use latest released bundle for QL-for-QL
2022-12-06 12:43:53 +01:00
Michael Nebel
204766b967
Java: Adjust generated model paths in Model difference workflow.
2022-12-06 09:53:39 +01:00
Michael Nebel
6fa2193602
Java: Add Model Difference workflow on model generator changes.
2022-12-06 09:26:09 +01:00
Michael Nebel
cd5c0bec33
Merge pull request #11527 from michaelnebel/java/regeneratemodels
...
Java/C#: Delete old model generator scripts and update Java model re-generator script.
2022-12-06 09:24:13 +01:00
Henry Mercer
6484935d25
Add CI job for check query IDs script
2022-12-05 18:51:48 +00:00
Michael Nebel
1c135bd207
Java: Temporarily disable the Model Difference workflow for changes to the model generator.
2022-12-05 11:39:44 +01:00
Michael Nebel
17e7f04adf
Java: Update the MaD Model Difference workflow.
2022-12-05 11:39:44 +01:00
Michael Nebel
bf332fa5e7
Java: Update MaD regenerate models worksflow.
2022-12-05 11:39:44 +01:00
Tom Hvitved
c2d843f96b
CI: Change --ram value from 52G to 50G in codeql tests
2022-12-05 09:35:56 +01:00
Stephan Brandauer
e6c5975ed9
Merge pull request #11484 from erik-krogh/js-ml-cache
...
ATM: use the query compilation cache in the ATM qltest
2022-12-02 10:03:18 +01:00
erik-krogh
045e6ef148
remove unused environment variable
2022-11-30 09:59:20 +01:00
erik-krogh
0eae638a93
combine into one job, and run on an XL runner
2022-11-29 22:34:31 +01:00
erik-krogh
84ce23249f
use the query compilation cache in the ATM qltest
2022-11-29 22:23:23 +01:00
Paolo Tranquilli
52a117aaf5
Swift: optimize bazel caching in CI
...
Previously the cache would become stale. Now the same incremental
cache mechanism in use for the QL cache is adopted (and factored out
in a separate action).
Namely, pushes on main will populate the cache using the commit hash as
key, while PRs will try to use the cache of their merge base, read-only.
To avoid the cache growing out of control, a simple cache eviction is
done on pushes.
2022-11-29 11:43:54 +01:00
erik-krogh
d2824413db
skip the only remaining macos job running on main
2022-11-28 14:44:34 +01:00
Erik Krogh Kristensen
7049532227
Merge pull request #11364 from github/redsun82/swift-ci-cache
...
Swift: cache more aggressively in CI
2022-11-28 14:34:43 +01:00
erik-krogh
2b0ecec0c8
only run other-os on non-ql changes
2022-11-26 10:43:33 +01:00
erik-krogh
dcfa0b38c1
use a non-xl mac runner because the XL runners keep queing
2022-11-26 10:43:33 +01:00
erik-krogh
2b996f11cc
use query compilation cache
2022-11-26 10:43:33 +01:00
erik-krogh
1e732ad4d7
use XL workers, and update the windows runner
2022-11-26 10:43:33 +01:00
erik-krogh
b6034b4935
delete language specific format check
2022-11-26 10:43:30 +01:00
Paolo Tranquilli
8df7d465cb
Swift: cache more aggressively in CI
...
* the QL compilation cache action is used for ql and integration tests
* all caches (Bazel and QL) are populated on push
2022-11-25 08:52:46 +01:00
erik-krogh
c9a600d496
Ruby: cache the compiled extractor, because that's way smaller than the cargo cache
2022-11-24 10:55:38 +01:00
Tom Hvitved
8f3731fd42
C#: Split AutobuildOptions into C#/C++ specific classes
2022-11-23 12:57:16 +01:00
Tom Hvitved
4ad7d2d822
C#: Also include extractor unit tests in csharp-qltest.yml
2022-11-22 19:55:38 +01:00
Tom Hvitved
ed841aee30
Merge pull request #11329 from hvitved/csharp/qltest-ci
...
C#: Add workflow for running QL tests
2022-11-22 11:36:16 +01:00
Tom Hvitved
313767539a
C#: Add workflow for running QL tests
2022-11-22 09:32:44 +01:00
erik-krogh
29055f7709
delete packs
2022-11-22 00:12:33 +01:00
erik-krogh
76ceb49841
re-introduce the paths requirements in the ruby workflows
2022-11-21 17:55:57 +01:00
Erik Krogh Kristensen
53ba22ab5c
simplify pack creation
...
Co-authored-by: Arthur Baars <aibaars@github.com >
2022-11-21 17:55:57 +01:00
erik-krogh
3b7ce0680d
Ruby: build queries on an XL worker, and use all the threads
2022-11-21 17:55:57 +01:00
erik-krogh
999e8ed0d0
Ruby: remove the path on branch pushes, for caching
2022-11-21 17:55:57 +01:00
erik-krogh
b1db390200
Ruby: use compilation cache in the ruby-build workflow
2022-11-21 17:55:57 +01:00
Erik Krogh Kristensen
4f08000a2e
Merge pull request #11344 from erik-krogh/all-the-cache
...
Ruby: Use compilation cache for the qltest CI workflow
2022-11-21 16:26:29 +01:00
Erik Krogh Kristensen
b4661f4a59
Merge pull request #11245 from erik-krogh/rb-redosMod
...
Ruby: use the shared regex pack
2022-11-21 15:34:20 +01:00
erik-krogh
f50778ae26
Ruby: set ram usage to 52GB in the qltest workflow
2022-11-21 15:02:14 +01:00
erik-krogh
a9c95a3230
ruby: delete the path requirement when running qltest on branches
2022-11-21 14:39:56 +01:00
erik-krogh
4af8d5769a
use compilation cache in ruby qltest
2022-11-21 14:35:12 +01:00
erik-krogh
24a973e545
run ruby qltest on a single XL worker
2022-11-21 14:35:12 +01:00
erik-krogh
af58329931
split saving the compilation cache into a shared workflow
2022-11-21 14:35:10 +01:00
Tom Hvitved
f7fc61e39d
Merge pull request #11336 from hvitved/ruby/ci-check-undefined-labels
...
Ruby: Add `--check-undefined-labels` to QL test job
2022-11-21 13:36:52 +01:00
AlexDenisov
6f52fe81d1
Merge pull request #11331 from github/redsun82/swift-codegen-skip-unchanged
...
Swift: skip QL code generation on untouched files
2022-11-21 13:34:41 +01:00
Tom Hvitved
1dbcf8eb10
Ruby: Add --check-undefined-labels to QL test job
2022-11-20 10:16:35 +01:00
erik-krogh
41e8170d59
delete the rest of the qlcompile job in Ruby
2022-11-19 11:16:24 +01:00
Paolo Tranquilli
2cd58817d7
Swift: skip QL code generation on untouched files
...
This is a developer QoL improvement, where running codegen will skip
writing (and especially formatting) any files that were not changed.
**Why?** While code generation in itself was pretty much instant, QL
formatting of generated code was starting to take a long time. This made
unconditionally running codegen quite annoying, for example before each
test run as part of an IDE workflow or as part of the pre-commit hook.
**How?** This was not completely straightforward as we could not work
with the contents of the file prior to code generation as that was
already post-processed by the QL formatting, so we had no chance of
comparing the output of template rendering with that. We therefore store
the hashes of the files _prior_ to QL formatting in a checked-in file
(`swift/ql/.generated.list`). We can therefore load those hashes at
the beginning of code generation, use them to compare the template
rendering output and update them in this special registry file.
**What else?** We also extend this mechanism to detect accidental
modification of generated files in a more robust way. Before this patch,
we were doing it with a rough regexp based heuristic. Now, we just store
the hashes of the files _after_ QL formatting in the same checked file,
so we can check that and stop generation if a generated file was
modified, or a stub was modified without removing the `// generated`
header.
2022-11-18 16:56:01 +01:00
erik-krogh
3cdfed9483
CI: delete language specific codeql query compile checks
2022-11-18 14:41:29 +01:00
erik-krogh
7c091fa6cd
also compile the examples folders as part of the compilation check
2022-11-18 10:31:42 +01:00