mrva/vscode-codeql
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Update test plan

Browse Source 
This fixes the model pack query to account for the new MAD ID in the
`sinkModel` and removes the LLM section.
This commit is contained in:
Koen Vlaswinkel
2024-05-29 11:22:03 +02:00
parent 28a7d1cf34
commit 1bc13d70ce
1 changed files with 2 additions and 12 deletions
Download Patch File Download Diff File Expand all files Collapse all files

14
docs/test-plan.md
View File

@@ -179,7 +179,7 @@ Run one of the above MRVAs, but cancel it from within VS Code:
import semmle.python.frameworks.data.internal.ApiGraphModelsExtensions import semmle.python.frameworks.data.internal.ApiGraphModelsExtensions
from string path, string kind from string path, string kind
where sinkModel("vscode-codeql", path, kind) where sinkModel("vscode-codeql", path, kind, _)
select path, kind select path, kind
``` ```
@@ -210,17 +210,7 @@ Run one of the above MRVAs, but cancel it from within VS Code:
4. Open the ".model.yml" file corresponding to the library that was changed. 4. Open the ".model.yml" file corresponding to the library that was changed.
- Check that the file contains entries for the methods that were modeled. - Check that the file contains entries for the methods that were modeled.
#### Test Case 3: Model with AI #### Test Case 3: Model as dependency
Note that this test requires the feature flag: `codeQL.model.llmGeneration`
A package that the AI normally gives models for is `javax.servlet-api` from the `jhy/jsoup` repository.
1. Click "Model with AI".
- Check that rows change to "Thinking".
- Check that results come back and rows get filled out.
#### Test Case 4: Model as dependency
Note that this test requires the feature flag: `codeQL.model.flowGeneration` Note that this test requires the feature flag: `codeQL.model.flowGeneration`