Expand query results scenarios based on variant analysis state

This commit is contained in:
Elena Tanasoiu
2022-12-22 12:07:33 +00:00
parent 1b76159c06
commit 531f32c1f6

View File

@@ -123,67 +123,96 @@ These are mostly aimed at MRVA, but some of them are also applicable to non-MRVA
2. The org does not exist
### Using different types of controller repos
1. The controller is public
1. Can run queries on public repositories
2. Can not run queries on private repositories
2. The controller is private
1. Can run queries on public repositories
2. Can run queries on private repositories
3. The controller repo exists but you do not have write access
4. The controller repo doesnt exist
5. The "config field" for the controller repo is not set
#### Test case 1: Running a query when the controller repository is public
1. Can run queries on public repositories
2. Can not run queries on private repositories
#### Test case 2: Running a query when the controller repository is private
1. Can run queries on public repositories
2. Can run queries on private repositories
#### Test case 3: Running a query when the controller repo exists but you do not have write access
1. Cannot run queries
#### Test case 4: Running a query when the controller repo doesnt exist
1. Cannot run queries
#### Test case 5: Running a query when the "config field" for the controller repo is not set
1. Cannot run queries
### Query History
1. Query history is loaded when vscode starts
- Handles when action workflow was cancelled while vscode was closed
- Starts monitoring variant analyses
- When variant analysis state is "pending"
- When variant analysis state is "in_progress"
- When variant analysis state is "succeded"
- All results are downloaded
- Not all results are downloaded
- When variant analysis state is "failed"
- Stops monitoring
2. Can open query history item
- Manually by clicking on them
- Automatically when vscode starts (if they were open when vscode was last used)
This requires running a MRVA query and viewing the query history.
The first test case specifies actions that you can do when the query is first run and is in "pending" state. We start
with this since it has quite a limited number of actions you can do.
#### Test case 1: When variant analysis state is "pending"
1. Starts monitoring variant analysis
2. Cannot open query history item
3. Can delete a query history item
- Item is removed from list in UI
- Files on dist are deleted (can get to files using "open query directory")
1. Item is removed from list in UI
2. Files on dist are deleted (can get to files using "open query directory")
4. Can sort query history items
- By name
- By query date
- By result count
5. Can open query directory
6. Can open query that produced these results
- When the file still exists and has not moved
- When the file does not exist
7. Can open variant analysis on github
- Option is not shown before an actions run has been scheduled
- Option is shown when an actions run has been scheduled
8. Can copy repository list
- Option is not shown before all analyses have finished
- Option is shown once all analyses are finished
- Text is copied to clipboard
- Text is a valid repository list
9. Can export results
- Option is not shown before all analyses have finished
- Option is shown once all analyses are finished
10. Can select to create gist
- A gist is created
- The first thing in the gist is a summary
- Contains a file for each repository with results
- A popup links you to the gist
11. Can select to save as markdown
- A directory is created on disk
- Contains a summary file
- Contains a file for each repository with results
- A popup allows you to open the directory
12. Can cancel analysis
- Option is shown when analysis is in progress
- Option is not shown once all analyses are finished
- Option is not shown before action run has been started
- Causes the actions run to be cancelled
1. By name
2. By query date
3. By result count
5. Cannot open query directory
6. Can open query that produced these results
1. When the file still exists and has not moved
2. When the file does not exist
7. Cannot open variant analysis on github
8. Cannot copy repository list
9. Cannot export results
10. Cannot select to create a gist
11. Cannot select to save as markdown
12. Cannot cancel analysis
#### Test case 2: When the variant analysis state is not "pending"
1. Query history is loaded when VSCode starts
2. Handles when action workflow was cancelled while VSCode was closed
3. Can open query history item
1. Manually by clicking on them
2. Automatically when VSCode starts (if they were open when VSCode was last used)
4. Can delete a query history item
1. Item is removed from list in UI
2. Files on dist are deleted (can get to files using "open query directory")
5. Can sort query history items
1. By name
2. By query date
3. By result count
6. Can open query directory
7. Can open query that produced these results
1. When the file still exists and has not moved
2. When the file does not exist
8. Can open variant analysis on github
9. Can copy repository list
1. Text is copied to clipboard
2. Text is a valid repository list
10. Can export results
11. Can select to create gist
1. A gist is created
2. The first thing in the gist is a summary
3. Contains a file for each repository with results
4. A popup links you to the gist
12. Can select to save as markdown
1. A directory is created on disk
2. Contains a summary file
3. Contains a file for each repository with results
4. A popup allows you to open the directory
#### Test case 3: When variant analysis state is "in_progress"
1. Starts monitoring variant analysis
1. Ready results are downloaded
2. Can cancel analysis
1. Causes the actions run to be cancelled
#### Test case 4: When variant analysis state is in final state ("succeeded"/"failed"/"canceled")
1. Stops monitoring variant analysis
1. All results are downloaded if state is succeeded
2. Otherwise, ready results are downloaded, if any are available
2. Cannot cancel analysis
### Results view
1. Can open a results view
@@ -194,7 +223,7 @@ These are mostly aimed at MRVA, but some of them are also applicable to non-MRVA
- When variant analysis state is "canceled"
2. Results view opens automatically
- When starting variant analysis run
- When vscode opens (if view was open when vscode was closed)
- When VSCode opens (if view was open when VSCode was closed)
3. Can copy repository list
See section from query history.
4. Can export results