106 Commits

Author SHA1 Message Date
df89b81a6e Add hepc-serve-global and stabilize container startup
- Introduce hepc-serve-global to serve global MRVA values from
  hohnlab.org/mrva/values without local DB provisioning.
- Keep schema initialization symmetric across server and agent, while
  serializing PostgreSQL DDL via a global advisory lock to prevent
  concurrent CREATE TABLE races.
- Pin RabbitMQ image to rabbitmq:3.13.7-management to avoid credential
  incompatibilities introduced by upstream image changes.
- Remove pre-hashed RabbitMQ credentials and return to deterministic
  user/password initialization.
- Eliminate reliance on implicit container state to ensure reproducible
  startup.

The primary purpose of this change is integration of global MRVA values;
the remaining fixes are required to make the new startup path reliable.
2026-01-08 16:17:34 -08:00
447b9da39b switch to password-hash 2025-12-21 17:36:16 -08:00
e4b8dd797b imrove outline 2025-12-21 17:35:42 -08:00
21a902f2a9 Fix erratic status reporting. Results jumped from 0 to all instead of gradually.
The system now provides:

Real-time progress updates - each completed scan is immediately reflected
Individual job tracking - each repository has its own status (pending → in_progress → succeeded)
Accurate aggregation - overall session status correctly reflects the state of all jobs
No more jumps - gradual progression from 0 → 1 → 2 → 3 → 4 → 5 successful scans
v0.4.6
2025-12-15 14:51:32 -08:00
30197ae18c wip: workflow-ui 2025-12-05 12:31:48 -08:00
8024d1dfdd reduce cache duration to 0; adjust for demo 2025-12-04 10:48:07 -08:00
c312717421 add outlines for docker steps 2025-12-02 10:43:41 -08:00
bad36d6d17 Add host-hepc-serve, to serve large selections w/o bloating containers 2025-12-01 13:00:36 -08:00
13a065545e Standardize container build workflow for v0.4.5
- Build Go binaries (gh-mrva, mrvaserver, mrvaagent) in source repos before
  copying to container dirs

- Apply consistent v0.4.5 tagging across all containers (ghmrva, vscode,
  hepc, server, agent)

- Update hepc to sync mrvahepc source with venv and .git exclusions

- Verify deployment with docker-compose-demo.yml and bin/ma.send-request
  tests
v0.4.5
2025-11-26 12:39:59 -08:00
344ebd8d9b run another test 2025-11-25 15:39:57 -08:00
d7d78d7f6e add vs code workspace 2025-11-25 15:30:23 -08:00
c9840aabbd Fix container configuration for working deployment
Combined changes to get containers working:
- Updated to Ubuntu 24.04 LTS
- Reset compose network config to known working state
- Updated container data loading instructions and script
- Changed DB loader to upload all DBs (not just random sample)
- Added Lima VM configuration for Docker with full control
- Improved job submission to running compose setup
2025-11-25 15:25:24 -08:00
38f5c46f58 wip: add k8s manifest as first step in conversion 2025-11-22 13:13:08 -08:00
6ff5cd348e * TODO Containerd / k3s version for kubernetes deployment 2025-11-22 12:52:06 -08:00
9b4f6bdfa0 Abandon conversion attempts for docker-compose to nerdctl. Go to k3s.
Running the container collection is only needed for local use; docker is fine
   for that.  For k3s etc., we don't need the docker-compose file.
2025-11-22 12:47:01 -08:00
2d55f44e56 wip: Conversion attempts for docker-compose to nerdctl 2025-11-22 12:35:17 -08:00
57b3d629e1 ** TODO container build and run 2025-11-19 16:37:38 -08:00
a51a6eeaa2 update base image to FROM ubuntu:24.04 AS runner 2025-11-19 16:35:51 -08:00
c219ceed33 update base image to FROM ubuntu:24.04 AS runner 2025-11-19 16:35:47 -08:00
65e3a4ade2 update base image to FROM ubuntu:24.04 AS runner 2025-11-19 16:22:18 -08:00
a388f90d7d # Install buildkit 2025-11-19 16:18:41 -08:00
17f47af130 start moving to containerd 2025-11-19 13:36:58 -08:00
Michael Hohn
a47d44f9ed Add simple memory profile data 2025-08-19 11:22:20 -07:00
Michael Hohn
9ee2cdd1eb add top-3 cpu profile data 2025-08-11 14:25:18 -07:00
Michael Hohn
92d54d11c4 updated information for testing 2025-08-04 13:31:20 -07:00
Michael Hohn
28d481f690 Additions for ** Inspect postgres container 2025-08-04 12:40:07 -07:00
Michael Hohn
224f35bef2 simplified ** docker setup and run 2025-08-04 12:17:10 -07:00
Michael Hohn
f579b21b78 The updated / combined instructions are in [[*docker setup and run][docker setup and run]]. The details: 2025-08-04 11:10:39 -07:00
Michael Hohn
f95090972d Add nsenter instructions 2025-08-04 10:48:52 -07:00
Michael Hohn
e7b9d9b011 ** strace containers and processes from lima 2025-07-29 12:11:52 -07:00
Michael Hohn
c1b3a90ebd Use lima to trace all traffic without container modifications
Results are in work-gh/mrva/gh-mrva,  ls trace-*
2025-07-28 22:33:54 -07:00
Michael Hohn
654ea40520 Set up lima and get mrva/docker-compose running 2025-07-28 14:23:59 -07:00
Michael Hohn
cb24af65c1 fix: code logic updates: make sessionID consistent with original 2025-07-17 10:28:31 -07:00
d55d586900 update readme and compose 2025-07-14 13:27:18 -07:00
03ac2bf727 ** Inspect postgres container 2025-07-14 11:48:27 -07:00
ac6d77509a wip: update state_postgres, update dependent modules 2025-07-11 15:34:07 -07:00
e74f135494 updated dockerfiles and READMEs to v0.4.0 2025-06-30 16:02:39 -07:00
4d8cd5b53f Added postgres container to docker compose 2025-06-30 16:01:56 -07:00
Michael Hohn
4012470a6d switch to pollling rabbitmq; update images 2025-06-16 16:07:37 -07:00
af46dd6fa4 debugged sudden failure to download sarif results. Cause: gh.HTTPClient(nil)
Switch
client, err := gh.HTTPClient(nil)
to
client := &http.Client{}
and everything works again
2025-05-19 13:50:57 -07:00
80dbf9f299 * lima vm for running docker # run containers 2025-05-18 21:55:18 -07:00
7d505e4191 modified to build docker images on lima, v0.4.0 2025-05-18 21:43:19 -07:00
93510a0223 rearranged 2025-05-18 21:38:03 -07:00
087f6a0754 * TODO lima vm for running docker # hepc 2025-05-18 21:37:15 -07:00
5905c5b203 * TODO lima vm for running docker # code-server 2025-05-18 21:32:42 -07:00
0528e13b2a * TODO lima vm for running docker # ghmrva 2025-05-18 21:28:50 -07:00
31e4533d9e * TODO lima vm for running docker 2025-05-18 21:10:15 -07:00
dec85e6a5b * TODO lima vm for running docker 2025-05-18 14:15:52 -07:00
16cbf848c9 wip: pausing docker -> chroot conversion
Current state:  most Dockerfiles converted, chroots created via scripts
todo: finish conversions, run assembly
2025-05-18 14:13:57 -07:00
5d9f3b9d00 ** TODO migrating the containers to chroot 2025-05-18 14:11:39 -07:00