bbb54caaf3
- Set up the minio ql db - Use bind mounts in docker compose to get persistence - Populate the ql db with the sample DBs
176 lines
4.2 KiB
Markdown
176 lines
4.2 KiB
Markdown
# Overview
|
|
|
|
TODO diagram
|
|
|
|
TODO Style notes
|
|
- NO package init() functions
|
|
- Dynamic behaviour must be explicit
|
|
|
|
## Cross-compile server on host, run it in container
|
|
These are simple steps using a single container.
|
|
|
|
1. build server on host
|
|
|
|
GOOS=linux GOARCH=arm64 go build
|
|
|
|
2. build docker image
|
|
|
|
cd cmd/server
|
|
docker build -t server-image .
|
|
|
|
3. Start container with shared directory
|
|
|
|
```sh
|
|
docker run -it \
|
|
-v /Users/hohn/work-gh/mrva/mrvacommander:/mrva/mrvacommander \
|
|
server-image
|
|
```
|
|
|
|
4. Run server in container
|
|
|
|
cd /mrva/mrvacommander/cmd/server/ && ./server
|
|
|
|
## Using docker-compose
|
|
### Steps to build and run the server in a multi-container environment set up by docker-compose.
|
|
|
|
1. Built the server-image, above
|
|
|
|
1. Build server on host
|
|
|
|
cd ~/work-gh/mrva/mrvacommander/cmd/server/
|
|
GOOS=linux GOARCH=arm64 go build
|
|
|
|
1. Start the containers
|
|
|
|
cd ~/work-gh/mrva/mrvacommander/
|
|
docker-compose down
|
|
docker-compose up -d
|
|
|
|
4. Run server in its container
|
|
|
|
cd ~/work-gh/mrva/mrvacommander/
|
|
docker exec -it server bash
|
|
cd /mrva/mrvacommander/cmd/server/
|
|
./server -loglevel=debug -mode=container
|
|
|
|
1. Test server via remote client by following the steps in [gh-mrva](https://github.com/hohn/gh-mrva/blob/connection-redirect/README.org#compacted-edit-run-debug-cycle)
|
|
|
|
### Some general docker-compose commands
|
|
|
|
2. Get service status
|
|
|
|
docker-compose ps
|
|
|
|
3. Stop services
|
|
|
|
docker-compose down
|
|
|
|
4. View all logs
|
|
|
|
docker-compose logs
|
|
|
|
5. check containers from server container
|
|
|
|
docker exec -it server bash
|
|
curl -I postgres:5432
|
|
curl -I http://rabbitmq:15672
|
|
|
|
|
|
### Some postgres specific commands
|
|
|
|
1. Access PostgreSQL
|
|
|
|
psql -h localhost -p 5432 -U exampleuser -d exampledb
|
|
|
|
1. List all tables
|
|
|
|
\dt
|
|
|
|
1. Examine a table
|
|
|
|
select * from db_infos
|
|
|
|
1. Show all columns in a specific table
|
|
|
|
\d+ db_infos
|
|
|
|
1. Miscellany
|
|
|
|
\pset pager off
|
|
\lo_import FILE [COMMENT]
|
|
|
|
|
|
### Manually create needed postgres databases
|
|
|
|
docker-compose now runs a db init script, but this information is useful for
|
|
debugging/manual work.
|
|
|
|
~~This is still necessary after `docker-compose up` to avoid~~
|
|
|
|
[error] failed to initialize database, got error failed to connect to
|
|
`user=exampleuser database=server_db`: 172.25.0.3:5432 (postgres): server
|
|
error: FATAL: database "server_db" does not exist (SQLSTATE 3D000)
|
|
|
|
from
|
|
|
|
./server -loglevel=debug -mode=container
|
|
|
|
The steps:
|
|
|
|
# on the host
|
|
psql -h localhost -p 5432 -U exampleuser -d postgres
|
|
|
|
# Conditionally create dbs
|
|
SELECT 'CREATE DATABASE server_db' WHERE NOT EXISTS (SELECT FROM pg_database WHERE datname = 'server_db')\gexec
|
|
SELECT 'CREATE DATABASE querypack_db' WHERE NOT EXISTS (SELECT FROM pg_database WHERE datname = 'querypack_db')\gexec
|
|
SELECT 'CREATE DATABASE qldb_db' WHERE NOT EXISTS (SELECT FROM pg_database WHERE datname = 'qldb_db')\gexec
|
|
|
|
# List all dbs
|
|
\l
|
|
|
|
### To run pgmin, the minimal go/postgres test part of this repository
|
|
|
|
1. Run pgmin
|
|
|
|
```sh
|
|
cd ~/work-gh/mrva/mrvacommander/cmd/postgres
|
|
GOOS=linux GOARCH=arm64 go build
|
|
docker exec -it server bash
|
|
/mrva/mrvacommander/cmd/postgres/postgres
|
|
```
|
|
|
|
Exit the container. Back on the host:
|
|
|
|
psql -h localhost -p 5432 -U exampleuser -d exampledb
|
|
\dt
|
|
|
|
Should show
|
|
|
|
List of relations
|
|
Schema | Name | Type | Owner
|
|
--------+-------------+-------+-------------
|
|
public | owner_repos | table | exampleuser
|
|
|
|
|
|
1. Check table contents
|
|
|
|
exampledb=# select * from owner_repos;
|
|
owner | repo
|
|
-------+---------
|
|
foo | foo/bar
|
|
|
|
### Use the minio ql db
|
|
|
|
1. Web access via
|
|
|
|
open http://localhost:9001/login
|
|
|
|
username / password are in `docker-compose.yml` for now. The ql db listing
|
|
will be at
|
|
|
|
http://localhost:9001/browser/qldb
|
|
|
|
1. The names use `owner_repo` format for now, e.g. `google_flatbuffers_db.zip`.
|
|
TODO This will be enhanced to include other data later
|
|
|
|
|