Skip to content

feat(tests): add nightly workflow - #16

Open
j4n wants to merge 1 commit into
mainfrom
j4n/nightly-matrix
Open

feat(tests): add nightly workflow#16
j4n wants to merge 1 commit into
mainfrom
j4n/nightly-matrix

Conversation

@j4n

@j4n j4n commented May 20, 2026

Copy link
Copy Markdown
Contributor

.github/workflows/nightly.yml:

  • Scheduled at 02:17 UTC daily (also workflow_dispatch for manual runs).
  • based on reusable workflow

Adds .github/workflows/nightly.yml, a daily full-stack integration run of lxc-test.yml workflow across a larger matrix of relay deployments.

  • Scheduled 02:17 UTC daily, plus workflow_dispatch for manual runs.
  • Exercises cmdeploy (dual-stack DNS and --type ipv4), madmail at --source @latest, the Docker driver against ghcr:main, and the cross-relay test-mini matrix in both directions.
  • Based on the @latest resolution built into chore(madmail): port to v2 #31.

Before merge, drop the two blocks marked TEMPORARY in the workflow: the push: trigger on this branch, and cmlxc_version: ${{ github.sha }}, which pins the reusable workflow to the branch under test rather than main.

@j4n
j4n force-pushed the j4n/docker-support branch from 5485307 to 7bb8b83 Compare May 20, 2026 14:35

@missytake missytake left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me, but I guess others should look at this as well :)

I think there was also the idea to run https://github.com/chatmail/core/blob/main/.github/workflows/ci.yml against the four different deployment options? afaict you can only pass one CHATMAIL_DOMAIN to it, so it doesn't seem to be cross-server. Which should be enough, too :D

but maybe a cmlxc core-test command is out of scope for this PR, this is already a good start.

How do we get notified on failure?

@j4n
j4n force-pushed the j4n/nightly-matrix branch from e41d8b5 to d5a96ea Compare May 20, 2026 14:57
@j4n j4n changed the title tests(docker): add nightly workflow tests: add nightly workflow May 20, 2026
@j4n
j4n changed the base branch from j4n/docker-support to main May 20, 2026 15:00
@j4n
j4n changed the base branch from main to j4n/docker-support May 20, 2026 15:00
@j4n
j4n force-pushed the j4n/docker-support branch from 7bb8b83 to 74b3c30 Compare May 20, 2026 15:05
@j4n
j4n force-pushed the j4n/nightly-matrix branch from d5a96ea to 11342ae Compare May 20, 2026 15:05
@j4n
j4n changed the base branch from j4n/docker-support to main May 20, 2026 15:06
@j4n
j4n changed the base branch from main to j4n/docker-support May 20, 2026 15:06
@j4n
j4n force-pushed the j4n/nightly-matrix branch from 11342ae to 9e4704d Compare May 20, 2026 15:10
@j4n
j4n force-pushed the j4n/docker-support branch from 74b3c30 to 75f3583 Compare May 28, 2026 14:24
@j4n
j4n force-pushed the j4n/nightly-matrix branch from 9e4704d to deaf811 Compare May 28, 2026 14:28
@j4n
j4n force-pushed the j4n/docker-support branch 2 times, most recently from 2b322ff to 645ba94 Compare May 28, 2026 14:44
@j4n
j4n force-pushed the j4n/nightly-matrix branch from deaf811 to 95dc71d Compare May 28, 2026 14:47

@hpk42 hpk42 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it's a bit weird this is living in cmlxc but i guess it's worth a try if this nightly approach reliably works.

@j4n
j4n force-pushed the j4n/docker-support branch from 645ba94 to 6c5bc39 Compare June 1, 2026 08:47
@j4n
j4n force-pushed the j4n/docker-support branch from 6c5bc39 to cb86c37 Compare June 30, 2026 09:30
@j4n
j4n force-pushed the j4n/nightly-matrix branch 2 times, most recently from ee8b08c to 2f93e70 Compare July 28, 2026 12:47
@j4n
j4n force-pushed the j4n/docker-support branch from cb86c37 to e29d4e6 Compare July 28, 2026 12:47
@j4n

j4n commented Jul 28, 2026

Copy link
Copy Markdown
Contributor Author

it's a bit weird this is living in cmlxc but i guess it's worth a try if this nightly approach reliably works.

I think we could just move it over to the relay repo and call the reusable workflow from there. The question about notification on test failures is relevant: It seems one way to do it would be to allow the action to create an issue when the build fails (and potentially auto-close it when it succeeds again). Or somehow patching cmsend in, with its state in a secret or something.

@j4n
j4n force-pushed the j4n/docker-support branch from e29d4e6 to 9dbb0c1 Compare July 28, 2026 14:40
@j4n j4n self-assigned this Jul 31, 2026
@j4n
j4n force-pushed the j4n/docker-support branch from 9dbb0c1 to 7616a37 Compare July 31, 2026 17:17
@j4n
j4n force-pushed the j4n/nightly-matrix branch from 14e7f20 to 27d005b Compare July 31, 2026 17:18
@j4n
j4n force-pushed the j4n/docker-support branch 2 times, most recently from d7ecf5d to b90b5dd Compare July 31, 2026 17:38
@j4n
j4n force-pushed the j4n/dualstack-dns branch from 74970df to 0472cdb Compare August 6, 2026 08:39
@j4n
j4n force-pushed the j4n/nightly-matrix branch from 2f7fb43 to fab4d55 Compare August 6, 2026 11:23
@j4n
j4n force-pushed the j4n/dualstack-dns branch from 0472cdb to b57e7e1 Compare August 6, 2026 11:23
@j4n
j4n force-pushed the j4n/nightly-matrix branch from fab4d55 to 4a9dc6f Compare August 6, 2026 11:35
@j4n
j4n force-pushed the j4n/dualstack-dns branch from b57e7e1 to 08fa0ed Compare August 6, 2026 11:35
@j4n
j4n force-pushed the j4n/nightly-matrix branch from 4a9dc6f to bd8fe12 Compare August 11, 2026 10:39
@j4n
j4n force-pushed the j4n/dualstack-dns branch from 08fa0ed to 90ee135 Compare August 11, 2026 10:39
@hpk42
hpk42 force-pushed the j4n/dualstack-dns branch from 90ee135 to 251ebd9 Compare August 11, 2026 12:36
@hpk42
hpk42 force-pushed the j4n/nightly-matrix branch from bd8fe12 to a34d855 Compare August 11, 2026 12:36
@hpk42
hpk42 force-pushed the j4n/dualstack-dns branch from 251ebd9 to 0c3ab70 Compare August 11, 2026 12:53
@hpk42
hpk42 force-pushed the j4n/nightly-matrix branch from a34d855 to 8be4379 Compare August 11, 2026 12:53
@j4n
j4n force-pushed the j4n/nightly-matrix branch from 8be4379 to 51d7475 Compare August 12, 2026 07:04
@j4n
j4n force-pushed the j4n/dualstack-dns branch from 0c3ab70 to 35e872d Compare August 12, 2026 07:04
@j4n
j4n force-pushed the j4n/nightly-matrix branch from 51d7475 to 97613b0 Compare August 13, 2026 14:53
@j4n
j4n changed the base branch from j4n/dualstack-dns to main August 13, 2026 14:53
@j4n
j4n force-pushed the j4n/nightly-matrix branch from 97613b0 to bc5eaee Compare August 17, 2026 12:10
.github/workflows/nightly.yml:
- Scheduled at 02:17 UTC daily (also workflow_dispatch for manual runs).
- based on reusable workflow
@j4n
j4n force-pushed the j4n/nightly-matrix branch 12 times, most recently from bd37e6c to 95c2e14 Compare August 20, 2026 15:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants