Nightly system tests pipelines

These Cardano node system tests are run on a nightly basis. The tests are run on multiple instances of a local cluster. The tests are run on the master branch of the cardano-node repository.

Several pipelines run the nightly system tests. In each pipeline, different sets of tests are run.

Test statuses

failed - tests that failed assertion or that were aborted because of unhandled exception
broken - tests that are affected by a real known issue; these are marked as xfailed (expected failure) until the issue is fixed
skipped - tests that are not meant to run in the given pipeline

Nightly results

Results on Github Actions

nightly:
- network in Babbage era
- Babbage transaction era
- default (legacy) network topology
nightly-dbsync:
- network in Babbage era
- Babbage transaction era
- default (legacy) network topology
- DB Sync testing enabled
nightly-p2p:
- network in Babbage era
- Babbage transaction era
- P2P network topology
nightly-mixed:
- network in Babbage era
- default transaction era
- mixed network topology (two stake pools P2P, two stake pools default topology)
nightly-alonzo-tx:
- network in Babbage era
- Alonzo transaction era
- default (legacy) network topology
- skip long-running tests
nightly-mary-tx:
- network in Babbage era
- Mary transaction era
- default (legacy) network topology
- skip long-running tests
nightly-shelley-tx:
- network in Babbage era
- Shelley transaction era
- default (legacy) network topology
- skip long-running tests
- cluster starts directly in Babbage era

Nightly upgrade testing

Step 1:
- using latest cardano-node release for Mainnet (1.35.4)
- network in Babbage era
- Babbage transaction era
- default (legacy) network topology
- smoke tests
Step 2:
- upgrade all nodes except one to latest cardano-node master
- network in Babbage era
- Babbage transaction era
- mixed network topology (half nodes P2P, half nodes legacy topology)
- smoke tests
Step 3:
- upgrade the last remaining node to latest cardano-node master
- network in Babbage era
- Babbage transaction era
- P2P network topology
- smoke tests