I’m evaluating different CI solutions for a software that I write and I like Drone for its simplicity and its clear documentation. However, I cannot figure out if what I would like to do could be supported or not.
I have 3 sets of test that I would like to run on a regular basis:
Installation tests: check that the software installs correctly on a few selected Linux distro (at least Debian, Ubuntu, CentOS – all of them provide official Docker containers AFAICS)
Unit tests (once installation tests are fine, they can be run on a selected distro only, e.g. Ubuntu)
Functional tests: given a set of options, try out the software with all combinations. (Possibly blacklisting some combinations.)
Now, 1. and 3. seem to require a “matrix” approach but my reading of the documentation is that I can only have one pipeline and one matrix, so I cannot loop over distros in 1. and over configs in 3. Also, the three sets of tests could be run independently one from the other so they could be split off to different pipelines.
Is there a way to achieve this with Drone? Or have I misunderstood the docs altogether?
Thank you very much for any suggestion or clarification.