The pipeline-style PXC jobs doesn't support parallel jobs
Description
Environment
Smart Checklist
Activity
Slava SarzhanMarch 19, 2020 at 5:18 PM
@Zsolt Parragi
The param job you can find using the following link: https://pxc.cd.percona.com/view/PXC%208.0/job/pxc-8.0-param/ if you need to run tests for specific OS you can use https://pxc.cd.percona.com/view/PXC%208.0/job/pxc-8.0-pipeline/ job .
Zsolt ParragiMarch 18, 2020 at 6:51 PMEdited
@Slava Sarzhan Thanks again, looks good, please add it to pxc.cd
One minor issue: There is also a `galera_3nodes_sr`, which should be in the default mtr list
Zsolt ParragiMarch 18, 2020 at 8:27 AM
Thanks! I'm running a quick test with a pyhton3 fix now.
Slava SarzhanMarch 17, 2020 at 1:39 PM
@Zsolt Parragi I have created new jobs and all needed build/test infrastructures for it. So please have a look at https://ps3.cd.percona.com/view/PXC/job/pxc-8.0-param/ . If everything is ok I will add it to pxc.cd jenkins.
P.S. As you can see pxc build does not work correctly for new 'ubuntu:focal' from log:
scons -j8 psi=1 --config=force revno=752664d libgalera_smm.so
/tmp/pxc/percona-xtradb-cluster-galera /
scons: Reading SConscript files ...
Host: linux x86_64 64bit
Signature: version: 4.3, revision: 752664d
AttributeError: 'str' object has no attribute 'decode':
File "/tmp/pxc/percona-xtradb-cluster-galera/SConstruct", line 222:
cc_version = cc_version.decode()Zsolt ParragiMarch 5, 2020 at 12:46 PM
I don't think we need those. The WITH_ options aren't needed at all, and the analyzer opts can be specified manually as cmake + mtr args.
Current PXC jenkins jobs are separated into 3 stages:
clone
build
test
This could result in incorrect results when multiple jobs are started around the same time, e.g. tests linked to a clone job, but ran with the binaries of a different clone job.
As we have 3 developers working on PXC now, this requires manual coordination and queing to avoid the issue.
PXC probably should use the same singe-job setup as ps-X.Y-param.
one more issue with this pipeline style setup (compared to ps-8.0-param): there's no way to modify the cmake build/mtr parameters.
E.g. if I want to do a build with -DWITH_SOMETHING, or I also want to run a different mtr suite, or limited mtr suites... I can't do it in the current setup.