We need a tool that will check a release build statically - without installing anything.

In the release we have following:

• rpm packages

• deb packages

• binary tarballs

• source files of all the above

The idea is to create a python script that will check things like:

• are all the packages signed

• do all packages required even exist (and for all distributions and for all arch's)

• does binary tarball includes all the files needed, check the filesize also

• do the packages include required files

• extra files in the release directories (no extra files should exist - error if they do)

For this to work we'll need to create some parametrization - possibly config file with rules but it can be in a script itself.

From the time I started to work here we had all those errors: unsigned packages, missing libraries in the packages and also faulty binary tarballs (latest example is PXC).
It will take some time to produce initial rules, but once it's done it should provide more stable releases.