Currently, we duplicate a bunch of files for our deploy files generation. The duplication was introduced with our CW mode support.

We should find a way to better organize all the kustomize config files and avoid duplication.