Initial setup of Jenkins can be done via the configuration as code plugin.
See: https://github.com/jenkinsci/configuration-as-code-plugin/blob/master/README.md
This will be even more useful should Jenkins docker be used once the build tool installation issue is resolved.