caddy "add-package" will not persist upgrades my idea would be to add a file that lists additional packages, which is read by the install-scripts or the init-scripts.