mirror/dsa-puppet.git
6 years agoundo casulana custom roles
Luca Filipozzi [Wed, 18 Oct 2017 00:26:37 +0000 (00:26 +0000)]
undo casulana custom roles

6 years agofix up the custom cloud-admins rule
Luca Filipozzi [Tue, 17 Oct 2017 23:13:57 +0000 (23:13 +0000)]
fix up the custom cloud-admins rule

6 years agocustom rule for cloud-builds on casaluna
Luca Filipozzi [Tue, 17 Oct 2017 23:11:59 +0000 (23:11 +0000)]
custom rule for cloud-builds on casaluna

6 years agoadd sudo access to group cloud-builds
Martin Zobel-Helas [Mon, 16 Oct 2017 20:46:14 +0000 (16:46 -0400)]
add sudo access to group cloud-builds

Signed-off-by: Martin Zobel-Helas <zobel@debian.org>
6 years agobmdb1 main cluster is back on timeline 1
Julien Cristau [Sun, 15 Oct 2017 10:22:30 +0000 (12:22 +0200)]
bmdb1 main cluster is back on timeline 1

6 years agoEnsure mirror-health is restarted after the daemon-reload
Tollef Fog Heen [Sun, 8 Oct 2017 05:34:43 +0000 (07:34 +0200)]
Ensure mirror-health is restarted after the daemon-reload

6 years agoDrop klecker from ftp.d.o mirror-health checking
Tollef Fog Heen [Sun, 8 Oct 2017 05:21:47 +0000 (07:21 +0200)]
Drop klecker from ftp.d.o mirror-health checking

klecker is not part of the set of backends that Fastly uses, so
checking against it has no value and might leave us unhealthy if
klecker is ahead.

6 years agomask sys-kernel-debug-tracing.mount and sys-kernel-debug.mount
Peter Palfrader [Fri, 6 Oct 2017 08:25:10 +0000 (10:25 +0200)]
mask sys-kernel-debug-tracing.mount and sys-kernel-debug.mount

6 years agoAdd a systemd::mask
Peter Palfrader [Fri, 6 Oct 2017 08:23:48 +0000 (10:23 +0200)]
Add a systemd::mask

6 years agoFix octal number in python script to it compiles
Peter Palfrader [Thu, 5 Oct 2017 09:43:36 +0000 (11:43 +0200)]
Fix octal number in python script to it compiles

6 years agoRevert "Use RedirectPermanent instead of RewriteRule"
Paul Wise [Thu, 5 Oct 2017 08:37:09 +0000 (16:37 +0800)]
Revert "Use RedirectPermanent instead of RewriteRule"

This reverts commit abb8a9a1d0c72a616e297be5a1b091b6c9a74191.

6 years agoUse RedirectPermanent instead of RewriteRule
Paul Wise [Thu, 5 Oct 2017 08:21:32 +0000 (16:21 +0800)]
Use RedirectPermanent instead of RewriteRule

6 years agoBetter debian-ports.org/debian-cd redirection
Aurelien Jarno [Thu, 5 Oct 2017 08:21:22 +0000 (10:21 +0200)]
Better debian-ports.org/debian-cd redirection

Signed-off-by: Aurelien Jarno <aurelien@aurel32.net>
6 years agoDrop remaining debian-ports-cd code
Aurelien Jarno [Thu, 5 Oct 2017 07:57:42 +0000 (09:57 +0200)]
Drop remaining debian-ports-cd code

6 years agoRedirect ftp.ports.debian.org/debian-ports-cd to cdimage
Aurelien Jarno [Thu, 5 Oct 2017 07:54:57 +0000 (09:54 +0200)]
Redirect ftp.ports.debian.org/debian-ports-cd to cdimage

6 years agoUpdate debian-ports.org/debian-cd redirection to cdimage.d.do
Aurelien Jarno [Thu, 5 Oct 2017 07:41:20 +0000 (09:41 +0200)]
Update debian-ports.org/debian-cd redirection to cdimage.d.do

Signed-off-by: Aurelien Jarno <aurelien@aurel32.net>
6 years agoFormat weekly stunnel restart script nicer
Peter Palfrader [Tue, 3 Oct 2017 10:51:19 +0000 (12:51 +0200)]
Format weekly stunnel restart script nicer

6 years agoHave gobby reload its config when we change its ssl cert
Julien Cristau [Tue, 3 Oct 2017 10:42:35 +0000 (12:42 +0200)]
Have gobby reload its config when we change its ssl cert

6 years agoremove auto-cert and auto-clientcert symlinks from fileserver path
Peter Palfrader [Tue, 3 Oct 2017 08:49:55 +0000 (10:49 +0200)]
remove auto-cert and auto-clientcert symlinks from fileserver path

6 years agofix one path
Peter Palfrader [Tue, 3 Oct 2017 08:48:55 +0000 (10:48 +0200)]
fix one path

6 years agoTry to replace file access to auto-ca things with templates
Peter Palfrader [Tue, 3 Oct 2017 08:47:51 +0000 (10:47 +0200)]
Try to replace file access to auto-ca things with templates

6 years agoAdd syncproxy addresses to ssh whitelist
Julien Cristau [Tue, 3 Oct 2017 08:34:40 +0000 (10:34 +0200)]
Add syncproxy addresses to ssh whitelist

6 years agoAnd more move things
Peter Palfrader [Tue, 3 Oct 2017 08:34:37 +0000 (10:34 +0200)]
And more move things

6 years agomove ssl/clientcerts to ssl/auto-clientcerts
Peter Palfrader [Tue, 3 Oct 2017 08:33:04 +0000 (10:33 +0200)]
move ssl/clientcerts to ssl/auto-clientcerts

6 years agomove exim/certs to ssl/auto-certs
Peter Palfrader [Tue, 3 Oct 2017 08:31:19 +0000 (10:31 +0200)]
move exim/certs to ssl/auto-certs

6 years agoStop hardcoding /srv/puppet.debian.org/from-letsencrypt/ all over the place
Peter Palfrader [Tue, 3 Oct 2017 08:28:08 +0000 (08:28 +0000)]
Stop hardcoding /srv/puppet.debian.org/from-letsencrypt/ all over the place

6 years agoremove from-letsencrypt symlink from fileserver path
Peter Palfrader [Tue, 3 Oct 2017 08:16:23 +0000 (10:16 +0200)]
remove from-letsencrypt symlink from fileserver path

6 years agoMake db key loaded from a template
Peter Palfrader [Tue, 3 Oct 2017 08:15:17 +0000 (10:15 +0200)]
Make db key loaded from a template

6 years agoMake gobby key loaded from a template
Peter Palfrader [Tue, 3 Oct 2017 08:14:36 +0000 (08:14 +0000)]
Make gobby key loaded from a template

6 years agoAdd tls key for gobby server
Julien Cristau [Tue, 3 Oct 2017 07:51:00 +0000 (09:51 +0200)]
Add tls key for gobby server

This should remove the need to rotate it manually.

6 years agoUse restrict authorized_keys option for geodns
Julien Cristau [Tue, 3 Oct 2017 07:07:07 +0000 (09:07 +0200)]
Use restrict authorized_keys option for geodns

no-port-forwarding,no-X11-forwarding,no-agent-forwarding,no-pty,no-user
is a mouthful, and geo[123] are all on stretch.

6 years agoremove unused modules/ssl/files/chains with the GANDI chains
Peter Palfrader [Tue, 3 Oct 2017 07:07:20 +0000 (09:07 +0200)]
remove unused modules/ssl/files/chains with the GANDI chains

6 years agoUse a template to get more of the from-letsencrypt certs and keys, and no longer...
Peter Palfrader [Tue, 3 Oct 2017 07:06:52 +0000 (09:06 +0200)]
Use a template to get more of the from-letsencrypt certs and keys, and no longer support getting certs and chains from files/{servicecerts,chains} (which no longer holds any DSA certs)

6 years agoRestrict ssh to mirrors
Julien Cristau [Tue, 3 Oct 2017 07:00:09 +0000 (09:00 +0200)]
Restrict ssh to mirrors

6 years agoFix ssl key template
Julien Cristau [Tue, 3 Oct 2017 06:59:30 +0000 (08:59 +0200)]
Fix ssl key template

6 years agoUse a template to get from-letsencrypt cert key, and no longer support getting keys...
Peter Palfrader [Tue, 3 Oct 2017 06:55:52 +0000 (08:55 +0200)]
Use a template to get from-letsencrypt cert key, and no longer support getting keys from files/keys (which no longer exists anyhow)

6 years agobmdb1/main on postgresql 9.6
Julien Cristau [Mon, 2 Oct 2017 16:26:45 +0000 (18:26 +0200)]
bmdb1/main on postgresql 9.6

6 years agodon't spawn a shell in create-onionbalance-config
Julien Cristau [Mon, 2 Oct 2017 12:48:50 +0000 (14:48 +0200)]
don't spawn a shell in create-onionbalance-config

python can do these things.

6 years agoMake sure onionbalance private keys are group-readable
Julien Cristau [Mon, 2 Oct 2017 12:27:26 +0000 (14:27 +0200)]
Make sure onionbalance private keys are group-readable

Seems umask is no longer sufficient and they end up 0600.

6 years agobmdb1's debsources cluster is on 9.6
Julien Cristau [Sun, 1 Oct 2017 21:41:39 +0000 (23:41 +0200)]
bmdb1's debsources cluster is on 9.6

6 years agoAdd debconf17.dc.o static component
Julien Cristau [Sun, 1 Oct 2017 19:34:54 +0000 (21:34 +0200)]
Add debconf17.dc.o static component

6 years agoConsider ourselves unhealthy if fetching from localhost fails
Tollef Fog Heen [Sun, 1 Oct 2017 18:27:30 +0000 (20:27 +0200)]
Consider ourselves unhealthy if fetching from localhost fails

6 years agoUse max instead of if to get biggest timestamp
Tollef Fog Heen [Sun, 1 Oct 2017 18:27:08 +0000 (20:27 +0200)]
Use max instead of if to get biggest timestamp

6 years agostop hardcoding danzi in postgres-make-base-backup
Julien Cristau [Sun, 1 Oct 2017 18:27:15 +0000 (20:27 +0200)]
stop hardcoding danzi in postgres-make-base-backup

It's now added in a concat fragment.

6 years agoUse postgres::backup_source for danzi's main pg cluster
Julien Cristau [Sun, 1 Oct 2017 18:20:15 +0000 (20:20 +0200)]
Use postgres::backup_source for danzi's main pg cluster

6 years agoadd danzi/debconf pg cluster as backup source
Julien Cristau [Sun, 1 Oct 2017 18:07:27 +0000 (20:07 +0200)]
add danzi/debconf pg cluster as backup source

6 years ago.onion for debconf18.dc.o
Julien Cristau [Sun, 1 Oct 2017 17:47:42 +0000 (19:47 +0200)]
.onion for debconf18.dc.o

6 years agoAt least -current-live is expected to exist
Peter Palfrader [Sun, 1 Oct 2017 17:40:20 +0000 (19:40 +0200)]
At least -current-live is expected to exist

6 years agoAdd debconf18.dc.o static component
Julien Cristau [Sun, 1 Oct 2017 17:26:29 +0000 (19:26 +0200)]
Add debconf18.dc.o static component

6 years agoserial on klecker
Julien Cristau [Sun, 1 Oct 2017 15:40:34 +0000 (17:40 +0200)]
serial on klecker

6 years agomirror-health: have systemd restart the service when it dies
Julien Cristau [Sun, 1 Oct 2017 13:33:36 +0000 (15:33 +0200)]
mirror-health: have systemd restart the service when it dies

6 years agomirror-health: add shutdown check
Julien Cristau [Sun, 1 Oct 2017 10:32:19 +0000 (12:32 +0200)]
mirror-health: add shutdown check

6 years agomirror-health: move up-to-date check to a function
Julien Cristau [Sun, 1 Oct 2017 10:28:56 +0000 (12:28 +0200)]
mirror-health: move up-to-date check to a function

6 years agoAdd a tiny bit of error handling for health checking
Tollef Fog Heen [Sat, 30 Sep 2017 20:59:20 +0000 (22:59 +0200)]
Add a tiny bit of error handling for health checking

6 years agoMake apache listen for debian.backend.mirrors.debian.org on loopback too
Tollef Fog Heen [Sat, 30 Sep 2017 20:54:46 +0000 (22:54 +0200)]
Make apache listen for debian.backend.mirrors.debian.org on loopback too

6 years agoAdd missing domain component, now with 100% more valid names
Tollef Fog Heen [Sat, 30 Sep 2017 20:51:31 +0000 (22:51 +0200)]
Add missing domain component, now with 100% more valid names

6 years agoUse service-looking names instead…
Tollef Fog Heen [Sat, 30 Sep 2017 20:48:28 +0000 (22:48 +0200)]
Use service-looking names instead…

6 years agoUse hard coded list for what hosts to check
Tollef Fog Heen [Sat, 30 Sep 2017 20:40:26 +0000 (22:40 +0200)]
Use hard coded list for what hosts to check

We can't just grab this from hiera, since some hosts have service
addresses that are not their primary host addresses and so we get 404s
when asking on the wrong IP.

6 years agoNotify service when the underlying file changes or the service changes
Tollef Fog Heen [Sat, 30 Sep 2017 20:21:07 +0000 (22:21 +0200)]
Notify service when the underlying file changes or the service changes

6 years agoCorrect path to health check status and allow access to it
Tollef Fog Heen [Sat, 30 Sep 2017 20:18:52 +0000 (22:18 +0200)]
Correct path to health check status and allow access to it

6 years agoMake sure to start the mirror-health service
Tollef Fog Heen [Sat, 30 Sep 2017 20:16:07 +0000 (22:16 +0200)]
Make sure to start the mirror-health service

6 years agoFix logic in healthy/unhealthy
Tollef Fog Heen [Sat, 30 Sep 2017 20:05:55 +0000 (22:05 +0200)]
Fix logic in healthy/unhealthy

6 years agoStatus code is an int
Tollef Fog Heen [Sat, 30 Sep 2017 20:05:43 +0000 (22:05 +0200)]
Status code is an int

6 years agoCorrect variable name in systemd unit
Tollef Fog Heen [Sat, 30 Sep 2017 19:53:41 +0000 (21:53 +0200)]
Correct variable name in systemd unit

6 years agoFix name of variable (it is a timestamp, not a zone) and log a bit more
Tollef Fog Heen [Sat, 30 Sep 2017 19:52:41 +0000 (21:52 +0200)]
Fix name of variable (it is a timestamp, not a zone) and log a bit more

6 years agoDisallow redirects for health checking
Tollef Fog Heen [Sat, 30 Sep 2017 19:50:27 +0000 (21:50 +0200)]
Disallow redirects for health checking

6 years agoDynamicUser and python don't mix, apply by hand instead
Tollef Fog Heen [Sat, 30 Sep 2017 19:44:15 +0000 (21:44 +0200)]
DynamicUser and python don't mix, apply by hand instead

It seems like importing site fails for python with a dynamic user, so
set the same settings and run as nobody instead.

6 years agoFormat the list of hosts to check properly
Tollef Fog Heen [Sat, 30 Sep 2017 19:38:32 +0000 (21:38 +0200)]
Format the list of hosts to check properly

6 years agoUse define rather than class to make this work properly
Tollef Fog Heen [Sat, 30 Sep 2017 19:36:17 +0000 (21:36 +0200)]
Use define rather than class to make this work properly

6 years agoAdd health checking support for mirrors
Tollef Fog Heen [Sat, 30 Sep 2017 19:00:19 +0000 (21:00 +0200)]
Add health checking support for mirrors

Add a small daemon which checks if the local Last-Modified of a given
file is the same as on other hosts.  If it is, write a file saying
that we can receive traffic, else remove it.

Also map that file to /_health in the Apache config so bgpd/fastly can
check it.

6 years agoinstall newer version of devscripts
Martin Zobel-Helas [Fri, 29 Sep 2017 21:14:46 +0000 (23:14 +0200)]
install newer version of devscripts

Signed-off-by: Martin Zobel-Helas <zobel@debian.org>
6 years agofixup ferm rule for danzi
Julien Cristau [Fri, 29 Sep 2017 18:02:45 +0000 (20:02 +0200)]
fixup ferm rule for danzi

6 years agoupdate ferm rules for postgresql@danzi
Julien Cristau [Fri, 29 Sep 2017 18:00:30 +0000 (20:00 +0200)]
update ferm rules for postgresql@danzi

6 years agosudo: debconf-web group can become debconf-web user
Julien Cristau [Fri, 29 Sep 2017 16:47:42 +0000 (18:47 +0200)]
sudo: debconf-web group can become debconf-web user

6 years agoadd debussy
Julien Cristau [Fri, 29 Sep 2017 15:51:45 +0000 (17:51 +0200)]
add debussy

6 years agoadd debussy volume at ubc
Julien Cristau [Fri, 29 Sep 2017 13:15:26 +0000 (15:15 +0200)]
add debussy volume at ubc

6 years agodanzi pg is now 9.6
Julien Cristau [Fri, 29 Sep 2017 10:02:56 +0000 (12:02 +0200)]
danzi pg is now 9.6

6 years agoRevert "redirect linux updates to security-cdn"
Julien Cristau [Fri, 29 Sep 2017 09:48:31 +0000 (11:48 +0200)]
Revert "redirect linux updates to security-cdn"

This reverts commit 34eacf56eba8289174e139dee14af8d926723115.

6 years agoBe more defensive with mv and use --no-target-directory
Peter Palfrader [Fri, 29 Sep 2017 09:33:27 +0000 (11:33 +0200)]
Be more defensive with mv and use --no-target-directory

6 years agoRefactor logging.
Peter Palfrader [Fri, 29 Sep 2017 09:30:44 +0000 (11:30 +0200)]
Refactor logging.

Keep a <component>.lock on the master for all updates, instead of trying
to lock individual directories.

There was a race in static-master-update-component, where we would keep
locks of <component> and <component>-updating.incoming-XXXXXX, and then
move <component> aside and replace it by
<component>-updating.incoming-XXXXXX in two steps.  Things could fail
if in between these two moves, another static-master-update-component
job showed up, and created a new <component> dir.

6 years agoBetter python, i.e., python that actually does what it should
Peter Palfrader [Fri, 29 Sep 2017 08:47:40 +0000 (10:47 +0200)]
Better python, i.e., python that actually does what it should

6 years agoDo not hardcode debian specifics in staticsync scripts, make them use a conffile
Peter Palfrader [Fri, 29 Sep 2017 08:43:29 +0000 (10:43 +0200)]
Do not hardcode debian specifics in staticsync scripts, make them use a conffile

6 years agoQuote COMPONENT computation in static-mirror-run
Peter Palfrader [Fri, 29 Sep 2017 08:31:13 +0000 (10:31 +0200)]
Quote COMPONENT computation in static-mirror-run

6 years agoRevert "Restrict ssh to anycast and static mirrors"
Julien Cristau [Wed, 27 Sep 2017 10:07:05 +0000 (12:07 +0200)]
Revert "Restrict ssh to anycast and static mirrors"

Needs more work.

This reverts commit 162626172d5eaaa017e69ee990842c89272fc60e.

6 years agoRestrict ssh to anycast and static mirrors
Julien Cristau [Wed, 27 Sep 2017 09:48:13 +0000 (11:48 +0200)]
Restrict ssh to anycast and static mirrors

6 years agoActually add the template
Peter Palfrader [Sun, 24 Sep 2017 18:09:21 +0000 (20:09 +0200)]
Actually add the template

6 years agoTry pages.debian.net apache
Peter Palfrader [Sun, 24 Sep 2017 18:08:45 +0000 (20:08 +0200)]
Try pages.debian.net apache

6 years agoAnd reload networking when we add new addresses
Peter Palfrader [Sun, 24 Sep 2017 17:41:56 +0000 (19:41 +0200)]
And reload networking when we add new addresses

6 years agoTry different filename, and set preferred-lifetime
Peter Palfrader [Sun, 24 Sep 2017 17:26:25 +0000 (19:26 +0200)]
Try different filename, and set preferred-lifetime

6 years agoAdd pages.d.n ip address
Peter Palfrader [Sun, 24 Sep 2017 17:22:21 +0000 (19:22 +0200)]
Add pages.d.n ip address

6 years agoLooks like bmdb1/wannabuild is back to timeline 1
Julien Cristau [Sat, 23 Sep 2017 17:21:54 +0000 (19:21 +0200)]
Looks like bmdb1/wannabuild is back to timeline 1

6 years agowannabuild cluster on pg 9.6
Julien Cristau [Sat, 23 Sep 2017 17:07:07 +0000 (19:07 +0200)]
wannabuild cluster on pg 9.6

6 years agofasolo on postgresql 9.6
Julien Cristau [Sat, 23 Sep 2017 13:23:05 +0000 (15:23 +0200)]
fasolo on postgresql 9.6

6 years agoprint VSS after service restart. only restart when using more than 6g
Peter Palfrader [Sat, 23 Sep 2017 13:07:13 +0000 (15:07 +0200)]
print VSS after service restart.  only restart when using more than 6g

6 years agoprovide full path to service
Peter Palfrader [Sat, 23 Sep 2017 13:03:04 +0000 (15:03 +0200)]
provide full path to service

6 years agorestart multipath on bytemark blades
Peter Palfrader [Sat, 23 Sep 2017 12:53:53 +0000 (14:53 +0200)]
restart multipath on bytemark blades

6 years agofix modes on qemu-system-aarch64-wrapper
Peter Palfrader [Sat, 23 Sep 2017 12:51:34 +0000 (14:51 +0200)]
fix modes on qemu-system-aarch64-wrapper

6 years agoserial on lobos/villa
Peter Palfrader [Fri, 22 Sep 2017 21:04:50 +0000 (23:04 +0200)]
serial on lobos/villa

6 years agoserial on mirror-isc/-umn
Peter Palfrader [Fri, 22 Sep 2017 21:02:17 +0000 (23:02 +0200)]
serial on mirror-isc/-umn

6 years agoserial on byrd
Peter Palfrader [Fri, 22 Sep 2017 20:48:58 +0000 (22:48 +0200)]
serial on byrd