mirror/dsa-puppet.git
6 years agoUse postgres::backup_source for danzi's main pg cluster
Julien Cristau [Sun, 1 Oct 2017 18:20:15 +0000 (20:20 +0200)]
Use postgres::backup_source for danzi's main pg cluster

6 years agoadd danzi/debconf pg cluster as backup source
Julien Cristau [Sun, 1 Oct 2017 18:07:27 +0000 (20:07 +0200)]
add danzi/debconf pg cluster as backup source

6 years ago.onion for debconf18.dc.o
Julien Cristau [Sun, 1 Oct 2017 17:47:42 +0000 (19:47 +0200)]
.onion for debconf18.dc.o

6 years agoAt least -current-live is expected to exist
Peter Palfrader [Sun, 1 Oct 2017 17:40:20 +0000 (19:40 +0200)]
At least -current-live is expected to exist

6 years agoAdd debconf18.dc.o static component
Julien Cristau [Sun, 1 Oct 2017 17:26:29 +0000 (19:26 +0200)]
Add debconf18.dc.o static component

6 years agoserial on klecker
Julien Cristau [Sun, 1 Oct 2017 15:40:34 +0000 (17:40 +0200)]
serial on klecker

6 years agomirror-health: have systemd restart the service when it dies
Julien Cristau [Sun, 1 Oct 2017 13:33:36 +0000 (15:33 +0200)]
mirror-health: have systemd restart the service when it dies

6 years agomirror-health: add shutdown check
Julien Cristau [Sun, 1 Oct 2017 10:32:19 +0000 (12:32 +0200)]
mirror-health: add shutdown check

6 years agomirror-health: move up-to-date check to a function
Julien Cristau [Sun, 1 Oct 2017 10:28:56 +0000 (12:28 +0200)]
mirror-health: move up-to-date check to a function

6 years agoAdd a tiny bit of error handling for health checking
Tollef Fog Heen [Sat, 30 Sep 2017 20:59:20 +0000 (22:59 +0200)]
Add a tiny bit of error handling for health checking

6 years agoMake apache listen for debian.backend.mirrors.debian.org on loopback too
Tollef Fog Heen [Sat, 30 Sep 2017 20:54:46 +0000 (22:54 +0200)]
Make apache listen for debian.backend.mirrors.debian.org on loopback too

6 years agoAdd missing domain component, now with 100% more valid names
Tollef Fog Heen [Sat, 30 Sep 2017 20:51:31 +0000 (22:51 +0200)]
Add missing domain component, now with 100% more valid names

6 years agoUse service-looking names instead…
Tollef Fog Heen [Sat, 30 Sep 2017 20:48:28 +0000 (22:48 +0200)]
Use service-looking names instead…

6 years agoUse hard coded list for what hosts to check
Tollef Fog Heen [Sat, 30 Sep 2017 20:40:26 +0000 (22:40 +0200)]
Use hard coded list for what hosts to check

We can't just grab this from hiera, since some hosts have service
addresses that are not their primary host addresses and so we get 404s
when asking on the wrong IP.

6 years agoNotify service when the underlying file changes or the service changes
Tollef Fog Heen [Sat, 30 Sep 2017 20:21:07 +0000 (22:21 +0200)]
Notify service when the underlying file changes or the service changes

6 years agoCorrect path to health check status and allow access to it
Tollef Fog Heen [Sat, 30 Sep 2017 20:18:52 +0000 (22:18 +0200)]
Correct path to health check status and allow access to it

6 years agoMake sure to start the mirror-health service
Tollef Fog Heen [Sat, 30 Sep 2017 20:16:07 +0000 (22:16 +0200)]
Make sure to start the mirror-health service

6 years agoFix logic in healthy/unhealthy
Tollef Fog Heen [Sat, 30 Sep 2017 20:05:55 +0000 (22:05 +0200)]
Fix logic in healthy/unhealthy

6 years agoStatus code is an int
Tollef Fog Heen [Sat, 30 Sep 2017 20:05:43 +0000 (22:05 +0200)]
Status code is an int

6 years agoCorrect variable name in systemd unit
Tollef Fog Heen [Sat, 30 Sep 2017 19:53:41 +0000 (21:53 +0200)]
Correct variable name in systemd unit

6 years agoFix name of variable (it is a timestamp, not a zone) and log a bit more
Tollef Fog Heen [Sat, 30 Sep 2017 19:52:41 +0000 (21:52 +0200)]
Fix name of variable (it is a timestamp, not a zone) and log a bit more

6 years agoDisallow redirects for health checking
Tollef Fog Heen [Sat, 30 Sep 2017 19:50:27 +0000 (21:50 +0200)]
Disallow redirects for health checking

6 years agoDynamicUser and python don't mix, apply by hand instead
Tollef Fog Heen [Sat, 30 Sep 2017 19:44:15 +0000 (21:44 +0200)]
DynamicUser and python don't mix, apply by hand instead

It seems like importing site fails for python with a dynamic user, so
set the same settings and run as nobody instead.

6 years agoFormat the list of hosts to check properly
Tollef Fog Heen [Sat, 30 Sep 2017 19:38:32 +0000 (21:38 +0200)]
Format the list of hosts to check properly

6 years agoUse define rather than class to make this work properly
Tollef Fog Heen [Sat, 30 Sep 2017 19:36:17 +0000 (21:36 +0200)]
Use define rather than class to make this work properly

6 years agoAdd health checking support for mirrors
Tollef Fog Heen [Sat, 30 Sep 2017 19:00:19 +0000 (21:00 +0200)]
Add health checking support for mirrors

Add a small daemon which checks if the local Last-Modified of a given
file is the same as on other hosts.  If it is, write a file saying
that we can receive traffic, else remove it.

Also map that file to /_health in the Apache config so bgpd/fastly can
check it.

6 years agoinstall newer version of devscripts
Martin Zobel-Helas [Fri, 29 Sep 2017 21:14:46 +0000 (23:14 +0200)]
install newer version of devscripts

Signed-off-by: Martin Zobel-Helas <zobel@debian.org>
6 years agofixup ferm rule for danzi
Julien Cristau [Fri, 29 Sep 2017 18:02:45 +0000 (20:02 +0200)]
fixup ferm rule for danzi

6 years agoupdate ferm rules for postgresql@danzi
Julien Cristau [Fri, 29 Sep 2017 18:00:30 +0000 (20:00 +0200)]
update ferm rules for postgresql@danzi

6 years agosudo: debconf-web group can become debconf-web user
Julien Cristau [Fri, 29 Sep 2017 16:47:42 +0000 (18:47 +0200)]
sudo: debconf-web group can become debconf-web user

6 years agoadd debussy
Julien Cristau [Fri, 29 Sep 2017 15:51:45 +0000 (17:51 +0200)]
add debussy

6 years agoadd debussy volume at ubc
Julien Cristau [Fri, 29 Sep 2017 13:15:26 +0000 (15:15 +0200)]
add debussy volume at ubc

6 years agodanzi pg is now 9.6
Julien Cristau [Fri, 29 Sep 2017 10:02:56 +0000 (12:02 +0200)]
danzi pg is now 9.6

6 years agoRevert "redirect linux updates to security-cdn"
Julien Cristau [Fri, 29 Sep 2017 09:48:31 +0000 (11:48 +0200)]
Revert "redirect linux updates to security-cdn"

This reverts commit 34eacf56eba8289174e139dee14af8d926723115.

6 years agoBe more defensive with mv and use --no-target-directory
Peter Palfrader [Fri, 29 Sep 2017 09:33:27 +0000 (11:33 +0200)]
Be more defensive with mv and use --no-target-directory

6 years agoRefactor logging.
Peter Palfrader [Fri, 29 Sep 2017 09:30:44 +0000 (11:30 +0200)]
Refactor logging.

Keep a <component>.lock on the master for all updates, instead of trying
to lock individual directories.

There was a race in static-master-update-component, where we would keep
locks of <component> and <component>-updating.incoming-XXXXXX, and then
move <component> aside and replace it by
<component>-updating.incoming-XXXXXX in two steps.  Things could fail
if in between these two moves, another static-master-update-component
job showed up, and created a new <component> dir.

6 years agoBetter python, i.e., python that actually does what it should
Peter Palfrader [Fri, 29 Sep 2017 08:47:40 +0000 (10:47 +0200)]
Better python, i.e., python that actually does what it should

6 years agoDo not hardcode debian specifics in staticsync scripts, make them use a conffile
Peter Palfrader [Fri, 29 Sep 2017 08:43:29 +0000 (10:43 +0200)]
Do not hardcode debian specifics in staticsync scripts, make them use a conffile

6 years agoQuote COMPONENT computation in static-mirror-run
Peter Palfrader [Fri, 29 Sep 2017 08:31:13 +0000 (10:31 +0200)]
Quote COMPONENT computation in static-mirror-run

6 years agoRevert "Restrict ssh to anycast and static mirrors"
Julien Cristau [Wed, 27 Sep 2017 10:07:05 +0000 (12:07 +0200)]
Revert "Restrict ssh to anycast and static mirrors"

Needs more work.

This reverts commit 162626172d5eaaa017e69ee990842c89272fc60e.

6 years agoRestrict ssh to anycast and static mirrors
Julien Cristau [Wed, 27 Sep 2017 09:48:13 +0000 (11:48 +0200)]
Restrict ssh to anycast and static mirrors

6 years agoActually add the template
Peter Palfrader [Sun, 24 Sep 2017 18:09:21 +0000 (20:09 +0200)]
Actually add the template

6 years agoTry pages.debian.net apache
Peter Palfrader [Sun, 24 Sep 2017 18:08:45 +0000 (20:08 +0200)]
Try pages.debian.net apache

6 years agoAnd reload networking when we add new addresses
Peter Palfrader [Sun, 24 Sep 2017 17:41:56 +0000 (19:41 +0200)]
And reload networking when we add new addresses

6 years agoTry different filename, and set preferred-lifetime
Peter Palfrader [Sun, 24 Sep 2017 17:26:25 +0000 (19:26 +0200)]
Try different filename, and set preferred-lifetime

6 years agoAdd pages.d.n ip address
Peter Palfrader [Sun, 24 Sep 2017 17:22:21 +0000 (19:22 +0200)]
Add pages.d.n ip address

6 years agoLooks like bmdb1/wannabuild is back to timeline 1
Julien Cristau [Sat, 23 Sep 2017 17:21:54 +0000 (19:21 +0200)]
Looks like bmdb1/wannabuild is back to timeline 1

6 years agowannabuild cluster on pg 9.6
Julien Cristau [Sat, 23 Sep 2017 17:07:07 +0000 (19:07 +0200)]
wannabuild cluster on pg 9.6

6 years agofasolo on postgresql 9.6
Julien Cristau [Sat, 23 Sep 2017 13:23:05 +0000 (15:23 +0200)]
fasolo on postgresql 9.6

6 years agoprint VSS after service restart. only restart when using more than 6g
Peter Palfrader [Sat, 23 Sep 2017 13:07:13 +0000 (15:07 +0200)]
print VSS after service restart.  only restart when using more than 6g

6 years agoprovide full path to service
Peter Palfrader [Sat, 23 Sep 2017 13:03:04 +0000 (15:03 +0200)]
provide full path to service

6 years agorestart multipath on bytemark blades
Peter Palfrader [Sat, 23 Sep 2017 12:53:53 +0000 (14:53 +0200)]
restart multipath on bytemark blades

6 years agofix modes on qemu-system-aarch64-wrapper
Peter Palfrader [Sat, 23 Sep 2017 12:51:34 +0000 (14:51 +0200)]
fix modes on qemu-system-aarch64-wrapper

6 years agoserial on lobos/villa
Peter Palfrader [Fri, 22 Sep 2017 21:04:50 +0000 (23:04 +0200)]
serial on lobos/villa

6 years agoserial on mirror-isc/-umn
Peter Palfrader [Fri, 22 Sep 2017 21:02:17 +0000 (23:02 +0200)]
serial on mirror-isc/-umn

6 years agoserial on byrd
Peter Palfrader [Fri, 22 Sep 2017 20:48:58 +0000 (22:48 +0200)]
serial on byrd

6 years agoserial on grnet/csail node 0[12]
Peter Palfrader [Fri, 22 Sep 2017 20:47:21 +0000 (22:47 +0200)]
serial on grnet/csail node 0[12]

6 years agoaagaard-> conova-node01
Peter Palfrader [Fri, 22 Sep 2017 06:29:18 +0000 (08:29 +0200)]
aagaard-> conova-node01

6 years agoacker -> conova-node02
Peter Palfrader [Thu, 21 Sep 2017 19:49:49 +0000 (21:49 +0200)]
acker -> conova-node02

6 years agoTouch /srv/static.debian.org/.nobackup
Peter Palfrader [Thu, 21 Sep 2017 15:28:53 +0000 (17:28 +0200)]
Touch /srv/static.debian.org/.nobackup

6 years agocreate /srv/static.debian.org/master static-masters
Peter Palfrader [Thu, 21 Sep 2017 15:22:33 +0000 (17:22 +0200)]
create /srv/static.debian.org/master static-masters

6 years agocreate ~staticsync/static-master -> /srv/static.debian.org on static-masters
Peter Palfrader [Thu, 21 Sep 2017 15:21:11 +0000 (17:21 +0200)]
create ~staticsync/static-master -> /srv/static.debian.org on static-masters

6 years agoAnd remove second /srv/static.debian.org dir from static-mirror class
Peter Palfrader [Thu, 21 Sep 2017 15:15:31 +0000 (17:15 +0200)]
And remove second /srv/static.debian.org dir from static-mirror class

6 years agoMove mirror-master to static-master-grnet-01 from dillon
Peter Palfrader [Thu, 21 Sep 2017 15:13:50 +0000 (17:13 +0200)]
Move mirror-master to static-master-grnet-01 from dillon

6 years agofix class
Peter Palfrader [Thu, 21 Sep 2017 15:12:41 +0000 (17:12 +0200)]
fix class

6 years agoCreate /srv/static.debian.org on static mirrors and masters (not on sources)
Peter Palfrader [Thu, 21 Sep 2017 15:12:00 +0000 (17:12 +0200)]
Create /srv/static.debian.org on static mirrors and masters (not on sources)

6 years agoMove /usr/local/bin/static-update-component from static_source to statice_base, and...
Peter Palfrader [Thu, 21 Sep 2017 15:08:57 +0000 (17:08 +0200)]
Move /usr/local/bin/static-update-component from static_source to statice_base, and have static_mirror include static_base instead of static_source

6 years agoAdd static-master-grnet-01 as a static-master
Peter Palfrader [Thu, 21 Sep 2017 14:16:49 +0000 (16:16 +0200)]
Add static-master-grnet-01 as a static-master

6 years agoDo not do regex fo on variables that might not be defined yet
Peter Palfrader [Thu, 21 Sep 2017 14:06:21 +0000 (14:06 +0000)]
Do not do regex fo on variables that might not be defined yet

6 years agoSet /etc/environment and /etc/default/locale with puppet instead of in new-machine...
Peter Palfrader [Thu, 21 Sep 2017 13:05:37 +0000 (15:05 +0200)]
Set /etc/environment and /etc/default/locale with puppet instead of in new-machine howto

6 years agoSet root alias via samhain
Peter Palfrader [Thu, 21 Sep 2017 13:02:32 +0000 (15:02 +0200)]
Set root alias via samhain

6 years agosyntax fix
Peter Palfrader [Thu, 21 Sep 2017 13:00:57 +0000 (15:00 +0200)]
syntax fix

6 years agoMove samhain_recipients to hiera
Peter Palfrader [Thu, 21 Sep 2017 13:00:13 +0000 (15:00 +0200)]
Move samhain_recipients to hiera

6 years agoInstall userdir-ldap
Peter Palfrader [Thu, 21 Sep 2017 12:56:32 +0000 (14:56 +0200)]
Install userdir-ldap

6 years agoInstall debian.org-recommended
Peter Palfrader [Thu, 21 Sep 2017 12:56:22 +0000 (14:56 +0200)]
Install debian.org-recommended

6 years agoSet grub config on mirror-isc
Julien Cristau [Thu, 21 Sep 2017 10:18:30 +0000 (12:18 +0200)]
Set grub config on mirror-isc

6 years agoAdd slapd service definition
Julien Cristau [Thu, 21 Sep 2017 09:40:06 +0000 (11:40 +0200)]
Add slapd service definition

6 years agoRestart slapd on TLS cert renew
Julien Cristau [Thu, 21 Sep 2017 06:52:43 +0000 (08:52 +0200)]
Restart slapd on TLS cert renew

6 years agoRestart repro when the sip-ws TLS cert is renewed
Julien Cristau [Thu, 21 Sep 2017 06:49:40 +0000 (08:49 +0200)]
Restart repro when the sip-ws TLS cert is renewed

6 years agoredirect linux updates to security-cdn
Julien Cristau [Tue, 20 Jun 2017 06:40:01 +0000 (08:40 +0200)]
redirect linux updates to security-cdn

avoid overloading security mirrors

6 years agoPut mirror-master only on klecker and mirror-isc
Peter Palfrader [Mon, 18 Sep 2017 11:34:24 +0000 (13:34 +0200)]
Put mirror-master only on klecker and mirror-isc

6 years agoinstall python-requests on salsa
Martin Zobel-Helas [Mon, 18 Sep 2017 06:03:13 +0000 (08:03 +0200)]
install python-requests on salsa

Signed-off-by: Martin Zobel-Helas <zobel@debian.org>
6 years agoAdd buildd to paths we facter
Peter Palfrader [Thu, 14 Sep 2017 12:26:54 +0000 (14:26 +0200)]
Add buildd to paths we facter

6 years agoAdd debian-buildd to syncproxy rsyncd
Peter Palfrader [Thu, 14 Sep 2017 12:24:48 +0000 (14:24 +0200)]
Add debian-buildd to syncproxy rsyncd

6 years agoexim: treat Subject as a single line during regexp match for RT
Julien Cristau [Wed, 13 Sep 2017 09:52:06 +0000 (11:52 +0200)]
exim: treat Subject as a single line during regexp match for RT

This should hopefully fix truncation of multi-line subject header fields
and thus rt ticket titles.  Thanks, adsb.

6 years agoMake debian-buildd tree available over rsync for syncproxies
Peter Palfrader [Wed, 13 Sep 2017 08:24:31 +0000 (10:24 +0200)]
Make debian-buildd tree available over rsync for syncproxies

6 years agoadd ruby-ldap to salsa
Peter Palfrader [Tue, 12 Sep 2017 20:09:05 +0000 (22:09 +0200)]
add ruby-ldap to salsa

6 years agoRevert "disable different paths on mirror-conova for now"
Peter Palfrader [Tue, 12 Sep 2017 19:01:24 +0000 (21:01 +0200)]
Revert "disable different paths on mirror-conova for now"

This reverts commit 2a639d0531ce5dd40e28cd033908fa244a127112.

6 years agoDon't set grub_do_nopat or grub_do_extra unless grub_manage is set
Julien Cristau [Tue, 12 Sep 2017 13:33:11 +0000 (15:33 +0200)]
Don't set grub_do_nopat or grub_do_extra unless grub_manage is set

6 years agodisable different paths on mirror-conova for now
Peter Palfrader [Tue, 12 Sep 2017 11:58:12 +0000 (11:58 +0000)]
disable different paths on mirror-conova for now

6 years agomirror-conova: move syncproxy to default paths, move debian mirrors to public-* paths
Peter Palfrader [Tue, 12 Sep 2017 11:55:42 +0000 (11:55 +0000)]
mirror-conova: move syncproxy to default paths, move debian mirrors to public-* paths

6 years agomake a hiera setting for mirror base directory (/srv/mirrors)
Peter Palfrader [Tue, 12 Sep 2017 11:53:01 +0000 (11:53 +0000)]
make a hiera setting for mirror base directory (/srv/mirrors)

6 years agoflatten hiera role_config/syncproxy/mirror_basedir_prefix to role_config__syncproxy...
Peter Palfrader [Tue, 12 Sep 2017 11:52:29 +0000 (11:52 +0000)]
flatten hiera role_config/syncproxy/mirror_basedir_prefix to role_config__syncproxy/mirror_basedir_prefix

6 years agoMake historical mirror rsync template use the archive_root variable
Peter Palfrader [Tue, 12 Sep 2017 09:50:17 +0000 (09:50 +0000)]
Make historical mirror rsync template use the archive_root variable

6 years agohistorical mirror: make rsyncd.conf a template
Peter Palfrader [Tue, 12 Sep 2017 09:49:15 +0000 (09:49 +0000)]
historical mirror: make rsyncd.conf a template

6 years agoMake ports mirror template use an @archive_root and @archive_cd_root variable defined...
Peter Palfrader [Tue, 12 Sep 2017 09:47:04 +0000 (09:47 +0000)]
Make ports mirror template use an @archive_root and @archive_cd_root variable defined in the manifest

6 years agoMake debug mirror template use an @archive_root variable defined in the manifest
Peter Palfrader [Tue, 12 Sep 2017 09:44:47 +0000 (09:44 +0000)]
Make debug mirror template use an @archive_root variable defined in the manifest

6 years agorsycnd.conf.erb: make future changes less likely to break stuff
Peter Palfrader [Tue, 12 Sep 2017 09:44:01 +0000 (09:44 +0000)]
rsycnd.conf.erb: make future changes less likely to break stuff

6 years agofix ruby in rsycnd.conf.erb template
Peter Palfrader [Tue, 12 Sep 2017 09:43:42 +0000 (09:43 +0000)]
fix ruby in rsycnd.conf.erb template

6 years agodo not list debian-security archive
Peter Palfrader [Tue, 12 Sep 2017 08:56:04 +0000 (10:56 +0200)]
do not list debian-security archive