Create bookworm-based build host
Open, MediumPublic
Actions

Assigned To

Authored By

	MoritzMuehlenhoff
	Fri, Nov 8, 8:40 AM

Description

Keep it in parallel to the existing build2001 host running bullseye for now (since we still need to build some applications using Python 2 and while pbuilder manages the build within per-OS chroots, the source packages are created on the native host).

container image reports and builds will also initially remain on build2001 and will be moved in separate steps.

Details

Subject	Repo	Branch	Lines +/-
Make docker::baseimages ensurable	operations/puppet	production	+15 -23
package_builder: Cleanups	operations/puppet	production	+3 -15
Add build2002	operations/puppet	production	+4 -0

Customize query in gerrit

Event Timeline

MoritzMuehlenhoff created this task.Fri, Nov 8, 8:40 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFri, Nov 8, 8:40 AM

MoritzMuehlenhoff triaged this task as Medium priority.Mon, Nov 11, 3:01 PM

Change #1091606 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Add build2002

https://gerrit.wikimedia.org/r/1091606

gerritbot added a project: Patch-For-Review.Fri, Nov 15, 9:51 AM

Change #1091606 merged by Muehlenhoff:

[operations/puppet@production] Add build2002

https://gerrit.wikimedia.org/r/1091606

Maintenance_bot removed a project: Patch-For-Review.Fri, Nov 15, 10:30 AM

Cookbook cookbooks.sre.hosts.reimage was started by jmm@cumin2002 for host build2002.codfw.wmnet with OS bookworm

Cookbook cookbooks.sre.hosts.reimage started by jmm@cumin2002 for host build2002.codfw.wmnet with OS bookworm completed:

build2002 (PASS)
- Removed from Puppet and PuppetDB if present and deleted any certificates
- Removed from Debmonitor if present
- Forced PXE for next reboot
- Host rebooted via gnt-instance
- Host up (Debian installer)
- Add puppet_version metadata to Debian installer
- Set boot media to disk
- Host up (new fresh bookworm OS)
- Generated Puppet certificate
- Signed new Puppet certificate
- Run Puppet in NOOP mode to populate exported resources in PuppetDB
- Found Nagios_host resource for this host in PuppetDB
- Downtimed the new host on Icinga/Alertmanager
- First Puppet run completed and logged in /var/log/spicerack/sre/hosts/reimage/202411151236_jmm_1276900_build2002.out
- configmaster.wikimedia.org updated with the host new SSH public key for wmf-update-known-hosts-production
- Rebooted
- Automatic Puppet run was successful
- Forced a re-check of all Icinga services for the host
- Icinga status is optimal
- Icinga downtime removed
- Updated Netbox data from PuppetDB