Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.22 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 3086 2463306 2463039 2026-10-05T09:08:31Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-cli 2463306 wikitext text/x-wiki b0rmti57r50sa7u1m1jr9mnh6d1mh9p 2463307 2463306 2026-10-05T09:09:06Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-cli 2463307 wikitext text/x-wiki 26gas2irsakcg6000sm9r4r0dhtgroq 2463427 2463307 2026-10-05T11:48:55Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-cli 2463427 wikitext text/x-wiki 3wnccubtwbnun1n86v5lshvd5nuoe0g 2463428 2463427 2026-10-05T11:49:23Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-cli 2463428 wikitext text/x-wiki t6cirow1x233cqu3p82ikgmixktd4fz 0 4108 2463265 2463220 2026-10-04T21:02:25Z ScheduleDeploymentBot 37566 Add [[gerrit:1347674]] to Monday, October 05 UTC morning backport window 2463265 wikitext text/x-wiki mrip7bycpsboo6nxx3v3jddjkynqg4u 2463280 2463265 2026-10-05T07:31:21Z JWodstrcil (WMF) 24826 add GitLab Runner CI maintenance to calendar (one-off) 2463280 wikitext text/x-wiki pxfxy6x2yn9kvtoddya12hk9cr1rttn 2463288 2463280 2026-10-05T08:06:02Z ScheduleDeploymentBot 37566 Add [[gerrit:1347674]] to Monday, October 05 UTC late backport window 2463288 wikitext text/x-wiki ebn9wam4rk84ons2no95qc2265v9oyx 2463289 2463288 2026-10-05T08:18:30Z ScheduleDeploymentBot 37566 Add [[gerrit:1343917]] to Tuesday, October 06 UTC morning backport window 2463289 wikitext text/x-wiki f83nwc58y0qkkka3phy5piwm0s0nhyy 2463329 2463289 2026-10-05T10:24:51Z LToscano (WMF) 7191 /* Tuesday, October 6 */ 2463329 wikitext text/x-wiki tgfimptigf33xrdgn7s3fsdj6j9739s 2463401 2463329 2026-10-05T11:29:28Z ScheduleDeploymentBot 37566 Add [[gerrit:1350233]] to Monday, October 05 UTC afternoon backport window 2463401 wikitext text/x-wiki g6u8kg7lpztk56nc4jztfdsqwcdlt4u 2463422 2463401 2026-10-05T11:45:59Z ATomasevich (WMF) 14799 /* {{Deployment_day|date=2026-10-05}} */ Move my patches to a different window 2463422 wikitext text/x-wiki 3gdchu2fv1zo9lp7vd91etzsg8r44uv 498 6726 2463304 2463000 2026-10-05T09:07:49Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-cli 2463304 wikitext text/x-wiki t44mw0g0vnun7k4on34lsf0re2s0242 2463305 2463304 2026-10-05T09:08:20Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-cli 2463305 wikitext text/x-wiki sbiwmqzbvgamvtqjrqwlssq99xb6tnq 2463423 2463305 2026-10-05T11:47:01Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-cli 2463423 wikitext text/x-wiki 8z75s5ghhots1lvclxd7c3diziucpcv 2463426 2463423 2026-10-05T11:48:31Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-cli 2463426 wikitext text/x-wiki 9spsydnqrxyt0se513uq695qlzqm7jn 0 7919 2463246 2463242 2026-10-04T13:25:22Z Stashbot 7414 osleger@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2463246 wikitext text/x-wiki mx1aw9119dbel7gj0cbslskhxkku7b6 2463247 2463246 2026-10-04T13:25:24Z Stashbot 7414 osleger@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2463247 wikitext text/x-wiki 458z5dj914fqh58w7hxrbngaaao9y2d 2463248 2463247 2026-10-04T13:25:34Z Stashbot 7414 osleger@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2463248 wikitext text/x-wiki jmo1g55zmbqw3a96z6aqy6wt79c5g09 2463249 2463248 2026-10-04T13:25:35Z Stashbot 7414 osleger@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2463249 wikitext text/x-wiki ajmhgq13taf4zkwxea7ei3viab2p1a2 2463250 2463249 2026-10-04T13:27:21Z Stashbot 7414 osleger@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2463250 wikitext text/x-wiki clrdk78mty4f97e2d9lhzdtvn69ip2f 2463251 2463250 2026-10-04T13:27:23Z Stashbot 7414 osleger@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2463251 wikitext text/x-wiki ee4cfsuv8knailw6josd726af1ko98k 2463252 2463251 2026-10-04T13:27:25Z Stashbot 7414 osleger@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2463252 wikitext text/x-wiki giubvwnm7pvfwxphzihz6qkkvewpz61 2463253 2463252 2026-10-04T13:27:28Z Stashbot 7414 osleger@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2463253 wikitext text/x-wiki hrcsir4eq9no2twy8268r8o1talv5mm 2463255 2463253 2026-10-04T14:17:50Z Stashbot 7414 osleger@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2463255 wikitext text/x-wiki 3xrz94arw9sep92topc4kxgkux9s475 2463256 2463255 2026-10-04T14:17:53Z Stashbot 7414 osleger@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2463256 wikitext text/x-wiki 0gmvj3zbevkunatny5gka67pxxdwxjj 2463257 2463256 2026-10-04T14:17:54Z Stashbot 7414 osleger@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2463257 wikitext text/x-wiki bt5re5rrl9wray9smjgpcst4x9326d0 2463258 2463257 2026-10-04T14:17:57Z Stashbot 7414 osleger@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2463258 wikitext text/x-wiki 3hkqj2r0c4iad3zqy1tq7b5gsid3gc8 2463261 2463258 2026-10-04T16:13:12Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-dumps: apply 2463261 wikitext text/x-wiki 5g92guc6rye46vxztd94xeznhrkc39r 2463262 2463261 2026-10-04T16:13:46Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-dumps: apply 2463262 wikitext text/x-wiki p1kdj0kapaz5oz19svk8o8yfvzafdk7 2463270 2463262 2026-10-05T02:00:20Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2463270 wikitext text/x-wiki el0qnpoourk86igwjjzbqn4735bk57y 2463271 2463270 2026-10-05T02:08:06Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 07m 46s) 2463271 wikitext text/x-wiki k4cneegm7m0aod7adulu09eiwxmvp8k 2463275 2463271 2026-10-05T07:15:58Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2463275 wikitext text/x-wiki sf9ibmum17wjfs01eeys7bjolblu7gy 2463276 2463275 2026-10-05T07:16:31Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2463276 wikitext text/x-wiki tp3mqx4umr5s8pk7jhdq2ol11oljfk1 2463277 2463276 2026-10-05T07:17:35Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. 2463277 wikitext text/x-wiki 0h2efaomxif2hsyk3x4sxvsr9kdmi9f 2463278 2463277 2026-10-05T07:18:31Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. 2463278 wikitext text/x-wiki 0b59tzgddvqvm9z6yjpwsggychxmjie 2463282 2463278 2026-10-05T07:39:36Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'sync'. 2463282 wikitext text/x-wiki lqtlkz8zl4v5ljbib2xcs2x0xuw9bf2 2463283 2463282 2026-10-05T07:40:46Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'sync'. 2463283 wikitext text/x-wiki 8900yks7qbal0e7fsy7uf0p1pdpdllf 2463284 2463283 2026-10-05T07:41:02Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/liftwing-studio: sync 2463284 wikitext text/x-wiki hujnlg90s55yjvyl19vildqaept467h 2463285 2463284 2026-10-05T07:42:19Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/liftwing-studio: sync 2463285 wikitext text/x-wiki bfgpqj4aixisa614agoxs00e20ac1ma 2463286 2463285 2026-10-05T07:46:59Z Stashbot 7414 dpogorzelski@dns1004: START - running authdns-update 2463286 wikitext text/x-wiki 1xds2k9f2t0g7uby5gl0ce91fxr8oh6 2463287 2463286 2026-10-05T07:49:31Z Stashbot 7414 dpogorzelski@dns1004: END - running authdns-update 2463287 wikitext text/x-wiki 8tf7akajeme0ivjdefpsvwn111p5sew 2463290 2463287 2026-10-05T08:20:35Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reimage for host testvm2001.codfw.wmnet with OS bookworm 2463290 wikitext text/x-wiki t8fesb6dbsdeoxms3e5thqk3kujeuly 2463292 2463290 2026-10-05T08:22:41Z Stashbot 7414 volans: upgrading cloudcumin2001 in-place to trixie T436667 2463292 wikitext text/x-wiki a2ape64myk4ejsancmj6p2ezlacjwbk 2463293 2463292 2026-10-05T08:30:13Z Stashbot 7414 jelto@cumin1004: START - Cookbook sre.loadbalancer.migrate-service-ipip for alias: wikikube-worker-codfw@codfw 2463293 wikitext text/x-wiki achnvoxa7c7r62tsrisbwrwn4aay352 2463294 2463293 2026-10-05T08:34:02Z Stashbot 7414 jelto@cumin1004: START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on (A:lvs-low-traffic-codfw or A:lvs-secondary-codfw) and A:bullseye and A:lvs 2463294 wikitext text/x-wiki fxsfujws8smyjha5s89tkhnln4jli0z 2463295 2463294 2026-10-05T08:35:01Z Stashbot 7414 jelto@cumin1004: END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on (A:lvs-low-traffic-codfw or A:lvs-secondary-codfw) and A:bullseye and A:lvs 2463295 wikitext text/x-wiki 61utzymu98elair57n11i91lzmun955 2463296 2463295 2026-10-05T08:35:02Z Stashbot 7414 jelto@cumin1004: END (PASS) - Cookbook sre.loadbalancer.migrate-service-ipip (exit_code=0) for alias: wikikube-worker-codfw@codfw 2463296 wikitext text/x-wiki 45w1vpr652w4ix6we6jn29suwaqpxxu 2463297 2463296 2026-10-05T08:37:52Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on testvm2001.codfw.wmnet with reason: host reimage 2463297 wikitext text/x-wiki lfgitjhscod4vkokblxb2jj79fujeqo 2463298 2463297 2026-10-05T08:42:40Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on testvm2001.codfw.wmnet with reason: host reimage 2463298 wikitext text/x-wiki 83wx6q7d2qc6p8naqxhwd2ifh6c0ym7 2463299 2463298 2026-10-05T08:46:50Z Stashbot 7414 jelto@cumin1004: START - Cookbook sre.loadbalancer.migrate-service-ipip for alias: wikikube-worker-eqiad@eqiad 2463299 wikitext text/x-wiki t6ce34ni7dtc33mx43d2mv51vh9wcqk 2463300 2463299 2026-10-05T08:52:44Z Stashbot 7414 jelto@cumin1004: START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on (A:lvs-low-traffic-eqiad or A:lvs-secondary-eqiad) and A:bullseye and A:lvs 2463300 wikitext text/x-wiki 95fsy0wjqv7j2o48ymdqu6ggtobzwyn 2463301 2463300 2026-10-05T08:53:54Z Stashbot 7414 jelto@cumin1004: END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on (A:lvs-low-traffic-eqiad or A:lvs-secondary-eqiad) and A:bullseye and A:lvs 2463301 wikitext text/x-wiki kpcxmkumta2v77utyn5mc4xey7j9e23 2463302 2463301 2026-10-05T08:53:55Z Stashbot 7414 jelto@cumin1004: END (PASS) - Cookbook sre.loadbalancer.migrate-service-ipip (exit_code=0) for alias: wikikube-worker-eqiad@eqiad 2463302 wikitext text/x-wiki i57e2exw6x9chuh67zki71djofxc4zc 2463303 2463302 2026-10-05T08:58:53Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host testvm2001.codfw.wmnet with OS bookworm 2463303 wikitext text/x-wiki iob8kl9i8zexl4pnyjb9pzjzsaan3xz 2463308 2463303 2026-10-05T09:17:50Z Stashbot 7414 dkertesz@cumin1004: START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on A:cp-codfw and A:cp - upgrade haproxy to 3.2.25-1 (T439667) 2463308 wikitext text/x-wiki bxf49e06eyr2clxiyq7rhpsma4f1vma 2463309 2463308 2026-10-05T09:20:35Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host sretest2004.codfw.wmnet 2463309 wikitext text/x-wiki hy2z0p6vh5txs8aaay0ayyz7rixsotw 2463310 2463309 2026-10-05T09:26:31Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sretest2004.codfw.wmnet 2463310 wikitext text/x-wiki 58mcjgkxvj3s9r94tfen5jarajpx67o 2463311 2463310 2026-10-05T09:30:38Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host zuul1004.eqiad.wmnet 2463311 wikitext text/x-wiki dal4cbswa114b9p3f6y30w046q856pz 2463313 2463311 2026-10-05T09:36:12Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host zuul1004.eqiad.wmnet 2463313 wikitext text/x-wiki 2fcupkedpm91dmdqu7k1361l90t2d8f 2463314 2463313 2026-10-05T09:50:01Z Stashbot 7414 btullis@cumin1004: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host an-druid1003.eqiad.wmnet with OS bookworm 2463314 wikitext text/x-wiki 16l8rcd0ww0dlo5xhne9orbpvop9lzi 2463315 2463314 2026-10-05T09:50:26Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reimage for host an-druid1003.eqiad.wmnet with OS bookworm 2463315 wikitext text/x-wiki mxthixojnmgspw2mhrpnxkl2iao6edh 2463316 2463315 2026-10-05T10:01:58Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1007.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART (NO reboot will be performed automatically) 2463316 wikitext text/x-wiki qtl4p3rd217e0vtv6gbqbfbfvz83479 2463317 2463316 2026-10-05T10:05:41Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART 2463317 wikitext text/x-wiki niulhoziasfr4i2zbdnfjzeflfpiopq 2463318 2463317 2026-10-05T10:05:45Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest2001.codfw.wmnet (push config only) 2463318 wikitext text/x-wiki cqx51j1q17im2v5gct058yntzl1mqqw 2463319 2463318 2026-10-05T10:05:50Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest2001.codfw.wmnet (push config only) 2463319 wikitext text/x-wiki ra036r2yps23aorws8oy9xoanu5ba7k 2463320 2463319 2026-10-05T10:05:53Z Stashbot 7414 blake@deploy1003: Started scap sync-world: helm-only deploy for T417800 2463320 wikitext text/x-wiki 2g1hcnsrwgd1ew02w8mzoco457boztw 2463321 2463320 2026-10-05T10:06:09Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on an-druid1003.eqiad.wmnet with reason: host reimage 2463321 wikitext text/x-wiki mn39thvqo0awo1y62z783424cnwt5bh 2463322 2463321 2026-10-05T10:08:57Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-druid1003.eqiad.wmnet with reason: host reimage 2463322 wikitext text/x-wiki n1lbslom7zhrplifwf24z5jijz0cegn 2463323 2463322 2026-10-05T10:15:00Z Stashbot 7414 blake@deploy1003: Finished scap sync-world: helm-only deploy for T417800 (duration: 09m 40s) 2463323 wikitext text/x-wiki 98ma4bw2284cbsvtqn3ohr0v9241fl4 2463324 2463323 2026-10-05T10:15:59Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest2001.codfw.wmnet (remove config only) 2463324 wikitext text/x-wiki rdiv6y5n45e4hh8tw07ou3f67radewd 2463325 2463324 2026-10-05T10:16:05Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest2001.codfw.wmnet (remove config only) 2463325 wikitext text/x-wiki bgfl3dmlsnpkzwzfkf0tbxdocradax1 2463326 2463325 2026-10-05T10:16:16Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART 2463326 wikitext text/x-wiki 0d8dgqzx5cp31lhrz8hbsarqlc8k3bf 2463327 2463326 2026-10-05T10:19:43Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.reimage for host sretest2001.codfw.wmnet with OS trixie 2463327 wikitext text/x-wiki 19vfy0lghtz07bojqy5w43bzt27u1dw 2463328 2463327 2026-10-05T10:20:38Z Stashbot 7414 elukey@cumin1004: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest2001.codfw.wmnet with OS trixie 2463328 wikitext text/x-wiki sameeum3d8qpqyvp6pfnk5jak4bq79d 2463330 2463328 2026-10-05T10:25:07Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1007.eqiad.wmnet 2463330 wikitext text/x-wiki 6ejcvgwylooozdrg1pdim0aeenm82q4 2463331 2463330 2026-10-05T10:25:43Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1007.eqiad.wmnet 2463331 wikitext text/x-wiki bm7rvp7m5xkrn3gizjopth3xy271vtt 2463332 2463331 2026-10-05T10:27:15Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.mysql.depool depool db2207: stress tests 2463332 wikitext text/x-wiki rgic108u0c51z0beey42g8y03ma5e2n 2463333 2463332 2026-10-05T10:28:09Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2207: stress tests 2463333 wikitext text/x-wiki a5smp4395otglwqi5vxq82wpci7mfzd 2463334 2463333 2026-10-05T10:28:26Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-druid1003.eqiad.wmnet with OS bookworm 2463334 wikitext text/x-wiki so0rsrgls7ez8yjbfkgcms5jo3mic2s 2463335 2463334 2026-10-05T10:29:05Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on db2207.codfw.wmnet with reason: stress testing 2463335 wikitext text/x-wiki p7o24323ixal3aw0nat1ginue3t7z8r 2463336 2463335 2026-10-05T10:29:20Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.reimage for host sretest2001.codfw.wmnet with OS trixie 2463336 wikitext text/x-wiki 0ax5qjnk7hlovpajzs40ttqy3ayw1ee 2463337 2463336 2026-10-05T10:29:28Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest2001.codfw.wmnet (push config only) 2463337 wikitext text/x-wiki 0l81chto31yfhh6lzw11qohp0s6cx2c 2463338 2463337 2026-10-05T10:29:33Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest2001.codfw.wmnet (push config only) 2463338 wikitext text/x-wiki ol3duwhl564e0knjasq2owjxgxbhw6s 2463339 2463338 2026-10-05T10:30:58Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1007.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART (NO reboot will be performed automatically) 2463339 wikitext text/x-wiki 9ybloecpwof1xx2l93ste11fbx6vkc0 2463340 2463339 2026-10-05T10:31:23Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1007.eqiad.wmnet 2463340 wikitext text/x-wiki op0p8xm0aixgzt70xfxyk55vhbd3nqw 2463341 2463340 2026-10-05T10:31:26Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1007.eqiad.wmnet 2463341 wikitext text/x-wiki k3gnj7gxed1ieobxtn2gye36n4l3ubh 2463342 2463341 2026-10-05T10:31:53Z Stashbot 7414 marostegui: Stop MariaDB on db2207 and db2209 for stress testing 2463342 wikitext text/x-wiki bkj1zf4vxajf235cq4v7d8rldg1c9ho 2463343 2463342 2026-10-05T10:32:13Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on db2209.codfw.wmnet with reason: stress testing 2463343 wikitext text/x-wiki 3jnfopxc83b4kh49ihd1mzt1nkjf8dy 2463344 2463343 2026-10-05T10:32:25Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.mysql.depool depool db2209: stress tests 2463344 wikitext text/x-wiki g99v9qoe1znre475os0itd3la2xdcbh 2463345 2463344 2026-10-05T10:32:38Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2209: stress tests 2463345 wikitext text/x-wiki mi3e6tve7c8xjg2dz84iz0l6abs77uc 2463346 2463345 2026-10-05T10:33:36Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reimage for host an-druid1004.eqiad.wmnet with OS bookworm 2463346 wikitext text/x-wiki i4er0tqu576mfrn7sf3vxcp72hgl9ua 2463347 2463346 2026-10-05T10:33:42Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.mysql.depool depool db1218: stress tests 2463347 wikitext text/x-wiki l20u1i2a10uas9abj4ptonupxzide0d 2463348 2463347 2026-10-05T10:33:49Z Stashbot 7414 marostegui: Stop MariaDB on db1218, db2207 and db2209 for stress testing 2463348 wikitext text/x-wiki a8c7gons1y5nmy20cy8ym7908bbo2cm 2463349 2463348 2026-10-05T10:33:54Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1218: stress tests 2463349 wikitext text/x-wiki o766yma812sqaz4qr9bmdhnmnezfn6r 2463350 2463349 2026-10-05T10:34:22Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on db1218.eqiad.wmnet with reason: stress testing 2463350 wikitext text/x-wiki 3rptmjd5xcla1gxisnmaqh3s2syp1yy 2463351 2463350 2026-10-05T10:37:51Z Stashbot 7414 dkertesz@cumin1004: END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on A:cp-codfw and A:cp - upgrade haproxy to 3.2.25-1 (T439667) 2463351 wikitext text/x-wiki j9j34wm7htuoisxrfoas2lveblvka25 2463352 2463351 2026-10-05T10:38:14Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest2001.codfw.wmnet (remove config only) 2463352 wikitext text/x-wiki drzvqgqv8nqn94ge8p71yyl7ods98u6 2463353 2463352 2026-10-05T10:38:19Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest2001.codfw.wmnet (remove config only) 2463353 wikitext text/x-wiki 2hkqvwttd3d2j82v23rdmdw2y95678n 2463354 2463353 2026-10-05T10:39:57Z Stashbot 7414 tappof@deploy1003: helmfile [eqiad] START helmfile.d/admin 'sync'. 2463354 wikitext text/x-wiki pq250ran8cqk1qmsmeydj3rrmlihpki 2463355 2463354 2026-10-05T10:40:09Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2001.codfw.wmnet 2463355 wikitext text/x-wiki 1itqm1ly5w2sjr2jglcnhehsqm7u9o8 2463356 2463355 2026-10-05T10:40:12Z Stashbot 7414 tappof@deploy1003: helmfile [eqiad] DONE helmfile.d/admin 'sync'. 2463356 wikitext text/x-wiki moxywy04mqml4zve9vt2483mpqhrx81 2463357 2463356 2026-10-05T10:40:44Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2001.codfw.wmnet 2463357 wikitext text/x-wiki j9bk82c6dmpxzilcpzzqqer5hz9g7lk 2463358 2463357 2026-10-05T10:40:45Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on sretest2001.codfw.wmnet with reason: host reimage 2463358 wikitext text/x-wiki jl27llnr13vwo40pgtn3lgm2ot4pzrg 2463359 2463358 2026-10-05T10:40:50Z Stashbot 7414 tappof@deploy1003: helmfile [codfw] START helmfile.d/admin 'sync'. 2463359 wikitext text/x-wiki ng9lvnb86oydk575awx7ahd0e5gvn9g 2463360 2463359 2026-10-05T10:41:25Z Stashbot 7414 tappof@deploy1003: helmfile [codfw] DONE helmfile.d/admin 'sync'. 2463360 wikitext text/x-wiki n65wgl6hakt4y1swcowvz00jgqzm8bf 2463361 2463360 2026-10-05T10:42:59Z Stashbot 7414 tappof@deploy1003: Started scap sync-world: T432444 - Remove kafka-logging200[1-3] 2463361 wikitext text/x-wiki 32oy52vsa0utvb9s62i3a1qaugbz4vu 2463362 2463361 2026-10-05T10:43:13Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2001.codfw.wmnet 2463362 wikitext text/x-wiki fs9pn3kmabx63myq8dggtreqxuj42f5 2463363 2463362 2026-10-05T10:43:15Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2001.codfw.wmnet 2463363 wikitext text/x-wiki it1sxunlc4m4yax0x2l5ayvvcp0t0ay 2463364 2463363 2026-10-05T10:43:26Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2001.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2463364 wikitext text/x-wiki slgrgrh6fos2sy5hhkcgaymk96364sq 2463365 2463364 2026-10-05T10:43:27Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sretest2001.codfw.wmnet with reason: host reimage 2463365 wikitext text/x-wiki nf4f4okgosnhbv7d68qfun5rj5uwvud 2463367 2463365 2026-10-05T10:46:25Z Stashbot 7414 tappof@deploy1003: Finished scap sync-world: T432444 - Remove kafka-logging200[1-3] (duration: 04m 44s) 2463367 wikitext text/x-wiki j3ls748trr8d2o7w2z38viy33etz13s 2463370 2463367 2026-10-05T10:50:04Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on an-druid1004.eqiad.wmnet with reason: host reimage 2463370 wikitext text/x-wiki lyaj9v7de6o5f0h7trxyxcw72t3nt51 2463371 2463370 2026-10-05T10:51:53Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2001.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2463371 wikitext text/x-wiki ckl4lxuwekzng9dq3vkeykeglu4mt3b 2463372 2463371 2026-10-05T10:51:58Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2001.codfw.wmnet 2463372 wikitext text/x-wiki gkyeu5t1q9n3gtvhx1vl5u1db1rv20k 2463373 2463372 2026-10-05T10:52:01Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2001.codfw.wmnet 2463373 wikitext text/x-wiki k5vwv9e2tjpj36ot9phw336lludekp9 2463374 2463373 2026-10-05T10:52:10Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2002.codfw.wmnet 2463374 wikitext text/x-wiki ck25wmx1ujw3q66db82tiq6ne1e2a70 2463375 2463374 2026-10-05T10:52:44Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2002.codfw.wmnet 2463375 wikitext text/x-wiki 4t2lu3lb81tsp0w77vxjhf2g4b4lsef 2463376 2463375 2026-10-05T10:52:54Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on an-druid1004.eqiad.wmnet with reason: host reimage 2463376 wikitext text/x-wiki svusirpgzd773idxf1r9yxpuqd15xl9 2463377 2463376 2026-10-05T10:55:28Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. 2463377 wikitext text/x-wiki 9miecld3glcnutzsomnfap0r7fy87j5 2463379 2463377 2026-10-05T10:57:38Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. 2463379 wikitext text/x-wiki lv8to07m8vdfpdkokjtpkli6lupgxpg 2463380 2463379 2026-10-05T10:58:03Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - elukey@cumin1004" 2463380 wikitext text/x-wiki 699kc2x8ulrtxtlli2d1oqdull0n8ub 2463381 2463380 2026-10-05T11:00:58Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2002.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2463381 wikitext text/x-wiki 0kijwzpuhnvo58pxjqeg0c9zukrk232 2463382 2463381 2026-10-05T11:08:22Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2002.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2463382 wikitext text/x-wiki 6rode556r7smqxgkgo9ox418grpb4ew 2463383 2463382 2026-10-05T11:08:27Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2002.codfw.wmnet 2463383 wikitext text/x-wiki fouipu0cb2itcjh2anqmt4gr5x2ay64 2463384 2463383 2026-10-05T11:09:21Z Stashbot 7414 oblivian@cumin1004: END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) pool for host wikikube-worker2002.codfw.wmnet 2463384 wikitext text/x-wiki 9l0q9bnw6t4hmpovrwxdenkgo0rrcym 2463385 2463384 2026-10-05T11:10:03Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2002.codfw.wmnet 2463385 wikitext text/x-wiki 6tiurhcgohyju6j7il9ufmp8o1w114h 2463386 2463385 2026-10-05T11:10:05Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2002.codfw.wmnet 2463386 wikitext text/x-wiki 9xgfz46pdreu0f5y2ddgz9tfti6b60p 2463388 2463386 2026-10-05T11:13:43Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2005.codfw.wmnet 2463388 wikitext text/x-wiki 06w6b8bp4sqekphk9u9jexjyp78rv1w 2463389 2463388 2026-10-05T11:14:17Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2005.codfw.wmnet 2463389 wikitext text/x-wiki kcazcamc1j9b6ncgh2du812y35u0e3l 2463390 2463389 2026-10-05T11:14:27Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2005.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2463390 wikitext text/x-wiki ockuc4iouo9uqt3t4jgrim81jfa1duy 2463391 2463390 2026-10-05T11:14:56Z Stashbot 7414 oblivian@cumin1004: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker2005.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2463391 wikitext text/x-wiki awxxoph1fodnzyv7jkvog77hbs4nghi 2463392 2463391 2026-10-05T11:18:36Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2005.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2463392 wikitext text/x-wiki f0073chdtw2v2v6n97jiablh1yms30j 2463393 2463392 2026-10-05T11:25:01Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2005.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2463393 wikitext text/x-wiki 3g7iv16bxflloyjcyqo1bnmcvnhibt1 2463394 2463393 2026-10-05T11:25:08Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host an-druid1004.eqiad.wmnet with OS bookworm 2463394 wikitext text/x-wiki 8z8hyctbl8xjkycepiydhxkjwfwcd0o 2463395 2463394 2026-10-05T11:25:22Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2005.codfw.wmnet 2463395 wikitext text/x-wiki mfjsijgk1od27w4jc0fv79wqfynj4sm 2463396 2463395 2026-10-05T11:25:41Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2005.codfw.wmnet 2463396 wikitext text/x-wiki acos2e8cwfnuaqxmx6ydm241mabd2ts 2463397 2463396 2026-10-05T11:26:45Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2006.codfw.wmnet 2463397 wikitext text/x-wiki llbnk765y6wabqvcz8ydrnikjaygr5x 2463398 2463397 2026-10-05T11:27:23Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2006.codfw.wmnet 2463398 wikitext text/x-wiki 8tismfj0x6v5bz0oej9jufxgislunn0 2463399 2463398 2026-10-05T11:27:34Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2006.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2463399 wikitext text/x-wiki qsr4njdmwihkh9bn3dfdo4r4v5v106m 2463400 2463399 2026-10-05T11:28:48Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2463400 wikitext text/x-wiki hbu5wjy0kwjsma9gjpytfbxhdnw0mn8 2463402 2463400 2026-10-05T11:29:33Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2463402 wikitext text/x-wiki hdnkdhwuqt2hyow9u27tflf7ab3tfuk 2463403 2463402 2026-10-05T11:31:39Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2006.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2463403 wikitext text/x-wiki 62bt8e64vseq44aec72x7dslt5qm0d4 2463404 2463403 2026-10-05T11:31:44Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2006.codfw.wmnet 2463404 wikitext text/x-wiki 9couzvnzz8kmjkb25lpno0druso7iob 2463405 2463404 2026-10-05T11:34:32Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2006.codfw.wmnet 2463405 wikitext text/x-wiki azxu10mujoxvg4iu882hxoxrgprc3hg 2463406 2463405 2026-10-05T11:34:41Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2011.codfw.wmnet 2463406 wikitext text/x-wiki fyd2d32wyioz39ll529493hxp8mip1w 2463407 2463406 2026-10-05T11:35:15Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2011.codfw.wmnet 2463407 wikitext text/x-wiki 0ygav9rxrz1wl41w3li17uxrcvfqcvt 2463408 2463407 2026-10-05T11:35:45Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2011.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2463408 wikitext text/x-wiki sm4aw9dvk7qs5v7yxjln0k1h64rhief 2463409 2463408 2026-10-05T11:41:21Z Stashbot 7414 dkertesz@cumin1004: START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on A:cp-drmrs and A:cp - upgrade haproxy to 3.2.25-1 (T439667) 2463409 wikitext text/x-wiki ee89quv9i1nmzr0roekfuxnqtoenyf5 2463410 2463409 2026-10-05T11:42:03Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2011.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2463410 wikitext text/x-wiki bho3wonzyqqla4fiqyjkfqz9k0y9i21 2463411 2463410 2026-10-05T11:42:08Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2011.codfw.wmnet 2463411 wikitext text/x-wiki r3h9zxzk826kqdj3t543peyca4q2jo5 2463412 2463411 2026-10-05T11:43:00Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Started scap sync-world: Backport for [[gerrit:1350233|instrument(AccountSetup): expose motivation data for control (T439887)]] 2463412 wikitext text/x-wiki lbpuhzftx1gb1ny4a93fplgl2wieqwe 2463413 2463412 2026-10-05T11:43:02Z Stashbot 7414 oblivian@cumin1004: END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) pool for host wikikube-worker2011.codfw.wmnet 2463413 wikitext text/x-wiki 4mj5zdrqwupnmlqlyn7kqvg0fehkht5 2463414 2463413 2026-10-05T11:43:37Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2011.codfw.wmnet 2463414 wikitext text/x-wiki a07rzbvd5dldtoggm5q5os031li31xw 2463415 2463414 2026-10-05T11:43:52Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2011.codfw.wmnet 2463415 wikitext text/x-wiki j959kbutjscuzi1e9mua5caji6agf2p 2463416 2463415 2026-10-05T11:44:00Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2012.codfw.wmnet 2463416 wikitext text/x-wiki ifd634jpmbmjvl9zdk8xvw1zrgtw3xc 2463417 2463416 2026-10-05T11:44:34Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2012.codfw.wmnet 2463417 wikitext text/x-wiki liwadvf56oh4v7q36jqewpwpa6ccdta 2463418 2463417 2026-10-05T11:44:49Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reimage for host an-druid1005.eqiad.wmnet with OS bookworm 2463418 wikitext text/x-wiki ht6m7efbz12k644v490p8afqkxfkq73 2463419 2463418 2026-10-05T11:45:18Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.move-vlan for host an-druid1005 2463419 wikitext text/x-wiki 13w4rhv0vlvpq371grj55o07kpjtb8b 2463420 2463419 2026-10-05T11:45:25Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.dns.netbox 2463420 wikitext text/x-wiki do47i38v4gv3j3fqj67uto3xcvmmvq7 2463425 2463420 2026-10-05T11:48:06Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2012.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2463425 wikitext text/x-wiki kvktgo2c8e79euzm3285d6itvrirhkh 2463429 2463425 2026-10-05T11:52:26Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host an-druid1005 - btullis@cumin1004" 2463429 wikitext text/x-wiki 8aosf9yjzw7m9a4ln5bpnpb68fadcbn 2463430 2463429 2026-10-05T11:52:56Z Stashbot 7414 jmm@puppetserver1001: conftool action : set/weight=10; selector: name=ldap-replica2008.wikimedia.org 2463430 wikitext text/x-wiki qw14jswqk64xa6woyid9hmjia69ldj7 2463431 2463430 2026-10-05T11:53:11Z Stashbot 7414 jmm@puppetserver1001: conftool action : set/weight=10; selector: name=ldap-replica2007.wikimedia.org 2463431 wikitext text/x-wiki 0x9ba24vtms81r6ahfduyo583i45au2 2463432 2463431 2026-10-05T11:53:13Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host an-druid1005 - btullis@cumin1004" 2463432 wikitext text/x-wiki asmtat0evyei2fvub7sdeg5hpml5sy5 2463433 2463432 2026-10-05T11:53:14Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2463433 wikitext text/x-wiki a311q6hwnhr77kesn3ogxkidm6yv29e 2463434 2463433 2026-10-05T11:53:15Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.dns.wipe-cache an-druid1005.eqiad.wmnet 13.53.64.10.in-addr.arpa 3.1.0.0.3.5.0.0.4.6.0.0.0.1.0.0.8.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2463434 wikitext text/x-wiki odxare60m48k1qbk28pmpkb1cq9h5iu 2463435 2463434 2026-10-05T11:53:17Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) an-druid1005.eqiad.wmnet 13.53.64.10.in-addr.arpa 3.1.0.0.3.5.0.0.4.6.0.0.0.1.0.0.8.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2463435 wikitext text/x-wiki 6t1yf5kiffgsqp8xyjhkd04zpla0mtz 2463436 2463435 2026-10-05T11:53:18Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.network.configure-switch-interfaces for host an-druid1005 2463436 wikitext text/x-wiki eky5g5iylvu3jexzryp2nfsp8bfwkba 2463437 2463436 2026-10-05T11:53:19Z Stashbot 7414 jmm@puppetserver1001: conftool action : set/weight=10; selector: name=ldap-replica1005.wikimedia.org 2463437 wikitext text/x-wiki 670fw5xnnyhgqztzxa10b3dl120wu15 2463438 2463437 2026-10-05T11:53:24Z Stashbot 7414 jmm@puppetserver1001: conftool action : set/weight=10; selector: name=ldap-replica1006.wikimedia.org 2463438 wikitext text/x-wiki s528wuojhu95evfue2qkchegw21mv0h 2463439 2463438 2026-10-05T11:53:42Z Stashbot 7414 jmm@puppetserver1001: conftool action : set/pooled=yes; selector: name=ldap-replica2008.wikimedia.org 2463439 wikitext text/x-wiki skgd9x1a3cd0nq9pe8uwl7p5mpmd6li 2463440 2463439 2026-10-05T11:54:24Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2012.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2463440 wikitext text/x-wiki cc65v514mt75dg762j01jbeb0korcwp 2463441 2463440 2026-10-05T11:54:29Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2012.codfw.wmnet 2463441 wikitext text/x-wiki 6fzn2pvwozojb0afnjnup9a0c1f91vb 2463442 2463441 2026-10-05T11:54:32Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2012.codfw.wmnet 2463442 wikitext text/x-wiki tgo15g3dti0rvka32bkjavu79kedovj 2463443 2463442 2026-10-05T11:54:41Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2013.codfw.wmnet 2463443 wikitext text/x-wiki ojjp49erpytnb52obq51ew6eyev6er8 2463444 2463443 2026-10-05T11:55:15Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2013.codfw.wmnet 2463444 wikitext text/x-wiki 3n15bsf0xwjgencchd6kvo5bxjunvym 2463445 2463444 2026-10-05T11:55:22Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host an-druid1005 2463445 wikitext text/x-wiki srqd4k3ayjq6cr8i3p1aswlmv0bnbv7 2463446 2463445 2026-10-05T11:55:23Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host an-druid1005 2463446 wikitext text/x-wiki k6hbff1u9tu3xdny8n3o6epjay1ojk7 2463448 2463446 2026-10-05T11:58:02Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2463448 wikitext text/x-wiki lqatc7tjm8b2s4p751c43oovghp0mti 0 17290 2463421 2463222 2026-10-05T11:45:48Z Stashbot 7414 hashar: Updating jobs to Quibble 1.22 (nodejs still at version 24.x) # T437752 T426684 2463421 wikitext text/x-wiki 8sg45u4pzb046s6qvhhalasnke0052q 498 30942 2463272 2463240 2026-10-05T03:46:11Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.depool_and_destroy (T429387) 2463272 wikitext text/x-wiki e7vsq2ondtm6yv3391qwctyz1djggoh 2463279 2463272 2026-10-05T07:20:38Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=99) (T429387) 2463279 wikitext text/x-wiki eff2h9nnfze5hvxk5590y27rh13khte 2463291 2463279 2026-10-05T08:22:03Z Stashbot 7414 volans: upgrading cloudcumin2001 in-place to trixie T436667 2463291 wikitext text/x-wiki 9ker6ljsv5ftihx5y8yylljthebivbl 0 440607 2463263 2407068 2026-10-04T18:52:44Z Addshore 138 /* Production databases */ Add wmf_dev_metrics 2463263 wikitext text/x-wiki dg3x2t2v1wbvgsm4hl75xwajyoewrzy 498 443949 2463259 2463158 2026-10-04T15:19:47Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy b258f49 (Allow a reference-check suffix on a column source) for T429918 2463259 wikitext text/x-wiki 2plbxbe3dyb9qvu5jmhbnrxjsv9xloj 2463260 2463259 2026-10-04T15:19:49Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy e10f3fe (Reject an invalid suffix on a column source instead of ignoring it) for T429918 2463260 wikitext text/x-wiki 7058se1eezqv6yx2jfikadv57rhs9eo 0 444148 2463378 2433674 2026-10-05T10:57:17Z GKyziridis-WMF 39160 Update the Partitions of ml-serve1013/ml-serve1014 16x96GB each, and ml-serve1012 (SPX/NPS1, 8x192GB) and ml-serve1015 (CPX/NPS4, 64x24GB) based on T436928#12359461. 2463378 wikitext text/x-wiki 75l2uptge0nxq7dveu14mig63rx5omd 0 447718 2463281 2456919 2026-10-05T07:34:45Z Hashar 32 /* Fetch our additional plugins */ 2463281 wikitext text/x-wiki 5pdor9jaxc30wwmyelqpu68qta5dqdf 12 449113 2463254 2462102 2026-10-04T14:07:26Z Lucas Werkmeister 8093 /* Creating webservice jobs */ fix typo 2463254 wikitext text/x-wiki 7zz2ootn0g4za46m48j1e79556r9387 0 449160 2463266 2463238 2026-10-05T00:01:27Z Dexbot 30554 Bot: Updating the report 2463266 wikitext text/x-wiki l01hq79vmpx9gwacg0upi407r83av48 3 453064 2463273 2462417 2026-10-05T04:16:12Z SSapaty (WMF) 28955 /* contribgraph review */ Reply 2463273 wikitext text/x-wiki sz89cechok4ki8zvulk65ivaf44u49o 116 453906 2463274 2463243 2026-10-05T04:18:26Z Gitlabaccountapprovalbot 37332 manjurul was rejected. 2463274 wikitext text/x-wiki 640sm37xnkx7vy5pvggns8vnkiz09tw 0 459290 2463312 2462757 2026-10-05T09:31:37Z KCVelaga (WMF) 38150 /* YYYY-MM-DD NEXT TUESDAY TRAIN (REPLACE THIS AFTER DEPLOY) */ 2463312 wikitext text/x-wiki s7xnat9okzd8n7l5mmxhgula6m426yy 0 459699 2463366 2463025 2026-10-05T10:45:35Z Stashbot 7414 jgleeson: payments-wiki upgraded from dac9a1b9 to a5dbf560 2463366 wikitext text/x-wiki ro2x0b45yqh1atcm1bw7fade37g8oik 0 460746 2463424 2462347 2026-10-05T11:47:32Z HNowlan (WMF) 15760 2463424 wikitext text/x-wiki qlebnfbtexe3tsrrpw1ek5til7w09e0 2 460766 2463245 2026-10-04T12:19:55Z Davidjohny01 60220 Reliable Heating Repair in Saddle Brook NJ 2463245 wikitext text/x-wiki 9kkaktxris4v84tug0mybokf67wh2m5 0 460767 2463264 2026-10-04T19:02:58Z Addshore 138 First sample query 2463264 wikitext text/x-wiki 8d133exyt4fmcaxzfcjflh4odac20wv 3 460768 2463267 2026-10-05T01:07:04Z StrikerBot 8475 Welcome to Toolforge! 2463267 wikitext text/x-wiki o88wgcq18lbclmb1p3rlxtfgn8ikk7c 3 460769 2463268 2026-10-05T01:07:37Z StrikerBot 8475 Welcome to Toolforge! 2463268 wikitext text/x-wiki 4obottuzwf4m2f430scctp0kfpzrn8p 3 460770 2463269 2026-10-05T01:08:41Z StrikerBot 8475 Welcome to Toolforge! 2463269 wikitext text/x-wiki mo05njxkcdz6jrqniu1hkpyad0nkxtl 0 460771 2463368 2026-10-05T10:46:28Z JGiannelos (WMF) 17083 Created page with "<mark>To get started, make a copy of this page, named after your service, as a subpage of [[SLO]]. (For example, "SLO/Foobaroid".) Also open the [[SLO/Template_instructions|instructions]], which guide you in more detail through the steps outlined here. Answer the questions in your new copy, removing ''all'' the yellow text, in mark tags, as you go. (Save early and often.)</mark> Status: '''[[SLO/Runbook#Drafting|draft]]''' <mark>(Replace with "approved" when the SLO is..." 2463368 wikitext text/x-wiki c2v9e69iid8s89iqumybv8ad9dm6eay 2463387 2463368 2026-10-05T11:10:21Z JGiannelos (WMF) 17083 2463387 wikitext text/x-wiki dwh5nnymcturp989vdwxa3d1xg8lits 2463449 2463387 2026-10-05T11:58:54Z JGiannelos (WMF) 17083 2463449 wikitext text/x-wiki qt6tikyfi2uudzyifbgtxo7mrp354ys 0 460772 2463369 2026-10-05T10:48:20Z Nemoralis 21869 Redirected page to [[Wikitech:Cloud Services End User Terms of use]] 2463369 wikitext text/x-wiki c04o5urcq32bvdznqmk0htfekqtvah5 0 460773 2463447 2026-10-05T11:55:55Z DPogorzelski-WMF 48508 Created page with "<!-- scrollbot-page: SCROLL/Tools/Wikitech page template --> <templatestyles src="User:Effie_Mouzeli_(WMF)/SCROLL/styles.css"/> ''Get all your ducks in a row before you go to production!'' <span class="scroll-placeholder">This is a template for a Wikitech component page. Read the greyed example text in each section below as a guide, and replace it with your own content. Delete this paragraph, and any greyed text you have not replaced, before publishing. Drop whole sect..." 2463447 wikitext text/x-wiki frz56fkqzg7kz2d4yshzzk9pvoti3hj