Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.48.0-wmf.3 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 3086 2478267 2477851 2026-11-05T12:31:57Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component builds-api 2478267 wikitext text/x-wiki 6bsir3lci9elnlo7o0wejdx0zybb61h 2478269 2478267 2026-11-05T12:36:14Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api 2478269 wikitext text/x-wiki m4eqxy2yczlv6zw9v45aeokzm88jab9 2478275 2478269 2026-11-05T12:44:11Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2478275 wikitext text/x-wiki tbf02iy2rtbz6x3pu65kwbu0d8sx2wz 2478279 2478275 2026-11-05T12:47:50Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api 2478279 wikitext text/x-wiki hwjtp15xwhbz3wqoeiwl0uyn3kcz9qc 0 3170 2478362 2460142 2026-11-05T15:44:03Z SSingh (WMF) 13928 /* Depool a site */ add section on DNS host depooling 2478362 wikitext text/x-wiki eu737hnde33v0jcou22aknp93zq9rlo 2478363 2478362 2026-11-05T15:44:55Z SSingh (WMF) 13928 /* Depool a site */ fix typo 2478363 wikitext text/x-wiki 71kmb2dmcgc8h6jjlyp3juziul4vnh6 2478364 2478363 2026-11-05T15:48:24Z SSingh (WMF) 13928 add section on depooling DNS hosts via cookbook 2478364 wikitext text/x-wiki 9xw2g565nthvi1yqi3dcsqkwonm1oge 0 3906 2478491 2370276 2026-11-05T21:31:07Z TCipriani (WMF) 4895 /* Deployment */ 2478491 wikitext text/x-wiki 5lux2yxkd1497saoehynomdxc00r68v 0 4108 2478272 2478243 2026-11-05T12:37:59Z ScheduleDeploymentBot 37566 Add [[gerrit:1364301]] to Thursday, November 05 UTC afternoon backport window 2478272 wikitext text/x-wiki l4pzhdnurwu88qv8yyy2pqkwf6ejlfb 2478330 2478272 2026-11-05T14:41:27Z ScheduleDeploymentBot 37566 Add [[gerrit:1362175]] to Thursday, November 05 UTC afternoon backport window 2478330 wikitext text/x-wiki q0d0o79m0fa74bdqo4ks31bs9xrjc90 2478365 2478330 2026-11-05T16:09:13Z ADancy (WMF) 17694 Add 1361577 to next puppet window 2478365 wikitext text/x-wiki 402mh9fm6mfdwx6avl54orgbn4gyu2g 2478464 2478365 2026-11-05T20:31:51Z ScheduleDeploymentBot 37566 Add [[gerrit:1340815]] to Thursday, November 05 UTC late backport window 2478464 wikitext text/x-wiki ormapfql9k830q3kv68sjg0k58ccuf7 2478471 2478464 2026-11-05T20:53:17Z ScheduleDeploymentBot 37566 Add [[gerrit:1364770]] to Thursday, November 05 UTC late backport window 2478471 wikitext text/x-wiki q4goxc4ttk5nrqgs7604zrpd3rpqc9p 2478487 2478471 2026-11-05T21:26:24Z ScheduleDeploymentBot 37566 Add [[gerrit:1364782]] to Monday, November 09 UTC afternoon backport window 2478487 wikitext text/x-wiki czlwxzloern97fvlv9x4vxzm6lpe6y5 498 6726 2478264 2477823 2026-11-05T12:28:00Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component builds-api 2478264 wikitext text/x-wiki dqzcha7fjwoaf8wi6p86rmbaypbi4ax 2478266 2478264 2026-11-05T12:31:35Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api 2478266 wikitext text/x-wiki i2soxlqookdzswo1kualrtfcnip0lqd 2478271 2478266 2026-11-05T12:37:55Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2478271 wikitext text/x-wiki e412ogyewhx3ei7pzn95ssi8qq06goc 2478273 2478271 2026-11-05T12:41:03Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api 2478273 wikitext text/x-wiki o73m44uo0h0fihb4cjgmliceyulyyp9 2 7639 2478545 2452979 2026-11-05T23:47:16Z BryanDavis 1604 Undid revision [[Special:Diff/2452979|2452979]] by [[Special:Contributions/BryanDavis|BryanDavis]] ([[User talk:BryanDavis|talk]]); forgot to take this one down on Monday 2478545 wikitext text/x-wiki 1x5jc7m2n4lr36yh88dqzldrh7fv1om 0 7919 2478248 2478247 2026-11-05T12:00:06Z Stashbot 7414 root@deploy2003: helmfile [staging] START helmfile.d/services/shellbox: sync 2478248 wikitext text/x-wiki hcudtcdnf3aigs1twqrq64v8v914qvf 2478249 2478248 2026-11-05T12:00:16Z Stashbot 7414 root@deploy2003: helmfile [staging] DONE helmfile.d/services/shellbox: sync 2478249 wikitext text/x-wiki i5ztjtvcimrymnd9w5q05ga9c9j0rbz 2478250 2478249 2026-11-05T12:00:21Z Stashbot 7414 root@deploy2003: helmfile [staging] START helmfile.d/services/shellbox-timeline: sync 2478250 wikitext text/x-wiki 8lsapuee7w2owvxdz4x43s14pfqzo6p 2478251 2478250 2026-11-05T12:00:31Z Stashbot 7414 root@deploy2003: helmfile [staging] DONE helmfile.d/services/shellbox-timeline: sync 2478251 wikitext text/x-wiki t2e4x8q7nyg9b6iugcfyi2uepdg5de1 2478252 2478251 2026-11-05T12:00:34Z Stashbot 7414 root@deploy2003: helmfile [codfw] START helmfile.d/services/shellbox-timeline: sync 2478252 wikitext text/x-wiki lbsj8ldb8q3grg09ylt6dpysdp6gh0z 2478253 2478252 2026-11-05T12:00:47Z Stashbot 7414 root@deploy2003: helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: sync 2478253 wikitext text/x-wiki kq3maysyr3q978h8uv3r9tjilcpyql4 2478254 2478253 2026-11-05T12:05:52Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1214', diff saved to https://phabricator.wikimedia.org/P97357 and previous config saved to /var/cache/conftool/dbconfig/20261105-120551-ladsgroup.json 2478254 wikitext text/x-wiki g7kgmoid8l7a0ugsttdbnvyxzm1y0vj 2478255 2478254 2026-11-05T12:07:12Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest1006.eqiad.wmnet (remove config only) 2478255 wikitext text/x-wiki pr7yc4fywkky5n4z7rjqm2od6zryew2 2478256 2478255 2026-11-05T12:07:17Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest1006.eqiad.wmnet (remove config only) 2478256 wikitext text/x-wiki qv8fbyrwmflmsqjqqv2eam4jcrdhpme 2478257 2478256 2026-11-05T12:09:21Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on sretest1006.eqiad.wmnet with reason: host reimage 2478257 wikitext text/x-wiki mr049r2kvncsajlrr3xgoq4pkoadn8e 2478258 2478257 2026-11-05T12:11:36Z Stashbot 7414 moritzm: installing alsa-lib security updates 2478258 wikitext text/x-wiki cez4gtr6w5cnbckow4x5tjlopq37dlu 2478259 2478258 2026-11-05T12:13:48Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sretest1006.eqiad.wmnet with reason: host reimage 2478259 wikitext text/x-wiki 3vfmfmzbbf8v2934ua2ixsx0l6puu75 2478260 2478259 2026-11-05T12:15:54Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1214', diff saved to https://phabricator.wikimedia.org/P97358 and previous config saved to /var/cache/conftool/dbconfig/20261105-121552-ladsgroup.json 2478260 wikitext text/x-wiki 0iuiu6k10hstk3rwh1t500bwiilgrta 2478261 2478260 2026-11-05T12:25:56Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1214 (T441633)', diff saved to https://phabricator.wikimedia.org/P97359 and previous config saved to /var/cache/conftool/dbconfig/20261105-122554-ladsgroup.json 2478261 wikitext text/x-wiki 06c3lomlgev643x18c1a6psuso7dnmx 2478262 2478261 2026-11-05T12:26:14Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1226.eqiad.wmnet with reason: Maintenance 2478262 wikitext text/x-wiki 8x9v7npdobactka8so1ze18p04xr3ru 2478263 2478262 2026-11-05T12:26:16Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db1226 (T441633)', diff saved to https://phabricator.wikimedia.org/P97360 and previous config saved to /var/cache/conftool/dbconfig/20261105-122614-ladsgroup.json 2478263 wikitext text/x-wiki 0ql90r3bmd0v003auqqznf53tj5cd3d 2478265 2478263 2026-11-05T12:31:23Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sretest1006.eqiad.wmnet with OS trixie 2478265 wikitext text/x-wiki 7ytex3vpo5xgd9iy3rw2eay6s9hutbv 2478268 2478265 2026-11-05T12:35:20Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1226 (T441633)', diff saved to https://phabricator.wikimedia.org/P97361 and previous config saved to /var/cache/conftool/dbconfig/20261105-123519-ladsgroup.json 2478268 wikitext text/x-wiki gkcl44ypb4s4clsn7gi9ztm4c130zkp 2478270 2478268 2026-11-05T12:37:34Z Stashbot 7414 moritzm: installing alsa-lib security updates 2478270 wikitext text/x-wiki dr1zz6vhd6ipjlohu46i50206o2tgo4 2478274 2478270 2026-11-05T12:41:59Z Stashbot 7414 kamila@deploy2003: Started scap sync-world: Backport for [[gerrit:1364180|Enroll 5% of client sessions in PHP 8.5 (T441689)]] 2478274 wikitext text/x-wiki 32fgrhqx673lw3d8ewvn06mm6yik2bv 2478276 2478274 2026-11-05T12:45:22Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1226', diff saved to https://phabricator.wikimedia.org/P97362 and previous config saved to /var/cache/conftool/dbconfig/20261105-124521-ladsgroup.json 2478276 wikitext text/x-wiki m90aa6n9x638ocymt2grlnge8272idc 2478277 2478276 2026-11-05T12:46:09Z Stashbot 7414 kamila@deploy2003: kamila: Backport for [[gerrit:1364180|Enroll 5% of client sessions in PHP 8.5 (T441689)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2478277 wikitext text/x-wiki 5x760o4pgaultbep8027rjfab7xqg6i 2478278 2478277 2026-11-05T12:46:42Z Stashbot 7414 kamila@deploy2003: kamila: Continuing with deployment 2478278 wikitext text/x-wiki 332afyc1xs8npthknd0l7xn20zlp4oa 2478280 2478278 2026-11-05T12:52:50Z Stashbot 7414 kamila@deploy2003: Finished scap sync-world: Backport for [[gerrit:1364180|Enroll 5% of client sessions in PHP 8.5 (T441689)]] (duration: 10m 50s) 2478280 wikitext text/x-wiki qeci11qw94ntcsrfv3g9zp1awi8jc4i 2478281 2478280 2026-11-05T12:55:24Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1226', diff saved to https://phabricator.wikimedia.org/P97363 and previous config saved to /var/cache/conftool/dbconfig/20261105-125522-ladsgroup.json 2478281 wikitext text/x-wiki 5io2wndin4e04pa42tno8akkzy7cudg 2478282 2478281 2026-11-05T13:05:26Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1226 (T441633)', diff saved to https://phabricator.wikimedia.org/P97364 and previous config saved to /var/cache/conftool/dbconfig/20261105-130524-ladsgroup.json 2478282 wikitext text/x-wiki fz4cu588mw5xqw8vnfhtsey8zjrv84h 2478283 2478282 2026-11-05T13:05:44Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1281.eqiad.wmnet with reason: Maintenance 2478283 wikitext text/x-wiki 13mjkpof9xmfxjrk6aqj6ddadxmt7d9 2478284 2478283 2026-11-05T13:06:06Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on 7 hosts with reason: Maintenance 2478284 wikitext text/x-wiki puq96hmwwis88dkwe83u2e8u1jfhffd 2478285 2478284 2026-11-05T13:06:09Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db1281 (T441633)', diff saved to https://phabricator.wikimedia.org/P97365 and previous config saved to /var/cache/conftool/dbconfig/20261105-130607-ladsgroup.json 2478285 wikitext text/x-wiki 9mhdnhbbm9s4vx6c6vbqlg3wv55y039 2478286 2478285 2026-11-05T13:11:21Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1281 (T441633)', diff saved to https://phabricator.wikimedia.org/P97366 and previous config saved to /var/cache/conftool/dbconfig/20261105-131120-ladsgroup.json 2478286 wikitext text/x-wiki jt4vci7hh4gji0v4otkb8lad72mccpa 2478287 2478286 2026-11-05T13:14:13Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.dns.netbox 2478287 wikitext text/x-wiki ht852ntumcsmhq7j2ou790qw83mypiv 2478288 2478287 2026-11-05T13:18:17Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.hosts.reimage for host sretest1006.eqiad.wmnet with OS trixie 2478288 wikitext text/x-wiki 7jxh5c8d6w8qpwmfm16ifnhc7radjh1 2478289 2478288 2026-11-05T13:19:19Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update entry for sretest1006 - cmooney@cumin1004" 2478289 wikitext text/x-wiki buvh8m4ac9hohr60q9fbn01l494uogr 2478290 2478289 2026-11-05T13:19:22Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update entry for sretest1006 - cmooney@cumin1004" 2478290 wikitext text/x-wiki 3v5an457rjc3p6y3ubf5v9o9xmy5k8p 2478291 2478290 2026-11-05T13:19:23Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2478291 wikitext text/x-wiki 5kdnztfwr011fhlnrzg5z59h1hvm7ak 2478292 2478291 2026-11-05T13:19:29Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest1006.eqiad.wmnet (push config only) 2478292 wikitext text/x-wiki lb9jyy0jlxz4vizaztku37myvfs02li 2478293 2478292 2026-11-05T13:19:33Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest1006.eqiad.wmnet (push config only) 2478293 wikitext text/x-wiki 8x8ndnaqmyxpvxsuaaa185le7lbi7xs 2478294 2478293 2026-11-05T13:19:59Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.dns.wipe-cache sretest1006.eqiad.wmnet on all recursors 2478294 wikitext text/x-wiki bbhc0ke8d5yc1t2iyjgrb2vdnnfumc5 2478295 2478294 2026-11-05T13:20:03Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) sretest1006.eqiad.wmnet on all recursors 2478295 wikitext text/x-wiki 8wocwxj6b1gwcml2juhckgz7mjnailz 2478296 2478295 2026-11-05T13:21:23Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1281', diff saved to https://phabricator.wikimedia.org/P97367 and previous config saved to /var/cache/conftool/dbconfig/20261105-132122-ladsgroup.json 2478296 wikitext text/x-wiki ezam41c352jjb2um8ht1hu80o259p16 2478297 2478296 2026-11-05T13:26:44Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.hosts.provision for host sretest1006.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2478297 wikitext text/x-wiki 653rw6u3dk5okvu7k892mvvy8chfddl 2478299 2478297 2026-11-05T13:31:25Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1281', diff saved to https://phabricator.wikimedia.org/P97368 and previous config saved to /var/cache/conftool/dbconfig/20261105-133123-ladsgroup.json 2478299 wikitext text/x-wiki mcqrhxhdcfcg9vus1f4s3yog12cedz0 2478300 2478299 2026-11-05T13:33:07Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest1006.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2478300 wikitext text/x-wiki dreko4fst4i2sy5ebzis40zdd50snmk 2478301 2478300 2026-11-05T13:34:53Z Stashbot 7414 eevans@deploy2003: helmfile [staging] START helmfile.d/services/linked-artifacts: apply 2478301 wikitext text/x-wiki ai0csjpoqvzibs0o3ozl1mpityppj6k 2478302 2478301 2026-11-05T13:35:01Z Stashbot 7414 eevans@deploy2003: helmfile [staging] DONE helmfile.d/services/linked-artifacts: apply 2478302 wikitext text/x-wiki 0w974cpp2xuy2vmuj3bi48nfdmb3jp2 2478303 2478302 2026-11-05T13:35:07Z Stashbot 7414 eevans@deploy2003: helmfile [eqiad] START helmfile.d/services/linked-artifacts: apply 2478303 wikitext text/x-wiki 0ves4krlek94gpmg9mbfumiyd6p7bwd 2478304 2478303 2026-11-05T13:35:27Z Stashbot 7414 eevans@deploy2003: helmfile [eqiad] DONE helmfile.d/services/linked-artifacts: apply 2478304 wikitext text/x-wiki iqq31l3sj82r4wu4ke1njqi8ixccu4h 2478305 2478304 2026-11-05T13:35:41Z Stashbot 7414 eevans@deploy2003: helmfile [codfw] START helmfile.d/services/linked-artifacts: apply 2478305 wikitext text/x-wiki 1b0jd4ln1ivu81990pqdc2chl2ss5kz 2478307 2478305 2026-11-05T13:35:57Z Stashbot 7414 eevans@deploy2003: helmfile [codfw] DONE helmfile.d/services/linked-artifacts: apply 2478307 wikitext text/x-wiki 69tl469xr6rsnqgmowbmx10fmytfrlf 2478308 2478307 2026-11-05T13:41:26Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1281 (T441633)', diff saved to https://phabricator.wikimedia.org/P97369 and previous config saved to /var/cache/conftool/dbconfig/20261105-134125-ladsgroup.json 2478308 wikitext text/x-wiki ke8p2gxjfe9plzq4e9kzs2rp7bxmkup 2478309 2478308 2026-11-05T13:41:45Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1286.eqiad.wmnet with reason: Maintenance 2478309 wikitext text/x-wiki ny050tw8jntph507tpqaqqvwcj14neh 2478310 2478309 2026-11-05T13:41:47Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db1286 (T441633)', diff saved to https://phabricator.wikimedia.org/P97370 and previous config saved to /var/cache/conftool/dbconfig/20261105-134145-ladsgroup.json 2478310 wikitext text/x-wiki nznmp4rm1xy2k7bqvjllivvyn38y6xp 2478312 2478310 2026-11-05T13:45:52Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest1006.eqiad.wmnet (remove config only) 2478312 wikitext text/x-wiki 1py01a0d8sixr3wfd4gnab3t16rpva5 2478313 2478312 2026-11-05T13:45:56Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest1006.eqiad.wmnet (remove config only) 2478313 wikitext text/x-wiki o5miv5dc62kaiempz6944re80svrmc0 2478314 2478313 2026-11-05T13:46:51Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1286 (T441633)', diff saved to https://phabricator.wikimedia.org/P97371 and previous config saved to /var/cache/conftool/dbconfig/20261105-134649-ladsgroup.json 2478314 wikitext text/x-wiki olukv2n4zzjm0dhdiqtr0s3z855wvra 2478315 2478314 2026-11-05T13:48:00Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on sretest1006.eqiad.wmnet with reason: host reimage 2478315 wikitext text/x-wiki sbvyb7evm6pc5ztfrfxfv92lgbbq27p 2478316 2478315 2026-11-05T13:53:32Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sretest1006.eqiad.wmnet with reason: host reimage 2478316 wikitext text/x-wiki no7c2t8zz6lbbndklqhym8u3vf0qnj1 2478317 2478316 2026-11-05T13:56:52Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1286', diff saved to https://phabricator.wikimedia.org/P97372 and previous config saved to /var/cache/conftool/dbconfig/20261105-135651-ladsgroup.json 2478317 wikitext text/x-wiki irmkb3tjtqz8tln9pqwwtxjx8fffqnk 2478318 2478317 2026-11-05T14:03:50Z Stashbot 7414 stran@deploy2003: Started scap sync-world: Backport for [[gerrit:1364209|Enable SuggestedInvestigations for nlwiki (hidden), enwikivoyage (T443646 T443147)]] 2478318 wikitext text/x-wiki biiqar7sl8zu52rhsr32rowm3hu69j0 2478319 2478318 2026-11-05T14:06:54Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1286', diff saved to https://phabricator.wikimedia.org/P97373 and previous config saved to /var/cache/conftool/dbconfig/20261105-140653-ladsgroup.json 2478319 wikitext text/x-wiki lrah4ihms4c5awvv3hd2xx53fb61c98 2478320 2478319 2026-11-05T14:08:09Z Stashbot 7414 stran@deploy2003: stran: Backport for [[gerrit:1364209|Enable SuggestedInvestigations for nlwiki (hidden), enwikivoyage (T443646 T443147)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2478320 wikitext text/x-wiki 72m47zeylyhyvgry2y0t65tbb2cgr1r 2478321 2478320 2026-11-05T14:09:23Z Stashbot 7414 stran@deploy2003: stran: Continuing with deployment 2478321 wikitext text/x-wiki 5ejgkmzoy2mw61hxahkppo7avzj4g3n 2478322 2478321 2026-11-05T14:11:30Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sretest1006.eqiad.wmnet with OS trixie 2478322 wikitext text/x-wiki a9409bmvyecm4xys9x3b86dapot6b5f 2478323 2478322 2026-11-05T14:15:24Z Stashbot 7414 stran@deploy2003: Finished scap sync-world: Backport for [[gerrit:1364209|Enable SuggestedInvestigations for nlwiki (hidden), enwikivoyage (T443646 T443147)]] (duration: 11m 34s) 2478323 wikitext text/x-wiki m68zsrswslgfk9y4f54sft1yugz3iv5 2478324 2478323 2026-11-05T14:16:56Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1286 (T441633)', diff saved to https://phabricator.wikimedia.org/P97374 and previous config saved to /var/cache/conftool/dbconfig/20261105-141655-ladsgroup.json 2478324 wikitext text/x-wiki tkwdfcj18zmmmm4vewwftx0u8q2to8b 2478325 2478324 2026-11-05T14:17:14Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on dbstore1009.eqiad.wmnet with reason: Maintenance 2478325 wikitext text/x-wiki t34y6kyqeripebhg9el9wiwdxq1ocj2 2478326 2478325 2026-11-05T14:32:16Z Stashbot 7414 Tran: Deployed patch for T443598 2478326 wikitext text/x-wiki alcfxfzo0s0zqkjnm4fshtmozyudqtu 2478327 2478326 2026-11-05T14:34:36Z Stashbot 7414 mlitn@deploy2003: Started scap sync-world: Backport for [[gerrit:1364301|Squashed diff to master]] (1.48.0-wmf.3) 2478327 wikitext text/x-wiki px9xsgr3sqortf9s58fevvaatqp6689 2478328 2478327 2026-11-05T14:38:45Z Stashbot 7414 mlitn@deploy2003: mlitn: Backport for [[gerrit:1364301|Squashed diff to master]] (1.48.0-wmf.3) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2478328 wikitext text/x-wiki 8li7rmfgnnm32pd601rhxkksf4v6qld 2478329 2478328 2026-11-05T14:41:16Z Stashbot 7414 mlitn@deploy2003: mlitn: Continuing with deployment 2478329 wikitext text/x-wiki 6ihwbw3vdrtmqhdotg0t6x8k8itasss 2478331 2478329 2026-11-05T14:44:14Z Stashbot 7414 dbrant@deploy2003: helmfile [staging] START helmfile.d/services/mobileapps: apply 2478331 wikitext text/x-wiki azc00c8onv2qb7j3f6mci0fi9ji5uz9 2478332 2478331 2026-11-05T14:44:40Z Stashbot 7414 dbrant@deploy2003: helmfile [staging] DONE helmfile.d/services/mobileapps: apply 2478332 wikitext text/x-wiki fu30ywi5ap1dmdk3qc3xxk62a3womlb 2478333 2478332 2026-11-05T14:46:36Z Stashbot 7414 akhatun@deploy2003: helmfile [eqiad] START helmfile.d/services/lac-lambdas: apply 2478333 wikitext text/x-wiki hg9pxydk5qjuelxggrxn2gxdwr5mmrp 2478334 2478333 2026-11-05T14:46:43Z Stashbot 7414 akhatun@deploy2003: helmfile [eqiad] DONE helmfile.d/services/lac-lambdas: apply 2478334 wikitext text/x-wiki kr21arpn5cbep10ddro8rezlsb7mdvq 2478335 2478334 2026-11-05T14:47:08Z Stashbot 7414 dbrant@deploy2003: helmfile [eqiad] START helmfile.d/services/mobileapps: apply 2478335 wikitext text/x-wiki 0hy3kzd9dwqoajj681a0jwyw2zzmw7x 2478336 2478335 2026-11-05T14:47:15Z Stashbot 7414 mlitn@deploy2003: Finished scap sync-world: Backport for [[gerrit:1364301|Squashed diff to master]] (1.48.0-wmf.3) (duration: 12m 38s) 2478336 wikitext text/x-wiki 2spvv3ytjci3y5xf4icuukofx3fdmff 2478337 2478336 2026-11-05T14:47:57Z Stashbot 7414 dbrant@deploy2003: helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply 2478337 wikitext text/x-wiki hj2b7tivjp976zyetgj7krviddo2exh 2478338 2478337 2026-11-05T14:48:06Z Stashbot 7414 dbrant@deploy2003: helmfile [codfw] START helmfile.d/services/mobileapps: apply 2478338 wikitext text/x-wiki 3g7rl0q0trazj1eot8wsbmw7nf33l4x 2478339 2478338 2026-11-05T14:48:45Z Stashbot 7414 dbrant@deploy2003: helmfile [codfw] DONE helmfile.d/services/mobileapps: apply 2478339 wikitext text/x-wiki cjdf6qnh53pz9gepjct5ebtiw2tg8wx 2478340 2478339 2026-11-05T14:56:01Z Stashbot 7414 akhatun@deploy2003: helmfile [eqiad] START helmfile.d/services/lac-lambdas: apply 2478340 wikitext text/x-wiki 4pbqihaigzq45iy55jrnsvusd52t8qd 2478341 2478340 2026-11-05T14:56:20Z Stashbot 7414 akhatun@deploy2003: helmfile [eqiad] DONE helmfile.d/services/lac-lambdas: apply 2478341 wikitext text/x-wiki et5hkfl6pz6t4l1s84miel4o5mwtqjb 2478342 2478341 2026-11-05T14:58:24Z Stashbot 7414 stran@deploy2003: Started scap sync-world: Backport for [[gerrit:1362175|Round 2 on disabling createpage for anonymous users on English Wikibooks (T443449)]], [[gerrit:1364399|Enable Special:SuggestedInvestigations for nlwiki (T443646)]] 2478342 wikitext text/x-wiki sal9wrsw6meqj7s9t7zeift6jc98oz8 2478344 2478342 2026-11-05T15:02:18Z Stashbot 7414 jhancock@cumin2003: START - Cookbook sre.hosts.provision for host wikikube-worker2337.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART 2478344 wikitext text/x-wiki 6uzmc0k0zkzl8ti1v0j6nt5fggcmhr0 2478345 2478344 2026-11-05T15:02:29Z Stashbot 7414 jhancock@cumin2003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker2337.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART 2478345 wikitext text/x-wiki 9zd1aju31gsy5kwyk1afh1j2wp7bpmb 2478346 2478345 2026-11-05T15:02:40Z Stashbot 7414 stran@deploy2003: stran, codenamenoreste: Backport for [[gerrit:1362175|Round 2 on disabling createpage for anonymous users on English Wikibooks (T443449)]], [[gerrit:1364399|Enable Special:SuggestedInvestigations for nlwiki (T443646)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2478346 wikitext text/x-wiki ryo8wdwggzoxyyth9ren6b2z7j44xwp 2478347 2478346 2026-11-05T15:02:52Z Stashbot 7414 jhancock@cumin2003: START - Cookbook sre.hosts.provision for host wikikube-worker2337.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART 2478347 wikitext text/x-wiki 0opxqloyw2ga7nad66od2xvheud8y6o 2478348 2478347 2026-11-05T15:04:56Z Stashbot 7414 stran@deploy2003: stran, codenamenoreste: Continuing with deployment 2478348 wikitext text/x-wiki j41ljerzt8mo3n90zy1ev6hkgmkpb3s 2478349 2478348 2026-11-05T15:08:29Z Stashbot 7414 jhancock@cumin2003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2337.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART 2478349 wikitext text/x-wiki cucnwm6kpp93ibt2hw1aouv632ow8pm 2478350 2478349 2026-11-05T15:10:52Z Stashbot 7414 stran@deploy2003: Finished scap sync-world: Backport for [[gerrit:1362175|Round 2 on disabling createpage for anonymous users on English Wikibooks (T443449)]], [[gerrit:1364399|Enable Special:SuggestedInvestigations for nlwiki (T443646)]] (duration: 12m 28s) 2478350 wikitext text/x-wiki 4wszyey0f1smhm62sx3yn7cke7cmaxo 2478351 2478350 2026-11-05T15:12:47Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on P{lvs2014.codfw.wmnet} and A:lvs 2478351 wikitext text/x-wiki o7hh248npn8dac7ff07elp7akyl1hx6 2478352 2478351 2026-11-05T15:13:20Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on P{lvs2014.codfw.wmnet} and A:lvs 2478352 wikitext text/x-wiki 1qm40pe8rpp9nj7dynf7piwacq1cqvo 2478353 2478352 2026-11-05T15:13:42Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on P{lvs2013.codfw.wmnet} and A:lvs 2478353 wikitext text/x-wiki hi51r2r2hth2v1dnwskb8ottsvva69o 2478354 2478353 2026-11-05T15:14:28Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on P{lvs2013.codfw.wmnet} and A:lvs 2478354 wikitext text/x-wiki 71zkt14ehkccmlamariisjgprbf4wvg 2478357 2478354 2026-11-05T15:27:01Z Stashbot 7414 sukhe@cumin1004: START - Cookbook sre.dns.admin DNS admin: depool magru [reason: testing DNS admin cookbook changes, no task ID specified] 2478357 wikitext text/x-wiki pavwslwwblkcryqqxlk3ymsrfv6eawf 2478358 2478357 2026-11-05T15:27:09Z Stashbot 7414 sukhe@cumin1004: END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: depool magru [reason: testing DNS admin cookbook changes, no task ID specified] 2478358 wikitext text/x-wiki 4msnr3jtglpt12svtj0ptu8ns52ikwg 2478359 2478358 2026-11-05T15:28:05Z Stashbot 7414 sukhe@cumin1004: START - Cookbook sre.dns.admin DNS admin: pool magru [reason: done testing DNS admin cookbook changes, no task ID specified] 2478359 wikitext text/x-wiki s8dugkf2ao6fp9mvi83x240n2dtn4rk 2478360 2478359 2026-11-05T15:28:07Z Stashbot 7414 sukhe@cumin1004: END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: pool magru [reason: done testing DNS admin cookbook changes, no task ID specified] 2478360 wikitext text/x-wiki claxzpqtegcgf5l5d02wjrldz1m6fcn 2478368 2478360 2026-11-05T16:34:46Z Stashbot 7414 kamila@deploy2003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2478368 wikitext text/x-wiki kyn9flxiwmvkdq6tio2086f723zsz3k 2478369 2478368 2026-11-05T16:35:21Z Stashbot 7414 moritzm: installing krb5 security updates 2478369 wikitext text/x-wiki 2s8pe1h73y56tv93nvcaodrloj3moh1 2478370 2478369 2026-11-05T16:35:38Z Stashbot 7414 kamila@deploy2003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2478370 wikitext text/x-wiki b8mmou7hy5eqkpdx71koo4e53efg5ua 2478371 2478370 2026-11-05T16:37:19Z Stashbot 7414 kamila@deploy2003: Started scap sync-world: switch mw-parsoid to php 8.5 - T439955 2478371 wikitext text/x-wiki eimt0ikymy27lmg7yli4du1i698jl4l 2478372 2478371 2026-11-05T16:40:21Z Stashbot 7414 kamila@deploy2003: Finished scap sync-world: switch mw-parsoid to php 8.5 - T439955 (duration: 03m 03s) 2478372 wikitext text/x-wiki rclw6658lw8nilyfgpo0kma4a9u8w7s 2478373 2478372 2026-11-05T16:40:39Z Stashbot 7414 moritzm: installing krb5 security updates 2478373 wikitext text/x-wiki bs1x4k1o37j2i7ys4xyr5njvori9aov 2478374 2478373 2026-11-05T16:41:03Z Stashbot 7414 kamila@deploy2003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2478374 wikitext text/x-wiki 0j7ncaos92cviospqjv4euuv5nwsax5 2478375 2478374 2026-11-05T16:42:05Z Stashbot 7414 kamila@deploy2003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2478375 wikitext text/x-wiki fsmga1scp7sbaz3k7501zofvs1yk936 2478376 2478375 2026-11-05T16:43:37Z Stashbot 7414 kamila@deploy2003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2478376 wikitext text/x-wiki roq5b3vs9yimpn3k3md62p2pup9it1e 2478377 2478376 2026-11-05T16:44:26Z Stashbot 7414 kamila@deploy2003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2478377 wikitext text/x-wiki lrffhpd4k0kusbye8nmj7es8tzrju3o 2478378 2478377 2026-11-05T16:47:30Z Stashbot 7414 sukhe@cumin1004: START - Cookbook sre.loadbalancer.migrate-service-ipip for role: aux_k8s::worker@eqiad 2478378 wikitext text/x-wiki f7dwmgif4unx0o15ehsnjzi0y4hvktl 2478379 2478378 2026-11-05T16:48:11Z Stashbot 7414 sukhe@cumin1004: END (FAIL) - Cookbook sre.loadbalancer.migrate-service-ipip (exit_code=99) for role: aux_k8s::worker@eqiad 2478379 wikitext text/x-wiki 2x6os14q4rw9rnodywl8sc4byjbh1ia 2478381 2478379 2026-11-05T17:04:27Z Stashbot 7414 fabfur: installing haproxykafka 0.4.0 on cp7002 for testing (T443632) (T443640) 2478381 wikitext text/x-wiki n2hlek2beaiwiz5qxnvykwydk3rswph 2478382 2478381 2026-11-05T17:31:54Z Stashbot 7414 cmooney@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on sretest1006.eqiad.wmnet with reason: need to test things on switch 2478382 wikitext text/x-wiki n23cr8bkhseovhh3hnpma0rx2wps02p 2478383 2478382 2026-11-05T17:32:24Z Stashbot 7414 cmooney@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on lsw1-b3-eqiad with reason: need to test things on switch 2478383 wikitext text/x-wiki co07dn17iavwyy43jfcavf1tzxaoz7t 2478384 2478383 2026-11-05T17:33:04Z Stashbot 7414 cmooney@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on ssw1-a[1,8]-eqiad with reason: need to test things on switch 2478384 wikitext text/x-wiki rh8h7sjbabs02hq7l0z19rke5d4cvsu 2478385 2478384 2026-11-05T17:34:40Z Stashbot 7414 jayme@cumin2003: START - Cookbook sre.hosts.decommission for hosts parsoidtest1001.eqiad.wmnet 2478385 wikitext text/x-wiki 8isbbwg40ughotprnrskqmofuskmm29 2478386 2478385 2026-11-05T17:35:35Z Stashbot 7414 hnowlan@deploy1003: helmfile [staging] START helmfile.d/services/miscweb: apply 2478386 wikitext text/x-wiki 4yusoft4vmcq8nvh33mgbvq4e0e7x0n 2478387 2478386 2026-11-05T17:35:47Z Stashbot 7414 hnowlan@deploy1003: helmfile [staging] DONE helmfile.d/services/miscweb: apply 2478387 wikitext text/x-wiki j7f4ufy1w77h2eb82h2vkgq8y3n86yu 2478388 2478387 2026-11-05T17:39:25Z Stashbot 7414 topranks: reboot lsw1-b3-eqiad to downgrade to SR-Linux 26.3.3 T443687 2478388 wikitext text/x-wiki spcsphm6n6yaridxsqt37h0misplynj 2478389 2478388 2026-11-05T17:40:01Z Stashbot 7414 hnowlan@deploy1003: helmfile [staging-eqiad] START helmfile.d/admin 'apply'. 2478389 wikitext text/x-wiki 40ib0ywizb30zt2bxsmry3krahpg8fe 2478390 2478389 2026-11-05T17:40:14Z Stashbot 7414 jayme@cumin2003: START - Cookbook sre.dns.netbox 2478390 wikitext text/x-wiki 7v6ghth6kx6nr1q521pknkuyxe2kfsk 2478391 2478390 2026-11-05T17:40:42Z Stashbot 7414 hnowlan@deploy1003: helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. 2478391 wikitext text/x-wiki gbnwthx81ps4nwkgd8wd2wldiye0hur 2478392 2478391 2026-11-05T17:43:08Z Stashbot 7414 hnowlan@deploy1003: helmfile [eqiad] START helmfile.d/admin 'apply'. 2478392 wikitext text/x-wiki pcodta6vxy5x1f7ydf82x959ew8ot1i 2478393 2478392 2026-11-05T17:43:41Z Stashbot 7414 hnowlan@deploy1003: helmfile [eqiad] DONE helmfile.d/admin 'apply'. 2478393 wikitext text/x-wiki l3y352jtrqmjloq9ds4g5nbv24b35a0 2478395 2478393 2026-11-05T17:45:04Z Stashbot 7414 jayme@cumin2003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: parsoidtest1001.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - jayme@cumin2003" 2478395 wikitext text/x-wiki tj9vdfrkl2q66cb4uo7gwvjrvauwis8 2478396 2478395 2026-11-05T17:45:24Z Stashbot 7414 hnowlan@deploy1003: helmfile [codfw] START helmfile.d/admin 'apply'. 2478396 wikitext text/x-wiki 846evuq6cx6nnv1sgf7h3ikn22gpcba 2478397 2478396 2026-11-05T17:45:29Z Stashbot 7414 jayme@cumin2003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: parsoidtest1001.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - jayme@cumin2003" 2478397 wikitext text/x-wiki 7j2h30uxvnke0uybmlboeoj0w4odn2s 2478398 2478397 2026-11-05T17:45:30Z Stashbot 7414 jayme@cumin2003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2478398 wikitext text/x-wiki n7if8xk3ejiaae9i3f54rlvq9azs1zv 2478399 2478398 2026-11-05T17:45:32Z Stashbot 7414 jayme@cumin2003: END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts parsoidtest1001.eqiad.wmnet 2478399 wikitext text/x-wiki 4v7y0t3td47ylkgoqsxkhhwzyhbvcbi 2478400 2478399 2026-11-05T17:46:27Z Stashbot 7414 hnowlan@deploy1003: helmfile [codfw] DONE helmfile.d/admin 'apply'. 2478400 wikitext text/x-wiki nspestjzeo8fgr9tow0u3vril2fgqi7 2478401 2478400 2026-11-05T17:51:52Z Stashbot 7414 hnowlan@deploy1003: helmfile [eqiad] START helmfile.d/services/miscweb: apply 2478401 wikitext text/x-wiki r0lqhylkrhv6pewmgivlgp7tigo3mjw 2478402 2478401 2026-11-05T17:52:03Z Stashbot 7414 hnowlan@deploy1003: helmfile [eqiad] DONE helmfile.d/services/miscweb: apply 2478402 wikitext text/x-wiki jy8iisbybhplzidzrkcem5ujruuxrop 2478403 2478402 2026-11-05T17:52:52Z Stashbot 7414 hnowlan@deploy1003: helmfile [codfw] START helmfile.d/services/miscweb: apply 2478403 wikitext text/x-wiki k93gmehu6feb857ahe9h503ezkoja5c 2478404 2478403 2026-11-05T17:53:06Z Stashbot 7414 hnowlan@deploy1003: helmfile [codfw] DONE helmfile.d/services/miscweb: apply 2478404 wikitext text/x-wiki f3of8ejg3ab9cvl3h1cx0glcaaf1q6b 2478406 2478404 2026-11-05T17:59:55Z Stashbot 7414 cmooney@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on lsw1-b3-eqiad IPv6,lsw1-b3-eqiad.mgmt with reason: need to test things on switch 2478406 wikitext text/x-wiki qrspkpvw3tbbpqgjj13lf6ix26qic44 2478407 2478406 2026-11-05T18:03:49Z Stashbot 7414 ladsgroup@deploy2003: Started scap sync-world: Push small changes for error pages 2478407 wikitext text/x-wiki a1qs4q5fa9mb8q33tedpc5rehnpcbe4 2478408 2478407 2026-11-05T18:04:55Z Stashbot 7414 ladsgroup@deploy2003: ladsgroup: Push small changes for error pages synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2478408 wikitext text/x-wiki q5rh0c2qbnrspa51rng9zwxfnz2otx1 2478410 2478408 2026-11-05T18:06:42Z Stashbot 7414 ladsgroup@deploy2003: ladsgroup: Continuing with deployment 2478410 wikitext text/x-wiki r6mdi57cc4jhnvmsxk9bv75tt8nmdjn 2478411 2478410 2026-11-05T18:08:11Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2154.codfw.wmnet with reason: Maintenance 2478411 wikitext text/x-wiki ooyemp24grt15yo9s3hmwdjhgl0t884 2478412 2478411 2026-11-05T18:08:13Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db2154 (T441633)', diff saved to https://phabricator.wikimedia.org/P97377 and previous config saved to /var/cache/conftool/dbconfig/20261105-180812-ladsgroup.json 2478412 wikitext text/x-wiki geenpmdyrvtxrnqzrwwqabn9rl9a952 2478413 2478412 2026-11-05T18:08:48Z Stashbot 7414 ladsgroup@deploy2003: Finished scap sync-world: Push small changes for error pages (duration: 05m 08s) 2478413 wikitext text/x-wiki 0g297jgaph7isu68glf4owz9mu6obg0 2478416 2478413 2026-11-05T18:13:24Z Stashbot 7414 dancy@deploy2003: Started scap sync-world: Testing T411063 2478416 wikitext text/x-wiki 5alywtq5hzf9tbuvff6402n8pa54v54 2478417 2478416 2026-11-05T18:15:25Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2154 (T441633)', diff saved to https://phabricator.wikimedia.org/P97378 and previous config saved to /var/cache/conftool/dbconfig/20261105-181524-ladsgroup.json 2478417 wikitext text/x-wiki r999za2llyr9j3kk7yrrv57xxzxjuon 2478418 2478417 2026-11-05T18:25:27Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2154', diff saved to https://phabricator.wikimedia.org/P97379 and previous config saved to /var/cache/conftool/dbconfig/20261105-182526-ladsgroup.json 2478418 wikitext text/x-wiki 0cob8xy2v7bewbtaabsew5512u3n6vo 2478420 2478418 2026-11-05T18:31:13Z Stashbot 7414 bd808@deploy2003: helmfile [staging] START helmfile.d/services/developer-portal: apply 2478420 wikitext text/x-wiki r71dpt43aiclm8kevku2m5qfs2pq2e8 2478421 2478420 2026-11-05T18:31:34Z Stashbot 7414 bd808@deploy2003: helmfile [staging] DONE helmfile.d/services/developer-portal: apply 2478421 wikitext text/x-wiki pl75zxmesmvl05tmx92cz74adix9jp3 2478422 2478421 2026-11-05T18:31:50Z Stashbot 7414 bd808@deploy2003: helmfile [codfw] START helmfile.d/services/developer-portal: apply 2478422 wikitext text/x-wiki 80ja510gt12tt6hm9v9iz6192sresos 2478423 2478422 2026-11-05T18:32:08Z Stashbot 7414 bd808@deploy2003: helmfile [codfw] DONE helmfile.d/services/developer-portal: apply 2478423 wikitext text/x-wiki 85shslei05zj9zfuar6e6uczqiad51d 2478424 2478423 2026-11-05T18:32:19Z Stashbot 7414 bd808@deploy2003: helmfile [eqiad] START helmfile.d/services/developer-portal: apply 2478424 wikitext text/x-wiki 8bthb1vudomd2ldk1p2xrf3olizjvhy 2478425 2478424 2026-11-05T18:32:34Z Stashbot 7414 bd808@deploy2003: helmfile [eqiad] DONE helmfile.d/services/developer-portal: apply 2478425 wikitext text/x-wiki ttx2gjrulb1crtsbt4lmjabwcnsz1qg 2478426 2478425 2026-11-05T18:35:23Z Stashbot 7414 dancy@deploy2003: dancy: Testing T411063 synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2478426 wikitext text/x-wiki blw8um5rgci5c505vdxx0fckxw4x3l1 2478427 2478426 2026-11-05T18:35:29Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2154', diff saved to https://phabricator.wikimedia.org/P97380 and previous config saved to /var/cache/conftool/dbconfig/20261105-183527-ladsgroup.json 2478427 wikitext text/x-wiki 9zglfy187lwotpqbdeveqn91fs7cjul 2478429 2478427 2026-11-05T18:42:34Z Stashbot 7414 dancy@deploy2003: dancy: Continuing with deployment 2478429 wikitext text/x-wiki 4w4fu0zipmu8su4hxff88vc440svudg 2478430 2478429 2026-11-05T18:45:31Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2154 (T441633)', diff saved to https://phabricator.wikimedia.org/P97381 and previous config saved to /var/cache/conftool/dbconfig/20261105-184529-ladsgroup.json 2478430 wikitext text/x-wiki 9wfuudf07o4lzg1b6l5dndlpm85ogxm 2478431 2478430 2026-11-05T18:45:49Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2163.codfw.wmnet with reason: Maintenance 2478431 wikitext text/x-wiki gds2anq4406wc8sismm1qinzfipc29z 2478432 2478431 2026-11-05T18:45:52Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db2163 (T441633)', diff saved to https://phabricator.wikimedia.org/P97382 and previous config saved to /var/cache/conftool/dbconfig/20261105-184550-ladsgroup.json 2478432 wikitext text/x-wiki 380shflemj0t99s38iwzyj1s87ktdhx 2478433 2478432 2026-11-05T18:54:10Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.network.tls for network device lsw1-b3-eqiad 2478433 wikitext text/x-wiki bfb5k55kdbygolqia5j3gknytk09gkb 2478434 2478433 2026-11-05T18:54:12Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2163 (T441633)', diff saved to https://phabricator.wikimedia.org/P97383 and previous config saved to /var/cache/conftool/dbconfig/20261105-185411-ladsgroup.json 2478434 wikitext text/x-wiki q7p0a55q9ri1q1ntugnf4yo0tn83ia7 2478435 2478434 2026-11-05T18:54:30Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-b3-eqiad 2478435 wikitext text/x-wiki c77pyzxa4gk1epm93s8jg9jy6v68suf 2478436 2478435 2026-11-05T18:57:33Z Stashbot 7414 dancy@deploy2003: Finished scap sync-world: Testing T411063 (duration: 44m 09s) 2478436 wikitext text/x-wiki mbbv5vgeg2porwu9itwktrdyzfjzpxm 2478437 2478436 2026-11-05T19:04:13Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2163', diff saved to https://phabricator.wikimedia.org/P97384 and previous config saved to /var/cache/conftool/dbconfig/20261105-190412-ladsgroup.json 2478437 wikitext text/x-wiki jepbgyc6bfk0zolpu6zq5ejwkwwpvim 2478438 2478437 2026-11-05T19:10:38Z Stashbot 7414 bd808@deploy2003: helmfile [staging] START helmfile.d/services/toolhub: apply 2478438 wikitext text/x-wiki ow6mt6dx55usaksxq4hdilw4eof4ul2 2478439 2478438 2026-11-05T19:11:11Z Stashbot 7414 bd808@deploy2003: helmfile [staging] DONE helmfile.d/services/toolhub: apply 2478439 wikitext text/x-wiki 2lhb904tze8cxkynqs6vmajqw9elyxj 2478440 2478439 2026-11-05T19:12:06Z Stashbot 7414 bd808@deploy2003: helmfile [codfw] START helmfile.d/services/toolhub: apply 2478440 wikitext text/x-wiki h3l5kqmso50it1lwxr99grfxvwb3wh0 2478441 2478440 2026-11-05T19:12:54Z Stashbot 7414 bd808@deploy2003: helmfile [codfw] DONE helmfile.d/services/toolhub: apply 2478441 wikitext text/x-wiki 4yvpsx3zyyc8byowgeesmi18xe7i0fd 2478442 2478441 2026-11-05T19:13:51Z Stashbot 7414 bd808@deploy2003: helmfile [eqiad] START helmfile.d/services/toolhub: apply 2478442 wikitext text/x-wiki s09zuxvumw0zy66ax828n8w4j882olx 2478443 2478442 2026-11-05T19:14:15Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2163', diff saved to https://phabricator.wikimedia.org/P97385 and previous config saved to /var/cache/conftool/dbconfig/20261105-191414-ladsgroup.json 2478443 wikitext text/x-wiki jcwomfijitc4jhnh5yo9edly1nfj95p 2478444 2478443 2026-11-05T19:14:43Z Stashbot 7414 bd808@deploy2003: helmfile [eqiad] DONE helmfile.d/services/toolhub: apply 2478444 wikitext text/x-wiki mwgnu0pux2xe2uwytiozhygd7c0fxu4 2478445 2478444 2026-11-05T19:24:17Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2163 (T441633)', diff saved to https://phabricator.wikimedia.org/P97386 and previous config saved to /var/cache/conftool/dbconfig/20261105-192416-ladsgroup.json 2478445 wikitext text/x-wiki trwn5h07506s62avmxtbrycv0gt6lh1 2478446 2478445 2026-11-05T19:24:25Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2164.codfw.wmnet with reason: Maintenance 2478446 wikitext text/x-wiki 1i1r699sdxpgxgbdc376b6aulfou26h 2478447 2478446 2026-11-05T19:24:28Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db2164 (T441633)', diff saved to https://phabricator.wikimedia.org/P97387 and previous config saved to /var/cache/conftool/dbconfig/20261105-192426-ladsgroup.json 2478447 wikitext text/x-wiki b51npgcbieu37v0xsxghkagt1rvla1y 2478448 2478447 2026-11-05T19:31:46Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2164 (T441633)', diff saved to https://phabricator.wikimedia.org/P97388 and previous config saved to /var/cache/conftool/dbconfig/20261105-193144-ladsgroup.json 2478448 wikitext text/x-wiki nja1zt0svtz47s31wrsr2tr21f98a3f 2478449 2478448 2026-11-05T19:41:48Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2164', diff saved to https://phabricator.wikimedia.org/P97389 and previous config saved to /var/cache/conftool/dbconfig/20261105-194146-ladsgroup.json 2478449 wikitext text/x-wiki 1l80c7e46q8vkk4i5bc1iboqm3hrcdk 2478451 2478449 2026-11-05T19:51:49Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2164', diff saved to https://phabricator.wikimedia.org/P97390 and previous config saved to /var/cache/conftool/dbconfig/20261105-195148-ladsgroup.json 2478451 wikitext text/x-wiki kwuozlkaqg35xhwisbma3shagimkwce 2478452 2478451 2026-11-05T19:55:52Z Stashbot 7414 bking@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/matomo-next: apply 2478452 wikitext text/x-wiki cxgw16sdo32bdacuneoue79rjnkxmhu 2478453 2478452 2026-11-05T19:56:04Z Stashbot 7414 bking@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/matomo-next: apply 2478453 wikitext text/x-wiki 1u2lk7kjl3mlg785v1ltxxenkeo1qux 2478454 2478453 2026-11-05T20:01:52Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2164 (T441633)', diff saved to https://phabricator.wikimedia.org/P97391 and previous config saved to /var/cache/conftool/dbconfig/20261105-200150-ladsgroup.json 2478454 wikitext text/x-wiki bd9fsk51d8rtpfqbtpw0wgs3o2nueau 2478455 2478454 2026-11-05T20:02:11Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2165.codfw.wmnet with reason: Maintenance 2478455 wikitext text/x-wiki cfgxy5me68qbp47dl4gmm9vu6ifacpw 2478456 2478455 2026-11-05T20:02:13Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db2165 (T441633)', diff saved to https://phabricator.wikimedia.org/P97392 and previous config saved to /var/cache/conftool/dbconfig/20261105-200211-ladsgroup.json 2478456 wikitext text/x-wiki 2290wi02hd6jhb683uhx40325xgl9v3 2478459 2478456 2026-11-05T20:05:33Z Stashbot 7414 bking@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/matomo-next: apply 2478459 wikitext text/x-wiki 2p9zfcec3554rrnxj4d1q3bbvq4qyq5 2478460 2478459 2026-11-05T20:06:22Z Stashbot 7414 bking@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/matomo-next: apply 2478460 wikitext text/x-wiki ix7zpv3hkr6k0bcice728afju1uij3x 2478461 2478460 2026-11-05T20:09:12Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2165 (T441633)', diff saved to https://phabricator.wikimedia.org/P97393 and previous config saved to /var/cache/conftool/dbconfig/20261105-200911-ladsgroup.json 2478461 wikitext text/x-wiki t2t8il4yuerhrkpu4hvelfqnjxp6lex 2478462 2478461 2026-11-05T20:19:14Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2165', diff saved to https://phabricator.wikimedia.org/P97394 and previous config saved to /var/cache/conftool/dbconfig/20261105-201913-ladsgroup.json 2478462 wikitext text/x-wiki kvv2gkuuzmovd9oo8prkp14xx6zoly9 2478463 2478462 2026-11-05T20:29:16Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2165', diff saved to https://phabricator.wikimedia.org/P97395 and previous config saved to /var/cache/conftool/dbconfig/20261105-202915-ladsgroup.json 2478463 wikitext text/x-wiki t8fpfiftn90zel4vg3tps4r58fgp4yz 2478465 2478463 2026-11-05T20:39:15Z Stashbot 7414 cmooney@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on lvs1019.eqiad.wmnet with reason: failover lvs1019 to lvs1020 to add new vlan sub-ints 2478465 wikitext text/x-wiki bxsev26db6plveh8mbupbf5qyrwttuf 2478466 2478465 2026-11-05T20:39:19Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2165 (T441633)', diff saved to https://phabricator.wikimedia.org/P97396 and previous config saved to /var/cache/conftool/dbconfig/20261105-203917-ladsgroup.json 2478466 wikitext text/x-wiki l06duw7leod9blza7jypatavqi0bklw 2478467 2478466 2026-11-05T20:39:37Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2166.codfw.wmnet with reason: Maintenance 2478467 wikitext text/x-wiki s2efn4rkb0c2wniu0pi5udpp1psnito 2478468 2478467 2026-11-05T20:39:39Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db2166 (T441633)', diff saved to https://phabricator.wikimedia.org/P97397 and previous config saved to /var/cache/conftool/dbconfig/20261105-203938-ladsgroup.json 2478468 wikitext text/x-wiki pltmsctodqn570t84w166kojjvc1tpa 2478469 2478468 2026-11-05T20:44:29Z Stashbot 7414 topranks: disable pybal service on lvs1019 to failover to lvs1020 ahead of adding new vlan ints to the former T440859 2478469 wikitext text/x-wiki 2ey7nw1b6t6hyyw314scn3buwf4uahp 2478470 2478469 2026-11-05T20:46:43Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2166 (T441633)', diff saved to https://phabricator.wikimedia.org/P97398 and previous config saved to /var/cache/conftool/dbconfig/20261105-204641-ladsgroup.json 2478470 wikitext text/x-wiki njb6j55pishig6932ai4y9sy0gs5rp5 2478472 2478470 2026-11-05T20:56:39Z Stashbot 7414 James_F: mwscript sql.php --wiki=wikifunctionswiki --cluster extension1 extensions/WikiLambda/sql/mysql/table-abstractwiki_integrations.sql # T443295 2478472 wikitext text/x-wiki pu3l2vlh53ocg00ifz0mwptnbpjuaqs 2478473 2478472 2026-11-05T20:56:44Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2166', diff saved to https://phabricator.wikimedia.org/P97399 and previous config saved to /var/cache/conftool/dbconfig/20261105-205643-ladsgroup.json 2478473 wikitext text/x-wiki 57311x59qhkt39bff3szcfjzfa0pate 2478476 2478473 2026-11-05T21:06:46Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2166', diff saved to https://phabricator.wikimedia.org/P97400 and previous config saved to /var/cache/conftool/dbconfig/20261105-210645-ladsgroup.json 2478476 wikitext text/x-wiki 8d7cctrzjid8fujyn8zfuwj63fpmse6 2478477 2478476 2026-11-05T21:08:09Z Stashbot 7414 kemayo@deploy2003: Started scap sync-world: Backport for [[gerrit:1364770|VisualEditor: Precompute edit suggestion counts on 25% of jawiki + 5% of arwiki (T442767)]], [[gerrit:1340815|Add new namespace for zh_min_nanwiki (T430731)]] 2478477 wikitext text/x-wiki d0jyc0nc4n2009hj2tzl8jt378r7o2r 2478479 2478477 2026-11-05T21:14:01Z Stashbot 7414 kemayo@deploy2003: pppery, kemayo: Backport for [[gerrit:1364770|VisualEditor: Precompute edit suggestion counts on 25% of jawiki + 5% of arwiki (T442767)]], [[gerrit:1340815|Add new namespace for zh_min_nanwiki (T430731)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2478479 wikitext text/x-wiki 3ew27eo1r0pzhfhqme9pupk3c2u3dea 2478480 2478479 2026-11-05T21:15:32Z Stashbot 7414 kemayo@deploy2003: pppery, kemayo: Continuing with deployment 2478480 wikitext text/x-wiki exhluv2iv8zgmvpt1a53ff5trnyu12i 2478481 2478480 2026-11-05T21:16:48Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2166 (T441633)', diff saved to https://phabricator.wikimedia.org/P97401 and previous config saved to /var/cache/conftool/dbconfig/20261105-211647-ladsgroup.json 2478481 wikitext text/x-wiki fftrmgnsy7yv1z93dywbd05xf1yswaj 2478482 2478481 2026-11-05T21:17:07Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2167.codfw.wmnet with reason: Maintenance 2478482 wikitext text/x-wiki bek141ad24wcwg6k0kejul5ivmuezjs 2478483 2478482 2026-11-05T21:17:10Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db2167 (T441633)', diff saved to https://phabricator.wikimedia.org/P97402 and previous config saved to /var/cache/conftool/dbconfig/20261105-211708-ladsgroup.json 2478483 wikitext text/x-wiki dlvhg03jl7baaa8cw5bchekhkz45lmx 2478484 2478483 2026-11-05T21:19:51Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.hosts.reboot-single for host lvs1019.eqiad.wmnet 2478484 wikitext text/x-wiki kmqv3uv2zxuzkv3femv7hhbdzvfq0gv 2478485 2478484 2026-11-05T21:24:30Z Stashbot 7414 kemayo@deploy2003: Finished scap sync-world: Backport for [[gerrit:1364770|VisualEditor: Precompute edit suggestion counts on 25% of jawiki + 5% of arwiki (T442767)]], [[gerrit:1340815|Add new namespace for zh_min_nanwiki (T430731)]] (duration: 16m 22s) 2478485 wikitext text/x-wiki iz06ty12feto90bczfmynu773gawmwz 2478486 2478485 2026-11-05T21:24:33Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2167 (T441633)', diff saved to https://phabricator.wikimedia.org/P97403 and previous config saved to /var/cache/conftool/dbconfig/20261105-212426-ladsgroup.json 2478486 wikitext text/x-wiki fuxx9w8q9cv3wluiig0tyk5g4gbq09s 2478488 2478486 2026-11-05T21:26:44Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host lvs1019.eqiad.wmnet 2478488 wikitext text/x-wiki iqucrz5gr8npvdlcqi75ztwl4mnlo1f 2478489 2478488 2026-11-05T21:28:30Z Stashbot 7414 kemayo@deploy2003: mwscript-k8s job started: namespaceDupes zh_min_nanwiki --fix # T430731 2478489 wikitext text/x-wiki mltpsumvwha5bga47yv1lfryg58usez 2478490 2478489 2026-11-05T21:30:42Z Stashbot 7414 topranks: re-enable BGP for pybal on lvs1019 to fail back from lvs1020 after vlan add T440859 2478490 wikitext text/x-wiki 4p2xt6skd5aomua00pah2bswgyb6439 2478492 2478490 2026-11-05T21:33:50Z Stashbot 7414 ssastry@deploy2003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2478492 wikitext text/x-wiki ir2mj90cc6lwwlkiknxnn82o06d313m 2478493 2478492 2026-11-05T21:34:29Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2167', diff saved to https://phabricator.wikimedia.org/P97405 and previous config saved to /var/cache/conftool/dbconfig/20261105-213428-ladsgroup.json 2478493 wikitext text/x-wiki pxbeenw4qsjxclcswchl9j2crl0ecaw 2478494 2478493 2026-11-05T21:34:33Z Stashbot 7414 ssastry@deploy2003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2478494 wikitext text/x-wiki 7ql0gogub4qg89aup048e0193ghxp1c 2478498 2478494 2026-11-05T21:44:31Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2167', diff saved to https://phabricator.wikimedia.org/P97406 and previous config saved to /var/cache/conftool/dbconfig/20261105-214430-ladsgroup.json 2478498 wikitext text/x-wiki ptt33mwj4i7riy02jtlcfvw5js65rrl 2478499 2478498 2026-11-05T21:51:41Z Stashbot 7414 mutante: ci / contint1003/contint2003 - docker will be reconfigured to use containerd-snapshotter rather than dockers legacy store, overlay2 (a thing docker has been moving towards for a while). images pulled under layer2 become invisible on next docker restart. releng will handle that and prune the old images. new images will have to be pulled down. needed for ST6.1.4 (T440668) 2478499 wikitext text/x-wiki 25yxksynsgp0vlyk71uuzjx3v6q550m 2478500 2478499 2026-11-05T21:54:33Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2167 (T441633)', diff saved to https://phabricator.wikimedia.org/P97407 and previous config saved to /var/cache/conftool/dbconfig/20261105-215432-ladsgroup.json 2478500 wikitext text/x-wiki i9wopn19c0iwukizpxxxcrcpflb0ud1 2478501 2478500 2026-11-05T21:54:53Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2181.codfw.wmnet with reason: Maintenance 2478501 wikitext text/x-wiki nnb2y1njjue6qxybzwlrtnvjufvaxyn 2478502 2478501 2026-11-05T21:54:56Z Stashbot 7414 mutante: ci / contint1003/contint2003 - if "sudo docker info -f '{{.Driver}}'" says "overlay2" it's the classic way. after restart when it says "overlayfs2" that will be the NEW way! (T440668) 2478502 wikitext text/x-wiki qhta1guh7t53nc6vptnj216fyk9hcvn 2478503 2478502 2026-11-05T21:54:57Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db2181 (T441633)', diff saved to https://phabricator.wikimedia.org/P97408 and previous config saved to /var/cache/conftool/dbconfig/20261105-215453-ladsgroup.json 2478503 wikitext text/x-wiki n9g7kevzsjjniok5hl3dl6fwgfauik5 2478504 2478503 2026-11-05T22:01:14Z Stashbot 7414 egardner@deploy2003: Started scap sync-world: Backport for [[gerrit:1358851|Add Creative Commons license icons for the share card (T439162)]] 2478504 wikitext text/x-wiki o1vpmpo6hdr6ivdqi05y3y15kmng87u 2478505 2478504 2026-11-05T22:02:21Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2181 (T441633)', diff saved to https://phabricator.wikimedia.org/P97409 and previous config saved to /var/cache/conftool/dbconfig/20261105-220220-ladsgroup.json 2478505 wikitext text/x-wiki aahaotriz7j8derkpo3uvc6wj2wzw95 2478508 2478505 2026-11-05T22:07:37Z Stashbot 7414 egardner@deploy2003: egardner: Backport for [[gerrit:1358851|Add Creative Commons license icons for the share card (T439162)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2478508 wikitext text/x-wiki 0aqcrvzes1u752jdvxzstkfol00305b 2478509 2478508 2026-11-05T22:08:03Z Stashbot 7414 egardner@deploy2003: egardner: Continuing with deployment 2478509 wikitext text/x-wiki jjq5r0pwv9jr5n8tbcimk3tf2yc9yv1 2478516 2478509 2026-11-05T22:12:23Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2181', diff saved to https://phabricator.wikimedia.org/P97410 and previous config saved to /var/cache/conftool/dbconfig/20261105-221221-ladsgroup.json 2478516 wikitext text/x-wiki pu8l8gzjsvwc80gvh9xfcwzqxbwl9tg 2478517 2478516 2026-11-05T22:15:34Z Stashbot 7414 egardner@deploy2003: Finished scap sync-world: Backport for [[gerrit:1358851|Add Creative Commons license icons for the share card (T439162)]] (duration: 14m 19s) 2478517 wikitext text/x-wiki m5f2j9jr73egt1wsgbpxhn0qa9426fz 2478518 2478517 2026-11-05T22:19:14Z Stashbot 7414 egardner@deploy2003: Started scap sync-world: Backport for [[gerrit:1364473|ShareCard: Log client errors with the topic "error.sharecard" (T439163)]] (1.48.0-wmf.3), [[gerrit:1363474|ShareCard: Show animated GIFs as a still image (T442968)]] (1.48.0-wmf.3) 2478518 wikitext text/x-wiki mt1cr1apbgh2k2t2wfa0l0elcpqpmnn 2478520 2478518 2026-11-05T22:22:18Z Stashbot 7414 ssastry@deploy2003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2478520 wikitext text/x-wiki nkpq3wtmmeor43nf470kyxcskgddy2p 2478521 2478520 2026-11-05T22:22:25Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2181', diff saved to https://phabricator.wikimedia.org/P97411 and previous config saved to /var/cache/conftool/dbconfig/20261105-222223-ladsgroup.json 2478521 wikitext text/x-wiki 1tne1wenri6f6wlwob874l7owax850y 2478522 2478521 2026-11-05T22:22:51Z Stashbot 7414 ssastry@deploy2003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2478522 wikitext text/x-wiki nxu170o5bzfgzrb68oh6jce82fm7pz4 2478523 2478522 2026-11-05T22:23:32Z Stashbot 7414 egardner@deploy2003: egardner: Backport for [[gerrit:1364473|ShareCard: Log client errors with the topic "error.sharecard" (T439163)]] (1.48.0-wmf.3), [[gerrit:1363474|ShareCard: Show animated GIFs as a still image (T442968)]] (1.48.0-wmf.3) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2478523 wikitext text/x-wiki 28rvorbc3nw66kh1h6dk8ntzs1zgj05 2478524 2478523 2026-11-05T22:24:07Z Stashbot 7414 egardner@deploy2003: egardner: Continuing with deployment 2478524 wikitext text/x-wiki b8x8a28bva60fmjey5e1mjrydtapi29 2478526 2478524 2026-11-05T22:31:00Z Stashbot 7414 egardner@deploy2003: Finished scap sync-world: Backport for [[gerrit:1364473|ShareCard: Log client errors with the topic "error.sharecard" (T439163)]] (1.48.0-wmf.3), [[gerrit:1363474|ShareCard: Show animated GIFs as a still image (T442968)]] (1.48.0-wmf.3) (duration: 11m 46s) 2478526 wikitext text/x-wiki q0wf3p2mwmp623wgqfskxdugt7m1rhj 2478527 2478526 2026-11-05T22:32:27Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2181 (T441633)', diff saved to https://phabricator.wikimedia.org/P97412 and previous config saved to /var/cache/conftool/dbconfig/20261105-223225-ladsgroup.json 2478527 wikitext text/x-wiki 4agfzsge0v66ua5mtlrzz4dv9trp08s 2478528 2478527 2026-11-05T22:32:47Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2195.codfw.wmnet with reason: Maintenance 2478528 wikitext text/x-wiki dlxp3re9cy44svokm6sn8w05ft3c5ip 2478529 2478528 2026-11-05T22:32:49Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db2195 (T441633)', diff saved to https://phabricator.wikimedia.org/P97413 and previous config saved to /var/cache/conftool/dbconfig/20261105-223248-ladsgroup.json 2478529 wikitext text/x-wiki 3w8lrf5ejo8lfykrei5t3jrip644vqm 2478530 2478529 2026-11-05T22:39:58Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2195 (T441633)', diff saved to https://phabricator.wikimedia.org/P97414 and previous config saved to /var/cache/conftool/dbconfig/20261105-223956-ladsgroup.json 2478530 wikitext text/x-wiki 6u17vc0q7jpa7wpi2f200sb4n9p9uxt 2478533 2478530 2026-11-05T22:50:00Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2195', diff saved to https://phabricator.wikimedia.org/P97415 and previous config saved to /var/cache/conftool/dbconfig/20261105-224958-ladsgroup.json 2478533 wikitext text/x-wiki 0vw6hdipyclx8klxty4gyzwwbd4e6cx 2478534 2478533 2026-11-05T22:51:26Z Stashbot 7414 sbassett: Deployed security fixes for T439878, T440323, T440657, T440656, T440655 2478534 wikitext text/x-wiki iodi7gxjezgkyhdrb6rlwe6q7mc2vsv 2478535 2478534 2026-11-05T23:00:01Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2195', diff saved to https://phabricator.wikimedia.org/P97416 and previous config saved to /var/cache/conftool/dbconfig/20261105-230000-ladsgroup.json 2478535 wikitext text/x-wiki go12lrn6hoxdco0w2nwqxkqxzwtwc3s 2478537 2478535 2026-11-05T23:10:03Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2195 (T441633)', diff saved to https://phabricator.wikimedia.org/P97417 and previous config saved to /var/cache/conftool/dbconfig/20261105-231002-ladsgroup.json 2478537 wikitext text/x-wiki 6wkowf0i05htztziczlhqzuchxpowhw 2478538 2478537 2026-11-05T23:10:23Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2198.codfw.wmnet with reason: Maintenance 2478538 wikitext text/x-wiki iys8zpgv1r9kxv76eiosx60fu24cstn 2478539 2478538 2026-11-05T23:18:41Z Stashbot 7414 maryum: Deployed security fix for T443424, T443467, T443036 2478539 wikitext text/x-wiki k2u7ci4v5exjpszq4ufxde85v7vykks 2478542 2478539 2026-11-05T23:30:07Z Stashbot 7414 mutante: codesearch2001 initial repo pull from github. codesearch1001 temp puppet disabled for careful rollout. 2478542 wikitext text/x-wiki o96z3t026vidon0wd5fk9m6jt7bj52h 2478546 2478542 2026-11-06T00:00:07Z Stashbot 7414 root@deploy2003: helmfile [codfw] START helmfile.d/services/shellbox-timeline: sync 2478546 wikitext text/x-wiki po74l109orajuy3udbuqificy686fdd 2478547 2478546 2026-11-06T00:00:14Z Stashbot 7414 root@deploy2003: helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: sync 2478547 wikitext text/x-wiki be59nmq7ocmr7g6spms8cfu9m4gjowe 2478576 2478547 2026-11-06T06:52:58Z Stashbot 7414 XioNoX: push pfw policies - T443852 2478576 wikitext text/x-wiki q9lxisqiy89165kouysc3yh2soius87 2478585 2478576 2026-11-06T08:47:55Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.swift.roll-restart-reboot-swift-thanos-proxies rolling restart_daemons on A:thanos-fe 2478585 wikitext text/x-wiki 2frn2xytu3oifphv01xwv2rgzk418d2 2478586 2478585 2026-11-06T08:48:05Z Stashbot 7414 mvernon@cumin1004: START - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies rolling restart_daemons on A:swift-fe 2478586 wikitext text/x-wiki 17hjz1fxhrbwm7cmya3gt37hdfr8tor 2478587 2478586 2026-11-06T08:52:06Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-thanos-proxies (exit_code=0) rolling restart_daemons on A:thanos-fe 2478587 wikitext text/x-wiki huxusn70cufbxvq5rg0kdifa25fb1pb 2478588 2478587 2026-11-06T08:53:24Z Stashbot 7414 jelto@deploy2003: Started scap deploy-service miscweb-aux: Deploy to fix T443826 2478588 wikitext text/x-wiki 289hpp4tvtc3ftsxu9pr4diam1r8sof 2478589 2478588 2026-11-06T08:53:25Z Stashbot 7414 jelto@deploy2003: scap deploy-service miscweb-aux: [PRODUCTION/DEFAULT] aux-k8s-eqiad Deploying miscweb 2478589 wikitext text/x-wiki gk80el6165e3q2ewymd1z7pheinggca 2478590 2478589 2026-11-06T08:56:06Z Stashbot 7414 jelto@deploy2003: scap deploy-service miscweb-aux: [PRODUCTION/DEFAULT] aux-k8s-codfw Deploying miscweb 2478590 wikitext text/x-wiki mywjapgjfivlejfjf4j26u1cvdwv6r4 2478591 2478590 2026-11-06T08:57:35Z Stashbot 7414 jelto@deploy2003: Finished scap deploy-service miscweb-aux: Deploy to fix T443826 (duration: 04m 11s) 2478591 wikitext text/x-wiki t3q1lizupjj0qbg7rwywlam5zcs0ru9 2478592 2478591 2026-11-06T09:04:07Z Stashbot 7414 mvernon@cumin1004: END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies (exit_code=0) rolling restart_daemons on A:swift-fe 2478592 wikitext text/x-wiki 3prwdrfz5hxbqg49y3gobry4s9upnhr 2478594 2478592 2026-11-06T10:08:31Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox-canary 2478594 wikitext text/x-wiki s8jkjmpys4odagwqdlxaspvh19yg2fm 2478595 2478594 2026-11-06T10:11:52Z Stashbot 7414 fabfur@cumin1004: conftool action : set/pooled=yes; selector: dc=magru,cluster=dnsbox 2478595 wikitext text/x-wiki 1787kkd1arqu6f41rbhqr01qexwiqmh 2478599 2478595 2026-11-06T10:16:04Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox-canary 2478599 wikitext text/x-wiki sy1rhdg98yqh2nlur41ap4jua2qehul 2478600 2478599 2026-11-06T10:16:13Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox 2478600 wikitext text/x-wiki qecr2llbc7pxe5x40ufk1z0c4i3i7h5 2478601 2478600 2026-11-06T10:16:41Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox 2478601 wikitext text/x-wiki s439vyb4k6yvypjyd6c6gvncj3kggj4 2478602 2478601 2026-11-06T10:29:14Z Stashbot 7414 marostegui: Limit icinga db user connections to 10 in ms* and pc* T442995 2478602 wikitext text/x-wiki l4rkg1lwl0276teq069hq4lvmzdz50a 2478603 2478602 2026-11-06T10:31:15Z Stashbot 7414 jelto@deploy2003: Started scap deploy-service miscweb-aux: Deploy to fix T443357 2478603 wikitext text/x-wiki o7mtkwbrggbsnmfc9yu0m863shrpc80 2478604 2478603 2026-11-06T10:31:17Z Stashbot 7414 jelto@deploy2003: scap deploy-service miscweb-aux: [PRODUCTION/DEFAULT] aux-k8s-eqiad Deploying miscweb 2478604 wikitext text/x-wiki rp3gsxivq6za4ukiuhkgt5g5u7a8wo0 2478609 2478604 2026-11-06T10:33:40Z Stashbot 7414 jelto@deploy2003: scap deploy-service miscweb-aux: [PRODUCTION/DEFAULT] aux-k8s-codfw Deploying miscweb 2478609 wikitext text/x-wiki 86pe0spvmf129ndijxmvbok129oqkuh 2478610 2478609 2026-11-06T10:34:55Z Stashbot 7414 jelto@deploy2003: Finished scap deploy-service miscweb-aux: Deploy to fix T443357 (duration: 03m 39s) 2478610 wikitext text/x-wiki kihmqtf0xzkirf4qegoha6sf9rqs9kq 2478612 2478610 2026-11-06T10:42:28Z Stashbot 7414 effie: depool kartotherian from eqiad (ie maps) - T443438 2478612 wikitext text/x-wiki nug3dsogk79m2pkiy9f42b2ysh2a7d1 2478613 2478612 2026-11-06T10:44:25Z Stashbot 7414 jiji@cumin1004: START - Cookbook sre.discovery.service-route depool kartotherian in eqiad: maintenance 2478613 wikitext text/x-wiki edfpq10ttxccdf59dey2zxw3mhj00ml 2478615 2478613 2026-11-06T10:49:29Z Stashbot 7414 jiji@cumin1004: END (PASS) - Cookbook sre.discovery.service-route (exit_code=0) depool kartotherian in eqiad: maintenance 2478615 wikitext text/x-wiki gkqpg2qeb3gs8a33yhc8mavplhovbu7 2478619 2478615 2026-11-06T11:00:48Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts wdqs1030.eqiad.wmnet 2478619 wikitext text/x-wiki obj7znhuuswewti7lyrz7e88e1dycrj 2478621 2478619 2026-11-06T11:08:03Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reboot-single for host wdqs1030.eqiad.wmnet 2478621 wikitext text/x-wiki 9vvndqbg7pbzhr8xp03i1oyozald89b 2478622 2478621 2026-11-06T11:09:29Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts wdqs2025.codfw.wmnet 2478622 wikitext text/x-wiki ek6q9jge1sa4g2b6idp5d90i8yihkm2 2478623 2478622 2026-11-06T11:09:52Z Stashbot 7414 btullis@cumin1004: END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts wdqs2025.codfw.wmnet 2478623 wikitext text/x-wiki 1dcszvy8g4i1nbip12nervmf8rjefhi 2478625 2478623 2026-11-06T11:18:33Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs1030.eqiad.wmnet 2478625 wikitext text/x-wiki b32hp956h6w3te1pckf3qpx8lc84itk 2478626 2478625 2026-11-06T11:18:35Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts wdqs1030.eqiad.wmnet 2478626 wikitext text/x-wiki qp82u4ktxgbgv56apnylpc3f82cokz6 2478627 2478626 2026-11-06T11:19:01Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts wdqs1031.eqiad.wmnet 2478627 wikitext text/x-wiki 8x74zzw9c7flou6qwpdf065yjp6fdec 2478631 2478627 2026-11-06T11:30:00Z Stashbot 7414 a-pizzata@deploy2003: Started deploy [analytics/refinery@f4aa212] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@f4aa2127] 2478631 wikitext text/x-wiki 5ud48zlpl17lplcevuamtu1y6rgf1s6 2478632 2478631 2026-11-06T11:30:46Z Stashbot 7414 a-pizzata@deploy2003: Finished deploy [analytics/refinery@f4aa212] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@f4aa2127] (duration: 00m 46s) 2478632 wikitext text/x-wiki 36m0rw9f3az7afojaxb9wi1s5rqgf7j 2478633 2478632 2026-11-06T11:31:22Z Stashbot 7414 a-pizzata@deploy2003: Started deploy [analytics/refinery@f4aa212]: Regular analytics weekly train [analytics/refinery@f4aa2127] 2478633 wikitext text/x-wiki 9wnw2bc50rkoyku2xztepwftml476zc 2478634 2478633 2026-11-06T11:31:48Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts wdqs2025.codfw.wmnet 2478634 wikitext text/x-wiki gas9grb2vjbqyemvrykwoees1bm6hja 2478635 2478634 2026-11-06T11:32:26Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reboot-single for host wdqs1031.eqiad.wmnet 2478635 wikitext text/x-wiki ir99f4zwhq1tj4ic3nk164d3ungq86q 2478636 2478635 2026-11-06T11:32:40Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reboot-single for host wdqs2025.codfw.wmnet 2478636 wikitext text/x-wiki j9ol1nmk6iu63mgczbrx97rnrn0ry1k 2478637 2478636 2026-11-06T11:36:12Z Stashbot 7414 a-pizzata@deploy2003: Finished deploy [analytics/refinery@f4aa212]: Regular analytics weekly train [analytics/refinery@f4aa2127] (duration: 04m 50s) 2478637 wikitext text/x-wiki 88wy5qcbp3wkwf81dpd80pc7u28r6d8 2478638 2478637 2026-11-06T11:39:55Z Stashbot 7414 fabfur: installing haproxykafka 0.4.0 on cp7001 for testing (T443632) (T443640) 2478638 wikitext text/x-wiki botmrpt2iemjno6x7gscimvv9l3l2l9 2478639 2478638 2026-11-06T11:42:38Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs1031.eqiad.wmnet 2478639 wikitext text/x-wiki 7pf79m0c8cw8o8m0daeb8e2wa7iwpm9 2478640 2478639 2026-11-06T11:42:39Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts wdqs1031.eqiad.wmnet 2478640 wikitext text/x-wiki 73g4v063n36d99yx3qufprabf1wy87e 2478641 2478640 2026-11-06T11:43:09Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs2025.codfw.wmnet 2478641 wikitext text/x-wiki l2pcipbt3g58sr0hkvhkb05615bf9fp 2478642 2478641 2026-11-06T11:43:10Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts wdqs2025.codfw.wmnet 2478642 wikitext text/x-wiki o17mob1soc5knl9tjllwttvic2d3e4b 2478643 2478642 2026-11-06T11:47:30Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts wdqs1032.eqiad.wmnet 2478643 wikitext text/x-wiki lmm8uwcdgp76s2mzuetsm1059dx7ptl 2478644 2478643 2026-11-06T11:48:28Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reboot-single for host wdqs1032.eqiad.wmnet 2478644 wikitext text/x-wiki 2wvxzof9pylg8h3u9w3kc08it1whocb 2478645 2478644 2026-11-06T11:49:56Z Stashbot 7414 cgoubert@deploy2003: helmfile [aux-k8s-eqiad] START helmfile.d/admin 'apply'. 2478645 wikitext text/x-wiki l0nlogd6j1mrw6p72m6zm45mbqzt975 2478646 2478645 2026-11-06T11:51:38Z Stashbot 7414 cgoubert@deploy2003: helmfile [aux-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2478646 wikitext text/x-wiki ijbcrdgki60lct7fslzyph4sb5niew4 2478647 2478646 2026-11-06T11:52:08Z Stashbot 7414 cgoubert@deploy2003: helmfile [aux-k8s-codfw] START helmfile.d/admin 'apply'. 2478647 wikitext text/x-wiki ajwbm1cbeeutvuye1rsakyoipsd2pjw 2478648 2478647 2026-11-06T11:52:55Z Stashbot 7414 cgoubert@deploy2003: helmfile [aux-k8s-codfw] DONE helmfile.d/admin 'apply'. 2478648 wikitext text/x-wiki buffd103m0k6lxgo8b5otijzzfe9ots 2478649 2478648 2026-11-06T11:58:02Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host wdqs1032.eqiad.wmnet 2478649 wikitext text/x-wiki gty2xduamhnyztbags4dhm17dlfsjkv 2478650 2478649 2026-11-06T11:58:03Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts wdqs1032.eqiad.wmnet 2478650 wikitext text/x-wiki eyq7plsbquw1svyyzbnj3qlwvk1a2v9 0 17290 2478394 2477982 2026-11-05T17:43:55Z Stashbot 7414 dduvall: creating new integration-agent-docker-9998 trixie based instances/agent to replace integration-agent-docker-9999 (T440670) 2478394 wikitext text/x-wiki 6jodkcqgh7v3b8fhct6xpikavr83o2r 2478474 2478394 2026-11-05T20:58:31Z Stashbot 7414 dduvall: deleting integration-agent-docker-9999 following replacement (T440670) 2478474 wikitext text/x-wiki rwnc8ktrp3zedsfup0ciu7110u9otl7 2478475 2478474 2026-11-05T21:05:44Z Stashbot 7414 dduvall: creating integration-agent-qemu-1005 trixie based agent to replace integration-agent-qemu-1004 (T440670) 2478475 wikitext text/x-wiki 0t1k6ao4gw8wocorcs7m4s1jve6pr13 2478495 2478475 2026-11-05T21:35:31Z Stashbot 7414 dduvall: registered integration-agent-qemu-1005 with jenkins. note the debian-11 image was copied from integration-agent-qemu-1004 due to build failures (T440670) 2478495 wikitext text/x-wiki jpkwqag3efwuhtk66ks5q09il39q26l 2478496 2478495 2026-11-05T21:36:17Z Stashbot 7414 Southparkfan: Decommission deployment-ms-fe04 - T436476 2478496 wikitext text/x-wiki gvr1lu5k0ceotsjv3ros7g56hvzneu2 2478497 2478496 2026-11-05T21:36:54Z Stashbot 7414 dduvall: deleting integration-agent-qemu-1004 agent and instance following its replacement (T440670) 2478497 wikitext text/x-wiki d421lau4btroq82cf41mubzrx1hdfhx 2478506 2478497 2026-11-05T22:03:18Z Stashbot 7414 dduvall: doing `docker system prune -af` followed by `systemctl restart docker` on contint1003.wikimedia.org to enable the containerd-snapshotter (T440668) 2478506 wikitext text/x-wiki rj2d6x4cno68r6b9m5lgcl571yp6p40 2478507 2478506 2026-11-05T22:05:20Z Stashbot 7414 dduvall: doing `docker system prune -af` followed by `systemctl restart docker` on contint2003.wikimedia.org to enable the containerd-snapshotter (T440668) 2478507 wikitext text/x-wiki mu898at81yykaia0fvvbnkqjexxfkex 2478525 2478507 2026-11-05T22:30:43Z Stashbot 7414 dancy: Updated gitlab-cloud-runners buildkit to v0.34.2 (staging and production) 2478525 wikitext text/x-wiki i2cvu46x21swq4hjqtg4xefh5xg2xv8 2478550 2478525 2026-11-06T00:15:19Z Stashbot 7414 Southparkfan: Decommission deployment-echostore02 - T436479 2478550 wikitext text/x-wiki 0hrdtia570ab8x3mjjtk86iomm8uv4m 0 22503 2478361 2471978 2026-11-05T15:42:27Z EAlbizzati-WMF 57662 Adding reading list share feature for iOS app. 2478361 wikitext text/x-wiki cszwcvefinria0l3sb5kggr77yurd2w 498 443628 2478552 2478080 2026-11-06T03:18:14Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42155618053 (https://github.com/cluebotng/component-configs/commits/4552b8960c5335ae823db495604178008b4a4985) 2478552 wikitext text/x-wiki hpb3f1qekwj2e379lr6yo9hwf7ip1xm 2478559 2478552 2026-11-06T04:41:30Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42162423731 (https://github.com/cluebotng/component-configs/commits/f0d701fcec7061cd6d2bf7ea127a73895e4a005f) 2478559 wikitext text/x-wiki b3ag3krpcq1ko0a8ju4xa68frsxjxga 2478564 2478559 2026-11-06T05:15:27Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42166677976 (https://github.com/cluebotng/component-configs/commits/ceeb81f4d5e5d7b6a4947b95df020093bdea2903) 2478564 wikitext text/x-wiki mxh954r0mcevzqyp65q8b5iys9xfi9q 2478574 2478564 2026-11-06T06:10:39Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42172297609 (https://github.com/cluebotng/component-configs/commits/109e459ca496c932b43af3430299a707499c2d1b) 2478574 wikitext text/x-wiki j8qhkbhlpibzbg2uyr4rtbdjufpc03u 2478579 2478574 2026-11-06T06:57:33Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42177270625 (https://github.com/cluebotng/component-configs/commits/7dfced152f131f82242418b59d55e373d9ad8f77) 2478579 wikitext text/x-wiki i4q0clni9ph684it2znzczuds2bbah7 2478583 2478579 2026-11-06T07:40:24Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42181945119 (https://github.com/cluebotng/component-configs/commits/da424e45124170000e83bc261fc0ac034e51b840) 2478583 wikitext text/x-wiki e3wpymi0xmps55l44zvcqyfuix75aqq 2478597 2478583 2026-11-06T10:13:08Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42200307462 (https://github.com/cluebotng/component-configs/commits/255eec1d87ca571dcfd0f09253a9504e7d2b70f1) 2478597 wikitext text/x-wiki l6jw1z1oapn978hcvlec83oknu1kzqr 0 443850 2478593 2363916 2026-11-06T09:24:55Z DKertesz-WMF 59186 add a note about icinga misfires and mention new Prometheus metric 2478593 wikitext text/x-wiki jrk4kjnby6n11j8s998uy3a1odc7rxj 498 443949 2478510 2478175 2026-11-05T22:09:23Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 0a5ef5d (Add pytest-socket; enforce --disable-socket in all test runs) 2478510 wikitext text/x-wiki kvu3nye1e64zg5agkqgj30ch2l50xma 2478511 2478510 2026-11-05T22:09:24Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy d0429d9 (Allow callers to override TTL per entry type in RedisCache.set_cache_value) 2478511 wikitext text/x-wiki 8y87i9qudka33aqz7damzvq1ej7i73p 2478512 2478511 2026-11-05T22:09:27Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy d9df643 (Add LabelResolver: batch label resolution via pywikibot, Redis-cached) for T440134 2478512 wikitext text/x-wiki qhpsj14nyikc09qsnmjoggd3k32r9qv 2478513 2478512 2026-11-05T22:09:30Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy f8cb58e (Resolve entity labels in config panel on /dashboard) for T440134 2478513 wikitext text/x-wiki p2vmk3oegs87il023gygmra6djlaai2 2478514 2478513 2026-11-05T22:09:32Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 3c6d630 (Resolve entity labels in feature facets and chips on /dashboards) for T440134 2478514 wikitext text/x-wiki 7grpf53q30mdymhrle83q9aofhy5t2x 2478515 2478514 2026-11-05T22:09:35Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 35bfc8a (Warm label cache from bot after each successful run) for T440134 2478515 wikitext text/x-wiki ffhbvzdm51e5hui70qe1drxuufhqc2v 2478519 2478515 2026-11-05T22:21:10Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 07b1874 (Skip fully-updated dashboards in --update-existing backfill) 2478519 wikitext text/x-wiki 9tsjs4n4bwzzgudv1fr20bsfxeh0vb4 2478605 2478519 2026-11-06T10:33:29Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy d719b47 (Add dashboard_run_cells table to the schema to store cell-count data) for T443875 2478605 wikitext text/x-wiki nal0qumjme7gylssc8haefufiz2r105 2478606 2478605 2026-11-06T10:33:31Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 7316ace (Populate dashboard_run_cells on each bot run) for T443875 2478606 wikitext text/x-wiki hlonts6tivhx9j8ijj1h75q7ayrzjf4 2478607 2478606 2026-11-06T10:33:34Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 9e99142 (Populate dashboard_run_cells from historical revisions in backfiller) for T443875 2478607 wikitext text/x-wiki l7y2w91bq1uq8i14a9cypvy5jjxvinx 2478608 2478607 2026-11-06T10:33:36Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy d5113fe (Do not cache fallback IDs in label_resolver) for T440134 2478608 wikitext text/x-wiki 5lw3nl9i92dk55l56fk09j9m886lu81 2478611 2478608 2026-11-06T10:39:59Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 5a74bae (Add --update-existing-and-cells combined mode in the backfiller) 2478611 wikitext text/x-wiki 1zkape6ownx6xpb4v841ppfmtsw1968 2478616 2478611 2026-11-06T10:56:08Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 66509be (Update pywikibot from 11.8.0 to latest 11.10.0) 2478616 wikitext text/x-wiki by68ik7ukbw128jk03s9tc3hfgeh5ga 2478617 2478616 2026-11-06T10:56:09Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy c5f9757 (Upgrade all Python dev-dependencies) 2478617 wikitext text/x-wiki t64hri6uditaalt3u1kjzfb8ksuar83 2478618 2478617 2026-11-06T10:56:11Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 06cf307 (Update all Python transitive dependencies) 2478618 wikitext text/x-wiki rvrugp0camq4p1r2hovt6orc5aeh0j7 2478628 2478618 2026-11-06T11:19:34Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy de205c6 (Substitute TotalsGrouping.MARKER for None totals title in cells) 2478628 wikitext text/x-wiki 8igh2p5a6rknw398nu608063ff0116f 2478629 2478628 2026-11-06T11:19:35Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy e638496 (Fall back to property= when column= absent in cell templates in backfiller) 2478629 wikitext text/x-wiki daueml8ngn04y235901ibved5kipc1o 0 444380 2478450 2423693 2026-11-05T19:42:40Z Ottomata 88 /* Declaring specific fields in a map */ 2478450 wikitext text/x-wiki p2u096h3xx7l5k1fd8bi85oj9wlcyo8 498 446211 2478571 2478066 2026-11-06T06:09:01Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42172297593 (https://github.com/cluebotng/component-configs/commits/109e459ca496c932b43af3430299a707499c2d1b) 2478571 wikitext text/x-wiki g2olfxbflpafkk9avcryun8rhopilb8 0 446532 2478620 2442784 2026-11-06T11:06:33Z BTullis (WMF) 25295 /* Firmware Revision Updating on Cumin Hosts: */ Updated with latest cumin hostname. 2478620 wikitext text/x-wiki bm773gm8mbh14vhu1rvjx6lgwfhoobm 0 446705 2478419 2452127 2026-11-05T18:30:27Z JMeybohm (WMF) 16709 /* Packaging */ Build from source again, gbp flow 2478419 wikitext text/x-wiki 5eqwxqvjptbmk13x9ar9kfizi6j17la 0 448496 2478298 2396282 2026-11-05T13:31:20Z Effie Mouzeli (WMF) 12880 updated planet import instructions 2478298 wikitext text/x-wiki r4l34zvlkj3nq7exvexnr6qmlqyt2rw 2478306 2478298 2026-11-05T13:35:50Z Effie Mouzeli (WMF) 12880 minor 2478306 wikitext text/x-wiki bd634km8s811syflumd82xl2ztp84wm 2478311 2478306 2026-11-05T13:45:38Z Effie Mouzeli (WMF) 12880 minor 2478311 wikitext text/x-wiki kswsvmdw425yv8cwnek2wsonnlsv0xa 0 449160 2478415 2478150 2026-11-05T18:09:49Z Dexbot 30554 Bot: Updating the report 2478415 wikitext text/x-wiki qxjcuwoedmhghak4ue9x91sxonzzpwh 2478549 2478415 2026-11-06T00:01:53Z Dexbot 30554 Bot: Updating the report 2478549 wikitext text/x-wiki lcbk259q6r7pyab8exes82b74o7bqf1 498 452890 2478343 2478086 2026-11-05T14:59:27Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42049573846 (https://github.com/cluebotng/component-configs/commits/120177aabd7236410755f7187b351195daceb172) 2478343 wikitext text/x-wiki rqe0gv3peatsiywbxsktsu0ng87jhc8 2478355 2478343 2026-11-05T15:15:47Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42052229859 (https://github.com/cluebotng/component-configs/commits/4f5b065a67c9c1036d100bb6ae2816f193b11b90) 2478355 wikitext text/x-wiki s3cwmcgvkiwtim19q8hcnpj7ky8g1l6 2478554 2478355 2026-11-06T03:22:48Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42155618011 (https://github.com/cluebotng/component-configs/commits/4552b8960c5335ae823db495604178008b4a4985) 2478554 wikitext text/x-wiki ivuyv5uxs9asbbho16p47ee18cgfonx 2478558 2478554 2026-11-06T04:36:46Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42163050761 (https://github.com/cluebotng/component-configs/commits/82355b13bf40529ca3af84e6749306f7cad42b92) 2478558 wikitext text/x-wiki ri4f6c42ch2m1l5cn1aqgcqszuauu0e 2478563 2478558 2026-11-06T05:13:40Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42166677986 (https://github.com/cluebotng/component-configs/commits/ceeb81f4d5e5d7b6a4947b95df020093bdea2903) 2478563 wikitext text/x-wiki h0egv9uqgtyj2llwmue5ak9ae034xtp 2478567 2478563 2026-11-06T06:06:48Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42172297558 (https://github.com/cluebotng/component-configs/commits/109e459ca496c932b43af3430299a707499c2d1b) 2478567 wikitext text/x-wiki k77ya3qijmjxjvlrr85i5dhbvrwud4g 2478577 2478567 2026-11-06T06:54:07Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42177270550 (https://github.com/cluebotng/component-configs/commits/7dfced152f131f82242418b59d55e373d9ad8f77) 2478577 wikitext text/x-wiki egsvqd17mycyrl4jp2ezr14ji39p5jd 2478584 2478577 2026-11-06T07:41:34Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42181945109 (https://github.com/cluebotng/component-configs/commits/da424e45124170000e83bc261fc0ac034e51b840) 2478584 wikitext text/x-wiki 575n9r9q94ycaidg15mbvca5ln50lva 0 453101 2478536 2452036 2026-11-05T23:05:43Z DWisehaupt (WMF) 14911 Add process section with maint week comms stub. 2478536 wikitext text/x-wiki 7kwteidrmxvbfzw54tyyx8hz6gfdamg 0 453691 2478478 2304298 2026-11-05T21:08:28Z RCoccioli (WMF) 7416 Add link to grafana 2478478 wikitext text/x-wiki 7ckv0kzh25o7820jxboev3zn7815rib 116 453906 2478356 2476977 2026-11-05T15:24:12Z Gitlabaccountapprovalbot 37332 mohammadalawneh was rejected. 2478356 wikitext text/x-wiki iofb3h1bmkudbxt5zx6reiuql1ihi9z 2 454269 2478614 2293035 2026-11-06T10:46:19Z Taavi 13997 add tfsc membership, team split, push to deploy 2478614 wikitext text/x-wiki el1auh7da3a2a8llq2amzwjne59wqjh 0 454537 2478532 2180803 2026-11-05T22:49:09Z Southparkfan 1843 /* Deployment-prep */ 2478532 wikitext text/x-wiki qb4862jt8vkbcyvcbebsuant558fois 0 457955 2478380 2476302 2026-11-05T16:57:07Z ASanford-WMF 52089 /* 3. Generate new SSH key pair(s) */ 2478380 wikitext text/x-wiki e8bq78m0amdob4ubet46b1yd05xl66g 2478531 2478380 2026-11-05T22:45:09Z ABaso (WMF) 1044 /* Additional instructions for macOS */ Just the brew you need 2478531 wikitext text/x-wiki 1dxph0e8mu6pekm4c1o4z2f43qzq3ir 498 458787 2478557 2478079 2026-11-06T04:29:09Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42162423773 (https://github.com/cluebotng/component-configs/commits/f0d701fcec7061cd6d2bf7ea127a73895e4a005f) 2478557 wikitext text/x-wiki dlq962kpd3783acjg5r63l9r76w4j9p 2478572 2478557 2026-11-06T06:09:26Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42172297535 (https://github.com/cluebotng/component-configs/commits/109e459ca496c932b43af3430299a707499c2d1b) 2478572 wikitext text/x-wiki ouj72m54s3ihaqjpctm6rnwvm9o34pt 2478582 2478572 2026-11-06T07:39:36Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42181945089 (https://github.com/cluebotng/component-configs/commits/da424e45124170000e83bc261fc0ac034e51b840) 2478582 wikitext text/x-wiki 0t4u8sfkiqi6uadldn819jzongi3ide 2478596 2478582 2026-11-06T10:12:19Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42200307291 (https://github.com/cluebotng/component-configs/commits/255eec1d87ca571dcfd0f09253a9504e7d2b70f1) 2478596 wikitext text/x-wiki 5kon7ioq5bkr7ppatrpsr4mu3iy5ol6 498 459243 2478556 2478088 2026-11-06T04:11:57Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42160643918 (https://github.com/cluebotng/component-configs/commits/d75eff3c0ab6904c739a0b88046627a0eb019bcc) 2478556 wikitext text/x-wiki syr0lopad0gz0nfkdfbaaao3w4z10p9 2478561 2478556 2026-11-06T05:04:34Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42165716583 (https://github.com/cluebotng/component-configs/commits/73465623988d4a1316253b991ecba1de5f9f2902) 2478561 wikitext text/x-wiki i2aaq3my0y1c2r6ulizp4p17t1d3n6w 2478562 2478561 2026-11-06T05:12:30Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42166166337 (https://github.com/cluebotng/component-configs/commits/533681769ce14b9dc06e88480d711dfd2be43926) 2478562 wikitext text/x-wiki kfxjkxbsrnar4sr9vegz10ly2ig0vp4 2478565 2478562 2026-11-06T05:58:49Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42171126034 (https://github.com/cluebotng/component-configs/commits/99cc62d4318ecb79d0e5642eab91b3d01e3fe55c) 2478565 wikitext text/x-wiki sod8g21l3bcuzdmb3rnt7ivp41t4pp2 2478573 2478565 2026-11-06T06:10:23Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42172297612 (https://github.com/cluebotng/component-configs/commits/109e459ca496c932b43af3430299a707499c2d1b) 2478573 wikitext text/x-wiki ps32jrl9hhzeqcp3ikymjlq58pxjbu2 2478575 2478573 2026-11-06T06:14:17Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42172625760 (https://github.com/cluebotng/component-configs/commits/b4e427ee91fef96236b0b67b43d9e9465d70e2bc) 2478575 wikitext text/x-wiki aav7ojax08bnt8b519aeoo18j9tsoyw 2478581 2478575 2026-11-06T07:31:44Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42181039067 (https://github.com/cluebotng/component-configs/commits/6227b943f6ee18f3ac6046651a55ad11e53b6823) 2478581 wikitext text/x-wiki j4qczb24d3knn5xv0whuin3s51ed63j 2478598 2478581 2026-11-06T10:14:27Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42200488452 (https://github.com/cluebotng/component-configs/commits/3811ff050c237ab472542a64c46c558d7d159b6d) 2478598 wikitext text/x-wiki 71aeznzqw9ygv2wsv1gf24b2afrfsxl 2478624 2478598 2026-11-06T11:13:59Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42208073822 (https://github.com/cluebotng/component-configs/commits/6639b38d3900750530ebf6ef8d0a92218849b0f5) 2478624 wikitext text/x-wiki r7cgcx2cnsc2yb7wkl2d99k4d668upg 2478630 2478624 2026-11-06T11:28:40Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42210074274 (https://github.com/cluebotng/component-configs/commits/a4f327022b82328ec3d56e77ca3f3f984da6b964) 2478630 wikitext text/x-wiki fyeq1t1oglw4fn0fq94wptj39kx00xv 498 459244 2478458 2478075 2026-11-05T20:04:53Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42099049001 (https://github.com/cluebotng/component-configs/commits/c7e091e072725a2ef015a48313e08c2f2a378bdf) 2478458 wikitext text/x-wiki ijw81e1r0r9y2bxkyc9vhkw2w183hi3 2478553 2478458 2026-11-06T03:21:17Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42155618016 (https://github.com/cluebotng/component-configs/commits/4552b8960c5335ae823db495604178008b4a4985) 2478553 wikitext text/x-wiki k7t700lat07je4oh4bwv572o86ezyl2 2478566 2478553 2026-11-06T06:06:48Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42172297634 (https://github.com/cluebotng/component-configs/commits/109e459ca496c932b43af3430299a707499c2d1b) 2478566 wikitext text/x-wiki 9bvqajmw70gvdg5qweoz2eue1sr3fgu 2478578 2478566 2026-11-06T06:57:09Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42177270563 (https://github.com/cluebotng/component-configs/commits/7dfced152f131f82242418b59d55e373d9ad8f77) 2478578 wikitext text/x-wiki cllihb3wq04r03ary58begeheao27ol 2478580 2478578 2026-11-06T07:01:26Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42177719434 (https://github.com/cluebotng/component-configs/commits/66d0b6ee6547ac11df039d6d7e288c9f0acac36b) 2478580 wikitext text/x-wiki rk394uxbdwbhbll48oe1wdu4hhm1y8h 498 459255 2478457 2478067 2026-11-05T20:02:26Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42099048852 (https://github.com/cluebotng/component-configs/commits/c7e091e072725a2ef015a48313e08c2f2a378bdf) 2478457 wikitext text/x-wiki 0q9166cw7m5jr7s8dc01bqwzwfe9gih 2478568 2478457 2026-11-06T06:08:56Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42172297595 (https://github.com/cluebotng/component-configs/commits/109e459ca496c932b43af3430299a707499c2d1b) 2478568 wikitext text/x-wiki 954n1fy1ri4zmfa70mrgyzs5af83gqf 498 459263 2478569 2478070 2026-11-06T06:08:57Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42172297537 (https://github.com/cluebotng/component-configs/commits/109e459ca496c932b43af3430299a707499c2d1b) 2478569 wikitext text/x-wiki tlbbazlvbgeyomjudqstzkambke4cck 0 459290 2478405 2476801 2026-11-05T17:53:16Z XCollazo-WMF 31846 /* YYYY-MM-DD NEXT TUESDAY TRAIN (REPLACE THIS AFTER DEPLOY) */ 2478405 wikitext text/x-wiki kkh96lvh9gx2dan0q0r8im47syyz52q 2478414 2478405 2026-11-05T18:09:22Z XCollazo-WMF 31846 /* YYYY-MM-DD NEXT TUESDAY TRAIN (REPLACE THIS AFTER DEPLOY) */ 2478414 wikitext text/x-wiki esd7v13k6n0ik163qiq6pxe5803got9 498 459362 2478570 2478069 2026-11-06T06:08:59Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42172297576 (https://github.com/cluebotng/component-configs/commits/109e459ca496c932b43af3430299a707499c2d1b) 2478570 wikitext text/x-wiki jod8gyzqu9jneqr8lbmevce5h3fbxv4 0 459699 2478541 2477183 2026-11-05T23:26:15Z Stashbot 7414 eileen: civicrm upgraded from e09e0b2b to 5ba9d8e4 2478541 wikitext text/x-wiki n0d457bovo5ps7rxl34i2k822sprf59 2478560 2478541 2026-11-06T04:43:36Z Stashbot 7414 cstone: payments-wiki upgraded from e801b49c to 6d847ea1 2478560 wikitext text/x-wiki 7pa0o368eqfqcqovur9zhnun4bxvnxf 0 459966 2478367 2477896 2026-11-05T16:34:34Z JVanderhoop-WMF 41069 /* Server-side feature toggling */ Small tweaks 2478367 wikitext text/x-wiki 2syexn04milb3mx6876h0ijbopf6jh4 499 460938 2478366 2478152 2026-11-05T16:30:03Z Adithyak1997 13351 /* PHP outage */ Reply 2478366 wikitext text/x-wiki c1zdwzc7lwfp1bb5k25sij05laeroq1 2478409 2478366 2026-11-05T18:05:46Z Ciell 42095 /* PHP outage */ Reply 2478409 wikitext text/x-wiki nacydy6csqadqn3ih7trs096wnon8uj 0 460941 2478428 2026-11-05T18:41:43Z RLazarus (WMF) 15215 Created page with "{{SCROLL/Tools/Banner|requested}} <templatestyles src="User:Effie_Mouzeli_(WMF)/SCROLL/styles.css" /> ''Service Checklist for Readiness, Operations, Launch and Lifecycle'' __TOC__ {| style="width: 100%; border: none; background: transparent;" | style="vertical-align: top; width: 38%; padding-right: 2%;" | {| class="wikitable" style="font-size: 90%; width: 100%; border: 1px solid #a2a9b1;" |- ! colspan="2" class="scroll-card-header" | 📜 Service/Component identity |-..." 2478428 wikitext text/x-wiki 56ixp4hca49qtu3i2jt978bz0u4vy80 0 460942 2478540 2026-11-05T23:22:52Z DWisehaupt (WMF) 14911 Add initial maint week comms page 2478540 wikitext text/x-wiki g0r2bjqgf5680c5vcvfqxeh0rd0hh4a 2478543 2478540 2026-11-05T23:31:57Z DWisehaupt (WMF) 14911 /* Templates */ add comms email examples for maint week 2478543 wikitext text/x-wiki 4gpel1a9t616ntza39ruwy0kj3br7ly 2478544 2478543 2026-11-05T23:32:26Z DWisehaupt (WMF) 14911 /* Templates */ header change 2478544 wikitext text/x-wiki 2vs6d2rwsy2kzc7tam4t2hrov7b8i4c 2 460943 2478548 2026-11-06T00:01:02Z BryanDavis 1604 /* Touch required notification */ new section 2478548 wikitext text/x-wiki q58ec2ykwze4ukbdebqshcelv45lebi 2478551 2478548 2026-11-06T00:40:46Z BryanDavis 1604 /* Generating a new ssh key */ new section so I can rm a note on my laptop 2478551 wikitext text/x-wiki qdkgxjzy9bxi3alulv00zgwm2dyzyuo 498 460944 2478555 2026-11-06T04:11:26Z Stashbot 7414 greg-g: ran toolforge webservice buildservice restart 2478555 wikitext text/x-wiki tn7j3fraat4805h07t327evf2qrxq03