Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.48.0-wmf.3 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 549 2477807 2453521 2026-11-04T20:28:03Z Stashbot 7414 andrewbogott: deleting all VMs, see T435774 2477807 wikitext text/x-wiki phic9fzbjmslzh7g8gkbypqboa5kk5s 498 739 2477798 2455781 2026-11-04T20:20:56Z Stashbot 7414 andrewbogott: deleting VM 'dumps-10', see T435767 2477798 wikitext text/x-wiki gdnd9rj9t6saqtvcpfdhk0p1c3rh9vw 498 1319 2477837 2453525 2026-11-04T20:48:00Z Stashbot 7414 andrewbogott: deleting bullseye VMS, see https://phabricator.wikimedia.org/T435781 2477837 wikitext text/x-wiki g58zngfm4dpklbbkrvdri647cvtk6r7 498 3086 2477411 2475466 2026-11-04T12:31:24Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component image-config 2477411 wikitext text/x-wiki 7ikj66qbzdtu3symp09chxx5z0llg3v 2477418 2477411 2026-11-04T12:37:24Z Stashbot 7414 dcaro@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component image-config 2477418 wikitext text/x-wiki 40u34qwqtelx2e8ddzo1321tgjnvk5b 2477436 2477418 2026-11-04T12:47:44Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component image-config 2477436 wikitext text/x-wiki 9l2c5z0nbms4iomk6gz5f8k6auue8c9 2477453 2477436 2026-11-04T12:57:41Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component image-config 2477453 wikitext text/x-wiki sfvvyj5zoforcopo2ws4e5kq3g53vqo 2477712 2477453 2026-11-04T18:10:13Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component builds-api 2477712 wikitext text/x-wiki o9bqsd5wnco2szw24iwqr3oo59gmv44 2477713 2477712 2026-11-04T18:10:29Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.copy_istio_images_to_registry for Istio 1.31.3 2477713 wikitext text/x-wiki ecvb5j1ytuovmbtz1pnvw5ws1muzrix 2477714 2477713 2026-11-04T18:10:57Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.k8s.copy_istio_images_to_registry (exit_code=0) for Istio 1.31.3 2477714 wikitext text/x-wiki b7a0wuswbk09kuuw612wklbtdb6z9p7 2477717 2477714 2026-11-04T18:14:30Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api 2477717 wikitext text/x-wiki tmhjnlfouk1eotcdg7mv8wl2a17an2s 2477734 2477717 2026-11-04T18:42:15Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component istio-system 2477734 wikitext text/x-wiki gf4jiijv636i48kuuzszgjzjm9ibpf7 2477741 2477734 2026-11-04T18:48:01Z Stashbot 7414 taavi@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component istio-system 2477741 wikitext text/x-wiki k4wcuxuwalsb72dr7s3tf5tvwrtmtz3 2477836 2477741 2026-11-04T20:47:34Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2477836 wikitext text/x-wiki lick8a7fkhwhlko9lm9s99p6p6ect8j 2477840 2477836 2026-11-04T20:49:22Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component components-api 2477840 wikitext text/x-wiki 3ugm0uxzd8vo6q2y5d6yibgfnj24m40 2477850 2477840 2026-11-04T20:57:02Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2477850 wikitext text/x-wiki ac3td0ip6mhxhk2mpfyn3gcf39i3uz8 2477851 2477850 2026-11-04T20:58:17Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component components-api 2477851 wikitext text/x-wiki ku8n0xwg3n38h7th8o2slu25ksdd1sz 2 3849 2477706 2434033 2026-11-04T18:02:00Z ArielGlenn 11 yet another set of notes on another service 2477706 wikitext text/x-wiki m5w1cj7xvdk5q8mxr978v0nh1j0u805 0 4039 2477673 2477010 2026-11-04T17:20:54Z RSilvola-WMF 49112 /* Creating a Security Patch */ consolidating pages 2477673 wikitext text/x-wiki n04t3f1vh15k9j89zxjp6uk2379qh4b 2477674 2477673 2026-11-04T17:24:55Z RSilvola-WMF 49112 2477674 wikitext text/x-wiki 0wv0q3tzryo06io29vjydeqrk0eidme 2477709 2477674 2026-11-04T18:07:59Z RSilvola-WMF 49112 /* Creating a Security Patch */ Add note on applicability and backports 2477709 wikitext text/x-wiki 9sg0t39q9pt0gwn9kzh6mfqqvub5xce 2477710 2477709 2026-11-04T18:08:40Z RSilvola-WMF 49112 /* Creating a Security Patch */ 2477710 wikitext text/x-wiki iov9hsb3gx5h940bcqod5id8dootxjp 2477991 2477710 2026-11-05T01:01:17Z Roan Kattouw (WMF) 8 /* After */ 2477991 wikitext text/x-wiki qe99y6juml6govjt7ik9kns6qcmkser 2477992 2477991 2026-11-05T01:05:29Z Roan Kattouw (WMF) 8 /* Before */ 2477992 wikitext text/x-wiki gyy30qsoimhg15oca7283wxoa6fd0rn 0 4108 2477437 2476980 2026-11-04T12:48:42Z ScheduleDeploymentBot 37566 Add [[gerrit:1360437]] to Wednesday, November 04 UTC afternoon backport window 2477437 wikitext text/x-wiki a81zhy1zq2idx2rzswci6uqkr38mhz3 2477536 2477437 2026-11-04T14:47:12Z ScheduleDeploymentBot 37566 Add [[gerrit:1363260]] to Wednesday, November 04 UTC afternoon backport window 2477536 wikitext text/x-wiki 8i3hq0pbcl1grliav6689mbull511df 2477542 2477536 2026-11-04T14:55:25Z ScheduleDeploymentBot 37566 Add [[gerrit:1363265]] to Wednesday, November 04 UTC late backport window 2477542 wikitext text/x-wiki 3oadpr447mm61ugl89z174didvsquh5 2477550 2477542 2026-11-04T15:01:11Z ScheduleDeploymentBot 37566 Add [[gerrit:1363263]] to Wednesday, November 04 UTC late backport window 2477550 wikitext text/x-wiki 829bw8py4tbjgzrzkdqrje6xwcf5kfg 2477848 2477550 2026-11-04T20:55:39Z ScheduleDeploymentBot 37566 Add [[gerrit:1363467]] to Wednesday, November 04 UTC late backport window 2477848 wikitext text/x-wiki 71z598y2bkuulbln7yokex7tcu1lw0u 2477945 2477848 2026-11-04T23:33:53Z ScheduleDeploymentBot 37566 Add [[gerrit:1363494]] to Tuesday, November 10 UTC late backport window 2477945 wikitext text/x-wiki eu4b4vcmzdwerimu23lqiyi9w4f25ix 2478100 2477945 2026-11-05T07:44:22Z ScheduleDeploymentBot 37566 Add [[gerrit:1363978]] to Thursday, November 05 UTC morning backport window 2478100 wikitext text/x-wiki leaexzq9nbf3zugk1h8pt6waz966tqp 2478230 2478100 2026-11-05T11:33:55Z ScheduleDeploymentBot 37566 Add [[gerrit:1364209]] to Thursday, November 05 UTC afternoon backport window 2478230 wikitext text/x-wiki euhe23f13kx0f4u68l92p3pe15g0q1x 2478243 2478230 2026-11-05T11:50:04Z ScheduleDeploymentBot 37566 Add [[gerrit:1364235]] to Thursday, November 05 UTC late backport window 2478243 wikitext text/x-wiki 5hebifgmput6hvc6zir0n89bh812ffy 0 4627 2477623 2456660 2026-11-04T15:57:47Z Krinkle 44 /* mediawiki.httpd.accesslog */ new section 2477623 wikitext text/x-wiki ixhw8d57e7ze4zeqylb6ka3ry463klb 2477624 2477623 2026-11-04T15:58:03Z Krinkle 44 /* Request logs */ 2477624 wikitext text/x-wiki fwbk9g5njrl86ts5f905o9xzu8uxc84 2477625 2477624 2026-11-04T15:58:43Z Krinkle 44 2477625 wikitext text/x-wiki tesn0go2zr9w8z7gg8u1wz9swfq25jv 0 4673 2477862 2458707 2026-11-04T21:16:14Z Taavi 13997 /* 2025-present */ update 2477862 wikitext text/x-wiki 5kgh6aidq20yictto27soxqcccl93oe 498 6726 2477707 2477315 2026-11-04T18:06:00Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component builds-api 2477707 wikitext text/x-wiki ssavcdmjrr4ysn3c83167x4zfc1uxd5 2477711 2477707 2026-11-04T18:09:38Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api 2477711 wikitext text/x-wiki l0kldlqfzth8vxcacrt7u49nqy59wj3 2477721 2477711 2026-11-04T18:25:26Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component istio-system 2477721 wikitext text/x-wiki it7dy70jun3pa0ej05mtwh0ye11ttza 2477733 2477721 2026-11-04T18:41:51Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component istio-system 2477733 wikitext text/x-wiki jd3vt5yfd7ri2k382jnsg7nyhz9iow4 2477815 2477733 2026-11-04T20:36:11Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2477815 wikitext text/x-wiki tgpxf2pqmoh98r56wlqblk0h8cz0l8h 2477823 2477815 2026-11-04T20:39:16Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api 2477823 wikitext text/x-wiki 81czp0smjzi8rwhyuim08gf16tio1ea 0 7919 2477341 2477340 2026-11-04T11:59:17Z Stashbot 7414 cgoubert@deploy2003: cgoubert: Backport for [[gerrit:1363104|ProductionServices: Repool poolcounter1007, depool poolcounter2005 (#3/5) (T441653)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2477341 wikitext text/x-wiki kkh8pt6osx6mn42qsg3boijrk8zxsfr 2477343 2477341 2026-11-04T12:00:07Z Stashbot 7414 root@deploy2003: helmfile [staging] START helmfile.d/services/shellbox: sync 2477343 wikitext text/x-wiki 2e58guap0pzwn23nxn6rfbs9z2i48ia 2477344 2477343 2026-11-04T12:00:31Z Stashbot 7414 root@deploy2003: helmfile [staging] DONE helmfile.d/services/shellbox: sync 2477344 wikitext text/x-wiki tjlpg8mhp13nndebwtqpxbqrhwsegwr 2477345 2477344 2026-11-04T12:00:35Z Stashbot 7414 root@deploy2003: helmfile [staging] START helmfile.d/services/shellbox-timeline: sync 2477345 wikitext text/x-wiki m6c3wkk4b77cl32brga2ez531lmwbpr 2477346 2477345 2026-11-04T12:00:55Z Stashbot 7414 root@deploy2003: helmfile [staging] DONE helmfile.d/services/shellbox-timeline: sync 2477346 wikitext text/x-wiki 5h4oex1jbuieyp7ekqs9paqh412qe48 2477347 2477346 2026-11-04T12:00:58Z Stashbot 7414 root@deploy2003: helmfile [codfw] START helmfile.d/services/shellbox-timeline: sync 2477347 wikitext text/x-wiki kp5edy8pud0uhxng7v1ykkypy4tmc9e 2477348 2477347 2026-11-04T12:01:11Z Stashbot 7414 root@deploy2003: helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: sync 2477348 wikitext text/x-wiki rjsly9y5v5sf0dqujqkyqawiujg3g5v 2477349 2477348 2026-11-04T12:01:28Z Stashbot 7414 blake@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host kubestage2001.codfw.wmnet 2477349 wikitext text/x-wiki ai3zi5hvlv7h8bpe6u3ux8jav9dl8ix 2477350 2477349 2026-11-04T12:01:31Z Stashbot 7414 blake@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host kubestage2001.codfw.wmnet 2477350 wikitext text/x-wiki m0e41cdr526431kvv1y5a7j1qsgkka7 2477351 2477350 2026-11-04T12:01:35Z Stashbot 7414 blake@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host kubestage2002.codfw.wmnet 2477351 wikitext text/x-wiki a1unkpyd508ib43plqvcnk9eslz5t7i 2477352 2477351 2026-11-04T12:01:39Z Stashbot 7414 blake@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host kubestage2002.codfw.wmnet 2477352 wikitext text/x-wiki 1qxodyjpmxs4wr7r0yambs5c62ejh4l 2477353 2477352 2026-11-04T12:02:21Z Stashbot 7414 atsuko@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-dumps: apply 2477353 wikitext text/x-wiki qus79lw0sdo07giy5q9rsbezmy7a51w 2477354 2477353 2026-11-04T12:02:56Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2175', diff saved to https://phabricator.wikimedia.org/P97260 and previous config saved to /var/cache/conftool/dbconfig/20261104-120254-ladsgroup.json 2477354 wikitext text/x-wiki g6qyn6uu209r8elh7999m3p60hgo6uc 2477355 2477354 2026-11-04T12:03:27Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-wdqs2002.codfw.wmnet 2477355 wikitext text/x-wiki etiwi8vzg141byqwn97zpl5s96p1s7u 2477356 2477355 2026-11-04T12:03:30Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-wdqs2002.codfw.wmnet 2477356 wikitext text/x-wiki p9y4to2x8a46nld0s54s9382d86e0my 2477357 2477356 2026-11-04T12:03:35Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-wdqs2003.codfw.wmnet 2477357 wikitext text/x-wiki lhdm0af3qve0mz0p3n0b4vktbmtp74g 2477358 2477357 2026-11-04T12:03:44Z Stashbot 7414 atsuko@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-dumps: apply 2477358 wikitext text/x-wiki 9yrod511q28golvydbw3dfijy14irru 2477359 2477358 2026-11-04T12:04:10Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-wdqs2003.codfw.wmnet 2477359 wikitext text/x-wiki rszvtafm44j3h1fj0flc9ps55ysrpt4 2477360 2477359 2026-11-04T12:04:13Z Stashbot 7414 cgoubert@deploy2003: cgoubert: Continuing with deployment 2477360 wikitext text/x-wiki t6d6rcvpcdy2gdsl1ujog289ac228fk 2477361 2477360 2026-11-04T12:07:28Z Stashbot 7414 mvolz@deploy2003: Started scap deploy-service citoid: Update user-agent 2477361 wikitext text/x-wiki 9yi8jgisxgffu09youzae2truz0o6m4 2477362 2477361 2026-11-04T12:07:31Z Stashbot 7414 mvolz@deploy2003: scap deploy-service citoid: [STAGING/DEFAULT] staging-eqiad Deploying citoid 2477362 wikitext text/x-wiki tm88tp55aah04gvc93pe6lbp4tzrq3x 2477363 2477362 2026-11-04T12:08:00Z Stashbot 7414 blake@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host kubestage2002.codfw.wmnet 2477363 wikitext text/x-wiki axozfs2490fm4j0rawuy9iipulxf096 2477364 2477363 2026-11-04T12:08:03Z Stashbot 7414 blake@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host kubestage2002.codfw.wmnet 2477364 wikitext text/x-wiki l6c5hfwyy8dqgpk43ebc5la2v3q1usm 2477365 2477364 2026-11-04T12:08:10Z Stashbot 7414 blake@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host kubestage2003.codfw.wmnet 2477365 wikitext text/x-wiki ckp4sabm47kmvkxaa3nsg3pbizthq3r 2477366 2477365 2026-11-04T12:08:41Z Stashbot 7414 blake@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host kubestage2003.codfw.wmnet 2477366 wikitext text/x-wiki n7whxeuijhjpdhur3z8zu871xbbzhoc 2477367 2477366 2026-11-04T12:09:21Z Stashbot 7414 mvolz@deploy2003: scap deploy-service citoid: [PRODUCTION/DEFAULT] eqiad Deploying citoid 2477367 wikitext text/x-wiki 202pw02vevi4sipub2vchphsup4e8bq 2477368 2477367 2026-11-04T12:09:42Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-wdqs2003.codfw.wmnet 2477368 wikitext text/x-wiki b26cmus0hkn62jt14hgj7fzcdunttxr 2477369 2477368 2026-11-04T12:09:45Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-wdqs2003.codfw.wmnet 2477369 wikitext text/x-wiki m7o53980fvdtqklec71ooddmikqoo47 2477370 2477369 2026-11-04T12:09:50Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-wdqs2004.codfw.wmnet 2477370 wikitext text/x-wiki h9uzhyb18irg75y8l17lzo7pulvt9jo 2477371 2477370 2026-11-04T12:10:06Z Stashbot 7414 cgoubert@deploy2003: Finished scap sync-world: Backport for [[gerrit:1363104|ProductionServices: Repool poolcounter1007, depool poolcounter2005 (#3/5) (T441653)]] (duration: 15m 19s) 2477371 wikitext text/x-wiki co81a44c0gx0p1dojz0krbqmcxh2iui 2477372 2477371 2026-11-04T12:10:25Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-wdqs2004.codfw.wmnet 2477372 wikitext text/x-wiki jm50f677zpx7f6d1m3bqzrgnopmx7gd 2477373 2477372 2026-11-04T12:10:48Z Stashbot 7414 mvolz@deploy2003: scap deploy-service citoid: [PRODUCTION/DEFAULT] codfw Deploying citoid 2477373 wikitext text/x-wiki 43mukgz68wmc1asg8nks71fv24m3q39 2477374 2477373 2026-11-04T12:10:51Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host poolcounter2005.codfw.wmnet 2477374 wikitext text/x-wiki aszv8cfo2wskah5w5vn7xhkrulj8izt 2477375 2477374 2026-11-04T12:12:54Z Stashbot 7414 mvolz@deploy2003: Finished scap deploy-service citoid: Update user-agent (duration: 05m 26s) 2477375 wikitext text/x-wiki mljtbfw6s9vulzob4utmqknfa930t1i 2477376 2477375 2026-11-04T12:12:58Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2175 (T441633)', diff saved to https://phabricator.wikimedia.org/P97261 and previous config saved to /var/cache/conftool/dbconfig/20261104-121256-ladsgroup.json 2477376 wikitext text/x-wiki n8hg6vt404palyjwwg7vv0jjua62n4j 2477377 2477376 2026-11-04T12:13:16Z Stashbot 7414 moritzm: installing apt security updates 2477377 wikitext text/x-wiki gjcwiiooj62blancyph4oqlk4x5ewvk 2477378 2477377 2026-11-04T12:13:19Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2189.codfw.wmnet with reason: Maintenance 2477378 wikitext text/x-wiki l4gghqahano88eg3tn8y9cyb3qs7ci5 2477379 2477378 2026-11-04T12:13:23Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db2189 (T441633)', diff saved to https://phabricator.wikimedia.org/P97262 and previous config saved to /var/cache/conftool/dbconfig/20261104-121318-ladsgroup.json 2477379 wikitext text/x-wiki r3sarl4qeclaejbb2dvtd6ybcsvou54 2477380 2477379 2026-11-04T12:14:37Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host poolcounter2005.codfw.wmnet 2477380 wikitext text/x-wiki 19l7r0d1gzl8yduocctzjnly2tb7u5h 2477381 2477380 2026-11-04T12:15:19Z Stashbot 7414 blake@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host kubestage2003.codfw.wmnet 2477381 wikitext text/x-wiki equx9vtiifmvd4xi06juknvqsj2ygnl 2477382 2477381 2026-11-04T12:15:22Z Stashbot 7414 blake@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host kubestage2003.codfw.wmnet 2477382 wikitext text/x-wiki 8yw0m89jfoy4z2hpdc3vdo0g8xa84ce 2477383 2477382 2026-11-04T12:15:27Z Stashbot 7414 blake@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host kubestage2004.codfw.wmnet 2477383 wikitext text/x-wiki jxzvdihv7g1gbg7bu9j4h4utwqeihs3 2477384 2477383 2026-11-04T12:16:07Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-wdqs2004.codfw.wmnet 2477384 wikitext text/x-wiki 18r44el5vkh2g1yrwlf1pfj49ifsi3e 2477385 2477384 2026-11-04T12:16:10Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-wdqs2004.codfw.wmnet 2477385 wikitext text/x-wiki nk7p55tbq91rc4j7muwe3c0k9x71sae 2477386 2477385 2026-11-04T12:16:15Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-wdqs2005.codfw.wmnet 2477386 wikitext text/x-wiki dmq9utewpvc7todg5t2rkqjjmws1vgj 2477387 2477386 2026-11-04T12:16:18Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-wdqs2005.codfw.wmnet 2477387 wikitext text/x-wiki f0c9ha52c5xpcpl7w6jg9l7wuxji1ja 2477388 2477387 2026-11-04T12:16:21Z Stashbot 7414 cgoubert@deploy2003: Started scap sync-world: Backport for [[gerrit:1363105|ProductionServices: Repool poolcounter2005, depool poolcounter2006 (#4/5) (T441653)]] 2477388 wikitext text/x-wiki awmhpmzzz8wn5untwzcwqkkz9omytd6 2477389 2477388 2026-11-04T12:17:11Z Stashbot 7414 atsuko@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-dumps: apply 2477389 wikitext text/x-wiki 4uhr5on5fs5ios5okpqdt2q3842cggg 2477390 2477389 2026-11-04T12:18:02Z Stashbot 7414 atsuko@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-dumps: apply 2477390 wikitext text/x-wiki 3qu9v5r60xnlt0yw7o6buyjtay9acqu 2477392 2477390 2026-11-04T12:20:27Z Stashbot 7414 cgoubert@deploy2003: cgoubert: Backport for [[gerrit:1363105|ProductionServices: Repool poolcounter2005, depool poolcounter2006 (#4/5) (T441653)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2477392 wikitext text/x-wiki iv5uyj18oqykzh0vb8j1z9nwvq032q3 2477393 2477392 2026-11-04T12:20:45Z Stashbot 7414 blake@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host kubestage2004.codfw.wmnet 2477393 wikitext text/x-wiki 71if9i1b1d3el4k3eyv2eia1apgsxql 2477394 2477393 2026-11-04T12:21:04Z Stashbot 7414 cgoubert@deploy2003: cgoubert: Continuing with deployment 2477394 wikitext text/x-wiki lsadd4jlh7k4pw3hzyl5aoifg334vz9 2477395 2477394 2026-11-04T12:21:49Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-wdqs2005.codfw.wmnet 2477395 wikitext text/x-wiki nxcij16qig55byqah0i9d4qtempuqu3 2477396 2477395 2026-11-04T12:21:52Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-wdqs2005.codfw.wmnet 2477396 wikitext text/x-wiki d2jkq8rznag5tqe2r7sol6cd4m338s4 2477397 2477396 2026-11-04T12:21:57Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-wdqs-test2001.codfw.wmnet 2477397 wikitext text/x-wiki 83n3uarwdz205dwl7qi8e2uxp8jzdzs 2477398 2477397 2026-11-04T12:22:32Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-wdqs-test2001.codfw.wmnet 2477398 wikitext text/x-wiki q1m2aw9v3g37vzyj56xs3eiqr658w4j 2477400 2477398 2026-11-04T12:26:52Z Stashbot 7414 cgoubert@deploy2003: Finished scap sync-world: Backport for [[gerrit:1363105|ProductionServices: Repool poolcounter2005, depool poolcounter2006 (#4/5) (T441653)]] (duration: 10m 32s) 2477400 wikitext text/x-wiki noujmkck0d2jlohboqsuv1xvhfngq2m 2477401 2477400 2026-11-04T12:27:26Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host poolcounter2006.codfw.wmnet 2477401 wikitext text/x-wiki 9aig0jgr6chu7yntxfmkflizggh64ow 2477402 2477401 2026-11-04T12:27:30Z Stashbot 7414 blake@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host kubestage2004.codfw.wmnet 2477402 wikitext text/x-wiki 8io44mukwjikysgs09xuouhfpkjggsy 2477403 2477402 2026-11-04T12:27:33Z Stashbot 7414 blake@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host kubestage2004.codfw.wmnet 2477403 wikitext text/x-wiki 9d5rshrcsq2nhh2137vympgat3u753s 2477404 2477403 2026-11-04T12:27:36Z Stashbot 7414 blake@cumin1004: END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on A:wikikube-staging-worker-codfw 2477404 wikitext text/x-wiki ln4ye0t715njulwusfdyxo2l7wa52sg 2477405 2477404 2026-11-04T12:27:55Z Stashbot 7414 blake@cumin1004: START - Cookbook sre.k8s.reboot-nodes rolling reboot on A:wikikube-staging-worker-eqiad 2477405 wikitext text/x-wiki 96m5i9ppdt46klhqoe2frlhcw66297o 2477406 2477405 2026-11-04T12:28:00Z Stashbot 7414 blake@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host kubestage1003.eqiad.wmnet 2477406 wikitext text/x-wiki rw0em5l63m4lz7sgrsukcsgubis6dvk 2477407 2477406 2026-11-04T12:28:31Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-wdqs-test2001.codfw.wmnet 2477407 wikitext text/x-wiki qmybxl2wxav6vx783rdxf540qjb3n5b 2477408 2477407 2026-11-04T12:28:34Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-wdqs-test2001.codfw.wmnet 2477408 wikitext text/x-wiki 4o91nfu4ztl2aolzxa8qy0f09g6t8zq 2477409 2477408 2026-11-04T12:28:38Z Stashbot 7414 blake@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host kubestage1003.eqiad.wmnet 2477409 wikitext text/x-wiki 9otpqdaen6h82r1t8e89um1j7k8ohv6 2477410 2477409 2026-11-04T12:28:41Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker2001.codfw.wmnet 2477410 wikitext text/x-wiki oh475xw4jkmbrtm1la8nq6armnl2t17 2477412 2477410 2026-11-04T12:31:26Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host poolcounter2006.codfw.wmnet 2477412 wikitext text/x-wiki 08bg83oslgezxdxja0qiueixv8v7dbg 2477413 2477412 2026-11-04T12:33:27Z Stashbot 7414 cgoubert@deploy2003: Started scap sync-world: Backport for [[gerrit:1363106|ProductionServices: Repool poolcounter2006 after reboot (#5/5) (T441653)]] 2477413 wikitext text/x-wiki 1jon0fm0ltvwyi11g6zqvjcu7rzjuci 2477414 2477413 2026-11-04T12:33:42Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker2001.codfw.wmnet 2477414 wikitext text/x-wiki hots52k0yo0oamsk6qqsp1mrafmk6ok 2477415 2477414 2026-11-04T12:34:39Z Stashbot 7414 blake@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host kubestage1003.eqiad.wmnet 2477415 wikitext text/x-wiki 7tzyilrbv4u3q0t86k35xu2yqfd148g 2477416 2477415 2026-11-04T12:34:42Z Stashbot 7414 blake@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host kubestage1003.eqiad.wmnet 2477416 wikitext text/x-wiki s3imrwvw61m3b8htbwpkzpof9rgtm6i 2477417 2477416 2026-11-04T12:34:46Z Stashbot 7414 blake@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host kubestage1004.eqiad.wmnet 2477417 wikitext text/x-wiki 81x8xno8vcusnytxseovkp069fa097l 2477419 2477417 2026-11-04T12:37:54Z Stashbot 7414 cgoubert@deploy2003: cgoubert: Backport for [[gerrit:1363106|ProductionServices: Repool poolcounter2006 after reboot (#5/5) (T441653)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2477419 wikitext text/x-wiki ctf2kzw99jt1ja0em7tjp9lq7vjbxcb 2477420 2477419 2026-11-04T12:38:40Z Stashbot 7414 cgoubert@deploy2003: cgoubert: Continuing with deployment 2477420 wikitext text/x-wiki tuhzb2gcgm1qeg3wjp34qj3ehs8zjn0 2477421 2477420 2026-11-04T12:39:52Z Stashbot 7414 blake@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host kubestage1004.eqiad.wmnet 2477421 wikitext text/x-wiki dbxa20sq05kl3pu1pw1721g6r96wvvp 2477422 2477421 2026-11-04T12:40:12Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker2001.codfw.wmnet 2477422 wikitext text/x-wiki 6oynhv9f858yi9edyhhvu8lcij1lljz 2477423 2477422 2026-11-04T12:40:14Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker2001.codfw.wmnet 2477423 wikitext text/x-wiki cl7bjhlgkcyt171f3hrtk7e1slbdx6k 2477424 2477423 2026-11-04T12:40:22Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker2002.codfw.wmnet 2477424 wikitext text/x-wiki hvqwts0o5bv6qr09go8iannqdk2hpg6 2477426 2477424 2026-11-04T12:44:25Z Stashbot 7414 cgoubert@deploy2003: Finished scap sync-world: Backport for [[gerrit:1363106|ProductionServices: Repool poolcounter2006 after reboot (#5/5) (T441653)]] (duration: 10m 58s) 2477426 wikitext text/x-wiki 8h7falphqma3y7es93769ymz3ylfff8 2477427 2477426 2026-11-04T12:45:27Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker2002.codfw.wmnet 2477427 wikitext text/x-wiki 6cds7k0zp0pqiqaj60bxh48xi003tra 2477428 2477427 2026-11-04T12:45:42Z Stashbot 7414 claime: donne with poolcounter reboots 2477428 wikitext text/x-wiki 3y7ffyofl2c3pkavqco8240qc9yu1un 2477429 2477428 2026-11-04T12:46:02Z Stashbot 7414 blake@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host kubestage1004.eqiad.wmnet 2477429 wikitext text/x-wiki oo6qffu0u62td3dyzl281k54xgdxegd 2477430 2477429 2026-11-04T12:46:05Z Stashbot 7414 blake@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host kubestage1004.eqiad.wmnet 2477430 wikitext text/x-wiki 4k8ieq1dncsks9cyvoj70vac5dsrs4i 2477431 2477430 2026-11-04T12:46:08Z Stashbot 7414 blake@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host kubestage1005.eqiad.wmnet 2477431 wikitext text/x-wiki 2763tzcavbob6az0b8ge2ipham6ifdy 2477432 2477431 2026-11-04T12:46:17Z Stashbot 7414 ladsgroup@deploy2003: helmfile [staging] START helmfile.d/services/thumbor: apply 2477432 wikitext text/x-wiki 2zlfidyxgw0gcczsgubl41a3ltf3hk8 2477433 2477432 2026-11-04T12:46:36Z Stashbot 7414 ladsgroup@deploy2003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2477433 wikitext text/x-wiki t9rqjn3yub0vyr86blodmixlgubsc2t 2477434 2477433 2026-11-04T12:47:12Z Stashbot 7414 blake@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host kubestage1005.eqiad.wmnet 2477434 wikitext text/x-wiki sdyntko65bkk5n0629oqgsoduiwggpp 2477435 2477434 2026-11-04T12:47:20Z Stashbot 7414 ladsgroup@deploy2003: helmfile [eqiad] START helmfile.d/services/thumbor: apply 2477435 wikitext text/x-wiki 0r36ehpw21wgrodj9zc04a6xevcjxo0 2477438 2477435 2026-11-04T12:50:32Z Stashbot 7414 ladsgroup@deploy2003: helmfile [eqiad] DONE helmfile.d/services/thumbor: apply 2477438 wikitext text/x-wiki mnzdpdky1kit4ldq9w5k627cgf861tw 2477439 2477438 2026-11-04T12:50:58Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker2002.codfw.wmnet 2477439 wikitext text/x-wiki b9kogkqnmg6gn8cjrbnecrcqzgahf1s 2477440 2477439 2026-11-04T12:51:01Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker2002.codfw.wmnet 2477440 wikitext text/x-wiki tdapwxufzjwdhsl8xhz37slhhmkwrn7 2477441 2477440 2026-11-04T12:51:06Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker2003.codfw.wmnet 2477441 wikitext text/x-wiki 5msi3yysikbi8nibd1pygpu8i13ghtw 2477442 2477441 2026-11-04T12:51:40Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker2003.codfw.wmnet 2477442 wikitext text/x-wiki nwlbp4caha33dx1bx0i2zo2hx1xrxyv 2477443 2477442 2026-11-04T12:54:03Z Stashbot 7414 blake@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host kubestage1005.eqiad.wmnet 2477443 wikitext text/x-wiki c6ty2kawvi3jeerqjo7u11o3k9gik0q 2477444 2477443 2026-11-04T12:54:06Z Stashbot 7414 blake@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host kubestage1005.eqiad.wmnet 2477444 wikitext text/x-wiki 1ny5el6ibb69xda3ossktgrhc9eb890 2477445 2477444 2026-11-04T12:54:10Z Stashbot 7414 blake@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host kubestage1006.eqiad.wmnet 2477445 wikitext text/x-wiki i4ad7te44trqkdj49gekqgplxce67qa 2477447 2477445 2026-11-04T12:54:58Z Stashbot 7414 blake@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host kubestage1006.eqiad.wmnet 2477447 wikitext text/x-wiki g4777ria99aa1ug4bcjm8ampedc0i3w 2477448 2477447 2026-11-04T12:56:50Z Stashbot 7414 ladsgroup@deploy2003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2477448 wikitext text/x-wiki ry16f29cziehv87gf2neb1rrirjti42 2477449 2477448 2026-11-04T12:57:12Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker2003.codfw.wmnet 2477449 wikitext text/x-wiki i6i1yk58xm7eii40lt26u79pvpmxfco 2477450 2477449 2026-11-04T12:57:14Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker2003.codfw.wmnet 2477450 wikitext text/x-wiki f33igktu18rztgy14sr9gjx8o1afriq 2477451 2477450 2026-11-04T12:57:19Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker2004.codfw.wmnet 2477451 wikitext text/x-wiki 8s5hsx08134qnl4qyweofkkpg77dm5i 2477452 2477451 2026-11-04T12:57:23Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.dns.netbox 2477452 wikitext text/x-wiki 1mljw63bd96izfmay236wa1m20my0j1 2477454 2477452 2026-11-04T12:57:52Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker2004.codfw.wmnet 2477454 wikitext text/x-wiki l4alwk1byj32x444vjumugjy1oc8ckh 2477455 2477454 2026-11-04T12:58:49Z Stashbot 7414 ladsgroup@deploy2003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2477455 wikitext text/x-wiki mi1namzz9wa6740j84adohi74o67xwm 2477456 2477455 2026-11-04T13:01:17Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cr3-esams mgmt - ayounsi@cumin1004" 2477456 wikitext text/x-wiki l9glu9y1owwd84yexqvhc6in924vfgn 2477457 2477456 2026-11-04T13:01:20Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cr3-esams mgmt - ayounsi@cumin1004" 2477457 wikitext text/x-wiki 8f1bn5cfj5on3s1hvne7j40j10e1thb 2477458 2477457 2026-11-04T13:01:23Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2477458 wikitext text/x-wiki d7wu37uqy5bj2n1f9al48y0my13jlbg 2477459 2477458 2026-11-04T13:01:26Z Stashbot 7414 blake@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host kubestage1006.eqiad.wmnet 2477459 wikitext text/x-wiki 19raevyxy65gvmlrey7fpkohniepo9u 2477460 2477459 2026-11-04T13:01:28Z Stashbot 7414 blake@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host kubestage1006.eqiad.wmnet 2477460 wikitext text/x-wiki crflnk1p2530weyy88fnvssy26hlykj 2477461 2477460 2026-11-04T13:01:31Z Stashbot 7414 blake@cumin1004: END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on A:wikikube-staging-worker-eqiad 2477461 wikitext text/x-wiki 3dsg525zcfloqtpledngglk8vw0wpzk 2477462 2477461 2026-11-04T13:03:24Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker2004.codfw.wmnet 2477462 wikitext text/x-wiki 9n5412qub4tb65riz4pajhwaob2czpi 2477463 2477462 2026-11-04T13:03:27Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker2004.codfw.wmnet 2477463 wikitext text/x-wiki 4e84e3o7kpwiopxcpdtlvhmoflu7ckj 2477464 2477463 2026-11-04T13:03:31Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker2005.codfw.wmnet 2477464 wikitext text/x-wiki k8v9k3kgihb1gdrm4bvqcu0dm6i8bny 2477465 2477464 2026-11-04T13:04:05Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker2005.codfw.wmnet 2477465 wikitext text/x-wiki 34hpo9ww8j259cul3ao6bjjvh3hul9a 2477466 2477465 2026-11-04T13:09:24Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker2005.codfw.wmnet 2477466 wikitext text/x-wiki 1r2hgpfkxe83ujrui0qt2d2xjaiodft 2477467 2477466 2026-11-04T13:09:28Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker2005.codfw.wmnet 2477467 wikitext text/x-wiki itx6jxmy372d1ah783zllcqnsjoeakv 2477468 2477467 2026-11-04T13:09:32Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker2006.codfw.wmnet 2477468 wikitext text/x-wiki dlc21e97hqgj0xpdszptk5hhd4k25e4 2477469 2477468 2026-11-04T13:10:05Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker2006.codfw.wmnet 2477469 wikitext text/x-wiki kut7a1b7v8l6fpj5319ox0elluzsgsz 2477470 2477469 2026-11-04T13:10:22Z Stashbot 7414 mszwarc@deploy2003: Started scap sync-world: Backport for SECURITY: AbuseLogLookup: Don't count logs the user can't see (T439885) ([[gerrit:1363090|1.48.0-wmf.1]], [[gerrit:1363091|1.48.0-wmf.3]]) 2477470 wikitext text/x-wiki eofrrl2b1xig1flpweu9l7dx3wzbada 2477472 2477470 2026-11-04T13:13:43Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2189 (T441633)', diff saved to https://phabricator.wikimedia.org/P97263 and previous config saved to /var/cache/conftool/dbconfig/20261104-131341-ladsgroup.json 2477472 wikitext text/x-wiki ncb28cjg0da5eb6495fyxfh3yve7cfv 2477473 2477472 2026-11-04T13:14:23Z Stashbot 7414 mszwarc@deploy2003: mszwarc: Backport for SECURITY: AbuseLogLookup: Don't count logs the user can't see (T439885) ([[gerrit:1363090|1.48.0-wmf.1]], [[gerrit:1363091|1.48.0-wmf.3]]) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2477473 wikitext text/x-wiki 04hv630e4z64bwyxkuw4e3dq92lxust 2477474 2477473 2026-11-04T13:15:25Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker2006.codfw.wmnet 2477474 wikitext text/x-wiki bmuo59gij0v0cfrjeu20n3np5xol4rk 2477475 2477474 2026-11-04T13:15:28Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker2006.codfw.wmnet 2477475 wikitext text/x-wiki rupb6gb4qv7pufz2i4s4v1p9b6wjywb 2477476 2477475 2026-11-04T13:15:33Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker2007.codfw.wmnet 2477476 wikitext text/x-wiki jof52grl0flvo7jvlz0qrm9lfh2nsvz 2477477 2477476 2026-11-04T13:15:42Z Stashbot 7414 mszwarc@deploy2003: mszwarc: Continuing with deployment 2477477 wikitext text/x-wiki kgfu5ncd1cy1w9yy48doz4czvi9i3ep 2477478 2477477 2026-11-04T13:16:07Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker2007.codfw.wmnet 2477478 wikitext text/x-wiki spn7klgsld7cmyqnh03u5kb165894j9 2477479 2477478 2026-11-04T13:17:16Z Stashbot 7414 moritzm: installing expat security updates 2477479 wikitext text/x-wiki apic4tllq3uj73cqim273fvuvboajzq 2477480 2477479 2026-11-04T13:21:27Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker2007.codfw.wmnet 2477480 wikitext text/x-wiki fvdcysgqi6am2ebtcfm7wk2uz87ghz9 2477481 2477480 2026-11-04T13:21:32Z Stashbot 7414 mszwarc@deploy2003: Finished scap sync-world: Backport for SECURITY: AbuseLogLookup: Don't count logs the user can't see (T439885) ([[gerrit:1363090|1.48.0-wmf.1]], [[gerrit:1363091|1.48.0-wmf.3]]) (duration: 11m 06s) 2477481 wikitext text/x-wiki moy8eg5vbl6ipm4kwhbcwxnbloqn0o0 2477482 2477481 2026-11-04T13:21:35Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker2007.codfw.wmnet 2477482 wikitext text/x-wiki 8ddhlgkdlp52un4e19gb2mwr7ax9nz8 2477483 2477482 2026-11-04T13:21:38Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker2008.codfw.wmnet 2477483 wikitext text/x-wiki ewm4whq9jotnmdjsmfwst7bgjiwufvr 2477484 2477483 2026-11-04T13:23:45Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2189', diff saved to https://phabricator.wikimedia.org/P97264 and previous config saved to /var/cache/conftool/dbconfig/20261104-132343-ladsgroup.json 2477484 wikitext text/x-wiki a6emtpcg8dauvga6d3y9ftnjr32zf4x 2477485 2477484 2026-11-04T13:26:38Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker2008.codfw.wmnet 2477485 wikitext text/x-wiki bpvdyby8xux8jl555tsk8yqqw22jo0j 2477486 2477485 2026-11-04T13:31:59Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker2008.codfw.wmnet 2477486 wikitext text/x-wiki 2tbvbva5z8n3x7ymrpw6a0cwxpwhqg7 2477487 2477486 2026-11-04T13:32:01Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker2008.codfw.wmnet 2477487 wikitext text/x-wiki 1i6npkqa1eazz6by3vq3u898i2dsdjv 2477488 2477487 2026-11-04T13:32:06Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker2009.codfw.wmnet 2477488 wikitext text/x-wiki 5o2lqw9c5ibykmvhza3fq0bo3hhee5z 2477489 2477488 2026-11-04T13:32:39Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker2009.codfw.wmnet 2477489 wikitext text/x-wiki 7c68phzgcfcc49y3u6tgav8mmlfag8o 2477490 2477489 2026-11-04T13:33:47Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2189', diff saved to https://phabricator.wikimedia.org/P97265 and previous config saved to /var/cache/conftool/dbconfig/20261104-133345-ladsgroup.json 2477490 wikitext text/x-wiki b2bfab7xjsw1ysyhv40xd1giyjqqnn1 2477491 2477490 2026-11-04T13:39:54Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker2009.codfw.wmnet 2477491 wikitext text/x-wiki tqdwku3w6valfr3m54ys7uklmb6ab8t 2477492 2477491 2026-11-04T13:39:58Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker2009.codfw.wmnet 2477492 wikitext text/x-wiki 76zk8gt49zxdayoqvubx9pdf15y4vqm 2477493 2477492 2026-11-04T13:40:02Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker2010.codfw.wmnet 2477493 wikitext text/x-wiki 97zey2rzp651cl1basvfr7ont6swdn5 2477494 2477493 2026-11-04T13:41:30Z Stashbot 7414 jelto@deploy2003: helmfile [aux-k8s-eqiad] START helmfile.d/aux-k8s-services/etherpad: apply 2477494 wikitext text/x-wiki 5sjr2wxju46nxqkj9nrfj9789jz3aec 2477495 2477494 2026-11-04T13:43:49Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2189 (T441633)', diff saved to https://phabricator.wikimedia.org/P97266 and previous config saved to /var/cache/conftool/dbconfig/20261104-134347-ladsgroup.json 2477495 wikitext text/x-wiki 4coluhqrys4lkj2ox2rez7m5y7mt2a9 2477496 2477495 2026-11-04T13:44:09Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2197.codfw.wmnet with reason: Maintenance 2477496 wikitext text/x-wiki rb94ivxw9osg2mgh8jgf3xjm90aidd5 2477497 2477496 2026-11-04T13:45:04Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker2010.codfw.wmnet 2477497 wikitext text/x-wiki pbvayeyotcz76a6nr5epmkjh5idrrd9 2477498 2477497 2026-11-04T13:49:51Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2207.codfw.wmnet with reason: Maintenance 2477498 wikitext text/x-wiki 2y5j2kqvrd2w441dfkztw4oo7epcoy4 2477499 2477498 2026-11-04T13:49:54Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db2207 (T441633)', diff saved to https://phabricator.wikimedia.org/P97267 and previous config saved to /var/cache/conftool/dbconfig/20261104-134951-ladsgroup.json 2477499 wikitext text/x-wiki mpj6evyfp1ffchkinw2sg9glngzvhcw 2477500 2477499 2026-11-04T13:52:23Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker2010.codfw.wmnet 2477500 wikitext text/x-wiki 72wk0jno9cxpbqquxlw6dk9velwp3rl 2477501 2477500 2026-11-04T13:52:27Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker2010.codfw.wmnet 2477501 wikitext text/x-wiki kerfb7hl4y0gkb1ikj6k3xscxe6qbnn 2477502 2477501 2026-11-04T13:52:31Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker2011.codfw.wmnet 2477502 wikitext text/x-wiki gij0c3nr9kaaojjx1kfxylyl2frj595 2477503 2477502 2026-11-04T13:53:03Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker2011.codfw.wmnet 2477503 wikitext text/x-wiki n87hbbv7396t8ova2q3z3rjr33bbeey 2477504 2477503 2026-11-04T13:57:03Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2207 (T441633)', diff saved to https://phabricator.wikimedia.org/P97268 and previous config saved to /var/cache/conftool/dbconfig/20261104-135701-ladsgroup.json 2477504 wikitext text/x-wiki l678lroz82p4248eb10shbyf433r3zf 2477506 2477504 2026-11-04T14:00:24Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker2011.codfw.wmnet 2477506 wikitext text/x-wiki lx0u5yp8b5zvhl10s4tzxk3zqaql7zd 2477507 2477506 2026-11-04T14:00:27Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker2011.codfw.wmnet 2477507 wikitext text/x-wiki mye480pywsdkgwkmj20lm00jnm8coyj 2477508 2477507 2026-11-04T14:00:30Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on A:dse-k8s-worker-codfw 2477508 wikitext text/x-wiki 7uh4eqkcskyhgmk2err4b86tldv0o5g 2477509 2477508 2026-11-04T14:01:42Z Stashbot 7414 jelto@deploy2003: helmfile [aux-k8s-eqiad] DONE helmfile.d/aux-k8s-services/etherpad: apply 2477509 wikitext text/x-wiki rr1qqhamrh7bcha3pspi0zg52xo32bi 2477510 2477509 2026-11-04T14:03:47Z Stashbot 7414 urbanecm@deploy2003: Started scap sync-world: Backport for [[gerrit:1362080|Re-enable NewUserMessage for viwikivoyage (T442485)]] 2477510 wikitext text/x-wiki 2iwfucbcqwu1566ummm2ud4k2rs66u3 2477511 2477510 2026-11-04T14:05:09Z Stashbot 7414 kamila@deploy2003: helmfile [eqiad] START helmfile.d/services/mw-web: apply 2477511 wikitext text/x-wiki 7sgk2x9mh2enjp9kkqxdnl68xu95dxr 2477512 2477511 2026-11-04T14:05:54Z Stashbot 7414 kamila@deploy2003: helmfile [eqiad] START helmfile.d/services/mw-web: apply 2477512 wikitext text/x-wiki dlg5o642p4q1avextknxjvm3cqt1pev 2477513 2477512 2026-11-04T14:06:08Z Stashbot 7414 kamila@deploy2003: helmfile [eqiad] DONE helmfile.d/services/mw-web: apply 2477513 wikitext text/x-wiki icymelr0ny37lnbn8f8p1v2gemhivon 2477514 2477513 2026-11-04T14:07:05Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2207', diff saved to https://phabricator.wikimedia.org/P97269 and previous config saved to /var/cache/conftool/dbconfig/20261104-140703-ladsgroup.json 2477514 wikitext text/x-wiki n6g8bnw6o4m8433ub0ro8gaxw3oq5qh 2477515 2477514 2026-11-04T14:08:23Z Stashbot 7414 urbanecm@deploy2003: urbanecm, nvdtn19: Backport for [[gerrit:1362080|Re-enable NewUserMessage for viwikivoyage (T442485)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2477515 wikitext text/x-wiki qrmopbdi1op9pt0s27r7wffp8gbvssp 2477516 2477515 2026-11-04T14:15:22Z Stashbot 7414 urbanecm@deploy2003: urbanecm, nvdtn19: Continuing with deployment 2477516 wikitext text/x-wiki p7nnx16bm055otl2nx9xvqtbzcfku3j 2477517 2477516 2026-11-04T14:15:55Z Stashbot 7414 urbanecm@deploy2003: Started scap sync-world: Backport for [[gerrit:1362080|Re-enable NewUserMessage for viwikivoyage (T442485)]], [[gerrit:1362144|Configure cookie-based enrollment in PHP 8.5 (T441689)]] 2477517 wikitext text/x-wiki m3ukzf20pxfj2vhynkdj5hiwywje6f4 2477518 2477517 2026-11-04T14:17:07Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2207', diff saved to https://phabricator.wikimedia.org/P97270 and previous config saved to /var/cache/conftool/dbconfig/20261104-141705-ladsgroup.json 2477518 wikitext text/x-wiki k71k64u7ksggvu2acc3kgqpcxcdbikt 2477519 2477518 2026-11-04T14:18:13Z Stashbot 7414 urbanecm@deploy2003: kamila, nvdtn19, urbanecm: Backport for [[gerrit:1362080|Re-enable NewUserMessage for viwikivoyage (T442485)]], [[gerrit:1362144|Configure cookie-based enrollment in PHP 8.5 (T441689)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2477519 wikitext text/x-wiki rra1dy0ec8684uq7jpxiltkgrovaslo 2477520 2477519 2026-11-04T14:19:21Z Stashbot 7414 urbanecm@deploy2003: kamila, nvdtn19, urbanecm: Continuing with deployment 2477520 wikitext text/x-wiki l4gx2nwo23b15qxgxos6na03rrc88z3 2477521 2477520 2026-11-04T14:27:09Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2207 (T441633)', diff saved to https://phabricator.wikimedia.org/P97272 and previous config saved to /var/cache/conftool/dbconfig/20261104-142707-ladsgroup.json 2477521 wikitext text/x-wiki ankmqhnu3ltdbdzukybr59y52i23vuk 2477522 2477521 2026-11-04T14:27:29Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2225.codfw.wmnet with reason: Maintenance 2477522 wikitext text/x-wiki asy0f89j5e78z52k26gkarobxd0b4l0 2477523 2477522 2026-11-04T14:27:32Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db2225 (T441633)', diff saved to https://phabricator.wikimedia.org/P97273 and previous config saved to /var/cache/conftool/dbconfig/20261104-142729-ladsgroup.json 2477523 wikitext text/x-wiki l85l4ok1u7mdzs4dhk5lhk2osmnj4em 2477524 2477523 2026-11-04T14:32:32Z Stashbot 7414 pt1979@cumin1004: START - Cookbook sre.dns.admin DNS admin: depool eqsin [reason: router upgrade, T416563] 2477524 wikitext text/x-wiki 7gm2oxqy92tnwcvox183r5d812c9ipg 2477525 2477524 2026-11-04T14:32:50Z Stashbot 7414 pt1979@cumin1004: END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: depool eqsin [reason: router upgrade, T416563] 2477525 wikitext text/x-wiki nql1h9pnmz72z3ixsnw1ox35xp2cv9n 2477526 2477525 2026-11-04T14:33:07Z Stashbot 7414 cwilliams@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts db1176.eqiad.wmnet 2477526 wikitext text/x-wiki rscm2amob2itacmo83fzfkk43z0pol9 2477527 2477526 2026-11-04T14:34:36Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2225 (T441633)', diff saved to https://phabricator.wikimedia.org/P97274 and previous config saved to /var/cache/conftool/dbconfig/20261104-143434-ladsgroup.json 2477527 wikitext text/x-wiki l6nya35pffjibfsg5jaw1hsyy5tq3w5 2477529 2477527 2026-11-04T14:38:37Z Stashbot 7414 atsuko@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-dumps: apply 2477529 wikitext text/x-wiki fws63wd0oksfoq6gtdymmb3nomzv1hp 2477530 2477529 2026-11-04T14:39:24Z Stashbot 7414 atsuko@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-dumps: apply 2477530 wikitext text/x-wiki jmqf8wh6y5e4rasxoq3pp6vpnzu0ljl 2477531 2477530 2026-11-04T14:42:17Z Stashbot 7414 pt1979@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cr2-eqsin,cr2-eqsin IPv6,cr2-eqsin.mgmt with reason: Junos upgrade 2477531 wikitext text/x-wiki 4dh2ldijm8z2rnbflt3anp32513ah4y 2477532 2477531 2026-11-04T14:43:05Z Stashbot 7414 kamila@deploy2003: helmfile [eqiad] START helmfile.d/services/mw-web: apply 2477532 wikitext text/x-wiki 1l5xtxzc8owrpva05yiy6do450aapuu 2477533 2477532 2026-11-04T14:44:38Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2225', diff saved to https://phabricator.wikimedia.org/P97275 and previous config saved to /var/cache/conftool/dbconfig/20261104-144436-ladsgroup.json 2477533 wikitext text/x-wiki raq5hsxguqlwy0izd39d5i1k1mvgcyx 2477534 2477533 2026-11-04T14:45:27Z Stashbot 7414 urbanecm@deploy2003: Finished scap sync-world: Backport for [[gerrit:1362080|Re-enable NewUserMessage for viwikivoyage (T442485)]], [[gerrit:1362144|Configure cookie-based enrollment in PHP 8.5 (T441689)]] (duration: 29m 32s) 2477534 wikitext text/x-wiki rutqt43zmiyyo8eclykxebr6nwfsejf 2477535 2477534 2026-11-04T14:46:03Z Stashbot 7414 urbanecm@deploy2003: Started scap sync-world: Backport for [[gerrit:1350687|Rename project namespace on Madurese Wiktionary (T440137)]] 2477535 wikitext text/x-wiki euo2l0ck8h8gvr1bhaqf5gupis20va9 2477537 2477535 2026-11-04T14:48:36Z Stashbot 7414 urbanecm@deploy2003: urbanecm, amire80: Backport for [[gerrit:1350687|Rename project namespace on Madurese Wiktionary (T440137)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2477537 wikitext text/x-wiki pmdzm9hy016iv7fgcqq37z9ovccu368 2477539 2477537 2026-11-04T14:49:08Z Stashbot 7414 cwilliams@cumin1004: END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts db1176.eqiad.wmnet 2477539 wikitext text/x-wiki nykqetww2wf288dk5dyw11bb3fdeuk9 2477540 2477539 2026-11-04T14:49:55Z Stashbot 7414 urbanecm@deploy2003: urbanecm, amire80: Continuing with deployment 2477540 wikitext text/x-wiki cib0198yfp3tbx3qqb2y1qujcpzsavj 2477541 2477540 2026-11-04T14:54:40Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2225', diff saved to https://phabricator.wikimedia.org/P97277 and previous config saved to /var/cache/conftool/dbconfig/20261104-145438-ladsgroup.json 2477541 wikitext text/x-wiki 462862clmih9vhff1hauu0ygte7cfcy 2477543 2477541 2026-11-04T14:57:17Z Stashbot 7414 urbanecm@deploy2003: Finished scap sync-world: Backport for [[gerrit:1350687|Rename project namespace on Madurese Wiktionary (T440137)]] (duration: 11m 14s) 2477543 wikitext text/x-wiki s02m2qnks7fbm3xhon8gyw6dbozwdgp 2477544 2477543 2026-11-04T14:59:07Z Stashbot 7414 urbanecm@deploy2003: mwscript-k8s job started: namespaceDupes.php --wiki=madwiktionary # T440137 2477544 wikitext text/x-wiki m0bukiino3l4p53i5ka0v6jy8l8u7xw 2477545 2477544 2026-11-04T14:59:21Z Stashbot 7414 urbanecm@deploy2003: mwscript-k8s job started: namespaceDupes.php --wiki=madwiktionary --fix # T440137 2477545 wikitext text/x-wiki iz5j1jhy7peenf8csdgn25oetyz9r7l 2477546 2477545 2026-11-04T14:59:35Z Stashbot 7414 urbanecm@deploy2003: mwscript-k8s job started: namespaceDupes.php --wiki=madwiktionary # T440137 2477546 wikitext text/x-wiki j2zzyotgd84e1yudljdne6j7f8drk11 2477547 2477546 2026-11-04T15:00:07Z Stashbot 7414 urbanecm@deploy2003: mwscript-k8s job started: namespaceDupes.php --wiki=madwiktionary --add-prefix=BROKEN --fix # T440137 2477547 wikitext text/x-wiki s4bhbfk46946sb5gl5ypt3dv0jamj8j 2477548 2477547 2026-11-04T15:00:23Z Stashbot 7414 urbanecm@deploy2003: mwscript-k8s job started: namespaceDupes.php --wiki=madwiktionary # T440137 2477548 wikitext text/x-wiki 6weiqdljojpwj462h4wylftgr306h77 2477549 2477548 2026-11-04T15:00:49Z Stashbot 7414 sbisson@deploy2003: Started scap sync-world: Backport for [[gerrit:1357358|ArticleGuidance: Enable the reference risk model in production (T442164)]], [[gerrit:1362118|Load ArticleGuidance on all Wikipedias (T442035)]] 2477549 wikitext text/x-wiki pakomz2menys6iaxlcwegrnltjelrjp 2477551 2477549 2026-11-04T15:01:28Z Stashbot 7414 jforrester@deploy2003: Started scap deploy-service wikifunctions: Weekly service deploy, function-evaluators first (1363247) 2477551 wikitext text/x-wiki ouuohiq87e7gat9lpjmsqpmalyx9pb1 2477552 2477551 2026-11-04T15:01:31Z Stashbot 7414 jforrester@deploy2003: scap deploy-service wikifunctions: [STAGING/DEFAULT] staging-eqiad Deploying wikifunctions 2477552 wikitext text/x-wiki 4a7ynvwizu2rfbpu2zbkmwc1f6tiovv 2477553 2477552 2026-11-04T15:02:34Z Stashbot 7414 jforrester@deploy2003: scap deploy-service wikifunctions: [PRODUCTION/DEFAULT] eqiad Deploying wikifunctions 2477553 wikitext text/x-wiki lian6n1wd6n7ugjnd8rwfwocw0pmwrs 2477554 2477553 2026-11-04T15:03:23Z Stashbot 7414 jforrester@deploy2003: scap deploy-service wikifunctions: [PRODUCTION/DEFAULT] codfw Deploying wikifunctions 2477554 wikitext text/x-wiki faideogt63o5qrv2seljg34oqhih0dn 2477555 2477554 2026-11-04T15:03:41Z Stashbot 7414 cwilliams@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on 8 hosts with reason: Testing 2477555 wikitext text/x-wiki mmemz2fa68jntpa412ii9v2peol7gtp 2477556 2477555 2026-11-04T15:03:56Z Stashbot 7414 jforrester@deploy2003: Finished scap deploy-service wikifunctions: Weekly service deploy, function-evaluators first (1363247) (duration: 02m 28s) 2477556 wikitext text/x-wiki anfovm66t1wtupm3eovy1xiaouj47du 2477557 2477556 2026-11-04T15:04:42Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2225 (T441633)', diff saved to https://phabricator.wikimedia.org/P97278 and previous config saved to /var/cache/conftool/dbconfig/20261104-150440-ladsgroup.json 2477557 wikitext text/x-wiki azqol6vo5tn6wx74mp8lmbs6adsec36 2477558 2477557 2026-11-04T15:05:02Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2226.codfw.wmnet with reason: Maintenance 2477558 wikitext text/x-wiki alw9jie9ufzfd6c6f8he10ixnv0noih 2477559 2477558 2026-11-04T15:05:05Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db2226 (T441633)', diff saved to https://phabricator.wikimedia.org/P97279 and previous config saved to /var/cache/conftool/dbconfig/20261104-150502-ladsgroup.json 2477559 wikitext text/x-wiki 7gvwaoyc9m0hh4vxsu8fa4fxhupv4bq 2477560 2477559 2026-11-04T15:05:09Z Stashbot 7414 papaul: start maintenance on cr2-eqsin 2477560 wikitext text/x-wiki qls29rdncak5u01dx7oectnp26yiob9 2477561 2477560 2026-11-04T15:05:52Z Stashbot 7414 sbisson@deploy2003: sbisson: Backport for [[gerrit:1357358|ArticleGuidance: Enable the reference risk model in production (T442164)]], [[gerrit:1362118|Load ArticleGuidance on all Wikipedias (T442035)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2477561 wikitext text/x-wiki 3wpww3cam0atu8ymzzih912g44pcn0h 2477562 2477561 2026-11-04T15:06:31Z Stashbot 7414 jforrester@deploy2003: Started scap deploy-service wikifunctions: Weekly service deploy, function-orchestrator second (1363248) 2477562 wikitext text/x-wiki cp6eqwk7uigclrcav71r00cp759zlhr 2477563 2477562 2026-11-04T15:06:34Z Stashbot 7414 jforrester@deploy2003: scap deploy-service wikifunctions: [STAGING/DEFAULT] staging-eqiad Deploying wikifunctions 2477563 wikitext text/x-wiki 297bq58jcry0skhn2ctwl3k6nuwb2j0 2477564 2477563 2026-11-04T15:06:55Z Stashbot 7414 jforrester@deploy2003: scap deploy-service wikifunctions: [PRODUCTION/DEFAULT] eqiad Deploying wikifunctions 2477564 wikitext text/x-wiki giyd4pbzg0jdqjod9v5yg6lpweemg9x 2477565 2477564 2026-11-04T15:07:21Z Stashbot 7414 sbisson@deploy2003: sbisson: Continuing with deployment 2477565 wikitext text/x-wiki cge178c2w9w3whazkstqk9stwz4rfgf 2477566 2477565 2026-11-04T15:07:41Z Stashbot 7414 jforrester@deploy2003: scap deploy-service wikifunctions: [PRODUCTION/DEFAULT] codfw Deploying wikifunctions 2477566 wikitext text/x-wiki 9a4vrez1oe2598eqp2t2gyx8ao3zx81 2477567 2477566 2026-11-04T15:08:02Z Stashbot 7414 cwilliams@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts db1176.eqiad.wmnet 2477567 wikitext text/x-wiki 2lfjlzzvm3fioqjx5s1n1s05pzf45re 2477568 2477567 2026-11-04T15:08:16Z Stashbot 7414 jforrester@deploy2003: Finished scap deploy-service wikifunctions: Weekly service deploy, function-orchestrator second (1363248) (duration: 01m 46s) 2477568 wikitext text/x-wiki r52ys81kqtzs41gi3ozgvbk61qren61 2477569 2477568 2026-11-04T15:10:46Z Stashbot 7414 cwilliams@cumin1004: START - Cookbook sre.hosts.reboot-single for host db1176.eqiad.wmnet 2477569 wikitext text/x-wiki nukmwewb17nmmizfc7bc6804opvz49s 2477570 2477569 2026-11-04T15:11:52Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2226 (T441633)', diff saved to and previous config saved to /var/cache/conftool/dbconfig/20261104-151151-ladsgroup.json 2477570 wikitext text/x-wiki aswcid2cr70pkqkibmbeb61s1r864is 2477571 2477570 2026-11-04T15:12:00Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.reboot-nodes rolling reboot on A:dse-k8s-worker-eqiad 2477571 wikitext text/x-wiki a8b2ingk1onq5y7mqiextj24wbjd3js 2477572 2477571 2026-11-04T15:12:04Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-wdqs1001.eqiad.wmnet 2477572 wikitext text/x-wiki 0w0qtf8dhzvp7cm5miq7japq1u1xmzg 2477573 2477572 2026-11-04T15:12:38Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-wdqs1001.eqiad.wmnet 2477573 wikitext text/x-wiki 01v36ui1tjjad1jiwitjgl6eelonmze 2477574 2477573 2026-11-04T15:13:18Z Stashbot 7414 sbisson@deploy2003: Finished scap sync-world: Backport for [[gerrit:1357358|ArticleGuidance: Enable the reference risk model in production (T442164)]], [[gerrit:1362118|Load ArticleGuidance on all Wikipedias (T442035)]] (duration: 12m 29s) 2477574 wikitext text/x-wiki mi8r7hp4urc9unbf66rnruya9zfrnqb 2477575 2477574 2026-11-04T15:18:46Z Stashbot 7414 cwilliams@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1176.eqiad.wmnet 2477575 wikitext text/x-wiki am51d0v4fmwc5qzzic2b5n8l9miboxd 2477576 2477575 2026-11-04T15:18:49Z Stashbot 7414 cwilliams@cumin1004: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts db1176.eqiad.wmnet 2477576 wikitext text/x-wiki ptgzq8xjpxt2hyi6abbvhyxyxwv18n4 2477577 2477576 2026-11-04T15:19:38Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-wdqs1001.eqiad.wmnet 2477577 wikitext text/x-wiki sk70mxj23re88clswzvg6xa5s8ws3xz 2477578 2477577 2026-11-04T15:19:41Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-wdqs1001.eqiad.wmnet 2477578 wikitext text/x-wiki 7w1sjg7yuu4fo2mnvvr5mn5tfx1d25h 2477579 2477578 2026-11-04T15:19:45Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-wdqs1002.eqiad.wmnet 2477579 wikitext text/x-wiki 1cffg6827490uiax3lbiupaq5iriloq 2477580 2477579 2026-11-04T15:20:20Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-wdqs1002.eqiad.wmnet 2477580 wikitext text/x-wiki btpbtfq63a4vmykyaztj78a6fe5y1jm 2477581 2477580 2026-11-04T15:21:54Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2226', diff saved to https://phabricator.wikimedia.org/P97280 and previous config saved to /var/cache/conftool/dbconfig/20261104-152152-ladsgroup.json 2477581 wikitext text/x-wiki qoaz8cfy27bfwr0knm6avg8n79yrmzf 2477582 2477581 2026-11-04T15:22:15Z Stashbot 7414 kharlan@deploy2003: Started scap sync-world: Backport for [[gerrit:1363260|AbuseReview: Add undo and rollback links to all queues (T443591)]] (1.48.0-wmf.3) 2477582 wikitext text/x-wiki fuv3u370pdt7ue4ml1causm9uxwarm1 2477583 2477582 2026-11-04T15:24:32Z Stashbot 7414 kharlan@deploy2003: kharlan: Backport for [[gerrit:1363260|AbuseReview: Add undo and rollback links to all queues (T443591)]] (1.48.0-wmf.3) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2477583 wikitext text/x-wiki agre35uzmgptk9kvt9c9sjpp1e3up7o 2477584 2477583 2026-11-04T15:25:09Z Stashbot 7414 kharlan@deploy2003: kharlan: Continuing with deployment 2477584 wikitext text/x-wiki mz4s8qhiw8o8o70kzy979tu7ut1q3x4 2477585 2477584 2026-11-04T15:25:43Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-wdqs1002.eqiad.wmnet 2477585 wikitext text/x-wiki a6y0457h9aa48fet36wwd4ymc6qojv5 2477586 2477585 2026-11-04T15:25:46Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-wdqs1002.eqiad.wmnet 2477586 wikitext text/x-wiki 9il9fddp9dn2ded2mrzcqip5pz46fi6 2477587 2477586 2026-11-04T15:25:49Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-wdqs1003.eqiad.wmnet 2477587 wikitext text/x-wiki pxu4i5gbtad53b18abxdz14sufhnlzm 2477589 2477587 2026-11-04T15:26:17Z Stashbot 7414 atsuko@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-dumps: apply 2477589 wikitext text/x-wiki fxroe58uxeeteizgmvf6ejdpnliys2l 2477590 2477589 2026-11-04T15:26:24Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-wdqs1003.eqiad.wmnet 2477590 wikitext text/x-wiki kd084rfw6zv1q3xurb4sp6j2ll1zh31 2477591 2477590 2026-11-04T15:28:50Z Stashbot 7414 atsuko@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-dumps: apply 2477591 wikitext text/x-wiki kyoiz3gy5zrddav8c3cl3e3xmvrk736 2477592 2477591 2026-11-04T15:31:29Z Stashbot 7414 kharlan@deploy2003: Finished scap sync-world: Backport for [[gerrit:1363260|AbuseReview: Add undo and rollback links to all queues (T443591)]] (1.48.0-wmf.3) (duration: 09m 14s) 2477592 wikitext text/x-wiki kvhfhqnrlz3udp27321hnobopxiyf2c 2477593 2477592 2026-11-04T15:31:56Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2226', diff saved to https://phabricator.wikimedia.org/P97281 and previous config saved to /var/cache/conftool/dbconfig/20261104-153154-ladsgroup.json 2477593 wikitext text/x-wiki 9odkwj7qo1cjeidprc7cnpzah76jam0 2477594 2477593 2026-11-04T15:33:21Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-wdqs1003.eqiad.wmnet 2477594 wikitext text/x-wiki 0yn4dmnndihnwf8rfsbviojgo8rujuu 2477595 2477594 2026-11-04T15:33:24Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-wdqs1003.eqiad.wmnet 2477595 wikitext text/x-wiki gmg7iq0e067rp88wu19kg1zin1n3yho 2477597 2477595 2026-11-04T15:33:28Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-wdqs1004.eqiad.wmnet 2477597 wikitext text/x-wiki jys779oeyy0v234mdeaauwjguasfmza 2477598 2477597 2026-11-04T15:33:31Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-wdqs1004.eqiad.wmnet 2477598 wikitext text/x-wiki 0nv4a9jhq79f0afe7f48ms4l82tiuzt 2477599 2477598 2026-11-04T15:39:05Z Stashbot 7414 atsuko@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2477599 wikitext text/x-wiki nritotntbam5o87r5p61k9xn2lrsdc2 2477600 2477599 2026-11-04T15:40:17Z Stashbot 7414 atsuko@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2477600 wikitext text/x-wiki d9irtbuysgdj6db9mw85vmhwjg8cab5 2477601 2477600 2026-11-04T15:40:23Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-wdqs1004.eqiad.wmnet 2477601 wikitext text/x-wiki r5q6mqjpreduowgf92mdbwlvh5sjfxp 2477602 2477601 2026-11-04T15:40:26Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-wdqs1004.eqiad.wmnet 2477602 wikitext text/x-wiki ahgstusu5yal0ltjek8ckfi6nqwbquk 2477603 2477602 2026-11-04T15:40:30Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-wdqs-test1001.eqiad.wmnet 2477603 wikitext text/x-wiki 13nyk34hup7q1a2gg3wvmtvroi0n9mo 2477604 2477603 2026-11-04T15:41:05Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-wdqs-test1001.eqiad.wmnet 2477604 wikitext text/x-wiki rzc91pimkzsyta6eiwgtxfbgkzdu8cr 2477605 2477604 2026-11-04T15:41:59Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2226 (T441633)', diff saved to https://phabricator.wikimedia.org/P97282 and previous config saved to /var/cache/conftool/dbconfig/20261104-154156-ladsgroup.json 2477605 wikitext text/x-wiki arc6ubdlpm48vvq3218hdpwe43wijtz 2477606 2477605 2026-11-04T15:42:18Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2238.codfw.wmnet with reason: Maintenance 2477606 wikitext text/x-wiki fxxhngwwy1x4vl35wy735mb3wqj1apk 2477607 2477606 2026-11-04T15:42:21Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db2238 (T441633)', diff saved to https://phabricator.wikimedia.org/P97283 and previous config saved to /var/cache/conftool/dbconfig/20261104-154218-ladsgroup.json 2477607 wikitext text/x-wiki i8flu1v7hjq3fw88jd8q6klhpnppg6b 2477612 2477607 2026-11-04T15:46:50Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.dns.netbox 2477612 wikitext text/x-wiki 63ief68qmg0pfyx47zmurin4aomdytx 2477613 2477612 2026-11-04T15:48:25Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-wdqs-test1001.eqiad.wmnet 2477613 wikitext text/x-wiki msc539q9o8ft9qiyy2zppxf35mp7o5o 2477614 2477613 2026-11-04T15:48:28Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-wdqs-test1001.eqiad.wmnet 2477614 wikitext text/x-wiki amyjuriowobcsqxyoqu2xg9no7bonx6 2477615 2477614 2026-11-04T15:48:31Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1001.eqiad.wmnet 2477615 wikitext text/x-wiki qnyxewwts5fqh6syb11rvw5v9packtq 2477616 2477615 2026-11-04T15:49:02Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1001.eqiad.wmnet 2477616 wikitext text/x-wiki abzipb818c657rpgtu6o87i3i5o00k0 2477617 2477616 2026-11-04T15:49:44Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2238 (T441633)', diff saved to https://phabricator.wikimedia.org/P97284 and previous config saved to /var/cache/conftool/dbconfig/20261104-154941-ladsgroup.json 2477617 wikitext text/x-wiki n4345du3utscb74aqo9ea7dqvnkfx02 2477618 2477617 2026-11-04T15:51:19Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: remove old cr2-eqord lo IPs - ayounsi@cumin1004" 2477618 wikitext text/x-wiki 9r12psaienfvrf7hm0pgv6cff88e5lq 2477619 2477618 2026-11-04T15:51:22Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: remove old cr2-eqord lo IPs - ayounsi@cumin1004" 2477619 wikitext text/x-wiki r5hbe3s582nu9mzxkd0aotv6n7cvryu 2477620 2477619 2026-11-04T15:51:25Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2477620 wikitext text/x-wiki cr9iwbfngvw766t7fw1h2l1ghrnlgen 2477622 2477620 2026-11-04T15:56:32Z Stashbot 7414 kamila@deploy2003: Started scap sync-world: Backport for [[gerrit:1363270|Enroll 1% of client sessions in PHP 8.5 (T441689)]] 2477622 wikitext text/x-wiki dpsfor3pk0nbtp3vnoe6kz03d89tppp 2477626 2477622 2026-11-04T15:58:48Z Stashbot 7414 kamila@deploy2003: kamila: Backport for [[gerrit:1363270|Enroll 1% of client sessions in PHP 8.5 (T441689)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2477626 wikitext text/x-wiki el6v8ps13klck15kmxoxqjeok7z0vfq 2477627 2477626 2026-11-04T15:59:08Z Stashbot 7414 pt1979@cumin1004: START - Cookbook sre.hosts.remove-downtime for cr2-eqsin,cr2-eqsin IPv6,cr2-eqsin.mgmt 2477627 wikitext text/x-wiki 3p0ecgqb3nb6rvwcrwxocok1bj1egen 2477628 2477627 2026-11-04T15:59:12Z Stashbot 7414 pt1979@cumin1004: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cr2-eqsin,cr2-eqsin IPv6,cr2-eqsin.mgmt 2477628 wikitext text/x-wiki gbwmwzw86vudxnn74vm43nzuftmcd35 2477629 2477628 2026-11-04T15:59:45Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2238', diff saved to https://phabricator.wikimedia.org/P97285 and previous config saved to /var/cache/conftool/dbconfig/20261104-155943-ladsgroup.json 2477629 wikitext text/x-wiki it470jlqt5sesisxybntzk4zjaiuxma 2477630 2477629 2026-11-04T16:00:26Z Stashbot 7414 kamila@deploy2003: kamila: Continuing with deployment 2477630 wikitext text/x-wiki qjunw0h6tpafwbwnrk794q0f9qyi127 2477631 2477630 2026-11-04T16:03:21Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1001.eqiad.wmnet 2477631 wikitext text/x-wiki sct3vslz9n577kv5up69c3vtwgbhotp 2477632 2477631 2026-11-04T16:03:25Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1001.eqiad.wmnet 2477632 wikitext text/x-wiki mwfwdtuu3bje7uy3qdhjnm74fywccbb 2477633 2477632 2026-11-04T16:03:31Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1002.eqiad.wmnet 2477633 wikitext text/x-wiki no1e9flqqsxapp8zvg0misv5ij2why6 2477635 2477633 2026-11-04T16:03:50Z Stashbot 7414 pt1979@cumin1004: START - Cookbook sre.dns.admin DNS admin: pool eqsin [reason: no reason specified, T416563] 2477635 wikitext text/x-wiki f6n9eejna1o38lf9vur3m5p5tocodej 2477636 2477635 2026-11-04T16:03:58Z Stashbot 7414 pt1979@cumin1004: END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: pool eqsin [reason: no reason specified, T416563] 2477636 wikitext text/x-wiki 4wmkjir52jgkl0sp0aywhyfhe6vrvku 2477637 2477636 2026-11-04T16:06:33Z Stashbot 7414 kamila@deploy2003: Finished scap sync-world: Backport for [[gerrit:1363270|Enroll 1% of client sessions in PHP 8.5 (T441689)]] (duration: 10m 02s) 2477637 wikitext text/x-wiki b8bjw7dea3quxq1eevpulyn23wq34i5 2477638 2477637 2026-11-04T16:09:47Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2238', diff saved to https://phabricator.wikimedia.org/P97286 and previous config saved to /var/cache/conftool/dbconfig/20261104-160946-ladsgroup.json 2477638 wikitext text/x-wiki ms2piogvdkh72ene38x1c5lxxly17vm 2477639 2477638 2026-11-04T16:18:49Z Stashbot 7414 gmodena@deploy2003: helmfile [staging] START helmfile.d/services/rest-gateway: apply 2477639 wikitext text/x-wiki tk5edd72nzdq787f04o09exv8txv02w 2477640 2477639 2026-11-04T16:19:02Z Stashbot 7414 gmodena@deploy2003: helmfile [staging] DONE helmfile.d/services/rest-gateway: apply 2477640 wikitext text/x-wiki izgg45zvx7tbsbi2fwien91x4raiiix 2477642 2477640 2026-11-04T16:19:50Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2238 (T441633)', diff saved to https://phabricator.wikimedia.org/P97287 and previous config saved to /var/cache/conftool/dbconfig/20261104-161948-ladsgroup.json 2477642 wikitext text/x-wiki fnyhs7xm5ejle91gtaz8rtgsxztxmti 2477644 2477642 2026-11-04T16:21:54Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.wdqs.data-transfer (T441682, seed eqiad with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs1011.eqiad.wmnet, repooling both afterwards 2477644 wikitext text/x-wiki 9eexz9l9tf0k2pv94wc7r3xgv1uu7mi 2477645 2477644 2026-11-04T16:29:51Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, seed eqiad with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs1011.eqiad.wmnet, repooling both afterwards 2477645 wikitext text/x-wiki t2rzpw7dvmewtt1hz5mwbdah5niabis 2477646 2477645 2026-11-04T16:31:48Z Stashbot 7414 gmodena@deploy2003: helmfile [eqiad] START helmfile.d/services/rest-gateway: apply 2477646 wikitext text/x-wiki sp9dc4e17rxfvptwfwpap86sm1uus2z 2477647 2477646 2026-11-04T16:32:06Z Stashbot 7414 gmodena@deploy2003: helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply 2477647 wikitext text/x-wiki kbkkad87n6hfi3ho417v20qiiqye72f 2477648 2477647 2026-11-04T16:33:34Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1002.eqiad.wmnet 2477648 wikitext text/x-wiki pzaterwh21lw4ym1ytdyl92ty23u8jl 2477649 2477648 2026-11-04T16:36:24Z Stashbot 7414 gmodena@deploy2003: helmfile [codfw] START helmfile.d/services/rest-gateway: apply 2477649 wikitext text/x-wiki ddzftsqt5axn34bt1009bj1oymvnb89 2477650 2477649 2026-11-04T16:36:39Z Stashbot 7414 gmodena@deploy2003: helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply 2477650 wikitext text/x-wiki in2fdgwxawiqbfnqt7r5f5qcy093e10 2477653 2477650 2026-11-04T16:46:59Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1002.eqiad.wmnet 2477653 wikitext text/x-wiki 3fb8gt4s0yk3dfq3g8rcuvyztnol9tt 2477654 2477653 2026-11-04T16:47:02Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1002.eqiad.wmnet 2477654 wikitext text/x-wiki 3u9iza8on6cn4js4i0k7kh3fkrfs7w0 2477655 2477654 2026-11-04T16:47:06Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1003.eqiad.wmnet 2477655 wikitext text/x-wiki iz5gc0bnu93yfepp5161waifi3rcxys 2477656 2477655 2026-11-04T16:47:42Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1003.eqiad.wmnet 2477656 wikitext text/x-wiki nh7epyvm4hvoov8ug8mjc3pa071yvxc 2477657 2477656 2026-11-04T16:51:01Z Stashbot 7414 ladsgroup@deploy2003: Started scap sync-world: Backport for [[gerrit:1356470|Redesign 503 pages (T129433)]] 2477657 wikitext text/x-wiki 6q37hztksdm92jpal3o4ndrcjvkrhd1 2477659 2477657 2026-11-04T16:53:18Z Stashbot 7414 ladsgroup@deploy2003: ladsgroup: Backport for [[gerrit:1356470|Redesign 503 pages (T129433)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2477659 wikitext text/x-wiki o62m3uaat4er3de2rvhl9hx93rixywn 2477661 2477659 2026-11-04T16:56:20Z Stashbot 7414 ladsgroup@deploy2003: ladsgroup: Continuing with deployment 2477661 wikitext text/x-wiki luxdle2ca5vfc5udxj7w292ome2dfot 2477662 2477661 2026-11-04T16:58:41Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1003.eqiad.wmnet 2477662 wikitext text/x-wiki mkfkhttg29463ht8vywhkumcrxkwv9q 2477663 2477662 2026-11-04T16:58:44Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1003.eqiad.wmnet 2477663 wikitext text/x-wiki 4o87iomx2yle2o02rv0ycj6ox6u5a3z 2477664 2477663 2026-11-04T16:58:48Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1004.eqiad.wmnet 2477664 wikitext text/x-wiki knjw9fd7j9zdczuxl02nukclr4r3val 2477665 2477664 2026-11-04T16:59:20Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1004.eqiad.wmnet 2477665 wikitext text/x-wiki 43j85aaddc6jupjwe7z2ujlqcm1ls5b 2477666 2477665 2026-11-04T17:02:20Z Stashbot 7414 ladsgroup@deploy2003: Finished scap sync-world: Backport for [[gerrit:1356470|Redesign 503 pages (T129433)]] (duration: 11m 19s) 2477666 wikitext text/x-wiki 9f5hy96905antyi5k4xh699z2zb1clk 2477667 2477666 2026-11-04T17:02:29Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hadoop.reboot-workers for Hadoop analytics cluster 2477667 wikitext text/x-wiki oto97psxzk90jc575m8rclhtchttcwl 2477668 2477667 2026-11-04T17:07:31Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1004.eqiad.wmnet 2477668 wikitext text/x-wiki ee1ajsh0db106dy1j6rpw6471u05kiy 2477669 2477668 2026-11-04T17:07:33Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1004.eqiad.wmnet 2477669 wikitext text/x-wiki e23ylhptnvo4rhg9umzdim01vegkmu3 2477670 2477669 2026-11-04T17:07:38Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1005.eqiad.wmnet 2477670 wikitext text/x-wiki ogl66vdxlqx7ct2s24ifuxxmpdrjkhf 2477671 2477670 2026-11-04T17:13:09Z Stashbot 7414 cmooney@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on lsw1-b3-eqiad,ssw1-a[1,8]-eqiad with reason: desperate troubleshooting measure 2477671 wikitext text/x-wiki g2i9ddhpzhbo70uz8xc1by9w5baxp81 2477675 2477671 2026-11-04T17:26:17Z Stashbot 7414 jhancock@cumin2003: START - Cookbook sre.hosts.provision for host wikikube-worker2337.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART 2477675 wikitext text/x-wiki oe23s6sc0ebqukb2499p893070zfx3t 2477676 2477675 2026-11-04T17:26:38Z Stashbot 7414 fabfur: apt: included haproxykafka 0.3.18 into trixie-wikimedia (T443632) 2477676 wikitext text/x-wiki erryfw3pli7aycccqclguzut7zzia6k 2477677 2477676 2026-11-04T17:31:46Z Stashbot 7414 jhancock@cumin2003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2337.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART 2477677 wikitext text/x-wiki pmrcqcb5tygxy0ic3j8bc6fbqreywd8 2477680 2477677 2026-11-04T17:37:40Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1005.eqiad.wmnet 2477680 wikitext text/x-wiki rggwsu2md6rqglg692vgab13rbphcpm 2477683 2477680 2026-11-04T17:44:38Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1005.eqiad.wmnet 2477683 wikitext text/x-wiki n4pzcmzcxdj6umqhzv73kekses4z9po 2477684 2477683 2026-11-04T17:44:41Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1005.eqiad.wmnet 2477684 wikitext text/x-wiki iw7ehansx4p39uxsx3babe1oqhhvtnz 2477685 2477684 2026-11-04T17:44:45Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1006.eqiad.wmnet 2477685 wikitext text/x-wiki gtdmetla700z1ksv26b7phrhb1d3r2g 2477686 2477685 2026-11-04T17:45:17Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1006.eqiad.wmnet 2477686 wikitext text/x-wiki 1i8tavrbw3deynkjxew64xwyw5edyip 2477687 2477686 2026-11-04T17:45:36Z Stashbot 7414 ariel@deploy2003: helmfile [staging] START helmfile.d/services/changeprop: apply 2477687 wikitext text/x-wiki dk49eq700vguzuyin0fxdfllk0zv100 2477688 2477687 2026-11-04T17:46:26Z Stashbot 7414 ariel@deploy2003: helmfile [staging] DONE helmfile.d/services/changeprop: apply 2477688 wikitext text/x-wiki auh643hf6fasxjihs5wkm5lrn1knvpu 2477689 2477688 2026-11-04T17:47:25Z Stashbot 7414 ariel@deploy2003: helmfile [eqiad] START helmfile.d/services/changeprop: apply 2477689 wikitext text/x-wiki k8589y8ii95eqrvbc1bi7u1ey2dcls9 2477690 2477689 2026-11-04T17:48:05Z Stashbot 7414 ariel@deploy2003: helmfile [eqiad] DONE helmfile.d/services/changeprop: apply 2477690 wikitext text/x-wiki epe2w9ommbjqyr9o8flrd1a4dg3vw72 2477691 2477690 2026-11-04T17:48:29Z Stashbot 7414 ariel@deploy2003: helmfile [codfw] START helmfile.d/services/changeprop: apply 2477691 wikitext text/x-wiki flilb4kfndfskhqkced2eqzl5y7za62 2477692 2477691 2026-11-04T17:49:08Z Stashbot 7414 ariel@deploy2003: helmfile [codfw] DONE helmfile.d/services/changeprop: apply 2477692 wikitext text/x-wiki higfb9prqlo00v3x4snlm8957qx5zxz 2477693 2477692 2026-11-04T17:51:29Z Stashbot 7414 ariel@deploy2003: helmfile [staging] START helmfile.d/services/changeprop-jobqueue: apply 2477693 wikitext text/x-wiki n88gliyndixa2emlsmn8yo6p1cxbvad 2477694 2477693 2026-11-04T17:51:44Z Stashbot 7414 ariel@deploy2003: helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: apply 2477694 wikitext text/x-wiki kczyan2b1if0ytkqooesedzatjety33 2477695 2477694 2026-11-04T17:51:56Z Stashbot 7414 ariel@deploy2003: helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply 2477695 wikitext text/x-wiki e00bt84rys9og7etmj6fqtvsxxz7wq7 2477696 2477695 2026-11-04T17:52:02Z Stashbot 7414 ariel@deploy2003: helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply 2477696 wikitext text/x-wiki du8vz4n0hxles1dqwkhg7nqee22t4xl 2477697 2477696 2026-11-04T17:52:09Z Stashbot 7414 ariel@deploy2003: helmfile [eqiad] START helmfile.d/services/changeprop-jobqueue: apply 2477697 wikitext text/x-wiki tq0drho4athnej1chdrb5vu3og388sk 2477698 2477697 2026-11-04T17:52:12Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1006.eqiad.wmnet 2477698 wikitext text/x-wiki nn6uwayh9t139qujg30lbxyq1pbdmx2 2477699 2477698 2026-11-04T17:52:15Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1006.eqiad.wmnet 2477699 wikitext text/x-wiki 0sbyk5t4gu0x58nejvbcytt7jbacxr9 2477700 2477699 2026-11-04T17:52:19Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1007.eqiad.wmnet 2477700 wikitext text/x-wiki 5ks7y4a91cu79scrppvrfu8l3wifmeh 2477701 2477700 2026-11-04T17:53:13Z Stashbot 7414 ariel@deploy2003: helmfile [eqiad] DONE helmfile.d/services/changeprop-jobqueue: apply 2477701 wikitext text/x-wiki 3bh2t7ireuzhzt0651rodhuddxy0pyr 2477702 2477701 2026-11-04T17:53:23Z Stashbot 7414 ariel@deploy2003: helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply 2477702 wikitext text/x-wiki h2b2nifhe61ksw1l879ez22vq5xs153 2477703 2477702 2026-11-04T17:54:27Z Stashbot 7414 ariel@deploy2003: helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply 2477703 wikitext text/x-wiki r0w1oe03y5ova6s65c2r5s59ef6sxw5 2477704 2477703 2026-11-04T17:58:25Z Stashbot 7414 krinkle@deploy2003: Started scap sync-world: Backport for [[gerrit:1311062|Remove Mathoid SVG option from wgMathValidModes (T271001)]] 2477704 wikitext text/x-wiki 2acxkyzstwm67j4bvk09f8hxxwld6ku 2477705 2477704 2026-11-04T18:01:21Z Stashbot 7414 krinkle@deploy2003: krinkle: Backport for [[gerrit:1311062|Remove Mathoid SVG option from wgMathValidModes (T271001)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2477705 wikitext text/x-wiki rexmz6mvac6wmvk2zop4p30i63u7h7e 2477708 2477705 2026-11-04T18:06:07Z Stashbot 7414 krinkle@deploy2003: krinkle: Continuing with deployment 2477708 wikitext text/x-wiki 7t8dgy8x4tl39csopof2st0wz5bjv8a 2477715 2477708 2026-11-04T18:11:19Z Stashbot 7414 mutante: gerrit2003/gerrit2002 - systemctl restart gerrit to deploy gerrit:1308081 to cap index query results to 5000 (T431398) 2477715 wikitext text/x-wiki gmo0nm3xutf9h6c7yb4iu16ozzdbqzl 2477716 2477715 2026-11-04T18:12:09Z Stashbot 7414 krinkle@deploy2003: Finished scap sync-world: Backport for [[gerrit:1311062|Remove Mathoid SVG option from wgMathValidModes (T271001)]] (duration: 13m 43s) 2477716 wikitext text/x-wiki r012qhinqkkqedtmmsd2rcvducigw4i 2477718 2477716 2026-11-04T18:18:58Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.wdqs.data-transfer (T441682, seed eqiad with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs1011.eqiad.wmnet -> wdqs1012.eqiad.wmnet, repooling both afterwards 2477718 wikitext text/x-wiki a9hh31wrmcil049q85g7692808i5a4l 2477719 2477718 2026-11-04T18:19:21Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.wdqs.data-transfer (T441682, seed codfw with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2007.codfw.wmnet, repooling both afterwards 2477719 wikitext text/x-wiki 3bcfea294bc6ye1ay0epmhxo1255li8 2477720 2477719 2026-11-04T18:22:22Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1007.eqiad.wmnet 2477720 wikitext text/x-wiki dq62poks888ijq0fpqiwcdr0v3ha4q7 2477722 2477720 2026-11-04T18:26:54Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, seed eqiad with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs1011.eqiad.wmnet -> wdqs1012.eqiad.wmnet, repooling both afterwards 2477722 wikitext text/x-wiki nyibfgumd701rhus670fhkh8yig51g5 2477723 2477722 2026-11-04T18:27:03Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, seed codfw with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2007.codfw.wmnet, repooling both afterwards 2477723 wikitext text/x-wiki gpx2j43w1fdja757mzwps43awpw6iu6 2477724 2477723 2026-11-04T18:29:13Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1007.eqiad.wmnet 2477724 wikitext text/x-wiki l1hv84bfldcxpfg6sh5x4iy5wucg4vp 2477725 2477724 2026-11-04T18:29:16Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1007.eqiad.wmnet 2477725 wikitext text/x-wiki eobyk765843pwl5l5elgg90h7qrcsbh 2477726 2477725 2026-11-04T18:29:20Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1008.eqiad.wmnet 2477726 wikitext text/x-wiki 7uqf3meixq5r4gaujxfo5em1vl3mh2u 2477727 2477726 2026-11-04T18:34:34Z Stashbot 7414 ladsgroup@deploy2003: Started scap sync-world: Pushing 503 redesigns (T129433) 2477727 wikitext text/x-wiki nrv08t9416pskoqvpnbbep001f3gy7e 2477728 2477727 2026-11-04T18:35:14Z Stashbot 7414 ladsgroup@deploy2003: Stopping before sync operations 2477728 wikitext text/x-wiki e0b262kgeqc40d53tpadpinzyw0483i 2477729 2477728 2026-11-04T18:37:32Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.wdqs.data-transfer (T441682, seed eqiad with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs1011.eqiad.wmnet -> wdqs1013.eqiad.wmnet, repooling both afterwards 2477729 wikitext text/x-wiki 5l26dequspas3pre7fsh1lr75sm91qg 2477730 2477729 2026-11-04T18:37:51Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.wdqs.data-transfer (T441682, seed codfw with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2010.codfw.wmnet, repooling both afterwards 2477730 wikitext text/x-wiki e2u95o95e9d05ih86egw2htlg2c8ezc 2477731 2477730 2026-11-04T18:39:03Z Stashbot 7414 ladsgroup@deploy2003: Started scap sync-world: Pushing 503 redesigns (T129433) 2477731 wikitext text/x-wiki sqzi310xyj1quyd1d0b8s27726gb96z 2477732 2477731 2026-11-04T18:40:35Z Stashbot 7414 ladsgroup@deploy2003: ladsgroup: Pushing 503 redesigns (T129433) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2477732 wikitext text/x-wiki tfze3bzeglh1y4qoeumshv99ve5iubx 2477736 2477732 2026-11-04T18:42:40Z Stashbot 7414 ladsgroup@deploy2003: ladsgroup: Continuing with deployment 2477736 wikitext text/x-wiki 67xhq0vftfg2rxucfuwqt6gn5mrc6f9 2477737 2477736 2026-11-04T18:45:30Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, seed eqiad with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs1011.eqiad.wmnet -> wdqs1013.eqiad.wmnet, repooling both afterwards 2477737 wikitext text/x-wiki bj7rr63kqq5amsxg3jym3x5i9prvzru 2477738 2477737 2026-11-04T18:45:35Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, seed codfw with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2010.codfw.wmnet, repooling both afterwards 2477738 wikitext text/x-wiki 36yizj8kym6zye4w1zs8tnedi2j2dho 2477739 2477738 2026-11-04T18:45:57Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.wdqs.data-transfer (T441682, seed eqiad with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs1011.eqiad.wmnet -> wdqs1014.eqiad.wmnet, repooling both afterwards 2477739 wikitext text/x-wiki a8p4524tpywfzkiixj1ib7mw890dvza 2477740 2477739 2026-11-04T18:46:12Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.wdqs.data-transfer (T441682, seed codfw with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2011.codfw.wmnet, repooling both afterwards 2477740 wikitext text/x-wiki bx4hgbukulpm3ep0zwdpnz84ba7hjrt 2477742 2477740 2026-11-04T18:48:38Z Stashbot 7414 ladsgroup@deploy2003: Finished scap sync-world: Pushing 503 redesigns (T129433) (duration: 09m 40s) 2477742 wikitext text/x-wiki 0o0qy1mb4he40bl0zs5gd3lmh02cvtz 2477743 2477742 2026-11-04T18:53:49Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, seed eqiad with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs1011.eqiad.wmnet -> wdqs1014.eqiad.wmnet, repooling both afterwards 2477743 wikitext text/x-wiki 31wvub92za01clatojzan7tdazaqq4u 2477744 2477743 2026-11-04T18:53:54Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, seed codfw with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2011.codfw.wmnet, repooling both afterwards 2477744 wikitext text/x-wiki ctjyqf0buvm5fhkwk26hq9rsxokyio0 2477745 2477744 2026-11-04T18:59:23Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1008.eqiad.wmnet 2477745 wikitext text/x-wiki cd7yq4kakhy4ffgh7nphsgv1s1edeq0 2477746 2477745 2026-11-04T18:59:55Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.wdqs.data-transfer (T441682, seed codfw with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2012.codfw.wmnet, repooling both afterwards 2477746 wikitext text/x-wiki hzos0i5urljhtehit6flh26dk6plnjg 2477747 2477746 2026-11-04T19:00:09Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.wdqs.data-transfer (T441682, seed eqiad with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs1011.eqiad.wmnet -> wdqs1016.eqiad.wmnet, repooling both afterwards 2477747 wikitext text/x-wiki qfcxtc0r6aiuv7c19cinsjn775dsdd5 2477748 2477747 2026-11-04T19:06:13Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1008.eqiad.wmnet 2477748 wikitext text/x-wiki 0vjqlt13dck34vvb65db86fz6csh9hy 2477749 2477748 2026-11-04T19:06:17Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1008.eqiad.wmnet 2477749 wikitext text/x-wiki 41fzjs1z9kj74x5wfn591mp5ezaofow 2477750 2477749 2026-11-04T19:06:21Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1009.eqiad.wmnet 2477750 wikitext text/x-wiki abk75gc6pswkiquub9ddfkvq2aubahx 2477751 2477750 2026-11-04T19:07:32Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, seed codfw with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2012.codfw.wmnet, repooling both afterwards 2477751 wikitext text/x-wiki fz4yvfaq81my0paq0m4grhb7b5jebsv 2477752 2477751 2026-11-04T19:08:04Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, seed eqiad with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs1011.eqiad.wmnet -> wdqs1016.eqiad.wmnet, repooling both afterwards 2477752 wikitext text/x-wiki ev3p3xxb9rxfpr556segy7dguuferwi 2477753 2477752 2026-11-04T19:08:45Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.wdqs.data-transfer (T441682, seed eqiad with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs1011.eqiad.wmnet -> wdqs1017.eqiad.wmnet, repooling both afterwards 2477753 wikitext text/x-wiki i63n4jjs4ny76samids7dtc8sdo1i0n 2477754 2477753 2026-11-04T19:09:01Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.wdqs.data-transfer (T441682, seed codfw with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2013.codfw.wmnet, repooling both afterwards 2477754 wikitext text/x-wiki fs73mkb0ggyuq4xhh7umxh0c61ewono 2477755 2477754 2026-11-04T19:16:29Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, seed eqiad with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs1011.eqiad.wmnet -> wdqs1017.eqiad.wmnet, repooling both afterwards 2477755 wikitext text/x-wiki 6rbfz7lxsdjpog1xnnmbexz0eijpbu5 2477756 2477755 2026-11-04T19:16:33Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, seed codfw with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2013.codfw.wmnet, repooling both afterwards 2477756 wikitext text/x-wiki 9e0dbizw1g67121i59hsskivuwyhp3e 2477757 2477756 2026-11-04T19:18:17Z Stashbot 7414 ladsgroup@deploy2003: Started scap sync-world: Backport for [[gerrit:1363423|Redesign 404 pages (T129433)]] 2477757 wikitext text/x-wiki 621e4lu96f7u96ultgleljgrnk79ywr 2477758 2477757 2026-11-04T19:20:36Z Stashbot 7414 ladsgroup@deploy2003: ladsgroup, ladsgroup-claude: Backport for [[gerrit:1363423|Redesign 404 pages (T129433)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2477758 wikitext text/x-wiki 6vju6t403lkef5cgcahw0fbaccb4wxs 2477760 2477758 2026-11-04T19:21:42Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.wdqs.data-transfer (T441682, seed codfw with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2014.codfw.wmnet, repooling both afterwards 2477760 wikitext text/x-wiki 4j51o2pux5y4m7e133hey73qwrn1o44 2477761 2477760 2026-11-04T19:22:01Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.wdqs.data-transfer (T441682, seed eqiad with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs1011.eqiad.wmnet -> wdqs1018.eqiad.wmnet, repooling both afterwards 2477761 wikitext text/x-wiki ntmy9rjai34b78go3lo9ivg6lvjc3a7 2477762 2477761 2026-11-04T19:22:06Z Stashbot 7414 ladsgroup@deploy2003: ladsgroup, ladsgroup-claude: Continuing with deployment 2477762 wikitext text/x-wiki qponvzbyawpw4e37zlrnlzbl21kyzr9 2477767 2477762 2026-11-04T19:28:03Z Stashbot 7414 ladsgroup@deploy2003: Finished scap sync-world: Backport for [[gerrit:1363423|Redesign 404 pages (T129433)]] (duration: 09m 46s) 2477767 wikitext text/x-wiki 01h6rsa71dyakuo4tcj1vxcmzoo2zqa 2477768 2477767 2026-11-04T19:29:09Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, seed codfw with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2014.codfw.wmnet, repooling both afterwards 2477768 wikitext text/x-wiki ekiv3u9m1s50jy6e0tpob9jxam3umq5 2477769 2477768 2026-11-04T19:29:49Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, seed eqiad with the reloaded categories journal (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs1011.eqiad.wmnet -> wdqs1018.eqiad.wmnet, repooling both afterwards 2477769 wikitext text/x-wiki 3293zhuwssx7m4toi82s8wknft2gw1t 2477770 2477769 2026-11-04T19:37:18Z Stashbot 7414 mutante: !log is not !logging 2477770 wikitext text/x-wiki 85ja7jz891eo5a2ekp573fb9kzu4d1t 2477857 2477770 2026-11-04T21:12:45Z Taavi 13997 archive rest of September 2477857 wikitext text/x-wiki tp0fwjjvnbcqdpz799aa53o3rn6bvag 2477858 2477857 2026-11-04T21:13:43Z Stashbot 7414 tsev@deploy2003: tsev: Backport for [[gerrit:1363467|Allow ReadingLists path in Apple App Site Association File (T443456)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2477858 wikitext text/x-wiki m7gnic94bkjo4y0vo69u8jyo6wgwhqd 2477859 2477858 2026-11-04T21:15:45Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P97301 and previous config saved to /var/cache/conftool/dbconfig/20261104-211544-ladsgroup.json 2477859 wikitext text/x-wiki 4uxpvkto8rurf6t22twmig9kcqgqdwv 2477861 2477859 2026-11-04T21:15:53Z Taavi 13997 archive october 2477861 wikitext text/x-wiki lt7kwm3t2ucu7kq71wuf4pp6jg5puxb 2477863 2477861 2026-11-04T21:16:44Z Stashbot 7414 tsev@deploy2003: tsev: Continuing with deployment 2477863 wikitext text/x-wiki 1vdioogf32eki7t23jstim6p5msfz8u 2477865 2477863 2026-11-04T21:22:50Z Stashbot 7414 tsev@deploy2003: Finished scap sync-world: Backport for [[gerrit:1363467|Allow ReadingLists path in Apple App Site Association File (T443456)]] (duration: 11m 26s) 2477865 wikitext text/x-wiki qenliai07umyba8bmpxwjzuj70fnu73 2477866 2477865 2026-11-04T21:25:47Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2182', diff saved to https://phabricator.wikimedia.org/P97302 and previous config saved to /var/cache/conftool/dbconfig/20261104-212545-ladsgroup.json 2477866 wikitext text/x-wiki 67vcbd76ebqandn3yq6307gea35y7s4 2477867 2477866 2026-11-04T21:29:53Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1013.eqiad.wmnet 2477867 wikitext text/x-wiki leddw85zdobn8z8wg9tbooztr1wg5p8 2477868 2477867 2026-11-04T21:29:55Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1013.eqiad.wmnet 2477868 wikitext text/x-wiki gum1kgpj41cquxw9ej9ssim1qjwjycs 2477869 2477868 2026-11-04T21:30:01Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1014.eqiad.wmnet 2477869 wikitext text/x-wiki 3998n53momka33kw7rp3b7vmkaozsus 2477871 2477869 2026-11-04T21:35:27Z Stashbot 7414 ejegg@deploy2003: Started scap sync-world: Backport for Update CentralNotice for new mixin ([[gerrit:1363265|1.48.0-wmf.1]], [[gerrit:1363263|1.48.0-wmf.3]]) 2477871 wikitext text/x-wiki q13hxprcoek51dt23im726h5oqif6ro 2477872 2477871 2026-11-04T21:35:49Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2182 (T441633)', diff saved to https://phabricator.wikimedia.org/P97303 and previous config saved to /var/cache/conftool/dbconfig/20261104-213547-ladsgroup.json 2477872 wikitext text/x-wiki 8du1d84xq642ru84h24h863d93hx1ow 2477873 2477872 2026-11-04T21:36:08Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2198.codfw.wmnet with reason: Maintenance 2477873 wikitext text/x-wiki gownwgeblxkdxfuvoyasnvncpozxxfa 2477875 2477873 2026-11-04T21:41:17Z Stashbot 7414 tsev@deploy2003: mwscript-k8s job started: purgeList.php # T443456 2477875 wikitext text/x-wiki rv4k1m4z2lwkdrg9wrjtoh76amo2eyd 2477876 2477875 2026-11-04T21:43:48Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2208.codfw.wmnet with reason: Maintenance 2477876 wikitext text/x-wiki sf4xodsg6m2um6kv5a9tjvoms0fg9xq 2477877 2477876 2026-11-04T21:43:50Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db2208 (T441633)', diff saved to https://phabricator.wikimedia.org/P97304 and previous config saved to /var/cache/conftool/dbconfig/20261104-214349-ladsgroup.json 2477877 wikitext text/x-wiki efxowssainn7fgjrstqxpxxf6sg8r4q 2477879 2477877 2026-11-04T21:48:16Z Stashbot 7414 tsev@deploy2003: mwscript-k8s job started: purgeList.php # T443456 2477879 wikitext text/x-wiki cqdtzq2wzdlnxvb6xgbaskon25cmm3g 2477881 2477879 2026-11-04T21:50:58Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2208 (T441633)', diff saved to https://phabricator.wikimedia.org/P97305 and previous config saved to /var/cache/conftool/dbconfig/20261104-215057-ladsgroup.json 2477881 wikitext text/x-wiki 9o9ttgkokok7g77qr4gm0x7f46iitg3 2477882 2477881 2026-11-04T21:57:12Z Stashbot 7414 ejegg@deploy2003: ejegg: Backport for Update CentralNotice for new mixin ([[gerrit:1363265|1.48.0-wmf.1]], [[gerrit:1363263|1.48.0-wmf.3]]) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2477882 wikitext text/x-wiki kjrb86xx2x2c808e6sejgvq6ay14l5l 2477884 2477882 2026-11-04T22:00:04Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1014.eqiad.wmnet 2477884 wikitext text/x-wiki sz80r15vfv4a2mbexm1lrx3uwzdgzl9 2477885 2477884 2026-11-04T22:01:00Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2208', diff saved to https://phabricator.wikimedia.org/P97306 and previous config saved to /var/cache/conftool/dbconfig/20261104-220059-ladsgroup.json 2477885 wikitext text/x-wiki lc957bhqi3ncwr6yem8lax0rmqkxf1d 2477886 2477885 2026-11-04T22:02:18Z Stashbot 7414 ejegg@deploy2003: ejegg: Continuing with deployment 2477886 wikitext text/x-wiki 2b4xrsmwm7fda26tm3iovnqgzd4shwb 2477887 2477886 2026-11-04T22:05:44Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1014.eqiad.wmnet 2477887 wikitext text/x-wiki q94a5pepxzxuw56ifk1pkg52k7obfik 2477888 2477887 2026-11-04T22:05:45Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1014.eqiad.wmnet 2477888 wikitext text/x-wiki eiyu2aoe637ifcou2aa79qiu73gocql 2477889 2477888 2026-11-04T22:05:51Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1015.eqiad.wmnet 2477889 wikitext text/x-wiki l0pd85ef8v7pq9ukzs081knb3rs1r97 2477890 2477889 2026-11-04T22:06:27Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1015.eqiad.wmnet 2477890 wikitext text/x-wiki 2widlixmobfnck38x4c943a7dsfgdyd 2477891 2477890 2026-11-04T22:11:02Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2208', diff saved to https://phabricator.wikimedia.org/P97307 and previous config saved to /var/cache/conftool/dbconfig/20261104-221101-ladsgroup.json 2477891 wikitext text/x-wiki epqfch8kipxcez4bvnekmwsucxb9jue 2477892 2477891 2026-11-04T22:12:37Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1015.eqiad.wmnet 2477892 wikitext text/x-wiki p9rx3nd1qfokjl4ztaocld1hmkxo76r 2477893 2477892 2026-11-04T22:12:38Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1015.eqiad.wmnet 2477893 wikitext text/x-wiki 0xdz7lpb50hl5m8bleaekjnavu2evf1 2477894 2477893 2026-11-04T22:12:44Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1016.eqiad.wmnet 2477894 wikitext text/x-wiki r2mg1y9qt0sjnjx7gegrk56pt79d7ck 2477895 2477894 2026-11-04T22:13:19Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1016.eqiad.wmnet 2477895 wikitext text/x-wiki 2cck7tnqz68yyqaht8o589iwhlkla5w 2477897 2477895 2026-11-04T22:17:00Z Stashbot 7414 ejegg@deploy2003: Finished scap sync-world: Backport for Update CentralNotice for new mixin ([[gerrit:1363265|1.48.0-wmf.1]], [[gerrit:1363263|1.48.0-wmf.3]]) (duration: 41m 33s) 2477897 wikitext text/x-wiki 4l7fkf2fjon3skezg9z2769iin6h893 2477898 2477897 2026-11-04T22:19:38Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1016.eqiad.wmnet 2477898 wikitext text/x-wiki 6u0g45zjzarq39hlu42yfsv28j5ytwo 2477899 2477898 2026-11-04T22:19:40Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1016.eqiad.wmnet 2477899 wikitext text/x-wiki b5pyywws6yjotfu0vacrwzljdeerd3g 2477900 2477899 2026-11-04T22:19:45Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1017.eqiad.wmnet 2477900 wikitext text/x-wiki e2vyd8smpxnbcu1r9vb5u1mwgw0j79f 2477901 2477900 2026-11-04T22:20:21Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1017.eqiad.wmnet 2477901 wikitext text/x-wiki f1gvzf6ghtt7d3wn4xo09ten17e5znt 2477902 2477901 2026-11-04T22:21:04Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2208 (T441633)', diff saved to https://phabricator.wikimedia.org/P97308 and previous config saved to /var/cache/conftool/dbconfig/20261104-222102-ladsgroup.json 2477902 wikitext text/x-wiki trrh64u5opuiky2mt7gkdz7lw10mq2v 2477903 2477902 2026-11-04T22:21:23Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2218.codfw.wmnet with reason: Maintenance 2477903 wikitext text/x-wiki 8zhb8e4e19fek7vy5zo29mzxj4n1j9b 2477904 2477903 2026-11-04T22:21:25Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db2218 (T441633)', diff saved to https://phabricator.wikimedia.org/P97309 and previous config saved to /var/cache/conftool/dbconfig/20261104-222124-ladsgroup.json 2477904 wikitext text/x-wiki pivkal12tbbfc57hje1tqbg0hr513oa 2477905 2477904 2026-11-04T22:26:30Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1017.eqiad.wmnet 2477905 wikitext text/x-wiki f0qkv57fqisy6gvt60ww6enls2sah1z 2477906 2477905 2026-11-04T22:26:31Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1017.eqiad.wmnet 2477906 wikitext text/x-wiki 2b4lyq8ds84mw99nz0ffqbjo01ntper 2477907 2477906 2026-11-04T22:26:37Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1018.eqiad.wmnet 2477907 wikitext text/x-wiki nkgjabh5xivybf9pd1ph38mi4ro2zek 2477908 2477907 2026-11-04T22:28:17Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2218 (T441633)', diff saved to https://phabricator.wikimedia.org/P97310 and previous config saved to /var/cache/conftool/dbconfig/20261104-222815-ladsgroup.json 2477908 wikitext text/x-wiki 7e5khvybmqpcon0twzykr3a7twhvl0r 2477909 2477908 2026-11-04T22:28:39Z Stashbot 7414 btullis@cumin1004: END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) depool for host dse-k8s-worker1018.eqiad.wmnet 2477909 wikitext text/x-wiki nbi8ckbjzqd20o4y1pgxieklr13ul99 2477911 2477909 2026-11-04T22:38:18Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2218', diff saved to https://phabricator.wikimedia.org/P97311 and previous config saved to /var/cache/conftool/dbconfig/20261104-223817-ladsgroup.json 2477911 wikitext text/x-wiki gg6n9ag3ox8096x9j3mz6ibb9dbq7hg 2477913 2477911 2026-11-04T22:41:49Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1018.eqiad.wmnet 2477913 wikitext text/x-wiki c7ee2wsk2c1zq3at4iwv9hbijgv4mbe 2477914 2477913 2026-11-04T22:41:51Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1018.eqiad.wmnet 2477914 wikitext text/x-wiki 092uocy1wlsr2xcinlepapy4bfyniex 2477915 2477914 2026-11-04T22:41:56Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1019.eqiad.wmnet 2477915 wikitext text/x-wiki 65ujy8jon8s2pvxbx2k41cuu1a4q4zf 2477916 2477915 2026-11-04T22:43:57Z Stashbot 7414 btullis@cumin1004: END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) depool for host dse-k8s-worker1019.eqiad.wmnet 2477916 wikitext text/x-wiki 1wtogzp2ibm8gozrbfltdyffkcc5e3f 2477917 2477916 2026-11-04T22:48:20Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2218', diff saved to https://phabricator.wikimedia.org/P97312 and previous config saved to /var/cache/conftool/dbconfig/20261104-224819-ladsgroup.json 2477917 wikitext text/x-wiki l6h2p1k9ab84wmczhi636v3kkg7d4xp 2477919 2477917 2026-11-04T22:58:22Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2218 (T441633)', diff saved to https://phabricator.wikimedia.org/P97314 and previous config saved to /var/cache/conftool/dbconfig/20261104-225821-ladsgroup.json 2477919 wikitext text/x-wiki at6tgtklctfk2efk2tbk917av900p19 2477920 2477919 2026-11-04T22:58:42Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2220.codfw.wmnet with reason: Maintenance 2477920 wikitext text/x-wiki c6tfrcohsnkg91lmdrlg2q7xawmna8s 2477921 2477920 2026-11-04T22:58:44Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db2220 (T441633)', diff saved to https://phabricator.wikimedia.org/P97315 and previous config saved to /var/cache/conftool/dbconfig/20261104-225843-ladsgroup.json 2477921 wikitext text/x-wiki 3u10dj0ux97blt5hrgyxic5zxag52oo 2477925 2477921 2026-11-04T23:05:55Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2220 (T441633)', diff saved to https://phabricator.wikimedia.org/P97316 and previous config saved to /var/cache/conftool/dbconfig/20261104-230554-ladsgroup.json 2477925 wikitext text/x-wiki 3l3t90nkpaljwgkcnsaa1j1wi9jiv0l 2477926 2477925 2026-11-04T23:06:10Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1019.eqiad.wmnet 2477926 wikitext text/x-wiki hzu2v746qsa8ymdyyy4tee96hefd206 2477927 2477926 2026-11-04T23:06:11Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1019.eqiad.wmnet 2477927 wikitext text/x-wiki px2jkx0up9wcyp0mivxqvw86nq34609 2477928 2477927 2026-11-04T23:06:17Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1020.eqiad.wmnet 2477928 wikitext text/x-wiki k46zq3p3tj0oqlpssjyojpjkskr79rj 2477929 2477928 2026-11-04T23:07:56Z Stashbot 7414 jdlrobson@deploy2003: Started scap sync-world: Backport for [[gerrit:1363460|UnsaveDialog: Don't render in place in bottom sheet mode (T443481)]] (1.48.0-wmf.3) 2477929 wikitext text/x-wiki 1nzyb3y3d7dvq0jyz4ns1nhf2g983yp 2477930 2477929 2026-11-04T23:08:20Z Stashbot 7414 btullis@cumin1004: END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) depool for host dse-k8s-worker1020.eqiad.wmnet 2477930 wikitext text/x-wiki j3c21vzdjdlj2bczdij0sglpxprclrm 2477932 2477930 2026-11-04T23:15:22Z Stashbot 7414 jdlrobson@deploy2003: jdlrobson: Backport for [[gerrit:1363460|UnsaveDialog: Don't render in place in bottom sheet mode (T443481)]] (1.48.0-wmf.3) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2477932 wikitext text/x-wiki q7p8lsyq5up4m9iti3qpsr2hbqcvb7t 2477933 2477932 2026-11-04T23:15:56Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2220', diff saved to https://phabricator.wikimedia.org/P97317 and previous config saved to /var/cache/conftool/dbconfig/20261104-231555-ladsgroup.json 2477933 wikitext text/x-wiki ea50sv77mxmxaa1usd0poogp0zke4bf 2477934 2477933 2026-11-04T23:16:17Z Stashbot 7414 jdlrobson@deploy2003: jdlrobson: Continuing with deployment 2477934 wikitext text/x-wiki axco90p382214gx5cdkw6fsrac6wt9r 2477936 2477934 2026-11-04T23:24:30Z Stashbot 7414 jdlrobson@deploy2003: Finished scap sync-world: Backport for [[gerrit:1363460|UnsaveDialog: Don't render in place in bottom sheet mode (T443481)]] (1.48.0-wmf.3) (duration: 16m 34s) 2477936 wikitext text/x-wiki ackwz6owsqhl5j5fc0s5hqwe8iiqwk3 2477937 2477936 2026-11-04T23:25:58Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2220', diff saved to https://phabricator.wikimedia.org/P97318 and previous config saved to /var/cache/conftool/dbconfig/20261104-232557-ladsgroup.json 2477937 wikitext text/x-wiki 4mfgrp7nu6sg1ey3jdanxxhg1pravsz 2477939 2477937 2026-11-04T23:27:31Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1020.eqiad.wmnet 2477939 wikitext text/x-wiki 2dedh4czyltcccm30zue45o32bh25ju 2477940 2477939 2026-11-04T23:27:32Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1020.eqiad.wmnet 2477940 wikitext text/x-wiki ltxkvjrc3mu8o538xze6oqsf02j2ky3 2477941 2477940 2026-11-04T23:27:38Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1021.eqiad.wmnet 2477941 wikitext text/x-wiki epsf8oo65svllqbsk9sxmuqtj7xhp3l 2477946 2477941 2026-11-04T23:36:00Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2220 (T441633)', diff saved to https://phabricator.wikimedia.org/P97319 and previous config saved to /var/cache/conftool/dbconfig/20261104-233559-ladsgroup.json 2477946 wikitext text/x-wiki 34ta15fs7p712qlpuveiwt9xgwnpfbd 2477947 2477946 2026-11-04T23:36:20Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2221.codfw.wmnet with reason: Maintenance 2477947 wikitext text/x-wiki 8n6mjyxl1s7xin8pjefmhzcxt76e054 2477948 2477947 2026-11-04T23:36:22Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db2221 (T441633)', diff saved to https://phabricator.wikimedia.org/P97320 and previous config saved to /var/cache/conftool/dbconfig/20261104-233620-ladsgroup.json 2477948 wikitext text/x-wiki 6mh875c5kkhda5g3xpp8kbjmufq2tk1 2477949 2477948 2026-11-04T23:43:32Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2221 (T441633)', diff saved to https://phabricator.wikimedia.org/P97321 and previous config saved to /var/cache/conftool/dbconfig/20261104-234330-ladsgroup.json 2477949 wikitext text/x-wiki fbn6pczdhlgawyt3j0186zl95pplf9p 2477952 2477949 2026-11-04T23:53:33Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2221', diff saved to https://phabricator.wikimedia.org/P97322 and previous config saved to /var/cache/conftool/dbconfig/20261104-235332-ladsgroup.json 2477952 wikitext text/x-wiki 3g99gkok4qfo1ivj0sjqk6l0dgmhegs 2477955 2477952 2026-11-04T23:57:40Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1021.eqiad.wmnet 2477955 wikitext text/x-wiki 92jit5cxa06a9xsjndytkmwvfiuo926 2477956 2477955 2026-11-05T00:00:08Z Stashbot 7414 root@deploy2003: helmfile [staging] START helmfile.d/services/shellbox: sync 2477956 wikitext text/x-wiki 0y46v4nt2j5mivfvvyqp89hsco53v2d 2477957 2477956 2026-11-05T00:00:17Z Stashbot 7414 root@deploy2003: helmfile [staging] DONE helmfile.d/services/shellbox: sync 2477957 wikitext text/x-wiki stthppmopg18t9t17k2cu37l2yrvtqh 2477958 2477957 2026-11-05T00:00:22Z Stashbot 7414 root@deploy2003: helmfile [staging] START helmfile.d/services/shellbox-timeline: sync 2477958 wikitext text/x-wiki 4tmpkt81akefdngvxxh43mn7n7slpap 2477959 2477958 2026-11-05T00:00:32Z Stashbot 7414 root@deploy2003: helmfile [staging] DONE helmfile.d/services/shellbox-timeline: sync 2477959 wikitext text/x-wiki mbsad3msny88ubcpdkddhha403td9ts 2477960 2477959 2026-11-05T00:00:35Z Stashbot 7414 root@deploy2003: helmfile [codfw] START helmfile.d/services/shellbox-timeline: sync 2477960 wikitext text/x-wiki gyv3sk3umroxkecaorxph1sj9hq4j2a 2477962 2477960 2026-11-05T00:00:46Z Stashbot 7414 root@deploy2003: helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: sync 2477962 wikitext text/x-wiki ih7jjc2kqda14mc0f74rbcogumy2tyd 2477963 2477962 2026-11-05T00:03:35Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2221', diff saved to https://phabricator.wikimedia.org/P97323 and previous config saved to /var/cache/conftool/dbconfig/20261105-000334-ladsgroup.json 2477963 wikitext text/x-wiki fw3lnqjm47ndn6v6qa7an0miq2ul5fv 2477964 2477963 2026-11-05T00:04:19Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1021.eqiad.wmnet 2477964 wikitext text/x-wiki el7kx1iutaoqxl16okht2398tgh68g0 2477965 2477964 2026-11-05T00:04:20Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1021.eqiad.wmnet 2477965 wikitext text/x-wiki rd7umfquwwamuq4kfcgkw189g0mfh5f 2477966 2477965 2026-11-05T00:04:26Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1022.eqiad.wmnet 2477966 wikitext text/x-wiki 8vc0figlnbjtnbecht6px1dsxzho2mz 2477968 2477966 2026-11-05T00:05:01Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1022.eqiad.wmnet 2477968 wikitext text/x-wiki m0bbjtsi8sdowkdlotv7l2rqd4dr1w3 2477969 2477968 2026-11-05T00:11:29Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1022.eqiad.wmnet 2477969 wikitext text/x-wiki iy8mvpyfvdpcfiysj5vgxzfgmucrpc1 2477970 2477969 2026-11-05T00:11:30Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1022.eqiad.wmnet 2477970 wikitext text/x-wiki 6wu49xhveb9dyc2dknjowqx7guk32vf 2477971 2477970 2026-11-05T00:11:36Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1023.eqiad.wmnet 2477971 wikitext text/x-wiki jyt26mo544vmyeayyk6x7gif93je8uj 2477972 2477971 2026-11-05T00:13:37Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2221 (T441633)', diff saved to https://phabricator.wikimedia.org/P97324 and previous config saved to /var/cache/conftool/dbconfig/20261105-001336-ladsgroup.json 2477972 wikitext text/x-wiki t0ql4uk3m3oozdnbh8ssix9pzsz3ffk 2477973 2477972 2026-11-05T00:13:57Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2222.codfw.wmnet with reason: Maintenance 2477973 wikitext text/x-wiki tgujpy832gzrlwax5qprua27n2lzp50 2477974 2477973 2026-11-05T00:13:59Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db2222 (T441633)', diff saved to https://phabricator.wikimedia.org/P97325 and previous config saved to /var/cache/conftool/dbconfig/20261105-001358-ladsgroup.json 2477974 wikitext text/x-wiki ee0dp5s1zzyvtjwy7i9lobbwgyut3rl 2477977 2477974 2026-11-05T00:21:03Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2222 (T441633)', diff saved to https://phabricator.wikimedia.org/P97326 and previous config saved to /var/cache/conftool/dbconfig/20261105-002101-ladsgroup.json 2477977 wikitext text/x-wiki 04id2q4o6dmqiavhb85xbyg405zkmet 2477981 2477977 2026-11-05T00:31:04Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2222', diff saved to https://phabricator.wikimedia.org/P97327 and previous config saved to /var/cache/conftool/dbconfig/20261105-003103-ladsgroup.json 2477981 wikitext text/x-wiki c8tdmj6qwgm1osgdmkem43u7iggmndr 2477983 2477981 2026-11-05T00:41:06Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2222', diff saved to https://phabricator.wikimedia.org/P97328 and previous config saved to /var/cache/conftool/dbconfig/20261105-004105-ladsgroup.json 2477983 wikitext text/x-wiki 4li5cq1g3pjacyxs0ugnpnldxx9sw1c 2477984 2477983 2026-11-05T00:41:38Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1023.eqiad.wmnet 2477984 wikitext text/x-wiki tidvgccq5rxikvfqapxpxraa9yp8dh7 2477985 2477984 2026-11-05T00:51:08Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2222 (T441633)', diff saved to https://phabricator.wikimedia.org/P97329 and previous config saved to /var/cache/conftool/dbconfig/20261105-005107-ladsgroup.json 2477985 wikitext text/x-wiki b4tailey7akb1mngi7pgnqf7r1hhzaz 2477986 2477985 2026-11-05T00:51:28Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2228.codfw.wmnet with reason: Maintenance 2477986 wikitext text/x-wiki 4u8tge5x4owqtdv6wlzq0j09z700wqg 2477987 2477986 2026-11-05T00:51:30Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db2228 (T441633)', diff saved to https://phabricator.wikimedia.org/P97330 and previous config saved to /var/cache/conftool/dbconfig/20261105-005129-ladsgroup.json 2477987 wikitext text/x-wiki 040sn9q59p7jau6a1o61ca2autrgfb8 2477988 2477987 2026-11-05T00:52:27Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1023.eqiad.wmnet 2477988 wikitext text/x-wiki lmmq2i4x78rnjnlaq2xdi0y3ey4yaas 2477989 2477988 2026-11-05T00:52:28Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1023.eqiad.wmnet 2477989 wikitext text/x-wiki 08omwd5f1agkycxzj61ncj4io31c4db 2477990 2477989 2026-11-05T00:52:34Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1024.eqiad.wmnet 2477990 wikitext text/x-wiki gflimpimaobzsywpajrquvkmiyi4z4x 2477993 2477990 2026-11-05T01:22:36Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1024.eqiad.wmnet 2477993 wikitext text/x-wiki 3hd8x3jey2g25w9edcxjoh82yqbb3cv 2477995 2477993 2026-11-05T01:31:17Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1024.eqiad.wmnet 2477995 wikitext text/x-wiki 7xp4u7udy1oke7ofmmvr3pjkva8sv2i 2477996 2477995 2026-11-05T01:31:18Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1024.eqiad.wmnet 2477996 wikitext text/x-wiki jpt7uvoojilvhven1lknetxpoximdb5 2477997 2477996 2026-11-05T01:31:23Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1025.eqiad.wmnet 2477997 wikitext text/x-wiki lymg0t1bat0it70o7decv6fueky2pep 2477998 2477997 2026-11-05T01:51:54Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2228 (T441633)', diff saved to https://phabricator.wikimedia.org/P97331 and previous config saved to /var/cache/conftool/dbconfig/20261105-015153-ladsgroup.json 2477998 wikitext text/x-wiki cvh3t86tx8qu1yul6a7uonls0wdhcc3 2477999 2477998 2026-11-05T02:01:25Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1025.eqiad.wmnet 2477999 wikitext text/x-wiki 5fx5n9x6bv3a73w1v5shyh7un8ncvqf 2478000 2477999 2026-11-05T02:01:49Z Stashbot 7414 mwpresync@deploy2003: Started scap build-images: Publishing wmf/next image 2478000 wikitext text/x-wiki tg9rnmsjsznvgyxfk5pncuolv5lg0gi 2478001 2478000 2026-11-05T02:01:56Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2228', diff saved to https://phabricator.wikimedia.org/P97332 and previous config saved to /var/cache/conftool/dbconfig/20261105-020155-ladsgroup.json 2478001 wikitext text/x-wiki 3szq4g02bdmjnggtrez5qnerikqifxg 2478002 2478001 2026-11-05T02:09:20Z Stashbot 7414 mwpresync@deploy2003: Finished scap build-images: Publishing wmf/next image (duration: 07m 31s) 2478002 wikitext text/x-wiki mhrmx5b4hurs9valvz0grmnf1eghxih 2478003 2478002 2026-11-05T02:09:34Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1025.eqiad.wmnet 2478003 wikitext text/x-wiki sf9yok1h62z6q7bsrgndrlxpofxfmku 2478004 2478003 2026-11-05T02:09:35Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1025.eqiad.wmnet 2478004 wikitext text/x-wiki qsmeqopgd2t26ejxc7q5tbm5zfcejlc 2478005 2478004 2026-11-05T02:09:41Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1026.eqiad.wmnet 2478005 wikitext text/x-wiki 8po71qpyih5bh8cynvbgw8ri966xrqt 2478006 2478005 2026-11-05T02:10:12Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1026.eqiad.wmnet 2478006 wikitext text/x-wiki 7hdyx7wzezyvezvv5qho36g0ea39x3h 2478007 2478006 2026-11-05T02:11:58Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2228', diff saved to https://phabricator.wikimedia.org/P97333 and previous config saved to /var/cache/conftool/dbconfig/20261105-021157-ladsgroup.json 2478007 wikitext text/x-wiki t9g96pygc4f5u94px88dwkqmkf6srfr 2478008 2478007 2026-11-05T02:22:01Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2228 (T441633)', diff saved to https://phabricator.wikimedia.org/P97334 and previous config saved to /var/cache/conftool/dbconfig/20261105-022159-ladsgroup.json 2478008 wikitext text/x-wiki pha77mengwm3x2zqak2q4k7vtjvy4fn 2478009 2478008 2026-11-05T02:23:44Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1026.eqiad.wmnet 2478009 wikitext text/x-wiki k4r1grihtg6aqtf5ipi5ci58bnmqdge 2478010 2478009 2026-11-05T02:23:45Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1026.eqiad.wmnet 2478010 wikitext text/x-wiki 1iw41ghuixdg2wq0wsi08a1c1ccgd2f 2478011 2478010 2026-11-05T02:23:51Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1027.eqiad.wmnet 2478011 wikitext text/x-wiki 0ovaiqbht2vmhz83wjoclva5z2bew96 2478012 2478011 2026-11-05T02:24:22Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1027.eqiad.wmnet 2478012 wikitext text/x-wiki bg0jxhn3bto2qzxmzyjlvf88vctn8mn 2478013 2478012 2026-11-05T02:32:20Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1027.eqiad.wmnet 2478013 wikitext text/x-wiki tvo5bhbuzwhdgskj20rt9rpu0hzrt4h 2478014 2478013 2026-11-05T02:32:21Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1027.eqiad.wmnet 2478014 wikitext text/x-wiki 56sr6dm8fk9rzr9obtntppdd4mel5bg 2478015 2478014 2026-11-05T02:32:27Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1028.eqiad.wmnet 2478015 wikitext text/x-wiki cmkxehyxxf2fqv1uyfle2m56pmoi8dh 2478016 2478015 2026-11-05T02:34:44Z Stashbot 7414 dani@deploy2003: helmfile [staging] START helmfile.d/services/miscweb: apply 2478016 wikitext text/x-wiki 3b5uqgbgfbpi5b1luetnne8d4mwsbqb 2478017 2478016 2026-11-05T02:34:59Z Stashbot 7414 dani@deploy2003: helmfile [staging] DONE helmfile.d/services/miscweb: apply 2478017 wikitext text/x-wiki itwgkd76qm0t4lnrb9b4g8cbnm6s5xl 2478018 2478017 2026-11-05T02:35:01Z Stashbot 7414 dani@deploy2003: helmfile [eqiad] START helmfile.d/services/miscweb: apply 2478018 wikitext text/x-wiki ro0ukxbvzbllhytxyqrnk96916btfz5 2478019 2478018 2026-11-05T02:35:16Z Stashbot 7414 dani@deploy2003: helmfile [eqiad] DONE helmfile.d/services/miscweb: apply 2478019 wikitext text/x-wiki t8q2to34ttksxwfq499d09yanmiqj78 2478020 2478019 2026-11-05T02:35:17Z Stashbot 7414 dani@deploy2003: helmfile [codfw] START helmfile.d/services/miscweb: apply 2478020 wikitext text/x-wiki ex56o7krx0c2zlo05t08datdfwhygnj 2478021 2478020 2026-11-05T02:35:29Z Stashbot 7414 dani@deploy2003: helmfile [codfw] DONE helmfile.d/services/miscweb: apply 2478021 wikitext text/x-wiki 70r9pu2sdtxf73g2pc7ixg2trkj4c73 2478022 2478021 2026-11-05T03:02:29Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1028.eqiad.wmnet 2478022 wikitext text/x-wiki rju5sow2msd1inbthl21v7v5sfpz556 2478025 2478022 2026-11-05T03:10:27Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1028.eqiad.wmnet 2478025 wikitext text/x-wiki q4jcr2esc7rnp9sda12jdr5il3wsqv9 2478026 2478025 2026-11-05T03:10:28Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1028.eqiad.wmnet 2478026 wikitext text/x-wiki r23wgxknfh5r1wcle8fr1oqdca9qt5t 2478027 2478026 2026-11-05T03:10:34Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1039.eqiad.wmnet 2478027 wikitext text/x-wiki 9si4n65i0qzgz5dd74jiojgrdf4jmdt 2478028 2478027 2026-11-05T03:11:07Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1039.eqiad.wmnet 2478028 wikitext text/x-wiki mbfyfiy7ijifu4npy6v5sizfewtkxwo 2478029 2478028 2026-11-05T03:16:25Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1039.eqiad.wmnet 2478029 wikitext text/x-wiki pslg6h6p95m9l3lqa4evr0218awau61 2478030 2478029 2026-11-05T03:16:26Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1039.eqiad.wmnet 2478030 wikitext text/x-wiki 8cen9rzt7qh37fm2ytl0e3sfnluomlr 2478031 2478030 2026-11-05T03:16:31Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1040.eqiad.wmnet 2478031 wikitext text/x-wiki o66fw5jls0lil07vw64u6a8srvhy4x4 2478035 2478031 2026-11-05T03:46:33Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1040.eqiad.wmnet 2478035 wikitext text/x-wiki 9pzpdjija4nn94y4ojjihbvtcx7ftv6 2478036 2478035 2026-11-05T03:56:04Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1040.eqiad.wmnet 2478036 wikitext text/x-wiki o81a4izbvbwtch06ettuqzl7y9q7lmv 2478037 2478036 2026-11-05T03:56:06Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1040.eqiad.wmnet 2478037 wikitext text/x-wiki 38nvk1403n9azv1fr1320tmictrv6b2 2478038 2478037 2026-11-05T03:56:11Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1041.eqiad.wmnet 2478038 wikitext text/x-wiki 38naexigmdsxurnr1l9ppifypu5i51c 2478039 2478038 2026-11-05T04:11:04Z Stashbot 7414 ryankemper@cumin2003: START - Cookbook sre.wdqs.data-transfer (T441682, copy the reloaded categories journal to wdqs-internal-main (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2018.codfw.wmnet, repooling both afterwards 2478039 wikitext text/x-wiki pfbtrftryg4klrrcoqxkwgxfe8muv41 2478040 2478039 2026-11-05T04:11:24Z Stashbot 7414 ryankemper@cumin2003: START - Cookbook sre.wdqs.data-transfer (T441682, copy the reloaded categories journal to wdqs-internal-main (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs1011.eqiad.wmnet -> wdqs1025.eqiad.wmnet, repooling both afterwards 2478040 wikitext text/x-wiki c97vkcz1qngyv1sxr8gufrsgqhq55jh 2478041 2478040 2026-11-05T04:18:42Z Stashbot 7414 ryankemper@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, copy the reloaded categories journal to wdqs-internal-main (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2018.codfw.wmnet, repooling both afterwards 2478041 wikitext text/x-wiki 24fln5yj25o6q6v61rsujujpzsmgked 2478042 2478041 2026-11-05T04:18:45Z Stashbot 7414 ryankemper@cumin2003: START - Cookbook sre.wdqs.data-transfer (T441682, copy the reloaded categories journal to wdqs-internal-main (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2019.codfw.wmnet, repooling both afterwards 2478042 wikitext text/x-wiki 5sxaad19plhanrgns0yngjonav0wc71 2478043 2478042 2026-11-05T04:19:12Z Stashbot 7414 ryankemper@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, copy the reloaded categories journal to wdqs-internal-main (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs1011.eqiad.wmnet -> wdqs1025.eqiad.wmnet, repooling both afterwards 2478043 wikitext text/x-wiki 3454c85dgnbbmdd3iyh7qx4hdnb2kso 2478044 2478043 2026-11-05T04:19:14Z Stashbot 7414 ryankemper@cumin2003: START - Cookbook sre.wdqs.data-transfer (T441682, copy the reloaded categories journal to wdqs-internal-main (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs1011.eqiad.wmnet -> wdqs1026.eqiad.wmnet, repooling both afterwards 2478044 wikitext text/x-wiki 41w0vsyokc3vcvrtr9w45rspzc4dnds 2478045 2478044 2026-11-05T04:26:15Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1041.eqiad.wmnet 2478045 wikitext text/x-wiki p4nhov87apmrqhiy906ly48sfjtc2o3 2478046 2478045 2026-11-05T04:26:19Z Stashbot 7414 ryankemper@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, copy the reloaded categories journal to wdqs-internal-main (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2019.codfw.wmnet, repooling both afterwards 2478046 wikitext text/x-wiki g0njdpvyovarq0kv07t41se0mawy7ur 2478047 2478046 2026-11-05T04:26:22Z Stashbot 7414 ryankemper@cumin2003: START - Cookbook sre.wdqs.data-transfer (T441682, copy the reloaded categories journal to wdqs-internal-main (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2020.codfw.wmnet, repooling both afterwards 2478047 wikitext text/x-wiki 4wwbwly0lqyaogn0iyu4l434jnucd4b 2478048 2478047 2026-11-05T04:27:05Z Stashbot 7414 ryankemper@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, copy the reloaded categories journal to wdqs-internal-main (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs1011.eqiad.wmnet -> wdqs1026.eqiad.wmnet, repooling both afterwards 2478048 wikitext text/x-wiki 4p85s6t0rd0i7vjgjfvjkzlyfq7xauc 2478049 2478048 2026-11-05T04:31:37Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1041.eqiad.wmnet 2478049 wikitext text/x-wiki olmj01jmit2c87w7uh1j58e114yeize 2478050 2478049 2026-11-05T04:31:38Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1041.eqiad.wmnet 2478050 wikitext text/x-wiki 7sbqqdyamsddy0rabh6tkjuxvwt4g3z 2478051 2478050 2026-11-05T04:31:43Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1042.eqiad.wmnet 2478051 wikitext text/x-wiki etpbkvgwh7mdvblf5slkuuyjrjpbrtv 2478052 2478051 2026-11-05T04:33:45Z Stashbot 7414 btullis@cumin1004: END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) depool for host dse-k8s-worker1042.eqiad.wmnet 2478052 wikitext text/x-wiki 2gdpz0x6c1sl2i6r6h6tp9zo178lqa5 2478053 2478052 2026-11-05T04:33:53Z Stashbot 7414 ryankemper@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T441682, copy the reloaded categories journal to wdqs-internal-main (fills the 10-15 to 10-28 Commons gap)) xfer categories from wdqs2008.codfw.wmnet -> wdqs2020.codfw.wmnet, repooling both afterwards 2478053 wikitext text/x-wiki p99x076mrdt6am8nu91qz9n8e4f80dj 2478054 2478053 2026-11-05T04:41:03Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1042.eqiad.wmnet 2478054 wikitext text/x-wiki takbtcaenjr86lrbqriztdlbxayiy9n 2478055 2478054 2026-11-05T04:41:04Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1042.eqiad.wmnet 2478055 wikitext text/x-wiki 9l5mbx7nm2fwxxmfojqvu87z6f0oz3y 2478056 2478055 2026-11-05T04:41:10Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1043.eqiad.wmnet 2478056 wikitext text/x-wiki k6xmk51whg2ykbomet6bwb5rwqkjw9b 2478059 2478056 2026-11-05T05:08:11Z Stashbot 7414 denisse@cumin1004: DONE (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Cfoster out of all services on: 4 hosts 2478059 wikitext text/x-wiki 86rboi4jiy7kv0mt52qpkzpzyp6hjvd 2478060 2478059 2026-11-05T05:11:12Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1043.eqiad.wmnet 2478060 wikitext text/x-wiki 6hvghkdr8oihkwatebno8h3hymmscyg 2478061 2478060 2026-11-05T05:18:31Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1043.eqiad.wmnet 2478061 wikitext text/x-wiki 1490c3phkdtcqeh2vejwbl9l2gz70xg 2478062 2478061 2026-11-05T05:18:32Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1043.eqiad.wmnet 2478062 wikitext text/x-wiki jhbb4r88yfbbzpmtdoknudu7smkm99z 2478063 2478062 2026-11-05T05:18:37Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1044.eqiad.wmnet 2478063 wikitext text/x-wiki kp8d8i8k7o1lnq20740u3lb6noouiuz 2478064 2478063 2026-11-05T05:21:27Z Stashbot 7414 denisse@cumin1004: DONE (FAIL) - Cookbook sre.idm.logout (exit_code=99) Logging Cfoster out of all services on: 4 hosts 2478064 wikitext text/x-wiki qpz61n8ocux4wx520ugb2p5ehkxocp7 2478077 2478064 2026-11-05T05:48:51Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-worker1044.eqiad.wmnet 2478077 wikitext text/x-wiki 3eejaeopkywgu9kwm6pywehejjo0dhj 2478081 2478077 2026-11-05T05:55:39Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-worker1044.eqiad.wmnet 2478081 wikitext text/x-wiki lluf6d7870y54nrtzad5hcwyprplvw9 2478082 2478081 2026-11-05T05:55:40Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-worker1044.eqiad.wmnet 2478082 wikitext text/x-wiki ilrvzqjor99di3oo5fowka1b3ww74su 2478083 2478082 2026-11-05T05:55:41Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on A:dse-k8s-worker-eqiad 2478083 wikitext text/x-wiki f0nk8j6bojzt1ni2nzumjmj2r183237 2478089 2478083 2026-11-05T06:48:29Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.hosts.reimage for host dbprov2007.codfw.wmnet with OS trixie 2478089 wikitext text/x-wiki 59tswkk81x5purfcghia1sweepx9zcp 2478090 2478089 2026-11-05T06:49:25Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.hosts.dhcp for host dbprov2007.codfw.wmnet (push config only) 2478090 wikitext text/x-wiki eou6pu2v4s3xb57ka34jtrw79gszcv9 2478091 2478090 2026-11-05T06:49:30Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host dbprov2007.codfw.wmnet (push config only) 2478091 wikitext text/x-wiki bjh288j84qw7kqyd4xkmdlrg0lxzerm 2478092 2478091 2026-11-05T07:01:31Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.hosts.dhcp for host dbprov2007.codfw.wmnet (remove config only) 2478092 wikitext text/x-wiki f7rhq8l9irff9rdvnetv1ffdumhv4jr 2478093 2478092 2026-11-05T07:01:36Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host dbprov2007.codfw.wmnet (remove config only) 2478093 wikitext text/x-wiki 1j9lhxipvzspxgb8swnd3yqt7xws009 2478094 2478093 2026-11-05T07:03:56Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on dbprov2007.codfw.wmnet with reason: host reimage 2478094 wikitext text/x-wiki bssukzu79ejbr36ts9htosolz6qyug6 2478095 2478094 2026-11-05T07:07:37Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dbprov2007.codfw.wmnet with reason: host reimage 2478095 wikitext text/x-wiki ii4ky3jinmqqjc5nzkyhu14yf5envtw 2478096 2478095 2026-11-05T07:23:02Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dbprov2007.codfw.wmnet with OS trixie 2478096 wikitext text/x-wiki kxc1fzedkr0f0edtpit2xqjjma3g9fl 2478097 2478096 2026-11-05T07:26:47Z Stashbot 7414 marostegui: Drop thread_reaction tables T442289 2478097 wikitext text/x-wiki m06ijds6mlbifq5msxn2gzd2y4v4jgt 2478098 2478097 2026-11-05T07:30:52Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host bast2003.wikimedia.org 2478098 wikitext text/x-wiki 2j8uk5mlbl71zkup5xv7pe9u6z13d0a 2478099 2478098 2026-11-05T07:37:24Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host bast2003.wikimedia.org 2478099 wikitext text/x-wiki lbt8785xfrkjmfjxnz85ko94mqlihdh 2478101 2478099 2026-11-05T07:53:22Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host bast6003.wikimedia.org 2478101 wikitext text/x-wiki 00h3duo02sre5xo1knpvlsgq5jkn4yl 2478102 2478101 2026-11-05T07:56:38Z Stashbot 7414 moritzm: installing expat security updates 2478102 wikitext text/x-wiki tur4gj9h2gbgiphhpw0capr0mby7ogz 2478103 2478102 2026-11-05T07:59:33Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host bast6003.wikimedia.org 2478103 wikitext text/x-wiki 3254zp8vro18dj12irdj6ef1ewzkf5x 2478104 2478103 2026-11-05T08:01:54Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.mysql.decommission 2478104 wikitext text/x-wiki fv938c2trko49axhse66amklbejyvqy 2478105 2478104 2026-11-05T08:02:07Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.hosts.decommission for hosts clouddb1014.eqiad.wmnet 2478105 wikitext text/x-wiki 9eynhkwhjowzolijr0lwgynofn3sgbt 2478106 2478105 2026-11-05T08:06:19Z Stashbot 7414 dcausse@deploy2003: Started scap sync-world: Backport for [[gerrit:1363978|Restore the semantic highlighting batch ext]] (1.48.0-wmf.3) 2478106 wikitext text/x-wiki ebv12e9xfs34bi97hhwbdy2std1z8yz 2478107 2478106 2026-11-05T08:07:48Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.dns.netbox 2478107 wikitext text/x-wiki 02p7xjtz4n5y486ic96u2f940gm9cuz 2478108 2478107 2026-11-05T08:10:57Z Stashbot 7414 dcausse@deploy2003: dcausse: Backport for [[gerrit:1363978|Restore the semantic highlighting batch ext]] (1.48.0-wmf.3) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2478108 wikitext text/x-wiki gyrk4fyjecpupg7as402dkzuzmxu2tf 2478109 2478108 2026-11-05T08:11:32Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: clouddb1014.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - marostegui@cumin1004" 2478109 wikitext text/x-wiki n8zbjseqe17hpq58vat4ei2lf3wn9qw 2478110 2478109 2026-11-05T08:11:45Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: clouddb1014.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - marostegui@cumin1004" 2478110 wikitext text/x-wiki ebothro6jj7v5ymgob1wkavjemff2dk 2478111 2478110 2026-11-05T08:11:46Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2478111 wikitext text/x-wiki atou7tc914e5sku74k7ya1ztctdx0rt 2478112 2478111 2026-11-05T08:11:47Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts clouddb1014.eqiad.wmnet 2478112 wikitext text/x-wiki n70wruz4zh8tvklshtkqnu7sat6kzl1 2478113 2478112 2026-11-05T08:11:50Z Stashbot 7414 marostegui@cumin1004: Removing clouddb1014 from zarcillo T441395 2478113 wikitext text/x-wiki as31t4u5nlw15pgsvxk4me9pza65al1 2478114 2478113 2026-11-05T08:11:53Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.mysql.decommission (exit_code=0) 2478114 wikitext text/x-wiki qke34rwmgkpx49nlk4uobnuotbl2fc8 2478115 2478114 2026-11-05T08:14:52Z Stashbot 7414 dcausse@deploy2003: dcausse: Continuing with deployment 2478115 wikitext text/x-wiki 65hz19an3ghywyrs4srnmgzcs0je8jp 2478116 2478115 2026-11-05T08:22:23Z Stashbot 7414 dcausse@deploy2003: Finished scap sync-world: Backport for [[gerrit:1363978|Restore the semantic highlighting batch ext]] (1.48.0-wmf.3) (duration: 16m 04s) 2478116 wikitext text/x-wiki l1sbzpop9u2mtdjbsl4a45u44z2ftnu 2478117 2478116 2026-11-05T08:42:20Z Stashbot 7414 brouberol@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/services/mediawiki-dumps-legacy: apply 2478117 wikitext text/x-wiki i3buchmtye175jqj6xole1qr9i10j4w 2478118 2478117 2026-11-05T08:42:31Z Stashbot 7414 moritzm: restarting FPM on phab1005 to pick up Expat security updates 2478118 wikitext text/x-wiki 0kbb29ovyhp3zmbvdp8vg40pb6ba1an 2478119 2478118 2026-11-05T08:44:12Z Stashbot 7414 brouberol@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/mediawiki-dumps-legacy: apply 2478119 wikitext text/x-wiki b3dcsvcilpk3bo0ns2nxdvbu7eow7la 2478120 2478119 2026-11-05T09:08:07Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.hadoop.check-user-leftovers Checking for leftover data for user nettrom 2478120 wikitext text/x-wiki l3xxbezflnkgohnuabkfmbee2pgdujn 2478121 2478120 2026-11-05T09:09:11Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.hadoop.check-user-leftovers (exit_code=0) Checking for leftover data for user nettrom 2478121 wikitext text/x-wiki cetg0cu49kqaz2m3gzifpxqu3xn6n1t 2478122 2478121 2026-11-05T09:12:50Z Stashbot 7414 jnuche@deploy2003: rebuilt and synchronized wikiversions files: group2 to 1.48.0-wmf.3 refs T442221 2478122 wikitext text/x-wiki fepabb1h0nt4hj06xoc4nuwe5jh47oa 2478123 2478122 2026-11-05T09:16:32Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.hadoop.check-user-leftovers Checking for leftover data for user kgraessle 2478123 wikitext text/x-wiki 4ppbl8x1fi3so01ofvxocgbm3u27elo 2478124 2478123 2026-11-05T09:16:58Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.hadoop.check-user-leftovers (exit_code=0) Checking for leftover data for user kgraessle 2478124 wikitext text/x-wiki p9884qxvlloejcwg55vm8vktu9xscxi 2478125 2478124 2026-11-05T09:16:59Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.hadoop.check-user-leftovers Checking for leftover data for user hmonroy 2478125 wikitext text/x-wiki hdjbymvcbwkredijl5rhnsy8wiklovh 2478126 2478125 2026-11-05T09:17:20Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.hadoop.check-user-leftovers (exit_code=0) Checking for leftover data for user hmonroy 2478126 wikitext text/x-wiki mth3zplua8dhoqfv3y4cprs35b5bhot 2478127 2478126 2026-11-05T09:17:21Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.hadoop.check-user-leftovers Checking for leftover data for user dmaza 2478127 wikitext text/x-wiki cdbvdh6lud4xxqv828apky52t1emwwl 2478128 2478127 2026-11-05T09:17:29Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.hadoop.check-user-leftovers (exit_code=0) Checking for leftover data for user dmaza 2478128 wikitext text/x-wiki h9kx7pgr5qsa4t4zpdr3clcq8prg8yg 2478129 2478128 2026-11-05T09:17:31Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.hadoop.check-user-leftovers Checking for leftover data for user ksiebert 2478129 wikitext text/x-wiki ehf40y7o3f2wqqrnd9wnvcxg2s9daa4 2478130 2478129 2026-11-05T09:17:39Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.hadoop.check-user-leftovers (exit_code=0) Checking for leftover data for user ksiebert 2478130 wikitext text/x-wiki 56c8xxyyeg2kjnvieu38gvfib2cvqod 2478131 2478130 2026-11-05T09:17:40Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.hadoop.check-user-leftovers Checking for leftover data for user atieno 2478131 wikitext text/x-wiki i8lvkbvhgxnfox81dcl2657arnoy2v4 2478132 2478131 2026-11-05T09:17:48Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.hadoop.check-user-leftovers (exit_code=0) Checking for leftover data for user atieno 2478132 wikitext text/x-wiki 38igktwtuy1jebowohxzh1mllbgnwa1 2478133 2478132 2026-11-05T09:17:49Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.hadoop.check-user-leftovers Checking for leftover data for user harrayo-wmf 2478133 wikitext text/x-wiki 2lhzvy59cgvseeslxhljtf0a81sdcbb 2478134 2478133 2026-11-05T09:17:57Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.hadoop.check-user-leftovers (exit_code=0) Checking for leftover data for user harrayo-wmf 2478134 wikitext text/x-wiki 0p9cappsbd6ohe3gz6wewa41ns1jmho 2478135 2478134 2026-11-05T09:23:52Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.hadoop.check-user-leftovers Checking for leftover data for user hmonroy 2478135 wikitext text/x-wiki kn375vsa5sj4a8ab2o1qc73k09ve9p7 2478136 2478135 2026-11-05T09:24:02Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.hadoop.check-user-leftovers (exit_code=0) Checking for leftover data for user hmonroy 2478136 wikitext text/x-wiki f4fap4aihrzuqum58v5uocq9kzzyc83 2478137 2478136 2026-11-05T09:31:01Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.hadoop.check-user-leftovers Checking for leftover data for user suecarmol 2478137 wikitext text/x-wiki khhptjujch160sxtmfd9oat3qi5l0dn 2478138 2478137 2026-11-05T09:31:10Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.hadoop.check-user-leftovers (exit_code=0) Checking for leftover data for user suecarmol 2478138 wikitext text/x-wiki tkei73l5yav9uqsrs4ke0lggv8nt7na 2478139 2478138 2026-11-05T09:35:31Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.hadoop.check-user-leftovers Checking for leftover data for user andreawest 2478139 wikitext text/x-wiki 2dxvl5d1q9vewadgcsb57xlzhdt510x 2478140 2478139 2026-11-05T09:35:52Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.hadoop.check-user-leftovers (exit_code=0) Checking for leftover data for user andreawest 2478140 wikitext text/x-wiki 2hbp4xpv0xfelahwsdkgor2yclsicc2 2478141 2478140 2026-11-05T09:35:53Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.hadoop.check-user-leftovers Checking for leftover data for user jmoore111 2478141 wikitext text/x-wiki k562jla3qy535x8fockhiv64o5qg8kh 2478142 2478141 2026-11-05T09:36:02Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.hadoop.check-user-leftovers (exit_code=0) Checking for leftover data for user jmoore111 2478142 wikitext text/x-wiki b666hs7s09z3k81wud8p56o4cmyajza 2478143 2478142 2026-11-05T09:36:03Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.hadoop.check-user-leftovers Checking for leftover data for user jynus 2478143 wikitext text/x-wiki axazk34krdxa3rhxml67x6hiibsxl13 2478144 2478143 2026-11-05T09:36:12Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.hadoop.check-user-leftovers (exit_code=0) Checking for leftover data for user jynus 2478144 wikitext text/x-wiki c848xrlfx3lk0gy6f4s0xyxzfn0azvi 2478145 2478144 2026-11-05T09:45:51Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ldap-replica2008.wikimedia.org 2478145 wikitext text/x-wiki 48mhootmdhwjb94zyj0hohh5gm8va6k 2478146 2478145 2026-11-05T09:49:40Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-replica2008.wikimedia.org 2478146 wikitext text/x-wiki hlg2gtb7pu1o3nzxpdvd8riye0fd80u 2478147 2478146 2026-11-05T09:53:19Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ldap-replica1005.wikimedia.org 2478147 wikitext text/x-wiki azx06tdcdrmc76yfmvh3j6dplf7jtgq 2478148 2478147 2026-11-05T09:53:50Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1167.eqiad.wmnet with reason: Maintenance 2478148 wikitext text/x-wiki cpi8lm0ydleev0os7swa5u90hlluixq 2478149 2478148 2026-11-05T09:53:52Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db1167 (T441633)', diff saved to https://phabricator.wikimedia.org/P97335 and previous config saved to /var/cache/conftool/dbconfig/20261105-095350-ladsgroup.json 2478149 wikitext text/x-wiki 4duklmb2jrxycof1y4knail6w7coynp 2478151 2478149 2026-11-05T09:57:11Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-replica1005.wikimedia.org 2478151 wikitext text/x-wiki dcbn0vvpg1emsjfoym98lufgdys7qb0 2478153 2478151 2026-11-05T10:02:11Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1167 (T441633)', diff saved to https://phabricator.wikimedia.org/P97336 and previous config saved to /var/cache/conftool/dbconfig/20261105-100209-ladsgroup.json 2478153 wikitext text/x-wiki jz3m7levam7mcmd38ca4bxkyc9mp4co 2478154 2478153 2026-11-05T10:02:16Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ldap-replica1006.wikimedia.org 2478154 wikitext text/x-wiki 0m6p7364v4c6tmg538uydhmq60lwajw 2478155 2478154 2026-11-05T10:04:25Z Stashbot 7414 cwilliams@cumin1004: START - Cookbook sre.mysql.pool pool db1262: Maintenance 2478155 wikitext text/x-wiki atz088o4040jyld3ylv52w1ry29mat5 2478156 2478155 2026-11-05T10:04:29Z Stashbot 7414 cwilliams@cumin1004: END (ERROR) - Cookbook sre.mysql.pool (exit_code=97) pool db1262: Maintenance 2478156 wikitext text/x-wiki dgb2ihfb8am1we3fddqwzivn8rm2d9h 2478157 2478156 2026-11-05T10:06:18Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ldap-replica1006.wikimedia.org 2478157 wikitext text/x-wiki hny5mtkbz4orbx2qtxtsmsj2gie5sva 2478158 2478157 2026-11-05T10:12:12Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1167', diff saved to https://phabricator.wikimedia.org/P97337 and previous config saved to /var/cache/conftool/dbconfig/20261105-101211-ladsgroup.json 2478158 wikitext text/x-wiki 2680kk940fw4wrf4kuw9ryaj2gi5tam 2478159 2478158 2026-11-05T10:16:58Z Stashbot 7414 cmooney@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on sretest1006.eqiad.wmnet with reason: test on other vlan 2478159 wikitext text/x-wiki hs55s1awq0qg8gozah3xjdmkmah9mmg 2478160 2478159 2026-11-05T10:19:05Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2250.codfw.wmnet with reason: Reimage 2478160 wikitext text/x-wiki r9jf6m4zf6z3eosoc9a8a9p44xufq1n 2478161 2478160 2026-11-05T10:20:42Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.hosts.reimage for host db2250.codfw.wmnet with OS trixie 2478161 wikitext text/x-wiki 91lgbw5vvglk361r0qrhbcdp467valk 2478162 2478161 2026-11-05T10:21:27Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.hosts.dhcp for host db2250.codfw.wmnet (push config only) 2478162 wikitext text/x-wiki nty94gb10ak2yuxxnhscbkh0isnxek6 2478163 2478162 2026-11-05T10:21:32Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host db2250.codfw.wmnet (push config only) 2478163 wikitext text/x-wiki 9ty6fzfqltl0w14jj8lg0jqs0i2sn3k 2478164 2478163 2026-11-05T10:22:14Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1167', diff saved to https://phabricator.wikimedia.org/P97338 and previous config saved to /var/cache/conftool/dbconfig/20261105-102213-ladsgroup.json 2478164 wikitext text/x-wiki 6zza5o1w75xa0o9x7i7ozmsjyq58xli 2478165 2478164 2026-11-05T10:26:02Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.hosts.reimage for host sretest1006.eqiad.wmnet with OS trixie 2478165 wikitext text/x-wiki dzft9jid6l8n0kuig8keoyxsw8q4kml 2478166 2478165 2026-11-05T10:27:03Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest1006.eqiad.wmnet (push config only) 2478166 wikitext text/x-wiki mvsseewiz64dr1ipee3nulqgxf5aotk 2478167 2478166 2026-11-05T10:27:07Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest1006.eqiad.wmnet (push config only) 2478167 wikitext text/x-wiki cxzh1m93753fst77an58iefp5uhoj6t 2478176 2478167 2026-11-05T10:32:04Z Stashbot 7414 moritzm: installing libgit2 security updates 2478176 wikitext text/x-wiki 9o69sywo87l1zkvorqo61lk4uvcahak 2478177 2478176 2026-11-05T10:32:06Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.hosts.dhcp for host db2250.codfw.wmnet (remove config only) 2478177 wikitext text/x-wiki p7i50mw9wiivqa5wni3z0o8adas5zjg 2478178 2478177 2026-11-05T10:32:12Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host db2250.codfw.wmnet (remove config only) 2478178 wikitext text/x-wiki 6n780pgbissyhtxt4rou4dkdk7hkt3d 2478179 2478178 2026-11-05T10:32:16Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1167 (T441633)', diff saved to https://phabricator.wikimedia.org/P97339 and previous config saved to /var/cache/conftool/dbconfig/20261105-103215-ladsgroup.json 2478179 wikitext text/x-wiki jzzbpgqe42d52s45vz4pjngbtvvgqzm 2478180 2478179 2026-11-05T10:32:34Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1192.eqiad.wmnet with reason: Maintenance 2478180 wikitext text/x-wiki m4gzmejpt0ajb7hpo0jqdg86q0mu56h 2478181 2478180 2026-11-05T10:32:36Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db1192 (T441633)', diff saved to https://phabricator.wikimedia.org/P97340 and previous config saved to /var/cache/conftool/dbconfig/20261105-103234-ladsgroup.json 2478181 wikitext text/x-wiki 3yfkkcx6ynyf3jvq2rtwqdwtbp4ohbx 2478182 2478181 2026-11-05T10:34:40Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on db2250.codfw.wmnet with reason: host reimage 2478182 wikitext text/x-wiki arduvfzwkucspsn46iz7yoidps476tu 2478183 2478182 2026-11-05T10:35:04Z Stashbot 7414 cwilliams@cumin1004: START - Cookbook sre.mysql.pool pool db1262: Maintenance 2478183 wikitext text/x-wiki 0esms4itq05wqmuwbla7fg9qdhepvzn 2478184 2478183 2026-11-05T10:38:26Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.reboot-nodes rolling reboot on A:dse-k8s-master-codfw 2478184 wikitext text/x-wiki f2z1w512z8t72y1a0l1mpic3a8anzjk 2478185 2478184 2026-11-05T10:38:30Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2250.codfw.wmnet with reason: host reimage 2478185 wikitext text/x-wiki nhdl6gnytggq3zbi1sxh6i42tcc7ywq 2478186 2478185 2026-11-05T10:38:31Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-ctrl2001.codfw.wmnet 2478186 wikitext text/x-wiki bz32x3x58nay527bzgpapwc0y9cf0vz 2478187 2478186 2026-11-05T10:38:32Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-ctrl2001.codfw.wmnet 2478187 wikitext text/x-wiki 54dbgzhq2wozdrpxwz4wdbazm1d7755 2478188 2478187 2026-11-05T10:40:49Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1192 (T441633)', diff saved to https://phabricator.wikimedia.org/P97342 and previous config saved to /var/cache/conftool/dbconfig/20261105-104047-ladsgroup.json 2478188 wikitext text/x-wiki 2l1pe09e437rh34sfle2136eghkb6rf 2478189 2478188 2026-11-05T10:43:26Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-ctrl2001.codfw.wmnet 2478189 wikitext text/x-wiki oivvq0zw9xnvfw971ke4q8rveu7nx1s 2478190 2478189 2026-11-05T10:43:28Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-ctrl2001.codfw.wmnet 2478190 wikitext text/x-wiki ej2fzfdx71zwastotw36trlxfyke9yb 2478191 2478190 2026-11-05T10:43:33Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-ctrl2002.codfw.wmnet 2478191 wikitext text/x-wiki q57axxdguolkykfckcl188s9v7valjt 2478192 2478191 2026-11-05T10:43:35Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-ctrl2002.codfw.wmnet 2478192 wikitext text/x-wiki l2x8vdvhah2kfk4kf7oh2vsl5onxhao 2478193 2478192 2026-11-05T10:48:38Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-ctrl2002.codfw.wmnet 2478193 wikitext text/x-wiki fagzcary6oko4pmylmo26jybswztb9j 2478194 2478193 2026-11-05T10:48:41Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-ctrl2002.codfw.wmnet 2478194 wikitext text/x-wiki tjptmqhgvtq0qm7591eldvncr89yh14 2478195 2478194 2026-11-05T10:48:42Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on A:dse-k8s-master-codfw 2478195 wikitext text/x-wiki jxzbhkngtd49v9aa03nrcytxpv7h6t9 2478196 2478195 2026-11-05T10:50:50Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1192', diff saved to https://phabricator.wikimedia.org/P97344 and previous config saved to /var/cache/conftool/dbconfig/20261105-105049-ladsgroup.json 2478196 wikitext text/x-wiki mgyl1ih77cgup3pfyg4omojvrbaqs8p 2478197 2478196 2026-11-05T10:51:38Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.kafka.roll-restart-reboot-brokers rolling reboot on A:kafka-test-eqiad 2478197 wikitext text/x-wiki i2vp14wjri508elfz660i9ct7jd983t 2478198 2478197 2026-11-05T10:51:53Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.reboot-nodes rolling reboot on A:dse-k8s-master-eqiad 2478198 wikitext text/x-wiki fpk6dznafyhzc83aespni4fgsv3hlza 2478199 2478198 2026-11-05T10:51:56Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-ctrl1001.eqiad.wmnet 2478199 wikitext text/x-wiki 00g1w165p2sq1m9f6pg5f5c6q7i9c94 2478200 2478199 2026-11-05T10:51:58Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-ctrl1001.eqiad.wmnet 2478200 wikitext text/x-wiki dmtggsmx7ga827280kvqxj9rsnnld1o 2478201 2478200 2026-11-05T10:56:50Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-ctrl1001.eqiad.wmnet 2478201 wikitext text/x-wiki 3s157wd13r0o4tb4h31c5p8qul1oty7 2478202 2478201 2026-11-05T10:56:52Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-ctrl1001.eqiad.wmnet 2478202 wikitext text/x-wiki tk8pbia9tvueclmeq4t8jymkf9pvwp9 2478203 2478202 2026-11-05T10:56:57Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-ctrl1002.eqiad.wmnet 2478203 wikitext text/x-wiki 609i250m4ava53wj0dqrjzre53bz0nl 2478204 2478203 2026-11-05T10:56:58Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host dse-k8s-ctrl1002.eqiad.wmnet 2478204 wikitext text/x-wiki 1qg4icmsy1keylpnvb1l5anz7bzsrug 2478205 2478204 2026-11-05T11:00:52Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1192', diff saved to https://phabricator.wikimedia.org/P97346 and previous config saved to /var/cache/conftool/dbconfig/20261105-110051-ladsgroup.json 2478205 wikitext text/x-wiki iqih98bpdgz9ib1h80dif7n40j80lw3 2478207 2478205 2026-11-05T11:01:49Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host dse-k8s-ctrl1002.eqiad.wmnet 2478207 wikitext text/x-wiki jnad7n5fj78akq2dzgdr83j4yowrua2 2478208 2478207 2026-11-05T11:01:50Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host dse-k8s-ctrl1002.eqiad.wmnet 2478208 wikitext text/x-wiki d0vl4m35tawcgw6tgq2cp5eahuyp8pg 2478209 2478208 2026-11-05T11:01:51Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on A:dse-k8s-master-eqiad 2478209 wikitext text/x-wiki fokwxqv297jmcv6bgshtz0px21ralwr 2478212 2478209 2026-11-05T11:04:39Z Stashbot 7414 ladsgroup@deploy2003: helmfile [staging] START helmfile.d/services/thumbor: apply 2478212 wikitext text/x-wiki 4af06qci8a9a00l0yurajwkpu4yn1h0 2478213 2478212 2026-11-05T11:05:48Z Stashbot 7414 ladsgroup@deploy2003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2478213 wikitext text/x-wiki dcfszf5nmxnlhotghwxhbdvwdozkmwy 2478214 2478213 2026-11-05T11:09:06Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2250.codfw.wmnet with OS trixie 2478214 wikitext text/x-wiki f657lczqglfwlbou2nwdqos1u6x4m62 2478215 2478214 2026-11-05T11:10:54Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1192 (T441633)', diff saved to https://phabricator.wikimedia.org/P97348 and previous config saved to /var/cache/conftool/dbconfig/20261105-111053-ladsgroup.json 2478215 wikitext text/x-wiki d682uk5mfn1a9jcdedlsfohtydn4616 2478216 2478215 2026-11-05T11:11:12Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1209.eqiad.wmnet with reason: Maintenance 2478216 wikitext text/x-wiki 684b0a7yorceot4lyjzbff8bchylmjm 2478217 2478216 2026-11-05T11:11:14Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db1209 (T441633)', diff saved to https://phabricator.wikimedia.org/P97349 and previous config saved to /var/cache/conftool/dbconfig/20261105-111113-ladsgroup.json 2478217 wikitext text/x-wiki bwc3arg7qjxde45165jcgg7z4vn1a74 2478218 2478217 2026-11-05T11:12:08Z Stashbot 7414 ladsgroup@deploy2003: helmfile [eqiad] START helmfile.d/services/thumbor: apply 2478218 wikitext text/x-wiki 9s0woz2bhs2ydgs3bpbbel8ovhntchx 2478219 2478218 2026-11-05T11:13:38Z Stashbot 7414 ladsgroup@deploy2003: helmfile [eqiad] DONE helmfile.d/services/thumbor: apply 2478219 wikitext text/x-wiki t9lfvb8je9vcdfya9ft9wxtzeaazxud 2478220 2478219 2026-11-05T11:14:38Z Stashbot 7414 ladsgroup@deploy2003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2478220 wikitext text/x-wiki 23zs9vlag1ah1egf52f236i7inapmjd 2478221 2478220 2026-11-05T11:15:12Z Stashbot 7414 atsuko@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-ml: apply 2478221 wikitext text/x-wiki 53b2bndcktvei1s10ms8f34ar203rq4 2478222 2478221 2026-11-05T11:16:15Z Stashbot 7414 atsuko@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-ml: apply 2478222 wikitext text/x-wiki sl1hy9npk390xd2523q38s8codq21u9 2478223 2478222 2026-11-05T11:16:59Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.dns.netbox 2478223 wikitext text/x-wiki tt07qi9wop4q4ksdz1shtp8i5nphil2 2478224 2478223 2026-11-05T11:17:58Z Stashbot 7414 ladsgroup@deploy2003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2478224 wikitext text/x-wiki h2kewva8kx2y21h04qcizruf1bcqky2 2478225 2478224 2026-11-05T11:18:20Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1209 (T441633)', diff saved to https://phabricator.wikimedia.org/P97350 and previous config saved to /var/cache/conftool/dbconfig/20261105-111819-ladsgroup.json 2478225 wikitext text/x-wiki 3yv7x59uiwbq120av0lo8qnhgya75hy 2478226 2478225 2026-11-05T11:20:12Z Stashbot 7414 cwilliams@cumin1004: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1262: Maintenance 2478226 wikitext text/x-wiki kx5rjolyabk1n5ryksgvnstqandl9ru 2478227 2478226 2026-11-05T11:22:34Z Stashbot 7414 btullis@cumin1004: END (ERROR) - Cookbook sre.hadoop.reboot-workers (exit_code=97) for Hadoop analytics cluster 2478227 wikitext text/x-wiki 2kxar98zr9gp54u6a0aypyhyxctru8x 2478228 2478227 2026-11-05T11:27:34Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.kafka.roll-restart-reboot-brokers (exit_code=0) rolling reboot on A:kafka-test-eqiad 2478228 wikitext text/x-wiki eevgj9amubmeg2pwup70v50k71qqxgy 2478229 2478228 2026-11-05T11:28:22Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1209', diff saved to https://phabricator.wikimedia.org/P97352 and previous config saved to /var/cache/conftool/dbconfig/20261105-112821-ladsgroup.json 2478229 wikitext text/x-wiki prc0vojuxxq7dqi2q0p3uqk2g3as6st 2478231 2478229 2026-11-05T11:38:24Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1209', diff saved to https://phabricator.wikimedia.org/P97353 and previous config saved to /var/cache/conftool/dbconfig/20261105-113823-ladsgroup.json 2478231 wikitext text/x-wiki dpslgojsv2pw7esuq4pk1rvdol4d1is 2478232 2478231 2026-11-05T11:47:07Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update entry for sretest1006 - cmooney@cumin1004" 2478232 wikitext text/x-wiki r3vwa6iusi08hsrkq1b71wjb704xyq8 2478233 2478232 2026-11-05T11:47:09Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest1006.eqiad.wmnet (remove config only) 2478233 wikitext text/x-wiki 5ebfja89zyj3jpw6rycs93x0ugh9jor 2478234 2478233 2026-11-05T11:47:11Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update entry for sretest1006 - cmooney@cumin1004" 2478234 wikitext text/x-wiki 21of3st90sk8lcxopkr7qcv20nlcafo 2478235 2478234 2026-11-05T11:47:12Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2478235 wikitext text/x-wiki 4egej4fvdy5o2bd0e1la7gj3vcj3q5s 2478236 2478235 2026-11-05T11:47:14Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest1006.eqiad.wmnet (remove config only) 2478236 wikitext text/x-wiki mxcainhxr006sn42umig2qlryzo0d96 2478237 2478236 2026-11-05T11:47:15Z Stashbot 7414 cmooney@cumin1004: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest1006.eqiad.wmnet with OS trixie 2478237 wikitext text/x-wiki 06l0pddb2pzbhesqueq5m7m5zizpg4y 2478238 2478237 2026-11-05T11:48:26Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1209 (T441633)', diff saved to https://phabricator.wikimedia.org/P97354 and previous config saved to /var/cache/conftool/dbconfig/20261105-114825-ladsgroup.json 2478238 wikitext text/x-wiki t0dhysxqxw5htd5ks8nphsopkqtvllv 2478239 2478238 2026-11-05T11:48:44Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1214.eqiad.wmnet with reason: Maintenance 2478239 wikitext text/x-wiki 5nrnee9woo7z1mpxcbfxj3emdsw732o 2478240 2478239 2026-11-05T11:48:46Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db1214 (T441633)', diff saved to https://phabricator.wikimedia.org/P97355 and previous config saved to /var/cache/conftool/dbconfig/20261105-114845-ladsgroup.json 2478240 wikitext text/x-wiki cqn4n0lc9u13s04mqp6qe7td9pe21hk 2478241 2478240 2026-11-05T11:49:12Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.dns.wipe-cache sretest1006.eqiad.wmnet on all recursors 2478241 wikitext text/x-wiki opi9leu6vgvfmanhmbj1oxv5gg3k92j 2478242 2478241 2026-11-05T11:49:16Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) sretest1006.eqiad.wmnet on all recursors 2478242 wikitext text/x-wiki mojvlhfa2xz6rbsyhviy0ow21iimd3g 2478244 2478242 2026-11-05T11:51:56Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.hosts.reimage for host sretest1006.eqiad.wmnet with OS trixie 2478244 wikitext text/x-wiki g8y1uj3nlov0rw5c8f78mtf9gbaocqt 2478245 2478244 2026-11-05T11:52:04Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest1006.eqiad.wmnet (push config only) 2478245 wikitext text/x-wiki ntd98seeqyminhshwdjjq2x9cpg8cyo 2478246 2478245 2026-11-05T11:52:08Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest1006.eqiad.wmnet (push config only) 2478246 wikitext text/x-wiki 959d1jmfbc4wlyyckakyxdw909p57i7 2478247 2478246 2026-11-05T11:55:50Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1214 (T441633)', diff saved to https://phabricator.wikimedia.org/P97356 and previous config saved to /var/cache/conftool/dbconfig/20261105-115549-ladsgroup.json 2478247 wikitext text/x-wiki 8d9rbvnb48nas06hejd76iankaj3tyo 498 10360 2477800 2444689 2026-11-04T20:22:47Z Stashbot 7414 andrewbogott: deleting all VMs, see T435771 2477800 wikitext text/x-wiki e2k0puo5kelrdm1w4syhdwi9dtl81uv 498 14874 2477843 2453538 2026-11-04T20:51:17Z Stashbot 7414 andrewbogott: deleting all VMs, see T435790 2477843 wikitext text/x-wiki 3eqpgi1wwh9jo0koaysvnbla17hu9d6 0 17290 2477505 2477062 2026-11-04T13:57:07Z Stashbot 7414 hashar: Regenerating ecs documentation after having upgraded the image from Bullseye to Trixie: `zuul enqueue --trigger gerrit --pipeline postmerge --project operations/software/ecs --change 1280737,6` # T383337 2477505 wikitext text/x-wiki ql2gi58mq8n4e7dusswe0b0g35hiy2q 2477763 2477505 2026-11-04T19:22:42Z Stashbot 7414 dduvall: taking integration-agent-docker-107[0-5] offline for migration to trixie based agents (T440670) 2477763 wikitext text/x-wiki 67eeet7gm6y165vubpxapxd59u6d8wz 2477764 2477763 2026-11-04T19:24:20Z Stashbot 7414 dduvall: provisioning integration-agent-docker-109[6-9] trixie based agents (T440670) 2477764 wikitext text/x-wiki pzzk71retafs17ihgqq84469y1tn3e1 2477765 2477764 2026-11-04T19:24:37Z Stashbot 7414 dancy: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/c/integration/config/+/1357928 2477765 wikitext text/x-wiki 1uw8jj6fctv8cz8iwcc6b2a67mrtgnk 2477766 2477765 2026-11-04T19:27:28Z Stashbot 7414 dancy: ./jjb-update mediawiki-node26 quibble-vendor-mysql-php83 (testing T439116) 2477766 wikitext text/x-wiki 1sj0fzyv5dp9le0yez3gcobukcw8ch1 2477786 2477766 2026-11-04T20:01:11Z Stashbot 7414 dduvall: added new integration-agent-docker-{1097,1098,1099,1100,1101} trixie based agents to jenkins (T440670) 2477786 wikitext text/x-wiki cm45l2vjwbz9s1zmi5ah9smootmggsb 2477788 2477786 2026-11-04T20:03:30Z Stashbot 7414 dduvall: removing integration-agent-docker-{1071,1072,1073,1074,1075} agents from jenkins and deleting instances (T440670) 2477788 wikitext text/x-wiki t7y30rll90hbpxujrc6f04cfcg0mcdu 2477811 2477788 2026-11-04T20:32:26Z Stashbot 7414 Southparkfan: Preparing Cassandra for sessionstore switchover - T436471 2477811 wikitext text/x-wiki qy20cycas4h8x58vytf1f5wctw7segb 2477878 2477811 2026-11-04T21:45:25Z Stashbot 7414 Southparkfan: Decommission deployment-sessionstore06 - T436471 2477878 wikitext text/x-wiki rehp2vif5fm7ac9ptoqcur5ydl9gmf3 2477883 2477878 2026-11-04T21:59:16Z Stashbot 7414 Southparkfan: Upgrade change-propragation container to use new image with node26 (T442195) - T442482 2477883 wikitext text/x-wiki l1o1lth3zvu4tsw5wt09azi2nropf3i 2477910 2477883 2026-11-04T22:32:38Z Stashbot 7414 dduvall: taking integration-agent-docker-{1076,1077,1078,1079,1080,1081} offline to be replaced by trixie agents (T440670) 2477910 wikitext text/x-wiki hwpntdoi9igbfi7rv5mh0w6nzv9hyvu 2477912 2477910 2026-11-04T22:40:58Z Stashbot 7414 dduvall: creating new integration-agent-docker-{1102,1103,1104,1105,1106,1107} trixie based instances/agents (T440670) 2477912 wikitext text/x-wiki aacq6556gbysruhm7xmnfsgczz5jsm3 2477918 2477912 2026-11-04T22:57:16Z Stashbot 7414 dduvall: registered new integration-agent-docker-{1102,1103,1104,1105,1106,1107} trixie based agents with jenkins (T440670) 2477918 wikitext text/x-wiki htog3tlrldzwo2psjiyb33qc4rcyb2z 2477922 2477918 2026-11-04T22:59:25Z Stashbot 7414 dduvall: deleting integration-agent-docker-{1076,1077,1078,1079,1081,1082} agents (T440670) 2477922 wikitext text/x-wiki eb1wdi3x2w4tjdblbgcwds3rfjzpvre 2477923 2477922 2026-11-04T23:02:39Z Stashbot 7414 dduvall: taking integration-agent-docker-{1083,1084,1085,1086,1087,1088} offline to be replaced by trixie agents (T440670) 2477923 wikitext text/x-wiki shusoyfs2sh7mw6hrdkqj9dhq5rypln 2477924 2477923 2026-11-04T23:04:11Z Stashbot 7414 dduvall: creating new integration-agent-docker-{1108,1109,1110,1111,1112,1113} trixie based instances/agents (T440670) 2477924 wikitext text/x-wiki 7v56wu3txqyzjnvtft6aewn8n23abj7 2477938 2477924 2026-11-04T23:27:09Z Stashbot 7414 dduvall: registered new integration-agent-docker-{1108,1109,1110,1111,1112,1113} trixie based agents with jenkins (T440670) 2477938 wikitext text/x-wiki p3fbstv4czhk7c5n2upvqkbhw3hnsda 2477942 2477938 2026-11-04T23:27:51Z Stashbot 7414 dduvall: deleting integration-agent-docker-{1083,1084,1085,1086,1087,1088} agents and instances (T440670) 2477942 wikitext text/x-wiki qcd8yfmv1u2s7ak5bd17qdnc8ydtz2b 2477943 2477942 2026-11-04T23:31:41Z Stashbot 7414 dduvall: taking integration-agent-docker-{1089,1090,1091,1092,1093} offline to be replaced by trixie agents (T440670) 2477943 wikitext text/x-wiki aq67bpl4oafsqnyp4sog1ol751lz0i8 2477944 2477943 2026-11-04T23:33:39Z Stashbot 7414 dduvall: creating new integration-agent-docker-{1114,1115,1116,1117,1118} trixie based instances/agents (T440670) 2477944 wikitext text/x-wiki a41ksk7f0gmqclqq9ociq0uani2oao1 2477953 2477944 2026-11-04T23:55:02Z Stashbot 7414 dduvall: registered new integration-agent-docker-{1114,1115,1116,1117,1118} trixie based agents with jenkins (T440670) 2477953 wikitext text/x-wiki 8duxq1zyut3tm5j9ibraiukwidacrel 2477954 2477953 2026-11-04T23:55:23Z Stashbot 7414 dduvall: deleting integration-agent-docker-{1089,1090,1091,1092,1093} agents and instances (T440670) 2477954 wikitext text/x-wiki jc1p93b3jqazdyn5sd2lctp691us2dx 2477967 2477954 2026-11-05T00:05:00Z Stashbot 7414 dduvall: creating new integration-agent-puppet-docker-{1006,1007} trixie based instances/agents (T440670) 2477967 wikitext text/x-wiki 2r8hbjia2uj6d3bxjt4l4qusz5kng5e 2477976 2477967 2026-11-05T00:19:19Z Stashbot 7414 dduvall: taking integration-agent-puppet-docker-{1004,1005} offline to be replaced by trixie agents (T440670) 2477976 wikitext text/x-wiki awmpcxigkgtchzu7fewq6gzts0u9inr 2477978 2477976 2026-11-05T00:21:13Z Stashbot 7414 dduvall: deleting integration-agent-puppet-docker-{1004,1005} agents and instances (T440670) 2477978 wikitext text/x-wiki dapc3njy707gpw74l3k91928f4yzuf1 2477979 2477978 2026-11-05T00:21:31Z Stashbot 7414 dduvall: registered new integration-agent-puppet-docker-{1006,1007} trixie based agents with jenkins (T440670) 2477979 wikitext text/x-wiki a8udeplk724ii6bi8roi0ccx6so80s8 2477980 2477979 2026-11-05T00:27:43Z Stashbot 7414 dduvall: all integration-agent-docker and integration-agent-puppet-docker agents have been migrated to trixie (T440670) 2477980 wikitext text/x-wiki hx9bu9lfdnnqud46bd7a7oo80sz2fza 2477982 2477980 2026-11-05T00:32:08Z Stashbot 7414 dduvall: restarting containerd on contint{1003,2003} to deploy https://gerrit.wikimedia.org/r/c/operations/puppet/+/1356455 2477982 wikitext text/x-wiki 2sgy5s1dq5xne4bl51l2trlwv0zpujg 0 22139 2477588 2470810 2026-11-04T15:26:06Z Krinkle 44 /* Interfaces */ restore clear and practical spark3-sql example to get started 2477588 wikitext text/x-wiki 5z8hcooij3uwpnvzz1fjgi0qr8r25iw 2477935 2477588 2026-11-04T23:17:27Z Krinkle 44 /* Command line */ 2477935 wikitext text/x-wiki s0kiuwwqcng7h44gzvynh88d5i9z0sp 0 24479 2477596 2443319 2026-11-04T15:33:28Z Krinkle 44 link [[Data Platform/Systems/AQS]] 2477596 wikitext text/x-wiki e0n5ww5ezb4fbnxwp4rfbpz831vcvjy 0 29021 2478206 2419351 2026-11-05T11:01:47Z Effie Mouzeli (WMF) 12880 2478206 wikitext text/x-wiki 1mrh4c5si0tyy1xidvvuo4860wg3lxi 498 73236 2478023 2472051 2026-11-05T03:07:25Z Stashbot 7414 wmbot~anticomposite@tools-bastion-15: deploy 08e4cee (StewardBot: Set bot mode, 2026-11-02) 2478023 wikitext text/x-wiki 0qxynbthea30pyu1dxrnesleq4j8l6d 2478024 2478023 2026-11-05T03:09:04Z Stashbot 7414 wmbot~anticomposite@tools-bastion-15: deploy 3db76d0 (SULWatcher: Set bot mode, 2026-11-02) 2478024 wikitext text/x-wiki k15q9wbaqpwxq2vnmmd49xcqtiil2lf 498 164643 2477833 2379434 2026-11-04T20:46:09Z Stashbot 7414 andrewbogott: deleting synapse01 VM, see T435777 2477833 wikitext text/x-wiki 8931rqapavy2vrdi9quom8cubngvxia 0 441912 2477787 2452101 2026-11-04T20:02:32Z BPirkle (WMF) 12686 typo fix 2477787 wikitext text/x-wiki 75o7g4zb8ktypk0n6jgjaa776kh53r7 498 443628 2477682 2477212 2026-11-04T17:44:21Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41879214126 (https://github.com/cluebotng/component-configs/commits/230211c76403808093c776115bc37480e740de36) 2477682 wikitext text/x-wiki j71j4hic9x3bfh045icq4460bop2jqa 2477951 2477682 2026-11-04T23:47:39Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/41935942732 (https://github.com/cluebotng/component-configs/commits/0acc26b8c3ae99ca82d89767fec31ad7b93e5262) 2477951 wikitext text/x-wiki dl3xtnvx5zkezag87x3gebq52k8b0m1 2478033 2477951 2026-11-05T03:29:13Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/41961409161 (https://github.com/cluebotng/component-configs/commits/f392ff08eb9768ab93538b5d6ed5cdf5306b9e50) 2478033 wikitext text/x-wiki lwdqklmlh6n97q845smp02y89381hkv 2478057 2478033 2026-11-05T04:55:32Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/41970293977 (https://github.com/cluebotng/component-configs/commits/249d7f9d3e64c31431d63973b2e535b32af4e788) 2478057 wikitext text/x-wiki 2nf45r9zsk5v0sibqcyc0bs5yjxqjck 2478072 2478057 2026-11-05T05:33:43Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41974300376 (https://github.com/cluebotng/component-configs/commits/62ff28a67ca66036c9cb17267fa8a2cff7a5b641) 2478072 wikitext text/x-wiki qwr1yhr3gwclpi8pzrsw0seugobw6cy 2478076 2478072 2026-11-05T05:39:06Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41974543482 (https://github.com/cluebotng/component-configs/commits/7f5f130ad27cc6b58d18dc7db9fb6f17a994795f) 2478076 wikitext text/x-wiki gd3ls4vpban6ft16q7r4q9ulbde8cxs 2478080 2478076 2026-11-05T05:54:16Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/41976470110 (https://github.com/cluebotng/component-configs/commits/dfe8bea82a81a0c7ff97c707693c7eff5fc01658) 2478080 wikitext text/x-wiki 1709hzu3eos5ipd2z4d23ih3chlk5ib 498 443949 2477771 2475433 2026-11-04T19:42:56Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 4ed15cb (Cap the dashboard health run-strip to recent runs) 2477771 wikitext text/x-wiki emf4kpu0wxkcf1orewaw2x6k9fzarpi 2477772 2477771 2026-11-04T19:42:57Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy f66509c (Add load-dump mise task for seeding a local DB from prod) 2477772 wikitext text/x-wiki ci7ibyab1yswsfa20hzga8zal8mu0ja 2477773 2477772 2026-11-04T19:43:00Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy acf1a3b (Add unified dashboard browse with feature facets) for T440134 2477773 wikitext text/x-wiki joj8kc1ka3tywun4xgfaeo9obcusdee 2477774 2477773 2026-11-04T19:43:02Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 67808f5 (Overlay config-change markers on the dashboard trend chart) for T440134 2477774 wikitext text/x-wiki byl9woivomr3ahw30d9ymeou2zpdkmz 2477775 2477774 2026-11-04T19:43:05Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 1b4fdbb (Add per-dashboard configuration panel) for T440134 2477775 wikitext text/x-wiki jgytgdt4z7gpz32zongsblanzb1ztpa 2477776 2477775 2026-11-04T19:43:07Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy c127991 (Make Selector mentions a multi-value AND facet with Tom Select (T440134)) for T440134 2477776 wikitext text/x-wiki 8mngaev6rp4k3hc0a5mnlvxuqva542w 2477777 2477776 2026-11-04T19:43:08Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy c7e61a4 (Use the relative_time macro for pre-existing inline <time> markup) 2477777 wikitext text/x-wiki tes7314i4rdoyype6wh2admdxrgkpn5 2477778 2477777 2026-11-04T19:43:10Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy e6de50c (Pass dashboard feature filters as one dict, not 13 kwargs) for T440134 2477778 wikitext text/x-wiki p0vt3iibs3uiuckdov9fb1ovihlbkwb 2477779 2477778 2026-11-04T19:43:12Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy c3dbf88 (Add a key for the run-tick strips) 2477779 wikitext text/x-wiki m2ssko338go8aich9nphz11coi1tpqb 2477780 2477779 2026-11-04T19:43:13Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 47b55de (Make count deltas on the stat cards neutral) 2477780 wikitext text/x-wiki nizsz6a3ash5m6i1zuyss7c3olww2k4 2477781 2477780 2026-11-04T19:43:15Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 3f252a8 (Show an absolute date for old tracked since values) for T440134 2477781 wikitext text/x-wiki m8jewr80ooz75gqxgpyk6syuavqtfcs 2477782 2477781 2026-11-04T19:43:16Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 01ca4aa (Size the stat-card sparklines through a wrapper, not the canvas) 2477782 wikitext text/x-wiki ma9j1j2qylc2ja0yru5hj6trv3mgxbi 2477783 2477782 2026-11-04T19:43:17Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 60713cb (Use compact point-style legends on the history charts) 2477783 wikitext text/x-wiki goxe2gm3vi6f0ty92bs5wmpc7wly11o 2477784 2477783 2026-11-04T19:43:18Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 8563874 (Make the Health card title a real heading) 2477784 wikitext text/x-wiki 06m3kcjgegsn1y3k6ly8o7ermyglqla 2477785 2477784 2026-11-04T19:43:20Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy e6e5a12 (Mute the parent path in the dashboard page title) 2477785 wikitext text/x-wiki qgc6wgk05eyf4umhvuz52gddbr0vb6r 2478169 2477785 2026-11-05T10:31:39Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy e3cee44 (Add grouping_counts JSON column to dashboard_runs) for T438830 2478169 wikitext text/x-wiki 7rdbqyemtygmzrvpad1h8apqbwl48sz 2478170 2478169 2026-11-05T10:31:41Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 2321887 (Capture no_group row in ParsedReport; add grouping_counts_dict) for T438830 2478170 wikitext text/x-wiki s6gh3c9059dzv6jzzzfw5h8fyv2i1ox 2478171 2478170 2026-11-05T10:31:44Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 02101ec (Populate grouping_counts on live runs) for T438830 2478171 wikitext text/x-wiki ayoij3oz0mo8w52f3zo80mik6mwj4nd 2478172 2478171 2026-11-05T10:31:47Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 2ac1669 (Derive entity_sum from grouping_counts; expose in chart and health) for T438830 2478172 wikitext text/x-wiki 4g9vglhl2mkg01my4jabkayov90oxck 2478173 2478172 2026-11-05T10:31:49Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 6ff0556 (Trend chart: add entity_sum series, legend, entity_sum stat card) for T438830 2478173 wikitext text/x-wiki srtp7249m7losf0wonb26zpcptitxua 2478174 2478173 2026-11-05T10:31:51Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 4c6f057 (Add --update-existing to backfiller to populate grouping_counts on old runs) for T438830 2478174 wikitext text/x-wiki 0mc2ed0ruhubzya56sat4mdchusf0xp 2478175 2478174 2026-11-05T10:31:52Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 3b3c3ea (Mute groupings line on trend chart (dashed, thin, secondary colour)) 2478175 wikitext text/x-wiki f8mfvy1sn8kum49roq6dhf9jk0t29yk 0 444110 2477880 2334407 2026-11-04T21:48:34Z Southparkfan 1843 2477880 wikitext text/x-wiki nxw4tmslv7clmzzhwnkyuys5w1lrv3y 498 446211 2478066 2477157 2026-11-05T05:30:15Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/41974300400 (https://github.com/cluebotng/component-configs/commits/62ff28a67ca66036c9cb17267fa8a2cff7a5b641) 2478066 wikitext text/x-wiki 81pvr34skyp1r2wzfoffl3mzfvcv81x 498 448784 2477796 2379413 2026-11-04T20:18:09Z Stashbot 7414 andrewbogott: deleting VM 'production', see T435763 2477796 wikitext text/x-wiki 31tmqgdxexboxwozxxgrurlqdvyd8j8 498 448953 2477841 2379442 2026-11-04T20:50:07Z Stashbot 7414 andrewbogott: deleting all VMs, see T435786 2477841 wikitext text/x-wiki c7mqib6yog0dwlyhk8qoypsqn43rho7 0 449160 2477874 2477319 2026-11-04T21:36:20Z Dexbot 30554 Bot: Updating the report 2477874 wikitext text/x-wiki 2od28gyfe5rih1ws45vk58tzoxbgnjk 2477961 2477874 2026-11-05T00:00:45Z Dexbot 30554 Bot: Updating the report 2477961 wikitext text/x-wiki lbrb2l3d6131rnoz5fjgjk84eklicc4 2477975 2477961 2026-11-05T00:15:48Z Dexbot 30554 Bot: Updating the report 2477975 wikitext text/x-wiki 44m8sz3xjtxxvc569hftw8sjzog3gaf 2478150 2477975 2026-11-05T09:56:24Z Dexbot 30554 Bot: Updating the report 2478150 wikitext text/x-wiki ldccs5ye6vnf1q6q9z0iwcsu85dx2pr 498 451228 2477838 2476306 2026-11-04T20:48:55Z Stashbot 7414 andrewbogott: deleting all VMs, see T435785 2477838 wikitext text/x-wiki pstehw0lpcya9pt6m3imns791zxlfd8 828 452250 2477471 2458945 2026-11-04T13:12:05Z Toolforge Image Bot 35765 Bot: Updating available container images 2477471 json application/json 5tln4je6q2v6c49facstmbjcyz6ub2v 498 452890 2477660 2477196 2026-11-04T16:55:26Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41871475015 (https://github.com/cluebotng/component-configs/commits/2013e4c5bd958fdebe0a0c4511369f5a2457b368) 2477660 wikitext text/x-wiki 28nyepbeb686wwlozkhogpjca8kjy0h 2477950 2477660 2026-11-04T23:47:34Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/41935942779 (https://github.com/cluebotng/component-configs/commits/0acc26b8c3ae99ca82d89767fec31ad7b93e5262) 2477950 wikitext text/x-wiki c1uvonas3u5zk74keat7f7tdd129v0g 2478034 2477950 2026-11-05T03:29:19Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/41961409152 (https://github.com/cluebotng/component-configs/commits/f392ff08eb9768ab93538b5d6ed5cdf5306b9e50) 2478034 wikitext text/x-wiki nv4ouqe1fip9kvr5kefqk739a46e0we 2478058 2478034 2026-11-05T04:57:13Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41970294033 (https://github.com/cluebotng/component-configs/commits/249d7f9d3e64c31431d63973b2e535b32af4e788) 2478058 wikitext text/x-wiki j1ohcanea0h58qvtf3k47yx6gp917y1 2478073 2478058 2026-11-05T05:34:39Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41974300319 (https://github.com/cluebotng/component-configs/commits/62ff28a67ca66036c9cb17267fa8a2cff7a5b641) 2478073 wikitext text/x-wiki cg3vh7co2en83iwyrg4dzxenfft1wr3 2478078 2478073 2026-11-05T05:50:56Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/41976470115 (https://github.com/cluebotng/component-configs/commits/dfe8bea82a81a0c7ff97c707693c7eff5fc01658) 2478078 wikitext text/x-wiki l63tr6u3wlbn19eulxqyvra8uskz2lv 2478086 2478078 2026-11-05T06:14:13Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41978491372 (https://github.com/cluebotng/component-configs/commits/c13b42c494b46b9b47c56144b4bfef621ce4246b) 2478086 wikitext text/x-wiki bcwvkyanj629w8kigip3nc9ddn2zgl5 0 453597 2477678 2475508 2026-11-04T17:33:56Z DCaro (WMF) 18271 /* 2026 */ 2477678 wikitext text/x-wiki 19rermwych4bydip91fnkfi3rp9bzd4 498 454469 2477794 2453510 2026-11-04T20:15:25Z Stashbot 7414 andrewbogott: deleting VM bub2-instance, see T435761 2477794 wikitext text/x-wiki ey1fknkrnsrxq6vpqh8k8ud9dworqnj 498 454772 2477845 2476307 2026-11-04T20:52:31Z Stashbot 7414 andrewbogott: deleting all VMs, see T435759 2477845 wikitext text/x-wiki chmanpk5ulkjk6cu6r8zffrnuurvd90 498 455144 2477802 2195341 2026-11-04T20:24:50Z Stashbot 7414 andrewbogott: deleting all VMs, see T435772 2477802 wikitext text/x-wiki am7wpr1vdiumstogdurupkhsrnbmixb 498 455174 2477804 2379428 2026-11-04T20:26:17Z Stashbot 7414 andrewbogott: deleting all VMs, see T435773 2477804 wikitext text/x-wiki lj7lrs6ev4edzbvqtmxn33qsvznnrqk 498 455195 2477829 2453522 2026-11-04T20:44:50Z Stashbot 7414 andrewbogott: deleting all VMs, see T435776 2477829 wikitext text/x-wiki g0mtrdh7sbqk8dwxuv277oigxsjzvsg 0 455791 2477391 2401383 2026-11-04T12:19:04Z SFaci-WMF 35637 /* Managed data */ 2477391 wikitext text/x-wiki pj0f8s0y7bppy3trsr4xbftvg32seuz 0 455989 2477864 2475653 2026-11-04T21:19:30Z JVanderhoop-WMF 41069 /* Exposure logging */ Made explicit guidance on divergence, testing in both variants 2477864 wikitext text/x-wiki bgl0yzu8pw8z8923u1vcotlt3n9ckz8 0 456453 2477425 2263383 2026-11-04T12:43:23Z Effie Mouzeli (WMF) 12880 Redirected page to [[PHP upgrade process for MediaWiki]] 2477425 wikitext text/x-wiki jqitifm4j0h969bcnf4gpx0953fxn3l 498 458787 2477681 2477211 2026-11-04T17:42:27Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41879214249 (https://github.com/cluebotng/component-configs/commits/230211c76403808093c776115bc37480e740de36) 2477681 wikitext text/x-wiki ghmerpp4f7xxecbbwtzsuolyi7abo46 2478071 2477681 2026-11-05T05:32:38Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41974300445 (https://github.com/cluebotng/component-configs/commits/62ff28a67ca66036c9cb17267fa8a2cff7a5b641) 2478071 wikitext text/x-wiki 8aguozc152d5ml6vaa3ie7grxrki1q9 2478074 2478071 2026-11-05T05:36:29Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41974543465 (https://github.com/cluebotng/component-configs/commits/7f5f130ad27cc6b58d18dc7db9fb6f17a994795f) 2478074 wikitext text/x-wiki 7n1cn9vd5jari2626bk00tj3g93rvke 2478079 2478074 2026-11-05T05:52:57Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41976470140 (https://github.com/cluebotng/component-configs/commits/dfe8bea82a81a0c7ff97c707693c7eff5fc01658) 2478079 wikitext text/x-wiki aa7rglsbmzz9czz8cglqhkm2nh4glgq 0 459043 2477634 2474237 2026-11-04T16:03:35Z AStein-WMF 39485 2477634 wikitext text/x-wiki negt6uy6vr2psmoc94bkmf8obwgwrno 498 459243 2477528 2477164 2026-11-04T14:36:50Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41848610075 (https://github.com/cluebotng/component-configs/commits/8c9d33b12cfd03687a781e4cc65df3014ba5ac3f) 2477528 wikitext text/x-wiki isc0q4j6wlijw9k1tyhrqef3qodkyh0 2477538 2477528 2026-11-04T14:48:39Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41850597334 (https://github.com/cluebotng/component-configs/commits/6d4c24a0f2ad8cc6b8220fb6195cac8eca56120e) 2477538 wikitext text/x-wiki 277403xd3mjsegpsqxr3tuyd2k08j0v 2477621 2477538 2026-11-04T15:54:45Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41861784896 (https://github.com/cluebotng/component-configs/commits/e820717bfa1e2145b54da8fff522fc828da9457f) 2477621 wikitext text/x-wiki s15oej7u7dfdb3dqa090aq6df7ynndm 2477643 2477621 2026-11-04T16:20:10Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/41865536484 (https://github.com/cluebotng/component-configs/commits/358d261c41034263816250714b7bda000b460afa) 2477643 wikitext text/x-wiki igylr3xo6cbc1e1ip4h1lej4eirs64l 2477658 2477643 2026-11-04T16:52:34Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41870962440 (https://github.com/cluebotng/component-configs/commits/3c1b5d1defc502bca33e6c53fe4f68d97f33cfba) 2477658 wikitext text/x-wiki 47nep83m2wk09hdz34i7uuprw5u27xw 2477679 2477658 2026-11-04T17:37:04Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41878343537 (https://github.com/cluebotng/component-configs/commits/d03a8439ccb347e558a42e94a674edbc6d1b087d) 2477679 wikitext text/x-wiki tkoaxmrl5djtcp8l8tmyscgo5qn9k3z 2477931 2477679 2026-11-04T23:08:57Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41930463906 (https://github.com/cluebotng/component-configs/commits/b495272b56a26a89b4498d24e762398799fe3f61) 2477931 wikitext text/x-wiki dgahe54bnmlfqeqgk1odq0s3v6tus1z 2477994 2477931 2026-11-05T01:26:20Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41947942541 (https://github.com/cluebotng/component-configs/commits/fb51e734553eadc617de48a568da790fd164e106) 2477994 wikitext text/x-wiki 4s06gwjacmu6ih5aoy8nxmn8hey9yet 2478068 2477994 2026-11-05T05:30:24Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/41974300597 (https://github.com/cluebotng/component-configs/commits/62ff28a67ca66036c9cb17267fa8a2cff7a5b641) 2478068 wikitext text/x-wiki 6wofqi7osnsi3zj977r7b5t9ffm4li5 2478084 2478068 2026-11-05T06:02:29Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41977287826 (https://github.com/cluebotng/component-configs/commits/26aeb742e54365acb8d07e0d79767159175ed5ca) 2478084 wikitext text/x-wiki mf6ome11wquxhoqmwcdfyel295fsnr7 2478085 2478084 2026-11-05T06:10:58Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41978117359 (https://github.com/cluebotng/component-configs/commits/445aed807c70e37fa8e4e9270743b99bd94a2c3c) 2478085 wikitext text/x-wiki mgpyrte9bveb3a552zli6j40dq6jpp5 2478087 2478085 2026-11-05T06:14:53Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41978385836 (https://github.com/cluebotng/component-configs/commits/518d18724ca549296a5ff755fa4e6a576a8c366c) 2478087 wikitext text/x-wiki tve4mhciwnoeh6n111v6uubp381u58x 2478088 2478087 2026-11-05T06:40:22Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41981558450 (https://github.com/cluebotng/component-configs/commits/23de2fc566aa0abfe228312ddd0b1e87b95990eb) 2478088 wikitext text/x-wiki jxxd66xec8nagyul3b39mue135rzags 498 459244 2477641 2477166 2026-11-04T16:19:43Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41865423884 (https://github.com/cluebotng/component-configs/commits/86b7159004732c324a71b91e87663d2e1cea32df) 2477641 wikitext text/x-wiki 3roejm7avas34lpu74n763nh1sdaqs8 2478032 2477641 2026-11-05T03:28:39Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41961409257 (https://github.com/cluebotng/component-configs/commits/f392ff08eb9768ab93538b5d6ed5cdf5306b9e50) 2478032 wikitext text/x-wiki ram5i1q23lihuth3gv20vx3az7s5kv0 2478065 2478032 2026-11-05T05:30:13Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/41974300499 (https://github.com/cluebotng/component-configs/commits/62ff28a67ca66036c9cb17267fa8a2cff7a5b641) 2478065 wikitext text/x-wiki 6ugq66zljpgbm351jqt7926ttz326k9 2478075 2478065 2026-11-05T05:37:28Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41974709611 (https://github.com/cluebotng/component-configs/commits/5efbb82f84986437a20d11414253c6eb8926c8d2) 2478075 wikitext text/x-wiki smn53sz62mfn8ngqkbmnlr8jp1mu6v1 498 459255 2478067 2477160 2026-11-05T05:30:23Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/41974300317 (https://github.com/cluebotng/component-configs/commits/62ff28a67ca66036c9cb17267fa8a2cff7a5b641) 2478067 wikitext text/x-wiki 5fh48voa3oyj07gvjyom6vagpg4a95f 498 459263 2478070 2477156 2026-11-05T05:32:37Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41974300416 (https://github.com/cluebotng/component-configs/commits/62ff28a67ca66036c9cb17267fa8a2cff7a5b641) 2478070 wikitext text/x-wiki mcbd8f4glnbokx395darygiluktc9qr 498 459362 2478069 2477159 2026-11-05T05:32:10Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41974300533 (https://github.com/cluebotng/component-configs/commits/62ff28a67ca66036c9cb17267fa8a2cff7a5b641) 2478069 wikitext text/x-wiki 6ebg7svcq0pmjersyjj4zhbsnrhjm24 0 459966 2477870 2458216 2026-11-04T21:32:39Z JVanderhoop-WMF 41069 Changed preamble, more to come 2477870 wikitext text/x-wiki s7r0r64l51h5g1o39l7x05js3hhzzly 2477896 2477870 2026-11-04T22:16:24Z JVanderhoop-WMF 41069 Flow changes to emphasize key points 2477896 wikitext text/x-wiki g7z7kg8xgnc06a4in5v6bgcjj13psbq 498 460126 2477608 2452763 2026-11-04T15:43:33Z Stashbot 7414 wmbot~gergesshamon@tools-bastion-15: [DEPLOY] Starting deployment | ref=v1.6.4 2477608 wikitext text/x-wiki ky78le6h84c5ml26zuuelgs05knanas 2477609 2477608 2026-11-04T15:44:39Z Stashbot 7414 wmbot~gergesshamon@tools-bastion-15: [DEPLOY] Build triggered successfully | ref=v1.6.4 2477609 wikitext text/x-wiki 2joem0pt84l80rgzl1sl60i5u64amrb 2477610 2477609 2026-11-04T15:44:40Z Stashbot 7414 wmbot~gergesshamon@tools-bastion-15: [DEPLOY] Restarting buildservice | ref=v1.6.4 2477610 wikitext text/x-wiki 3u1hrufuv3jht5cafmljzgah24oyt2i 2477611 2477610 2026-11-04T15:44:47Z Stashbot 7414 wmbot~gergesshamon@tools-bastion-15: [DEPLOY] Deployment completed successfully | ref=v1.6.4 2477611 wikitext text/x-wiki rn0wdlf0xcup4biprpdslfzb2fer8s8 0 460505 2478168 2443067 2026-11-05T10:28:15Z FNegri-WMF 32595 fix alert name 2478168 wikitext text/x-wiki c74b2v7ztryak391gejfury704bix9b 0 460608 2477342 2475723 2026-11-04T11:59:35Z APizzata-WMF 47941 pipeline design, threshold definition and fixes 2477342 wikitext text/x-wiki kg2n6szt0prrh4vg3yiawoxhv3rqd35 2477399 2477342 2026-11-04T12:24:44Z APizzata-WMF 47941 2477399 wikitext text/x-wiki jm1cgxzo9k32lnlpbkbhcxgudilvhvm 0 460698 2477856 2458705 2026-11-04T21:12:27Z Taavi 13997 archive rest of September 2477856 wikitext text/x-wiki 78fyva7cptfde2j8rzbw1jwvddarav7 0 460719 2477446 2472747 2026-11-04T12:54:34Z Mvolz (WMF) 2813 2477446 wikitext text/x-wiki n8mfxm6l315xv5shvjloab95phd90go 0 460840 2477651 2475798 2026-11-04T16:40:38Z DCaro (WMF) 18271 /* Availability of Wikimedia services */ updated the toolforge section 2477651 wikitext text/x-wiki 2570bj83sswrxpbisk6sqfhn8bmfjcl 2477652 2477651 2026-11-04T16:42:23Z DCaro (WMF) 18271 /* Availability of Wikimedia services */ 2477652 wikitext text/x-wiki fvmkpal22cvu4769mhfcflld7nomuuh 0 460881 2477852 2475749 2026-11-04T20:59:19Z AndrewBogott (WMF) 51047 /* shut off before incident; ingress and egress blocked; no php investigation done */ 2477852 wikitext text/x-wiki bj204j9nsmiub5d0yon1uaudm5l7oqe 2477853 2477852 2026-11-04T21:00:48Z AndrewBogott (WMF) 51047 /* fully restored */ 2477853 wikitext text/x-wiki 3unajtw67l67o0gz9vbyascp9x7josm 2477854 2477853 2026-11-04T21:02:08Z AndrewBogott (WMF) 51047 /* recently deleted, no security checks needed */ 2477854 wikitext text/x-wiki bav08nypn967fgjs1goeiklisgx5f3q 2477855 2477854 2026-11-04T21:04:27Z AndrewBogott (WMF) 51047 /* VMs deleted, no remaining concerns */ 2477855 wikitext text/x-wiki 4tl1gfr54vxioxogym6gpw1jm8abyf1 2 460934 2477672 2026-11-04T17:19:44Z Basedgirl 55124 Created page with "hi! i am working on corpus.toolforge.org" 2477672 wikitext text/x-wiki 94kxk0qjzzmai0rdzjx7jglgkj1kqzm 2 460935 2477735 2026-11-04T18:42:23Z ArielGlenn 11 Created page with "== Updating Changeprop to move from Node20 to Node26 == The prep work (patches to make the tests pass) was all done by James Forrester. This page describes only the steps needed to update the docker images, and to make the production service use those new images. === Step one: update blubber pipeline === Update the [https://doc.wikimedia.org/releng/blubber/ Blubber] pipeline so that Docker images will be built with the new node26 image: https://gerrit.wikimedia.org/r/c/..." 2477735 wikitext text/x-wiki 6imfa1c1xsqxr37qq5tpg8y6nt2kgfn 2477759 2477735 2026-11-04T19:20:50Z ArielGlenn 11 /* Monitor and see how things are */ 2477759 wikitext text/x-wiki 471ue88567li06y4zgxrk9je63n0bvg 0 460936 2477789 2026-11-04T20:08:22Z AndrewBogott (WMF) 51047 Created page with "We try to check for signs of life in all of the Cloud VPS projects once a year. This helps us reclaim shared computing resources for use by others. It also helps us find projects that are providing a useful service to the community but do not have any active maintainers. This page includes a list of all Cloud VPS projects as of '''November 4, 2026.''' We are asking project members to claim their active projects and also explicitly tell us about projects that are no long..." 2477789 wikitext text/x-wiki p2bwi0yrrro7mt1fgiy5q63wyeczrjy 2477790 2477789 2026-11-04T20:12:10Z AndrewBogott (WMF) 51047 /* admin */ 2477790 wikitext text/x-wiki tmans1myvwaeu8pjvv802tzk6aggkyj 2477791 2477790 2026-11-04T20:12:59Z AndrewBogott (WMF) 51047 /* admin-monitoring */ 2477791 wikitext text/x-wiki d8di7g34sono9g5g15yxinl32p97d6q 2477792 2477791 2026-11-04T20:13:22Z AndrewBogott (WMF) 51047 /* bastion */ 2477792 wikitext text/x-wiki gn0398cf151nliken0vg1zvcd5rbejy 2477793 2477792 2026-11-04T20:14:22Z AndrewBogott (WMF) 51047 /* bastion {{Used}} */ 2477793 wikitext text/x-wiki 9jsdg4fn02tju185ebvwjq7c1s08llv 2477795 2477793 2026-11-04T20:16:51Z AndrewBogott (WMF) 51047 /* bub2 */ 2477795 wikitext text/x-wiki axj8sl0q7tkeymxks16ce1xbryvrups 2477797 2477795 2026-11-04T20:19:14Z AndrewBogott (WMF) 51047 /* capacity-exchange */ 2477797 wikitext text/x-wiki nirpp01q45pns5rhjr23dldygr3jbys 2477799 2477797 2026-11-04T20:21:38Z AndrewBogott (WMF) 51047 /* dumps */ 2477799 wikitext text/x-wiki 4zsvchffcqtqcc57lzev0vken1hcro3 2477801 2477799 2026-11-04T20:23:50Z AndrewBogott (WMF) 51047 /* fastcci */ 2477801 wikitext text/x-wiki di4wuqklo7jk6a1pj53lowrryfuqw64 2477803 2477801 2026-11-04T20:25:27Z AndrewBogott (WMF) 51047 /* foundationmemory */ 2477803 wikitext text/x-wiki jcfrn8c6mjkkf29c8vyw9mokfyhl33m 2477805 2477803 2026-11-04T20:26:47Z AndrewBogott (WMF) 51047 /* foundationmemory */ 2477805 wikitext text/x-wiki f8xbtoujmy6nn0pva2so8wsabznts4v 2477806 2477805 2026-11-04T20:27:06Z AndrewBogott (WMF) 51047 /* imagebulk */ 2477806 wikitext text/x-wiki 7708la9m0crfhpbp5h2hjk4b3jx5vhj 2477808 2477806 2026-11-04T20:28:45Z AndrewBogott (WMF) 51047 /* incubator */ 2477808 wikitext text/x-wiki 4f1z93dpsk5sozoepm8fw59y5f83slb 2477809 2477808 2026-11-04T20:31:02Z AndrewBogott (WMF) 51047 /* auditlogging */ 2477809 wikitext text/x-wiki n4hcemoxb4xhj6g9x442tzzamdn15iv 2477810 2477809 2026-11-04T20:31:30Z AndrewBogott (WMF) 51047 /* cloudinfra */ 2477810 wikitext text/x-wiki tpfd4h0d9u0htcc322u6v496w1l74yh 2477812 2477810 2026-11-04T20:32:52Z AndrewBogott (WMF) 51047 /* cloudinfra-nfs */ 2477812 wikitext text/x-wiki 74t53xwbd5f1rrbfs8yoi67quey0gcn 2477813 2477812 2026-11-04T20:33:07Z AndrewBogott (WMF) 51047 /* cloudvirt-canary */ 2477813 wikitext text/x-wiki 2ri4stqzxfme0pulnmf51929hlvc7bp 2477814 2477813 2026-11-04T20:33:37Z AndrewBogott (WMF) 51047 /* deployment-prep */ 2477814 wikitext text/x-wiki byjv2pvzrx92fstnsm6idvjneoj19k1 2477816 2477814 2026-11-04T20:36:18Z AndrewBogott (WMF) 51047 /* quarry */ 2477816 wikitext text/x-wiki r49q6pn2ljvgj7ycaezw6bozvclqd97 2477817 2477816 2026-11-04T20:36:34Z AndrewBogott (WMF) 51047 /* puppet-diffs */ 2477817 wikitext text/x-wiki qpqigc819chufzlxh4zose4rl3xdzd5 2477818 2477817 2026-11-04T20:36:40Z AndrewBogott (WMF) 51047 /* paws */ 2477818 wikitext text/x-wiki g3a8pbt9472mu7k6vdscae2hx96u121 2477819 2477818 2026-11-04T20:36:56Z AndrewBogott (WMF) 51047 /* osbpo */ 2477819 wikitext text/x-wiki 89kr8k8aorno4vdsvpmacm3l3kb86kw 2477820 2477819 2026-11-04T20:37:14Z AndrewBogott (WMF) 51047 /* octavia */ 2477820 wikitext text/x-wiki 3entucmoaldzrfmi3y0j65qpi5udphe 2477821 2477820 2026-11-04T20:37:37Z AndrewBogott (WMF) 51047 /* observer */ 2477821 wikitext text/x-wiki oquatuwgu9vun2hszurqth4e0ucdin5 2477822 2477821 2026-11-04T20:38:03Z AndrewBogott (WMF) 51047 /* magnum */ 2477822 wikitext text/x-wiki q3kc1266zyxig4e5b0doprwgybp92wi 2477824 2477822 2026-11-04T20:39:44Z AndrewBogott (WMF) 51047 /* trove */ 2477824 wikitext text/x-wiki qh0hpscx1alb5h4vxa5trjbliy2be74 2477825 2477824 2026-11-04T20:39:57Z AndrewBogott (WMF) 51047 /* tools */ 2477825 wikitext text/x-wiki 9i0asrkq1v7s9gt8j69bcjo183g43qu 2477826 2477825 2026-11-04T20:40:20Z AndrewBogott (WMF) 51047 /* tofuinfratest */ 2477826 wikitext text/x-wiki 86teeamvh4uaudo9n9u9bgv9k8502jn 2477827 2477826 2026-11-04T20:40:33Z AndrewBogott (WMF) 51047 /* testlabs */ 2477827 wikitext text/x-wiki n1fu6l18ffjosioixtnu4rftdzxa0lt 2477828 2477827 2026-11-04T20:40:51Z AndrewBogott (WMF) 51047 /* tofuinfratest */ 2477828 wikitext text/x-wiki fpjlk7tlfbivwromlkecooyycg7qhxq 2477830 2477828 2026-11-04T20:45:09Z JJMC89 7474 /* account-creation-assistance */ 2477830 wikitext text/x-wiki nq2np375j521rdw9erizhixg4yeng7q 2477831 2477830 2026-11-04T20:45:55Z JJMC89 7474 /* copypatrol */ 2477831 wikitext text/x-wiki ns5xqzi0j0ro91om8yeyi49htoxbuth 2477832 2477831 2026-11-04T20:46:05Z JJMC89 7474 /* copypatrol */ {{Used}} 2477832 wikitext text/x-wiki sgn6ym9n7bp4yjxc1yy7vntylcutdvd 2477834 2477832 2026-11-04T20:46:56Z AndrewBogott (WMF) 51047 /* isa */ 2477834 wikitext text/x-wiki gl1p05l8iox1pdqo5bm420mi4ycxu3c 2477835 2477834 2026-11-04T20:47:14Z JJMC89 7474 /* utrs */ {{Used}} 2477835 wikitext text/x-wiki 9rbwfs9ymkf1ata07e3zmb47tmk1qew 2477839 2477835 2026-11-04T20:49:19Z AndrewBogott (WMF) 51047 /* text-to-speech */ 2477839 wikitext text/x-wiki nc8skkfcrlb2iuca4r32kmtq1z4eydl 2477842 2477839 2026-11-04T20:50:31Z AndrewBogott (WMF) 51047 /* teyora */ 2477842 wikitext text/x-wiki eaqle2tsclp3b1gwsbwje687jhvpw8t 2477844 2477842 2026-11-04T20:51:36Z AndrewBogott (WMF) 51047 /* wildcat */ 2477844 wikitext text/x-wiki 5r9u339wnqmnbddpl0hoc3s4nfntzwv 2477846 2477844 2026-11-04T20:53:03Z AndrewBogott (WMF) 51047 /* wmcs-uptime */ 2477846 wikitext text/x-wiki sdys1ohpxtixnshljngydqyop8etazx 2477847 2477846 2026-11-04T20:54:59Z AndrewBogott (WMF) 51047 /* signwriting */ 2477847 wikitext text/x-wiki iqu5hlgdmio71wsgu8yz06xy2gj4w3s 2477849 2477847 2026-11-04T20:55:42Z AndrewBogott (WMF) 51047 /* matrix */ 2477849 wikitext text/x-wiki 8wkamkbp5cvw8dzilrq3ritc8fqajmo 0 460937 2477860 2026-11-04T21:15:49Z Taavi 13997 archive october 2477860 wikitext text/x-wiki pcysj6edtjbcma8545p7hc5kyduv91v 499 460938 2478152 2026-11-05T10:00:54Z Ciell 42095 /* PHP outage */ new section 2478152 wikitext text/x-wiki pbgq31ja2rxf41gt08e3tkbw9u3ydsq 14 460939 2478210 2026-11-05T11:02:16Z Effie Mouzeli (WMF) 12880 Created page with "List of charts currently in Kubernetes" 2478210 wikitext text/x-wiki 2n5u0kgn4alkj3xj8kv5kcwrfnobnaw 0 460940 2478211 2026-11-05T11:03:38Z Effie Mouzeli (WMF) 12880 Created page with "TBA [[Category: Kubernetes Charts]]" 2478211 wikitext text/x-wiki 5lbbdvwfrghxb0bcsvh5a5wfx2626y9