Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.24 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 3086 2473121 2473008 2026-10-26T13:24:52Z Stashbot 7414 dcaro: re-enabled tools that were blocked using php buildpacks 2473121 wikitext text/x-wiki hy4d5l2ltayte7yfvqax27xszzcap5p 2473202 2473121 2026-10-26T14:27:43Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component registry-admission 2473202 wikitext text/x-wiki 09ztr7rqbms8186eamnbgb11zpjm03x 2473205 2473202 2026-10-26T14:28:19Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component registry-admission 2473205 wikitext text/x-wiki 5koaoibhsi5oyb4p0qapi63vwx4hszr 0 4108 2473076 2473026 2026-10-26T12:10:51Z Krinkle 44 /* {{Deployment_day|date=2026-10-26}} */ 2473076 wikitext text/x-wiki g6tvz3ixfib9vlzkpesdlng1i95xb65 2473095 2473076 2026-10-26T12:32:17Z Krinkle 44 /* {{Deployment_day|date=2026-10-26}} */ 2473095 wikitext text/x-wiki qe7djtx5x3qxgl5tc87zeayms560hsz 2473098 2473095 2026-10-26T12:43:50Z ScheduleDeploymentBot 37566 Add [[gerrit:1355485]] to Tuesday, October 27 UTC afternoon backport window 2473098 wikitext text/x-wiki 4nj9kjnk0vuxpu8h7a76ihzk50uvti8 2473100 2473098 2026-10-26T12:48:17Z Krinkle 44 /* {{Deployment_day|date=2026-10-26}} */ 2473100 wikitext text/x-wiki 2pyq5dl5qrh5d14cbwmuws5z08ip8om 2473101 2473100 2026-10-26T12:52:03Z Krinkle 44 /* Week of October 26 */ 2473101 wikitext text/x-wiki lh5l51a4u06jl4n8852wcsfmfpdi25i 2473109 2473101 2026-10-26T13:14:49Z Mmullie (WMF) 291 /* {{Deployment_day|date=2026-10-26}} */ 2473109 wikitext text/x-wiki kzyzybkb0i1ia0m7cdxiyvrrhebwz19 2473466 2473109 2026-10-26T19:24:10Z Krinkle 44 /* {{Deployment_day|date=2026-10-26}} */ Move perf backports to later so that it affects all wikis at once 2473466 wikitext text/x-wiki aoq5yuyfajx6hri8ea2ao6lz0qkgsty 2473561 2473466 2026-10-26T22:13:58Z ScheduleDeploymentBot 37566 Add [[gerrit:1358880]] to Tuesday, October 27 UTC morning backport window 2473561 wikitext text/x-wiki pxyqxcpbzjpshm52kfxi350mz43046m 2473741 2473561 2026-10-27T08:25:25Z ScheduleDeploymentBot 37566 Add [[gerrit:1358880]] to Tuesday, October 27 UTC afternoon backport window 2473741 wikitext text/x-wiki dt8wg6zcnekwrrhf12erurtses2yzmd 2473795 2473741 2026-10-27T09:08:15Z Neriah 36702 Undid revision [[Special:Diff/2473741|2473741]] by [[Special:Contributions/ScheduleDeploymentBot|ScheduleDeploymentBot]] ([[User talk:ScheduleDeploymentBot|talk]]) 2473795 wikitext text/x-wiki pxyqxcpbzjpshm52kfxi350mz43046m 498 6726 2473197 2472461 2026-10-26T14:24:46Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component registry-admission 2473197 wikitext text/x-wiki mlpfwhojas6j6hfx94xkhcbqjqrn018 2473198 2473197 2026-10-26T14:24:48Z Stashbot 7414 taavi@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component registry-admission 2473198 wikitext text/x-wiki 6vwsuus224q9e0pxlnij8l8r36300rz 2473864 2473198 2026-10-27T10:01:20Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.reboot for all workers 2473864 wikitext text/x-wiki 6th5lu3u7jdiqaht265ezgrz4w04z24 2473865 2473864 2026-10-27T10:01:22Z Stashbot 7414 taavi@cloudcumin1001: END (ERROR) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=97) for all workers 2473865 wikitext text/x-wiki aosoqyrtj38rhigjme19bslk6d3g91a 0 7919 2473066 2473065 2026-10-26T12:00:07Z Stashbot 7414 root@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-timeline: sync 2473066 wikitext text/x-wiki 56zu6mkhwwwl4h9czf7rlxj2ba9uqbm 2473067 2473066 2026-10-26T12:00:10Z Stashbot 7414 root@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-timeline: sync 2473067 wikitext text/x-wiki dfv38ctft3s41768xzehm3jrbbo9r0v 2473068 2473067 2026-10-26T12:02:59Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1040.eqiad.wmnet 2473068 wikitext text/x-wiki jpqfksia13ek0muc4x2c1z853s0dscl 2473069 2473068 2026-10-26T12:04:09Z Stashbot 7414 javiermonton@deploy1003: Started scap deploy-service pageview-trending-relative-next: testing Flink on spiderpig, this is a staging release for test. 2473069 wikitext text/x-wiki rqrjbrp1adai8fuuoo6uuez68sl21fr 2473070 2473069 2026-10-26T12:04:12Z Stashbot 7414 javiermonton@deploy1003: scap deploy-service pageview-trending-relative-next: [PRODUCTION/DEFAULT] dse-k8s-eqiad Deploying pageview-trending-relative-next 2473070 wikitext text/x-wiki irfe8ml5dgv1a80kmwritl4zfj9u7zv 2473071 2473070 2026-10-26T12:06:43Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti1040.eqiad.wmnet 2473071 wikitext text/x-wiki 3b2db8ynmwg0rnumwli7mlk880cv1x0 2473072 2473071 2026-10-26T12:06:45Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . 2473072 wikitext text/x-wiki f4cawjrfubuyx4wh1v156clyh75qmmo 2473073 2473072 2026-10-26T12:07:47Z Stashbot 7414 javiermonton@deploy1003: scap deploy-service pageview-trending-relative-next: [PRODUCTION/DEFAULT] dse-k8s-eqiad Rolling back pageview-trending-relative-next 2473073 wikitext text/x-wiki 1i61q6anjjjhyg47p8cxqitt97ldq4i 2473074 2473073 2026-10-26T12:07:49Z Stashbot 7414 javiermonton@deploy1003: Failed scap deploy-service pageview-trending-relative-next: testing Flink on spiderpig, this is a staging release for test. (duration: 03m 38s) 2473074 wikitext text/x-wiki 547hx3ti6n0tcttq2shb4aaimpsawu1 2473078 2473074 2026-10-26T12:12:05Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1040.eqiad.wmnet 2473078 wikitext text/x-wiki 6e58u25w0i6fzaq9gel3f3yb8b776d2 2473079 2473078 2026-10-26T12:12:13Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1040.eqiad.wmnet 2473079 wikitext text/x-wiki cq42y6i47blvwnep0qcc5mv4arw5qcv 2473080 2473079 2026-10-26T12:12:52Z Stashbot 7414 krinkle@deploy1003: Started scap sync-world: Backport for [[gerrit:1358718|build: update required NodeJS from 24.18.0 to 26.12.1 (T442288)]] (1.48.0-wmf.1), [[gerrit:1358706|Upgrade mocha to fix yargs / node 25+ incompatibility (T442317)]] (1.48.0-wmf.1) 2473080 wikitext text/x-wiki hwazegs6q2b1clbo5fi4wiednglk2ak 2473081 2473080 2026-10-26T12:12:56Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1041.eqiad.wmnet 2473081 wikitext text/x-wiki mgxr3em1ehrn284d6svgvkujahlmn8d 2473082 2473081 2026-10-26T12:13:43Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2035.codfw.wmnet 2473082 wikitext text/x-wiki fn2xpgw6oae0u5n1d3eeonum4klqubx 2473083 2473082 2026-10-26T12:13:49Z Stashbot 7414 slyngshede@cumin1004: START - Cookbook sre.cdn.roll-reboot rolling reboot on P{cp6013*} OR P{cp6014*} OR P{cp6015*} OR P{cp6016} and A:cp 2473083 wikitext text/x-wiki 22g96fykhqqxkob7vjkd09ixaejicv5 2473084 2473083 2026-10-26T12:18:49Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.hosts.reboot-single for host ml-lab1002.eqiad.wmnet 2473084 wikitext text/x-wiki cmlnvoi8jc1vblczuvjvwtzho9npa2r 2473086 2473084 2026-10-26T12:22:06Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti1041.eqiad.wmnet 2473086 wikitext text/x-wiki 8nvsa27baywugevwm4567jgqrkeydov 2473087 2473086 2026-10-26T12:24:24Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ml-lab1002.eqiad.wmnet 2473087 wikitext text/x-wiki 9q51noxfleheg7aqnyi33827ivpyemt 2473088 2473087 2026-10-26T12:24:42Z Stashbot 7414 slyngshede@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp6013.drmrs.wmnet 2473088 wikitext text/x-wiki rhiivgf3uuci0h8v3q8sjcr9a8jq8y4 2473089 2473088 2026-10-26T12:24:58Z Stashbot 7414 jelto@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:05:00 on phab1005.eqiad.wmnet with reason: PHP restart 2473089 wikitext text/x-wiki ktj0nocrm7g14dr0g8a3nmrcwf0u9ou 2473090 2473089 2026-10-26T12:25:19Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti2035.codfw.wmnet 2473090 wikitext text/x-wiki 4c27tety4ppabxemwmlyfigbwv7y7a3 2473091 2473090 2026-10-26T12:27:35Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1041.eqiad.wmnet 2473091 wikitext text/x-wiki 2ucwga115tra1x6tfw5afzhasxg2x30 2473092 2473091 2026-10-26T12:27:45Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1041.eqiad.wmnet 2473092 wikitext text/x-wiki 1s77k9bw3l44e5ecwso6rqajjz411qs 2473093 2473092 2026-10-26T12:30:28Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2035.codfw.wmnet 2473093 wikitext text/x-wiki erj99gxxeq6aeby5f8ibpzs5ndteax8 2473094 2473093 2026-10-26T12:30:47Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2035.codfw.wmnet 2473094 wikitext text/x-wiki 5eswnrg0u0q1f2jgpvstn0y38ie954u 2473096 2473094 2026-10-26T12:33:35Z Stashbot 7414 krinkle@deploy1003: krinkle, hashar, arthurtaylor: Backport for [[gerrit:1358718|build: update required NodeJS from 24.18.0 to 26.12.1 (T442288)]] (1.48.0-wmf.1), [[gerrit:1358706|Upgrade mocha to fix yargs / node 25+ incompatibility (T442317)]] (1.48.0-wmf.1) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2473096 wikitext text/x-wiki h07v046dostcghhjcyvf17cieqqxmla 2473097 2473096 2026-10-26T12:34:02Z Stashbot 7414 krinkle@deploy1003: krinkle, hashar, arthurtaylor: Continuing with deployment 2473097 wikitext text/x-wiki p2sov4rbpnw7luxolljxb1swiwka3ms 2473099 2473097 2026-10-26T12:46:42Z Stashbot 7414 krinkle@deploy1003: Finished scap sync-world: Backport for [[gerrit:1358718|build: update required NodeJS from 24.18.0 to 26.12.1 (T442288)]] (1.48.0-wmf.1), [[gerrit:1358706|Upgrade mocha to fix yargs / node 25+ incompatibility (T442317)]] (1.48.0-wmf.1) (duration: 33m 49s) 2473099 wikitext text/x-wiki sdeo7lmxlgck4a57gxpnpd04cta3866 2473102 2473099 2026-10-26T13:05:32Z Stashbot 7414 slyngshede@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp6014.drmrs.wmnet 2473102 wikitext text/x-wiki dk0nxbmfmt66aq4l1u737p23zyflp9r 2473103 2473102 2026-10-26T13:05:59Z Stashbot 7414 aude@deploy1003: Started scap sync-world: Backport for [[gerrit:1357809|Disable QuickSurvey on Special:ReadingLists (T433892)]] 2473103 wikitext text/x-wiki rqay56rsrahorrlymqac0zngjd74q1z 2473104 2473103 2026-10-26T13:09:25Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1042.eqiad.wmnet 2473104 wikitext text/x-wiki kww1q88wp74m79l15v60hpz6l9d8iie 2473105 2473104 2026-10-26T13:09:31Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2036.codfw.wmnet 2473105 wikitext text/x-wiki kca82xuyd4z638cx3i7l25gd9kmhj1r 2473107 2473105 2026-10-26T13:12:24Z Stashbot 7414 aude@deploy1003: aude: Backport for [[gerrit:1357809|Disable QuickSurvey on Special:ReadingLists (T433892)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2473107 wikitext text/x-wiki c0o18v5fcv3rc6rf7d4f03t9f8pj1v5 2473108 2473107 2026-10-26T13:13:30Z Stashbot 7414 aude@deploy1003: aude: Continuing with deployment 2473108 wikitext text/x-wiki 8xln67wowby834vck3245eoi1izjiy3 2473111 2473108 2026-10-26T13:17:50Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti2036.codfw.wmnet 2473111 wikitext text/x-wiki 1280snrwo8wy1ncol1joost6p148yo6 2473114 2473111 2026-10-26T13:21:21Z Stashbot 7414 aude@deploy1003: Finished scap sync-world: Backport for [[gerrit:1357809|Disable QuickSurvey on Special:ReadingLists (T433892)]] (duration: 15m 23s) 2473114 wikitext text/x-wiki rkyl4vieagcrod7w3feg7aefty1lqeg 2473115 2473114 2026-10-26T13:22:59Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2036.codfw.wmnet 2473115 wikitext text/x-wiki sia5k3sm91wdnsyqdqekhj5kjgc2wbx 2473116 2473115 2026-10-26T13:23:05Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2036.codfw.wmnet 2473116 wikitext text/x-wiki jao9vvfov7uqyzdicr2svaqq0lisek9 2473117 2473116 2026-10-26T13:24:14Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.reboot-nodes rolling reboot on A:ml-serve-worker-eqiad 2473117 wikitext text/x-wiki otw7k2usl22l3k6u36jn3nymiqxwsir 2473118 2473117 2026-10-26T13:24:18Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve1002.eqiad.wmnet 2473118 wikitext text/x-wiki 6f6h22q1ykiom04zl1b7lpn2gih9uh4 2473119 2473118 2026-10-26T13:24:20Z Stashbot 7414 klausman@cumin1004: END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) depool for host ml-serve1002.eqiad.wmnet 2473119 wikitext text/x-wiki mpl29q5wkuuh8gjqpva8e2ywrirvfja 2473122 2473119 2026-10-26T13:26:05Z Stashbot 7414 Amir1: dropping commons links tables from s4 sanitarium master with replication (T437278) 2473122 wikitext text/x-wiki 5bv9719096376nhbygu9y3o9l911vsd 2473123 2473122 2026-10-26T13:27:17Z Stashbot 7414 mlitn@deploy1003: Started scap sync-world: Backport for Squashed diff to master ([[gerrit:1358700|1.48.0-wmf.1]], [[gerrit:1358701|1.47.0-wmf.24]]), [[gerrit:1358751|Enable wgReaderExperimentsSemanticSearchEnabled on enwiki (T442376)]] 2473123 wikitext text/x-wiki qi6tp5yils19m9q3l0jk1gc78wukv4q 2473124 2473123 2026-10-26T13:29:13Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve1002.eqiad.wmnet 2473124 wikitext text/x-wiki i34elb5htsceey675p70t5qeoojnzjs 2473125 2473124 2026-10-26T13:29:16Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-serve1002.eqiad.wmnet 2473125 wikitext text/x-wiki hbjmzhqsw7xegx25n7epzo048g5xii3 2473126 2473125 2026-10-26T13:29:20Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve1003.eqiad.wmnet 2473126 wikitext text/x-wiki a8hvw48my74paafhs590roqf86y5ebu 2473127 2473126 2026-10-26T13:31:33Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.dns.netbox 2473127 wikitext text/x-wiki h7p4nf9ijoylsf06uam9b13mcysy7jj 2473128 2473127 2026-10-26T13:33:33Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2037.codfw.wmnet 2473128 wikitext text/x-wiki reobshjcwotgahlpup6wqu574dl32n2 2473129 2473128 2026-10-26T13:33:40Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti1042.eqiad.wmnet 2473129 wikitext text/x-wiki foryclf7ln3c2qllvr93ybkl4yszsez 2473130 2473129 2026-10-26T13:34:23Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-serve1003.eqiad.wmnet 2473130 wikitext text/x-wiki 1ci75wek1s7afd3pqmc2dxv3zwu854k 2473131 2473130 2026-10-26T13:35:35Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding ml-serve1016 to eqiad - jclark@cumin1004" 2473131 wikitext text/x-wiki 97oj0sdaya1k9fla0jyvbtl5iqyunf9 2473132 2473131 2026-10-26T13:35:52Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti2037.codfw.wmnet 2473132 wikitext text/x-wiki nuh3b78670jbf8ar1t3tycoaw9hvu23 2473133 2473132 2026-10-26T13:36:27Z Stashbot 7414 jclark@cumin1004: END (FAIL) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=99) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding ml-serve1016 to eqiad - jclark@cumin1004" 2473133 wikitext text/x-wiki 0qkaphu3fxmsnkiq6fyuus848xj481h 2473134 2473133 2026-10-26T13:36:29Z Stashbot 7414 jclark@cumin1004: END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) 2473134 wikitext text/x-wiki h8dojmyk8gp77e5hydjhy7u92qobg1f 2473135 2473134 2026-10-26T13:36:37Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.network.configure-switch-interfaces for host ml-serve1016 2473135 wikitext text/x-wiki 7abeg9e0vcrcxy5bg8gcmcy3ekedg8g 2473136 2473135 2026-10-26T13:36:47Z Stashbot 7414 jclark@cumin1004: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ml-serve1016 2473136 wikitext text/x-wiki eb71rh2hx5qzea5gcdu93656bulysyl 2473137 2473136 2026-10-26T13:37:56Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.hosts.reimage for host ml-serve1016.eqiad.wmnet with OS trixie 2473137 wikitext text/x-wiki pv9cwfvzyanvbydfosg2vf7jckhtk75 2473138 2473137 2026-10-26T13:38:04Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.hosts.dhcp for host ml-serve1016.eqiad.wmnet (push config only) 2473138 wikitext text/x-wiki 5ppwgxeg5ic2ls83xu80detbhkxqqoz 2473139 2473138 2026-10-26T13:38:08Z Stashbot 7414 jclark@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host ml-serve1016.eqiad.wmnet (push config only) 2473139 wikitext text/x-wiki dtqn8v79od0w4i8o75z47me8999jarg 2473140 2473139 2026-10-26T13:38:52Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1042.eqiad.wmnet 2473140 wikitext text/x-wiki ekhb8wr6kvp5ji6uc3b6rb3bnyntb2s 2473141 2473140 2026-10-26T13:39:14Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve1003.eqiad.wmnet 2473141 wikitext text/x-wiki 4w44q03haszojocd0adpc2nek5n7qk9 2473142 2473141 2026-10-26T13:39:16Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-serve1003.eqiad.wmnet 2473142 wikitext text/x-wiki 1znr3tb2jg2pup4bhppbp3lwwzlcxzt 2473143 2473142 2026-10-26T13:39:21Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve1004.eqiad.wmnet 2473143 wikitext text/x-wiki 25y68wxuqpv8bbv43vadn1f9brlyiay 2473144 2473143 2026-10-26T13:39:30Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1042.eqiad.wmnet 2473144 wikitext text/x-wiki o4laxqnxcct35acqo9s8fq9139diper 2473145 2473144 2026-10-26T13:41:12Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2037.codfw.wmnet 2473145 wikitext text/x-wiki i9d9onnnqarb6polk89ua9fzbthakf3 2473146 2473145 2026-10-26T13:41:19Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2037.codfw.wmnet 2473146 wikitext text/x-wiki qeab3u0v12ov1dm6oyoryrzy6ffzf8u 2473147 2473146 2026-10-26T13:44:23Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-serve1004.eqiad.wmnet 2473147 wikitext text/x-wiki m4z7wgysy8bj1jddosit1ecjilmo2z0 2473148 2473147 2026-10-26T13:44:27Z Stashbot 7414 aqu@deploy1003: Started deploy [analytics/refinery@62e4921] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@62e49215] 2473148 wikitext text/x-wiki ji6rcfbtli1jn4e5hb2q2jhtxdq49ow 2473149 2473148 2026-10-26T13:45:07Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.dns.netbox 2473149 wikitext text/x-wiki 6w5odb80u8o3lj3w4bw9ue6urwzn16b 2473150 2473149 2026-10-26T13:45:18Z Stashbot 7414 aqu@deploy1003: Finished deploy [analytics/refinery@62e4921] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@62e49215] (duration: 00m 51s) 2473150 wikitext text/x-wiki 0isgelddiw1y5aimdh430zsuuqnhjzg 2473151 2473150 2026-10-26T13:45:42Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2038.codfw.wmnet 2473151 wikitext text/x-wiki o6ck6xlj8uo5nmo2gmydgckeqfzo5o1 2473152 2473151 2026-10-26T13:45:49Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1043.eqiad.wmnet 2473152 wikitext text/x-wiki h7gce3cvk6p6wzb0k7flruhux897mn4 2473153 2473152 2026-10-26T13:46:29Z Stashbot 7414 slyngshede@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp6015.drmrs.wmnet 2473153 wikitext text/x-wiki a0wun1gvy86u9ttg9m5j1sdfxdyzkip 2473154 2473153 2026-10-26T13:46:32Z Stashbot 7414 slyngshede@cumin1004: END (PASS) - Cookbook sre.cdn.roll-reboot (exit_code=0) rolling reboot on P{cp6013*} OR P{cp6014*} OR P{cp6015*} OR P{cp6016} and A:cp 2473154 wikitext text/x-wiki a0s81uc60lvn40waw8v9wt52bgvngcf 2473155 2473154 2026-10-26T13:47:28Z Stashbot 7414 jclark@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2473155 wikitext text/x-wiki 1l1sgnw3bao2d828xzaw31qpiub3udf 2473156 2473155 2026-10-26T13:48:08Z Stashbot 7414 mlitn@deploy1003: mlitn: Backport for Squashed diff to master ([[gerrit:1358700|1.48.0-wmf.1]], [[gerrit:1358701|1.47.0-wmf.24]]), [[gerrit:1358751|Enable wgReaderExperimentsSemanticSearchEnabled on enwiki (T442376)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2473156 wikitext text/x-wiki 9vore79put59kqvouun2l59p2sv8efo 2473157 2473156 2026-10-26T13:49:57Z Stashbot 7414 mlitn@deploy1003: mlitn: Continuing with deployment 2473157 wikitext text/x-wiki 9aqzuzmgd5kc5wqeppskz2eqwrs3d2o 2473158 2473157 2026-10-26T13:51:00Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve1004.eqiad.wmnet 2473158 wikitext text/x-wiki 58ykg5qd6el94zadqjply9jfy4oo4om 2473159 2473158 2026-10-26T13:51:02Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-serve1004.eqiad.wmnet 2473159 wikitext text/x-wiki 5gxq648b8ugc5czo3g8nv4keyyn81te 2473160 2473159 2026-10-26T13:51:07Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve1005.eqiad.wmnet 2473160 wikitext text/x-wiki g8sw4md5ktjyf6zw2g7awov7pmap2s1 2473161 2473160 2026-10-26T13:51:33Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti2038.codfw.wmnet 2473161 wikitext text/x-wiki go5zvqnzqzdsqis9zcijiv688hkdxdx 2473162 2473161 2026-10-26T13:53:17Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.dns.netbox 2473162 wikitext text/x-wiki 2kicgwcclhvwyijxc9uhxa87ziucaxa 2473163 2473162 2026-10-26T13:53:20Z Stashbot 7414 jclark@cumin1004: END (ERROR) - Cookbook sre.dns.netbox (exit_code=97) 2473163 wikitext text/x-wiki gwzlxwlvighs9uxeg0se8fz2ivdtwcs 2473164 2473163 2026-10-26T13:53:36Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.network.configure-switch-interfaces for host ml-serve1016 2473164 wikitext text/x-wiki 74q48cl00hi5g9xj0wup552chcpvhlj 2473165 2473164 2026-10-26T13:53:45Z Stashbot 7414 jclark@cumin1004: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ml-serve1016 2473165 wikitext text/x-wiki ij3eomnhu16dgf3rhcceu308r2732s8 2473166 2473165 2026-10-26T13:53:53Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.dns.netbox 2473166 wikitext text/x-wiki 73oegku9rutgx3a4mizvdgt69mza5l2 2473167 2473166 2026-10-26T13:56:10Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-serve1005.eqiad.wmnet 2473167 wikitext text/x-wiki 2jb6zdmspginxnxyx76kj0yiybplfyn 2473168 2473167 2026-10-26T13:56:28Z Stashbot 7414 jclark@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2473168 wikitext text/x-wiki syzampksfzm9tgvc8scpsxh8a2oe4we 2473169 2473168 2026-10-26T13:57:07Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2038.codfw.wmnet 2473169 wikitext text/x-wiki qz5cclx00p1fdk20jemfft4h9ynh9l4 2473170 2473169 2026-10-26T13:57:14Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2038.codfw.wmnet 2473170 wikitext text/x-wiki 6ej279bi5ohbhx98dhdtiy1cf5o8q80 2473171 2473170 2026-10-26T13:59:30Z Stashbot 7414 aqu@deploy1003: Started deploy [analytics/refinery@62e4921]: Regular analytics weekly train [analytics/refinery@62e49215] 2473171 wikitext text/x-wiki deww5w8a9fh1rt3ths23z33p71ntpan 2473172 2473171 2026-10-26T14:01:26Z Stashbot 7414 mlitn@deploy1003: Finished scap sync-world: Backport for Squashed diff to master ([[gerrit:1358700|1.48.0-wmf.1]], [[gerrit:1358701|1.47.0-wmf.24]]), [[gerrit:1358751|Enable wgReaderExperimentsSemanticSearchEnabled on enwiki (T442376)]] (duration: 34m 09s) 2473172 wikitext text/x-wiki c5gj9m9xej974jld5t54yrulqy9cfea 2473173 2473172 2026-10-26T14:02:39Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve1005.eqiad.wmnet 2473173 wikitext text/x-wiki nfd6qhx3e84ntghvxcti46g8xjwy8xg 2473174 2473173 2026-10-26T14:02:41Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-serve1005.eqiad.wmnet 2473174 wikitext text/x-wiki ix1haskgtlqmt3k2denr937vyepuegf 2473175 2473174 2026-10-26T14:02:46Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve1006.eqiad.wmnet 2473175 wikitext text/x-wiki pprxjd20vo0y17bibefijslr8s19j0f 2473176 2473175 2026-10-26T14:06:24Z Stashbot 7414 aqu@deploy1003: Finished deploy [analytics/refinery@62e4921]: Regular analytics weekly train [analytics/refinery@62e49215] (duration: 06m 54s) 2473176 wikitext text/x-wiki 14h2ub4auofhrmse2tw2awv711rykb3 2473177 2473176 2026-10-26T14:07:48Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-serve1006.eqiad.wmnet 2473177 wikitext text/x-wiki jf0ts42547c7svko1xue4yecnxnznme 2473179 2473177 2026-10-26T14:08:36Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-dumps: apply 2473179 wikitext text/x-wiki 3hip5mfdargry6mj28potczv6ld9t5v 2473180 2473179 2026-10-26T14:09:28Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-dumps: apply 2473180 wikitext text/x-wiki 4t6dsh2i5eynx3uq4pptxcnzh34jq8o 2473181 2473180 2026-10-26T14:10:09Z Stashbot 7414 urbanecm@deploy1003: Started scap sync-world: Backport for [[gerrit:1358756|cswiki: Add 600k celebratory logo (T442387)]] 2473181 wikitext text/x-wiki aw3xnpjrmhjc6xbbltwoq2yqoxsxfk8 2473182 2473181 2026-10-26T14:12:49Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve1006.eqiad.wmnet 2473182 wikitext text/x-wiki oon20byy135cinzu74vdhr99an6uk7b 2473183 2473182 2026-10-26T14:12:51Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-serve1006.eqiad.wmnet 2473183 wikitext text/x-wiki 8xka9l3k11ldpc3nl5tv4ijzgr3p9kg 2473184 2473183 2026-10-26T14:12:55Z Stashbot 7414 urbanecm@deploy1003: mwscript-k8s job started: foreachwikiindblist growthexperiments GrowthExperiments:revalidateLinkRecommendations.php --olderThan=1790175600 --verbose # T438366 2473184 wikitext text/x-wiki 2yhpc51smob9l1kacwro9isrnnmhhjr 2473185 2473184 2026-10-26T14:12:58Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve1007.eqiad.wmnet 2473185 wikitext text/x-wiki pbn9cpazvixyfv6dw39g8h3opullayi 2473186 2473185 2026-10-26T14:13:18Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/liftwing-studio: sync 2473186 wikitext text/x-wiki 9gwn56x83k08i2rtlq7uucnt5ighlca 2473187 2473186 2026-10-26T14:14:25Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/liftwing-studio: sync 2473187 wikitext text/x-wiki mj9zwi9kaw0a7sxsj1uphaf79nn0m74 2473188 2473187 2026-10-26T14:16:28Z Stashbot 7414 urbanecm@deploy1003: urbanecm: Backport for [[gerrit:1358756|cswiki: Add 600k celebratory logo (T442387)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2473188 wikitext text/x-wiki icqv5malmri23lct4w9do4gf402gka6 2473189 2473188 2026-10-26T14:17:16Z Stashbot 7414 slyngshede@cumin1004: START - Cookbook sre.cdn.roll-reboot rolling reboot on P{cp2043*} OR P{cp2044*} and A:cp 2473189 wikitext text/x-wiki d91vfyx5c2ixrirkkicxoqw42cmy4j4 2473190 2473189 2026-10-26T14:17:59Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-serve1007.eqiad.wmnet 2473190 wikitext text/x-wiki seyiwiymipq1zbixz5evqg96hqirnue 2473191 2473190 2026-10-26T14:18:39Z Stashbot 7414 urbanecm@deploy1003: urbanecm: Continuing with deployment 2473191 wikitext text/x-wiki pe8p2f463qohbiakewjeo0hpyyu0ap5 2473192 2473191 2026-10-26T14:21:36Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.loadbalancer.admin depooling P{lvs7002.*} and A:liberica 2473192 wikitext text/x-wiki 1gfdtcl9odvt27v37k5mhxme5s48it4 2473193 2473192 2026-10-26T14:21:59Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) depooling P{lvs7002.*} and A:liberica 2473193 wikitext text/x-wiki f7r8olbhso7efery7ddx60lzh86n8lw 2473194 2473193 2026-10-26T14:22:47Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve1007.eqiad.wmnet 2473194 wikitext text/x-wiki syaqqa70dz1c1aek17vdnyd4tczad01 2473195 2473194 2026-10-26T14:22:49Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-serve1007.eqiad.wmnet 2473195 wikitext text/x-wiki g0cbz3lk6em4zthm66b7hbu43vj2w6c 2473196 2473195 2026-10-26T14:22:54Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve1008.eqiad.wmnet 2473196 wikitext text/x-wiki t2xdut3il9l5qbdrn3s75f902avhqir 2473199 2473196 2026-10-26T14:25:00Z Stashbot 7414 slyngshede@cumin1004: START - Cookbook sre.cdn.roll-reboot rolling reboot on P{cp2048*} OR P{cp2050*} and A:cp 2473199 wikitext text/x-wiki fw011tqdfm145c251zb4yz1093za24m 2473200 2473199 2026-10-26T14:25:51Z Stashbot 7414 slyngshede@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp2043.codfw.wmnet 2473200 wikitext text/x-wiki l4a7lcy6hou891ypvtqn5yx0e0hryzk 2473201 2473200 2026-10-26T14:26:26Z Stashbot 7414 urbanecm@deploy1003: Finished scap sync-world: Backport for [[gerrit:1358756|cswiki: Add 600k celebratory logo (T442387)]] (duration: 16m 16s) 2473201 wikitext text/x-wiki mwanvdx8o7wofovufvpvon1w05abivk 2473203 2473201 2026-10-26T14:27:57Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-serve1008.eqiad.wmnet 2473203 wikitext text/x-wiki a5agpwcm5czeluwchyvc9i6h9m4cd19 2473204 2473203 2026-10-26T14:28:14Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.hosts.reimage for host lvs7002.magru.wmnet with OS trixie 2473204 wikitext text/x-wiki e2v423fmpg2ykd3zsxpw4h1p9hd90nw 2473206 2473204 2026-10-26T14:29:10Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.hosts.dhcp for host lvs7002.magru.wmnet (push config only) 2473206 wikitext text/x-wiki du9oxbg61sgvdy4ajrvf3txyp3vr1w1 2473207 2473206 2026-10-26T14:29:16Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host lvs7002.magru.wmnet (push config only) 2473207 wikitext text/x-wiki 38wel0y5xrihhd3aw2j65rwwa3qov9x 2473210 2473207 2026-10-26T14:32:51Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve1008.eqiad.wmnet 2473210 wikitext text/x-wiki lw083luhgu6vlickhloz660gquwpiu0 2473211 2473210 2026-10-26T14:32:53Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-serve1008.eqiad.wmnet 2473211 wikitext text/x-wiki a6s8n38mqzrjx2twxq43xwlw05tsvd3 2473212 2473211 2026-10-26T14:32:57Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve1009.eqiad.wmnet 2473212 wikitext text/x-wiki kszr9lxziqzb1toopboejr0qa8tdb65 2473213 2473212 2026-10-26T14:33:03Z Stashbot 7414 slyngshede@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp2048.codfw.wmnet 2473213 wikitext text/x-wiki 1liyw58zbhk9ey13cpgerfnrr5t7tg1 2473215 2473213 2026-10-26T14:38:00Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-serve1009.eqiad.wmnet 2473215 wikitext text/x-wiki m8jf3fjmroqhuem6ar88yle4adap2db 2473216 2473215 2026-10-26T14:45:51Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve1009.eqiad.wmnet 2473216 wikitext text/x-wiki p7jfwd70mx9i5ggzugskevegmhsbcc2 2473217 2473216 2026-10-26T14:45:53Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-serve1009.eqiad.wmnet 2473217 wikitext text/x-wiki c8clidp8u3lvotqrn5pxers05mbe9bd 2473218 2473217 2026-10-26T14:45:58Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve1010.eqiad.wmnet 2473218 wikitext text/x-wiki gaha7nszdtf5nwe0ywkw6y50zzk1wyy 2473220 2473218 2026-10-26T14:48:49Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.hosts.dhcp for host lvs7002.magru.wmnet (remove config only) 2473220 wikitext text/x-wiki gkctf0q7vehbksc275cixpkbhxjknsd 2473221 2473220 2026-10-26T14:48:57Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host lvs7002.magru.wmnet (remove config only) 2473221 wikitext text/x-wiki eka865x7xjtklwhf2ycixhdsucxwodr 2473222 2473221 2026-10-26T14:50:38Z Stashbot 7414 brouberol@cumin1004: conftool action : get/pooled; selector: name=ml-staging-etcd2001.codfw.wmnet 2473222 wikitext text/x-wiki 7o7vagtnrclkctq66thmo77lsbrcsij 2473223 2473222 2026-10-26T14:51:50Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on lvs7002.magru.wmnet with reason: host reimage 2473223 wikitext text/x-wiki fxpgk9gvr2g1hqifyzo2migexz2kmrs 2473225 2473223 2026-10-26T14:54:50Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on lvs7002.magru.wmnet with reason: host reimage 2473225 wikitext text/x-wiki amhd6nzz8whylzj15nagk8oghv5mesg 2473226 2473225 2026-10-26T14:56:01Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-serve1010.eqiad.wmnet 2473226 wikitext text/x-wiki i9366whcuhvvstwvuoys705vcrcrvca 2473227 2473226 2026-10-26T14:57:24Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.etcd.roll-restart-reboot rolling restart_daemons on A:ml-staging-etcd 2473227 wikitext text/x-wiki bgw9d6w4g7bjsa2cg9qvx3jpml0mcjh 2473228 2473227 2026-10-26T14:57:27Z Stashbot 7414 brouberol@cumin1004: END (FAIL) - Cookbook sre.etcd.roll-restart-reboot (exit_code=1) rolling restart_daemons on A:ml-staging-etcd 2473228 wikitext text/x-wiki 1uzpp3wzhxkp189ma7rzdu6vukwqha7 2473230 2473228 2026-10-26T15:00:49Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve1010.eqiad.wmnet 2473230 wikitext text/x-wiki t9xf9dhomm2g32f8gj2pio4wg1w0j91 2473231 2473230 2026-10-26T15:00:51Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-serve1010.eqiad.wmnet 2473231 wikitext text/x-wiki dyxbm9tajgb6gmtcrq8tp39hmcgxaq0 2473232 2473231 2026-10-26T15:00:56Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve1011.eqiad.wmnet 2473232 wikitext text/x-wiki pr2ifaf3nmcoai1hrw8fdze6e6dgoqo 2473233 2473232 2026-10-26T15:04:24Z Stashbot 7414 slyngshede@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp2044.codfw.wmnet 2473233 wikitext text/x-wiki 3c912hxty4ixgc1ff9rypa9vvfv2ex5 2473234 2473233 2026-10-26T15:04:27Z Stashbot 7414 slyngshede@cumin1004: END (PASS) - Cookbook sre.cdn.roll-reboot (exit_code=0) rolling reboot on P{cp2043*} OR P{cp2044*} and A:cp 2473234 wikitext text/x-wiki bcsu9wrh9dgdtzo927xwtgnzo257wc1 2473235 2473234 2026-10-26T15:05:59Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-serve1011.eqiad.wmnet 2473235 wikitext text/x-wiki jvuwdluqhwiouwi4mw2ux7ss92nc1bj 2473236 2473235 2026-10-26T15:06:20Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.etcd.roll-restart-reboot rolling restart_daemons on A:ml-staging-etcd 2473236 wikitext text/x-wiki 26qlt3czsz4rk2cba2lg80415jqubp1 2473239 2473236 2026-10-26T15:10:43Z Stashbot 7414 brouberol@cumin1004: END (FAIL) - Cookbook sre.etcd.roll-restart-reboot (exit_code=99) rolling restart_daemons on A:ml-staging-etcd 2473239 wikitext text/x-wiki eh4krbkq4xc1t9n43r0r2wxa148szpx 2473241 2473239 2026-10-26T15:11:36Z Stashbot 7414 slyngshede@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp2050.codfw.wmnet 2473241 wikitext text/x-wiki nqm9umr8i6fi5a7hzxgk9poudmc5vsx 2473242 2473241 2026-10-26T15:11:39Z Stashbot 7414 slyngshede@cumin1004: END (PASS) - Cookbook sre.cdn.roll-reboot (exit_code=0) rolling reboot on P{cp2048*} OR P{cp2050*} and A:cp 2473242 wikitext text/x-wiki 75jsv4ufa1yiq1p4ivdaidqi70w04fp 2473243 2473242 2026-10-26T15:11:57Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve1011.eqiad.wmnet 2473243 wikitext text/x-wiki jfjwgfs87r981lrea2kdh77clq6b64g 2473244 2473243 2026-10-26T15:12:00Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-serve1011.eqiad.wmnet 2473244 wikitext text/x-wiki pdxwf2ipl4l9v1psesznv8c6rklm8tx 2473245 2473244 2026-10-26T15:12:03Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on A:ml-serve-worker-eqiad 2473245 wikitext text/x-wiki 00qtwqexl9lzn2okbicv15qprmw8pi7 2473246 2473245 2026-10-26T15:12:05Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.hosts.dhcp for host ml-serve1016.eqiad.wmnet (remove config only) 2473246 wikitext text/x-wiki 41zzdwlujr2s4zpg4ujni062n4gzjzs 2473247 2473246 2026-10-26T15:12:07Z Stashbot 7414 jclark@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host ml-serve1016.eqiad.wmnet (remove config only) 2473247 wikitext text/x-wiki f2bfd6bc1myhfv0p6k4hhpk22leyt0s 2473248 2473247 2026-10-26T15:12:10Z Stashbot 7414 jclark@cumin1004: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ml-serve1016.eqiad.wmnet with OS trixie 2473248 wikitext text/x-wiki sgx5e9nq0vsc4sgx65yq85jk8sscfro 2473250 2473248 2026-10-26T15:14:07Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.reboot-nodes rolling reboot on P{ml-serve1001.eqiad.wmnet} and (A:ml-serve-master-eqiad or A:ml-serve-worker-eqiad) 2473250 wikitext text/x-wiki 2ysv5njka5vbbmsir7nlje7ay2cyjal 2473251 2473250 2026-10-26T15:14:12Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host ml-serve1001.eqiad.wmnet 2473251 wikitext text/x-wiki suq5pzfxgn0t2wsoi95k0yqrn1tnmva 2473253 2473251 2026-10-26T15:14:57Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host lvs7002.magru.wmnet with OS trixie 2473253 wikitext text/x-wiki 7oxqtkx38j9gz4labfizvvtbp21v72z 2473254 2473253 2026-10-26T15:15:30Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.hosts.reimage for host ml-serve1016.eqiad.wmnet with OS trixie 2473254 wikitext text/x-wiki amo7pu8bali0mefthegrenw4js13jgc 2473255 2473254 2026-10-26T15:15:42Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.hosts.dhcp for host ml-serve1016.eqiad.wmnet (push config only) 2473255 wikitext text/x-wiki 62qkxcr1kt3tazx1wnuck8o2z5xt4el 2473256 2473255 2026-10-26T15:15:46Z Stashbot 7414 jclark@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host ml-serve1016.eqiad.wmnet (push config only) 2473256 wikitext text/x-wiki q37qhqt1ajf4593ocq9dlekh2w0ipot 2473257 2473256 2026-10-26T15:16:02Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.etcd.roll-restart-reboot rolling restart_daemons on A:ml-staging-etcd 2473257 wikitext text/x-wiki fa3jkpckrwh17fnjz5m210tlnn53ztp 2473258 2473257 2026-10-26T15:16:45Z Stashbot 7414 brouberol@cumin1004: END (FAIL) - Cookbook sre.etcd.roll-restart-reboot (exit_code=99) rolling restart_daemons on A:ml-staging-etcd 2473258 wikitext text/x-wiki 33n077yezwe98owfn5g34y3an42r8gv 2473259 2473258 2026-10-26T15:17:17Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.etcd.roll-restart-reboot rolling restart_daemons on A:ml-staging-etcd 2473259 wikitext text/x-wiki n3ldi26nehredekabocmypdmektrfn3 2473260 2473259 2026-10-26T15:19:14Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-serve1001.eqiad.wmnet 2473260 wikitext text/x-wiki 7f5xk6icutnp7blxgb5r398qgv4nflv 2473261 2473260 2026-10-26T15:20:09Z Stashbot 7414 slyngshede@cumin1004: START - Cookbook sre.cdn.roll-reboot rolling reboot on P{cp2046*} OR P{cp2045*} and A:cp 2473261 wikitext text/x-wiki 5gm45a18p0ewswfczrdbgka9std2yqg 2473262 2473261 2026-10-26T15:20:12Z Stashbot 7414 brouberol@cumin1004: END (FAIL) - Cookbook sre.etcd.roll-restart-reboot (exit_code=99) rolling restart_daemons on A:ml-staging-etcd 2473262 wikitext text/x-wiki ah508160cjupn8rmovqe8kz3006wy2h 2473263 2473262 2026-10-26T15:20:27Z Stashbot 7414 herron@cumin1004: START - Cookbook sre.opensearch.roll-restart-reboot rolling reboot on A:logstash-eqiad 2473263 wikitext text/x-wiki lwv14u1ccb5oiaxe3z8zcj1u8br4y8l 2473264 2473263 2026-10-26T15:21:42Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.etcd.roll-restart-reboot rolling restart_daemons on A:ml-staging-etcd 2473264 wikitext text/x-wiki d70yg67napzlsva35zvh7fw8f25hy07 2473265 2473264 2026-10-26T15:23:02Z Stashbot 7414 brouberol@cumin1004: END (FAIL) - Cookbook sre.etcd.roll-restart-reboot (exit_code=99) rolling restart_daemons on A:ml-staging-etcd 2473265 wikitext text/x-wiki 0vvgrfuaur1tl3yayqn6s93rrvn4om0 2473266 2473265 2026-10-26T15:23:31Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.etcd.roll-restart-reboot rolling restart_daemons on A:ml-staging-etcd 2473266 wikitext text/x-wiki fluvlrzgi8nkim868yrd0nf19a2c1gr 2473268 2473266 2026-10-26T15:25:36Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.etcd.roll-restart-reboot (exit_code=0) rolling restart_daemons on A:ml-staging-etcd 2473268 wikitext text/x-wiki q1oltztj2590cmr0kjd3ca6s1ff7qw2 2473269 2473268 2026-10-26T15:26:12Z Stashbot 7414 klausman@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host ml-serve1001.eqiad.wmnet 2473269 wikitext text/x-wiki hdc6pyj5qjxgobc7a575uagz0yvwpyp 2473270 2473269 2026-10-26T15:26:14Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-serve1001.eqiad.wmnet 2473270 wikitext text/x-wiki 3y28s9sdw22k9h6t29khmu4p8ip2i6o 2473271 2473270 2026-10-26T15:26:16Z Stashbot 7414 klausman@cumin1004: END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on P{ml-serve1001.eqiad.wmnet} and (A:ml-serve-master-eqiad or A:ml-serve-worker-eqiad) 2473271 wikitext text/x-wiki c1m7v0cxorfzgrbjn4cx3t7q7eun94t 2473272 2473271 2026-10-26T15:26:33Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2473272 wikitext text/x-wiki 2pjgnm049o8f7ivid2qnr7xdbh46b2m 2473273 2473272 2026-10-26T15:27:30Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2473273 wikitext text/x-wiki 02d2oemh5zyi34ap8puxtideyju69ll 2473274 2473273 2026-10-26T15:29:05Z Stashbot 7414 slyngshede@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp2045.codfw.wmnet 2473274 wikitext text/x-wiki s906ctwf1zl8sxgrogw837svukysd1e 2473275 2473274 2026-10-26T15:31:48Z Stashbot 7414 slyngshede@cumin1004: START - Cookbook sre.cdn.roll-reboot rolling reboot on P{cp2052*} OR P{cp2054*} and A:cp 2473275 wikitext text/x-wiki 8wulefbj3er5phenefhw41i9wo5irdr 2473277 2473275 2026-10-26T15:33:02Z Stashbot 7414 jiji@cumin2003: START - Cookbook sre.memcached.roll-reboot-restart rolling reboot on A:memcached-gutter-codfw 2473277 wikitext text/x-wiki efaeibtuvoggua6537mjqf9i24o404k 2473280 2473277 2026-10-26T15:40:24Z Stashbot 7414 slyngshede@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp2052.codfw.wmnet 2473280 wikitext text/x-wiki 6haq3d83v4fr0tkgeqznyneop81b9cg 2473282 2473280 2026-10-26T15:52:52Z Stashbot 7414 jiji@cumin2003: END (PASS) - Cookbook sre.memcached.roll-reboot-restart (exit_code=0) rolling reboot on A:memcached-gutter-codfw 2473282 wikitext text/x-wiki 2fso5s8m0p1gva7qsnkr3zyobqemhza 2473285 2473282 2026-10-26T15:54:15Z Stashbot 7414 jiji@cumin2003: START - Cookbook sre.memcached.roll-reboot-restart rolling reboot on A:memcached-codfw 2473285 wikitext text/x-wiki hftriuklhwor2r6d5t5svx5gn8uxn5d 2473289 2473285 2026-10-26T16:06:49Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply 2473289 wikitext text/x-wiki ad58x4oid90iutjb4s94xtnry09z5ql 2473290 2473289 2026-10-26T16:07:07Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply 2473290 wikitext text/x-wiki 8rgyoovxl7wfg7rx7uvgvnmwprsszrg 2473291 2473290 2026-10-26T16:09:28Z Stashbot 7414 slyngshede@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp2046.codfw.wmnet 2473291 wikitext text/x-wiki qrgo23mdjz99juwxvee9ud6l0641bsc 2473292 2473291 2026-10-26T16:09:31Z Stashbot 7414 slyngshede@cumin1004: END (PASS) - Cookbook sre.cdn.roll-reboot (exit_code=0) rolling reboot on P{cp2046*} OR P{cp2045*} and A:cp 2473292 wikitext text/x-wiki 581t7iwhe1e8i5y72ywixl3qxspd0om 2473293 2473292 2026-10-26T16:10:15Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.loadbalancer.admin config_reloading P{lvs7001.magru.wmnet} and A:liberica 2473293 wikitext text/x-wiki qphc6ghxtue1t2ev42efyfj8vwf3req 2473294 2473293 2026-10-26T16:10:33Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) config_reloading P{lvs7001.magru.wmnet} and A:liberica 2473294 wikitext text/x-wiki sp59rp617n8teijxlkp5v78jygx37hk 2473295 2473294 2026-10-26T16:13:02Z Stashbot 7414 slyngshede@cumin1004: START - Cookbook sre.cdn.roll-reboot rolling reboot on P{cp2047*} and A:cp 2473295 wikitext text/x-wiki ktsa62xdyz455d0vtn7h4r05gdp70uu 2473297 2473295 2026-10-26T16:17:28Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.hosts.reimage for host lvs7001.magru.wmnet with OS trixie 2473297 wikitext text/x-wiki 57w9y27ian5jmhf39d28ywi460jfigy 2473298 2473297 2026-10-26T16:18:25Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.hosts.dhcp for host lvs7001.magru.wmnet (push config only) 2473298 wikitext text/x-wiki gp6i3f3jpedwdy51esvpa0ej9m032mu 2473299 2473298 2026-10-26T16:18:31Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host lvs7001.magru.wmnet (push config only) 2473299 wikitext text/x-wiki ntq9lu7ytqs541n6t6skfjfb2518ptg 2473300 2473299 2026-10-26T16:18:47Z Stashbot 7414 slyngshede@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp2054.codfw.wmnet 2473300 wikitext text/x-wiki pyyursqylq7bnqlu0x1p5oswiaxd67j 2473301 2473300 2026-10-26T16:18:49Z Stashbot 7414 slyngshede@cumin1004: END (PASS) - Cookbook sre.cdn.roll-reboot (exit_code=0) rolling reboot on P{cp2052*} OR P{cp2054*} and A:cp 2473301 wikitext text/x-wiki k43lvnpjlj07eachk24u1cvty5olikz 2473306 2473301 2026-10-26T16:24:36Z Stashbot 7414 slyngshede@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp2047.codfw.wmnet 2473306 wikitext text/x-wiki cbmi593oynsb5jqcz51zar39b3slycc 2473307 2473306 2026-10-26T16:24:39Z Stashbot 7414 slyngshede@cumin1004: END (PASS) - Cookbook sre.cdn.roll-reboot (exit_code=0) rolling reboot on P{cp2047*} and A:cp 2473307 wikitext text/x-wiki nedr627oq6664jqznqpv2tu0e9zdnp4 2473314 2473307 2026-10-26T16:36:56Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.dns.netbox 2473314 wikitext text/x-wiki dtmo54l97s3y100rvbitw3mkvp8d41u 2473316 2473314 2026-10-26T16:37:37Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.hosts.dhcp for host lvs7001.magru.wmnet (remove config only) 2473316 wikitext text/x-wiki 1sjs7ogmikytzbzkmf8vs2q2ruxcj66 2473317 2473316 2026-10-26T16:37:45Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host lvs7001.magru.wmnet (remove config only) 2473317 wikitext text/x-wiki s73jfkao5d56ypq8148259pmt61lrum 2473318 2473317 2026-10-26T16:38:23Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti1043.eqiad.wmnet 2473318 wikitext text/x-wiki avp33jdouvpkhsknqyshyd5o6b6zu3z 2473319 2473318 2026-10-26T16:38:29Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2039.codfw.wmnet 2473319 wikitext text/x-wiki ivudj4om0zlutv58cs8w81lcn6emk8c 2473320 2473319 2026-10-26T16:39:32Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2473320 wikitext text/x-wiki m1hpkjzo4992hdaoetuwiqtv29mmdzd 2473321 2473320 2026-10-26T16:40:43Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on lvs7001.magru.wmnet with reason: host reimage 2473321 wikitext text/x-wiki 362g00650ddq7dim1l0u0icr1jmzcsl 2473323 2473321 2026-10-26T16:41:16Z Stashbot 7414 atsukoito: upgrading airflow-dumps to airflow 3.3: done 2473323 wikitext text/x-wiki n1uc9dil1xvavh698vnaeq695r91qax 2473325 2473323 2026-10-26T16:43:58Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1043.eqiad.wmnet 2473325 wikitext text/x-wiki rj92jz8f93pl29gmgffm36d0e32rz3z 2473326 2473325 2026-10-26T16:44:40Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on lvs7001.magru.wmnet with reason: host reimage 2473326 wikitext text/x-wiki grog6wz4het3n57a3s9pg7bwmwubhyu 2473327 2473326 2026-10-26T16:44:43Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1043.eqiad.wmnet 2473327 wikitext text/x-wiki nixrewn70rai0c5di7vqwsiyhm19khg 2473336 2473327 2026-10-26T16:53:27Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.reboot-nodes rolling reboot on A:wikikube-worker-codfw 2473336 wikitext text/x-wiki din4ndzegxnjbto2zit9zgx4wr0r4sn 2473338 2473336 2026-10-26T16:53:57Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2001-2002,2005-2006,2011-2018,2033-2035].codfw.wmnet 2473338 wikitext text/x-wiki 6xocq7nts9rq8nqecw3erxaupbzbeje 2473341 2473338 2026-10-26T17:01:46Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti2039.codfw.wmnet 2473341 wikitext text/x-wiki awbph2zcls1abgtey1bsr2upzvg9v7f 2473342 2473341 2026-10-26T17:01:56Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1044.eqiad.wmnet 2473342 wikitext text/x-wiki euj2t7u2uzddwdf972zhex5d6hc65q0 2473345 2473342 2026-10-26T17:04:39Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host lvs7001.magru.wmnet with OS trixie 2473345 wikitext text/x-wiki o1nr010hbbatp62iml9996394p9p2v9 2473347 2473345 2026-10-26T17:06:40Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2001-2002,2005-2006,2011-2018,2033-2035].codfw.wmnet 2473347 wikitext text/x-wiki 1hxfqcntuj5wakzxqp4y27dwrc1km18 2473349 2473347 2026-10-26T17:07:07Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2039.codfw.wmnet 2473349 wikitext text/x-wiki ss10gd0trzufbw1fvcp32ds1y4vkmr7 2473350 2473349 2026-10-26T17:07:13Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2039.codfw.wmnet 2473350 wikitext text/x-wiki geqvh5ut6ktphutv6ia7msps2svknzs 2473351 2473350 2026-10-26T17:09:26Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2040.codfw.wmnet 2473351 wikitext text/x-wiki ex90gkdf6udn31dxr2vcgfnfdul7993 2473352 2473351 2026-10-26T17:09:34Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti1044.eqiad.wmnet 2473352 wikitext text/x-wiki 59cms8lw4mdi54rebf82isr6xv0lm3l 2473354 2473352 2026-10-26T17:14:44Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1044.eqiad.wmnet 2473354 wikitext text/x-wiki eeefwbhj2oca4ilqa9r4hhuza8thiyj 2473355 2473354 2026-10-26T17:15:28Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1044.eqiad.wmnet 2473355 wikitext text/x-wiki bkhmxboi4ss5adr9dyo4hf9bv94xdf2 2473356 2473355 2026-10-26T17:15:31Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2001-2002,2005-2006,2011-2018,2033-2035].codfw.wmnet 2473356 wikitext text/x-wiki 0589pjbfeggtc227dwg85dsv9ozg8e5 2473357 2473356 2026-10-26T17:15:34Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2001-2002,2005-2006,2011-2018,2033-2035].codfw.wmnet 2473357 wikitext text/x-wiki cbgufx8twqbi2rkhcjsm3or6whptc3r 2473358 2473357 2026-10-26T17:15:59Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.loadbalancer.admin config_reloading P{lvs7001.magru.wmnet} and A:liberica 2473358 wikitext text/x-wiki gresu2r5kcfj3iwdexalivs5gdc0v1e 2473359 2473358 2026-10-26T17:16:05Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2036-2039,2041-2042,2044,2046,2049-2051,2055-2058].codfw.wmnet 2473359 wikitext text/x-wiki 0ofmdecrfyscuquilzu7b78cdo8papp 2473360 2473359 2026-10-26T17:16:18Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) config_reloading P{lvs7001.magru.wmnet} and A:liberica 2473360 wikitext text/x-wiki 7w3p14do1xwag8zw7a07wf1k2oohohs 2473363 2473360 2026-10-26T17:19:46Z Stashbot 7414 dancy@deploy1003: Installing scap version "4.306.0" for 3 host(s) 2473363 wikitext text/x-wiki 3zo3slr96odaeqiv288drhmttli7vtb 2473364 2473363 2026-10-26T17:21:42Z Stashbot 7414 dancy@deploy1003: Installation of scap version "4.306.0" completed for 3 hosts 2473364 wikitext text/x-wiki sixlp8yats1ngq60yqni3isns4ykwhw 2473365 2473364 2026-10-26T17:24:48Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2036-2039,2041-2042,2044,2046,2049-2051,2055-2058].codfw.wmnet 2473365 wikitext text/x-wiki 5ilquqyv42sqnyhiw6airzyh7m9ypn4 2473366 2473365 2026-10-26T17:25:45Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply 2473366 wikitext text/x-wiki g1b040se21a0ildzmn0uuqnbv2fbo1f 2473367 2473366 2026-10-26T17:26:00Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply 2473367 wikitext text/x-wiki 5woadetvgwdp2kayll5cnfe8hhzox2o 2473368 2473367 2026-10-26T17:26:23Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply 2473368 wikitext text/x-wiki ttkvd87xhqhr0y1b8uhrcw0st1iulct 2473369 2473368 2026-10-26T17:26:31Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply 2473369 wikitext text/x-wiki coxy2ied91vmyml9fnja203vis6q3qm 2473370 2473369 2026-10-26T17:26:38Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs-next: apply 2473370 wikitext text/x-wiki jbo6jmhsgvcvpalcqgw9971t27lezcj 2473373 2473370 2026-10-26T17:28:34Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs-next: apply 2473373 wikitext text/x-wiki ltaqyxpvlfbjm9rocrp4prdafsn7qek 2473375 2473373 2026-10-26T17:29:48Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs-next: apply 2473375 wikitext text/x-wiki gzdj5qyakxzqkl40462fb40fr36ingn 2473376 2473375 2026-10-26T17:30:28Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs-next: apply 2473376 wikitext text/x-wiki iu5yoppaikud2nvppirrpu2tm8dayqj 2473380 2473376 2026-10-26T17:33:24Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2036-2039,2041-2042,2044,2046,2049-2051,2055-2058].codfw.wmnet 2473380 wikitext text/x-wiki ogk5qnpumyveo5mp9mvehbx3frny4eq 2473381 2473380 2026-10-26T17:33:29Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2036-2039,2041-2042,2044,2046,2049-2051,2055-2058].codfw.wmnet 2473381 wikitext text/x-wiki 0ji866h8rzb7aipfx0744275iy44hb3 2473384 2473381 2026-10-26T17:34:07Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2059-2062,2064-2065,2067-2075].codfw.wmnet 2473384 wikitext text/x-wiki l874mc0ku96ifci9t4fd2mrg729nuth 2473387 2473384 2026-10-26T17:35:08Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs-next: apply 2473387 wikitext text/x-wiki 20e066eqj3kdgzkgnmdsjr0polixdlm 2473388 2473387 2026-10-26T17:36:05Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs-next: apply 2473388 wikitext text/x-wiki 7v559bzg2hrn8l4enmt5hcbiljhktgk 2473390 2473388 2026-10-26T17:37:34Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti2040.codfw.wmnet 2473390 wikitext text/x-wiki poin99ol9vou5sspeg7gv1vwdpjo3r1 2473396 2473390 2026-10-26T17:42:48Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2059-2062,2064-2065,2067-2075].codfw.wmnet 2473396 wikitext text/x-wiki tv5skd95zynwgo2roorlu4d5iezcn26 2473397 2473396 2026-10-26T17:42:51Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2040.codfw.wmnet 2473397 wikitext text/x-wiki 6bm8o7fvbeboaqpc3oya96yf7zpgbd7 2473398 2473397 2026-10-26T17:42:57Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2040.codfw.wmnet 2473398 wikitext text/x-wiki onsex9u94736luk2xb9gpfkrsm7wkcn 2473401 2473398 2026-10-26T17:48:27Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2473401 wikitext text/x-wiki 3b9c72w67f7dg8lavpzas12s2a6nn2f 2473402 2473401 2026-10-26T17:48:52Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2473402 wikitext text/x-wiki gxpj5mublojuao7o4q3ex0b4etmuqoh 2473403 2473402 2026-10-26T17:49:56Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2473403 wikitext text/x-wiki os3qreasr8g7zdubm0msyogdd1lzul2 2473404 2473403 2026-10-26T17:50:17Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2473404 wikitext text/x-wiki r8a6n3vhen2zoocw7dvaell6c7t692h 2473406 2473404 2026-10-26T17:50:51Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2059-2062,2064-2065,2067-2075].codfw.wmnet 2473406 wikitext text/x-wiki lio5sv8nu87uf0wkehkx050pepqw7l4 2473407 2473406 2026-10-26T17:50:56Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2059-2062,2064-2065,2067-2075].codfw.wmnet 2473407 wikitext text/x-wiki t5ecoz344lo15xmvfkc6w1buvsey9p1 2473408 2473407 2026-10-26T17:51:34Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2076-2078,2087-2095,2102-2104].codfw.wmnet 2473408 wikitext text/x-wiki rxgitm82d303mke0svfbk19un3b1e6j 2473409 2473408 2026-10-26T17:53:15Z Stashbot 7414 brett@cumin2003: START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade of ATS on A:cp-text_eqsin and not P{cp5001.eqsin.wmnet} and A:cp - 9.2.16 upgrade (T441945) 2473409 wikitext text/x-wiki qyjgf4elvgfcuxk90gbeyc0egiq6d60 2473410 2473409 2026-10-26T17:53:32Z Stashbot 7414 brett@cumin2003: START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade of ATS on A:cp-upload_eqsin and not P{cp5017.eqsin.wmnet} and A:cp - 9.2.16 upgrade (T441945) 2473410 wikitext text/x-wiki 0c6mjijlrlocus45wmzi731yen1g8sc 2473413 2473410 2026-10-26T18:00:57Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2076-2078,2087-2095,2102-2104].codfw.wmnet 2473413 wikitext text/x-wiki 0de2ivyaharfzffpah6bogsf6d5wv7u 2473414 2473413 2026-10-26T18:02:57Z Stashbot 7414 aokoth@cumin1004: START - Cookbook sre.vrts.upgrade on VRTS host vrts1003.eqiad.wmnet 2473414 wikitext text/x-wiki nht26ewhkltxv4cfd0j1p9lfp335m6u 2473415 2473414 2026-10-26T18:04:40Z Stashbot 7414 aokoth@cumin1004: END (PASS) - Cookbook sre.vrts.upgrade (exit_code=0) on VRTS host vrts1003.eqiad.wmnet 2473415 wikitext text/x-wiki hwegfvzj1pgdv3b9n6f4949h4g0qdwg 2473416 2473415 2026-10-26T18:09:26Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2076-2078,2087-2095,2102-2104].codfw.wmnet 2473416 wikitext text/x-wiki 02p58kiynfyhvtlj0mr1guqjoxrvcw0 2473417 2473416 2026-10-26T18:09:31Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2076-2078,2087-2095,2102-2104].codfw.wmnet 2473417 wikitext text/x-wiki 71szhjg4yecv4qcn4tio7ebprhdloz7 2473418 2473417 2026-10-26T18:10:03Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2105-2115,2124-2127].codfw.wmnet 2473418 wikitext text/x-wiki tf48ybp2yxvc6oh2wcijrlj05iragq8 2473419 2473418 2026-10-26T18:12:20Z Stashbot 7414 jiji@cumin2003: END (PASS) - Cookbook sre.memcached.roll-reboot-restart (exit_code=0) rolling reboot on A:memcached-codfw 2473419 wikitext text/x-wiki r2umiwz63opplakggsdomx7om6p8zj9 2473423 2473419 2026-10-26T18:22:50Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2105-2115,2124-2127].codfw.wmnet 2473423 wikitext text/x-wiki h3rq2fcldqpd1bh9hq4m5r7keskhb4l 2473424 2473423 2026-10-26T18:30:26Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs: apply 2473424 wikitext text/x-wiki 7c91fzzevc6s0xoigqe00ebvcq0vg5a 2473425 2473424 2026-10-26T18:30:53Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply 2473425 wikitext text/x-wiki e3qc02t9ogpaq1rpmp4rxat7tn8twb2 2473426 2473425 2026-10-26T18:31:02Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2105-2115,2124-2127].codfw.wmnet 2473426 wikitext text/x-wiki g9r8qs744cwpd42jejjs8t6o9exuqz0 2473427 2473426 2026-10-26T18:31:07Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2105-2115,2124-2127].codfw.wmnet 2473427 wikitext text/x-wiki 4t19wwlqpirpyc4ggx2cbojr71vehni 2473428 2473427 2026-10-26T18:31:39Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2128-2142].codfw.wmnet 2473428 wikitext text/x-wiki educvay9r3fpic9bllae1ajp3rmcxvh 2473429 2473428 2026-10-26T18:32:00Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs: apply 2473429 wikitext text/x-wiki m1rv3nzhrjnnrqw5t6uf8c1h8m8bapc 2473430 2473429 2026-10-26T18:32:24Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply 2473430 wikitext text/x-wiki 2n4obrlqydo3jsk9l2snxfqffjge87v 2473432 2473430 2026-10-26T18:34:26Z Stashbot 7414 brett@cumin2003: END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade of ATS on A:cp-upload_eqsin and not P{cp5017.eqsin.wmnet} and A:cp - 9.2.16 upgrade (T441945) 2473432 wikitext text/x-wiki bm88iygotax6lqjxrzch6tgf4ianctf 2473438 2473432 2026-10-26T18:39:51Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2128-2142].codfw.wmnet 2473438 wikitext text/x-wiki gdt7vlyf95zfksoqotnbh84gx67rfbf 2473442 2473438 2026-10-26T18:41:45Z Stashbot 7414 akhatun@deploy1003: Started scap sync-world: Backport for [[gerrit:1357360|Prefetch the LAC revision_feature_counts artifact on testwiki (T436695)]] 2473442 wikitext text/x-wiki ds9mek2yerogctcpdnphtraczedaicr 2473443 2473442 2026-10-26T18:46:12Z Stashbot 7414 akhatun@deploy1003: akhatun, otto: Backport for [[gerrit:1357360|Prefetch the LAC revision_feature_counts artifact on testwiki (T436695)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2473443 wikitext text/x-wiki i3h31ekorhyvrseztlkaayfos7s4w9g 2473444 2473443 2026-10-26T18:48:18Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2128-2142].codfw.wmnet 2473444 wikitext text/x-wiki 50s6usosmubl9wtcyopp0miscitzz2j 2473445 2473444 2026-10-26T18:48:23Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2128-2142].codfw.wmnet 2473445 wikitext text/x-wiki 4vsw2kff8h69eingvahvuny4l375us1 2473447 2473445 2026-10-26T18:48:57Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2143-2157].codfw.wmnet 2473447 wikitext text/x-wiki lrmty1cy6z2cfrpyo4g5mzq0w5kazje 2473452 2473447 2026-10-26T18:57:16Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2143-2157].codfw.wmnet 2473452 wikitext text/x-wiki pl4kpf3fy9r41nbjhsuolsj5dda81ns 2473453 2473452 2026-10-26T19:01:33Z Stashbot 7414 akhatun@deploy1003: akhatun, otto: Continuing with deployment 2473453 wikitext text/x-wiki kjd1fapu8ugpjxjlp7itxc0g0caammi 2473454 2473453 2026-10-26T19:03:06Z Stashbot 7414 jgreen@dns2006: START - running authdns-update 2473454 wikitext text/x-wiki si4mzdzcnff8wd62hnm22jv27h4egib 2473455 2473454 2026-10-26T19:05:35Z Stashbot 7414 jgreen@dns2006: END - running authdns-update 2473455 wikitext text/x-wiki a4eofnjg68k49uga2vqxs429acvm84c 2473456 2473455 2026-10-26T19:05:44Z Stashbot 7414 brett@cumin2003: END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade of ATS on A:cp-text_eqsin and not P{cp5001.eqsin.wmnet} and A:cp - 9.2.16 upgrade (T441945) 2473456 wikitext text/x-wiki dpxbpm18sqxgj0z8zk4c76nn9306oci 2473457 2473456 2026-10-26T19:05:59Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2143-2157].codfw.wmnet 2473457 wikitext text/x-wiki 6xl1wi2fi38jn6i384b09evoedlp7x7 2473458 2473457 2026-10-26T19:06:04Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2143-2157].codfw.wmnet 2473458 wikitext text/x-wiki 79hues2f7f1sctdbh8tt5i8g27858kj 2473459 2473458 2026-10-26T19:06:37Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2158-2172].codfw.wmnet 2473459 wikitext text/x-wiki 257qgg94l8444mh5onfk8scvxbjidsq 2473460 2473459 2026-10-26T19:07:25Z Stashbot 7414 akhatun@deploy1003: Finished scap sync-world: Backport for [[gerrit:1357360|Prefetch the LAC revision_feature_counts artifact on testwiki (T436695)]] (duration: 25m 40s) 2473460 wikitext text/x-wiki hruz8wo55us80hvmsdl2r75lgruqxxo 2473461 2473460 2026-10-26T19:14:54Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2158-2172].codfw.wmnet 2473461 wikitext text/x-wiki rsb5xa0db11sec76c6yeqe9kl31xpxp 2473464 2473461 2026-10-26T19:23:35Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2158-2172].codfw.wmnet 2473464 wikitext text/x-wiki 4pgo5zyk5mmau8aujk0orau9pc0oorb 2473465 2473464 2026-10-26T19:23:40Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2158-2172].codfw.wmnet 2473465 wikitext text/x-wiki f7fqztfvmiruk4jw2v5z5ec4y7v9hpn 2473467 2473465 2026-10-26T19:24:11Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2173-2179,2184-2190].codfw.wmnet 2473467 wikitext text/x-wiki 8jl3ivn9itsxtnvhvw3iuk1m9megv9h 2473468 2473467 2026-10-26T19:25:18Z Stashbot 7414 bking@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/matomo-next: apply 2473468 wikitext text/x-wiki 9alp95b82fzesa19hrv86mzku2h9m7c 2473469 2473468 2026-10-26T19:25:30Z Stashbot 7414 bking@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/matomo-next: apply 2473469 wikitext text/x-wiki 800fssh6wnyn79kklu4lmqoh23waowf 2473470 2473469 2026-10-26T19:26:35Z Stashbot 7414 krinkle@deploy1003: Started scap sync-world: Backport for [[gerrit:1346336|Remove unused StatsD configuration and instruments (T228380)]], [[gerrit:1254463|labs: Remove redundant wgSkipSkins override]] 2473470 wikitext text/x-wiki 7bartoeyhype9cxbgdxtwf1j71b3dm4 2473471 2473470 2026-10-26T19:30:54Z Stashbot 7414 krinkle@deploy1003: krinkle, awight: Backport for [[gerrit:1346336|Remove unused StatsD configuration and instruments (T228380)]], [[gerrit:1254463|labs: Remove redundant wgSkipSkins override]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2473471 wikitext text/x-wiki pigdjkljx4xiw8rz247kz267yub5n95 2473472 2473471 2026-10-26T19:32:32Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2173-2179,2184-2190].codfw.wmnet 2473472 wikitext text/x-wiki 71nn3ocy7mkajnhuyyj9xggvwzky43z 2473473 2473472 2026-10-26T19:35:06Z Stashbot 7414 jhathaway@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on mx-out2001.wikimedia.org with reason: new-kernel 2473473 wikitext text/x-wiki lqsr1zkcm5zpv70d78qy9c35qyxe363 2473474 2473473 2026-10-26T19:37:40Z Stashbot 7414 krinkle@deploy1003: krinkle, awight: Continuing with deployment 2473474 wikitext text/x-wiki 4cgtwdcpy1xyp9ej2jkt881m9f15qfm 2473475 2473474 2026-10-26T19:40:38Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2173-2179,2184-2190].codfw.wmnet 2473475 wikitext text/x-wiki 2qaljc5nuh53n6rwmsarzm8wh5dwmbr 2473476 2473475 2026-10-26T19:40:43Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2173-2179,2184-2190].codfw.wmnet 2473476 wikitext text/x-wiki r2dkoqer9x5qduyvi540nlh44ujbuxb 2473478 2473476 2026-10-26T19:41:20Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2191-2204].codfw.wmnet 2473478 wikitext text/x-wiki tjhtnxi6aaqdad72ec5y2yhci5ziz8f 2473479 2473478 2026-10-26T19:41:31Z Stashbot 7414 jhathaway@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on mx-out1001.wikimedia.org with reason: new-kernel 2473479 wikitext text/x-wiki ivy639u5ariytssrf94zjpt8ah8ukxg 2473481 2473479 2026-10-26T19:43:24Z Stashbot 7414 krinkle@deploy1003: Finished scap sync-world: Backport for [[gerrit:1346336|Remove unused StatsD configuration and instruments (T228380)]], [[gerrit:1254463|labs: Remove redundant wgSkipSkins override]] (duration: 16m 48s) 2473481 wikitext text/x-wiki 2dmi6m4hsee16ldcxa5mcvjt8cgd08f 2473482 2473481 2026-10-26T19:44:17Z Stashbot 7414 jhathaway@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on mx-in1001.wikimedia.org with reason: new-kernel 2473482 wikitext text/x-wiki 78hmk4wpcblfn4nm9vr2jo5eqe72723 2473483 2473482 2026-10-26T19:44:56Z Stashbot 7414 brett@cumin2003: START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade of ATS on P{cp4052.ulsfo.wmnet} and A:cp - 9.2.16 upgrade (T441945) 2473483 wikitext text/x-wiki 55cagqfyoykmeqdnj9x7pzpzw2qjhts 2473484 2473483 2026-10-26T19:45:13Z Stashbot 7414 brett@cumin2003: START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade of ATS on P{cp4037.ulsfo.wmnet} and A:cp - 9.2.16 upgrade (T441945) 2473484 wikitext text/x-wiki fqkkglxj91sz8ja6av8y11xz6zr5s0t 2473485 2473484 2026-10-26T19:46:06Z Stashbot 7414 jhathaway@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on mx-in2001.wikimedia.org with reason: new-kernel 2473485 wikitext text/x-wiki jmxwl2qkimt5n0snmdjwobe1xpn8kmx 2473486 2473485 2026-10-26T19:49:16Z Stashbot 7414 brett@cumin2003: END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade of ATS on P{cp4052.ulsfo.wmnet} and A:cp - 9.2.16 upgrade (T441945) 2473486 wikitext text/x-wiki tdig0vm2djyms9ngmyirzh7edoplc35 2473487 2473486 2026-10-26T19:49:41Z Stashbot 7414 brett@cumin2003: END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade of ATS on P{cp4037.ulsfo.wmnet} and A:cp - 9.2.16 upgrade (T441945) 2473487 wikitext text/x-wiki cee7vaolugj413x4uq7ovmwv1yh1m57 2473490 2473487 2026-10-26T19:58:36Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2191-2204].codfw.wmnet 2473490 wikitext text/x-wiki lg3hf33xbj2a6ssnk3oqjo1hpu89p94 2473491 2473490 2026-10-26T20:01:58Z Stashbot 7414 brett@cumin2003: START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade of ATS on A:cp-text_ulsfo and not P{cp4037.ulsfo.wmnet} and A:cp - 9.2.16 upgrade (T441945) 2473491 wikitext text/x-wiki c4zp2qylv2c8wbktzrl936qi1t57otr 2473492 2473491 2026-10-26T20:02:08Z Stashbot 7414 brett@cumin2003: START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade of ATS on A:cp-upload_ulsfo and not P{cp4052.ulsfo.wmnet} and A:cp - 9.2.16 upgrade (T441945) 2473492 wikitext text/x-wiki 5ggeh03vixjiye30vpm7pd5dn2jtd7i 2473495 2473492 2026-10-26T20:07:17Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2191-2204].codfw.wmnet 2473495 wikitext text/x-wiki 8qqwo33hpurgqgeye6ja3udx1clhnci 2473496 2473495 2026-10-26T20:07:22Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2191-2204].codfw.wmnet 2473496 wikitext text/x-wiki hctfiv92z5q3sbl6d3x89jc2tr44dvd 2473497 2473496 2026-10-26T20:07:53Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2205-2215,2242-2243,2248].codfw.wmnet 2473497 wikitext text/x-wiki n7x5fohlknjl1va4yp4obx0syoatn6c 2473498 2473497 2026-10-26T20:11:30Z Stashbot 7414 urbanecm@deploy1003: Started scap sync-world: Backport for [[gerrit:1358445|Revert "Improve types" (T441875)]] (1.48.0-wmf.1) 2473498 wikitext text/x-wiki cr58jqowaxzwjuvrebperwiy8ao1dtp 2473500 2473498 2026-10-26T20:15:48Z Stashbot 7414 urbanecm@deploy1003: somerandomdeveloper, urbanecm: Backport for [[gerrit:1358445|Revert "Improve types" (T441875)]] (1.48.0-wmf.1) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2473500 wikitext text/x-wiki n29i2n5oxyfzqth7okxirvgi0a74kop 2473501 2473500 2026-10-26T20:16:18Z Stashbot 7414 urbanecm@deploy1003: somerandomdeveloper, urbanecm: Continuing with deployment 2473501 wikitext text/x-wiki f7psfq5joglupdtecrpw9r05f4je6qc 2473502 2473501 2026-10-26T20:16:22Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2205-2215,2242-2243,2248].codfw.wmnet 2473502 wikitext text/x-wiki 5wiojvp0tiiea36cv9zo5gi8168nb9l 2473504 2473502 2026-10-26T20:21:01Z Stashbot 7414 ladsgroup@deploy1003: helmfile [staging] START helmfile.d/services/thumbor: apply 2473504 wikitext text/x-wiki jorh6mf4xum18ynf4avt0ml6yankfxo 2473505 2473504 2026-10-26T20:21:09Z Stashbot 7414 ladsgroup@deploy1003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2473505 wikitext text/x-wiki hwojwh8parfbvk7xszxe0yzibm7tkhr 2473506 2473505 2026-10-26T20:22:00Z Stashbot 7414 urbanecm@deploy1003: Finished scap sync-world: Backport for [[gerrit:1358445|Revert "Improve types" (T441875)]] (1.48.0-wmf.1) (duration: 10m 30s) 2473506 wikitext text/x-wiki tn2g1r4sskevwgrhsq3r1881gscetzs 2473507 2473506 2026-10-26T20:23:57Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2473507 wikitext text/x-wiki pmxo14d6t3g0d1idppvv79vz4i7tv6t 2473508 2473507 2026-10-26T20:24:50Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2205-2215,2242-2243,2248].codfw.wmnet 2473508 wikitext text/x-wiki os37etd728ajb77dkqiv19v62s7lz5g 2473509 2473508 2026-10-26T20:24:56Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2205-2215,2242-2243,2248].codfw.wmnet 2473509 wikitext text/x-wiki 0rfz8jkyeruomy9y301mqdg5izymr7b 2473510 2473509 2026-10-26T20:25:14Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2473510 wikitext text/x-wiki o31dlte05t36gaabqnio74n404i2cju 2473511 2473510 2026-10-26T20:25:25Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2249-2262].codfw.wmnet 2473511 wikitext text/x-wiki t8xd3k64yrjdw44nizmxhuh3tc18ing 2473513 2473511 2026-10-26T20:27:03Z Stashbot 7414 urbanecm@deploy1003: mwscript-k8s job started: foreachwikiindblist mwscript.dblist GrowthExperiments:revalidateLinkRecommendations.php --olderThan=1790175600 --verbose # T438366 (dblist: https://phabricator.wikimedia.org/P97002) 2473513 wikitext text/x-wiki fz5zhg3im3umgyx0ttf9d47th3srvse 2473515 2473513 2026-10-26T20:27:43Z Stashbot 7414 brett@cumin2003: END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade of ATS on A:cp-upload_ulsfo and not P{cp4052.ulsfo.wmnet} and A:cp - 9.2.16 upgrade (T441945) 2473515 wikitext text/x-wiki 2t6tl2hp7q2tddrw0i1veu7id384j8f 2473516 2473515 2026-10-26T20:29:28Z Stashbot 7414 urbanecm@deploy1003: mwscript-k8s job started: GrowthExperiments:revalidateLinkRecommendations.php --wiki=enwiki --olderThan=1790175600 --verbose # T438366 2473516 wikitext text/x-wiki dpwqu0p36xmv1o5twt3j5eqq9w5slq9 2473517 2473516 2026-10-26T20:30:14Z Stashbot 7414 ladsgroup@deploy1003: helmfile [eqiad] START helmfile.d/services/thumbor: apply 2473517 wikitext text/x-wiki 5cmy5qesgib0quan92ic6iaygigev5d 2473518 2473517 2026-10-26T20:30:58Z Stashbot 7414 ladsgroup@deploy1003: helmfile [eqiad] DONE helmfile.d/services/thumbor: apply 2473518 wikitext text/x-wiki 8fqmhzvg6wufgzssxly2qys42v0am67 2473519 2473518 2026-10-26T20:32:29Z Stashbot 7414 bking@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/matomo-next: apply 2473519 wikitext text/x-wiki k5sqmaww2kc0fw1be27o88ydt7rpivl 2473521 2473519 2026-10-26T20:32:43Z Stashbot 7414 bking@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/matomo-next: apply 2473521 wikitext text/x-wiki bwi9ase2aagjpxuqa0pjnkevhemkfww 2473522 2473521 2026-10-26T20:33:57Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2249-2262].codfw.wmnet 2473522 wikitext text/x-wiki 2up1kn2q35fqbhyj3d1hsj3ni0q054f 2473525 2473522 2026-10-26T20:41:50Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2249-2262].codfw.wmnet 2473525 wikitext text/x-wiki p7pe1sx7si8p0ykyjcxe4mpxciqt0t3 2473526 2473525 2026-10-26T20:41:55Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2249-2262].codfw.wmnet 2473526 wikitext text/x-wiki r1lru5f283yzss39x7pdce4fxb3b385 2473528 2473526 2026-10-26T20:42:23Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2263-2276].codfw.wmnet 2473528 wikitext text/x-wiki fxk5p5jnb5nhuuluif2o5k0jf0n5cl7 2473529 2473528 2026-10-26T20:50:53Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2263-2276].codfw.wmnet 2473529 wikitext text/x-wiki 2x546zjahhbtl3oxc8itd5dhcs54c8p 2473530 2473529 2026-10-26T20:51:51Z Stashbot 7414 brett@cumin2003: END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade of ATS on A:cp-text_ulsfo and not P{cp4037.ulsfo.wmnet} and A:cp - 9.2.16 upgrade (T441945) 2473530 wikitext text/x-wiki glc4156q9nn474m3zpw2g7tjvinlvhj 2473531 2473530 2026-10-26T20:56:47Z Stashbot 7414 brett@cumin2003: START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade of ATS on A:cp-upload_drmrs and A:cp - 9.2.16 upgrade (T441945) 2473531 wikitext text/x-wiki lr1n1ea1heomxfgz8vrxgbiydrzw6tl 2473532 2473531 2026-10-26T20:56:58Z Stashbot 7414 brett@cumin2003: START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade of ATS on A:cp-text_drmrs and A:cp - 9.2.16 upgrade (T441945) 2473532 wikitext text/x-wiki hfzlwi03khxckkkwdi2anljwebuc6he 2473533 2473532 2026-10-26T20:58:09Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2263-2276].codfw.wmnet 2473533 wikitext text/x-wiki gbyaxc1qei1bv43d4q3lhk4ib1fvxyn 2473534 2473533 2026-10-26T20:58:14Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2263-2276].codfw.wmnet 2473534 wikitext text/x-wiki keun7lfzvqbnu4pbv4og4bz9sjgvftw 2473535 2473534 2026-10-26T20:58:43Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2277-2290].codfw.wmnet 2473535 wikitext text/x-wiki n4hucm0pttl03rj7szdy4eyeerg0h5t 2473537 2473535 2026-10-26T21:06:28Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2277-2290].codfw.wmnet 2473537 wikitext text/x-wiki 9fnv6zd01drj0uiiazszvbqlcsmyzuo 2473538 2473537 2026-10-26T21:15:49Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2277-2290].codfw.wmnet 2473538 wikitext text/x-wiki 6989xl4td8c1is26lx35bznt4hs1su9 2473539 2473538 2026-10-26T21:15:54Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2277-2290].codfw.wmnet 2473539 wikitext text/x-wiki bdytk3jidtm4bwhyxa295w4dr49nmvv 2473540 2473539 2026-10-26T21:16:27Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2291-2304].codfw.wmnet 2473540 wikitext text/x-wiki 1cji068id5r706d8tpi99d57h0ds05p 2473541 2473540 2026-10-26T21:23:04Z Stashbot 7414 sbassett: Deployed security fix for T442373 and T441029 to wmf.24 and wmf.1 2473541 wikitext text/x-wiki 7034b3qfo6frwrusxxl6bclc5m4g7lv 2473542 2473541 2026-10-26T21:28:06Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2291-2304].codfw.wmnet 2473542 wikitext text/x-wiki 9lm197byjuyprpkj65p93t23rjx0ltk 2473543 2473542 2026-10-26T21:33:11Z Stashbot 7414 brett@cumin2003: END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade of ATS on A:cp-upload_drmrs and A:cp - 9.2.16 upgrade (T441945) 2473543 wikitext text/x-wiki jpeio01l5u13gry9s4loafvrnh8eg05 2473544 2473543 2026-10-26T21:35:59Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2291-2304].codfw.wmnet 2473544 wikitext text/x-wiki 8ip0gp1nxb2tdh15huyfp2dp6vf1ccl 2473545 2473544 2026-10-26T21:36:04Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2291-2304].codfw.wmnet 2473545 wikitext text/x-wiki pk640i53knuzp8ekg7rjb3jsv8jb6q3 2473546 2473545 2026-10-26T21:36:34Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2305-2318].codfw.wmnet 2473546 wikitext text/x-wiki 7melt78l9fqp958bjw5zljijd2gf809 2473547 2473546 2026-10-26T21:44:50Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2305-2318].codfw.wmnet 2473547 wikitext text/x-wiki aksczrmahjz2vk4jq7ii4ns8pbln24o 2473548 2473547 2026-10-26T21:49:41Z Stashbot 7414 sbassett: Deployed security fix for T442018 to wmf.24 and wmf.1 2473548 wikitext text/x-wiki b2fp1h9xbj8tu7s9x5lklcf4fv52r67 2473549 2473548 2026-10-26T21:52:07Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2305-2318].codfw.wmnet 2473549 wikitext text/x-wiki est6wirtrlui1bl6m96wu2p9c5mpjxn 2473550 2473549 2026-10-26T21:52:11Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2305-2318].codfw.wmnet 2473550 wikitext text/x-wiki 9qdud1lcu0r9pwyl0wd1p8arevni676 2473551 2473550 2026-10-26T21:52:43Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2319-2332].codfw.wmnet 2473551 wikitext text/x-wiki 3lnpst6c25a1ow0w6q9bix28a6522ru 2473552 2473551 2026-10-26T22:00:38Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2319-2332].codfw.wmnet 2473552 wikitext text/x-wiki h03kxs2jeja8el3voyfgkx79x30zl3j 2473553 2473552 2026-10-26T22:02:35Z Stashbot 7414 brett@cumin2003: END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade of ATS on A:cp-text_drmrs and A:cp - 9.2.16 upgrade (T441945) 2473553 wikitext text/x-wiki m4ouurtk9cf42j4hl5ry1b874xu6dny 2473555 2473553 2026-10-26T22:03:18Z Stashbot 7414 brett@cumin2003: START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade of ATS on A:cp-text_esams and A:cp - 9.2.16 upgrade (T441945) 2473555 wikitext text/x-wiki di1xx8syeu1bpatrgmksmi4ch4g87o3 2473556 2473555 2026-10-26T22:03:23Z Stashbot 7414 brett@cumin2003: START - Cookbook sre.cdn.roll-upgrade-ats Rolling upgrade of ATS on A:cp-upload_esams and A:cp - 9.2.16 upgrade (T441945) 2473556 wikitext text/x-wiki szl6yk8isjsrdlbg6gqu1ai1lajat0l 2473557 2473556 2026-10-26T22:07:58Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2319-2332].codfw.wmnet 2473557 wikitext text/x-wiki sdvh1k85skwp0h0vxzzqbkyi0vixpmi 2473558 2473557 2026-10-26T22:08:03Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2319-2332].codfw.wmnet 2473558 wikitext text/x-wiki qj6aosb113ho3d57m11w9fflxm9b257 2473559 2473558 2026-10-26T22:08:32Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2333-2346].codfw.wmnet 2473559 wikitext text/x-wiki 1g23uc5wok100ygszlc48lbn9e5rpbi 2473560 2473559 2026-10-26T22:08:53Z Stashbot 7414 sbassett: Deployed security fix for T440638 to wmf.24 and wmf.1 2473560 wikitext text/x-wiki 9mnlrjfs6zitaoj5zoxg70weqty67i1 2473562 2473560 2026-10-26T22:16:33Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2333-2346].codfw.wmnet 2473562 wikitext text/x-wiki 4taqmli8nudojja6yy9ldb26zh83qq1 2473563 2473562 2026-10-26T22:24:23Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2333-2346].codfw.wmnet 2473563 wikitext text/x-wiki b9m5kop67qku74lxkz9sig5r7wthtzo 2473564 2473563 2026-10-26T22:24:27Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2333-2346].codfw.wmnet 2473564 wikitext text/x-wiki 2svawogw30tzt0thf9m83tbs6ht0f4l 2473565 2473564 2026-10-26T22:24:58Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2347-2360].codfw.wmnet 2473565 wikitext text/x-wiki j3f5xjh7w4cxnetlmewz6bdjzjcziic 2473566 2473565 2026-10-26T22:38:05Z Stashbot 7414 brett@cumin2003: END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade of ATS on A:cp-upload_esams and A:cp - 9.2.16 upgrade (T441945) 2473566 wikitext text/x-wiki 1msemuo6qnawuhubkydtxaevtitu1kt 2473567 2473566 2026-10-26T22:38:29Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2347-2360].codfw.wmnet 2473567 wikitext text/x-wiki qnxawmw2xhwylga1r2000jzaj8h75wr 2473568 2473567 2026-10-26T22:45:41Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2347-2360].codfw.wmnet 2473568 wikitext text/x-wiki rhevuou9n63s1z00yy5hr9bylcvkjih 2473569 2473568 2026-10-26T22:45:46Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2347-2360].codfw.wmnet 2473569 wikitext text/x-wiki 49w6ingox898okrbng795pqddtgcx42 2473570 2473569 2026-10-26T22:46:17Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2361-2374].codfw.wmnet 2473570 wikitext text/x-wiki rfiqbx92s885xglz26h5i7nuc73wot2 2473571 2473570 2026-10-26T22:54:18Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2361-2374].codfw.wmnet 2473571 wikitext text/x-wiki ebp4szpnjxsa1ick7gf8ecn0ojh2y3j 2473572 2473571 2026-10-26T23:01:23Z Stashbot 7414 sbassett: Deployed security fixes for T440493 and T441721 to wmf.24 and wmf.1 2473572 wikitext text/x-wiki 56ob86ujwerpzog6efflr7yjjgx4yii 2473573 2473572 2026-10-26T23:01:33Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2361-2374].codfw.wmnet 2473573 wikitext text/x-wiki c953593rlqdjkuqtiti83q0z99bs1fv 2473574 2473573 2026-10-26T23:01:37Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2361-2374].codfw.wmnet 2473574 wikitext text/x-wiki 9z86pztwr5dr46k5vqgcqtp91xnzaux 2473575 2473574 2026-10-26T23:01:42Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker-exp2001.codfw.wmnet 2473575 wikitext text/x-wiki fqon2f28dwriyeaev9p6agu7g3vt2yv 2473576 2473575 2026-10-26T23:02:14Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker-exp2001.codfw.wmnet 2473576 wikitext text/x-wiki sa2mrpoc2bfx2o7xg5k1vwwdfdu5ui1 2473577 2473576 2026-10-26T23:03:39Z Stashbot 7414 brett@cumin2003: END (PASS) - Cookbook sre.cdn.roll-upgrade-ats (exit_code=0) Rolling upgrade of ATS on A:cp-text_esams and A:cp - 9.2.16 upgrade (T441945) 2473577 wikitext text/x-wiki o1q3usol1ux61xnidr19akvceyd8ndk 2473578 2473577 2026-10-26T23:04:29Z Stashbot 7414 jdlrobson@deploy1003: Started scap sync-world: Backport for ReadingList: Fix instrument for clicking on overflow icon (T441477) ([[gerrit:1358885|1.47.0-wmf.24]], [[gerrit:1358886|1.48.0-wmf.1]]), Fix recentlyDonated captures non-donors (T441244) ([[gerrit:1358847|1.48.0-wmf.1]], [[gerrit:1358846|1.47.0-wmf.24]]), Update account creation instrumentation mechanism (T429288) ([[gerrit:1358787|1.48.0-wmf.1]], [[gerrit:13 2473578 wikitext text/x-wiki i5tv24q70hbm9wsd3pknemwrzxysc8j 2473579 2473578 2026-10-26T23:06:07Z Stashbot 7414 jasmine@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker-exp2001.codfw.wmnet 2473579 wikitext text/x-wiki cmipqhrqavkspx5rqrbdoraut0060no 2473580 2473579 2026-10-26T23:06:10Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker-exp2001.codfw.wmnet 2473580 wikitext text/x-wiki mn6ieeg280v8kmitlh1mrb57rq0g2y4 2473581 2473580 2026-10-26T23:06:11Z Stashbot 7414 jasmine@cumin2003: END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on A:wikikube-worker-codfw 2473581 wikitext text/x-wiki 6p2h3aot9hbgctbcrtu6dpjwjj227l8 2473584 2473581 2026-10-26T23:09:38Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Backport for ReadingList: Fix instrument for clicking on overflow icon (T441477) ([[gerrit:1358885|1.47.0-wmf.24]], [[gerrit:1358886|1.48.0-wmf.1]]), Fix recentlyDonated captures non-donors (T441244) ([[gerrit:1358847|1.48.0-wmf.1]], [[gerrit:1358846|1.47.0-wmf.24]]), Update account creation instrumentation mechanism (T429288) ([[gerrit:1358787|1.48.0-wmf.1]], [[gerrit:1358786|1.47.0-w 2473584 wikitext text/x-wiki 1u4irdi02ox2gcg30jl0qyupse8ifyr 2473587 2473584 2026-10-26T23:13:37Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Continuing with deployment 2473587 wikitext text/x-wiki jy5cz6blhxnszjdvsw3mitrd0sew376 2473588 2473587 2026-10-26T23:21:22Z Stashbot 7414 jdlrobson@deploy1003: Finished scap sync-world: Backport for ReadingList: Fix instrument for clicking on overflow icon (T441477) ([[gerrit:1358885|1.47.0-wmf.24]], [[gerrit:1358886|1.48.0-wmf.1]]), Fix recentlyDonated captures non-donors (T441244) ([[gerrit:1358847|1.48.0-wmf.1]], [[gerrit:1358846|1.47.0-wmf.24]]), Update account creation instrumentation mechanism (T429288) ([[gerrit:1358787|1.48.0-wmf.1]], [[gerrit:1 2473588 wikitext text/x-wiki rldep6ydbcy4tap0vjvjn9q9c4v38ao 2473592 2473588 2026-10-27T00:00:09Z Stashbot 7414 root@deploy1003: helmfile [staging] START helmfile.d/services/shellbox: sync 2473592 wikitext text/x-wiki 45c415q72w8r116aaleueppj4bi7ulk 2473593 2473592 2026-10-27T00:00:16Z Stashbot 7414 root@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox: sync 2473593 wikitext text/x-wiki cvx0as4p2utqpfwhmzu7p5lrhanvbxt 2473665 2473593 2026-10-27T05:19:21Z Stashbot 7414 tchin@deploy1003: helmfile [eqiad] START helmfile.d/services/eventstreams: apply 2473665 wikitext text/x-wiki r98oomqidcyo3n38bb5evbgrvyl0syr 2473666 2473665 2026-10-27T05:19:31Z Stashbot 7414 tchin@deploy1003: helmfile [eqiad] DONE helmfile.d/services/eventstreams: apply 2473666 wikitext text/x-wiki ps9rfisxd6pxtrxg377bxnanamw6o91 2473681 2473666 2026-10-27T06:18:02Z Stashbot 7414 godog: silence ATSBackendErrorsHigh eventstreams.discovery.wmnet drmrs page for 12h - T442462 2473681 wikitext text/x-wiki m6120nkb1zuu77kp4xx85bzksww9upg 2473682 2473681 2026-10-27T06:29:16Z Stashbot 7414 hashar@deploy1003: Started deploy [gerrit/gerrit@38dd63c]: Disable banner about emergency maintenance 2473682 wikitext text/x-wiki k4bco0y9uqozc37tjss0jjgs5zd28f5 2473683 2473682 2026-10-27T06:29:30Z Stashbot 7414 hashar@deploy1003: Finished deploy [gerrit/gerrit@38dd63c]: Disable banner about emergency maintenance (duration: 00m 14s) 2473683 wikitext text/x-wiki d2tozzn211m3cm4qoodkkqj34r4y0su 2473684 2473683 2026-10-27T06:35:49Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section x4 2473684 wikitext text/x-wiki gbi3gz5kiqzr2lr8p5x0ldrvybtgu68 2473685 2473684 2026-10-27T06:37:19Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section x4 2473685 wikitext text/x-wiki qjwyav1thwkthtq6s0iheef92wf1ao0 2473689 2473685 2026-10-27T06:49:44Z Stashbot 7414 godog: add 5xx responses as a % of total traffic to https://grafana.wikimedia.org/d/1T_4O08Wk/ats-backends-3c-3e-origin-servers-overview - T400675 2473689 wikitext text/x-wiki 8d3d6j5s44285uokv4aubprc5vjgpfr 2473690 2473689 2026-10-27T07:07:54Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section es6 2473690 wikitext text/x-wiki i5jahz3tvvc3uw0vb8gnbpyjzr9ks9c 2473691 2473690 2026-10-27T07:09:02Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section es6 2473691 wikitext text/x-wiki gqbf7u4pvst3hqoxg74kaho3thfhc1a 2473692 2473691 2026-10-27T07:09:18Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section es7 2473692 wikitext text/x-wiki 7zp4trcvpbrgmt08tnnbyc8siiphldy 2473693 2473692 2026-10-27T07:10:14Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section es7 2473693 wikitext text/x-wiki n8zi9ettgamg3bd2pgd93i5yyskeasg 2473694 2473693 2026-10-27T07:17:04Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section s6 2473694 wikitext text/x-wiki oazy2ezvzq3y6t7ca7d0e0yh83yj3cm 2473695 2473694 2026-10-27T07:18:31Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section s6 2473695 wikitext text/x-wiki ttcnyfep2vfdm1uq7vumupcizumc92o 2473696 2473695 2026-10-27T07:23:34Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section s5 2473696 wikitext text/x-wiki mi0i9xob7jbp088jg2y2axxabf8apcr 2473697 2473696 2026-10-27T07:23:37Z Stashbot 7414 marostegui@cumin1004: END (FAIL) - Cookbook sre.switchdc.databases.prepare (exit_code=93) for the switch from eqiad to codfw for section s5 2473697 wikitext text/x-wiki 9uaubboqzgh23wfk6y22vpzecfvq3li 2473698 2473697 2026-10-27T07:23:45Z Stashbot 7414 slyngshede@cumin1004: START - Cookbook sre.cdn.roll-reboot rolling reboot on P{cp2049*} OR P{cp2051*} OR P{cp2053*} OR P{cp2055*} OR P{cp2057*} OR P{cp2059*} and A:cp 2473698 wikitext text/x-wiki thnwow0kotom9tavmfyo72n5s6la746 2473699 2473698 2026-10-27T07:23:54Z Stashbot 7414 slyngshede@cumin1004: END (ERROR) - Cookbook sre.cdn.roll-reboot (exit_code=97) rolling reboot on P{cp2049*} OR P{cp2051*} OR P{cp2053*} OR P{cp2055*} OR P{cp2057*} OR P{cp2059*} and A:cp 2473699 wikitext text/x-wiki kc6fyywue2cpnhs9wyf7o0rjy4wze1o 2473700 2473699 2026-10-27T07:24:13Z Stashbot 7414 slyngshede@cumin1004: START - Cookbook sre.cdn.roll-reboot rolling reboot on P{cp2049*} OR P{cp2051*} OR P{cp2053*} OR P{cp2055*} OR P{cp2057*} OR P{cp2059*} and A:cp 2473700 wikitext text/x-wiki pis10ip3ptt9r863kk53hlrat19g1e1 2473701 2473700 2026-10-27T07:24:36Z Stashbot 7414 slyngshede@cumin1004: START - Cookbook sre.cdn.roll-reboot rolling reboot on P{cp2056*} OR P{cp2058*} and A:cp 2473701 wikitext text/x-wiki oertw10lx7wlcpinngpx3dsx0rissqv 2473702 2473701 2026-10-27T07:24:58Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section s5 2473702 wikitext text/x-wiki eewilluhaiu7o00kcysd94y3ndve3xq 2473703 2473702 2026-10-27T07:26:19Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section s5 2473703 wikitext text/x-wiki g39c5gmluitm9x2w4pzvf0eh981ptnq 2473704 2473703 2026-10-27T07:32:48Z Stashbot 7414 slyngshede@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp2049.codfw.wmnet 2473704 wikitext text/x-wiki 29d54eschhastvao5p6b6qs6hn69w4q 2473705 2473704 2026-10-27T07:35:21Z Stashbot 7414 slyngshede@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp2056.codfw.wmnet 2473705 wikitext text/x-wiki m4xrsqi376w2u2odzkq6y0e3vtxlp70 2473706 2473705 2026-10-27T07:37:25Z Stashbot 7414 arthurtaylor@deploy1003: helmfile [staging] START helmfile.d/services/wikidata-query-gui: apply 2473706 wikitext text/x-wiki mfwmnuhy6snxlb0971ztp0pdmsa38q3 2473707 2473706 2026-10-27T07:37:54Z Stashbot 7414 arthurtaylor@deploy1003: helmfile [staging] DONE helmfile.d/services/wikidata-query-gui: apply 2473707 wikitext text/x-wiki ji6jphrcsx27xts9gj0lnoq4z79c6us 2473708 2473707 2026-10-27T07:38:02Z Stashbot 7414 arthurtaylor@deploy1003: helmfile [codfw] START helmfile.d/services/wikidata-query-gui: apply 2473708 wikitext text/x-wiki bmxmwad25zdhslijjkatas0cb7pt17c 2473709 2473708 2026-10-27T07:38:24Z Stashbot 7414 arthurtaylor@deploy1003: helmfile [codfw] DONE helmfile.d/services/wikidata-query-gui: apply 2473709 wikitext text/x-wiki fxwjyuf1uuij4qz87wmxxzyzgc8pit2 2473710 2473709 2026-10-27T07:38:31Z Stashbot 7414 arthurtaylor@deploy1003: helmfile [eqiad] START helmfile.d/services/wikidata-query-gui: apply 2473710 wikitext text/x-wiki 20gfkdzam9li29wh50pyc4eopa342es 2473711 2473710 2026-10-27T07:38:53Z Stashbot 7414 arthurtaylor@deploy1003: helmfile [eqiad] DONE helmfile.d/services/wikidata-query-gui: apply 2473711 wikitext text/x-wiki r5vj8y91og4npachh48vip273tiswyi 2473712 2473711 2026-10-27T07:50:24Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section s2 2473712 wikitext text/x-wiki pcy85hy5ifxvc2g91onp1i78xz0vuhu 2473713 2473712 2026-10-27T07:52:10Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section s2 2473713 wikitext text/x-wiki jjm52wcb1fhcy748zxb6gvrqp79yzrm 2473714 2473713 2026-10-27T08:02:30Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section s3 2473714 wikitext text/x-wiki bdjhh7c0aj055pr4ekwriuczbu1h3x5 2473715 2473714 2026-10-27T08:03:57Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section s3 2473715 wikitext text/x-wiki stnpi4a8t15sirda1lh9uvvwwl8yz3o 2473716 2473715 2026-10-27T08:04:20Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section s7 2473716 wikitext text/x-wiki qe6c9lfcdohgtawrp7s0m45keeud1lr 2473717 2473716 2026-10-27T08:05:52Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.reimage for host ml-serve1016.eqiad.wmnet with OS trixie 2473717 wikitext text/x-wiki qvpcfh0vbelv6021aud7qaetaqzuwod 2473718 2473717 2026-10-27T08:05:58Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section s7 2473718 wikitext text/x-wiki axqmi0fdn4lukfhtknkqb5nvw0ukrr1 2473719 2473718 2026-10-27T08:06:00Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.dhcp for host ml-serve1016.eqiad.wmnet (push config only) 2473719 wikitext text/x-wiki lzkwdu8j6g0bw1bifvf1e3rdlclex7r 2473720 2473719 2026-10-27T08:06:04Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host ml-serve1016.eqiad.wmnet (push config only) 2473720 wikitext text/x-wiki 9b13nbahnw8ucs6culzzfycpkdfjyp1 2473721 2473720 2026-10-27T08:06:28Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section s8 2473721 wikitext text/x-wiki b9vm1xd0r94jm67n9iwbb2sfquuig63 2473722 2473721 2026-10-27T08:07:52Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section s8 2473722 wikitext text/x-wiki spha66dve1qj4gghghq6ypxf3ztgs7y 2473723 2473722 2026-10-27T08:08:06Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section s4 2473723 wikitext text/x-wiki 8gwv80o8yogcmlwskzp0yka1k82y5dd 2473724 2473723 2026-10-27T08:08:32Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1027.eqiad.wmnet 2473724 wikitext text/x-wiki fbt1rgei0qtx3rll9v9nrep50w2j8zh 2473725 2473724 2026-10-27T08:09:05Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2025.codfw.wmnet 2473725 wikitext text/x-wiki dbm4coggaackgl7k2u5hopa6gsuetgd 2473726 2473725 2026-10-27T08:09:33Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['sretest2006'] 2473726 wikitext text/x-wiki 25lj0o5owsmyca9z9z5j7cpbgta28c6 2473727 2473726 2026-10-27T08:09:35Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section s4 2473727 wikitext text/x-wiki h0avo8qeqa0m4htr0a9cux0xtph0z7k 2473728 2473727 2026-10-27T08:09:39Z Stashbot 7414 elukey@cumin1004: END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['sretest2006'] 2473728 wikitext text/x-wiki g1rjghbkkx5ijyxjou8bwk9xufffdes 2473729 2473728 2026-10-27T08:10:30Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['sretest2006'] 2473729 wikitext text/x-wiki 5q4qv7yd81mzbug8im3shlmez0xk8d3 2473730 2473729 2026-10-27T08:11:35Z Stashbot 7414 slyngshede@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp2051.codfw.wmnet 2473730 wikitext text/x-wiki 9s5wfxhtqctt5l5uctptxn47qvnnrma 2473731 2473730 2026-10-27T08:13:21Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti1027.eqiad.wmnet 2473731 wikitext text/x-wiki d578bc7fgfnirho998b6bducue9v4cy 2473732 2473731 2026-10-27T08:13:25Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section s1 2473732 wikitext text/x-wiki ejpz7w4c362spqk5o6unzg778moi0zg 2473733 2473732 2026-10-27T08:13:54Z Stashbot 7414 slyngshede@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp2058.codfw.wmnet 2473733 wikitext text/x-wiki 6675zfv7hos5wv8729ww331pn8b0xnw 2473734 2473733 2026-10-27T08:13:57Z Stashbot 7414 slyngshede@cumin1004: END (PASS) - Cookbook sre.cdn.roll-reboot (exit_code=0) rolling reboot on P{cp2056*} OR P{cp2058*} and A:cp 2473734 wikitext text/x-wiki 85l2xgd5agh2z6x3j2p7x1hph8m0574 2473735 2473734 2026-10-27T08:15:01Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section s1 2473735 wikitext text/x-wiki dyhrxhcxl7yksuvftf3dwaen15ifar5 2473736 2473735 2026-10-27T08:15:36Z Stashbot 7414 marostegui: Enabled database circular replication https://phabricator.wikimedia.org/T439063 2473736 wikitext text/x-wiki rndxjw724dbzizoowmo8p1t3h89p0u2 2473737 2473736 2026-10-27T08:19:24Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1027.eqiad.wmnet 2473737 wikitext text/x-wiki kijhwgr90yum2vevaf5sqf9rqa946uw 2473738 2473737 2026-10-27T08:19:56Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1027.eqiad.wmnet 2473738 wikitext text/x-wiki eneub6c6nmyzoxxcot4zjh2ccodnfgd 2473739 2473738 2026-10-27T08:20:15Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1028.eqiad.wmnet 2473739 wikitext text/x-wiki b0jaszq8j3c9j8bzo23v0d0yx1kpn4i 2473740 2473739 2026-10-27T08:20:31Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti2025.codfw.wmnet 2473740 wikitext text/x-wiki 1lwvfx40sx29v0ttc0vwt9qmn53u0dg 2473742 2473740 2026-10-27T08:26:29Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2025.codfw.wmnet 2473742 wikitext text/x-wiki g1904sno9q3nj4cmzzr7686ut5djfvg 2473743 2473742 2026-10-27T08:26:36Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2025.codfw.wmnet 2473743 wikitext text/x-wiki j7dwl9x74q3ek9akmhvlbs8fp9t88lm 2473744 2473743 2026-10-27T08:28:42Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2026.codfw.wmnet 2473744 wikitext text/x-wiki k4rusx78yk9k58cwcew4x45malfklve 2473745 2473744 2026-10-27T08:28:47Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti1028.eqiad.wmnet 2473745 wikitext text/x-wiki 1hsrnsnjh6dwrgu5i90v1ccem9ynjtn 2473746 2473745 2026-10-27T08:29:44Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.dhcp for host ml-serve1016.eqiad.wmnet (remove config only) 2473746 wikitext text/x-wiki c7njbr4i7e30sqy6zgupfx6f2af9m5r 2473747 2473746 2026-10-27T08:29:48Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host ml-serve1016.eqiad.wmnet (remove config only) 2473747 wikitext text/x-wiki hcjzlt44u8yhqsrj0kfa35inpfuw471 2473748 2473747 2026-10-27T08:29:50Z Stashbot 7414 elukey@cumin1004: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host ml-serve1016.eqiad.wmnet with OS trixie 2473748 wikitext text/x-wiki 8qoxqb0e3ruirtucy1sjb102kv8aja9 2473749 2473748 2026-10-27T08:32:44Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.hosts.reimage for host lvs4010.ulsfo.wmnet with OS trixie 2473749 wikitext text/x-wiki huobkez655k0b8dikssxd9w6ky2nf8f 2473750 2473749 2026-10-27T08:33:40Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.hosts.dhcp for host lvs4010.ulsfo.wmnet (push config only) 2473750 wikitext text/x-wiki 7tbmqtnkldn137rdzlb9i9zmc9c35zv 2473751 2473750 2026-10-27T08:33:45Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host lvs4010.ulsfo.wmnet (push config only) 2473751 wikitext text/x-wiki 9j37opu88xqqvzb951iyhub6s5jl9fp 2473752 2473751 2026-10-27T08:34:49Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1028.eqiad.wmnet 2473752 wikitext text/x-wiki j4p1dtnnm8b35gr8h66opk8ydmtttbo 2473753 2473752 2026-10-27T08:35:26Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1028.eqiad.wmnet 2473753 wikitext text/x-wiki 74ncdhz6vuwwciyccpp0medogr831vi 2473754 2473753 2026-10-27T08:35:30Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti2026.codfw.wmnet 2473754 wikitext text/x-wiki evmv9so11oyowthgp4tfeye4gu1c0og 2473755 2473754 2026-10-27T08:35:40Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1037.eqiad.wmnet 2473755 wikitext text/x-wiki mkpbxdurifibhtg10qa6ouqmbmbwckv 2473756 2473755 2026-10-27T08:35:54Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.powercycle for host ml-serve1016 2473756 wikitext text/x-wiki hci9vy90pops2j9ey50copb4ttiew9r 2473757 2473756 2026-10-27T08:37:56Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti1037.eqiad.wmnet 2473757 wikitext text/x-wiki ffh6jip5qttp8b00pgussdgtr5kxf4h 2473758 2473757 2026-10-27T08:39:51Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2026.codfw.wmnet 2473758 wikitext text/x-wiki 5c537z48yamudegfplro8cvl85f90jh 2473759 2473758 2026-10-27T08:40:25Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2026.codfw.wmnet 2473759 wikitext text/x-wiki 3awdouqu2i2yfwxd2ar2opxvshauxbz 2473760 2473759 2026-10-27T08:40:44Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2041.codfw.wmnet 2473760 wikitext text/x-wiki cxcbs07c90u73padt209gqp0zbmtodu 2473761 2473760 2026-10-27T08:40:58Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.powercycle (exit_code=0) for host ml-serve1016 2473761 wikitext text/x-wiki t0g0zpa8cudmdf7z8woeifmgi75315i 2473762 2473761 2026-10-27T08:43:54Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['sretest2006'] 2473762 wikitext text/x-wiki d7vyvkdmmwxgpz1bh09tg1joxf3man7 2473763 2473762 2026-10-27T08:45:43Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1037.eqiad.wmnet 2473763 wikitext text/x-wiki pjznayknlpzacta6flasv3h5wycqfzr 2473764 2473763 2026-10-27T08:45:50Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1037.eqiad.wmnet 2473764 wikitext text/x-wiki 9u8mqimvbdirg7f9w785n75wghuir83 2473765 2473764 2026-10-27T08:46:10Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti2041.codfw.wmnet 2473765 wikitext text/x-wiki 2xzc9m0l9vgmu11k8a7zf86rglyh6gw 2473766 2473765 2026-10-27T08:46:28Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.hosts.dhcp for host lvs4010.ulsfo.wmnet (remove config only) 2473766 wikitext text/x-wiki ef8qdzqccettpd98z54q6r51alla7q4 2473767 2473766 2026-10-27T08:46:35Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host lvs4010.ulsfo.wmnet (remove config only) 2473767 wikitext text/x-wiki ofy99n8t6o5umnlnvpplta5q3lyjrll 2473768 2473767 2026-10-27T08:48:02Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1045.eqiad.wmnet 2473768 wikitext text/x-wiki iy2q7dwbo3kn7cravtlydn9jop3pv77 2473769 2473768 2026-10-27T08:48:11Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.provision for host sretest2006.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2473769 wikitext text/x-wiki 8m59ljyujwlbgyuk8vg6fo431e0rj87 2473770 2473769 2026-10-27T08:49:17Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on lvs4010.ulsfo.wmnet with reason: host reimage 2473770 wikitext text/x-wiki f0zapu8iokxpfowfon8i66y9jusumug 2473771 2473770 2026-10-27T08:49:59Z Stashbot 7414 hashar@deploy1003: Started scap sync-world: Backport for [[gerrit:1358880|Allow those with CheckUser right to view private filters on WMF projects (T442464)]] 2473771 wikitext text/x-wiki 926xdb5u5siys8s16oucuwojncb49wi 2473772 2473771 2026-10-27T08:50:05Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.powercycle for host ml-serve1016 2473772 wikitext text/x-wiki es9x5uhqjj0e46bujc1ow984kjimsa3 2473773 2473772 2026-10-27T08:50:28Z Stashbot 7414 slyngshede@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp2053.codfw.wmnet 2473773 wikitext text/x-wiki i74bya9m7rgs98usooopt37sc65iag5 2473774 2473773 2026-10-27T08:51:30Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2041.codfw.wmnet 2473774 wikitext text/x-wiki sokq5buwse0k69emo6gmkh31bmcjchw 2473775 2473774 2026-10-27T08:51:37Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2041.codfw.wmnet 2473775 wikitext text/x-wiki i9d34yzj5pclzqqubge84baltymoefr 2473779 2473775 2026-10-27T08:54:22Z Stashbot 7414 hashar@deploy1003: neriah, hashar: Backport for [[gerrit:1358880|Allow those with CheckUser right to view private filters on WMF projects (T442464)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2473779 wikitext text/x-wiki 4z2y3rlmi8d6vz68hvjfg37r7c7uamm 2473780 2473779 2026-10-27T08:54:28Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on lvs4010.ulsfo.wmnet with reason: host reimage 2473780 wikitext text/x-wiki 7xzyzs5ursw0p9lt190umz86mv5u0zb 2473781 2473780 2026-10-27T08:55:08Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.powercycle (exit_code=0) for host ml-serve1016 2473781 wikitext text/x-wiki lfe8qf7js7v46vx8eqwmlc87sv4q4lv 2473782 2473781 2026-10-27T08:58:07Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2006.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2473782 wikitext text/x-wiki oirujtne6arosrpd32brbxi8tpss4q9 2473783 2473782 2026-10-27T08:59:19Z Stashbot 7414 hashar@deploy1003: neriah, hashar: Continuing with deployment 2473783 wikitext text/x-wiki c8q1tfb9xtszos1vow3wf93sc8h6g4y 2473784 2473783 2026-10-27T08:59:26Z Stashbot 7414 fabfur@cumin1004: START - Cookbook sre.cdn.roll-reboot rolling reboot on A:cp-upload_esams 2473784 wikitext text/x-wiki r36mzk9q3dj0jz39wjuh799xjdi7i05 2473785 2473784 2026-10-27T09:02:29Z Stashbot 7414 moritzm: imported routinator 0.15.3 to thirdparty/routinator 2473785 wikitext text/x-wiki hmhl0o870i308kg01ts2u5tewmjk6k0 2473786 2473785 2026-10-27T09:02:51Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2042.codfw.wmnet 2473786 wikitext text/x-wiki nma1l71n4ffldscrfvbc4g331vs4dxl 2473787 2473786 2026-10-27T09:02:58Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti1045.eqiad.wmnet 2473787 wikitext text/x-wiki p5pyrld8phrbi0lniudn6m1v453kw5n 2473789 2473787 2026-10-27T09:04:48Z Stashbot 7414 moritzm: upgrade rpki2003 to routinator 0.15.3 2473789 wikitext text/x-wiki j0pe8ev3dxgrrwu4w604s5r0l1q6i24 2473790 2473789 2026-10-27T09:05:01Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.reimage for host sretest2006.codfw.wmnet with OS trixie 2473790 wikitext text/x-wiki buftb3ox7wqo2ayx1x193lchyr8wwr8 2473791 2473790 2026-10-27T09:05:09Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest2006.codfw.wmnet (push config only) 2473791 wikitext text/x-wiki 6npl8mazpskiehqca06oyytc5wcf52h 2473792 2473791 2026-10-27T09:05:13Z Stashbot 7414 hashar@deploy1003: Finished scap sync-world: Backport for [[gerrit:1358880|Allow those with CheckUser right to view private filters on WMF projects (T442464)]] (duration: 15m 12s) 2473792 wikitext text/x-wiki p26pv0qvi5od0iahpi7ivfkm89lv57v 2473793 2473792 2026-10-27T09:05:17Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest2006.codfw.wmnet (push config only) 2473793 wikitext text/x-wiki lc43qdqaa7efsgrhosip3uvi56k5xnn 2473794 2473793 2026-10-27T09:07:37Z Stashbot 7414 tappof: bump space for prometheus k8s-(dse|aux|ml-serve) in eqiad 2473794 wikitext text/x-wiki 4nfe8bsw2pjyyrkfyrzjze4gmhrgft6 2473796 2473794 2026-10-27T09:08:18Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1045.eqiad.wmnet 2473796 wikitext text/x-wiki n0pe6brevz39j23iewv9cpeqjk8jxjx 2473797 2473796 2026-10-27T09:08:25Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1045.eqiad.wmnet 2473797 wikitext text/x-wiki bt17lc6vzvi59xts16c6su633368kdz 2473798 2473797 2026-10-27T09:11:25Z Stashbot 7414 fabfur@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp3076.esams.wmnet 2473798 wikitext text/x-wiki sntaiyb15strqf4hyae98yg073txcfx 2473800 2473798 2026-10-27T09:15:17Z Stashbot 7414 elukey@cumin1004: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest2006.codfw.wmnet with OS trixie 2473800 wikitext text/x-wiki 7eyl2ftvf56ay0722vni2ki5rtqaxwv 2473801 2473800 2026-10-27T09:15:19Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host lvs4010.ulsfo.wmnet with OS trixie 2473801 wikitext text/x-wiki 97agypnxj44119s83dv6faturspsngl 2473802 2473801 2026-10-27T09:16:44Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.reimage for host sretest2006.codfw.wmnet with OS trixie 2473802 wikitext text/x-wiki ncqzkwy2utjpbwge8mig6ms2w43nd8w 2473803 2473802 2026-10-27T09:16:53Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest2006.codfw.wmnet (push config only) 2473803 wikitext text/x-wiki 5bjv56yxzs2ostz6llew1x7m5jd6z8u 2473804 2473803 2026-10-27T09:16:57Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest2006.codfw.wmnet (push config only) 2473804 wikitext text/x-wiki 4njxg7k3iv7ufzdsqf7zdrv076ctxlu 2473805 2473804 2026-10-27T09:17:25Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.reimage for host ml-serve1016.eqiad.wmnet with OS trixie 2473805 wikitext text/x-wiki qpj0r9jkn2z27a1kwnodbjixw55wdsq 2473806 2473805 2026-10-27T09:17:33Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.dhcp for host ml-serve1016.eqiad.wmnet (push config only) 2473806 wikitext text/x-wiki j9uh4ajby4jgw8v2a6fngayfvvyph8d 2473807 2473806 2026-10-27T09:17:37Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host ml-serve1016.eqiad.wmnet (push config only) 2473807 wikitext text/x-wiki 4x2s1u0ouh5p5psvt2zj93ivny5vo0p 2473809 2473807 2026-10-27T09:18:38Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti2042.codfw.wmnet 2473809 wikitext text/x-wiki 0698qhxoa41uy11u283zj6kw28wb4wd 2473810 2473809 2026-10-27T09:18:52Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1047.eqiad.wmnet 2473810 wikitext text/x-wiki bjweasbfvmzag6ujlqjfzaec0ajw07b 2473812 2473810 2026-10-27T09:23:58Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2042.codfw.wmnet 2473812 wikitext text/x-wiki p3w9m3vc5m92uvz8tj6toiez5zr9si2 2473813 2473812 2026-10-27T09:24:27Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2042.codfw.wmnet 2473813 wikitext text/x-wiki jqrqithhq59jw4d299u3130ujjvdznn 2473814 2473813 2026-10-27T09:24:35Z Stashbot 7414 moritzm: installing ca-certificates updates for trixie 2473814 wikitext text/x-wiki 22doa99d37jzjqqo3w6y22au90ux9dn 2473815 2473814 2026-10-27T09:25:04Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2043.codfw.wmnet 2473815 wikitext text/x-wiki opnuvm8ucg49ud8a6u59iaql56n03x1 2473817 2473815 2026-10-27T09:27:09Z Stashbot 7414 elukey@cumin1004: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest2006.codfw.wmnet with OS trixie 2473817 wikitext text/x-wiki c0z76iqcbqluad2jh1gvw1glmru5y1h 2473819 2473817 2026-10-27T09:29:19Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti1047.eqiad.wmnet 2473819 wikitext text/x-wiki jw5zxwvujt9s8ol30c3dg1vwk1pyuba 2473820 2473819 2026-10-27T09:29:23Z Stashbot 7414 slyngshede@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp2055.codfw.wmnet 2473820 wikitext text/x-wiki mr6bto777q7jfv4c5w1egdhgaihbb0p 2473822 2473820 2026-10-27T09:34:51Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1047.eqiad.wmnet 2473822 wikitext text/x-wiki qur8yxi4u39ndk59k3rny8popfcdd95 2473823 2473822 2026-10-27T09:35:27Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1047.eqiad.wmnet 2473823 wikitext text/x-wiki 2ulrsujdaqbq7yfu3jnu0hifjamacif 2473824 2473823 2026-10-27T09:36:43Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.dhcp for host ml-serve1016.eqiad.wmnet (remove config only) 2473824 wikitext text/x-wiki cok3vwn5ya8h4g2o9pvf51oj07rkoq5 2473825 2473824 2026-10-27T09:36:47Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host ml-serve1016.eqiad.wmnet (remove config only) 2473825 wikitext text/x-wiki 40yu3r3608bgpxgonfbrqenwlutrpre 2473826 2473825 2026-10-27T09:36:50Z Stashbot 7414 elukey@cumin1004: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host ml-serve1016.eqiad.wmnet with OS trixie 2473826 wikitext text/x-wiki habxwzaz6ri4inmr7lccdro4pdcd3pa 2473827 2473826 2026-10-27T09:37:40Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.reimage for host sretest2006.codfw.wmnet with OS trixie 2473827 wikitext text/x-wiki 2pblrv7dwusyiguki88yg042qjwgoto 2473828 2473827 2026-10-27T09:37:48Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest2006.codfw.wmnet (push config only) 2473828 wikitext text/x-wiki 7pu39bfnyepotb6e97ubavpudxopc50 2473829 2473828 2026-10-27T09:37:52Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest2006.codfw.wmnet (push config only) 2473829 wikitext text/x-wiki 5ycbmu46jmdzd8wu1jgxp5okxvmxz0y 2473831 2473829 2026-10-27T09:39:36Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti2043.codfw.wmnet 2473831 wikitext text/x-wiki nnhj0t95jh9ro9gbvlnd8d65qwc1vq0 2473832 2473831 2026-10-27T09:39:45Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1048.eqiad.wmnet 2473832 wikitext text/x-wiki d8vzd3s57zkuvuxiy6revb2vkrco561 2473833 2473832 2026-10-27T09:39:57Z Stashbot 7414 elukey@cumin1004: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest2006.codfw.wmnet with OS trixie 2473833 wikitext text/x-wiki q37h8ucqiryfkt68e2j2jnd3tprsb32 2473835 2473833 2026-10-27T09:41:38Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.reimage for host sretest2006.codfw.wmnet with OS trixie 2473835 wikitext text/x-wiki dpyb554mt4bchj1bm9s7kqvzhx2qgv4 2473836 2473835 2026-10-27T09:41:47Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest2006.codfw.wmnet (push config only) 2473836 wikitext text/x-wiki f7t4gnnb7wswzm3pr512gx6oqo5hty7 2473837 2473836 2026-10-27T09:41:51Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest2006.codfw.wmnet (push config only) 2473837 wikitext text/x-wiki m34g1hq2ohh6zrkbz3v9771lsnpo097 2473839 2473837 2026-10-27T09:45:18Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2043.codfw.wmnet 2473839 wikitext text/x-wiki khsii85kkearfzk0gzp29yrv9x9ulh3 2473840 2473839 2026-10-27T09:45:37Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2043.codfw.wmnet 2473840 wikitext text/x-wiki 2qwiy0p530b2vy9b6p217buefa929qq 2473841 2473840 2026-10-27T09:46:06Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2044.codfw.wmnet 2473841 wikitext text/x-wiki bok3ohbrsbrtkfwh25jof7rhszkb56l 2473842 2473841 2026-10-27T09:46:10Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti1048.eqiad.wmnet 2473842 wikitext text/x-wiki 9eh68dgr6s40y3zdmoajbj99zq8wf4k 2473845 2473842 2026-10-27T09:48:02Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.loadbalancer.admin config_reloading P{lvs4009.ulsfo.wmnet} and A:liberica 2473845 wikitext text/x-wiki 7bfzgic0bskez4t0ci080weftrruavs 2473846 2473845 2026-10-27T09:48:09Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) config_reloading P{lvs4009.ulsfo.wmnet} and A:liberica 2473846 wikitext text/x-wiki h27iy9rknrxy3btgro7vm11t104fvyo 2473849 2473846 2026-10-27T09:49:20Z Stashbot 7414 godog: extend silence ATSBackendErrorsHigh eventstreams.discovery.wmnet to all sites for another ~8h - T442462 2473849 wikitext text/x-wiki ba6wuaw29q6mp417c9jphckkmhimpzv 2473850 2473849 2026-10-27T09:49:41Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.loadbalancer.admin config_reloading P{lvs4009.ulsfo.wmnet} and A:liberica 2473850 wikitext text/x-wiki p4egebix3m306opm61tqbqv2nhh8z8j 2473851 2473850 2026-10-27T09:50:00Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) config_reloading P{lvs4009.ulsfo.wmnet} and A:liberica 2473851 wikitext text/x-wiki jzuqo1d5vmiw472usat4i9oy5uzcvsw 2473852 2473851 2026-10-27T09:51:30Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1048.eqiad.wmnet 2473852 wikitext text/x-wiki dm9ryq07y4pbbi37ff3vcfborwbd2ow 2473853 2473852 2026-10-27T09:51:38Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1048.eqiad.wmnet 2473853 wikitext text/x-wiki 9tm4t9g81f8l11d8tm3fl0cxohad044 2473854 2473853 2026-10-27T09:52:06Z Stashbot 7414 elukey@cumin1004: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest2006.codfw.wmnet with OS trixie 2473854 wikitext text/x-wiki oaym4pasf9eumye1t5utdnrz8ylb5r2 2473855 2473854 2026-10-27T09:53:02Z Stashbot 7414 fabfur@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp3077.esams.wmnet 2473855 wikitext text/x-wiki sj5zd4wm077420jg5n2db4mmpb1vdrg 2473856 2473855 2026-10-27T09:56:54Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti2044.codfw.wmnet 2473856 wikitext text/x-wiki b39d5yazk7jfyudofn45wte2v0yko9j 2473857 2473856 2026-10-27T09:56:57Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1058.eqiad.wmnet 2473857 wikitext text/x-wiki k8kottft4eqzwlj3d88f7n2269kt65g 2473858 2473857 2026-10-27T09:56:59Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.hosts.reimage for host lvs4009.ulsfo.wmnet with OS trixie 2473858 wikitext text/x-wiki pa2wnyl67uyug57mbxpgoouu0f9sezk 2473861 2473858 2026-10-27T09:57:56Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.hosts.dhcp for host lvs4009.ulsfo.wmnet (push config only) 2473861 wikitext text/x-wiki 2xbkcm2bor3vvfr7fm8ujs3ijj2p8ja 2473862 2473861 2026-10-27T09:58:02Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host lvs4009.ulsfo.wmnet (push config only) 2473862 wikitext text/x-wiki pap4o1lyiqzgip1ds5r3mx94kuu39qd 2473866 2473862 2026-10-27T10:02:14Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti2044.codfw.wmnet 2473866 wikitext text/x-wiki haoqr1yjhr30krbn4xl4k84u6406ibs 2473867 2473866 2026-10-27T10:02:21Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2044.codfw.wmnet 2473867 wikitext text/x-wiki m0tnar0gf5u0msbfswqr9q0kpik69vu 2473868 2473867 2026-10-27T10:06:59Z Stashbot 7414 fabfur@cumin1004: START - Cookbook sre.cdn.roll-reboot rolling reboot on A:cp-text_esams 2473868 wikitext text/x-wiki czxyfq6x0l2lhgho7p4esy1wbm3os96 2473871 2473868 2026-10-27T10:08:18Z Stashbot 7414 slyngshede@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp2057.codfw.wmnet 2473871 wikitext text/x-wiki 6uu4er1dzv9b2iq824hrn0uyfol1i34 2473872 2473871 2026-10-27T10:10:57Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.hosts.dhcp for host lvs4009.ulsfo.wmnet (remove config only) 2473872 wikitext text/x-wiki gvtxnijh6gesltfyv5esk4u4knn5hrj 2473873 2473872 2026-10-27T10:11:05Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host lvs4009.ulsfo.wmnet (remove config only) 2473873 wikitext text/x-wiki 7m520di71yjtv0l64idgjnwkeef4o53 2473874 2473873 2026-10-27T10:11:17Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host ganeti1058.eqiad.wmnet 2473874 wikitext text/x-wiki esr92vxyxzy509ky7a0nilzve26l6ym 2473876 2473874 2026-10-27T10:13:51Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on lvs4009.ulsfo.wmnet with reason: host reimage 2473876 wikitext text/x-wiki gfzzwk299fkkfz8wmgcr22r922im1i1 2473877 2473876 2026-10-27T10:14:07Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest2006.codfw.wmnet (remove config only) 2473877 wikitext text/x-wiki ria1g7szdb72dsrhrqwzr4t845ipugy 2473878 2473877 2026-10-27T10:14:12Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest2006.codfw.wmnet (remove config only) 2473878 wikitext text/x-wiki 996j2mcl7n7uni9xj8iuincaeyu0xd2 2473879 2473878 2026-10-27T10:16:45Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti1058.eqiad.wmnet 2473879 wikitext text/x-wiki am8evu4zto7v3j5yzgpbi1sv6boiatl 2473880 2473879 2026-10-27T10:16:48Z Stashbot 7414 fabfur@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp3066.esams.wmnet 2473880 wikitext text/x-wiki cxj4vyhpylc9z831vgsyfia2y6t13tw 2473881 2473880 2026-10-27T10:16:54Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti1058.eqiad.wmnet 2473881 wikitext text/x-wiki 1dwm6gurd0irpiz3yz3tyl7wcsjftqw 2473882 2473881 2026-10-27T10:17:39Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on lvs4009.ulsfo.wmnet with reason: host reimage 2473882 wikitext text/x-wiki huj0k3pff65tiqef5t7gjpslmh5g1dz 2473883 2473882 2026-10-27T10:20:22Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host rdb-lock2001.codfw.wmnet 2473883 wikitext text/x-wiki s777r0gtq3ahtwsajnxukwq5n03c54i 2473884 2473883 2026-10-27T10:20:37Z Stashbot 7414 cgoubert@cumin2003: END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) for host rdb-lock2001.codfw.wmnet 2473884 wikitext text/x-wiki laktmm0e8sevncxw3kro9j838pek5dl 2473885 2473884 2026-10-27T10:21:30Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host rdb-lock2001.codfw.wmnet 2473885 wikitext text/x-wiki psf8hbr6j7z9qtxso20r8q0nzz77l6x 2473886 2473885 2026-10-27T10:21:35Z Stashbot 7414 cgoubert@cumin2003: END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) for host rdb-lock2001.codfw.wmnet 2473886 wikitext text/x-wiki agctfe1dau2t1kdjv1as1g3x61we1yd 2473887 2473886 2026-10-27T10:21:51Z Stashbot 7414 javiermonton@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/pageview-trending-relative-next: apply 2473887 wikitext text/x-wiki nfvqbup1ka14294hylysx99d24ykl0l 2473888 2473887 2026-10-27T10:22:04Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host rdb-lock2001.codfw.wmnet 2473888 wikitext text/x-wiki 6zz0xeeizq72twr5yqhccvn63b8yvn8 2473889 2473888 2026-10-27T10:22:06Z Stashbot 7414 javiermonton@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/pageview-trending-relative-next: apply 2473889 wikitext text/x-wiki lv7y2d1u9f03ylps0olmvxlyd7yj0jq 2473890 2473889 2026-10-27T10:23:33Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host rdb1014.eqiad.wmnet 2473890 wikitext text/x-wiki jom4svp38onuut8f06s8f9bs3t255s5 2473891 2473890 2026-10-27T10:25:53Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb-lock2001.codfw.wmnet 2473891 wikitext text/x-wiki k4byiaxrcl5zy2kr0ecv4wehpnrz450 2473894 2473891 2026-10-27T10:27:39Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host rdb-lock2002.codfw.wmnet 2473894 wikitext text/x-wiki a3o2kskkbknx818yblfhm9bsrevtjss 2473895 2473894 2026-10-27T10:29:47Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb1014.eqiad.wmnet 2473895 wikitext text/x-wiki hhh83xjec4y68uj8o9urhkwryxnh127 2473897 2473895 2026-10-27T10:31:40Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb-lock2002.codfw.wmnet 2473897 wikitext text/x-wiki ppc02bn76vxocay6mu9re284zx3yczd 2473898 2473897 2026-10-27T10:32:54Z Stashbot 7414 fabfur@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp3078.esams.wmnet 2473898 wikitext text/x-wiki civtplhtyv7dtsryok511zpxd3ho3tg 2473899 2473898 2026-10-27T10:36:27Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host lvs4009.ulsfo.wmnet with OS trixie 2473899 wikitext text/x-wiki mfrgt63eac9oudxp6qpgb6tbsmsc89v 2473900 2473899 2026-10-27T10:38:43Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host rdb-lock2003.codfw.wmnet 2473900 wikitext text/x-wiki 87tux7hpk47ww5q96gutum6x8n3zibj 2473901 2473900 2026-10-27T10:38:59Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host rdb1016.eqiad.wmnet 2473901 wikitext text/x-wiki eipmri3fnta2ops168ya1z4hm9c6kgn 2473903 2473901 2026-10-27T10:42:33Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb-lock2003.codfw.wmnet 2473903 wikitext text/x-wiki p8uf7yktzo3t9jmfa4bqsp6k14ia4qf 2473904 2473903 2026-10-27T10:44:28Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb1016.eqiad.wmnet 2473904 wikitext text/x-wiki mcgw2kroqntwl2w9pxk1btn52xsggkq 2473905 2473904 2026-10-27T10:45:53Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host rdb2012.codfw.wmnet 2473905 wikitext text/x-wiki kjcli2qua6xzrsxddu8ezcf43t4a61d 2473906 2473905 2026-10-27T10:46:21Z Stashbot 7414 slyngshede@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp2059.codfw.wmnet 2473906 wikitext text/x-wiki h7ojlybljwe73mj1k76gx8fytufy85f 2473907 2473906 2026-10-27T10:46:23Z Stashbot 7414 slyngshede@cumin1004: END (PASS) - Cookbook sre.cdn.roll-reboot (exit_code=0) rolling reboot on P{cp2049*} OR P{cp2051*} OR P{cp2053*} OR P{cp2055*} OR P{cp2057*} OR P{cp2059*} and A:cp 2473907 wikitext text/x-wiki 0cjivmvbtoub8vovjr26veo7mpb2n3k 2473908 2473907 2026-10-27T10:46:47Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [staging] START helmfile.d/services/rest-gateway: apply 2473908 wikitext text/x-wiki ed86d4hgx13g2nhl8d7e9vwf95rek7u 2473909 2473908 2026-10-27T10:47:20Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [staging] DONE helmfile.d/services/rest-gateway: apply 2473909 wikitext text/x-wiki lq9neh1sl4du3rqlv4a9b9agmo5ot9q 2473910 2473909 2026-10-27T10:48:09Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host rdb-lock1001.eqiad.wmnet 2473910 wikitext text/x-wiki aqmttopgnr487k12z8btb70dpxyyvzt 2473912 2473910 2026-10-27T10:51:11Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb2012.codfw.wmnet 2473912 wikitext text/x-wiki gyegmuj4022jbups5kimh2nnlz9vpsp 2473913 2473912 2026-10-27T10:51:49Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host rdb2014.codfw.wmnet 2473913 wikitext text/x-wiki c3qlsk5fwusnupeni1i064yxrskym9g 2473914 2473913 2026-10-27T10:52:09Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb-lock1001.eqiad.wmnet 2473914 wikitext text/x-wiki ecif5ckuqnl44kta42rnw2d2ikqvomt 2473915 2473914 2026-10-27T10:54:05Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host rdb-lock1002.eqiad.wmnet 2473915 wikitext text/x-wiki t24ftc7rmimdguv62ff4t4slbq0zgz5 2473916 2473915 2026-10-27T10:54:13Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [eqiad] START helmfile.d/services/rest-gateway: apply 2473916 wikitext text/x-wiki fj7fwrnq52afn11mzr63bs7iykb5geu 2473917 2473916 2026-10-27T10:54:38Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply 2473917 wikitext text/x-wiki c05jamm34ag7h3n0wjnkzzrdxpq9waf 2473918 2473917 2026-10-27T10:55:58Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [codfw] START helmfile.d/services/rest-gateway: apply 2473918 wikitext text/x-wiki 2bvp0qip5epb86vwgvopquwuyn58iie 2473919 2473918 2026-10-27T10:56:01Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.reimage for host sretest2006.codfw.wmnet with OS trixie 2473919 wikitext text/x-wiki 1x8hwb41x2yfvf1e71xxowm0qu5lcvv 2473920 2473919 2026-10-27T10:56:06Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest2006.codfw.wmnet (push config only) 2473920 wikitext text/x-wiki 9el4xp2801w7bwuk4hr3jmzp19dlkko 2473921 2473920 2026-10-27T10:56:11Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest2006.codfw.wmnet (push config only) 2473921 wikitext text/x-wiki 8c1nd0dflee41983v043yhxg31909x1 2473922 2473921 2026-10-27T10:56:27Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply 2473922 wikitext text/x-wiki 1s642gdfft3y245xcg0sfncyqyf5x3s 2473923 2473922 2026-10-27T10:57:07Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb2014.codfw.wmnet 2473923 wikitext text/x-wiki 19bd1qk8avaxzfou8cy61nvc266p7pa 2473924 2473923 2026-10-27T10:57:55Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb-lock1002.eqiad.wmnet 2473924 wikitext text/x-wiki t14g4mmrgv1arrvh6pzeyp6byot8lnr 2473925 2473924 2026-10-27T10:58:36Z Stashbot 7414 fabfur@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp3067.esams.wmnet 2473925 wikitext text/x-wiki 4erkxc5f3atxqpf3u43nqdtw7gks3gt 2473926 2473925 2026-10-27T10:59:36Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host rdb-lock1003.eqiad.wmnet 2473926 wikitext text/x-wiki trye2uk8u3z9zy7yqi8uab5moebqunn 2473927 2473926 2026-10-27T10:59:51Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.loadbalancer.admin config_reloading P{lvs4009.ulsfo.wmnet} and A:liberica 2473927 wikitext text/x-wiki 86xl8zu7vb3ms2g91zs14j16zdtuawa 2473928 2473927 2026-10-27T11:00:09Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) config_reloading P{lvs4009.ulsfo.wmnet} and A:liberica 2473928 wikitext text/x-wiki lge0g6bczdrcqewzktezd8fx9vulhri 2473930 2473928 2026-10-27T11:03:15Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb-lock1003.eqiad.wmnet 2473930 wikitext text/x-wiki szhjxty1sn8msr6rl8km9xyvom0gnwx 2473931 2473930 2026-10-27T11:07:09Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest2006.codfw.wmnet (remove config only) 2473931 wikitext text/x-wiki tnnl41tsi3c4mav5wmi2exbea5oo212 2473932 2473931 2026-10-27T11:07:14Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest2006.codfw.wmnet (remove config only) 2473932 wikitext text/x-wiki r1x7ykvvc56cx1b7kv4fuv9b7mndddb 2473933 2473932 2026-10-27T11:09:25Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on sretest2006.codfw.wmnet with reason: host reimage 2473933 wikitext text/x-wiki gt8a2ks730e0fe8rb9b84vhn62gk6ru 2473934 2473933 2026-10-27T11:13:00Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host rdb1013.eqiad.wmnet 2473934 wikitext text/x-wiki pzatnstmpr8551oprge5qv952yzh2lm 2473935 2473934 2026-10-27T11:13:08Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sretest2006.codfw.wmnet with reason: host reimage 2473935 wikitext text/x-wiki syuzwbc0mnu7uj0lv1ie1v1fnj9a335 2473936 2473935 2026-10-27T11:14:22Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host rdb2011.codfw.wmnet 2473936 wikitext text/x-wiki ajoffr0g70bdguxx66mf688uhd0ekph 2473937 2473936 2026-10-27T11:14:54Z Stashbot 7414 fabfur@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp3079.esams.wmnet 2473937 wikitext text/x-wiki t3yfu1fyvr3qber8u31kvheami04abl 2473938 2473937 2026-10-27T11:15:59Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.loadbalancer.admin config_reloading P{lvs4008.ulsfo.wmnet} and A:liberica 2473938 wikitext text/x-wiki mu52gb9vfvj3pe3t787jgznisirblqt 2473939 2473938 2026-10-27T11:16:16Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) config_reloading P{lvs4008.ulsfo.wmnet} and A:liberica 2473939 wikitext text/x-wiki e574h2holqh8i7sw88fz0nmodhvu98k 2473940 2473939 2026-10-27T11:19:11Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb1013.eqiad.wmnet 2473940 wikitext text/x-wiki q8mk2eaidzz9t4i2bhjxj8be6fc91f4 2473941 2473940 2026-10-27T11:19:29Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb2011.codfw.wmnet 2473941 wikitext text/x-wiki 1st8thsv2hzey4v6q6ixel4dvxch35d 2473942 2473941 2026-10-27T11:22:12Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.hosts.reimage for host lvs4008.ulsfo.wmnet with OS trixie 2473942 wikitext text/x-wiki pa1nm9jvgsdjauviyey7dbxc398421d 2473943 2473942 2026-10-27T11:23:08Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.hosts.dhcp for host lvs4008.ulsfo.wmnet (push config only) 2473943 wikitext text/x-wiki jrm66mnxpreeolcq0pirdmifjus1c5r 2473944 2473943 2026-10-27T11:23:13Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host lvs4008.ulsfo.wmnet (push config only) 2473944 wikitext text/x-wiki 40w2w7wp7mwauh3bszn1qntotxh5lok 2473945 2473944 2026-10-27T11:26:59Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host rdb2013.codfw.wmnet 2473945 wikitext text/x-wiki ls0ph2yu9x49k0p31ggbg8hltsz596v 2473946 2473945 2026-10-27T11:28:11Z Stashbot 7414 vgutierrez: upload purged 0.25+deb13u2 to trixie-wikimedia (apt.wm.o) - T442513 2473946 wikitext text/x-wiki hlhcp4mxfsc87qbc4s85sul95sbj237 2473947 2473946 2026-10-27T11:28:15Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host rdb1015.eqiad.wmnet 2473947 wikitext text/x-wiki 3xs7wnwr8bam1zeq66u55w2f3w3kbtj 2473948 2473947 2026-10-27T11:30:30Z Stashbot 7414 vgutierrez: testing purged 0.25+deb13u2 in cp7010 and cp7016 - T442513 2473948 wikitext text/x-wiki rebyhtzvw7yop4kjf4spvmylhowndtc 2473949 2473948 2026-10-27T11:30:34Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sretest2006.codfw.wmnet with OS trixie 2473949 wikitext text/x-wiki 8zv4fcyl6vkrvangiic4xi8dog6vlq7 2473951 2473949 2026-10-27T11:32:31Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb2013.codfw.wmnet 2473951 wikitext text/x-wiki 1makahmhmgbx8c91donbjhv4uuvqpbu 2473952 2473951 2026-10-27T11:33:30Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host rdb1015.eqiad.wmnet 2473952 wikitext text/x-wiki jnw1bax9deuyx52cslcsz6u8ue3d3r8 2473953 2473952 2026-10-27T11:36:56Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.hosts.dhcp for host lvs4008.ulsfo.wmnet (remove config only) 2473953 wikitext text/x-wiki tor6ll3qnxdp2fweg5555hlkzpg2q2u 2473954 2473953 2026-10-27T11:37:02Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host lvs4008.ulsfo.wmnet (remove config only) 2473954 wikitext text/x-wiki 1j2zuf9bits0i0inp1hwe5dtagu7dtw 2473955 2473954 2026-10-27T11:37:50Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.k8s.reboot-nodes rolling reboot on A:wikikube-master-codfw 2473955 wikitext text/x-wiki g6h5b51j21gtpi06lek3a53mgja8r0g 2473956 2473955 2026-10-27T11:37:54Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-ctrl2001.codfw.wmnet 2473956 wikitext text/x-wiki qmugk6hcvhc6ugqsj69jdqpmqax9n3p 2473957 2473956 2026-10-27T11:37:57Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-ctrl2001.codfw.wmnet 2473957 wikitext text/x-wiki c84l90i2os1flnc0mgfld0jwhq5zv4p 2473960 2473957 2026-10-27T11:39:50Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on lvs4008.ulsfo.wmnet with reason: host reimage 2473960 wikitext text/x-wiki kutk77afdvaimi3633goiy33mxd74eb 2473961 2473960 2026-10-27T11:40:20Z Stashbot 7414 fabfur@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp3068.esams.wmnet 2473961 wikitext text/x-wiki cnhrv2gjii36wkcj4rpgyjuq1vjxkbe 2473962 2473961 2026-10-27T11:42:44Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on lvs4008.ulsfo.wmnet with reason: host reimage 2473962 wikitext text/x-wiki 68biexigg8m34mjl9xajfzy9dcpwcug 2473963 2473962 2026-10-27T11:43:14Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti1033.eqiad.wmnet 2473963 wikitext text/x-wiki 5294jp2wn61qg00hzt1d0dm0fcqsnqp 2473964 2473963 2026-10-27T11:43:44Z Stashbot 7414 blake@deploy1003: Started scap sync-world: Backport for [[gerrit:1358891|GrowthExperiments: Set link recommendation service timeout to 32s (T442468)]] 2473964 wikitext text/x-wiki jypf2xm858okch1kfiix6z1piwf60gb 2473965 2473964 2026-10-27T11:47:21Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-ctrl2001.codfw.wmnet 2473965 wikitext text/x-wiki pc73796p43un6twdegtp1rajjekgtyg 2473966 2473965 2026-10-27T11:47:23Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-ctrl2001.codfw.wmnet 2473966 wikitext text/x-wiki aqoi18b3wwef4xan9gp8c9qkjkh4nix 2473967 2473966 2026-10-27T11:47:28Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-ctrl2002.codfw.wmnet 2473967 wikitext text/x-wiki 15gpgd7unkn7qzx3d6knqfok7rlwe4x 2473968 2473967 2026-10-27T11:47:31Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-ctrl2002.codfw.wmnet 2473968 wikitext text/x-wiki h8r43dfbwrswv2uca3zzo8crhjao6gv 2473969 2473968 2026-10-27T11:47:52Z Stashbot 7414 blake@deploy1003: urbanecm, blake: Backport for [[gerrit:1358891|GrowthExperiments: Set link recommendation service timeout to 32s (T442468)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2473969 wikitext text/x-wiki 28xx4btutg0bg3b30oo3lh8fznc9pkx 2473970 2473969 2026-10-27T11:48:20Z Stashbot 7414 blake@deploy1003: urbanecm, blake: Continuing with deployment 2473970 wikitext text/x-wiki cfkjpdfvesjztsdkqq3xa7vqu3x8yea 2473971 2473970 2026-10-27T11:54:03Z Stashbot 7414 blake@deploy1003: Finished scap sync-world: Backport for [[gerrit:1358891|GrowthExperiments: Set link recommendation service timeout to 32s (T442468)]] (duration: 10m 18s) 2473971 wikitext text/x-wiki 4kgb7ovn5nwixvpjpaj9x0xlhxll6cb 2473972 2473971 2026-10-27T11:54:21Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/rest-gateway: apply 2473972 wikitext text/x-wiki 39rpt2ubpknqqp6yaynf27i1d44j9lh 2473973 2473972 2026-10-27T11:54:35Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply 2473973 wikitext text/x-wiki 0hpkfdz9lzkssfa0aca2g4hkdsipx0m 2473974 2473973 2026-10-27T11:54:37Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/rest-gateway: apply 2473974 wikitext text/x-wiki mql86lucv2bj0b36vbpqgdpnfcwsxi8 2473975 2473974 2026-10-27T11:54:40Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply 2473975 wikitext text/x-wiki mf8fbfq7nebibfkeugq3u3lrf95h68f 2473976 2473975 2026-10-27T11:54:51Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-ctrl2002.codfw.wmnet 2473976 wikitext text/x-wiki suwfzsv8j6bbzwj2iin9xw9qmgqbii5 2473977 2473976 2026-10-27T11:54:54Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-ctrl2002.codfw.wmnet 2473977 wikitext text/x-wiki tpybql7k9la9ir2j1druajzr7lqaa2b 2473978 2473977 2026-10-27T11:54:59Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-ctrl2003.codfw.wmnet 2473978 wikitext text/x-wiki m4wiakdzxo19u8x5quk5bk9xbwne82i 2473979 2473978 2026-10-27T11:55:02Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-ctrl2003.codfw.wmnet 2473979 wikitext text/x-wiki n2k90dc1paua5o1o4eh154pesdm6h0m 2473980 2473979 2026-10-27T11:57:04Z Stashbot 7414 fabfur@cumin1004: cookbooks.sre.cdn.roll-reboot finished rebooting cp3080.esams.wmnet 2473980 wikitext text/x-wiki kkol6wl7pjef1ovjy0ve9d1dyard1u3 498 14359 2473208 2438532 2026-10-26T14:31:45Z Stashbot 7414 volans@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.vm_console 2473208 wikitext text/x-wiki 5egqz9z6750gy6uxv5cnwb8ehb1ecd7 2473209 2473208 2026-10-26T14:32:12Z Stashbot 7414 volans@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=0) 2473209 wikitext text/x-wiki htv9zi2rrn23cffm8ehvdz8d8owon4h 498 16087 2473120 2458991 2026-10-26T13:24:41Z Stashbot 7414 dcaro: up and running again 2473120 wikitext text/x-wiki ntd88jng0xc7cjmonsxby098s6webd9 0 17290 2473267 2472756 2026-10-26T15:24:59Z Stashbot 7414 brennen: Updating development images on contint primary for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/130 2473267 wikitext text/x-wiki fltw0o9klotsw6f8qezl3xcws4d1v7x 2473296 2473267 2026-10-26T16:16:49Z Stashbot 7414 brennen: Updating development images on contint primary for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/131 (T435368, T441915) 2473296 wikitext text/x-wiki 7rx2attigld4fpzc69msok3iveodnmd 2473311 2473296 2026-10-26T16:32:42Z Stashbot 7414 hashar: doc.wikimedia.org: deleting MediaWiki docs for obsolete non LTS branches and tags # T440153 2473311 wikitext text/x-wiki qldwqqsuxz98dr6oulq97tkcq25iipc 2473950 2473311 2026-10-27T11:32:28Z Stashbot 7414 James_F: Docker: [node26] Add zip/unzip to maybe help Cypress, for T361520 2473950 wikitext text/x-wiki ku65f418v33yrz056josq8wh6pkvzjm 498 30942 2473816 2472594 2026-10-27T09:25:29Z Stashbot 7414 taavi: restore Horizon access 2473816 wikitext text/x-wiki 4c6il0ox2u2b94lynm4n0vf6zs1s73b 0 49472 2473676 2456703 2026-10-27T06:03:46Z VulcanSphere 14355 /* Known outages */ Fixing date #VulcanSphere 2473676 wikitext text/x-wiki 4m0311lbykwlfyh5nm5e29z301bdx2k 498 293634 2473605 2472058 2026-10-27T02:49:13Z Stashbot 7414 wmbot~anticomposite@tools-bastion-15: webservice stop 2473605 wikitext text/x-wiki 9itl0y3qaeq1twmexbmdby7ap8hmzxl 2473606 2473605 2026-10-27T02:49:23Z Stashbot 7414 wmbot~anticomposite@tools-bastion-15: webservice php8.4 start 2473606 wikitext text/x-wiki nadb5i2t7a1b78ap6cctxvde5jcsp1t 498 383664 2473420 2433174 2026-10-26T18:15:13Z Stashbot 7414 MacFan4000: (pg2) sudo mount /dev/sda /mnt/pgsql 2473420 wikitext text/x-wiki jk8a31fuohq2d90ynss0y7imiunebki 12 441751 2473596 2455360 2026-10-27T00:22:56Z Jberkel 5719 /* analytics vs web */ add "query timeout" to make this information more findable, see Talk 2473596 wikitext text/x-wiki oruo9t0v8420ccgndln583rkr13wb21 498 443628 2473435 2472680 2026-10-26T18:36:58Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40378908239 (https://github.com/cluebotng/component-configs/commits/2d1531d1cbfbfa07a816f43b825ad9d8214f9996) 2473435 wikitext text/x-wiki hes2u9t5ma0e3h7m50tqqkbk0ct9f53 2473590 2473435 2026-10-26T23:29:29Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40419679243 (https://github.com/cluebotng/component-configs/commits/c35c9753fc0f5978462a889014ba06ed450c3e0a) 2473590 wikitext text/x-wiki qxt89hz5075eq2yysf3zlgn0wrvehnr 2473612 2473590 2026-10-27T03:15:02Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40442736567 (https://github.com/cluebotng/component-configs/commits/44d3670909d5f5c7236df807b8156fa2cf0d81e6) 2473612 wikitext text/x-wiki lkmytdyqnpkbkmsfdm94p8xan6gbdb6 2473615 2473612 2026-10-27T03:18:54Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40442895975 (https://github.com/cluebotng/component-configs/commits/22ef6144c3a3323d2054a04b4a2fa02c7c9c2cee) 2473615 wikitext text/x-wiki tmpjbuyzkgb938hz3tsfdgvsp0l5adj 2473617 2473615 2026-10-27T03:30:22Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40444184085 (https://github.com/cluebotng/component-configs/commits/368024e9769a6b45b65ce73920e2f880a173e978) 2473617 wikitext text/x-wiki pnc8tkty7xnehsux9pqpp6hynpqf1vx 2473632 2473617 2026-10-27T03:55:54Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40446527027 (https://github.com/cluebotng/component-configs/commits/12ba566c97fb13fa2d055dd3e9d2df28c1e7d663) 2473632 wikitext text/x-wiki 4zrshjq6f4ylscma3wio9nvp9yovzx2 2473642 2473632 2026-10-27T04:05:32Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40447375412 (https://github.com/cluebotng/component-configs/commits/678d113e06e66a0a9093041f8678c92fa82a2d5b) 2473642 wikitext text/x-wiki 4c3mzniixmwsgn9zmcs2yhcz33gacyh 2473650 2473642 2026-10-27T04:52:37Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40451765772 (https://github.com/cluebotng/component-configs/commits/b95cee1256fe85e86858e9c35dbf825c29ae24dc) 2473650 wikitext text/x-wiki jv4z1z3v7uh0nyuo245h8813dse2xyo 2473653 2473650 2026-10-27T04:56:43Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40451826128 (https://github.com/cluebotng/component-configs/commits/264fe43c86ed52f85594cf77c7f12208c886bae9) 2473653 wikitext text/x-wiki 7xuzrovhbtvc4eqk4pjgyx4s075ouel 2473661 2473653 2026-10-27T05:00:55Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40452518044 (https://github.com/cluebotng/component-configs/commits/e6a41bbaf231a25d1cf182623832258b82e34982) 2473661 wikitext text/x-wiki b5g4qfo5e74pt7idrlq6579mqmi9pm7 2473668 2473661 2026-10-27T05:34:46Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40455721193 (https://github.com/cluebotng/component-configs/commits/33785ac45923c22c4e14a8b54268e25c98b83f89) 2473668 wikitext text/x-wiki 4pt2slah1q7o4xrkdw7cte361umyknw 2473671 2473668 2026-10-27T05:38:25Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40455798083 (https://github.com/cluebotng/component-configs/commits/80c03e09cf4126cf14f61eae6feded9feafbb264) 2473671 wikitext text/x-wiki 1g9qo6en4q2ir3ucd2o2u9esvwyrfix 2473678 2473671 2026-10-27T06:14:34Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40459540107 (https://github.com/cluebotng/component-configs/commits/bc660b38ce5052d918a9c8048fded9d70267c171) 2473678 wikitext text/x-wiki 98nxkfc66rtn289dlr0iq28cqpb5b9o 2473688 2473678 2026-10-27T06:47:05Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40462601906 (https://github.com/cluebotng/component-configs/commits/b4741b807618f702050fab2dca0bd5bbf12941ed) 2473688 wikitext text/x-wiki limy73rtwrclv7k601wi7gg44gjnumu 2473777 2473688 2026-10-27T08:53:22Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40476249547 (https://github.com/cluebotng/component-configs/commits/838abafe65c57870163e3118ce8a093debe0d2e6) 2473777 wikitext text/x-wiki rjgf35jbgtjkfeywp6zaf8ezkil02j0 2473860 2473777 2026-10-27T09:57:53Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40484261201 (https://github.com/cluebotng/component-configs/commits/698a9bac73dd63611a0686bc1785f80ca9a6683e) 2473860 wikitext text/x-wiki ohpchok5fa54zgnyn0ri9hmlcfaje16 2473959 2473860 2026-10-27T11:39:16Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40497231026 (https://github.com/cluebotng/component-configs/commits/ddd9bcc85b24abfbec8521371d7289c73517fb21) 2473959 wikitext text/x-wiki dzbllsguzuhxdmhiv7zxhsr618wu4cx 498 443800 2473437 2472791 2026-10-26T18:37:37Z Stashbot 7414 lucaswerkmeister: deployed ce128c0: Introduce dataclasses for batch background runs 2473437 wikitext text/x-wiki 9pmztldopu40qs26s6zjyadj9ud04ji 2473449 2473437 2026-10-26T18:54:28Z Stashbot 7414 lucaswerkmeister: re-clean up those stale background runs from 2026-10-10 – I forgot that the background_stopped_localuser is allowed to be NULL even for stopped background runs, and that’s more appropriate here 2473449 wikitext text/x-wiki nqicyflwtzyqmdetaklcj3e35ejim9v 2473450 2473449 2026-10-26T18:54:33Z Stashbot 7414 lucaswerkmeister: sql tools "UPDATE s53976__quickcategories.background SET background_stopped_localuser=NULL WHERE background_batch IN (11648, 12156, 9926, 12139, 12882, 7824, 13458, 13465, 13733, 13734, 13735, 13737, 9021, 9023, 9026, 9031, 9039, 9056, 9339, 9337, 9355, 9358, 9362, 9379, 9673, 9883, 9885, 9886, 9993, 11111, 13219, 13229, 2473450 wikitext text/x-wiki kr06t00sefk5tqpkisp4ety83qebvvr 2473451 2473450 2026-10-26T18:54:41Z Stashbot 7414 lucaswerkmeister: [cont.] 13230, 13271, 13283, 13301, 13434, 17412, 17445, 17477, 18154);" 2473451 wikitext text/x-wiki c7agva921zgcctde97tc0m786xufpaq 0 443810 2473520 2348117 2026-10-26T20:32:33Z Novem Linguae 23682 ce 2473520 wikitext text/x-wiki pjldcqifi0ubzuxut4spdasy4x1411d 13 444215 2473595 2473000 2026-10-27T00:07:07Z Jberkel 5719 /* What is the default timeout for queries on the replicas? */ Reply 2473595 wikitext text/x-wiki ts44npiiweoiicd5cbh3b6ywlqqbav3 0 444275 2473395 2450750 2026-10-26T17:42:05Z RLazarus (WMF) 15215 /* Prepare a new version */ 2473395 wikitext text/x-wiki rgan761jiqk2i5nmvuxdhx9ewh87pyo 2473462 2473395 2026-10-26T19:18:14Z RLazarus (WMF) 15215 /* Import to envoy-future with reprepo */ 2473462 wikitext text/x-wiki 57d0dtlaq3y1a85y43stgesslmr7v36 498 446211 2473629 2472589 2026-10-27T03:55:26Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40446527024 (https://github.com/cluebotng/component-configs/commits/12ba566c97fb13fa2d055dd3e9d2df28c1e7d663) 2473629 wikitext text/x-wiki pgmj5py2day3i1aebvtwg8pigewxlms 2473637 2473629 2026-10-27T04:04:39Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40447375517 (https://github.com/cluebotng/component-configs/commits/678d113e06e66a0a9093041f8678c92fa82a2d5b) 2473637 wikitext text/x-wiki jqdppnz84ho8k141lim6ieppkzocxa2 2473659 2473637 2026-10-27T05:00:16Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40452518152 (https://github.com/cluebotng/component-configs/commits/e6a41bbaf231a25d1cf182623832258b82e34982) 2473659 wikitext text/x-wiki k6x50xqzibb0w95jjvqp94slboa4mpj 2473929 2473659 2026-10-27T11:02:23Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40492675207 (https://github.com/cluebotng/component-configs/commits/677efd2e385dcbac779a72a750798b6b7fa31221) 2473929 wikitext text/x-wiki 8wvbti1mq0k4qpdom2f8484exs0lrri 0 449160 2473594 2472816 2026-10-27T00:02:09Z Dexbot 30554 Bot: Updating the report 2473594 wikitext text/x-wiki q984q6f8evomft9ou1topifyz5j0uba 2 451268 2473279 2269902 2026-10-26T15:39:23Z TChin (WMF) 25137 Align with metawiki page 2473279 wikitext text/x-wiki 8qtqomsjzzhpkwtdeaxoxrg2k6ipih8 116 452799 2473276 2300269 2026-10-26T15:32:55Z Valerio Bozzolan 10109 [[phabricator:T442396]] - migrate DeletionBot to its own tool 2473276 wikitext text/x-wiki hsk360ruexw5c9hfutlm6tx1akjlbo6 498 452890 2473609 2452759 2026-10-27T03:02:58Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40441575561 (https://github.com/cluebotng/component-configs/commits/457585647825bf9845a8c2a5e6ab8dba5aca3763) 2473609 wikitext text/x-wiki qobep4vg1xfcsg8dtwyw5k4b3tpr1ph 2473613 2473609 2026-10-27T03:16:56Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40442895976 (https://github.com/cluebotng/component-configs/commits/22ef6144c3a3323d2054a04b4a2fa02c7c9c2cee) 2473613 wikitext text/x-wiki ered6uao1brwgxi20xq3rsj1err6dob 2473618 2473613 2026-10-27T03:30:54Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40444183898 (https://github.com/cluebotng/component-configs/commits/368024e9769a6b45b65ce73920e2f880a173e978) 2473618 wikitext text/x-wiki ck0w1tsf02y442wdcohwwion2vszczr 2473634 2473618 2026-10-27T03:56:13Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40446526960 (https://github.com/cluebotng/component-configs/commits/12ba566c97fb13fa2d055dd3e9d2df28c1e7d663) 2473634 wikitext text/x-wiki 6sovncb1vdfmqr53oqvnvglr7tgjgh4 2473643 2473634 2026-10-27T04:06:05Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40447375770 (https://github.com/cluebotng/component-configs/commits/678d113e06e66a0a9093041f8678c92fa82a2d5b) 2473643 wikitext text/x-wiki 149b5evi32axzr51gj2o6xijh3s1zdw 2473651 2473643 2026-10-27T04:52:59Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40451765768 (https://github.com/cluebotng/component-configs/commits/b95cee1256fe85e86858e9c35dbf825c29ae24dc) 2473651 wikitext text/x-wiki soqyr7f83gxqi0pos82efar1a21pma1 2473662 2473651 2026-10-27T05:01:05Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40452518090 (https://github.com/cluebotng/component-configs/commits/e6a41bbaf231a25d1cf182623832258b82e34982) 2473662 wikitext text/x-wiki bd0tvi1vtnjblnc77y7ioec2srx0t9l 2473669 2473662 2026-10-27T05:35:02Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40455721244 (https://github.com/cluebotng/component-configs/commits/33785ac45923c22c4e14a8b54268e25c98b83f89) 2473669 wikitext text/x-wiki 1t051d9h2hhi58to2trezdopp9cofz8 2473672 2473669 2026-10-27T05:39:07Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40455798133 (https://github.com/cluebotng/component-configs/commits/80c03e09cf4126cf14f61eae6feded9feafbb264) 2473672 wikitext text/x-wiki 2u9alt1qok2xokibi53jbwz4gx1c1kw 2473675 2473672 2026-10-27T05:56:04Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40457745340 (https://github.com/cluebotng/component-configs/commits/c09fe8cd0f8bc989e3798ba689cbffc5c5cb362a) 2473675 wikitext text/x-wiki 9g0hw84kgb8zl85ogef921a1ktqu61e 2473679 2473675 2026-10-27T06:15:08Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40459540119 (https://github.com/cluebotng/component-configs/commits/bc660b38ce5052d918a9c8048fded9d70267c171) 2473679 wikitext text/x-wiki m46bhehpof3bb3ym2nokvpvqooph7sc 2473687 2473679 2026-10-27T06:46:54Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40462601965 (https://github.com/cluebotng/component-configs/commits/b4741b807618f702050fab2dca0bd5bbf12941ed) 2473687 wikitext text/x-wiki oug6p0lhbyb5ttz121oekmqpmds76s2 2473778 2473687 2026-10-27T08:54:03Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40476249549 (https://github.com/cluebotng/component-configs/commits/838abafe65c57870163e3118ce8a093debe0d2e6) 2473778 wikitext text/x-wiki ex25pqptv8h6v6phsrh7tlye9plrrx8 2473859 2473778 2026-10-27T09:57:42Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40484261191 (https://github.com/cluebotng/component-configs/commits/698a9bac73dd63611a0686bc1785f80ca9a6683e) 2473859 wikitext text/x-wiki np7hiyckb401kprbk8gfed2bvp7d92p 2473911 2473859 2026-10-27T10:50:45Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40491080407 (https://github.com/cluebotng/component-configs/commits/d72ea811ba6c14ea73c3b76fe67040cdac4fa091) 2473911 wikitext text/x-wiki oyc08h7yyp5p9ueeu029e2zxqxjx1x2 2473958 2473911 2026-10-27T11:39:12Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40497231000 (https://github.com/cluebotng/component-configs/commits/ddd9bcc85b24abfbec8521371d7289c73517fb21) 2473958 wikitext text/x-wiki ec7bu1z64o42o3dfeg6i0xtn5wi28ll 116 453426 2473646 2472871 2026-10-27T04:17:26Z Phabbanbot 37210 CNC was disabled by Dragoniez 2473646 wikitext text/x-wiki abuxb1z0dn3dhz09x60mj4taw597na3 116 453906 2473304 2472817 2026-10-26T16:21:24Z Gitlabaccountapprovalbot 37332 @techienk was approved. 2473304 wikitext text/x-wiki ro9rpw67d9tuuzu61zfcgk4iqslorc4 2473647 2473304 2026-10-27T04:18:24Z Gitlabaccountapprovalbot 37332 @sabrsl was approved. 2473647 wikitext text/x-wiki 46x615efey5p8a4qfm9u0fa12k9w0pd 0 457955 2473811 2472613 2026-10-27T09:23:23Z ASanford-WMF 52089 Remove Secure Enclave documentation as we will not be supporting this method for the time being. 2473811 wikitext text/x-wiki 95p6hcepqqmmhhmvzmsh4c314yqt54q 3 458461 2473503 2274223 2026-10-26T20:16:26Z StrikerBot 8475 Welcome to Toolforge! 2473503 wikitext text/x-wiki sdxkoqjgxmbyamdr9wstntvl3rn0gx6 498 458787 2473589 2453642 2026-10-26T23:29:09Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40419679333 (https://github.com/cluebotng/component-configs/commits/c35c9753fc0f5978462a889014ba06ed450c3e0a) 2473589 wikitext text/x-wiki 51gcr5njehk62dmnng6f2d1hx2fmhlh 2473611 2473589 2026-10-27T03:14:41Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40442736579 (https://github.com/cluebotng/component-configs/commits/44d3670909d5f5c7236df807b8156fa2cf0d81e6) 2473611 wikitext text/x-wiki cuk4bhos6iscr8ktc4m4oc61duva1wc 2473614 2473611 2026-10-27T03:17:59Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40442895988 (https://github.com/cluebotng/component-configs/commits/22ef6144c3a3323d2054a04b4a2fa02c7c9c2cee) 2473614 wikitext text/x-wiki 42yx8apzcbvj582ejp02dmewi1sgvpv 2473630 2473614 2026-10-27T03:55:28Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40446527051 (https://github.com/cluebotng/component-configs/commits/12ba566c97fb13fa2d055dd3e9d2df28c1e7d663) 2473630 wikitext text/x-wiki kgtf4mmie0vnoksibqljpd0xqxc791o 2473640 2473630 2026-10-27T04:05:29Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40447375498 (https://github.com/cluebotng/component-configs/commits/678d113e06e66a0a9093041f8678c92fa82a2d5b) 2473640 wikitext text/x-wiki dmu1lq01f9it7964bdockend7vqjoud 2473649 2473640 2026-10-27T04:51:48Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40451765837 (https://github.com/cluebotng/component-configs/commits/b95cee1256fe85e86858e9c35dbf825c29ae24dc) 2473649 wikitext text/x-wiki 1tz3t6yupimbttwuhqpnswjyd2hasvt 2473652 2473649 2026-10-27T04:55:18Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40451826228 (https://github.com/cluebotng/component-configs/commits/264fe43c86ed52f85594cf77c7f12208c886bae9) 2473652 wikitext text/x-wiki rrxf2cfoek3fdw6e9sfk6trsqyk8yxn 2473655 2473652 2026-10-27T04:59:47Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40452518212 (https://github.com/cluebotng/component-configs/commits/e6a41bbaf231a25d1cf182623832258b82e34982) 2473655 wikitext text/x-wiki 7ovopidwktuxftzl0donsc9fcg2f6u6 2473667 2473655 2026-10-27T05:33:37Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40455721145 (https://github.com/cluebotng/component-configs/commits/33785ac45923c22c4e14a8b54268e25c98b83f89) 2473667 wikitext text/x-wiki p0asusisrpadac6dxdpksuyf20fxesl 2473776 2473667 2026-10-27T08:52:28Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40476249856 (https://github.com/cluebotng/component-configs/commits/838abafe65c57870163e3118ce8a093debe0d2e6) 2473776 wikitext text/x-wiki 5hucpou501iyjvz10shyo1im06lcv8q 498 458884 2473514 2432902 2026-10-26T20:27:36Z Stashbot 7414 taavi: increment object storage objects quota to 5M 2473514 wikitext text/x-wiki s28afcexhyxetpba4fowj7pd48mlyg5 498 459243 2473621 2453565 2026-10-27T03:40:57Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40445124134 (https://github.com/cluebotng/component-configs/commits/f7026cd7409b14b6865323d50c6942fde358921e) 2473621 wikitext text/x-wiki s0gyijd3ivuysa416i8t3lgx0fn9eyu 2473633 2473621 2026-10-27T03:55:55Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40446526995 (https://github.com/cluebotng/component-configs/commits/12ba566c97fb13fa2d055dd3e9d2df28c1e7d663) 2473633 wikitext text/x-wiki j8fxef4alwbtdei11mufxbakd3gxtdl 2473641 2473633 2026-10-27T04:05:30Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40447375410 (https://github.com/cluebotng/component-configs/commits/678d113e06e66a0a9093041f8678c92fa82a2d5b) 2473641 wikitext text/x-wiki abi5o9b86lmy9lvycad95yd4hl4crxi 2473644 2473641 2026-10-27T04:08:46Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40447571824 (https://github.com/cluebotng/component-configs/commits/7d10e42f436c05ef56f6f317648388d592c3c05f) 2473644 wikitext text/x-wiki huajfit5celxsuqfdcew0yj6zl0noxw 2473645 2473644 2026-10-27T04:16:45Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40448492483 (https://github.com/cluebotng/component-configs/commits/d09fba9de2a42159fa1c899076588e5408ccc19b) 2473645 wikitext text/x-wiki 050k23hclb151pi0i5ij59wx179z1rb 2473648 2473645 2026-10-27T04:49:18Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40451550237 (https://github.com/cluebotng/component-configs/commits/d19590e442b664819343d4373714879e039ae49f) 2473648 wikitext text/x-wiki kdb453lhbjrknhx0e9r35v04qe1agfa 2473660 2473648 2026-10-27T05:00:54Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40452518130 (https://github.com/cluebotng/component-configs/commits/e6a41bbaf231a25d1cf182623832258b82e34982) 2473660 wikitext text/x-wiki jq3df1wir3dtb9i44w97o38z3y18q7k 2473663 2473660 2026-10-27T05:11:45Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40453565998 (https://github.com/cluebotng/component-configs/commits/0b40c20b317be8b21d7e6b4a9c452f2be1a63558) 2473663 wikitext text/x-wiki jpnbi4pic49j8ggp57isj6iwb3o861i 2473664 2473663 2026-10-27T05:15:38Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40453802690 (https://github.com/cluebotng/component-configs/commits/4186d7d35e3637e5f7722d66c028994026229d84) 2473664 wikitext text/x-wiki ls4wkqdyiqk2bltu2akqpz8ubvndkvy 2473673 2473664 2026-10-27T05:42:16Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40456450428 (https://github.com/cluebotng/component-configs/commits/b0fce42989bc739f2992831884538d17c4220a07) 2473673 wikitext text/x-wiki n05tn5jamvgzsebtlefzs6l1wv0afvc 2473680 2473673 2026-10-27T06:17:15Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40459831650 (https://github.com/cluebotng/component-configs/commits/bfbe8dc9171d388710c1d5eface2d00809cd79dd) 2473680 wikitext text/x-wiki rjbso92dktzv88lsjyoluceme64ht5i 2473686 2473680 2026-10-27T06:44:43Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40462539944 (https://github.com/cluebotng/component-configs/commits/e4c07d7c9925e5e434298a95070b8f40a7db75c8) 2473686 wikitext text/x-wiki ew119qthfqc86dtn2q0sznhi6byfj61 2473892 2473686 2026-10-27T10:26:47Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40487986665 (https://github.com/cluebotng/component-configs/commits/7cc193ac0999f846b516b843914c70a13924f99f) 2473892 wikitext text/x-wiki cck1xngi75ppzhuiuufu491vcuv6scs 2473902 2473892 2026-10-27T10:40:42Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40489900248 (https://github.com/cluebotng/component-configs/commits/8007804f0273db3ecaf618e4e3723dbe1bf0fb67) 2473902 wikitext text/x-wiki d7zm06hl8rraaye7fjhe46ola0q6frt 498 459244 2473616 2433018 2026-10-27T03:29:52Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40444183977 (https://github.com/cluebotng/component-configs/commits/368024e9769a6b45b65ce73920e2f880a173e978) 2473616 wikitext text/x-wiki l1o7qc1dsq65t45zvndn83l7az2z5gr 2473619 2473616 2026-10-27T03:36:21Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40444706514 (https://github.com/cluebotng/component-configs/commits/a9515adb6b57ca73316c1c6b8559bc6b49255d7f) 2473619 wikitext text/x-wiki 04asx07k8fcf15s88b2lp6gpeeitjoy 2473622 2473619 2026-10-27T03:41:10Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40445221759 (https://github.com/cluebotng/component-configs/commits/e6c8388c5259b03b82e9139c4d465a9c0084729f) 2473622 wikitext text/x-wiki t7lcewc1scyuea52irg3rmg4sftm39y 2473631 2473622 2026-10-27T03:55:48Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40446527142 (https://github.com/cluebotng/component-configs/commits/12ba566c97fb13fa2d055dd3e9d2df28c1e7d663) 2473631 wikitext text/x-wiki o026e9gdroklljknxyzpltlq0czfrtk 2473639 2473631 2026-10-27T04:04:56Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40447375409 (https://github.com/cluebotng/component-configs/commits/678d113e06e66a0a9093041f8678c92fa82a2d5b) 2473639 wikitext text/x-wiki awo3gib4oxq3lc8iq63lm7q2xxdxige 2473654 2473639 2026-10-27T04:59:41Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/40452518133 (https://github.com/cluebotng/component-configs/commits/e6a41bbaf231a25d1cf182623832258b82e34982) 2473654 wikitext text/x-wiki owjil2f1ripelor2zyx7jyrss7tcmqj 2473670 2473654 2026-10-27T05:35:05Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40455798034 (https://github.com/cluebotng/component-configs/commits/80c03e09cf4126cf14f61eae6feded9feafbb264) 2473670 wikitext text/x-wiki nh2kh2og65g3q64wo3s7spjl6u4a82z 2473674 2473670 2026-10-27T05:50:02Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40457189661 (https://github.com/cluebotng/component-configs/commits/30587ffc7ef251c2e1a6bcd1d55b7a3b2493d65c) 2473674 wikitext text/x-wiki fi74grdylidmkmlaz5f4h33ad7vrz4c 2473677 2473674 2026-10-27T06:14:23Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40459540079 (https://github.com/cluebotng/component-configs/commits/bc660b38ce5052d918a9c8048fded9d70267c171) 2473677 wikitext text/x-wiki oixl5ctgvug7ga8ejbi20qcqk04m11g 2473863 2473677 2026-10-27T09:58:10Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40484261158 (https://github.com/cluebotng/component-configs/commits/698a9bac73dd63611a0686bc1785f80ca9a6683e) 2473863 wikitext text/x-wiki 9mtt4js41rd2p0mpibl9q4idn542kw6 498 459255 2473623 2433016 2026-10-27T03:41:27Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40445221810 (https://github.com/cluebotng/component-configs/commits/e6c8388c5259b03b82e9139c4d465a9c0084729f) 2473623 wikitext text/x-wiki q5jw4f9i35gcjwt9e2bfdfeqykdl5qq 2473626 2473623 2026-10-27T03:55:10Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40446527178 (https://github.com/cluebotng/component-configs/commits/12ba566c97fb13fa2d055dd3e9d2df28c1e7d663) 2473626 wikitext text/x-wiki q8k0qn0rl0oc20ay2ww4rgxc65xtmlt 2473638 2473626 2026-10-27T04:04:43Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40447375417 (https://github.com/cluebotng/component-configs/commits/678d113e06e66a0a9093041f8678c92fa82a2d5b) 2473638 wikitext text/x-wiki nn3ewiw7mj64usl6p7xwtat8ltqbyw1 2473657 2473638 2026-10-27T05:00:04Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40452518051 (https://github.com/cluebotng/component-configs/commits/e6a41bbaf231a25d1cf182623832258b82e34982) 2473657 wikitext text/x-wiki b1l1mxa2i3x9ji0otd4n7gyuzi59ek8 498 459263 2473620 2435505 2026-10-27T03:38:37Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40445004144 (https://github.com/cluebotng/component-configs/commits/ba4dac835cbaed39f73a3456f14e9543c2fe63ac) 2473620 wikitext text/x-wiki q8ttyvcsna8ea7uy4gooxqorikkhqi7 2473628 2473620 2026-10-27T03:55:12Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40446527408 (https://github.com/cluebotng/component-configs/commits/12ba566c97fb13fa2d055dd3e9d2df28c1e7d663) 2473628 wikitext text/x-wiki 9oskx4my4w98gc9tva6tv3qcuz0nlix 2473636 2473628 2026-10-27T04:04:36Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40447375447 (https://github.com/cluebotng/component-configs/commits/678d113e06e66a0a9093041f8678c92fa82a2d5b) 2473636 wikitext text/x-wiki 3mvacta1hjgoato6v8o87o1pfoc6bqi 2473658 2473636 2026-10-27T05:00:05Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40452518081 (https://github.com/cluebotng/component-configs/commits/e6a41bbaf231a25d1cf182623832258b82e34982) 2473658 wikitext text/x-wiki to5a4v1l626r93ruv4aygtoygskylds 0 459290 2473287 2472967 2026-10-26T16:03:55Z SNwachukwu (WMF) 39521 Add new item to next deployment train 2473287 wikitext text/x-wiki eqqgsj6gvucvmt4ehysel5x38j7o6z0 0 459340 2473374 2468169 2026-10-26T17:28:53Z XCollazo-WMF 31846 Add section on Differences with the legacy XML Dumps 2473374 wikitext text/x-wiki cun9o2qoqs02t8rvn2xa28jdcui33fd 498 459362 2473627 2432376 2026-10-27T03:55:10Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40446527044 (https://github.com/cluebotng/component-configs/commits/12ba566c97fb13fa2d055dd3e9d2df28c1e7d663) 2473627 wikitext text/x-wiki tvllstsf1ezp31n8je9p3r2lo4uhmhy 2473656 2473627 2026-10-27T04:59:58Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/40452518077 (https://github.com/cluebotng/component-configs/commits/e6a41bbaf231a25d1cf182623832258b82e34982) 2473656 wikitext text/x-wiki evpmquacj28go258p87tkvpg1c6q9q2 0 459699 2473332 2472100 2026-10-26T16:48:40Z Stashbot 7414 larssandergreen: civicrm upgraded from 5a51e07f to 9ab5dfa4 2473332 wikitext text/x-wiki megyg2oggjdecjr4yif07li5bo3565b 2473586 2473332 2026-10-26T23:11:02Z Stashbot 7414 larssandergreen: civicrm upgraded from 9ab5dfa4 to 7980eec7 2473586 wikitext text/x-wiki m687ln0anyn1sqdxujakb2npczu3knu 0 459743 2473252 2444748 2026-10-26T15:14:19Z GModena (WMF) 20194 /* Runbooks */ 2473252 wikitext text/x-wiki jbp3kbmc85l297ht32xlj1tdghrpd2c 498 459970 2473494 2472672 2026-10-26T20:06:26Z Stashbot 7414 iridescence: deployed v0.11.6 (by DiFronzo on GitHub) 2473494 wikitext text/x-wiki pfausy5f05eenyp7zfelq3sdxchd0yi 0 460024 2473249 2398660 2026-10-26T15:12:50Z GModena (WMF) 20194 Add catlinks 2473249 wikitext text/x-wiki tbs79pcvcaxhu1w8tue947cwei3hbdo 0 460585 2473391 2460435 2026-10-26T17:38:15Z TBurmeister (WMF) 27417 Add additional link to example queries repo 2473391 wikitext text/x-wiki pium1kfwqwumqkbc27dbco8l1k8351v 0 460627 2473607 2472738 2026-10-27T02:52:12Z AKhatun (WMF) 50461 /* Roll Out */ 2473607 wikitext text/x-wiki 2sboat75usepimvnrjrsmgsjske7ob5 2473608 2473607 2026-10-27T02:57:24Z AKhatun (WMF) 50461 /* Alerts */ Add alert in colored box 2473608 wikitext text/x-wiki e9u1tp6mfhzkamilznr4liyo4p4pt7q 2473610 2473608 2026-10-27T03:04:03Z AKhatun (WMF) 50461 /* Lambda */ Add anchort 2473610 wikitext text/x-wiki cl2rodn4760i1dalhesn4x21otexx52 2473625 2473610 2026-10-27T03:54:58Z AKhatun (WMF) 50461 /* Lambda */ Refine some alerts actions 2473625 wikitext text/x-wiki ljc1v3z6x6kd6hmb9b5j47i5rwlsvy0 0 460646 2473554 2472104 2026-10-26T22:03:15Z BKing (WMF) 29017 2473554 wikitext text/x-wiki 6110vfzp551g9fbtzk7in7lee4mrk25 498 460727 2473493 2472671 2026-10-26T20:05:44Z Stashbot 7414 iridescence: deployed face-service-v0.11.6 (by DiFronzo on GitHub) 2473493 wikitext text/x-wiki omn25g83jo3i7ylvzri7nav7ut57lak 1 460744 2473237 2461725 2026-10-26T15:09:22Z Ottomata 88 2473237 wikitext text/x-wiki k9jm4efwfzkjgn1qh8n6ko3zhp5weov 0 460840 2473106 2472882 2026-10-26T13:11:14Z DCaro (WMF) 18271 /* What is the plan for bringing Toolforge services back online? */ updated the toolforge note 2473106 wikitext text/x-wiki nboz7e3wkjvt1pajop57tk74hzamsvq 2473214 2473106 2026-10-26T14:35:45Z Taavi-WMF 41365 php 8.2 is back 2473214 wikitext text/x-wiki 4l8xnqnpihfqfoyg65anky5cmzmccdg 2473219 2473214 2026-10-26T14:47:52Z BPiovesan-WMF 56466 /* Availability of Wikimedia services */ update on Cloud Demo and Beta Cluster 2473219 wikitext text/x-wiki jfpljka60gh96nvg69smmjb7wyw9kb8 2473348 2473219 2026-10-26T17:06:53Z AndrewBogott (WMF) 51047 /* Availability of Wikimedia services */ 2473348 wikitext text/x-wiki 21mya40rlhqntjarlj654oxtfoieh1c 2473870 2473348 2026-10-27T10:08:00Z APuthin-WMF 52425 Update status of Cloud VPS project enablement 2473870 wikitext text/x-wiki clsbgqju4mgn6xe7ou6wv3qejnd31ps 2473896 2473870 2026-10-27T10:30:10Z Taavi-WMF 41365 upgrade wording to clarify most Cloud VPS projects are back 2473896 wikitext text/x-wiki 8s4p9ptn5qdyz0efyyp0x286lljyh2d 1 460842 2473110 2473001 2026-10-26T13:17:20Z DCaro (WMF) 18271 /* Exceptions */ updated toolforge instructions to the buildserivce php unblocking 2473110 wikitext text/x-wiki iykmzdd6sjog49gtec7u82hxynzok43 2473112 2473110 2026-10-26T13:18:49Z Bawolff 130 /* CropTool */ Reply 2473112 wikitext text/x-wiki 2g5jp5e1ecbfwitw3w49f7u5m53njoj 2473113 2473112 2026-10-26T13:21:12Z DCaro (WMF) 18271 /* CropTool */ Reply 2473113 wikitext text/x-wiki e2im1n7njomrf7jiav1a39u05jr12je 2473281 2473113 2026-10-26T15:50:18Z DamianZaremba 54 /* Other WMCS (no PHP) */ Reply 2473281 wikitext text/x-wiki f2p3ri07a2naoc9icvdrlzepiqsrlwl 2473283 2473281 2026-10-26T15:53:23Z Taavi-WMF 41365 php 8.2 2473283 wikitext text/x-wiki mltny0q1f294818zxu7ncks09zrxjay 2473286 2473283 2026-10-26T15:54:58Z Taavi-WMF 41365 /* Cloud VPS (no PHP) */ move done items to collapsed block 2473286 wikitext text/x-wiki ff6gbzrila41tvr3ku7el59qwmjhnp5 2473340 2473286 2026-10-26T17:00:28Z Alien333 39666 /* Other WMCS (no PHP) */ reply to DamianZaremba ([[mw:c:Special:MyLanguage/User:JWBTH/CD|CD]]) 2473340 wikitext text/x-wiki ig3bu34o315dmqoqszjxfi6jxcmtw7n 2473394 2473340 2026-10-26T17:39:56Z Taavi-WMF 41365 wm-bot 2473394 wikitext text/x-wiki axp4ogreg0tc2v1zwgj4xccj45d01qa 2473405 2473394 2026-10-26T17:50:51Z Taavi-WMF 41365 mark some done as done 2473405 wikitext text/x-wiki 85vzghodt33ssl6lnkxs45d9xh881gz 2473412 2473405 2026-10-26T18:00:07Z Taavi-WMF 41365 wikistats + wikisource done 2473412 wikitext text/x-wiki 2k7zamsg2l1p0cu0jvil6jitx93yzhk 2473433 2473412 2026-10-26T18:34:55Z AntiCompositeNumber 14764 ce 2473433 wikitext text/x-wiki 7vynfy5pisx26k51skcsn3al3l4csj1 2473463 2473433 2026-10-26T19:21:33Z Ahecht 5894 /* CropTool */ Reply 2473463 wikitext text/x-wiki qujp605oljp6en30d0r3nw3569dgcne 2473582 2473463 2026-10-26T23:08:45Z Saper 135 /* Cloud VPS (PHP) */ maps not quite done 2473582 wikitext text/x-wiki bxiq2m88nxo700t9ojwe8x9fhakia49 2473583 2473582 2026-10-26T23:09:29Z Saper 135 /* Cloud VPS (PHP) */ ssh is there 2473583 wikitext text/x-wiki 5s078ah97bink9ywyjas15fadsqzw7p 2473585 2473583 2026-10-26T23:10:19Z Saper 135 /* Cloud VPS (PHP) */ php 7.4 here and there 2473585 wikitext text/x-wiki 3eugt7bw9804jnxvzfuzcsng6xbp2or 2473597 2473585 2026-10-27T02:01:48Z Bawolff 130 /* CropTool */ Reply 2473597 wikitext text/x-wiki dguuexyag41uhpcwft87c9y0w4cp8ij 2473598 2473597 2026-10-27T02:09:47Z Doc James 5804 /* CropTool */ Reply 2473598 wikitext text/x-wiki tb85u5ngtbu6bs6jjytcmcda5qi9lr7 2473599 2473598 2026-10-27T02:10:05Z Doc James 5804 /* CropTool */ 2473599 wikitext text/x-wiki 5xfliwsfsq98duqzz4ryq5mwcefnex8 2473624 2473599 2026-10-27T03:52:58Z Leonprimer 43301 /* CropTool */ 2473624 wikitext text/x-wiki sq4yb6oz7q6khdkhqbrdk1mn86moi7s 2473635 2473624 2026-10-27T03:59:02Z Leonprimer 43301 /* CropTool */ 2473635 wikitext text/x-wiki b2wae4sm0dmkzdrfdmsvb2swajygq9r 2473843 2473635 2026-10-27T09:46:35Z Taavi-WMF 41365 azwikimedia done 2473843 wikitext text/x-wiki s58vcf6j5owhytdzr7ja6a28sq9d4pz 2473844 2473843 2026-10-27T09:46:54Z Taavi-WMF 41365 /* PAWS tool */ Reply 2473844 wikitext text/x-wiki grgxicmds94csv61c5o7qtw8oz1wvmg 2473847 2473844 2026-10-27T09:48:30Z Ricki Jay (WMDE) 52108 /* Cloud VPS (no PHP) */ 2473847 wikitext text/x-wiki djz29km4qlxeip1set4dqqyoejz20b2 2473848 2473847 2026-10-27T09:48:33Z Taavi-WMF 41365 /* CropTool */ Reply 2473848 wikitext text/x-wiki gypxj8dlm3afhkgaqqqfmf8ytz9xh01 2473869 2473848 2026-10-27T10:07:13Z Taavi-WMF 41365 /* Cloud VPS (no PHP) */ Reply 2473869 wikitext text/x-wiki ey6mwyfxwp7pmimx48j542fqc5vklhe 2473875 2473869 2026-10-27T10:12:43Z Ricki Jay (WMDE) 52108 /* Cloud VPS (no PHP) */ Reply 2473875 wikitext text/x-wiki 8xu74uqqn87mpk67dgan0rrvx6j6w8h 0 460876 2473075 2473046 2026-10-26T12:09:44Z Effie Mouzeli (WMF) 12880 how to depool a mediawiki ro deployment 2473075 wikitext text/x-wiki pys00vowen6dpelvu0z4yc66tqqres4 2473085 2473075 2026-10-26T12:18:57Z Effie Mouzeli (WMF) 12880 minor update 2473085 wikitext text/x-wiki b9vdktvbaddkhdo9cvh7u2837ylj5jd 0 460877 2473077 2026-10-26T12:11:58Z Taavi 13997 Redirected page to [[Portal:Cloud VPS/Admin/Octavia]] 2473077 wikitext text/x-wiki t7b45lk2ajqqs2pjblyx62th4a9tbtt 3 460878 2473178 2026-10-26T14:08:26Z StrikerBot 8475 Welcome to Toolforge! 2473178 wikitext text/x-wiki bqkb5p6xy9l4urnpase6ssymrpenn6c 0 460879 2473224 2026-10-26T14:54:35Z GModena (WMF) 20194 Created blank page 2473224 wikitext text/x-wiki phoiac9h4m842xq45sp7s6u21eteeq1 2473229 2473224 2026-10-26T14:57:33Z GModena (WMF) 20194 Add tuple drift runbook 2473229 wikitext text/x-wiki drtfc73h8c7n576rcr2bagvz1p3htv6 2473238 2473229 2026-10-26T15:09:33Z GModena (WMF) 20194 Add catlinks 2473238 wikitext text/x-wiki iq64zd2qgbcjfsu1t4u1wzwf82xywna 2473240 2473238 2026-10-26T15:11:03Z GModena (WMF) 20194 Add Runbooks catlink 2473240 wikitext text/x-wiki ssdv1g71coz98hju467egb2gh351k32 2473591 2473240 2026-10-26T23:34:18Z LErickson-WMF 51715 /* Resolution */ 2473591 wikitext text/x-wiki 8dv9u1f86y5ava4hinma7ebmd10cjma 116 460880 2473278 2026-10-26T15:36:22Z Valerio Bozzolan 10109 Created page with "{{Tool |templatemode = |name = itwiki-bot-cancellazioni |title = itwiki's deletion bot (bot cancellazioni) |description = Tools in use by [[w:it:Utente:BotCancellazioni]] |website = https://it.wikipedia.org/wiki/Utente:BotCancellazioni |keywords = itwiki |author = |username = Valerio_Bozzolan |maintainer = Valerio Bozzolan, Sakretsu, etc. |repository = <!-- various --> |license = AGPL-3.0+ |image = |phabricator = tool-i..." 2473278 wikitext text/x-wiki qcqgag319dvufz4agnf9pmbftfzr2o5 0 460881 2473284 2026-10-26T15:53:25Z AndrewBogott (WMF) 51047 Created page with "== fully restored == == to be investigated == == blocked pending security fixes ==" 2473284 wikitext text/x-wiki 23yyumiz4795lx09ha7lgnpv7yw6ke7 2473288 2473284 2026-10-26T16:05:44Z AndrewBogott (WMF) 51047 /* fully restored */ 2473288 wikitext text/x-wiki hg1ojgc2xhchoc3usbq6m3xbwn6kxxr 2473303 2473288 2026-10-26T16:19:36Z AndrewBogott (WMF) 51047 2473303 wikitext text/x-wiki 8y2kv0vlnjeb0vhm55zazvum0t19y5t 2473305 2473303 2026-10-26T16:21:46Z AndrewBogott (WMF) 51047 2473305 wikitext text/x-wiki esama0dhmf0jc9rv2zluf487h05j95v 2473308 2473305 2026-10-26T16:29:43Z AndrewBogott (WMF) 51047 /* blocked pending security fixes */ 2473308 wikitext text/x-wiki cqy8uabe2hm52vmmrp6ikbrz1tx26ok 2473309 2473308 2026-10-26T16:30:12Z AndrewBogott (WMF) 51047 /* not yet investigated */ 2473309 wikitext text/x-wiki 8ki3bmrf5wz2beeanzxvine0qc77msq 2473310 2473309 2026-10-26T16:31:57Z Taavi-WMF 41365 wcdo 2473310 wikitext text/x-wiki bobnza50y69ipk3wqfqifin021inkvj 2473312 2473310 2026-10-26T16:34:51Z Taavi-WMF 41365 webperf apparently fixed 2473312 wikitext text/x-wiki h8uchbmt8tpmuk8of3zpinbxxp81c1e 2473313 2473312 2026-10-26T16:36:50Z Taavi-WMF 41365 some more 2473313 wikitext text/x-wiki rkxtr9wu6rdhppuv36mmubl7wo6g595 2473315 2473313 2026-10-26T16:37:11Z Taavi-WMF 41365 a 2473315 wikitext text/x-wiki 21m6az2b7jovke1fg4axbs8eycpmoqy 2473322 2473315 2026-10-26T16:41:02Z Taavi-WMF 41365 teyora shutdown 2473322 wikitext text/x-wiki nab2z2pl4wlfur9yo135mh5zg4gz5h2 2473324 2473322 2026-10-26T16:43:13Z Taavi-WMF 41365 swift 2473324 wikitext text/x-wiki ffzbvrgnhoka3v7ymh40zg4yzin94v3 2473328 2473324 2026-10-26T16:45:44Z Taavi-WMF 41365 superset 2473328 wikitext text/x-wiki 1s7jar6y7u3z5849vy4xvtinlth50ss 2473329 2473328 2026-10-26T16:47:12Z AndrewBogott (WMF) 51047 /* shut off before incident; no action taken so far */ 2473329 wikitext text/x-wiki q3sgtnd9lnfvvgw8wqw66dwybdttzpu 2473330 2473329 2026-10-26T16:47:30Z AndrewBogott (WMF) 51047 /* egress network blocked pending security fixes */ 2473330 wikitext text/x-wiki f0qaodhvq5ry2zl7w8j47pdbfp6ddte 2473331 2473330 2026-10-26T16:47:33Z Taavi-WMF 41365 suggestbot 2473331 wikitext text/x-wiki hmzes8cpm7l6x6srdkbrtic3ciinj6p 2473333 2473331 2026-10-26T16:49:50Z AndrewBogott (WMF) 51047 /* ingress network blocked pending security fixes */ 2473333 wikitext text/x-wiki r9h6f2x74a0ygm5hikhz1c316r8zkty 2473334 2473333 2026-10-26T16:51:05Z Taavi-WMF 41365 striker needs php upgrade 2473334 wikitext text/x-wiki 19mis68hjk6xa1hhs53igqfcdyewr0p 2473335 2473334 2026-10-26T16:51:32Z AndrewBogott (WMF) 51047 /* fully restored */ 2473335 wikitext text/x-wiki py50vcwi8bfpwzobitgxzb2kzcbemmu 2473337 2473335 2026-10-26T16:53:53Z Taavi-WMF 41365 spi-tools 2473337 wikitext text/x-wiki i5mbis3e5pthw5cwkrxewqt2qzzjlx8 2473339 2473337 2026-10-26T16:56:46Z Taavi-WMF 41365 signwriting 2473339 wikitext text/x-wiki ardaol2hjtunss35u0eakkac3hnvubo 2473343 2473339 2026-10-26T17:02:09Z Taavi-WMF 41365 reading-web-staging needs php upgrades 2473343 wikitext text/x-wiki 0qj74aocj4v8kavco51lhrasdefchqs 2473344 2473343 2026-10-26T17:03:03Z Taavi-WMF 41365 rcm empty project 2473344 wikitext text/x-wiki nirbgoki2g5azb9hxiash7hixojf9ii 2473346 2473344 2026-10-26T17:06:39Z Taavi-WMF 41365 prove done 2473346 wikitext text/x-wiki 05k94xqat0n3i6s2jrdtq0107e60zbf 2473353 2473346 2026-10-26T17:12:51Z Taavi-WMF 41365 packaging has etherpad builders with php 2473353 wikitext text/x-wiki qzxcfbqfo5706gwpnhjq3leclbdzyfj 2473361 2473353 2026-10-26T17:16:34Z RCoccioli (WMF) 7416 Opened wmcz-stats 2473361 wikitext text/x-wiki 67tnbdc5qjpvlgubvwq9xwuqgbsfnwz 2473362 2473361 2026-10-26T17:18:14Z Taavi-WMF 41365 testlabs ok 2473362 wikitext text/x-wiki r1x1foqx283ea1d2pvgy75tmw6mabdl 2473371 2473362 2026-10-26T17:27:10Z AndrewBogott (WMF) 51047 /* shut off before incident; no action taken so far */ 2473371 wikitext text/x-wiki 4027zasx22nj6uyg8ns0nqpdip5pzo0 2473372 2473371 2026-10-26T17:27:34Z AndrewBogott (WMF) 51047 /* ingress network blocked pending security fixes */ 2473372 wikitext text/x-wiki 6d1ryh57yw9ab7isv6z0ig8yatemwu3 2473377 2473372 2026-10-26T17:31:20Z AndrewBogott (WMF) 51047 /* not yet investigated */ 2473377 wikitext text/x-wiki 30cnm34oktkk6vn23fdjkj35wwqfpzz 2473378 2473377 2026-10-26T17:31:55Z AndrewBogott (WMF) 51047 /* ingress and egress network blocked pending security fixes */ 2473378 wikitext text/x-wiki dvhvjrroqnvtke3zitxly1rvq5e8f9c 2473379 2473378 2026-10-26T17:32:05Z AndrewBogott (WMF) 51047 /* not yet investigated */ 2473379 wikitext text/x-wiki p06x9olcvvpkygzj2ahz8r7begdg7wk 2473382 2473379 2026-10-26T17:33:34Z AndrewBogott (WMF) 51047 /* not yet investigated */ 2473382 wikitext text/x-wiki kauo4lgqnfkaynf7gso71msz5dx67q7 2473383 2473382 2026-10-26T17:33:50Z AndrewBogott (WMF) 51047 /* fully restored */ 2473383 wikitext text/x-wiki 5pzbbyg6l08ezrjnr80q0rou1lasb93 2473385 2473383 2026-10-26T17:34:45Z AndrewBogott (WMF) 51047 /* fully restored */ 2473385 wikitext text/x-wiki d5trmcxv6zhe8yfbrdxx8x3io166pbn 2473386 2473385 2026-10-26T17:34:55Z AndrewBogott (WMF) 51047 /* not yet investigated */ 2473386 wikitext text/x-wiki oz8hsyvn6c81m67ehp7apunv9wrrl5k 2473389 2473386 2026-10-26T17:36:25Z Taavi-WMF 41365 wm-bot updated 2473389 wikitext text/x-wiki n5b4ylww6vqew1xu7h8m8s24gr25i2d 2473392 2473389 2026-10-26T17:38:35Z AndrewBogott (WMF) 51047 /* not yet investigated */ 2473392 wikitext text/x-wiki 4zwte52rvgocygl5zwowdrjwyrb5pro 2473393 2473392 2026-10-26T17:38:53Z AndrewBogott (WMF) 51047 /* ingress and egress network blocked pending security fixes */ 2473393 wikitext text/x-wiki 6g3v38wcpdfaqye1rkxeynlhhoh9d8g 2473399 2473393 2026-10-26T17:43:00Z AndrewBogott (WMF) 51047 /* not yet investigated */ 2473399 wikitext text/x-wiki budbmt0o1coznbrazx78ah60uf4lmo9 2473400 2473399 2026-10-26T17:43:15Z AndrewBogott (WMF) 51047 /* ingress and egress network blocked pending security fixes */ 2473400 wikitext text/x-wiki mp0our1g7tsxqnftsnjqgv44s916vyw 2473411 2473400 2026-10-26T17:59:46Z Taavi-WMF 41365 wikisource 2473411 wikitext text/x-wiki 95lzep8hsgslvcnqf2nag0xihy50lvx 2473421 2473411 2026-10-26T18:18:38Z AndrewBogott (WMF) 51047 2473421 wikitext text/x-wiki 9hdvxcunagixoresqbioh0xxiyj3qa9 2473422 2473421 2026-10-26T18:20:03Z RCoccioli (WMF) 7416 /* ingress and egress network blocked pending security fixes */ remove spurious line 2473422 wikitext text/x-wiki i0kbv0c7uoi62q20y2r22gibcwtdrzp 2473431 2473422 2026-10-26T18:32:50Z RCoccioli (WMF) 7416 Updated catalyst* 2473431 wikitext text/x-wiki dk6g88t6826jlgrn6l2o0x3hi9scpco 2473434 2473431 2026-10-26T18:35:16Z Taavi-WMF 41365 wikispore 2473434 wikitext text/x-wiki c5p9s2m3qhsl4zk7mb1psxon9em97uy 2473436 2473434 2026-10-26T18:37:35Z RCoccioli (WMF) 7416 /* ingress and egress network blocked pending security fixes */ fix typo 2473436 wikitext text/x-wiki j1rz45rdfdl5zlbcyj6imq2svn4yc5h 2473439 2473436 2026-10-26T18:40:40Z AndrewBogott (WMF) 51047 /* fully restored */ 2473439 wikitext text/x-wiki c9v8uqoaqga6dplnyms6z7w6aa58w9g 2473440 2473439 2026-10-26T18:40:48Z AndrewBogott (WMF) 51047 /* ingress network blocked; security fixes in progress */ 2473440 wikitext text/x-wiki 1hwovai2yfplvemyjv2bcd7w8movd3z 2473441 2473440 2026-10-26T18:41:28Z Taavi-WMF 41365 wikispeech 2473441 wikitext text/x-wiki 15hsndtf5c835e3yk9vz1ya8xxjpayf 2473446 2473441 2026-10-26T18:48:43Z Taavi-WMF 41365 wikisp done 2473446 wikitext text/x-wiki 7bo3bwm49hwup8x6tiw0k87cgutk53i 2473448 2473446 2026-10-26T18:50:45Z Taavi-WMF 41365 acc pending fixes 2473448 wikitext text/x-wiki 5htjvchu693ok9knnqb3lw0fwbh7xyy 2473600 2473448 2026-10-27T02:32:24Z AndrewBogott (WMF) 51047 /* ingress and egress network blocked pending security fixes */ 2473600 wikitext text/x-wiki gcgzmy4lf7r7zawq0yuiltf3ckbwcdv 2473601 2473600 2026-10-27T02:32:33Z AndrewBogott (WMF) 51047 /* ingress network blocked; security fixes in progress */ 2473601 wikitext text/x-wiki q38aq448bdnbevr39cuzumbaz5rhnap 2473602 2473601 2026-10-27T02:38:06Z AndrewBogott (WMF) 51047 2473602 wikitext text/x-wiki bjek9vg86d9njxm2b1l3ecew4zcgt7o 2473603 2473602 2026-10-27T02:39:20Z AndrewBogott (WMF) 51047 2473603 wikitext text/x-wiki h6j38bvvuthlqw9fmhep9lsxvq50lps 2473604 2473603 2026-10-27T02:40:54Z AndrewBogott (WMF) 51047 /* ingress network blocked; security fixes in progress */ 2473604 wikitext text/x-wiki kjv4hlvysyem1tvx0r7rxs3uvseibyp 2473788 2473604 2026-10-27T09:04:46Z Taavi-WMF 41365 mobileappsperformance allows ssh+egress as well 2473788 wikitext text/x-wiki 539490cup6kjp5ru23r723onuwfkek9 2473799 2473788 2026-10-27T09:11:28Z Taavi-WMF 41365 restore azwikimedia 2473799 wikitext text/x-wiki rqoq7bbrrr1bbdc4ea2tp81m8qms94e 2473808 2473799 2026-10-27T09:17:54Z Taavi-WMF 41365 wikidata-reconciliation already open 2473808 wikitext text/x-wiki rh1ewsxa2grzxuq6op6vuziwe3jbj5u 2473818 2473808 2026-10-27T09:28:21Z Taavi-WMF 41365 reading-web-staging 2473818 wikitext text/x-wiki 6l3194s6qs34xdd6c50wmkjmv4qk73j 2473821 2473818 2026-10-27T09:30:57Z Taavi-WMF 41365 packaging 2473821 wikitext text/x-wiki 1owtfbzwkusp8q0sgg7xz6ulcbwxn8b 2473830 2473821 2026-10-27T09:38:56Z Taavi-WMF 41365 language is back 2473830 wikitext text/x-wiki if5o4hmnitkijlopn3mch4fyhxy3trj 2473834 2473830 2026-10-27T09:40:16Z Taavi-WMF 41365 impactvisualizer 2473834 wikitext text/x-wiki 267x1lxs5kyi6hvx3z08l3m3exf5mx1 2473893 2473834 2026-10-27T10:26:49Z Taavi-WMF 41365 imagor is back 2473893 wikitext text/x-wiki qcdstv996bgyj02ay5oy0jc7nonu6mn 0 460882 2473302 2026-10-26T16:18:58Z CStone (WMF) 38439 Created page with "will add more!" 2473302 wikitext text/x-wiki ekxhzg5ekhr7n5uk95cl151pznzlf48 3 460883 2473477 2026-10-26T19:40:54Z StrikerBot 8475 Welcome to Toolforge! 2473477 wikitext text/x-wiki 37zm9tn2qxmjc9v91lethkbl9aws1dj 3 460884 2473480 2026-10-26T19:42:54Z StrikerBot 8475 Welcome to Toolforge! 2473480 wikitext text/x-wiki f3urtx0aivalxizssrt902uw5ni043u 3 460885 2473488 2026-10-26T19:50:47Z StrikerBot 8475 Welcome to Toolforge! 2473488 wikitext text/x-wiki s9331p87ojzh25c9wr4ecwofppm6lj9 3 460886 2473489 2026-10-26T19:52:41Z StrikerBot 8475 Welcome to Toolforge! 2473489 wikitext text/x-wiki f2sey1er45h9ln7fygjkr5ierkmevy1 3 460887 2473499 2026-10-26T20:14:35Z StrikerBot 8475 Welcome to Toolforge! 2473499 wikitext text/x-wiki 7rtwx15d60fgwpt3qzd48sudxy5h2d4 3 460888 2473512 2026-10-26T20:26:39Z StrikerBot 8475 Welcome to Toolforge! 2473512 wikitext text/x-wiki 8ck1azd8a5adyyf5i8qt1nvxo76lky1 3 460889 2473523 2026-10-26T20:39:31Z StrikerBot 8475 Welcome to Toolforge! 2473523 wikitext text/x-wiki iwi1bombx8ev38lje1p1mr3849xdahv 116 460890 2473524 2026-10-26T20:41:12Z Valerio Bozzolan 10109 Created page with "{{Tool |templatemode = |name = itwiki-orfanizzabot |title = itwiki's orphanizer bot (OrfanizzaBot) |description = Tools in use by [[w:it:Utente:OrfanizzaBot]] |website = https://it.wikipedia.org/wiki/Utente:OrfanizzaBot |keywords = itwiki |author = |username = Valerio_Bozzolan |maintainer = Valerio Bozzolan, Sakretsu, etc. |repository = <!-- various --> |license = AGPL-3.0+ |image = |phabricator = tool-itwiki-orfanizzab..." 2473524 wikitext text/x-wiki 12i80own3nhl3m1mocpsm672tpo1hw9 2473527 2473524 2026-10-26T20:42:01Z Valerio Bozzolan 10109 repo 2473527 wikitext text/x-wiki 8mlz6w9j5idg68vagv19rde8x86d94j 2 460891 2473536 2026-10-26T21:05:44Z Xhoang888 61883 Sbh 2473536 wikitext text/x-wiki 2quqynxmsrcscsbrvmikvbel5bstolr 3 460892 2473838 2026-10-27T09:42:37Z StrikerBot 8475 Welcome to Toolforge! 2473838 wikitext text/x-wiki oc0uqt13yeduzmzslsiufnhq9tplcrc