Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.17 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 3086 2452151 2452120 2026-08-27T13:20:01Z Stashbot 7414 fnegri@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component builds-api 2452151 wikitext text/x-wiki gyxiqpyanm948g10m8dxrq9hmynaizh 2452152 2452151 2026-08-27T13:20:44Z Stashbot 7414 fnegri@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api 2452152 wikitext text/x-wiki jgmh6jg83lx643m0wc5986c5xxeaurf 2452153 2452152 2026-08-27T13:25:42Z Stashbot 7414 fnegri@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component builds-api 2452153 wikitext text/x-wiki 68fb63k2gii6s041op9u9a50xfvm3qm 2452154 2452153 2026-08-27T13:26:01Z Stashbot 7414 fnegri@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api 2452154 wikitext text/x-wiki 9gugjs7edg5zc6q8p5h4t5degfvkjz8 2452159 2452154 2026-08-27T13:34:53Z Stashbot 7414 fnegri@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component builds-api 2452159 wikitext text/x-wiki pp75riqb68hlrym2d3fk963u0ysmomu 2452167 2452159 2026-08-27T13:39:43Z Stashbot 7414 fnegri@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api 2452167 wikitext text/x-wiki q4u2mtss3en09gkbzlgl9ymurpgwens 2452283 2452167 2026-08-27T16:30:23Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component maintain-harbor 2452283 wikitext text/x-wiki frnkau012foflmytqeqaf2nbwnsv5ux 2452286 2452283 2026-08-27T16:35:04Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-harbor 2452286 wikitext text/x-wiki 2xaaemx9yaa3vigyw0hn4jk360lol0b 0 4108 2452145 2452116 2026-08-27T12:45:06Z ScheduleDeploymentBot 37566 Add [[gerrit:1330420]] to Thursday, August 27 UTC afternoon backport window 2452145 wikitext text/x-wiki enx7txx2iqwxbo0h57q4fia6h1d5jbx 2452148 2452145 2026-08-27T13:01:04Z ScheduleDeploymentBot 37566 Add [[gerrit:1311058]] to Thursday, August 27 UTC afternoon backport window 2452148 wikitext text/x-wiki g2emfato04qi2xu3m8zeh214kv14px3 2452149 2452148 2026-08-27T13:01:16Z ScheduleDeploymentBot 37566 Add [[gerrit:1311059]] to Thursday, August 27 UTC afternoon backport window 2452149 wikitext text/x-wiki 83myrcpqsg7mjmbcm32cvtebpfc9eak 2452240 2452149 2026-08-27T15:38:12Z CMing (WMF) 23277 /* {{Deployment_day|date=2026-08-27}} */ 2452240 wikitext text/x-wiki 3k904lskrwtjfne18glmma0a6bq1mye 2452252 2452240 2026-08-27T16:05:37Z CMing (WMF) 23277 /* {{Deployment_day|date=2026-08-27}} */ 2452252 wikitext text/x-wiki n9ojtjf1dx5a839d4nsgmo8xc1wg0be 2452267 2452252 2026-08-27T16:19:31Z CMing (WMF) 23277 /* {{Deployment_day|date=2026-08-27}} */ 2452267 wikitext text/x-wiki qk9rojvr2h16f9xutolcgwbpv0svpbp 2452558 2452267 2026-08-27T20:11:30Z ScheduleDeploymentBot 37566 Add [[gerrit:1330486]] to Thursday, August 27 UTC late backport window 2452558 wikitext text/x-wiki 7gjsq6s0uw82gipnqzr4s9z91uiy6nt 0 4673 2452536 2432162 2026-08-27T18:35:26Z Taavi 13997 /* 2025-present */ new archive 2452536 wikitext text/x-wiki lv70u8ssdzt9ucmoouopxxv9huf8g3e 498 6726 2452155 2452122 2026-08-27T13:28:40Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component builds-api 2452155 wikitext text/x-wiki l239sb96mn2h6vgo4qa27u2mjtpl4e5 2452157 2452155 2026-08-27T13:29:04Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api 2452157 wikitext text/x-wiki 2c7ixo4gspuz8zqpbugm1h3df5i6w81 2452274 2452157 2026-08-27T16:22:39Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component builds-api 2452274 wikitext text/x-wiki sbobte0y3watgz1m0jy1rw0ravxw51k 2452279 2452274 2026-08-27T16:26:47Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api 2452279 wikitext text/x-wiki dtxe3tqsui0n9g8e20ydooz5qus0leg 2452280 2452279 2026-08-27T16:27:52Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component maintain-harbor 2452280 wikitext text/x-wiki 35q6ybe3vzbpzvtoc097t0xp5p9xo5n 2452282 2452280 2026-08-27T16:29:40Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-harbor 2452282 wikitext text/x-wiki l30cqqr399iawfv9apiudusnl1t7kqf 0 7919 2452130 2452109 2026-08-27T12:13:22Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . 2452130 wikitext text/x-wiki ja961i9sbhtpiodjyqoy8bgu47juahw 2452131 2452130 2026-08-27T12:13:26Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'llm' . 2452131 wikitext text/x-wiki 3gj0ps0ls8onkaj5jya7bi4epuu8a2c 2452132 2452131 2026-08-27T12:16:03Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . 2452132 wikitext text/x-wiki llaqhta4lc86ykpq77kp4frdwsngdvn 2452133 2452132 2026-08-27T12:16:07Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'llm' . 2452133 wikitext text/x-wiki t86bf6sgfg4wa5s54rs36n4wqxdoan3 2452134 2452133 2026-08-27T12:20:21Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. 2452134 wikitext text/x-wiki 98n6vn7hbjni8uqn8w1ji2xvkevaqcp 2452135 2452134 2026-08-27T12:22:22Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. 2452135 wikitext text/x-wiki az7ufxb2dhglzrr5m0pqwrg015tkz25 2452136 2452135 2026-08-27T12:27:09Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . 2452136 wikitext text/x-wiki h5cvl3kddisenhi63ogv4wtq6ggj46u 2452137 2452136 2026-08-27T12:27:13Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'llm' . 2452137 wikitext text/x-wiki q1ktnedmpycnh6yghp2yfekzxg2fi86 2452138 2452137 2026-08-27T12:28:17Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. 2452138 wikitext text/x-wiki qivb33cmhfwleesnpc8a6i9sb3mwuq2 2452139 2452138 2026-08-27T12:30:18Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. 2452139 wikitext text/x-wiki 1z0m14xftsxtrlopocrpclcfeox8bfu 2452140 2452139 2026-08-27T12:31:34Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . 2452140 wikitext text/x-wiki bt8eeijp7lko9kws2t4fs15piu5sg38 2452141 2452140 2026-08-27T12:31:40Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'llm' . 2452141 wikitext text/x-wiki ka6r9ji8jvyoq8hm1w8r36ezljh57c3 2452142 2452141 2026-08-27T12:36:15Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . 2452142 wikitext text/x-wiki kkb20nrsjf1dryr0ignv26lqm7e6fth 2452143 2452142 2026-08-27T12:36:20Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'llm' . 2452143 wikitext text/x-wiki jyry60j1a0zl86lx1l1o8c5inqkuh3b 2452146 2452143 2026-08-27T12:55:39Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/mediawiki-dumps-legacy: apply 2452146 wikitext text/x-wiki tgw6dqaibnws18j2gk0clnm77me40mo 2452147 2452146 2026-08-27T12:55:49Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/mediawiki-dumps-legacy: apply 2452147 wikitext text/x-wiki hk5ccy4p3sbvtzrj0ipeff1cvu0ssda 2452150 2452147 2026-08-27T13:09:14Z Stashbot 7414 mfossati@deploy1003: Started scap sync-world: Backport for [[gerrit:1329672|Minimal Minerva: change label from "comments" to "discussion" (T436141)]] 2452150 wikitext text/x-wiki kfp3txf88dl2xnjf4f1fceq9ge0v7je 2452156 2452150 2026-08-27T13:29:01Z Stashbot 7414 mfossati@deploy1003: lwatson, mfossati: Backport for [[gerrit:1329672|Minimal Minerva: change label from "comments" to "discussion" (T436141)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2452156 wikitext text/x-wiki qo91azh8oo4x7521c8ainb70hzkn7iw 2452158 2452156 2026-08-27T13:29:54Z Stashbot 7414 mfossati@deploy1003: lwatson, mfossati: Continuing with deployment 2452158 wikitext text/x-wiki cy6dk13v84h1cahbc7rcwdfafwrn27a 2452168 2452158 2026-08-27T13:43:20Z Stashbot 7414 mfossati@deploy1003: Finished scap sync-world: Backport for [[gerrit:1329672|Minimal Minerva: change label from "comments" to "discussion" (T436141)]] (duration: 34m 06s) 2452168 wikitext text/x-wiki j89xnjn4h9eutvx8vub3jmosdnxalif 2452169 2452168 2026-08-27T13:53:48Z Stashbot 7414 daniel@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-experimental: apply 2452169 wikitext text/x-wiki socc2fcz0scmqt0adzsl12q3ttdtuck 2452170 2452169 2026-08-27T14:01:02Z Stashbot 7414 daniel@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-experimental: apply 2452170 wikitext text/x-wiki knn53kcp129d9c4w0z9oq4behyuzplu 2452171 2452170 2026-08-27T14:09:43Z Stashbot 7414 stran@deploy1003: Started scap sync-world: Backport for [[gerrit:1330420|Enable SuggestedInvestigations front-end for eswiki and jawiki (T435757)]] 2452171 wikitext text/x-wiki sw86ewxhz8ykqwla2fa0b7jzzcggpo5 2452172 2452171 2026-08-27T14:14:04Z Stashbot 7414 stran@deploy1003: stran: Backport for [[gerrit:1330420|Enable SuggestedInvestigations front-end for eswiki and jawiki (T435757)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2452172 wikitext text/x-wiki 6iumh18baj68w27hp1kg7an9fimpcy1 2452175 2452172 2026-08-27T14:15:32Z Stashbot 7414 stran@deploy1003: stran: Continuing with deployment 2452175 wikitext text/x-wiki bvo5ub8oi9m2yhapea8juh7vsy03s4j 2452176 2452175 2026-08-27T14:19:49Z Stashbot 7414 stran@deploy1003: Finished scap sync-world: Backport for [[gerrit:1330420|Enable SuggestedInvestigations front-end for eswiki and jawiki (T435757)]] (duration: 10m 06s) 2452176 wikitext text/x-wiki kniq0afmivef0524fx2h5mkiilm9pgv 2452177 2452176 2026-08-27T14:28:25Z Stashbot 7414 gmodena@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs-next: apply 2452177 wikitext text/x-wiki 0mu7mwo1x162lgtw6cxr3ptmlob7uw9 2452178 2452177 2026-08-27T14:29:07Z Stashbot 7414 gmodena@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs-next: apply 2452178 wikitext text/x-wiki eod9p2s7uhqw7qrhmlxt8bfgk57zjkw 2452179 2452178 2026-08-27T14:31:44Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.reboot-single for host registry1004.eqiad.wmnet 2452179 wikitext text/x-wiki d1tak4od5nopu6d7r273vwqp0hs4tl9 2452180 2452179 2026-08-27T14:36:12Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host registry1004.eqiad.wmnet 2452180 wikitext text/x-wiki i0hbnqijjqn3l3762zyubro6zglazzu 2452181 2452180 2026-08-27T14:37:14Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.reboot-single for host registry1005.eqiad.wmnet 2452181 wikitext text/x-wiki awkdrag1au49m0ic1rfof4cvw50o5dl 2452182 2452181 2026-08-27T14:37:28Z Stashbot 7414 gmodena@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs-next: apply 2452182 wikitext text/x-wiki o3tp3k27h68yphh6t7smxj8onwme3l9 2452183 2452182 2026-08-27T14:41:16Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.reboot-nodes rolling reboot on A:aux-worker-codfw 2452183 wikitext text/x-wiki fb7700cfekgz7t3ktb62s6pzt61ou3a 2452184 2452183 2026-08-27T14:41:20Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker2002.codfw.wmnet 2452184 wikitext text/x-wiki 3a8gr502b0yf03s0w16qplfvug7i3kl 2452185 2452184 2026-08-27T14:41:46Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host registry1005.eqiad.wmnet 2452185 wikitext text/x-wiki 9eaetgewevzziw15xxyjzpzjtnbm9qs 2452186 2452185 2026-08-27T14:42:22Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.reboot-single for host registry2005.codfw.wmnet 2452186 wikitext text/x-wiki lcbn47v327lpauv2rhnxztrdhhyvu6q 2452188 2452186 2026-08-27T14:46:22Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker2002.codfw.wmnet 2452188 wikitext text/x-wiki 68m68ogo18jnqlsyyqfvqixitjt6q2j 2452189 2452188 2026-08-27T14:47:00Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host registry2005.codfw.wmnet 2452189 wikitext text/x-wiki d6wmj8s03pjlavvqp4dm1q0ihe36pd8 2452191 2452189 2026-08-27T14:50:18Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.reboot-single for host registry2004.codfw.wmnet 2452191 wikitext text/x-wiki qa0mdkx36k2v8skn44h48s0f8thp682 2452192 2452191 2026-08-27T14:50:29Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker2002.codfw.wmnet 2452192 wikitext text/x-wiki jatavs5yo2sk8enzyd5qa2rz9nmdu6k 2452193 2452192 2026-08-27T14:50:33Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker2002.codfw.wmnet 2452193 wikitext text/x-wiki f3lqnxx8fxp6fuknxqhs698r51p9jop 2452194 2452193 2026-08-27T14:50:37Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker2003.codfw.wmnet 2452194 wikitext text/x-wiki elexc4rtdwquhtptephm9hyrcpvlv5o 2452195 2452194 2026-08-27T14:51:07Z Stashbot 7414 cdobbins@cumin1003: conftool action : set/pooled=no; selector: name=cp5022.* [reason: update IP addrs] 2452195 wikitext text/x-wiki ipi5hnrvayrzjck70ta2y76ignmb5aj 2452196 2452195 2026-08-27T14:51:10Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker2003.codfw.wmnet 2452196 wikitext text/x-wiki 47qj4jkkfilkyvk75s5oe10l578p5uk 2452197 2452196 2026-08-27T14:52:11Z Stashbot 7414 cdobbins@cumin1003: START - Cookbook sre.hosts.reimage for host cp5022.eqsin.wmnet with OS trixie 2452197 wikitext text/x-wiki 4n51he97bp7pas4bkp3z0p9460znca2 2452198 2452197 2026-08-27T14:54:53Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host registry2004.codfw.wmnet 2452198 wikitext text/x-wiki q243fih9718vvfivack20r6ud1uifvd 2452199 2452198 2026-08-27T14:55:14Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker2003.codfw.wmnet 2452199 wikitext text/x-wiki 6hvacib8mrsnb955anhr2iydds4pyp2 2452200 2452199 2026-08-27T14:55:17Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker2003.codfw.wmnet 2452200 wikitext text/x-wiki k2lclr10p6ckgxdri22l18z7yfr8n5r 2452201 2452200 2026-08-27T14:55:22Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker2004.codfw.wmnet 2452201 wikitext text/x-wiki efljf34apf1bohb1w7e58oyvp3xx9ja 2452202 2452201 2026-08-27T14:55:54Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker2004.codfw.wmnet 2452202 wikitext text/x-wiki jtbppmcplz9vnplxn2v7y9s7y0tue0s 2452203 2452202 2026-08-27T15:00:01Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker2004.codfw.wmnet 2452203 wikitext text/x-wiki javg68664h9ashapt12nor3svxbbhaz 2452204 2452203 2026-08-27T15:00:05Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker2004.codfw.wmnet 2452204 wikitext text/x-wiki 9nhcb6spp5c8b6rip57nkty0koqmt74 2452205 2452204 2026-08-27T15:00:09Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker2005.codfw.wmnet 2452205 wikitext text/x-wiki lv0oh83ib11fc8y7c0ebhqzjgbsafbc 2452206 2452205 2026-08-27T15:00:39Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker2005.codfw.wmnet 2452206 wikitext text/x-wiki gzwbydl5rr9znk14gszfucr5qw4bkqs 2452207 2452206 2026-08-27T15:04:44Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker2005.codfw.wmnet 2452207 wikitext text/x-wiki tdu1rsp6bkstbx5c2a0x5wwisum495v 2452208 2452207 2026-08-27T15:04:46Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker2005.codfw.wmnet 2452208 wikitext text/x-wiki j1jkr6sox0jtcj9c7rojqyh483rc8q2 2452209 2452208 2026-08-27T15:04:51Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker2006.codfw.wmnet 2452209 wikitext text/x-wiki nwjera2q5r63kd7olg6ic19p0jnkcvc 2452210 2452209 2026-08-27T15:05:28Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker2006.codfw.wmnet 2452210 wikitext text/x-wiki bshmdc79i10smvbplaenzsgpeaq65vm 2452212 2452210 2026-08-27T15:11:00Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker2006.codfw.wmnet 2452212 wikitext text/x-wiki 69vu9vssgpk1nk74micflwuruwg3v4p 2452213 2452212 2026-08-27T15:11:04Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker2006.codfw.wmnet 2452213 wikitext text/x-wiki 1s14rqlhs69e71p0age7vf0oh26s647 2452214 2452213 2026-08-27T15:11:07Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker2007.codfw.wmnet 2452214 wikitext text/x-wiki rwn7kyfix464ewjh12a898co9usjt6n 2452215 2452214 2026-08-27T15:11:44Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker2007.codfw.wmnet 2452215 wikitext text/x-wiki 3czc2jsv9t6i8igbzyqwzmabv3bn2b2 2452216 2452215 2026-08-27T15:14:11Z Stashbot 7414 krinkle@deploy1003: Started scap sync-world: Backport for [[gerrit:1311058|MathML+MathJax rollout to phase 3 (Wikibooks) (T271001)]], [[gerrit:1311059|MathML+MathJax rollout to phase 4 (Wikisource) (T271001)]] 2452216 wikitext text/x-wiki orx0foiaz328hxtbom9n4lgx1chznpg 2452217 2452216 2026-08-27T15:15:54Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.deploy.python-code homer to cumin2003.codfw.wmnet,cumin1003.eqiad.wmnet with reason: Homer - add function to wmf plugin to build rpm probe data - cmooney@cumin1003 2452217 wikitext text/x-wiki h5biep1x8imnmydyc1jem8vp0bc3vtj 2452218 2452217 2026-08-27T15:17:11Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker2007.codfw.wmnet 2452218 wikitext text/x-wiki 9rajdkl7xaw6q8pecdobm3qnom0mhoy 2452219 2452218 2026-08-27T15:17:14Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker2007.codfw.wmnet 2452219 wikitext text/x-wiki nttgcnx2t5o35iio247p21b3ho8giov 2452220 2452219 2026-08-27T15:17:18Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker2008.codfw.wmnet 2452220 wikitext text/x-wiki lnz9krumuc2ymecmqtz3qsdgbfauaaz 2452221 2452220 2026-08-27T15:17:32Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) homer to cumin2003.codfw.wmnet,cumin1003.eqiad.wmnet with reason: Homer - add function to wmf plugin to build rpm probe data - cmooney@cumin1003 2452221 wikitext text/x-wiki fvn4mha68hwsq8h13ue1bfnvduoucep 2452222 2452221 2026-08-27T15:17:54Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker2008.codfw.wmnet 2452222 wikitext text/x-wiki i1ht2ef9bagnmgeavfr3h4o5xllbrmx 2452223 2452222 2026-08-27T15:18:23Z Stashbot 7414 krinkle@deploy1003: krinkle: Backport for [[gerrit:1311058|MathML+MathJax rollout to phase 3 (Wikibooks) (T271001)]], [[gerrit:1311059|MathML+MathJax rollout to phase 4 (Wikisource) (T271001)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2452223 wikitext text/x-wiki 056aljjscxa0ogv5yjmng6zvfi6rr3y 2452224 2452223 2026-08-27T15:18:59Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.deploy.python-code homer to cumin2003.codfw.wmnet,cumin1003.eqiad.wmnet with reason: Homer - add function to wmf plugin to build rpm probe data - cmooney@cumin1003 2452224 wikitext text/x-wiki k6prwv0jg8qwlo4yj40enplbw62xn3y 2452225 2452224 2026-08-27T15:20:36Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) homer to cumin2003.codfw.wmnet,cumin1003.eqiad.wmnet with reason: Homer - add function to wmf plugin to build rpm probe data - cmooney@cumin1003 2452225 wikitext text/x-wiki fw3k55s5fz3ygzagoqko9lvdatu7v93 2452226 2452225 2026-08-27T15:23:14Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker2008.codfw.wmnet 2452226 wikitext text/x-wiki t75ez99ulpn1w1q9ocpu9x6y6sjkduj 2452227 2452226 2026-08-27T15:23:17Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker2008.codfw.wmnet 2452227 wikitext text/x-wiki 3sstlpk1sza5nu994ds0xichzdlr1bm 2452228 2452227 2026-08-27T15:23:22Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker2009.codfw.wmnet 2452228 wikitext text/x-wiki 9xf18cytsr3abfdwbm54mh7npvh4bcx 2452229 2452228 2026-08-27T15:23:26Z Stashbot 7414 krinkle@deploy1003: krinkle: Continuing with deployment 2452229 wikitext text/x-wiki 5k8ocymigtdq6xg5co6yb2837hefzf3 2452230 2452229 2026-08-27T15:24:19Z Stashbot 7414 cdobbins@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on cp5022.eqsin.wmnet with reason: host reimage 2452230 wikitext text/x-wiki bhc8q6j70j4km2ywk8lq6pev8khtr9q 2452231 2452230 2026-08-27T15:27:48Z Stashbot 7414 krinkle@deploy1003: Finished scap sync-world: Backport for [[gerrit:1311058|MathML+MathJax rollout to phase 3 (Wikibooks) (T271001)]], [[gerrit:1311059|MathML+MathJax rollout to phase 4 (Wikisource) (T271001)]] (duration: 13m 36s) 2452231 wikitext text/x-wiki dflyko8h0b1pcdvyqfglsukdu5iy2up 2452232 2452231 2026-08-27T15:28:14Z Stashbot 7414 dwisehaupt@dns1005: START - running authdns-update 2452232 wikitext text/x-wiki lvrvfqdeh4dkyo6m4ot1oidmbqx8j9o 2452233 2452232 2026-08-27T15:28:24Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker2009.codfw.wmnet 2452233 wikitext text/x-wiki bqq32qa5nc1v1vqfatsoythfhsfrokh 2452234 2452233 2026-08-27T15:28:29Z Stashbot 7414 cdobbins@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp5022.eqsin.wmnet with reason: host reimage 2452234 wikitext text/x-wiki jv4cgci7spnnxix6btrecyxccabliau 2452235 2452234 2026-08-27T15:30:53Z Stashbot 7414 dwisehaupt@dns1005: END - running authdns-update 2452235 wikitext text/x-wiki q3umdg8bvibimah8oqcgwzdfxwwf4by 2452236 2452235 2026-08-27T15:33:43Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker2009.codfw.wmnet 2452236 wikitext text/x-wiki i2dlc29vsqk4g9yqnglw67a8r4e40m1 2452237 2452236 2026-08-27T15:33:46Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker2009.codfw.wmnet 2452237 wikitext text/x-wiki of4cefq0t9dbjjxzls8uahvykrwoe4l 2452238 2452237 2026-08-27T15:33:49Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on A:aux-worker-codfw 2452238 wikitext text/x-wiki 3cmqbibuvo0qz05iv9ngnsgd76xdg6a 2452239 2452238 2026-08-27T15:38:10Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hosts.provision for host cassandra-dev2002.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2452239 wikitext text/x-wiki 3rxaoyy9e8qw0xukg64x2z7u4n5bdl7 2452241 2452239 2026-08-27T15:46:05Z Stashbot 7414 eevans@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cassandra-dev2002.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2452241 wikitext text/x-wiki mt5lz1ttxpb6jd7yf5nmvryix9req24 2452242 2452241 2026-08-27T15:50:56Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hosts.reimage for host cassandra-dev2002.codfw.wmnet with OS bookworm 2452242 wikitext text/x-wiki 6cncg9ad9acfaedkdg3fdwzos3tbb3q 2452243 2452242 2026-08-27T15:51:44Z Stashbot 7414 ladsgroup@deploy1003: Started scap sync-world: Backport for [[gerrit:1330491|Switch jawiki, zhwiki and ptwiki to thumb.wikimedia.org (T427465)]] 2452243 wikitext text/x-wiki 6tdt8hwifqx66vzkoxy1oqz0naydeki 2452244 2452243 2026-08-27T15:56:00Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup: Backport for [[gerrit:1330491|Switch jawiki, zhwiki and ptwiki to thumb.wikimedia.org (T427465)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2452244 wikitext text/x-wiki 5rgju2ysvyynh3be6kh2eesh66b81x5 2452245 2452244 2026-08-27T15:58:15Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup: Continuing with deployment 2452245 wikitext text/x-wiki 5857jow01gefxews2vyu0v4rcngjzkr 2452246 2452245 2026-08-27T15:59:00Z Stashbot 7414 eevans@cumin1003: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cassandra-dev2002.codfw.wmnet with OS bookworm 2452246 wikitext text/x-wiki g4b2dy3xwuh4ludxqnjrujb5dtendak 2452247 2452246 2026-08-27T16:00:56Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.reboot-nodes rolling reboot on A:aux-worker-eqiad 2452247 wikitext text/x-wiki 86g8dwcf9wx3dcwobl44xvpo9rp8n3i 2452248 2452247 2026-08-27T16:00:59Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker1002.eqiad.wmnet 2452248 wikitext text/x-wiki lbbyfglfw7xtrxyowt0c6sxcfelg7fl 2452249 2452248 2026-08-27T16:01:03Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hosts.provision for host cassandra-dev2002.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2452249 wikitext text/x-wiki lgsmgt0vehfj5zcwlq3rfd56znzdgcp 2452250 2452249 2026-08-27T16:01:33Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker1002.eqiad.wmnet 2452250 wikitext text/x-wiki ji8kfqbxkkatkjw5dosizg5edrovp6n 2452251 2452250 2026-08-27T16:02:32Z Stashbot 7414 ladsgroup@deploy1003: Finished scap sync-world: Backport for [[gerrit:1330491|Switch jawiki, zhwiki and ptwiki to thumb.wikimedia.org (T427465)]] (duration: 10m 47s) 2452251 wikitext text/x-wiki hsmmsydmlqhs16ptv0xtuejjp0sp5lw 2452253 2452251 2026-08-27T16:05:37Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker1002.eqiad.wmnet 2452253 wikitext text/x-wiki j3htz9cxitdi58rijkqhkg3f03ypxo8 2452254 2452253 2026-08-27T16:05:40Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker1002.eqiad.wmnet 2452254 wikitext text/x-wiki 77d70w9axmoi3qvyivacgmqqva5wp91 2452255 2452254 2026-08-27T16:05:45Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker1003.eqiad.wmnet 2452255 wikitext text/x-wiki t864qt88496rkia6osnga1fep4dm2b3 2452256 2452255 2026-08-27T16:06:19Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker1003.eqiad.wmnet 2452256 wikitext text/x-wiki tfnfra83uv09dhd9rknl2yve5im7i91 2452257 2452256 2026-08-27T16:10:26Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker1003.eqiad.wmnet 2452257 wikitext text/x-wiki 8uj1m9fv9oubpy1fcusj6ez8denvui8 2452258 2452257 2026-08-27T16:10:29Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker1003.eqiad.wmnet 2452258 wikitext text/x-wiki 0z2log4b1jg5b3cm06le4cyxfwnzjw8 2452259 2452258 2026-08-27T16:10:31Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker1004.eqiad.wmnet 2452259 wikitext text/x-wiki hlmrz2nwz3zxj7h9mx7ai2hime6at8f 2452260 2452259 2026-08-27T16:11:01Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker1004.eqiad.wmnet 2452260 wikitext text/x-wiki 0z2tyy52p38amdebt8ejwy4h9r0jfl6 2452261 2452260 2026-08-27T16:15:04Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker1004.eqiad.wmnet 2452261 wikitext text/x-wiki oyoe2tle5ny3s57pximg4ahoptz6i89 2452262 2452261 2026-08-27T16:15:07Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker1004.eqiad.wmnet 2452262 wikitext text/x-wiki jd79t98e3f5dw3y1gsdliqa75d17942 2452263 2452262 2026-08-27T16:15:11Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker1005.eqiad.wmnet 2452263 wikitext text/x-wiki o32b0wse3xm8gyztw3rjqa9pj0zvlkq 2452264 2452263 2026-08-27T16:15:45Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker1005.eqiad.wmnet 2452264 wikitext text/x-wiki r959a8gpd9sxbs4dtvah1delewucgua 2452265 2452264 2026-08-27T16:17:49Z Stashbot 7414 eevans@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cassandra-dev2002.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2452265 wikitext text/x-wiki c4tk76dofk9eewmesb94tt29mafc1ni 2452266 2452265 2026-08-27T16:18:32Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2452266 wikitext text/x-wiki rq80dlrefng9fcpcj6kloi4hcxu9yeb 2452268 2452266 2026-08-27T16:19:38Z Stashbot 7414 rzl@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-cron: apply 2452268 wikitext text/x-wiki 5tkki5k4zpjeib58cd1zenor8xas0tt 2452269 2452268 2026-08-27T16:19:48Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker1005.eqiad.wmnet 2452269 wikitext text/x-wiki flnral7s1slay2y245cgjm97htjrdia 2452270 2452269 2026-08-27T16:19:51Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker1005.eqiad.wmnet 2452270 wikitext text/x-wiki nqut3v4549y9peh7ynb4h4wa71i8zin 2452271 2452270 2026-08-27T16:19:56Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker1006.eqiad.wmnet 2452271 wikitext text/x-wiki r6dd8j4k3nuzyg9tqelp1frp0nibmg2 2452272 2452271 2026-08-27T16:20:10Z Stashbot 7414 rzl@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-cron: apply 2452272 wikitext text/x-wiki ehs7ppgn3tg3r85f01y87bjimehugvc 2452273 2452272 2026-08-27T16:20:28Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker1006.eqiad.wmnet 2452273 wikitext text/x-wiki m33nuxg9zjlvkxvel0r2x8xt9qf2u42 2452275 2452273 2026-08-27T16:23:52Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hosts.reimage for host cassandra-dev2002.codfw.wmnet with OS bookworm 2452275 wikitext text/x-wiki ef1o42p6p2wbev6hbq8dog5q4wz6i2p 2452276 2452275 2026-08-27T16:25:47Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker1006.eqiad.wmnet 2452276 wikitext text/x-wiki 7r0p7bo5sy9fvzes39uyx06q7wfjcgh 2452277 2452276 2026-08-27T16:25:50Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker1006.eqiad.wmnet 2452277 wikitext text/x-wiki a80s0reen40qac80wamopd8skcyok9w 2452278 2452277 2026-08-27T16:25:54Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker1007.eqiad.wmnet 2452278 wikitext text/x-wiki hc34teqmkw2i322kegs5h1y5dypv60z 2452281 2452278 2026-08-27T16:29:13Z Stashbot 7414 gmodena@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs-next: apply 2452281 wikitext text/x-wiki dwwylq7a5dcdaxb6v61cfljkie4p8an 2452284 2452281 2026-08-27T16:30:57Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker1007.eqiad.wmnet 2452284 wikitext text/x-wiki e88m3m1njbwn357ihdsdtlryzuq2wdy 2452287 2452284 2026-08-27T16:36:15Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker1007.eqiad.wmnet 2452287 wikitext text/x-wiki i9b5kc273oq2msew4kz6n4u8rzyjf9d 2452288 2452287 2026-08-27T16:36:18Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker1007.eqiad.wmnet 2452288 wikitext text/x-wiki rj24raobxt8yv3jtarmwqi4fsno28yf 2452289 2452288 2026-08-27T16:36:22Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker1008.eqiad.wmnet 2452289 wikitext text/x-wiki 6d8y46a6v9lfagw8y5zct1q503odk0f 2452290 2452289 2026-08-27T16:36:57Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker1008.eqiad.wmnet 2452290 wikitext text/x-wiki l5lfx0ekrft0xsoffj1jzutqi655gbn 2452291 2452290 2026-08-27T16:38:15Z Stashbot 7414 jforrester@deploy1003: helmfile [staging] START helmfile.d/services/wikifunctions: apply 2452291 wikitext text/x-wiki 2laqwa6z1vg0i8xh1h2n2nn6z8mjvoa 2452292 2452291 2026-08-27T16:38:54Z Stashbot 7414 jforrester@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifunctions: apply 2452292 wikitext text/x-wiki o5ex2i25r3wa51agrk1kblmwsggnacw 2452293 2452292 2026-08-27T16:39:40Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/apertium: apply 2452293 wikitext text/x-wiki fuwrk39zbu6pl8uxvg1o108vwt6rlet 2452294 2452293 2026-08-27T16:39:47Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/apertium: apply 2452294 wikitext text/x-wiki somqb7kxs91vm04eoozif0if9pfdwyt 2452295 2452294 2026-08-27T16:40:30Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on cassandra-dev2002.codfw.wmnet with reason: host reimage 2452295 wikitext text/x-wiki mdibtz2x6g1s7zur5ziq5oajh2i05cb 2452296 2452295 2026-08-27T16:40:42Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/chart-renderer: apply 2452296 wikitext text/x-wiki 7ktba4zaj8qd6ef8mwctbnufobxys85 2452297 2452296 2026-08-27T16:40:56Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/chart-renderer: apply 2452297 wikitext text/x-wiki h4k3larp9gsaxe0l7wxuwwod1hnxa1d 2452298 2452297 2026-08-27T16:41:09Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply 2452298 wikitext text/x-wiki fobtntkw9d2pglnaw4qppx2iy6tio7c 2452299 2452298 2026-08-27T16:41:13Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply 2452299 wikitext text/x-wiki okamvjnkacopohlfx2ob6q72f68ch4p 2452300 2452299 2026-08-27T16:41:27Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/citoid: apply 2452300 wikitext text/x-wiki lh6yhykdeplumhkatxq7p1wythmppuu 2452301 2452300 2026-08-27T16:41:46Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/citoid: apply 2452301 wikitext text/x-wiki 49q8b7s436nacd0ew15b995i332wxoz 2452302 2452301 2026-08-27T16:41:52Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/commons-impact-analytics: apply 2452302 wikitext text/x-wiki 1l2utupgl6z0pwb24yoik184pmg6plq 2452303 2452302 2026-08-27T16:42:00Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/commons-impact-analytics: apply 2452303 wikitext text/x-wiki kb7zowq5swngddintauzacq5dgx1gi2 2452304 2452303 2026-08-27T16:42:16Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker1008.eqiad.wmnet 2452304 wikitext text/x-wiki 2ujteeyauxkg2mqg37ihmgql43bgnd1 2452305 2452304 2026-08-27T16:42:19Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker1008.eqiad.wmnet 2452305 wikitext text/x-wiki jibuhatnztfeojgiiajk680u68sw2c2 2452306 2452305 2026-08-27T16:42:22Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker1009.eqiad.wmnet 2452306 wikitext text/x-wiki fvi92y5u730clmhlntx5no62kqal098 2452307 2452306 2026-08-27T16:42:25Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/cxserver: apply 2452307 wikitext text/x-wiki fl0a6jdg212hyg5s4konpxgh6i1wnfn 2452308 2452307 2026-08-27T16:42:42Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/cxserver: apply 2452308 wikitext text/x-wiki h7xiy58obj2ocw4avtdweu6m82pgsj1 2452309 2452308 2026-08-27T16:42:57Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker1009.eqiad.wmnet 2452309 wikitext text/x-wiki f1tc5f5islmzpc9kxesry00zllp1yz9 2452310 2452309 2026-08-27T16:43:01Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/data-gateway: apply 2452310 wikitext text/x-wiki jbubd24o16147mq9cg93kiq78k64dsl 2452311 2452310 2026-08-27T16:43:25Z Stashbot 7414 eevans@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cassandra-dev2002.codfw.wmnet with reason: host reimage 2452311 wikitext text/x-wiki d17a73t92rq30gix8ctqeee614vr7hj 2452312 2452311 2026-08-27T16:44:46Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/data-gateway: apply 2452312 wikitext text/x-wiki 29apjowmpqlwguwexlkp97xmwn3oxdb 2452313 2452312 2026-08-27T16:44:57Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/developer-portal: apply 2452313 wikitext text/x-wiki 3ccgeloxzdnibi7s2wak3y9xka2dy2m 2452314 2452313 2026-08-27T16:45:07Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/developer-portal: apply 2452314 wikitext text/x-wiki 4n2lzpnsumxk8ossct6wmzli26i8lem 2452315 2452314 2026-08-27T16:45:12Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/device-analytics: apply 2452315 wikitext text/x-wiki j7rqd49hbjzaxfrgt1dn0iyd0fiznq7 2452316 2452315 2026-08-27T16:45:20Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/device-analytics: apply 2452316 wikitext text/x-wiki 2rwjvrfhfwcslslhd7tmz4z8xdagviz 2452317 2452316 2026-08-27T16:45:29Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/echostore: apply 2452317 wikitext text/x-wiki mcm3g3ygwwgvbx2p869a7kb1w6mot48 2452318 2452317 2026-08-27T16:46:05Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/echostore: apply 2452318 wikitext text/x-wiki chtspozbrnote78pm61fvmekh18g77r 2452319 2452318 2026-08-27T16:46:12Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/edit-analytics: apply 2452319 wikitext text/x-wiki 0zjvld550nbtp6z0k687btyyrglw5lc 2452320 2452319 2026-08-27T16:46:20Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/edit-analytics: apply 2452320 wikitext text/x-wiki l67alworlyfglcp31hlr7t85o1js2fx 2452321 2452320 2026-08-27T16:46:27Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/editor-analytics: apply 2452321 wikitext text/x-wiki eelvwo3bzw8e6ecg8i27tfjmozga3w2 2452322 2452321 2026-08-27T16:46:35Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/editor-analytics: apply 2452322 wikitext text/x-wiki s4yjgcsqigkl6kjyajttu2ywwla59bp 2452323 2452322 2026-08-27T16:46:41Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/eventgate-analytics: apply 2452323 wikitext text/x-wiki j3mikdqi53r24zq02colim1q0bqo8si 2452324 2452323 2026-08-27T16:47:04Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/eventgate-analytics: apply 2452324 wikitext text/x-wiki my7dmbr09ykvxqltyprzcrcds6vqpon 2452325 2452324 2026-08-27T16:47:13Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/eventgate-analytics-external: apply 2452325 wikitext text/x-wiki o5a12w4233r5z8qaouv71ehizd2jzjs 2452326 2452325 2026-08-27T16:47:21Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/eventgate-analytics-external: apply 2452326 wikitext text/x-wiki thhgb9id03ongxp5fia733kcoqyt8lh 2452327 2452326 2026-08-27T16:47:26Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/eventgate-logging-external: apply 2452327 wikitext text/x-wiki g4m5qakouchslcvyfwe5chomt39g24q 2452328 2452327 2026-08-27T16:47:34Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/eventgate-logging-external: apply 2452328 wikitext text/x-wiki pwibpv3ii2tqurhkmwjck2jptqrpd22 2452329 2452328 2026-08-27T16:47:39Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/eventgate-main: apply 2452329 wikitext text/x-wiki 3xqbilgj5v6dz6k9pvd09gz3gr67o3u 2452330 2452329 2026-08-27T16:47:47Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/eventgate-main: apply 2452330 wikitext text/x-wiki mpz94vbwzeszppj9pfi49f5wzglr5mo 2452331 2452330 2026-08-27T16:47:53Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/eventstreams: apply 2452331 wikitext text/x-wiki iw2yi7uwpglypxw79uyzaa47ulfvn7e 2452332 2452331 2026-08-27T16:48:17Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker1009.eqiad.wmnet 2452332 wikitext text/x-wiki ppk6f0efdc2jzgytsgldxlsyi2o7kh1 2452333 2452332 2026-08-27T16:48:20Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker1009.eqiad.wmnet 2452333 wikitext text/x-wiki gx27s38k8id5chheljholym5ieni1wf 2452334 2452333 2026-08-27T16:48:24Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on A:aux-worker-eqiad 2452334 wikitext text/x-wiki 32wua2th4y5tnyn3o7dx857he3fdcud 2452335 2452334 2026-08-27T16:48:26Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/eventstreams: apply 2452335 wikitext text/x-wiki oxc36pbliev6gla2dq04sg2e9xsqzgm 2452336 2452335 2026-08-27T16:49:34Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/geo-analytics: apply 2452336 wikitext text/x-wiki ebu6px9slu9ldll2v2khluteoya89ra 2452337 2452336 2026-08-27T16:49:52Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/geo-analytics: apply 2452337 wikitext text/x-wiki qb05hurz200ln2c2244lbmlphn2sjav 2452338 2452337 2026-08-27T16:49:55Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/kartotherian: apply 2452338 wikitext text/x-wiki k4bndthp31xt09bhhrgx74cem2j3jt4 2452339 2452338 2026-08-27T16:50:09Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/kartotherian: apply 2452339 wikitext text/x-wiki 8b0k91xct3opq08711hcvrt8hfvk2r3 2452340 2452339 2026-08-27T16:50:14Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/linked-artifacts: apply 2452340 wikitext text/x-wiki qr3ifnbetcq9z3qdzxe1u2uxju5nsan 2452341 2452340 2026-08-27T16:50:26Z Stashbot 7414 dwisehaupt@dns1005: START - running authdns-update 2452341 wikitext text/x-wiki 7fivy6k1nb1pxic9dpz2d0x4san3ivk 2452342 2452341 2026-08-27T16:51:09Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/linked-artifacts: apply 2452342 wikitext text/x-wiki 3p01f1r5vmkx34onc85dbj4iwmcl4tp 2452343 2452342 2026-08-27T16:51:15Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/linkrecommendation: apply 2452343 wikitext text/x-wiki 3war8ztyz5itlw6h111scenfowblz0v 2452344 2452343 2026-08-27T16:51:25Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/linkrecommendation: apply 2452344 wikitext text/x-wiki 7nr2h0prtwox967r5n15ffwqe5jc5bb 2452345 2452344 2026-08-27T16:51:31Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/machinetranslation: apply 2452345 wikitext text/x-wiki aewy3rbuooy9sjojcgtfffcj6ilnzol 2452346 2452345 2026-08-27T16:52:50Z Stashbot 7414 dwisehaupt@dns1005: END - running authdns-update 2452346 wikitext text/x-wiki gz5e24asut8sq9452yqi58rxhjj3fao 2452347 2452346 2026-08-27T16:54:28Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/machinetranslation: apply 2452347 wikitext text/x-wiki 8rsaj3z0i92kj5p9q1drjaj86sd07qu 2452348 2452347 2026-08-27T16:54:34Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/media-analytics: apply 2452348 wikitext text/x-wiki 06hia6enwz083vuxwsfi6z10rczxjzx 2452349 2452348 2026-08-27T16:55:29Z Stashbot 7414 cdobbins@cumin1003: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp5022.eqsin.wmnet with OS trixie 2452349 wikitext text/x-wiki dlewedmt9xp9hicjtkb5lhd5z6cn9r9 2452350 2452349 2026-08-27T16:55:45Z Stashbot 7414 cdobbins@cumin1003: START - Cookbook sre.hosts.reimage for host cp5022.eqsin.wmnet with OS trixie 2452350 wikitext text/x-wiki ikzeki82rm8uciddzrxrlf7xdne40wo 2452351 2452350 2026-08-27T17:03:16Z Stashbot 7414 eevans@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cassandra-dev2002.codfw.wmnet with OS bookworm 2452351 wikitext text/x-wiki ndbia5tbryxgz2pukreywmxx4u067ie 2452352 2452351 2026-08-27T17:04:39Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/media-analytics: apply 2452352 wikitext text/x-wiki dupiy5ssci55bon4ccy00nzkt89hwkw 2452353 2452352 2026-08-27T17:05:04Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/media-analytics: apply 2452353 wikitext text/x-wiki q1rl92ppa2vktmfe3ure2ud9pqaarg9 2452354 2452353 2026-08-27T17:15:09Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/media-analytics: apply 2452354 wikitext text/x-wiki poynx7hd0em81ykxqrlkb98x2ik9ib5 2452355 2452354 2026-08-27T17:15:41Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/mobileapps: apply 2452355 wikitext text/x-wiki p3nhcfe7gl89ebnic89bomnzcjqaoje 2452356 2452355 2026-08-27T17:15:50Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/mobileapps: apply 2452356 wikitext text/x-wiki h5e9up16vjg3cdyj5k29pho5pfchm6n 2452357 2452356 2026-08-27T17:16:47Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/page-analytics: apply 2452357 wikitext text/x-wiki qp4ioovko84lllo26fstfz13oi0efpb 2452358 2452357 2026-08-27T17:16:55Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/page-analytics: apply 2452358 wikitext text/x-wiki shcq72zg5279ciav3dswzdbbju8dr0f 2452359 2452358 2026-08-27T17:17:00Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/proton: apply 2452359 wikitext text/x-wiki l7d0ru7mvwq9f0wyma2ys7mp3lcb05g 2452360 2452359 2026-08-27T17:17:38Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/proton: apply 2452360 wikitext text/x-wiki 3emtcpga55eqj38p4y1kbydoouogihx 2452361 2452360 2026-08-27T17:17:46Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/push-notifications: apply 2452361 wikitext text/x-wiki 1b2d4pqt2snnksd7gkmf7gfrd40exyy 2452362 2452361 2026-08-27T17:17:50Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/push-notifications: apply 2452362 wikitext text/x-wiki a5x3iwxlbomx7onqx0epjsjvfwm8j0i 2452363 2452362 2026-08-27T17:18:21Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/recommendation-api: apply 2452363 wikitext text/x-wiki 3fqldzgftlwykrqf74863ae1pqm7coy 2452364 2452363 2026-08-27T17:18:29Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/recommendation-api: apply 2452364 wikitext text/x-wiki itbzqqp42alja6n2qkinzm5mtj117o0 2452365 2452364 2026-08-27T17:18:35Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/sessionstore: apply 2452365 wikitext text/x-wiki fxmp6a85jxqyhpaa4r702qaxq207dn1 2452366 2452365 2026-08-27T17:18:42Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/sessionstore: apply 2452366 wikitext text/x-wiki al8lbmg1u5a3zy54k97kbeeyph5tx9f 2452367 2452366 2026-08-27T17:18:49Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/shellbox: apply 2452367 wikitext text/x-wiki r43htom4jqmg89fh234v10gi31uyfox 2452368 2452367 2026-08-27T17:19:09Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox: apply 2452368 wikitext text/x-wiki 3tdkcgb19zphigki94wwvxw34np896u 2452369 2452368 2026-08-27T17:19:17Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-constraints: apply 2452369 wikitext text/x-wiki hujbdun3mdcbtdiv938ajsxirz9ztw5 2452370 2452369 2026-08-27T17:19:26Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-constraints: apply 2452370 wikitext text/x-wiki bejsxbkkhbolwnup7ppbpclfv5u6xv8 2452371 2452370 2026-08-27T17:19:32Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-media: apply 2452371 wikitext text/x-wiki 8b4r1o9zceuy0u8e4f9t5ve90cmnzmy 2452372 2452371 2026-08-27T17:19:40Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-media: apply 2452372 wikitext text/x-wiki dzwzjoak9eemkqgxkdmi9jn7irpnkk6 2452373 2452372 2026-08-27T17:19:46Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-syntaxhighlight: apply 2452373 wikitext text/x-wiki rfnxzpf7ep9punolnqeur9avgj0cufn 2452374 2452373 2026-08-27T17:19:54Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-syntaxhighlight: apply 2452374 wikitext text/x-wiki hy69aq1l5wfx4a7wd6hyck44wa9wix4 2452375 2452374 2026-08-27T17:20:00Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-timeline: apply 2452375 wikitext text/x-wiki n7fnh8dxr8180jkumeld2t87c1d13mf 2452376 2452375 2026-08-27T17:20:16Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-timeline: apply 2452376 wikitext text/x-wiki am92b8wftjnfatq4llh9oww4aph7y73 2452377 2452376 2026-08-27T17:20:23Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-video: apply 2452377 wikitext text/x-wiki dbtbdryolnhdlvgug9eo86zfngxv70l 2452378 2452377 2026-08-27T17:20:43Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-video: apply 2452378 wikitext text/x-wiki bttg8j2tlwnvz3xp3gqlmxad0ynwkic 2452379 2452378 2026-08-27T17:21:10Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/termbox: apply 2452379 wikitext text/x-wiki lma4oj9mnsn1yhe532mqg92w5sdcxxn 2452380 2452379 2026-08-27T17:21:18Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/termbox: apply 2452380 wikitext text/x-wiki 6i35hpknk9hkq8naxyhto04eeenkp3y 2452381 2452380 2026-08-27T17:22:09Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/wikidata-query-gui: apply 2452381 wikitext text/x-wiki rvnx0r2id12yxl6dmc3c7hbdb6hd3q9 2452382 2452381 2026-08-27T17:22:22Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/wikidata-query-gui: apply 2452382 wikitext text/x-wiki rz6wluygvw19p45m3a0bu5ptru2dqgu 2452383 2452382 2026-08-27T17:22:27Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/wikifeeds: apply 2452383 wikitext text/x-wiki 2u7gsoo2wohcb4181zyug6ocgluapi4 2452384 2452383 2026-08-27T17:22:45Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifeeds: apply 2452384 wikitext text/x-wiki c1u71re2rbq417habyxnhhlcf71bmcm 2452385 2452384 2026-08-27T17:22:51Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/zotero: apply 2452385 wikitext text/x-wiki brhgemoxelrqwkcr5es0kzpnwcinlhb 2452386 2452385 2026-08-27T17:22:59Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/zotero: apply 2452386 wikitext text/x-wiki 3tzgomyjf3ocxluwcqpk0ths8jr8vsi 2452387 2452386 2026-08-27T17:25:18Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/apertium: apply 2452387 wikitext text/x-wiki c47nu4kohvnd63km57dd6pjiaj130dm 2452388 2452387 2026-08-27T17:25:51Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/apertium: apply 2452388 wikitext text/x-wiki n8p2e93zz8rjkka4p05xgdsi6g8ruor 2452389 2452388 2026-08-27T17:26:00Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/chart-renderer: apply 2452389 wikitext text/x-wiki a2iydvsg57qq7jikpkuzo06z7di48i4 2452390 2452389 2026-08-27T17:26:08Z Stashbot 7414 rscout@deploy1003: helmfile [codfw] START helmfile.d/services/miscweb: apply 2452390 wikitext text/x-wiki 5wgzhpf6nbtk09y3bdy1eja2ryf4h36 2452391 2452390 2026-08-27T17:26:25Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/chart-renderer: apply 2452391 wikitext text/x-wiki 54m7m0uh4ypc7a88t0mo10r09bcc7k3 2452392 2452391 2026-08-27T17:26:31Z Stashbot 7414 rscout@deploy1003: helmfile [codfw] DONE helmfile.d/services/miscweb: apply 2452392 wikitext text/x-wiki 6pcoc57y097ma5k13aiedqem75xvp7y 2452393 2452392 2026-08-27T17:26:40Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply 2452393 wikitext text/x-wiki 3zxtjsqq29zzkea2kdc0je8sgo579mp 2452394 2452393 2026-08-27T17:26:44Z Stashbot 7414 rscout@deploy1003: helmfile [eqiad] START helmfile.d/services/miscweb: apply 2452394 wikitext text/x-wiki 8hc3y57mssjsaqgbjol91yviz2pd1r9 2452395 2452394 2026-08-27T17:26:48Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply 2452395 wikitext text/x-wiki 12v9kxid20ihad5q7n1yty9lkicqctm 2452396 2452395 2026-08-27T17:26:52Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/citoid: apply 2452396 wikitext text/x-wiki 9rq55k1sa5gyj1m5w2dyc62ihz8is7o 2452397 2452396 2026-08-27T17:26:58Z Stashbot 7414 rscout@deploy1003: helmfile [eqiad] DONE helmfile.d/services/miscweb: apply 2452397 wikitext text/x-wiki 3c07c9l34j8e3b87men3chzyiuqor9b 2452398 2452397 2026-08-27T17:27:17Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/citoid: apply 2452398 wikitext text/x-wiki 6rnkua8ezuup14lvrazhx1t485fcqf6 2452399 2452398 2026-08-27T17:27:22Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/commons-impact-analytics: apply 2452399 wikitext text/x-wiki sj0xzz7c3tec627v8konk6yex1v2xra 2452400 2452399 2026-08-27T17:27:38Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/commons-impact-analytics: apply 2452400 wikitext text/x-wiki dinzfvp00uwcm90gw7vteu13pvbnbgu 2452401 2452400 2026-08-27T17:27:43Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/cxserver: apply 2452401 wikitext text/x-wiki a2vsb1y1wkoabwsmgqp5ace3wn99udt 2452402 2452401 2026-08-27T17:28:14Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/cxserver: apply 2452402 wikitext text/x-wiki iphatw3l6uta53a0hm4yl21le25w3np 2452403 2452402 2026-08-27T17:28:18Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/data-gateway: apply 2452403 wikitext text/x-wiki eqjxwdtxpks21wkxz2mambc0swkxg1t 2452404 2452403 2026-08-27T17:28:33Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/data-gateway: apply 2452404 wikitext text/x-wiki qno03070es3znllgf3jcb88jjcvo51k 2452405 2452404 2026-08-27T17:28:38Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/developer-portal: apply 2452405 wikitext text/x-wiki 4b5zhq3vru0tis7x5d8j6j4zjw5z5l2 2452406 2452405 2026-08-27T17:28:51Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/developer-portal: apply 2452406 wikitext text/x-wiki jimhv4kl1ba9j9q8fl2pwqv8xeh9734 2452407 2452406 2026-08-27T17:28:57Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/device-analytics: apply 2452407 wikitext text/x-wiki ev0r8zjxxanbnzsqhpca39eyyb3ihgh 2452408 2452407 2026-08-27T17:29:11Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/device-analytics: apply 2452408 wikitext text/x-wiki 5gne7v71zkj48hz2khuqkd6jhxjh0qu 2452409 2452408 2026-08-27T17:29:16Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/echostore: apply 2452409 wikitext text/x-wiki f1yk9x7oci1v48upfpgxajfkd2zx7mb 2452410 2452409 2026-08-27T17:29:30Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/echostore: apply 2452410 wikitext text/x-wiki etwaqpf57ivmeu6iiiauwmwfdy176f4 2452411 2452410 2026-08-27T17:29:36Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/edit-analytics: apply 2452411 wikitext text/x-wiki gh77kakx2odxuu0j6i14wq47oy6mxva 2452412 2452411 2026-08-27T17:29:49Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/edit-analytics: apply 2452412 wikitext text/x-wiki dccjj05qdterjwhzekih20y6iczxg6h 2452413 2452412 2026-08-27T17:29:57Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/editor-analytics: apply 2452413 wikitext text/x-wiki g8kqcref09yafw1o4njvaxgj9m7z0n7 2452414 2452413 2026-08-27T17:30:09Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/editor-analytics: apply 2452414 wikitext text/x-wiki jc2f3vs2u3uhbzj1hhgq150m3tpka6n 2452415 2452414 2026-08-27T17:30:13Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.deploy.python-code homer to cumin2003.codfw.wmnet,cumin1003.eqiad.wmnet with reason: Homer - add function to wmf plugin to build rpm probe data - cmooney@cumin1003 2452415 wikitext text/x-wiki aitxqf91jxmw5frx1212rb0dkje89wd 2452416 2452415 2026-08-27T17:30:17Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/eventgate-analytics: apply 2452416 wikitext text/x-wiki myxkxf820ivwdn825aq58ve8bqxnty7 2452417 2452416 2026-08-27T17:30:56Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/eventgate-analytics: apply 2452417 wikitext text/x-wiki 7rrmkyx7kjbb59g6pztdkpyc91prm4h 2452418 2452417 2026-08-27T17:31:04Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/eventgate-analytics-external: apply 2452418 wikitext text/x-wiki mh1wbbbhrkyw852nw3maq475g6ndky5 2452419 2452418 2026-08-27T17:31:32Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/eventgate-analytics-external: apply 2452419 wikitext text/x-wiki h78thy8xtmwbcmm62zwltn266jllpfz 2452420 2452419 2026-08-27T17:31:38Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/eventgate-logging-external: apply 2452420 wikitext text/x-wiki p65coh8ginwf6z8a5hdcf3aohix8xc6 2452421 2452420 2026-08-27T17:31:49Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) homer to cumin2003.codfw.wmnet,cumin1003.eqiad.wmnet with reason: Homer - add function to wmf plugin to build rpm probe data - cmooney@cumin1003 2452421 wikitext text/x-wiki rilwgo0kn8yk0mvrnxfpvafjpgrauf1 2452422 2452421 2026-08-27T17:32:06Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/eventgate-logging-external: apply 2452422 wikitext text/x-wiki 1bakt3vnzr47hhlole6gxc0oqim4p63 2452423 2452422 2026-08-27T17:32:16Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/eventgate-main: apply 2452423 wikitext text/x-wiki g1x0qm0w7gzataoqky8v2suapoigk2n 2452424 2452423 2026-08-27T17:32:28Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/eventgate-main: apply 2452424 wikitext text/x-wiki nmh9xlvurtm9au4ojf3lqn4ia0rpppr 2452425 2452424 2026-08-27T17:32:35Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/eventstreams: apply 2452425 wikitext text/x-wiki 8tz1pn08l611m0245dj817ch241ur6e 2452426 2452425 2026-08-27T17:33:10Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/eventstreams: apply 2452426 wikitext text/x-wiki jdcsmedr4zcstod04d5yr70wsao96xd 2452427 2452426 2026-08-27T17:33:15Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/geo-analytics: apply 2452427 wikitext text/x-wiki kj3co4kvdabrp0hvuixlufx7wdwzacs 2452428 2452427 2026-08-27T17:33:30Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/geo-analytics: apply 2452428 wikitext text/x-wiki 48h9iky9e2ux32ix314a3xl6pmk0a6r 2452429 2452428 2026-08-27T17:33:35Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/kartotherian: apply 2452429 wikitext text/x-wiki qdjt224q56csf4soax2bi1td3fi1oqd 2452430 2452429 2026-08-27T17:34:41Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/kartotherian: apply 2452430 wikitext text/x-wiki iggm00ch4dxc6wsii4muq6n7xc7t00o 2452431 2452430 2026-08-27T17:34:46Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/linked-artifacts: apply 2452431 wikitext text/x-wiki cs319f1sb3k5h23kf9dtt7dywgum686 2452432 2452431 2026-08-27T17:35:04Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/linked-artifacts: apply 2452432 wikitext text/x-wiki i9bid5uk05sc3d9d2on2s22z4hbo7xo 2452433 2452432 2026-08-27T17:35:13Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/linkrecommendation: apply 2452433 wikitext text/x-wiki 9yep27ftd7mu1mlzcrx4ju4mq1m85qz 2452434 2452433 2026-08-27T17:36:47Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/linkrecommendation: apply 2452434 wikitext text/x-wiki 4i2v2ou7gapfb3eam3cjd5cf2xeo6y0 2452435 2452434 2026-08-27T17:36:53Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/machinetranslation: apply 2452435 wikitext text/x-wiki ndlkst20qtw76g5jdy8n98jgg8fzxsi 2452436 2452435 2026-08-27T17:40:34Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/machinetranslation: apply 2452436 wikitext text/x-wiki raogi9sjukzs5csnhwero61rzvctdir 2452437 2452436 2026-08-27T17:40:41Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/media-analytics: apply 2452437 wikitext text/x-wiki fzqpsq1lz2paom7zv3evzaeyorl2ibd 2452438 2452437 2026-08-27T17:41:00Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/media-analytics: apply 2452438 wikitext text/x-wiki btrtlu30k5a6epc6eutz4ehcp84xb2g 2452439 2452438 2026-08-27T17:41:24Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/mobileapps: apply 2452439 wikitext text/x-wiki 066hr1wbx02pk7l09d5w3k483mn7o8a 2452440 2452439 2026-08-27T17:42:05Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/mobileapps: apply 2452440 wikitext text/x-wiki 32ucvrvwbh0pwjb6l4k6yrkuhmcurdb 2452441 2452440 2026-08-27T17:43:29Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2452441 wikitext text/x-wiki 3amg97zfjvwob3y5xa3bmrn8x8t82q9 2452442 2452441 2026-08-27T17:44:18Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2452442 wikitext text/x-wiki 5km6zigl0qxvuu3iryuahqtrk5zjv75 2452443 2452442 2026-08-27T17:44:28Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/mw-pretrain: apply 2452443 wikitext text/x-wiki fpocliyj19jmoqc25z8koceuvp93cko 2452444 2452443 2026-08-27T17:44:48Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-pretrain: apply 2452444 wikitext text/x-wiki 4vycgy8pnwdg0nczurmxraqu488wqif 2452445 2452444 2026-08-27T17:45:01Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/page-analytics: apply 2452445 wikitext text/x-wiki rrwirwmhiqxn91tlsazs1e07wfzx5k6 2452446 2452445 2026-08-27T17:45:18Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/page-analytics: apply 2452446 wikitext text/x-wiki ppts2chw2nmn9std382c5vh6mfva34a 2452447 2452446 2026-08-27T17:45:23Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/proton: apply 2452447 wikitext text/x-wiki rjnur5eqx12ow28b6x4w3a1d2raxjub 2452448 2452447 2026-08-27T17:46:28Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/proton: apply 2452448 wikitext text/x-wiki ctq4edeocnc8qq4ayqrnfs40ua4usi3 2452449 2452448 2026-08-27T17:46:34Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/push-notifications: apply 2452449 wikitext text/x-wiki rzcazbi7a92f2ih2dx2f5s3d7nyyupb 2452450 2452449 2026-08-27T17:47:10Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/push-notifications: apply 2452450 wikitext text/x-wiki 884aea4vn2zts6jhv7l2obp31gt0wxu 2452451 2452450 2026-08-27T17:47:33Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/recommendation-api: apply 2452451 wikitext text/x-wiki 3521v39dv2ask4uadqossln0db4fa41 2452452 2452451 2026-08-27T17:47:56Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/recommendation-api: apply 2452452 wikitext text/x-wiki 6s8impnrdgtoei1blxxsa99ij3py5u3 2452453 2452452 2026-08-27T17:48:06Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/sessionstore: apply 2452453 wikitext text/x-wiki 4ll7lf2o2fn7x4tqamwz8hvuj7xiyci 2452454 2452453 2026-08-27T17:48:20Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/sessionstore: apply 2452454 wikitext text/x-wiki 3ij9tpo8i2u1j2wi7y8jcohrul5gcbx 2452455 2452454 2026-08-27T17:48:31Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox: apply 2452455 wikitext text/x-wiki skkj0cpk0a4r12se7l0qgggngn1wjpk 2452456 2452455 2026-08-27T17:49:12Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox: apply 2452456 wikitext text/x-wiki n5bu24qlepksowqpq7vr2naxvp2p5h7 2452457 2452456 2026-08-27T17:49:18Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-constraints: apply 2452457 wikitext text/x-wiki h3od7sy34y74fn2ji3eiky4vmseemcz 2452458 2452457 2026-08-27T17:49:48Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-constraints: apply 2452458 wikitext text/x-wiki lud4dwzn995cy5wjodpst3cxj5pr4xl 2452459 2452458 2026-08-27T17:50:00Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-media: apply 2452459 wikitext text/x-wiki 84yscwu22jknfr6gp5jt9bk32v4my0q 2452460 2452459 2026-08-27T17:50:14Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-media: apply 2452460 wikitext text/x-wiki r8osj10bei10zbhn66cvsixlzvdyn1l 2452461 2452460 2026-08-27T17:50:22Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-syntaxhighlight: apply 2452461 wikitext text/x-wiki pgjpxelog85wgld5w1ja9fkmvav60so 2452462 2452461 2026-08-27T17:50:45Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-syntaxhighlight: apply 2452462 wikitext text/x-wiki q7lz6qiqsbacncd4dq50dgfyod35h34 2452463 2452462 2026-08-27T17:50:52Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-timeline: apply 2452463 wikitext text/x-wiki 3qpfo915di3g6il2pl7ygx7akk5ep27 2452464 2452463 2026-08-27T17:51:14Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: apply 2452464 wikitext text/x-wiki l6gkwnwhxv2cxh3smfiiulyn09wqyjr 2452465 2452464 2026-08-27T17:51:24Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-video: apply 2452465 wikitext text/x-wiki 7ys3sf1p2ofobr1q6jyoun3ts5naehd 2452466 2452465 2026-08-27T17:52:03Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-video: apply 2452466 wikitext text/x-wiki jgl2xgv9hnhenv5uidj0zt2lkw3u5nb 2452467 2452466 2026-08-27T17:52:24Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/termbox: apply 2452467 wikitext text/x-wiki 6m2ldw27ptlav6s2wtlh50p1ubyaji1 2452468 2452467 2026-08-27T17:53:06Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/termbox: apply 2452468 wikitext text/x-wiki 9kuddnk11b095vq2vv1nn4zzk4t3shb 2452469 2452468 2026-08-27T17:53:24Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/wikidata-query-gui: apply 2452469 wikitext text/x-wiki 3f1cifnygnluocd6vxt8ns0feytik4y 2452470 2452469 2026-08-27T17:53:44Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/wikidata-query-gui: apply 2452470 wikitext text/x-wiki lj3wr7hal3nr2onu4d99j1oxtvgwh27 2452471 2452470 2026-08-27T17:53:49Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/wikifeeds: apply 2452471 wikitext text/x-wiki 2t6854mzetfmu743qw2v75hno1q73zz 2452472 2452471 2026-08-27T17:54:14Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/wikifeeds: apply 2452472 wikitext text/x-wiki 76k7pvhxd9ajx92sfk64n6eybfbcw5n 2452473 2452472 2026-08-27T17:55:10Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/zotero: apply 2452473 wikitext text/x-wiki cab707y8vd18vr0zswf45ob20074fby 2452474 2452473 2026-08-27T17:55:34Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/zotero: apply 2452474 wikitext text/x-wiki q2o4p3up887cnbmf6esjebyh9brnzg6 2452475 2452474 2026-08-27T17:55:52Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/apertium: apply 2452475 wikitext text/x-wiki 4vdbtvn5xhntxjvcorukufnlywru3ev 2452476 2452475 2026-08-27T17:56:24Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/apertium: apply 2452476 wikitext text/x-wiki b19i3trr7no7le406wgkgtd8mb9fmwn 2452477 2452476 2026-08-27T17:56:31Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/chart-renderer: apply 2452477 wikitext text/x-wiki 7fpz20q777jtxgf3ynmm1y2ye1tyq84 2452478 2452477 2026-08-27T17:56:59Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/chart-renderer: apply 2452478 wikitext text/x-wiki g8q2riy3w898ggvxoxk6svwsh37ma84 2452479 2452478 2026-08-27T17:57:18Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply 2452479 wikitext text/x-wiki 8pf9z56pg43f5nfhygf0u4tyy2nck8h 2452480 2452479 2026-08-27T17:57:24Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply 2452480 wikitext text/x-wiki pnftwornst1bs9r3sdscgwmy86ni9jg 2452481 2452480 2026-08-27T17:57:29Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/citoid: apply 2452481 wikitext text/x-wiki hh8ahpzwb7urrk9o7j9o1i13jjttu4h 2452482 2452481 2026-08-27T17:57:50Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/citoid: apply 2452482 wikitext text/x-wiki a79yt0getx9agumipwd9msputmf4rxg 2452483 2452482 2026-08-27T17:57:57Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/commons-impact-analytics: apply 2452483 wikitext text/x-wiki n0hyq29ja5temug4y7het1huattdl44 2452484 2452483 2026-08-27T17:58:12Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/commons-impact-analytics: apply 2452484 wikitext text/x-wiki f8vyiqohr9oleu24tqacwx6l00au6me 2452485 2452484 2026-08-27T17:58:18Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/cxserver: apply 2452485 wikitext text/x-wiki 20t0if6dd57vs3wej99p8ua42n3kjlx 2452486 2452485 2026-08-27T17:58:49Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/cxserver: apply 2452486 wikitext text/x-wiki m3h6z7yf7j5u8kcr5nd5ifqdh1cvazo 2452487 2452486 2026-08-27T17:58:58Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/data-gateway: apply 2452487 wikitext text/x-wiki a5zaz8cg9x5eejx3j42vzd4uoeqwrrq 2452488 2452487 2026-08-27T17:59:11Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/data-gateway: apply 2452488 wikitext text/x-wiki 80jqlmgd3728mm8471u6sne6vr7xjq7 2452489 2452488 2026-08-27T17:59:20Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/developer-portal: apply 2452489 wikitext text/x-wiki 9jdpbweuedbqqoik4lez9l15sn2wk3f 2452490 2452489 2026-08-27T17:59:31Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/developer-portal: apply 2452490 wikitext text/x-wiki nlvhm90wxfg2tqcoxxvd7bs3ofjdkha 2452491 2452490 2026-08-27T17:59:36Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/device-analytics: apply 2452491 wikitext text/x-wiki daui62j8n5b2if5zrwr7jp9zu06520f 2452492 2452491 2026-08-27T17:59:51Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/device-analytics: apply 2452492 wikitext text/x-wiki c03l2n6lprdy0bpacgdmwnd33vv8ddy 2452493 2452492 2026-08-27T17:59:57Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/echostore: apply 2452493 wikitext text/x-wiki n541goxy3ww3fh7gvjefznqoiqdi58p 2452494 2452493 2026-08-27T18:00:10Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/echostore: apply 2452494 wikitext text/x-wiki 986s6orbad12svrp0ff8js5n3nlwune 2452495 2452494 2026-08-27T18:00:21Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/edit-analytics: apply 2452495 wikitext text/x-wiki 41rmcdyylbe996b3i3wndb2etuknl4d 2452496 2452495 2026-08-27T18:00:34Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/edit-analytics: apply 2452496 wikitext text/x-wiki 2pwi3174qg0hzjjur5ma22rtcsc3f7p 2452497 2452496 2026-08-27T18:00:45Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/editor-analytics: apply 2452497 wikitext text/x-wiki n6t1m87jqi1w79dxh413va4pls5hh1z 2452498 2452497 2026-08-27T18:00:58Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/editor-analytics: apply 2452498 wikitext text/x-wiki 10lacrrdghibkg5o5hnpydga5ykvl65 2452499 2452498 2026-08-27T18:01:05Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/eventgate-analytics: apply 2452499 wikitext text/x-wiki qyvboatbr21ne4erkpo43abcz4d7b53 2452500 2452499 2026-08-27T18:01:43Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/eventgate-analytics: apply 2452500 wikitext text/x-wiki m1yqwc8cwu6ejw0zhlsfy016qfz9gim 2452501 2452500 2026-08-27T18:01:55Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/eventgate-analytics-external: apply 2452501 wikitext text/x-wiki 4mxuhcgjv9a9vln7esn4leau249skld 2452502 2452501 2026-08-27T18:02:22Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/eventgate-analytics-external: apply 2452502 wikitext text/x-wiki m836ty8oblwfpq7e7pqpgigjb2edtq2 2452503 2452502 2026-08-27T18:02:37Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/eventgate-logging-external: apply 2452503 wikitext text/x-wiki erpyhu7krwpo3zpzofbvvixn9m7lbfd 2452504 2452503 2026-08-27T18:03:01Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/eventgate-logging-external: apply 2452504 wikitext text/x-wiki 0xxql0x6nv5rtktgj7pel3g1x4hzxm7 2452505 2452504 2026-08-27T18:03:08Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/eventgate-main: apply 2452505 wikitext text/x-wiki o3pqeyiejs2snlpqu69szmbp6w12c25 2452506 2452505 2026-08-27T18:03:44Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/eventgate-main: apply 2452506 wikitext text/x-wiki ds9bo04h3st007pyct59dci9qpwccp6 2452507 2452506 2026-08-27T18:04:32Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/eventstreams: apply 2452507 wikitext text/x-wiki ofp3l6bzgnn2snpu3l92p1o9y9y4j33 2452508 2452507 2026-08-27T18:05:14Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/eventstreams: apply 2452508 wikitext text/x-wiki 6dck5wpllnj7qkyq14gu3e0x4h2q4id 2452509 2452508 2026-08-27T18:05:19Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/geo-analytics: apply 2452509 wikitext text/x-wiki tiwpmmlo2fcvvhevn5z29gir38qn3tv 2452510 2452509 2026-08-27T18:05:32Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/geo-analytics: apply 2452510 wikitext text/x-wiki 0i9xtwpabza7oq2rrr677iq6jydzaan 2452511 2452510 2026-08-27T18:05:37Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/kartotherian: apply 2452511 wikitext text/x-wiki r20pgvkcskdnhrjqmg8gmsnd3axknln 2452512 2452511 2026-08-27T18:10:24Z Stashbot 7414 cdobbins@cumin1003: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp5022.eqsin.wmnet with OS trixie 2452512 wikitext text/x-wiki mpnm8fthvxcmtar9tvqsaa9kpeauhuh 2452513 2452512 2026-08-27T18:15:46Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/kartotherian: apply 2452513 wikitext text/x-wiki d1hzooha00etchmvd92ee4m56kh179g 2452514 2452513 2026-08-27T18:15:57Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/linked-artifacts: apply 2452514 wikitext text/x-wiki oyd44hskkahd47udofy6eg3xyef9ky8 2452515 2452514 2026-08-27T18:16:10Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/linked-artifacts: apply 2452515 wikitext text/x-wiki 6ap2feshnq2k25mz27s963oc531qvxp 2452516 2452515 2026-08-27T18:16:16Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/linkrecommendation: apply 2452516 wikitext text/x-wiki gf3mxxtbez8fk4d6z421bgnts0ekr14 2452517 2452516 2026-08-27T18:17:03Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/linkrecommendation: apply 2452517 wikitext text/x-wiki 103ndt239fvs8qirf5xswqnrigfi19k 2452518 2452517 2026-08-27T18:17:08Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/machinetranslation: apply 2452518 wikitext text/x-wiki 46pdgc9kwji9xv0uu0d4vweewhk31et 2452519 2452518 2026-08-27T18:17:44Z Stashbot 7414 dancy@deploy1003: Started scap sync-world: testing 2452519 wikitext text/x-wiki h6y8a3pksc13ni72r4a5ywfwlbc56hp 2452520 2452519 2026-08-27T18:21:28Z Stashbot 7414 dancy@deploy1003: Finished scap sync-world: testing (duration: 03m 44s) 2452520 wikitext text/x-wiki 2ewfjahae9vzk6excp98nifbxd3ousb 2452521 2452520 2026-08-27T18:22:48Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/machinetranslation: apply 2452521 wikitext text/x-wiki a7jejuanu12mmqkjuwto684035lrz9n 2452522 2452521 2026-08-27T18:23:02Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/media-analytics: apply 2452522 wikitext text/x-wiki pd5vhpdua1jphh16a6m0mb75jm68cer 2452523 2452522 2026-08-27T18:23:16Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/media-analytics: apply 2452523 wikitext text/x-wiki ceiksg0sxmms2qp58aa0kd5r0wwgvs8 2452524 2452523 2026-08-27T18:23:33Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/mobileapps: apply 2452524 wikitext text/x-wiki b89w4hj6a0fiiwfw93vb9dszmg0yuov 2452525 2452524 2026-08-27T18:24:17Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply 2452525 wikitext text/x-wiki 0bhtirw6xpqqn38kbj2cdckoo0ajaih 2452526 2452525 2026-08-27T18:24:33Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-experimental: apply 2452526 wikitext text/x-wiki 929qp4bwhxasma8jn5laauybjantigg 2452527 2452526 2026-08-27T18:25:03Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-experimental: apply 2452527 wikitext text/x-wiki bnliiho8z7c1e27705ifd2wyyy47kp5 2452528 2452527 2026-08-27T18:25:31Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2452528 wikitext text/x-wiki oufitv4t4ig19n68oq9vvgpmppvou9h 2452530 2452528 2026-08-27T18:33:41Z Taavi 13997 archive to [[Server Admin Log/Archive 108]] 2452530 wikitext text/x-wiki 6h1mp72ugzb10lqeijeaqus8tvvrqtc 2452531 2452530 2026-08-27T18:33:51Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-video: apply 2452531 wikitext text/x-wiki 6lwcjhb1hrahc6448oib98m5j8xkghj 2452532 2452531 2026-08-27T18:34:07Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/termbox: apply 2452532 wikitext text/x-wiki 3l2gmd4u00c983dhueklpo1od7w2nj5 2452534 2452532 2026-08-27T18:34:53Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/termbox: apply 2452534 wikitext text/x-wiki ajsw23haxrglqrv070sytfk0khzn15b 2452535 2452534 2026-08-27T18:35:26Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/wikidata-query-gui: apply 2452535 wikitext text/x-wiki rzstr7646dy8fcugdvsjyq27gp7tj2d 2452537 2452535 2026-08-27T18:36:07Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/wikidata-query-gui: apply 2452537 wikitext text/x-wiki 0uo2tbooql71uukog9ttav5mgwiimuf 2452538 2452537 2026-08-27T18:36:11Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/wikifeeds: apply 2452538 wikitext text/x-wiki n9hb5a9gs7u12babkvc60pq2ukwleey 2452539 2452538 2026-08-27T18:36:35Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/wikifeeds: apply 2452539 wikitext text/x-wiki t6vw8d39c9m7upsmi2qj22kvaymtifk 2452540 2452539 2026-08-27T18:36:53Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/zotero: apply 2452540 wikitext text/x-wiki ppx25oz8ty7rj8owwbbmau0k6naedkf 2452541 2452540 2026-08-27T18:37:16Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/zotero: apply 2452541 wikitext text/x-wiki hmpbwdppd9zq0nx4csqmw7ou8yslzii 2452542 2452541 2026-08-27T19:20:20Z Stashbot 7414 dancy@deploy1003: Installing scap version "4.286.0" for 3 host(s) 2452542 wikitext text/x-wiki tnjifruykynku4ihz9d6h0bvozenlju 2452543 2452542 2026-08-27T19:22:18Z Stashbot 7414 dancy@deploy1003: Installation of scap version "4.286.0" completed for 3 hosts 2452543 wikitext text/x-wiki 0sqaxb17ehyo0iuiuh15eycg6fgp4eq 2452544 2452543 2026-08-27T19:22:50Z Stashbot 7414 dancy@deploy1003: Started scap sync-world: testing 2452544 wikitext text/x-wiki bou76zu150axuu965bshjj5j74wspw0 2452545 2452544 2026-08-27T19:23:17Z Stashbot 7414 cdobbins@cumin1003: START - Cookbook sre.hosts.reimage for host cp5022.eqsin.wmnet with OS trixie 2452545 wikitext text/x-wiki r20ymsui2ni7smnda1paez82tay4cry 2452546 2452545 2026-08-27T19:23:21Z Stashbot 7414 cdobbins@cumin1003: START - Cookbook sre.hosts.move-vlan for host cp5022 2452546 wikitext text/x-wiki pp4541jv8zwcn8mstcsn5fgucxwe9kr 2452547 2452546 2026-08-27T19:23:22Z Stashbot 7414 cdobbins@cumin1003: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host cp5022 2452547 wikitext text/x-wiki s122vlu0pn7a2mcp1vymy9926a22cze 2452548 2452547 2026-08-27T19:28:17Z Stashbot 7414 dancy@deploy1003: Finished scap sync-world: testing (duration: 05m 45s) 2452548 wikitext text/x-wiki p374hzec2x31upk4uulkpxlwvm2s8ir 2452550 2452548 2026-08-27T19:34:04Z Stashbot 7414 inflatador: [bking@ganeti1046] ~$ sudo gnt-instance migrate krb1004 ganeti1035 -> ganeti1029 T435873 2452550 wikitext text/x-wiki m7w9awcsgsw0jl6irq39vrovmazjtjr 2452551 2452550 2026-08-27T19:34:22Z Stashbot 7414 dancy@deploy1003: Started scap sync-world: testing 2452551 wikitext text/x-wiki c09n1zn1s6r4fdmtxmpx2bsjvk26hht 2452553 2452551 2026-08-27T19:35:34Z Stashbot 7414 dancy@deploy1003: sync-world failed: <RuntimeError> dictionary changed size during iteration (scap version: 4.286.0) (duration: 01m 12s) 2452553 wikitext text/x-wiki doq1lra2taxu0qyw95016s5vokus2bh 2452554 2452553 2026-08-27T19:36:10Z Stashbot 7414 dancy@deploy1003: Started scap sync-world: testing 2452554 wikitext text/x-wiki 60yiupr921344bpjw5ml7f0sjuev4qj 2452556 2452554 2026-08-27T19:39:10Z Stashbot 7414 dancy@deploy1003: Finished scap sync-world: testing (duration: 03m 00s) 2452556 wikitext text/x-wiki pev17ciwihjfjw7fonasmkwe2m9kh5t 2452557 2452556 2026-08-27T19:41:08Z Stashbot 7414 inflatador: [bking@ganeti1046] ~$ sudo gnt-instance replace-disks -n ganeti1057.eqiad.wmnet krb1004.eqiad.wmnet T435873 2452557 wikitext text/x-wiki 82kp8gy3jsida5s1osybzys65is9qp0 2452559 2452557 2026-08-27T20:14:01Z Stashbot 7414 krinkle@deploy1003: Started scap sync-world: Backport for [[gerrit:1330486|Fix incorrect number of children in m(under|over) (T435705)]] 2452559 wikitext text/x-wiki rh4bl4jn1mnarfoxr6im6d4zk657bo9 2452560 2452559 2026-08-27T20:18:12Z Stashbot 7414 krinkle@deploy1003: krinkle: Backport for [[gerrit:1330486|Fix incorrect number of children in m(under|over) (T435705)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2452560 wikitext text/x-wiki 98kaz8n2ko9yljvl2c084fukl8to6kf 2452561 2452560 2026-08-27T20:22:24Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs-next: apply 2452561 wikitext text/x-wiki 2ar4oahi9xl92whd3mh9ypx4etef3ny 2452562 2452561 2026-08-27T20:25:59Z Stashbot 7414 krinkle@deploy1003: krinkle: Continuing with deployment 2452562 wikitext text/x-wiki hcht6u161vvawzkobntkdi3hd3v6n4a 2452563 2452562 2026-08-27T20:29:53Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs-next: apply 2452563 wikitext text/x-wiki 0nuosze9wokjhxehhzm8nwn962a5tbw 2452564 2452563 2026-08-27T20:31:02Z Stashbot 7414 krinkle@deploy1003: Finished scap sync-world: Backport for [[gerrit:1330486|Fix incorrect number of children in m(under|over) (T435705)]] (duration: 17m 00s) 2452564 wikitext text/x-wiki l0wmbhlmi0q5rbdkgen2c1b5lcfelsf 2452569 2452564 2026-08-27T20:37:06Z Stashbot 7414 cdobbins@cumin1003: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cp5022.eqsin.wmnet with OS trixie 2452569 wikitext text/x-wiki m85ac37o8lcqaxhchlwhoslk9xjnqh2 2452570 2452569 2026-08-27T20:47:08Z Stashbot 7414 jforrester@deploy1003: helmfile [staging] START helmfile.d/services/wikifunctions: apply 2452570 wikitext text/x-wiki 6nni26wjadq37cts4oqu4zwpz2iz4ms 2452571 2452570 2026-08-27T20:47:22Z Stashbot 7414 jforrester@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifunctions: apply 2452571 wikitext text/x-wiki rh3s142a28pkso6m5173cr4vwhqi1ex 2452575 2452571 2026-08-27T21:40:54Z Stashbot 7414 sbassett: Deployed security mitigations for T432713, T435026 2452575 wikitext text/x-wiki qwridl9lgh1c2jln4ojw2aojz6r2bkg 2452577 2452575 2026-08-27T22:11:08Z Stashbot 7414 jasmine@cumin1003: START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker1261.eqiad.wmnet 2452577 wikitext text/x-wiki jbjx6dfx8nekxf2y55m7jr1znleeoht 2452578 2452577 2026-08-27T22:11:12Z Stashbot 7414 jasmine@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1261.eqiad.wmnet 2452578 wikitext text/x-wiki 2a0s8905lykdptz362e5ka7nmiq1a1q 2452579 2452578 2026-08-27T22:11:44Z Stashbot 7414 jasmine@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1261.eqiad.wmnet 2452579 wikitext text/x-wiki o76ia7euvrs3ovokww96cpwsz9legtg 2452580 2452579 2026-08-27T22:12:08Z Stashbot 7414 jasmine@cumin1003: START - Cookbook sre.hosts.reimage for host wikikube-worker1261.eqiad.wmnet with OS trixie 2452580 wikitext text/x-wiki sqrulsafv6mvl5zfu4rxhshgrjx7nmx 2452581 2452580 2026-08-27T22:12:35Z Stashbot 7414 jasmine@cumin1003: START - Cookbook sre.hosts.move-vlan for host wikikube-worker1261 2452581 wikitext text/x-wiki f3keytjjm2yt9524clxk8e8pup3fi27 2452582 2452581 2026-08-27T22:13:53Z Stashbot 7414 jasmine@cumin1003: START - Cookbook sre.dns.netbox 2452582 wikitext text/x-wiki 5aj3axjr5yl5sbxixu9vemgzzivns8e 2452583 2452582 2026-08-27T22:19:10Z Stashbot 7414 jasmine@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1261 - jasmine@cumin1003" 2452583 wikitext text/x-wiki su1j8w8med8od235yderpqe406d7wpb 2452584 2452583 2026-08-27T22:19:14Z Stashbot 7414 jasmine@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1261 - jasmine@cumin1003" 2452584 wikitext text/x-wiki pmeuhk6mac42gz80q5bfqqox0bmoq04 2452585 2452584 2026-08-27T22:19:15Z Stashbot 7414 jasmine@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2452585 wikitext text/x-wiki a5c5beiwzhf55s1ow0kfgu0423vyaqj 2452586 2452585 2026-08-27T22:19:16Z Stashbot 7414 jasmine@cumin1003: START - Cookbook sre.dns.wipe-cache wikikube-worker1261.eqiad.wmnet 71.32.64.10.in-addr.arpa 1.7.0.0.2.3.0.0.4.6.0.0.0.1.0.0.3.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2452586 wikitext text/x-wiki i22r4n1juv9cy4s43ow3tharxgp70do 2452587 2452586 2026-08-27T22:19:17Z Stashbot 7414 jasmine@cumin1003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker1261.eqiad.wmnet 71.32.64.10.in-addr.arpa 1.7.0.0.2.3.0.0.4.6.0.0.0.1.0.0.3.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2452587 wikitext text/x-wiki cmksvgj6fpnoap4awlzw7vcdh8v1a38 2452588 2452587 2026-08-27T22:19:18Z Stashbot 7414 jasmine@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1261 2452588 wikitext text/x-wiki 594q20rdfjyid2jq6vttnn24p90mmxt 2452589 2452588 2026-08-27T22:20:40Z Stashbot 7414 jasmine@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1261 2452589 wikitext text/x-wiki c2zvj3agpkhu61iu48tcxu5epvjzvu2 2452590 2452589 2026-08-27T22:20:45Z Stashbot 7414 jasmine@cumin1003: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1261 2452590 wikitext text/x-wiki lk1wr82g4a8zd9cuqqsa0tjblc839uh 2452591 2452590 2026-08-27T22:40:52Z Stashbot 7414 jasmine@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1261.eqiad.wmnet with reason: host reimage 2452591 wikitext text/x-wiki hkogwvbdov4zjz7ebuock97g5grx5ke 2452592 2452591 2026-08-27T22:44:21Z Stashbot 7414 jasmine@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1261.eqiad.wmnet with reason: host reimage 2452592 wikitext text/x-wiki ci4il83q2shh80aesj24pngfo5c47j9 2452593 2452592 2026-08-27T23:05:47Z Stashbot 7414 jasmine@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1261.eqiad.wmnet with OS trixie 2452593 wikitext text/x-wiki p6qvkf989y5y6lcqlkna3wdpd56vbf0 2452594 2452593 2026-08-27T23:07:15Z Stashbot 7414 jasmine_: homer lsw1-c6-eqiad* commit 'T421711' 2452594 wikitext text/x-wiki kgg99g2k3bni2fuqzmh64tm1r7m6bvb 2452595 2452594 2026-08-27T23:14:52Z Stashbot 7414 jasmine@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1261.eqiad.wmnet 2452595 wikitext text/x-wiki poj0nzy2ksma9nerhu873m18s6sptu2 2452596 2452595 2026-08-27T23:14:53Z Stashbot 7414 jasmine@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1261.eqiad.wmnet 2452596 wikitext text/x-wiki m401v50iv83438gkzhjm07kfkqzmesv 2452597 2452596 2026-08-27T23:14:54Z Stashbot 7414 jasmine@cumin1003: END (PASS) - Cookbook sre.k8s.renumber-node (exit_code=0) Renumbering for host wikikube-worker1261.eqiad.wmnet 2452597 wikitext text/x-wiki o3c3ekduaeaj2qeufg91sme33fnljf7 2452599 2452597 2026-08-28T00:23:39Z Stashbot 7414 ladsgroup@deploy1003: helmfile [staging] START helmfile.d/services/thumbor: apply 2452599 wikitext text/x-wiki pewv0qzcs1mr6udc3qoj42fdjie9cgc 2452600 2452599 2026-08-28T00:24:01Z Stashbot 7414 ladsgroup@deploy1003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2452600 wikitext text/x-wiki gf7444s1eb0jllikk9mbe43vyr5ew87 2452601 2452600 2026-08-28T00:27:00Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2452601 wikitext text/x-wiki gbfukgioeco1n1r1u1xmmsd78c28ugt 2452602 2452601 2026-08-28T00:27:37Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2452602 wikitext text/x-wiki g88bzhnffeua3w95p5ft752eei38frz 2452603 2452602 2026-08-28T00:39:57Z Stashbot 7414 ladsgroup@deploy1003: helmfile [staging] START helmfile.d/services/thumbor: apply 2452603 wikitext text/x-wiki 5gi23wa31vj21aags3awd4yatkhh3o0 2452604 2452603 2026-08-28T00:40:05Z Stashbot 7414 ladsgroup@deploy1003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2452604 wikitext text/x-wiki p8d16izu87zjxgqtfgo4phfxhfwgro7 2452605 2452604 2026-08-28T00:52:12Z Stashbot 7414 ladsgroup@deploy1003: helmfile [staging] START helmfile.d/services/thumbor: apply 2452605 wikitext text/x-wiki 7zbkks8s32wm1hs3gyxf6pq6me5bvjv 2452606 2452605 2026-08-28T00:53:18Z Stashbot 7414 ladsgroup@deploy1003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2452606 wikitext text/x-wiki 7h6oqngw7673ordsaenw3kpw6rtjfq2 2452607 2452606 2026-08-28T00:53:28Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2452607 wikitext text/x-wiki cyzwvab2fhikhk6rqxe28bq6eiy4kkf 2452608 2452607 2026-08-28T00:53:57Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2452608 wikitext text/x-wiki mqdhbux9170mjrnm4gr9kborrlq1gk2 2452609 2452608 2026-08-28T00:54:07Z Stashbot 7414 ladsgroup@deploy1003: helmfile [eqiad] START helmfile.d/services/thumbor: apply 2452609 wikitext text/x-wiki e2w3eer9rzb950vzw1bp6n5xajaxyyb 2452610 2452609 2026-08-28T00:55:33Z Stashbot 7414 ladsgroup@deploy1003: helmfile [eqiad] DONE helmfile.d/services/thumbor: apply 2452610 wikitext text/x-wiki lvukm65tb33y5px2g81bl3xsncwvltb 2452611 2452610 2026-08-28T02:00:41Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2452611 wikitext text/x-wiki 9p56maw1k9ymxmlor3jrh9tfp4b05tr 2452612 2452611 2026-08-28T02:08:35Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 07m 53s) 2452612 wikitext text/x-wiki 64js8zr7qclncpgnap0k8s2b99y4wgy 2452613 2452612 2026-08-28T02:25:48Z Stashbot 7414 ryankemper: `ryankemper@pcc-db1002:~$ sudo -u jenkins-deploy puppetdb-populate --host an-test-coord1002.eqiad.wmnet` (refreshed stale catalog) 2452613 wikitext text/x-wiki ed07uq2u6fga7om5xhjac8vd1l84m7l 2452614 2452613 2026-08-28T02:58:08Z Stashbot 7414 tstarling@deploy1003: Started scap sync-world: Backport for [[gerrit:1328752|Grant produnto-update to groups that have editprotected (T421436)]], [[gerrit:1329728|Produnto: Add IPv6 range for GitLab (T421436)]] 2452614 wikitext text/x-wiki 62f2nq3d8hqcesl50lojdagt1jlhp6h 2452615 2452614 2026-08-28T03:02:20Z Stashbot 7414 tstarling@deploy1003: tstarling: Backport for [[gerrit:1328752|Grant produnto-update to groups that have editprotected (T421436)]], [[gerrit:1329728|Produnto: Add IPv6 range for GitLab (T421436)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2452615 wikitext text/x-wiki 3adt2st1uykgvcy84p3zb75ryau2pto 2452616 2452615 2026-08-28T03:05:26Z Stashbot 7414 tstarling@deploy1003: tstarling: Continuing with deployment 2452616 wikitext text/x-wiki 0w0zz1ab3vjg122rcb7ce4lpz3ctf3v 2452617 2452616 2026-08-28T03:10:52Z Stashbot 7414 tstarling@deploy1003: Finished scap sync-world: Backport for [[gerrit:1328752|Grant produnto-update to groups that have editprotected (T421436)]], [[gerrit:1329728|Produnto: Add IPv6 range for GitLab (T421436)]] (duration: 12m 44s) 2452617 wikitext text/x-wiki 0qknassc4rc154cphladp3e11q8oins 2452619 2452617 2026-08-28T03:38:21Z Stashbot 7414 ryankemper@cumin2003: START - Cookbook sre.presto.roll-restart-workers for Presto an-presto-test cluster: Roll restart of all Presto's jvm daemons. 2452619 wikitext text/x-wiki 9bgmc7ay4vjlpdgp80tb0vx1jgzwhx5 2452620 2452619 2026-08-28T03:40:42Z Stashbot 7414 ryankemper@cumin2003: END (PASS) - Cookbook sre.presto.roll-restart-workers (exit_code=0) for Presto an-presto-test cluster: Roll restart of all Presto's jvm daemons. 2452620 wikitext text/x-wiki atxpq83hjt2bqx8fxynkjsewl232jzw 2452621 2452620 2026-08-28T03:42:58Z Stashbot 7414 ryankemper: T435862 Verified `spill_enabled=true` and `join_spill_enabled=true` on the Presto test cluster after restarting its coordinator and worker; both nodes are active and distributed query `20260828_033922_00002_u9k78` succeeded 2452621 wikitext text/x-wiki bg777154i50mc7g6lxprl61t00g8oib 2452622 2452621 2026-08-28T03:58:53Z Stashbot 7414 ryankemper: T435862 Restarted both production Presto coordinators (standby first, then active) after enabling JOIN spilling; the active coordinator reports `spill_enabled=true` and `join_spill_enabled=true` and all 15 workers rejoined 2452622 wikitext text/x-wiki b7w1mqt77jty6xymwzoip6tr28jrkes 2452623 2452622 2026-08-28T03:59:47Z Stashbot 7414 ryankemper@cumin2003: START - Cookbook sre.presto.roll-restart-workers for Presto an-presto cluster: Roll restart of all Presto's jvm daemons. 2452623 wikitext text/x-wiki 2e631ht7o360qzrt4gw41xn7lzrwlqc 2452624 2452623 2026-08-28T04:31:52Z Stashbot 7414 ryankemper@cumin2003: END (PASS) - Cookbook sre.presto.roll-restart-workers (exit_code=0) for Presto an-presto cluster: Roll restart of all Presto's jvm daemons. 2452624 wikitext text/x-wiki a97s9hjebi8w2gf6kxlz2sln17vswc7 2452625 2452624 2026-08-28T04:34:43Z Stashbot 7414 ryankemper: T435862 Completed the rolling restart of all 15 production Presto workers; verified `true/true` spill settings across coordinators and workers, full runtime membership, the formerly failing query, and Superset dashboard 757. This is done 2452625 wikitext text/x-wiki jyzsmpidwbvmambalgzpgbah5e7ssb0 2452630 2452625 2026-08-28T06:26:30Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host bast6003.wikimedia.org 2452630 wikitext text/x-wiki rkv07roxeattgq4bpxe65g6v7sqh4kf 2452631 2452630 2026-08-28T06:30:37Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host bast6003.wikimedia.org 2452631 wikitext text/x-wiki bfua5jka0bs379mklie20nthmso2ad7 2452632 2452631 2026-08-28T07:49:46Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.decommission for hosts cumin2002.codfw.wmnet 2452632 wikitext text/x-wiki ge9qd57l0cbtz2hrkbcexrswikcpfnl 2452633 2452632 2026-08-28T08:28:49Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.dns.netbox 2452633 wikitext text/x-wiki 4j9w8nzpjf0s7qvv08hab07gseaxii2 2452634 2452633 2026-08-28T08:58:36Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cumin2002.codfw.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin2003" 2452634 wikitext text/x-wiki 42mhhkki8tegbq29uxsblioncggcz46 2452635 2452634 2026-08-28T08:59:03Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cumin2002.codfw.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin2003" 2452635 wikitext text/x-wiki owxsc51c4sz3yuhgox8bikckorx6ffa 2452636 2452635 2026-08-28T08:59:03Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2452636 wikitext text/x-wiki 4o35yb020kbdd0hmgh9dou56t98rbg6 2452637 2452636 2026-08-28T08:59:05Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts cumin2002.codfw.wmnet 2452637 wikitext text/x-wiki dfqjse0hfkpf9rwzuqpsx80vmav11r8 2452652 2452637 2026-08-28T10:43:59Z Stashbot 7414 aokoth@cumin1003: START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1004.wikimedia.org with reason: Security Release - T436069 2452652 wikitext text/x-wiki 5x6mlwndh01w66ev24dnzabz3alw2v1 2452655 2452652 2026-08-28T11:12:06Z Stashbot 7414 aokoth@cumin1003: END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1004.wikimedia.org with reason: Security Release - T436069 2452655 wikitext text/x-wiki tmtezzk9hgg35yw6hc114r623dmkgec 2452657 2452655 2026-08-28T11:23:07Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.makevm for new host cumin1004.eqiad.wmnet 2452657 wikitext text/x-wiki bkl0hsfr5lgz46u4n3ykk620lumdb6a 2452658 2452657 2026-08-28T11:23:09Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.dns.netbox 2452658 wikitext text/x-wiki l72edt8truuchvzf0getahxjb9yy7m6 2452660 2452658 2026-08-28T11:39:47Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM cumin1004.eqiad.wmnet - jmm@cumin2003" 2452660 wikitext text/x-wiki sdj2kv13x73k2q97ujd2aa8gedm0x1e 2452661 2452660 2026-08-28T11:40:09Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM cumin1004.eqiad.wmnet - jmm@cumin2003" 2452661 wikitext text/x-wiki 91iiys3kkfyqdqtmeawqxy7w0owesxa 2452662 2452661 2026-08-28T11:40:39Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2452662 wikitext text/x-wiki 3tev0dez62x4m099w7wkdwuiex3bvib 2452663 2452662 2026-08-28T11:42:49Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.dns.wipe-cache cumin1004.eqiad.wmnet on all recursors 2452663 wikitext text/x-wiki g6dwns158wa7bju7s33urx0ey1gtn6h 2452664 2452663 2026-08-28T11:43:09Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) cumin1004.eqiad.wmnet on all recursors 2452664 wikitext text/x-wiki 9dgjjtumq00dsivo0sgik5lqlj4k61n 2452665 2452664 2026-08-28T11:43:16Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM cumin1004.eqiad.wmnet - jmm@cumin2003" 2452665 wikitext text/x-wiki 3trhvle1c44pkro995lxdjn2pny0n8w 2452666 2452665 2026-08-28T11:43:23Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM cumin1004.eqiad.wmnet - jmm@cumin2003" 2452666 wikitext text/x-wiki 3170a4hzm7al2u51rd3836vuyawup2t 2452667 2452666 2026-08-28T11:43:27Z Stashbot 7414 moritzm: add new LDAP group cn=airflow-experiment-platform-ops,ou=groups,dc=wikimedia,dc=org T416709 2452667 wikitext text/x-wiki srnfi1p91hxl1d63stn16vfw5crfoda 2452668 2452667 2026-08-28T11:56:25Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reimage for host cumin1004.eqiad.wmnet with OS trixie 2452668 wikitext text/x-wiki 7y11p46e2a5b1yha5t15cxhfplw2eh3 0 17290 2452211 2451952 2026-08-27T15:06:24Z Stashbot 7414 Krinkle: Disable duplicate publishing noise from extension-IPReputation, EIPR, T143162 2452211 wikitext text/x-wiki j2halypq73hmhssdegqw7yqiqnwf8ry 0 24248 2452285 2451623 2026-08-27T16:34:55Z ADenisse-WMF 31462 /* Installing plugins */ 2452285 wikitext text/x-wiki 8hmwxq3512zv4itaxtmr4o5nlztu6vg 498 30942 2452566 2451429 2026-08-27T20:32:46Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.undrain_node 2452566 wikitext text/x-wiki tggrzu41khzbxm30unfey51a2w0n67r 2452567 2452566 2026-08-27T20:33:41Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=0) 2452567 wikitext text/x-wiki hzondonvqgx2ptv5wowujuet2c6a115 2452638 2452567 2026-08-28T09:37:27Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1065' (T435921) 2452638 wikitext text/x-wiki jqscjzsrrh4yw8z34c3mt8pxdzlk24l 2452639 2452638 2026-08-28T09:41:08Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.set_maintenance 2452639 wikitext text/x-wiki buj711fidgog1gj4t999g30bprodboi 2452640 2452639 2026-08-28T09:41:11Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.set_maintenance (exit_code=0) 2452640 wikitext text/x-wiki nkrfwlptvja9830wm4md4umyqs1kb5w 2452641 2452640 2026-08-28T09:41:21Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.set_maintenance 2452641 wikitext text/x-wiki ag8x5rinprmdazma9yn1s5aeidvs5b1 2452642 2452641 2026-08-28T09:41:25Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.set_maintenance (exit_code=0) 2452642 wikitext text/x-wiki 6a80vxppkw61jficb82egtj1ncvw4rt 2452643 2452642 2026-08-28T09:41:30Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.set_maintenance 2452643 wikitext text/x-wiki 4yt42wn426wjjj7d091ggz3cfqmm6v2 2452644 2452643 2026-08-28T09:41:37Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.set_maintenance (exit_code=0) 2452644 wikitext text/x-wiki eiih9zi22hi718g2cnc4fa6cusiz15z 2452645 2452644 2026-08-28T09:41:42Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.set_maintenance 2452645 wikitext text/x-wiki mputxil2v8x6t82b2ufmtilwu6m4mmu 2452646 2452645 2026-08-28T09:41:46Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.set_maintenance (exit_code=0) 2452646 wikitext text/x-wiki hbazxmkk6pmybppsdbo9xq10ogifikh 2452647 2452646 2026-08-28T09:41:50Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.set_maintenance 2452647 wikitext text/x-wiki 7fomdnz1yk3vz3v5rnhm94rhh21o4v5 2452648 2452647 2026-08-28T09:41:54Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.set_maintenance (exit_code=0) 2452648 wikitext text/x-wiki guhw2x4sg2w1oigtkf6fnmgg9x2y19h 2452649 2452648 2026-08-28T09:41:59Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.set_maintenance 2452649 wikitext text/x-wiki f5s5yg1k4gef4r5u3hn7dz7wgsy0s4t 2452650 2452649 2026-08-28T09:42:04Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.set_maintenance (exit_code=0) 2452650 wikitext text/x-wiki 7yox82r11vib5jbd05gpi21l60jsrlt 2452651 2452650 2026-08-28T09:49:48Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=0) on host 'cloudvirt1065' (T435921) 2452651 wikitext text/x-wiki qr2nv7vt33pbmnh1p3fw6lgngsxazgy 2452653 2452651 2026-08-28T10:44:34Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1066' (T435921) 2452653 wikitext text/x-wiki ntq6akn9qfrjhrrjab3ccl5xssyxql7 2452654 2452653 2026-08-28T10:59:48Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=0) on host 'cloudvirt1066' (T435921) 2452654 wikitext text/x-wiki qiic0eui0ppb2em1tgpycced6on7bb2 2452656 2452654 2026-08-28T11:13:57Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1067' (T435921) 2452656 wikitext text/x-wiki l05kh9i2qssblbqof5kp81d5e6isywd 2452659 2452656 2026-08-28T11:23:27Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=0) on host 'cloudvirt1067' (T435921) 2452659 wikitext text/x-wiki 1o8s8335lqfwz9tckzk9j8d19wgtmjd 498 443946 2452552 2448488 2026-08-27T19:35:09Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: deployed 04ffe29b8d (l10n updates: da, ha, he, ru) [actually deployed 7f46fc10fc, temporary T431146 branch rebased on top of that] 2452552 wikitext text/x-wiki gpikk7m3tlcmtlydzvmhrpej6sjqb8z 498 443947 2452555 2450679 2026-08-27T19:38:03Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: deployed 42c2642f71 (l10n updates: pl) 2452555 wikitext text/x-wiki o7yfn8bxe12b8i0ct20r4bxnfunmvs0 498 443949 2452160 2450676 2026-08-27T13:36:57Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy ae8f642 (Unify local dev DB config in a single dev.env file) for T436062 2452160 wikitext text/x-wiki a1eedd9kgag0g6t19khg0sdl6dk58ad 2452161 2452160 2026-08-27T13:36:59Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy d3bb817 (Add reset-db mise task to drop the database) for T436062 2452161 wikitext text/x-wiki tfpeu2bnimj1vcuvx6ou2hho653zosq 2452162 2452161 2026-08-27T13:37:02Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy aed346c (Add connect-db mise task for an interactive local DB shell) for T436062 2452162 wikitext text/x-wiki sd9e3g4iohubwflwq9a4wusmbw12vmo 2452163 2452162 2026-08-27T13:37:05Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 46bbd63 (Use DictCursor for database connections) for T436062 2452163 wikitext text/x-wiki o6vznh7r50ydmgcvwlv94h38865cecq 2452164 2452163 2026-08-27T13:37:07Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 09ca78b (Switch database name to be public-readable) for T436062 2452164 wikitext text/x-wiki 66xb60mfbes57eybs7v0ynudn53q5ws 2452165 2452164 2026-08-27T13:37:10Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 4c1328e (Provision tool database on ToolsDB using Ansible) for T436062 2452165 wikitext text/x-wiki ql5qibrbnb7w2vhx3nl1eu9oqwnjlok 2452166 2452165 2026-08-27T13:37:12Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 6623a9b (Pin database charset to utf8mb4 in dev environment) for T436062 2452166 wikitext text/x-wiki a3err4vtpi9ia9yhndh3bvlvj12jkjv 3 445563 2452529 2231946 2026-08-27T18:31:42Z RLazarus (WMF) 15215 2452529 wikitext text/x-wiki 516t1epxq65lm7no97rc35yc9qu60tx 498 447034 2452549 2439774 2026-08-27T19:33:48Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: deployed 1bf418f5d8 (l10n updates: hu) 2452549 wikitext text/x-wiki or4xwuteqbz8f0b3wjxjpnmduitxm9n 12 449113 2452173 2444302 2026-08-27T14:14:28Z Saper 135 Explain the warning 2452173 wikitext text/x-wiki 63fkp5e2tz23mkjw0tixfdifrrh6b6k 0 449160 2452598 2452069 2026-08-28T00:02:22Z Dexbot 30554 Bot: Updating the report 2452598 wikitext text/x-wiki q8vrhbjeqsajubf352ie3e9s1vuw2cm 13 449208 2452174 2452124 2026-08-27T14:14:59Z Saper 135 answered the question myself, added to the docs 2452174 wikitext text/x-wiki 5131p8uy18053huypofftbybvt6qwmu 0 451533 2452190 2451322 2026-08-27T14:47:31Z APuthin-WMF 52425 /* Next meeting agenda */ Updating next agenda & date (september edition) 2452190 wikitext text/x-wiki alobqabr9s6k0dlskgm39qqxtof70dm 0 453662 2452144 2231195 2026-08-27T12:38:53Z JMeybohm (WMF) 16709 /* Setting requests */ 2452144 wikitext text/x-wiki 76v7g3xdwnpcvviycmzc2q7dr6euh26 0 455928 2452626 2427296 2026-08-28T06:07:38Z CMing (WMF) 23277 2452626 wikitext text/x-wiki g9an4pixw48ivn6o6az0c800gpu9br7 2452627 2452626 2026-08-28T06:09:18Z CMing (WMF) 23277 /* The use() pattern */ 2452627 wikitext text/x-wiki c07c733lvq4kuf0aaorawr3vcon8h1y 2452628 2452627 2026-08-28T06:13:05Z CMing (WMF) 23277 /* How use() works */ 2452628 wikitext text/x-wiki bs1alzjq1cnx4iokdu13knscvfx9f8b 2452629 2452628 2026-08-28T06:13:55Z CMing (WMF) 23277 /* Chaining */ 2452629 wikitext text/x-wiki qt0kqi5uhgjj61q2fas04s32ezzkrb2 0 459699 2452618 2452063 2026-08-28T03:20:31Z Stashbot 7414 larssandergreen: civicrm upgraded from 06ede270 to 193803cb 2452618 wikitext text/x-wiki juceky1q1ejb6ezdqic35tqqh1mnnxk 0 460232 2452565 2449250 2026-08-27T20:31:32Z MPopov (WMF) 5891 Document app experiments' dimensions 2452565 wikitext text/x-wiki 7cxq67i58e5y0nojpj3p3vd0l8i79yr 2452568 2452565 2026-08-27T20:36:02Z MPopov (WMF) 5891 /* Dig deeper with dimensions */ Split out into two tables 2452568 wikitext text/x-wiki pg9nby02onhv292b6idbqyilbdqzbhs 0 460233 2452576 2438294 2026-08-27T21:55:00Z MPopov (WMF) 5891 Metrics and fact tables for app experiments 2452576 wikitext text/x-wiki tazl15ekp38btc8bpxef38xh7w89y74 0 460234 2452572 2451554 2026-08-27T20:48:57Z MPopov (WMF) 5891 Refocus import section to be about app experiments 2452572 wikitext text/x-wiki 4udtdmaj9045wbqtn8dlw5muiq464xu 0 460571 2452573 2450306 2026-08-27T20:58:38Z AMastilovic-WMF 40067 /* Job fields */ 2452573 wikitext text/x-wiki kmpq05g84v96qrvf3oqv74mjupcq481 2452574 2452573 2026-08-27T20:59:06Z AMastilovic-WMF 40067 /* Wait for upstream data */ 2452574 wikitext text/x-wiki 21z05ckheevq7hzneuztrdnp6k10717 0 460596 2452187 2026-08-27T14:45:30Z APuthin-WMF 52425 Adding August meeting notes 2452187 wikitext text/x-wiki gabtzehg998xrnnunrzhtgh89ww0wix 0 460597 2452533 2026-08-27T18:34:28Z Taavi 13997 archiving 2452533 wikitext text/x-wiki 7axeulyx5hx1oqxk6mow1eli8qkdsnc