Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.21 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 3086 2461625 2461080 2026-09-29T08:59:53Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-api 2461625 wikitext text/x-wiki j2a4tllmkgx9trpmjgg32ex51juy9f9 2461626 2461625 2026-09-29T09:12:28Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-api 2461626 wikitext text/x-wiki 6jlfkmhwr6zq79djb3voy66g40x85ua 0 3818 2461434 2431891 2026-09-28T18:44:19Z JHathaway (WMF) 28372 /* Micro Service */ 2461434 wikitext text/x-wiki cg1mxo901nsibz1w05y0hs6n4iya077 0 3967 2461418 2305466 2026-09-28T16:51:11Z GZWDer 4911 2461418 wikitext text/x-wiki k3zn3yfs0d94n6bwutb0vlfqjcdxl6u 2461419 2461418 2026-09-28T16:53:57Z GZWDer 4911 2461419 wikitext text/x-wiki 7qup9n8cwguzsqp2tkz9fyxqsyweyno 0 4101 2461420 48717 2026-09-28T16:54:34Z GZWDer 4911 Redirected page to [[Fundraising/Cluster/Deployments#Payments-wiki]] 2461420 wikitext text/x-wiki 1djpywwbzwfne9szretlxclisxb0nsw 0 4108 2461313 2461208 2026-09-28T12:12:12Z ScheduleDeploymentBot 37566 Add [[gerrit:1344771]] to Monday, September 28 UTC afternoon backport window 2461313 wikitext text/x-wiki 50yyaammc7i00ehqlstyxqxq90sxbl3 2461314 2461313 2026-09-28T12:12:54Z ScheduleDeploymentBot 37566 Add [[gerrit:1344772]] to Monday, September 28 UTC afternoon backport window 2461314 wikitext text/x-wiki 4cnrjox5qfapxyn704eradvg2rmf494 2461340 2461314 2026-09-28T13:08:25Z ScheduleDeploymentBot 37566 Add [[gerrit:1343917]] to Monday, October 05 UTC morning backport window 2461340 wikitext text/x-wiki kv3ww64hf0gya0eeseexn7zniikwlf8 2461353 2461340 2026-09-28T13:33:17Z JNuche (WMF) 30132 Add slot for Search Platform experiment 2461353 wikitext text/x-wiki 9029rtuv8xrzfsee1cjkbeemqg8bvvd 2461410 2461353 2026-09-28T16:14:28Z ScheduleDeploymentBot 37566 Add [[gerrit:1345588]] to Monday, September 28 UTC late backport window 2461410 wikitext text/x-wiki enmora4gzzdsdfpzlp84czz6160x862 2461423 2461410 2026-09-28T17:48:34Z ScheduleDeploymentBot 37566 Add [[gerrit:1345604]] to Monday, September 28 UTC late backport window 2461423 wikitext text/x-wiki d6a0pxlwj4vz91jx8g2cib9nidcze7p 2461425 2461423 2026-09-28T17:54:25Z ScheduleDeploymentBot 37566 Add [[gerrit:1345608]] to Monday, September 28 UTC late backport window 2461425 wikitext text/x-wiki kqptvhq4vf6cc7b3hu1jy3i7onnqclo 2461439 2461425 2026-09-28T19:13:53Z ScheduleDeploymentBot 37566 Add [[gerrit:1345624]] to Monday, September 28 UTC late backport window 2461439 wikitext text/x-wiki tqevit44ln5y326q1ra9op8g5r12g5f 2461441 2461439 2026-09-28T19:24:45Z ScheduleDeploymentBot 37566 Add [[gerrit:1345626]] to Tuesday, September 29 UTC morning backport window 2461441 wikitext text/x-wiki j1m526p4iz9y6daoif4l84x0fnxy0au 2461442 2461441 2026-09-28T19:25:44Z ScheduleDeploymentBot 37566 Add [[gerrit:1345632]] to Tuesday, September 29 UTC morning backport window 2461442 wikitext text/x-wiki 4ynnu9wjue97cyr1ujgeg1kzgvpqmjf 2461443 2461442 2026-09-28T19:25:52Z ScheduleDeploymentBot 37566 Add [[gerrit:1345627]] to Tuesday, September 29 UTC morning backport window 2461443 wikitext text/x-wiki 47fp9vxnjtsy6xd16tegfz1lwghnwm6 2461444 2461443 2026-09-28T19:26:00Z ScheduleDeploymentBot 37566 Add [[gerrit:1345633]] to Tuesday, September 29 UTC morning backport window 2461444 wikitext text/x-wiki 47f4007k7k4q851k556ythn47gbn41o 2461446 2461444 2026-09-28T19:35:06Z ScheduleDeploymentBot 37566 Add [[gerrit:1345619]] to Monday, September 28 UTC late backport window 2461446 wikitext text/x-wiki ea9ybt03j6m7gy9ud8yfr1cnq1dqp1d 2461449 2461446 2026-09-28T19:38:49Z ScheduleDeploymentBot 37566 Add [[gerrit:1345637]] to Monday, September 28 UTC late backport window 2461449 wikitext text/x-wiki i1eei0a22qduexfmlzl5mlei74dkqhx 2461454 2461449 2026-09-28T19:48:49Z ScheduleDeploymentBot 37566 Add [[gerrit:1345643]] to Monday, September 28 UTC late backport window 2461454 wikitext text/x-wiki ssjcfvr35txvwy49lg5yskzyp59kgqn 2461455 2461454 2026-09-28T19:51:44Z ScheduleDeploymentBot 37566 Add [[gerrit:1345649]] to Tuesday, September 29 UTC late backport window 2461455 wikitext text/x-wiki q8r2tt7dgl9hd5lixueuuboiuzpc25a 2461558 2461455 2026-09-29T06:19:35Z ScheduleDeploymentBot 37566 Add [[gerrit:1344405]] to Tuesday, September 29 UTC late backport window 2461558 wikitext text/x-wiki pzk0oxmsv3bln2n5x7rzxefhnzebw9c 2461559 2461558 2026-09-29T06:19:38Z ScheduleDeploymentBot 37566 Add [[gerrit:1345854]] to Tuesday, September 29 UTC morning backport window 2461559 wikitext text/x-wiki ccfyommtcl0u252o55euj20mci5573n 2461587 2461559 2026-09-29T07:27:14Z Mmullie (WMF) 291 /* {{Deployment_day|date=2026-09-29}} */ 2461587 wikitext text/x-wiki 6gf5ttkyz4yx9wtwd6clql2y2pn3bmb 2461590 2461587 2026-09-29T07:33:28Z Mmullie (WMF) 291 /* {{Deployment_day|date=2026-09-29}} */ 2461590 wikitext text/x-wiki nkszm5znxwe17d2bhq4zg328l0rmaz5 2461600 2461590 2026-09-29T07:49:48Z Mmullie (WMF) 291 /* {{Deployment_day|date=2026-09-29}} */ 2461600 wikitext text/x-wiki tfnekjg1hbus0it3y7mrzffyqtn02nz 2461627 2461600 2026-09-29T09:25:06Z WBrown (WMF) 37696 /* {{Deployment_day|date=2026-09-29}} */ + 2461627 wikitext text/x-wiki rs7yq8uuuxoxgdyf5zi5g9izx67l3tp 2461661 2461627 2026-09-29T11:03:13Z ScheduleDeploymentBot 37566 Add [[gerrit:1345952]] to Tuesday, September 29 UTC afternoon backport window 2461661 wikitext text/x-wiki 44swfg7soih8lnbs5gymahbfzw8o6ms 2461662 2461661 2026-09-29T11:03:47Z ScheduleDeploymentBot 37566 Add [[gerrit:1345953]] to Tuesday, September 29 UTC afternoon backport window 2461662 wikitext text/x-wiki d8o309ho6nal15t114quxa1dq9f6551 498 6726 2461617 2460309 2026-09-29T08:46:46Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-api 2461617 wikitext text/x-wiki bwdv17egtbjj9hz6qyzcu3nfhffcejo 2461623 2461617 2026-09-29T08:59:14Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-api 2461623 wikitext text/x-wiki asjzmqk93sedmmulvqcy14t73bn3ntc 0 7919 2461311 2461310 2026-09-28T12:04:27Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dse-k8s-worker2008.codfw.wmnet with reason: host reimage 2461311 wikitext text/x-wiki poa9h5wrd7e0j0n9jo0zwynz6g8insb 2461315 2461311 2026-09-28T12:14:19Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-liftwing-studio: apply 2461315 wikitext text/x-wiki cow71wwjy8yd6oyfelr71kt7u7vt6zy 2461316 2461315 2026-09-28T12:14:22Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-liftwing-studio: apply 2461316 wikitext text/x-wiki krde15zr6640m6qv013us57k3jeo8wo 2461317 2461316 2026-09-28T12:14:56Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-main: apply 2461317 wikitext text/x-wiki m1h687mhrg1zs8jdsz0s6d47jwq99dy 2461318 2461317 2026-09-28T12:15:29Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-main: apply 2461318 wikitext text/x-wiki f0d5uqpu4nmoht8q4fq3mnbhb3xvcak 2461319 2461318 2026-09-28T12:17:32Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. 2461319 wikitext text/x-wiki 5js4gega9otii16x8wjk1giw301awui 2461320 2461319 2026-09-28T12:17:49Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. 2461320 wikitext text/x-wiki 7sxiq3dn60q804f2lls0aq1912yh2sq 2461321 2461320 2026-09-28T12:18:06Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2461321 wikitext text/x-wiki g3o5ga2bu8wjvyjigebqquq21mngcan 2461322 2461321 2026-09-28T12:18:29Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2461322 wikitext text/x-wiki 0iw7m2690z4qg7paw2hxvjszpdly8e2 2461323 2461322 2026-09-28T12:19:10Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on A:cp-text_esams and A:cp - 3.2.23 upgrade (T438828) 2461323 wikitext text/x-wiki inepmx5ljryfgrv5y3x92mc363gvm53 2461324 2461323 2026-09-28T12:19:27Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/liftwing-studio: sync 2461324 wikitext text/x-wiki 0wcasnehl2kd0clkp0jv8mdd2hurqvf 2461325 2461324 2026-09-28T12:21:57Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dse-k8s-worker2008.codfw.wmnet with OS bookworm 2461325 wikitext text/x-wiki s3ivrj5xwd4zea5fhvv610wbk5yl7du 2461326 2461325 2026-09-28T12:27:50Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.hosts.reboot-single for host dse-k8s-worker2008.codfw.wmnet 2461326 wikitext text/x-wiki rebx1yveo8vpzjudimqojnbgcczhbif 2461327 2461326 2026-09-28T12:28:18Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/liftwing-studio: sync 2461327 wikitext text/x-wiki 92vntvhnd4zysxy1tpzvd268g49qulb 2461328 2461327 2026-09-28T12:29:11Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/liftwing-studio: sync 2461328 wikitext text/x-wiki avdi5jerx47bz023erpq0bep1xreftz 2461329 2461328 2026-09-28T12:29:49Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/liftwing-studio: sync 2461329 wikitext text/x-wiki sh5n4hv3lnykbdkx519atpdxev7jocs 2461330 2461329 2026-09-28T12:33:06Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dse-k8s-worker2008.codfw.wmnet 2461330 wikitext text/x-wiki r0mfdu9y9syryu001gx2i7v6t5vqe18 2461331 2461330 2026-09-28T12:33:13Z Stashbot 7414 brouberol@cumin1004: conftool action : set/weight=10; selector: name=dse-k8s-worker2008.codfw.wmnet 2461331 wikitext text/x-wiki 4rzj2spoh759ktxs9sibau9ggko1fs9 2461332 2461331 2026-09-28T12:33:22Z Stashbot 7414 brouberol@cumin1004: conftool action : set/pooled=yes; selector: name=dse-k8s-worker2008.codfw.wmnet 2461332 wikitext text/x-wiki 0s9mt9fpdgd9lkd17tzmk6zudulfsh6 2461338 2461332 2026-09-28T13:03:48Z Stashbot 7414 sbisson@deploy1003: Started scap sync-world: Backport for [[gerrit:1345130|Remove unused config: ArticleGuidanceRedirectEntryPointTitles (T437643)]] 2461338 wikitext text/x-wiki ry6jtq37wfurowou6689u2hpscg54g6 2461339 2461338 2026-09-28T13:07:47Z Stashbot 7414 sbisson@deploy1003: sbisson: Backport for [[gerrit:1345130|Remove unused config: ArticleGuidanceRedirectEntryPointTitles (T437643)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2461339 wikitext text/x-wiki bri4p3r6fr27b2uykx222jrjc6yv1mn 2461341 2461339 2026-09-28T13:11:24Z Stashbot 7414 sbisson@deploy1003: sbisson: Continuing with deployment 2461341 wikitext text/x-wiki 0w5utlhv5cuu2hc7ukxxxk2f3wisj5r 2461342 2461341 2026-09-28T13:16:46Z Stashbot 7414 sbisson@deploy1003: Finished scap sync-world: Backport for [[gerrit:1345130|Remove unused config: ArticleGuidanceRedirectEntryPointTitles (T437643)]] (duration: 12m 58s) 2461342 wikitext text/x-wiki ltmzrbomah9tm2iayjxcujzxi8ty85l 2461343 2461342 2026-09-28T13:18:25Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.hosts.provision for host krb1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2461343 wikitext text/x-wiki adb5s7frbz8cycngy3mdy6qy0pkyst1 2461344 2461343 2026-09-28T13:19:27Z Stashbot 7414 jclark@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host krb1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2461344 wikitext text/x-wiki 8hfoiug4vb7m75od5kp4c9zni7lzu7n 2461345 2461344 2026-09-28T13:21:45Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.hosts.provision for host krb1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2461345 wikitext text/x-wiki cw25zc66azxoefe6knnad7kz56xml5i 2461346 2461345 2026-09-28T13:22:18Z Stashbot 7414 jclark@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host krb1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2461346 wikitext text/x-wiki lfqz1k8m6b7on5svwyyzzmhr39nst6e 2461347 2461346 2026-09-28T13:23:29Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Started scap sync-world: Backport for [[gerrit:1345052|Enable FlaggedRevs for the Author NS on ruwikisource (T439159)]] 2461347 wikitext text/x-wiki 4nop7bwjk81ororbd1dul10mzsnsgxp 2461349 2461347 2026-09-28T13:27:31Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: ameisenigel, lucaswerkmeister-wmde: Backport for [[gerrit:1345052|Enable FlaggedRevs for the Author NS on ruwikisource (T439159)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2461349 wikitext text/x-wiki 8yv21601pig98cbu6s3exb5i9vfj3fx 2461350 2461349 2026-09-28T13:30:16Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: ameisenigel, lucaswerkmeister-wmde: Continuing with deployment 2461350 wikitext text/x-wiki liz3zubafhh7i12744qp3e9jaw0m4sz 2461351 2461350 2026-09-28T13:30:41Z Stashbot 7414 dpogorzelski@cumin1004: conftool action : set/pooled=true; selector: dnsdisc=inference,name=codfw 2461351 wikitext text/x-wiki 79xu8jg8x87845wroy6cn1j44j1zl1k 2461352 2461351 2026-09-28T13:32:06Z Stashbot 7414 dpogorzelski@cumin1004: conftool action : set/pooled=true; selector: dnsdisc=k8s-ingress-ml-serve,name=codfw 2461352 wikitext text/x-wiki kgtzm53bi2irqa3h0dq6mabj9qx82b2 2461354 2461352 2026-09-28T13:33:28Z Stashbot 7414 vgutierrez: depool cp7001 for some purged tests - T439361 2461354 wikitext text/x-wiki 4d5jlhuscpp7k7hnwcwy3swy70nhcpt 2461355 2461354 2026-09-28T13:33:31Z Stashbot 7414 filippo@cumin1004: START - Cookbook sre.hosts.reimage for host cloudcephosd1055.eqiad.wmnet with OS bookworm 2461355 wikitext text/x-wiki qgp3692a8kj5gvvyh4v0qg5jnca3uub 2461356 2461355 2026-09-28T13:35:32Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Finished scap sync-world: Backport for [[gerrit:1345052|Enable FlaggedRevs for the Author NS on ruwikisource (T439159)]] (duration: 12m 02s) 2461356 wikitext text/x-wiki rj4b7rjtmhpu7sbcsdjmx24kiwv3u2c 2461357 2461356 2026-09-28T13:36:43Z Stashbot 7414 dpogorzelski@cumin1004: conftool action : set/pooled=true; selector: dnsdisc=k8s-ingress-ml-staging,name=codfw 2461357 wikitext text/x-wiki 2zdz97u60a4wo9aidl862zsujtuvue8 2461358 2461357 2026-09-28T13:37:34Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Started scap sync-world: Backport for [[gerrit:1344216|Enable Extension:Translate and Extension:TranslationNotifications on co.wikimedia.org (T386776)]] 2461358 wikitext text/x-wiki cxjnqt4ujvwkius9wxcxt4ol1wo2wpn 2461359 2461358 2026-09-28T13:41:38Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: lucaswerkmeister-wmde, ameisenigel: Backport for [[gerrit:1344216|Enable Extension:Translate and Extension:TranslationNotifications on co.wikimedia.org (T386776)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2461359 wikitext text/x-wiki 9tlaw7aixnlsgllege63l3732gy0wmt 2461360 2461359 2026-09-28T13:41:39Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.hosts.provision for host krb1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2461360 wikitext text/x-wiki 9ndwxsn2l09x71yyfynpu60qpa0jjfz 2461361 2461360 2026-09-28T13:42:15Z Stashbot 7414 jclark@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host krb1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2461361 wikitext text/x-wiki bngny2ok9g1z8qdbxajgs77tg93sqyh 2461362 2461361 2026-09-28T13:44:51Z Stashbot 7414 bking@dns2004: START - running authdns-update 2461362 wikitext text/x-wiki 0lb70d7fnvxzvx2wfqyxvnbcb36093o 2461364 2461362 2026-09-28T13:47:20Z Stashbot 7414 bking@dns2004: END - running authdns-update 2461364 wikitext text/x-wiki bhri77lik6pa0sqan8r4szv63lzi24l 2461365 2461364 2026-09-28T13:51:54Z Stashbot 7414 tappof: Rebalancing is in progress on kafka-logging in eqiad to evacuate kafka-logging1001 and kafka-logging1002 - T432444 2461365 wikitext text/x-wiki qw653ubin7kwoq3c27nm5j9u8igrscn 2461366 2461365 2026-09-28T13:53:45Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.hosts.provision for host krb1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2461366 wikitext text/x-wiki 6sguzpamjjmvelhdrohfgr0jogbrurj 2461367 2461366 2026-09-28T13:54:15Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: lucaswerkmeister-wmde, ameisenigel: Rolling back deployment 2461367 wikitext text/x-wiki o5wq41c93rs4alg8bnk2g2wa1wczje4 2461368 2461367 2026-09-28T13:54:32Z Stashbot 7414 jclark@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host krb1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2461368 wikitext text/x-wiki scs70kfknfttj0zinf6dts9ds68n9kh 2461369 2461368 2026-09-28T13:57:13Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Finished scap sync-world: Backport for [[gerrit:1344216|Enable Extension:Translate and Extension:TranslationNotifications on co.wikimedia.org (T386776)]] (duration: 19m 38s) 2461369 wikitext text/x-wiki my3ncpjx128pzc2gx4c7x584x6l9mry 2461370 2461369 2026-09-28T13:57:22Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.hosts.provision for host krb1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2461370 wikitext text/x-wiki lfuxrncxk7jm5cxwmv858g6b86vemmg 2461371 2461370 2026-09-28T13:58:01Z Stashbot 7414 vgutierrez: repool cp7001 - T439361 2461371 wikitext text/x-wiki kqn2g7aw306jmzfrzlf9tyxsoe6toc3 2461372 2461371 2026-09-28T13:58:31Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Started scap sync-world: Backport for [[gerrit:1345559|Revert "Enable Extension:Translate and Extension:TranslationNotifications on co.wikimedia.org" (T386776)]] 2461372 wikitext text/x-wiki cd04afoj6fmxmwubwl3ijubzycb2389 2461373 2461372 2026-09-28T14:02:44Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: lucaswerkmeister-wmde: Backport for [[gerrit:1345559|Revert "Enable Extension:Translate and Extension:TranslationNotifications on co.wikimedia.org" (T386776)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2461373 wikitext text/x-wiki fkuyqhf010zue01wrkssijg49cvwgmg 2461374 2461373 2026-09-28T14:02:57Z Stashbot 7414 jclark@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host krb1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2461374 wikitext text/x-wiki t4j782dj1k2b1q2ucrje2ii76c3sguz 2461375 2461374 2026-09-28T14:03:54Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: lucaswerkmeister-wmde: Continuing with deployment 2461375 wikitext text/x-wiki jxgu7rrs9ljy9vjgaai4p674hzzve8d 2461376 2461375 2026-09-28T14:05:27Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.dns.netbox 2461376 wikitext text/x-wiki sj2v41kbtprxom3e9jqm3gdjiaktgj1 2461377 2461376 2026-09-28T14:09:12Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Finished scap sync-world: Backport for [[gerrit:1345559|Revert "Enable Extension:Translate and Extension:TranslationNotifications on co.wikimedia.org" (T386776)]] (duration: 10m 40s) 2461377 wikitext text/x-wiki 550je14umgqw7r885j6htk3yeqxd6mt 2461378 2461377 2026-09-28T14:09:22Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding krb1002 to eqiad - jclark@cumin1004" 2461378 wikitext text/x-wiki 9l7fmys8x3qgozcufy5aahsq9d7ubo2 2461379 2461378 2026-09-28T14:09:41Z Stashbot 7414 jclark@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding krb1002 to eqiad - jclark@cumin1004" 2461379 wikitext text/x-wiki rekd2y7ylhpc6b6grlzxn91604p8018 2461380 2461379 2026-09-28T14:09:42Z Stashbot 7414 jclark@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2461380 wikitext text/x-wiki a45pcoao8nzwdxm346uikav4kxa8lt2 2461381 2461380 2026-09-28T14:10:07Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.hosts.provision for host krb1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2461381 wikitext text/x-wiki 51n9w4ey5ki049mnsuug7yrihu58nnr 2461383 2461381 2026-09-28T14:10:38Z Stashbot 7414 jclark@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host krb1002.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2461383 wikitext text/x-wiki 2xxdgyx05sq379dyvm4y6n5iaef0du9 2461384 2461383 2026-09-28T14:17:13Z Stashbot 7414 bking@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2461384 wikitext text/x-wiki 0jmndl9m2dqubqs81ostyrd1fzzxs2r 2461385 2461384 2026-09-28T14:17:58Z Stashbot 7414 bking@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2461385 wikitext text/x-wiki rmtvf3w2ye7jt6lybzgnm5q4ny6rtqc 2461386 2461385 2026-09-28T14:20:50Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Started scap sync-world: Backport for [[gerrit:1344771|feat(AccountSetup), styles: Increase thumbnail size in ReadingRecommendations (T436332)]], [[gerrit:1344772|feat(AccountSetup), styles: Apply correct background and button styles (T436332)]] 2461386 wikitext text/x-wiki rrwvvdk0rglfnaf3qp4wkg4wjjy41wn 2461387 2461386 2026-09-28T14:24:56Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: lucaswerkmeister-wmde, volker-e: Backport for [[gerrit:1344771|feat(AccountSetup), styles: Increase thumbnail size in ReadingRecommendations (T436332)]], [[gerrit:1344772|feat(AccountSetup), styles: Apply correct background and button styles (T436332)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2461387 wikitext text/x-wiki 7iv1qzpxo0crl49n2m9ni7qemlaum8e 2461391 2461387 2026-09-28T14:49:12Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: lucaswerkmeister-wmde, volker-e: Continuing with deployment 2461391 wikitext text/x-wiki 7iu5yekvlhpc55ej4obzfjfxegqjt2s 2461392 2461391 2026-09-28T14:54:34Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Finished scap sync-world: Backport for [[gerrit:1344771|feat(AccountSetup), styles: Increase thumbnail size in ReadingRecommendations (T436332)]], [[gerrit:1344772|feat(AccountSetup), styles: Apply correct background and button styles (T436332)]] (duration: 33m 44s) 2461392 wikitext text/x-wiki s2fcyzfq6l052h3npjf8ukvj3ofa8li 2461393 2461392 2026-09-28T14:55:33Z Stashbot 7414 Lucas_WMDE: UTC afternoon backport+config window done 2461393 wikitext text/x-wiki 830a11e0er07w92ew1zza8688q78lmn 2461394 2461393 2026-09-28T15:06:27Z Stashbot 7414 filippo@cumin1004: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudcephosd1055.eqiad.wmnet with OS bookworm 2461394 wikitext text/x-wiki 3jvnpgox9gxa4r57xjxxhmcsigcv7fp 2461396 2461394 2026-09-28T15:40:35Z Stashbot 7414 elukey@puppetserver1001: conftool action : set/pooled=true; selector: dnsdisc=pki,name=codfw 2461396 wikitext text/x-wiki hdb6oyz9yjj63xr7kmy8q01r9ervvja 2461397 2461396 2026-09-28T15:41:44Z Stashbot 7414 jdrewniak@deploy1003: Started scap sync-world: Backport for [[gerrit:1345580|Bumping portals to master (T128546)]] 2461397 wikitext text/x-wiki g0bpzlp619ksc81e9sz5gesr4v0qe83 2461398 2461397 2026-09-28T15:41:53Z Stashbot 7414 elukey@puppetserver1001: conftool action : set/pooled=true; selector: dnsdisc=puppetdb-api,name=codfw 2461398 wikitext text/x-wiki tmk8mae87h86mb9rztrj7d4a08cq6md 2461399 2461398 2026-09-28T15:41:58Z Stashbot 7414 elukey@puppetserver1001: conftool action : set/pooled=true; selector: dnsdisc=puppetboard,name=codfw 2461399 wikitext text/x-wiki iupzo40ny138nx9pkyw5d9p6t3aj15d 2461400 2461399 2026-09-28T15:45:44Z Stashbot 7414 jdrewniak@deploy1003: jdrewniak: Backport for [[gerrit:1345580|Bumping portals to master (T128546)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2461400 wikitext text/x-wiki 1oxpf5zcm0uhw7yrx8f2utqn2r7h8w6 2461401 2461400 2026-09-28T15:46:55Z Stashbot 7414 zabe: clone wbc_entity_usage to x1 for testwikidatawiki clients # T439319 2461401 wikitext text/x-wiki e0dj1u3dyhubis8ivn0yd0flom0mwth 2461402 2461401 2026-09-28T15:56:16Z Stashbot 7414 jdrewniak@deploy1003: jdrewniak: Continuing with deployment 2461402 wikitext text/x-wiki tb4bfjoanxm54601rwds04r2ymkjl25 2461403 2461402 2026-09-28T16:01:38Z Stashbot 7414 jdrewniak@deploy1003: Finished scap sync-world: Backport for [[gerrit:1345580|Bumping portals to master (T128546)]] (duration: 19m 54s) 2461403 wikitext text/x-wiki hynpru47adewmoh660v76htl4bttkck 2461404 2461403 2026-09-28T16:02:46Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply 2461404 wikitext text/x-wiki 6t9im5tb827wxme15rzyogu5g8zqamf 2461405 2461404 2026-09-28T16:03:37Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply 2461405 wikitext text/x-wiki 9g3boh9mrk67ki1zntme9whz5zrk4rf 2461406 2461405 2026-09-28T16:04:57Z Stashbot 7414 brett@cumin1004: START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on A:cp-text_drmrs - 7.1.1-2~bpo13+wmf3 () 2461406 wikitext text/x-wiki n2lu15zuqken8cr2seoacfcldc0ddyj 2461407 2461406 2026-09-28T16:05:11Z Stashbot 7414 brett@cumin1004: START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on A:cp-upload_drmrs - 7.1.1-2~bpo13+wmf3 () 2461407 wikitext text/x-wiki ohhmapswimvtc2ilmv96iz55bu6z41x 2461408 2461407 2026-09-28T16:06:55Z Stashbot 7414 zabe@deploy1003: Started scap sync-world: Backport for [[gerrit:1345298|wikibase: Set virtual-wikibase-entityusage to x1 for test wikis (T439319)]] 2461408 wikitext text/x-wiki dxlha4l6wbfdruo9umu6rhdfjoh3eo5 2461409 2461408 2026-09-28T16:10:47Z Stashbot 7414 zabe@deploy1003: zabe: Backport for [[gerrit:1345298|wikibase: Set virtual-wikibase-entityusage to x1 for test wikis (T439319)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2461409 wikitext text/x-wiki mq90pogzu3ryszpfudaxw72hx97mwkp 2461411 2461409 2026-09-28T16:15:27Z Stashbot 7414 zabe@deploy1003: zabe: Continuing with deployment 2461411 wikitext text/x-wiki fhd2o7d2fxw98zj8ajmqw4pdr8qk83p 2461412 2461411 2026-09-28T16:20:45Z Stashbot 7414 zabe@deploy1003: Finished scap sync-world: Backport for [[gerrit:1345298|wikibase: Set virtual-wikibase-entityusage to x1 for test wikis (T439319)]] (duration: 13m 50s) 2461412 wikitext text/x-wiki stproautaegzge0hhju0e5yafnpplum 2461424 2461412 2026-09-28T17:48:53Z Stashbot 7414 dzahn@cumin1004: START - Cookbook sre.hosts.reimage for host zuul1006.eqiad.wmnet with OS trixie 2461424 wikitext text/x-wiki oy4cit3cy0yvc3mhe21ertkcrfzgeg7 2461427 2461424 2026-09-28T18:04:23Z Stashbot 7414 dzahn@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on zuul1006.eqiad.wmnet with reason: host reimage 2461427 wikitext text/x-wiki gzxoxpcdk39452dda8qk4zviw4j8blx 2461428 2461427 2026-09-28T18:08:36Z Stashbot 7414 dzahn@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on zuul1006.eqiad.wmnet with reason: host reimage 2461428 wikitext text/x-wiki sr0zhh248nk3eo6yy6t1megmsn8b645 2461430 2461428 2026-09-28T18:19:59Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hosts.reimage for host ncredir5004.eqsin.wmnet with OS trixie 2461430 wikitext text/x-wiki jxabd2rsccgvw2liq3f31ptddtojhgy 2461431 2461430 2026-09-28T18:24:22Z Stashbot 7414 dzahn@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host zuul1006.eqiad.wmnet with OS trixie 2461431 wikitext text/x-wiki 5nprud8ptdwwf3cs3j0sjc70uz61bxr 2461432 2461431 2026-09-28T18:36:30Z Stashbot 7414 dancy@deploy1003: Installing scap version "4.293.0" for 3 host(s) 2461432 wikitext text/x-wiki p6ziqcavwld2pp7brx2iy9ey6tq88sc 2461433 2461432 2026-09-28T18:38:26Z Stashbot 7414 dancy@deploy1003: Installation of scap version "4.293.0" completed for 3 hosts 2461433 wikitext text/x-wiki 7gkqwe6xqpuck5k6ak4vua3i6540y5s 2461435 2461433 2026-09-28T18:46:39Z Stashbot 7414 jhathaway: puppet lvm upgrade broke ml-serve hosts, looking for a hotfix, or I'll rollback... 2461435 wikitext text/x-wiki 8ci1kkivevmu7h4mxc8gsb2iqphm1zx 2461436 2461435 2026-09-28T18:47:29Z Stashbot 7414 brett@cumin1004: END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on A:cp-upload_drmrs - 7.1.1-2~bpo13+wmf3 () 2461436 wikitext text/x-wiki tpj66qdcx0d3or0oz2fdhdk6yoej017 2461437 2461436 2026-09-28T19:03:03Z Stashbot 7414 cdobbins@cumin1004: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ncredir5004.eqsin.wmnet with OS trixie 2461437 wikitext text/x-wiki 1svwez6otqsa6u07k7g78n6uwcorpfs 2461438 2461437 2026-09-28T19:03:25Z Stashbot 7414 brett@cumin1004: START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on A:cp-upload_esams - 7.1.1-2~bpo13+wmf3 () 2461438 wikitext text/x-wiki em8n36vzaoknm9axlqcmiy7suxmdsmu 2461440 2461438 2026-09-28T19:16:39Z Stashbot 7414 brett@cumin1004: END (FAIL) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=1) rolling upgrade of Varnish on A:cp-text_drmrs - 7.1.1-2~bpo13+wmf3 () 2461440 wikitext text/x-wiki qg3hgiz382exn02ngkhjmmb8z41gl4a 2461445 2461440 2026-09-28T19:31:27Z Stashbot 7414 brett@cumin1004: START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on P{cp601[3-6].drmrs.wmnet} and A:cp - 7.1.1-2~bpo13+wmf3 () 2461445 wikitext text/x-wiki dojraanotifomhabb2zoqont5n99gbk 2461451 2461445 2026-09-28T19:42:10Z Stashbot 7414 dancy@deploy1003: Installing scap version "4.293.1" for 3 host(s) 2461451 wikitext text/x-wiki dwh5ceidnpew168mhxyuxf9jaz6avpm 2461453 2461451 2026-09-28T19:44:03Z Stashbot 7414 dancy@deploy1003: Installation of scap version "4.293.1" completed for 3 hosts 2461453 wikitext text/x-wiki ahsznzkp21o3wvega0d5wqlj7md8gvy 2461456 2461453 2026-09-28T19:54:41Z Stashbot 7414 dzahn@cumin1004: START - Cookbook sre.hosts.reimage for host zuul1007.eqiad.wmnet with OS trixie 2461456 wikitext text/x-wiki ruj5cbzcrk4z5orvygfj1kg005cubn5 2461457 2461456 2026-09-28T20:03:05Z Stashbot 7414 aude@deploy1003: Started scap sync-world: Backport for [[gerrit:1345588|Enable ReadingLists on all Wikipedia wikis (T434924)]], [[gerrit:1345619|Enable Reading Recommendations experiment featured category setting (T437348)]] 2461457 wikitext text/x-wiki kegzojy75n8jinp6krbuk7ec1dzm5j8 2461458 2461457 2026-09-28T20:07:11Z Stashbot 7414 aude@deploy1003: aude, volker-e: Backport for [[gerrit:1345588|Enable ReadingLists on all Wikipedia wikis (T434924)]], [[gerrit:1345619|Enable Reading Recommendations experiment featured category setting (T437348)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2461458 wikitext text/x-wiki 7kh2azi6enzi31tf1zc15ua6mo8c568 2461459 2461458 2026-09-28T20:08:29Z Stashbot 7414 brett@puppetserver1001: conftool action : set/pooled=yes; selector: name=cp6013.* 2461459 wikitext text/x-wiki 8gpemi2knmskzdnmr9mu3vv2udqla8c 2461460 2461459 2026-09-28T20:08:37Z Stashbot 7414 dzahn@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on zuul1007.eqiad.wmnet with reason: host reimage 2461460 wikitext text/x-wiki n54h6axr6ffsnkoiua285k894kptad2 2461461 2461460 2026-09-28T20:10:45Z Stashbot 7414 aude@deploy1003: aude, volker-e: Continuing with deployment 2461461 wikitext text/x-wiki qo1nhuur8qxdk417nhbajy54lo1n1y9 2461462 2461461 2026-09-28T20:13:03Z Stashbot 7414 dzahn@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on zuul1007.eqiad.wmnet with reason: host reimage 2461462 wikitext text/x-wiki 409vacpvkd1b4pj1mg511c61v3paf8j 2461463 2461462 2026-09-28T20:16:10Z Stashbot 7414 aude@deploy1003: Finished scap sync-world: Backport for [[gerrit:1345588|Enable ReadingLists on all Wikipedia wikis (T434924)]], [[gerrit:1345619|Enable Reading Recommendations experiment featured category setting (T437348)]] (duration: 13m 05s) 2461463 wikitext text/x-wiki 5xsrlnh0xgp67d66xt3h8evk6vjsqhf 2461464 2461463 2026-09-28T20:22:26Z Stashbot 7414 cjming@deploy1003: Started scap sync-world: Backport for [[gerrit:1345604|Revert "HtmlToContentTransform: Pass DomPageBundle to Parsoid"]] 2461464 wikitext text/x-wiki bqa9xzk6rc3hx7elkyd0lcx3p2103n5 2461466 2461464 2026-09-28T20:26:24Z Stashbot 7414 cjming@deploy1003: ssastry, cjming: Backport for [[gerrit:1345604|Revert "HtmlToContentTransform: Pass DomPageBundle to Parsoid"]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2461466 wikitext text/x-wiki 7wckvbvis6g3mha0tx1qmvgsw7kh4fu 2461467 2461466 2026-09-28T20:27:00Z Stashbot 7414 cjming@deploy1003: ssastry, cjming: Continuing with deployment 2461467 wikitext text/x-wiki d5xxx6ktxgv7clpnnrn3jfqvd1jpka9 2461468 2461467 2026-09-28T20:29:21Z Stashbot 7414 dzahn@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host zuul1007.eqiad.wmnet with OS trixie 2461468 wikitext text/x-wiki 3h7f2ltmw756h8jpz4mph4tqkw70vhf 2461469 2461468 2026-09-28T20:32:13Z Stashbot 7414 cjming@deploy1003: Finished scap sync-world: Backport for [[gerrit:1345604|Revert "HtmlToContentTransform: Pass DomPageBundle to Parsoid"]] (duration: 09m 47s) 2461469 wikitext text/x-wiki igd4v9u7hjzzi7flr891hfzsyh3w8nj 2461470 2461469 2026-09-28T20:41:25Z Stashbot 7414 kemayo@deploy1003: Started scap sync-world: Backport for [[gerrit:1345608|BaseEditCheck#inAllowedNamespace: was true if any extra namespaces set (T400506)]], [[gerrit:1345637|EditCheck: only log a session if checks are actually possible (T438916)]] 2461470 wikitext text/x-wiki hiwlpm5t7q3jzzu47dic6eph2sivnw8 2461471 2461470 2026-09-28T20:45:26Z Stashbot 7414 kemayo@deploy1003: kemayo: Backport for [[gerrit:1345608|BaseEditCheck#inAllowedNamespace: was true if any extra namespaces set (T400506)]], [[gerrit:1345637|EditCheck: only log a session if checks are actually possible (T438916)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2461471 wikitext text/x-wiki fm249ceinma1s1391zhzg0dnlzrpfgh 2461472 2461471 2026-09-28T20:46:34Z Stashbot 7414 kemayo@deploy1003: kemayo: Continuing with deployment 2461472 wikitext text/x-wiki 3nlg2cylctaxhmajs493jix0fof12s7 2461473 2461472 2026-09-28T20:47:13Z Stashbot 7414 dzahn@cumin1004: START - Cookbook sre.hosts.reimage for host zuul1005.eqiad.wmnet with OS trixie 2461473 wikitext text/x-wiki 6z2rkgnuk2pmhr0fniucxzdanlf6yj4 2461474 2461473 2026-09-28T20:47:49Z Stashbot 7414 herron: uploaded rsyslog 8.2608.0-4~wmf13+1 to trixie-wikimedia T438375 2461474 wikitext text/x-wiki nysotwap8lalx3z7gn314r1he3ynu6a 2461475 2461474 2026-09-28T20:51:52Z Stashbot 7414 kemayo@deploy1003: Finished scap sync-world: Backport for [[gerrit:1345608|BaseEditCheck#inAllowedNamespace: was true if any extra namespaces set (T400506)]], [[gerrit:1345637|EditCheck: only log a session if checks are actually possible (T438916)]] (duration: 10m 28s) 2461475 wikitext text/x-wiki 5ww6pgcyxq6197zlyreaie8wnkjo350 2461478 2461475 2026-09-28T21:00:40Z Stashbot 7414 cjming@deploy1003: Started scap sync-world: Backport for [[gerrit:1345624|fix(ReadingRecommendations): reposition personalize button (T439158)]], [[gerrit:1345643|fix(Homepage): apply the body transform only when an overlay is open (T439038)]] 2461478 wikitext text/x-wiki bqe2bgvsujmnzybcazx9np7qggflbcq 2461479 2461478 2026-09-28T21:04:56Z Stashbot 7414 cjming@deploy1003: volker-e, cjming: Backport for [[gerrit:1345624|fix(ReadingRecommendations): reposition personalize button (T439158)]], [[gerrit:1345643|fix(Homepage): apply the body transform only when an overlay is open (T439038)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2461479 wikitext text/x-wiki j1psll7rn7wxxrabt8svveo3t1r3slv 2461481 2461479 2026-09-28T21:07:07Z Stashbot 7414 arlolra@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2461481 wikitext text/x-wiki 50ug25jdgot9to74a00o8j6o8pizszh 2461482 2461481 2026-09-28T21:07:44Z Stashbot 7414 arlolra@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2461482 wikitext text/x-wiki isghc4mcz06miyh91ko4y4x70ojtke9 2461483 2461482 2026-09-28T21:07:45Z Stashbot 7414 arlolra@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2461483 wikitext text/x-wiki rmmp4mgusftvo7ide3sexkoznj0p5t1 2461484 2461483 2026-09-28T21:08:07Z Stashbot 7414 cjming@deploy1003: volker-e, cjming: Continuing with deployment 2461484 wikitext text/x-wiki 1wsai0h1in60jn4xa0kpvasohm4fcwa 2461485 2461484 2026-09-28T21:08:30Z Stashbot 7414 arlolra@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2461485 wikitext text/x-wiki l8f2xumxxg975dlmjcwey5bcsky4s75 2461486 2461485 2026-09-28T21:12:55Z Stashbot 7414 brett@cumin1004: END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on P{cp601[3-6].drmrs.wmnet} and A:cp - 7.1.1-2~bpo13+wmf3 () 2461486 wikitext text/x-wiki 5nz001pfdol3s6fkjgovf6be4x838ul 2461487 2461486 2026-09-28T21:13:27Z Stashbot 7414 cjming@deploy1003: Finished scap sync-world: Backport for [[gerrit:1345624|fix(ReadingRecommendations): reposition personalize button (T439158)]], [[gerrit:1345643|fix(Homepage): apply the body transform only when an overlay is open (T439038)]] (duration: 12m 47s) 2461487 wikitext text/x-wiki t1oonn8r4w7mmewmdlr2bh1gjoefrsq 2461488 2461487 2026-09-28T21:24:56Z Stashbot 7414 swfrench-wmf: deleting suspect coredns pods showing upstream resolution health check failures in eqiad - T439201 2461488 wikitext text/x-wiki eek0ac1ph36w7sdu8k7fiajzx3omjv7 2461489 2461488 2026-09-28T21:41:50Z Stashbot 7414 eevans@deploy1003: helmfile [staging] START helmfile.d/services/sessionstore: sync 2461489 wikitext text/x-wiki rhocs00hyzit3lyv3o6mape3pp49t3o 2461490 2461489 2026-09-28T21:41:53Z Stashbot 7414 eevans@deploy1003: helmfile [staging] DONE helmfile.d/services/sessionstore: sync 2461490 wikitext text/x-wiki 0riaq0aujtctuu69wdjvwxust3tsocq 2461491 2461490 2026-09-28T21:42:06Z Stashbot 7414 eevans@deploy1003: helmfile [eqiad] START helmfile.d/services/sessionstore: sync 2461491 wikitext text/x-wiki m04qx7dmqmmela1eo3bbfmfq1p66ie6 2461492 2461491 2026-09-28T21:42:14Z Stashbot 7414 eevans@deploy1003: helmfile [eqiad] DONE helmfile.d/services/sessionstore: sync 2461492 wikitext text/x-wiki 5wdn4ad4l8xfkbgypc28zw7tzo43vl8 2461493 2461492 2026-09-28T21:43:24Z Stashbot 7414 brett@cumin1004: END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on A:cp-upload_esams - 7.1.1-2~bpo13+wmf3 () 2461493 wikitext text/x-wiki hsxj340zucju504fuhdb1yvjtweqen5 2461494 2461493 2026-09-28T21:44:45Z Stashbot 7414 brett@cumin1004: START - Cookbook sre.cdn.roll-upgrade-varnish rolling upgrade of Varnish on A:cp-text_esams - 7.1.1-2~bpo13+wmf3 () 2461494 wikitext text/x-wiki gmhnzxr9lz25i05wf7dk5v8m24j6uhv 2461495 2461494 2026-09-28T21:47:14Z Stashbot 7414 sbassett: Deployed security mitigation for T435455 2461495 wikitext text/x-wiki emqrgzd5wxfap9rs8561v3cmmja3qqr 2461496 2461495 2026-09-28T22:21:50Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply 2461496 wikitext text/x-wiki 0wma9iy6k71pq5f7ljtwtihwm8s8zbl 2461497 2461496 2026-09-28T22:22:16Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply 2461497 wikitext text/x-wiki rgvzjhy2qc6d8clgbs38gxgytbrwe5w 2461499 2461497 2026-09-28T23:35:30Z Stashbot 7414 zabe: run script to fix fr_metadata drifts # T420341 2461499 wikitext text/x-wiki t1ggiusp2p0380a2l5mi2ey0ntc6zjf 2461503 2461499 2026-09-28T23:44:13Z Stashbot 7414 dzahn@cumin1004: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host zuul1005.eqiad.wmnet with OS trixie 2461503 wikitext text/x-wiki s4fp7zlj9osxj3gg5twrhvgd95idj8y 2461505 2461503 2026-09-29T00:01:26Z Stashbot 7414 dzahn@cumin1004: START - Cookbook sre.hosts.reimage for host zuul1005.eqiad.wmnet with OS trixie 2461505 wikitext text/x-wiki 20f7ky8f7onxul2qjijlrzjbijfedm5 2461508 2461505 2026-09-29T00:17:12Z Stashbot 7414 dzahn@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on zuul1005.eqiad.wmnet with reason: host reimage 2461508 wikitext text/x-wiki a68ogppcjortr551kksvcag13msdhvj 2461509 2461508 2026-09-29T00:22:38Z Stashbot 7414 dzahn@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on zuul1005.eqiad.wmnet with reason: host reimage 2461509 wikitext text/x-wiki mlbxeriyroua7vrp0vp725j1c5bb087 2461530 2461509 2026-09-29T01:49:18Z Stashbot 7414 brett@cumin1004: END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on A:cp-text_esams - 7.1.1-2~bpo13+wmf3 () 2461530 wikitext text/x-wiki ao25b7jec117qn1z9ndayb9lfxio3l0 2461532 2461530 2026-09-29T02:00:35Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2461532 wikitext text/x-wiki s0u6rmh6p6fa58qphpi1d0k6knfw408 2461533 2461532 2026-09-29T02:08:03Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 07m 28s) 2461533 wikitext text/x-wiki 1zadb0mdcrmsgbjkhhp3nenagt2ywg5 2461536 2461533 2026-09-29T03:03:24Z Stashbot 7414 mwpresync@deploy1003: Started scap sync-world: testwikis to 1.47.0-wmf.22 refs T438218 2461536 wikitext text/x-wiki 26c17x7w996kret0heaq5y2anrhv7ch 2461537 2461536 2026-09-29T03:39:27Z Stashbot 7414 mwpresync@deploy1003: Finished scap sync-world: testwikis to 1.47.0-wmf.22 refs T438218 (duration: 36m 03s) 2461537 wikitext text/x-wiki nbast2wuu4o5y4yxcm0g7ktfjxo9dus 2461538 2461537 2026-09-29T04:01:06Z Stashbot 7414 mwpresync@deploy1003: Pruned MediaWiki: 1.47.0-wmf.19 (duration: 01m 00s) 2461538 wikitext text/x-wiki 8skxv1l7361oe1cf04i0cx0sam1a6un 2461539 2461538 2026-09-29T04:31:55Z Stashbot 7414 ryankemper@cumin2003: START - Cookbook sre.hosts.reimage for host wdqs1033.eqiad.wmnet with OS bookworm 2461539 wikitext text/x-wiki thhifdwlq64d6lkw398roim1qeyvigs 2461540 2461539 2026-09-29T04:32:18Z Stashbot 7414 ryankemper@cumin2003: START - Cookbook sre.hosts.move-vlan for host wdqs1033 2461540 wikitext text/x-wiki 819l2m653q6ba1w3vs56rbry56j4g98 2461541 2461540 2026-09-29T04:32:18Z Stashbot 7414 ryankemper@cumin2003: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wdqs1033 2461541 wikitext text/x-wiki r4hal1suvl4onbgqzdq0illtgf70r57 2461542 2461541 2026-09-29T04:43:35Z Stashbot 7414 ryankemper@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1033.eqiad.wmnet with reason: host reimage 2461542 wikitext text/x-wiki 5dhigca0f5lnvruejb9rvo0hx4u0e3x 2461543 2461542 2026-09-29T04:47:59Z Stashbot 7414 ryankemper@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1033.eqiad.wmnet with reason: host reimage 2461543 wikitext text/x-wiki guzpbb2y1bn3qp8rwgjzuxzghuwu78s 2461544 2461543 2026-09-29T04:51:35Z Stashbot 7414 fabfur: manually restarting dump_cloud_ip_range on puppetserver1001 after failure 2461544 wikitext text/x-wiki 3pi1rxzn93g1hjf70rmeclxgdifov46 2461545 2461544 2026-09-29T05:03:03Z Stashbot 7414 ryankemper@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1033.eqiad.wmnet with OS bookworm 2461545 wikitext text/x-wiki q2yfg2c1j1du2xl82bnytj468mbx1kb 2461546 2461545 2026-09-29T05:19:29Z Stashbot 7414 ryankemper@cumin2003: START - Cookbook sre.hosts.reimage for host wdqs1034.eqiad.wmnet with OS bookworm 2461546 wikitext text/x-wiki etp6npfyv7jjt8a6w6479ebd5240o71 2461547 2461546 2026-09-29T05:19:40Z Stashbot 7414 ryankemper@cumin2003: START - Cookbook sre.hosts.move-vlan for host wdqs1034 2461547 wikitext text/x-wiki foytd1qf0hqtjybkp2bebxyqp6vm1ik 2461548 2461547 2026-09-29T05:19:41Z Stashbot 7414 ryankemper@cumin2003: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wdqs1034 2461548 wikitext text/x-wiki hpjf0vj6hc9mmbp4gwxqd4b8vnz1ype 2461549 2461548 2026-09-29T05:21:13Z Stashbot 7414 ryankemper@cumin2003: START - Cookbook sre.hosts.reimage for host wdqs1035.eqiad.wmnet with OS bookworm 2461549 wikitext text/x-wiki stt2nytfc6xeqrunqcvub4v77bcxxpj 2461550 2461549 2026-09-29T05:21:35Z Stashbot 7414 ryankemper@cumin2003: START - Cookbook sre.hosts.move-vlan for host wdqs1035 2461550 wikitext text/x-wiki fdl74pn0zemm0901qwl0t0l23aa9ohs 2461551 2461550 2026-09-29T05:21:36Z Stashbot 7414 ryankemper@cumin2003: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wdqs1035 2461551 wikitext text/x-wiki avlmg6tgrh04yg80iplr8rh3ymi26sf 2461552 2461551 2026-09-29T05:31:14Z Stashbot 7414 ryankemper@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1034.eqiad.wmnet with reason: host reimage 2461552 wikitext text/x-wiki h371pda82779kad27can21foc4019gi 2461553 2461552 2026-09-29T05:32:59Z Stashbot 7414 ryankemper@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on wdqs1035.eqiad.wmnet with reason: host reimage 2461553 wikitext text/x-wiki ie2i8rbxpahiccrptuvijkubvkhukq3 2461554 2461553 2026-09-29T05:34:47Z Stashbot 7414 ryankemper@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1034.eqiad.wmnet with reason: host reimage 2461554 wikitext text/x-wiki qvnzeua8iwxwr586dp2x6kwy48rssp9 2461555 2461554 2026-09-29T05:38:16Z Stashbot 7414 ryankemper@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wdqs1035.eqiad.wmnet with reason: host reimage 2461555 wikitext text/x-wiki 2r060o4bqbg43r9gio061zkgjf4ttk6 2461556 2461555 2026-09-29T05:50:29Z Stashbot 7414 ryankemper@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1034.eqiad.wmnet with OS bookworm 2461556 wikitext text/x-wiki t0w5vbc1m2x5rk8gob4tyzny55tx24e 2461557 2461556 2026-09-29T05:54:02Z Stashbot 7414 ryankemper@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wdqs1035.eqiad.wmnet with OS bookworm 2461557 wikitext text/x-wiki ru46jf0kqnxhtqi4pbo13x9hsb4mhh9 2461560 2461557 2026-09-29T06:56:53Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/aux-k8s-services/etherpad: apply 2461560 wikitext text/x-wiki sfavqabgfngrgo9bt1e2xfi88wjx6i1 2461562 2461560 2026-09-29T06:57:32Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/aux-k8s-services/etherpad: apply 2461562 wikitext text/x-wiki 7538iyhxqidtf17y6vk72iqwhtx9d52 2461564 2461562 2026-09-29T07:01:40Z Stashbot 7414 kartik@deploy1003: helmfile [staging] START helmfile.d/services/cxserver: apply 2461564 wikitext text/x-wiki tv14002cpvkjjhc63o7mby23ylcd25u 2461565 2461564 2026-09-29T07:02:00Z Stashbot 7414 kartik@deploy1003: helmfile [staging] DONE helmfile.d/services/cxserver: apply 2461565 wikitext text/x-wiki 84op3qw3x1geurwd2h5675pbwnj5zj6 2461567 2461565 2026-09-29T07:04:53Z Stashbot 7414 mlitn@deploy1003: Started scap sync-world: Backport for [[gerrit:1345626|Skip expensive work if known to be useless (T439182)]], [[gerrit:1345632|Cache extracted carousel data (T439182)]], [[gerrit:1345627|Make carousel images are visible in the margins (T439422)]], [[gerrit:1345633|carousel: fix carousel image preload observer root (T439422)]] 2461567 wikitext text/x-wiki bt2km2hejp3xnqudik0xcj1kg7novfj 2461570 2461567 2026-09-29T07:09:09Z Stashbot 7414 mlitn@deploy1003: mlitn: Backport for [[gerrit:1345626|Skip expensive work if known to be useless (T439182)]], [[gerrit:1345632|Cache extracted carousel data (T439182)]], [[gerrit:1345627|Make carousel images are visible in the margins (T439422)]], [[gerrit:1345633|carousel: fix carousel image preload observer root (T439422)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now 2461570 wikitext text/x-wiki f10gnmrnbni3syb4p7tbglkp04cqogm 2461571 2461570 2026-09-29T07:11:08Z Stashbot 7414 mlitn@deploy1003: mlitn: Continuing with deployment 2461571 wikitext text/x-wiki crcilv410xktfdskyoc2b01jmk3fxl1 2461572 2461571 2026-09-29T07:14:50Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host idp-test2005.wikimedia.org 2461572 wikitext text/x-wiki dd9po88ldaslfgfnzm6sfce56d583u7 2461574 2461572 2026-09-29T07:18:32Z Stashbot 7414 mlitn@deploy1003: Finished scap sync-world: Backport for [[gerrit:1345626|Skip expensive work if known to be useless (T439182)]], [[gerrit:1345632|Cache extracted carousel data (T439182)]], [[gerrit:1345627|Make carousel images are visible in the margins (T439422)]], [[gerrit:1345633|carousel: fix carousel image preload observer root (T439422)]] (duration: 13m 39s) 2461574 wikitext text/x-wiki 9b0vw6abvuja2lu1tjs9r39a1wmptgb 2461575 2461574 2026-09-29T07:18:48Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp-test2005.wikimedia.org 2461575 wikitext text/x-wiki r06y8hooxila9ualyaoyixqjs26z2t7 2461580 2461575 2026-09-29T07:22:46Z Stashbot 7414 kartik@deploy1003: helmfile [codfw] START helmfile.d/services/cxserver: apply 2461580 wikitext text/x-wiki i1jxdhrih8t71duapnlpxj40w40vvab 2461581 2461580 2026-09-29T07:23:00Z Stashbot 7414 kharlan@deploy1003: Started scap sync-world: Backport for [[gerrit:1345854|CheckUser: Enable ClientHintsInEditRequest on group0 (T401808)]] 2461581 wikitext text/x-wiki g4isn741286dzezm1lhubyb75d77oa7 2461582 2461581 2026-09-29T07:23:20Z Stashbot 7414 kartik@deploy1003: helmfile [codfw] DONE helmfile.d/services/cxserver: apply 2461582 wikitext text/x-wiki p6olkutymagojdunox50vjfvxiqevxx 2461583 2461582 2026-09-29T07:24:17Z Stashbot 7414 kartik@deploy1003: helmfile [eqiad] START helmfile.d/services/cxserver: apply 2461583 wikitext text/x-wiki ktc0tcjivmberxh7bcl7pl2qquiupi3 2461584 2461583 2026-09-29T07:24:47Z Stashbot 7414 kartik@deploy1003: helmfile [eqiad] DONE helmfile.d/services/cxserver: apply 2461584 wikitext text/x-wiki r0ti7racxbbamkommig03oy6zdrq5oh 2461585 2461584 2026-09-29T07:26:00Z Stashbot 7414 kart_: Updated cxserver to 2026-09-25-114231-production 2461585 wikitext text/x-wiki lzo8v9ubnzoivgxlsl3z8e70tn040vt 2461586 2461585 2026-09-29T07:27:11Z Stashbot 7414 kharlan@deploy1003: kharlan: Backport for [[gerrit:1345854|CheckUser: Enable ClientHintsInEditRequest on group0 (T401808)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2461586 wikitext text/x-wiki 6curj9shom7uizpnx4ycug9o3m4oash 2461588 2461586 2026-09-29T07:27:58Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host sretest2004.codfw.wmnet 2461588 wikitext text/x-wiki 7csb3i3qbfcsxipjolxiyvak9rfvseg 2461589 2461588 2026-09-29T07:30:24Z Stashbot 7414 kharlan@deploy1003: kharlan: Continuing with deployment 2461589 wikitext text/x-wiki 21eng09mndbrhg5jp282znhftiiusqb 2461591 2461589 2026-09-29T07:33:45Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sretest2004.codfw.wmnet 2461591 wikitext text/x-wiki 86279leyrzh74eamxfo94re0tu66194 2461593 2461591 2026-09-29T07:35:41Z Stashbot 7414 kharlan@deploy1003: Finished scap sync-world: Backport for [[gerrit:1345854|CheckUser: Enable ClientHintsInEditRequest on group0 (T401808)]] (duration: 12m 41s) 2461593 wikitext text/x-wiki mmoq8fyttwkqkjvrneuq4ymjkufyzdm 2461595 2461593 2026-09-29T07:39:45Z Stashbot 7414 mlitn@deploy1003: Started scap sync-world: Backport for [[gerrit:1345862|carousel: keep the hide button attached to the carousel (T439507)]], [[gerrit:1345863|carousel: keep the hide button attached to the carousel (T439507)]] 2461595 wikitext text/x-wiki 62dznrmnkb6y98570u0nh78bg12ntml 2461597 2461595 2026-09-29T07:43:53Z Stashbot 7414 mlitn@deploy1003: mlitn: Backport for [[gerrit:1345862|carousel: keep the hide button attached to the carousel (T439507)]], [[gerrit:1345863|carousel: keep the hide button attached to the carousel (T439507)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2461597 wikitext text/x-wiki fk30ab9wv94xcwcpt9jy8k79ao4i3qj 2461598 2461597 2026-09-29T07:44:23Z Stashbot 7414 mlitn@deploy1003: mlitn: Continuing with deployment 2461598 wikitext text/x-wiki awl60qhvft9jgk3gbsphoosx6oxdoaj 2461599 2461598 2026-09-29T07:49:42Z Stashbot 7414 mlitn@deploy1003: Finished scap sync-world: Backport for [[gerrit:1345862|carousel: keep the hide button attached to the carousel (T439507)]], [[gerrit:1345863|carousel: keep the hide button attached to the carousel (T439507)]] (duration: 09m 57s) 2461599 wikitext text/x-wiki foi7z0nj4pf33irtvrt8tyqioczrqnz 2461601 2461599 2026-09-29T07:49:51Z Stashbot 7414 matthiasmullie: UTC morning backport window done 2461601 wikitext text/x-wiki hhgff2c4aaq5x9m29h23mmt5au85vp7 2461603 2461601 2026-09-29T08:10:56Z Stashbot 7414 moritzm: installing PHP 8.4 security updates 2461603 wikitext text/x-wiki bkglzujar9ji05ws30kw68ykpyp27lz 2461604 2461603 2026-09-29T08:18:58Z Stashbot 7414 isaranto@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'llm' for release 'main' . 2461604 wikitext text/x-wiki 2e15i5haf5ccbmsjawhjs25o1j4za82 2461605 2461604 2026-09-29T08:39:36Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.network.tls for network device lsw1-f7-eqiad 2461605 wikitext text/x-wiki m1g546qdjso36n40pzdo9ccir8ipbel 2461606 2461605 2026-09-29T08:39:43Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-f7-eqiad 2461606 wikitext text/x-wiki qx6o0qxcdlal28xwh2mz717cbtyc77v 2461607 2461606 2026-09-29T08:40:38Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.network.tls for network device lsw1-e6-eqiad 2461607 wikitext text/x-wiki 7lzghogei8266hb7ciw03sgy00wnx52 2461608 2461607 2026-09-29T08:40:45Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-e6-eqiad 2461608 wikitext text/x-wiki ph2kz60izcbok3yjesmu34ypuyta205 2461609 2461608 2026-09-29T08:40:53Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.network.tls for network device lsw1-e7-eqiad 2461609 wikitext text/x-wiki 1z4ognfx8z5b6zd567yzdqoqj8apypi 2461610 2461609 2026-09-29T08:41:00Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-e7-eqiad 2461610 wikitext text/x-wiki e7qv5lfnngww1jfws8wvbx3ohmkh4kp 2461611 2461610 2026-09-29T08:41:08Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.network.tls for network device lsw1-f6-eqiad 2461611 wikitext text/x-wiki lr92g7rsn3cfn6hafomt1vdpeatnf7n 2461612 2461611 2026-09-29T08:41:17Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-f6-eqiad 2461612 wikitext text/x-wiki 9d3fwsee0fcrwb11sml8sc2bhrncvic 2461613 2461612 2026-09-29T08:41:24Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.network.tls for network device lsw1-f5-eqiad 2461613 wikitext text/x-wiki cqkjhcr6u1ss0d5ciya2vipaqvual1i 2461614 2461613 2026-09-29T08:41:30Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-f5-eqiad 2461614 wikitext text/x-wiki f5d5b2ggiely9wfgny4bubrfupj4ros 2461615 2461614 2026-09-29T08:41:55Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.network.tls for network device lsw1-e5-eqiad 2461615 wikitext text/x-wiki 6tf3cdoad6kt2aztvxyzmb8epm6j2fs 2461616 2461615 2026-09-29T08:42:01Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-e5-eqiad 2461616 wikitext text/x-wiki a77eb4fofiorql4n9bzs8py5uqtmwse 2461618 2461616 2026-09-29T08:48:37Z Stashbot 7414 urbanecm@deploy1003: Started scap sync-world: Backport for [[gerrit:1344712|ReassignMentees: Actually deduplicate reassignMenteesJob (T418194)]] 2461618 wikitext text/x-wiki a5pi1kpswt2ymqudtjzau8j6sichjy2 2461619 2461618 2026-09-29T08:49:17Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/liftwing-studio: sync 2461619 wikitext text/x-wiki csjuz421jpdrzuzlmbi2yw3ocoa2tzs 2461620 2461619 2026-09-29T08:50:14Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/liftwing-studio: sync 2461620 wikitext text/x-wiki 73ipjg11m4h10gs4f2a3wbvcygrn6wi 2461621 2461620 2026-09-29T08:52:49Z Stashbot 7414 urbanecm@deploy1003: urbanecm: Backport for [[gerrit:1344712|ReassignMentees: Actually deduplicate reassignMenteesJob (T418194)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2461621 wikitext text/x-wiki 5tdalkgfis2xmrmybewwodvf0bfh7e2 2461622 2461621 2026-09-29T08:54:19Z Stashbot 7414 urbanecm@deploy1003: urbanecm: Continuing with deployment 2461622 wikitext text/x-wiki 7j9tav522diabc50siupn4goiy6hqaq 2461624 2461622 2026-09-29T08:59:45Z Stashbot 7414 urbanecm@deploy1003: Finished scap sync-world: Backport for [[gerrit:1344712|ReassignMentees: Actually deduplicate reassignMenteesJob (T418194)]] (duration: 11m 07s) 2461624 wikitext text/x-wiki 69qsyz0643jx8sv6gytni172z67rrfe 2461628 2461624 2026-09-29T09:36:03Z Stashbot 7414 urbanecm@deploy1003: mwscript-k8s job started: GrowthExperiments:reassignMentees --wiki=enwiki --mentor=Ikan --performer=Ikan --as-job # T418194 2461628 wikitext text/x-wiki 4w3e9fmefgclii0w00mt8j43aiawd7z 2461634 2461628 2026-09-29T10:09:26Z Stashbot 7414 ihurbain@deploy1003: helmfile [staging] START helmfile.d/services/mobileapps: apply 2461634 wikitext text/x-wiki r9edxg6by8vtvkpe6st6s3gt0jwo9na 2461635 2461634 2026-09-29T10:10:05Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.makevm for new host testvm2001.codfw.wmnet 2461635 wikitext text/x-wiki gqz432vssknywn0d7xxozwcv51zpdzq 2461636 2461635 2026-09-29T10:10:07Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.dns.netbox 2461636 wikitext text/x-wiki li7jgx525h2bh2cz17k4weccbmlfhaw 2461637 2461636 2026-09-29T10:10:29Z Stashbot 7414 ihurbain@deploy1003: helmfile [staging] DONE helmfile.d/services/mobileapps: apply 2461637 wikitext text/x-wiki qsypwrirwujxp2beyxitawh1bo6hfkm 2461638 2461637 2026-09-29T10:14:27Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM testvm2001.codfw.wmnet - jmm@cumin2003" 2461638 wikitext text/x-wiki r1e9c6orcjj2bvqztqw9bi99ocszdoz 2461639 2461638 2026-09-29T10:14:31Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM testvm2001.codfw.wmnet - jmm@cumin2003" 2461639 wikitext text/x-wiki hw1nh2qkgmvvhblmejxbyl73eirbpfa 2461640 2461639 2026-09-29T10:14:31Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2461640 wikitext text/x-wiki 4jcsswp90fwcf74e5dkt0p103zb2lpv 2461641 2461640 2026-09-29T10:14:32Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.dns.wipe-cache testvm2001.codfw.wmnet on all recursors 2461641 wikitext text/x-wiki 5ohks3c2o4f1ub9p70d5dqnzocf6r8o 2461642 2461641 2026-09-29T10:14:35Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) testvm2001.codfw.wmnet on all recursors 2461642 wikitext text/x-wiki oodf6zaxobbczd30wftcfoop49guziq 2461643 2461642 2026-09-29T10:14:56Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM testvm2001.codfw.wmnet - jmm@cumin2003" 2461643 wikitext text/x-wiki ojpl5iiiyanpnlkm4w6ekor5wowd7lk 2461644 2461643 2026-09-29T10:15:00Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM testvm2001.codfw.wmnet - jmm@cumin2003" 2461644 wikitext text/x-wiki e5io7kwtc12wbqh96fmgf7boarmhov3 2461645 2461644 2026-09-29T10:15:06Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reimage for host testvm2001.codfw.wmnet with OS trixie 2461645 wikitext text/x-wiki kl2zcbd9n2w47dgmcze7u4lpc2ohkg9 2461646 2461645 2026-09-29T10:17:30Z Stashbot 7414 claime: deploy2003:~$ sudo lvextend -L +50GB --resizefs /dev/vg0/srv # T438232 2461646 wikitext text/x-wiki e6mcjn87jhdg59f5r4yx78ph1tyuv15 2461647 2461646 2026-09-29T10:17:55Z Stashbot 7414 claime: deploy1003:~$ sudo lvextend -L +50GB --resizefs /dev/vg0/srv # T438232 2461647 wikitext text/x-wiki dmmzdv896skyg22s1n569yg5zwna4sl 2461648 2461647 2026-09-29T10:19:20Z Stashbot 7414 claime: deploy2002:~$ sudo lvextend -L +50GB --resizefs /dev/vg0/srv # T438232 2461648 wikitext text/x-wiki 2rg27nym0ej7fe5xm5y2w96bbmnwze0 2461649 2461648 2026-09-29T10:32:34Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on testvm2001.codfw.wmnet with reason: host reimage 2461649 wikitext text/x-wiki ml9uxbd628r1bsrrm04lxw79ci3ng6c 2461650 2461649 2026-09-29T10:33:35Z Stashbot 7414 blake@deploy1003: Started scap sync-world: add sidecar flag for T417800 2461650 wikitext text/x-wiki nx875e2r80a91d36zcboeehhbuamt6l 2461651 2461650 2026-09-29T10:37:16Z Stashbot 7414 blake@deploy1003: Finished scap sync-world: add sidecar flag for T417800 (duration: 04m 14s) 2461651 wikitext text/x-wiki kycmj2j2txqdx6af4loq5vw3i3wlbt9 2461652 2461651 2026-09-29T10:38:49Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on testvm2001.codfw.wmnet with reason: host reimage 2461652 wikitext text/x-wiki 30ikt5u8atsag31qy61ynaxy1o3bata 2461653 2461652 2026-09-29T10:43:45Z Stashbot 7414 atsukoito: shutting down https://airflow-test-k8s.wikimedia.org for upgrade, https://phabricator.wikimedia.org/T433383#12363530 2461653 wikitext text/x-wiki 1yc102echwxvj5nho7fdp5mtk3m1gjh 2461654 2461653 2026-09-29T10:46:50Z Stashbot 7414 tappof: Rebalancing has been completed on kafka-logging in eqiad: kafka-logging1001 and kafka-logging1002 are no longer assigned any partitions — T432444 2461654 wikitext text/x-wiki hzeqlaj61an48t0sbj7mv2i5qailke0 2461655 2461654 2026-09-29T10:47:26Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2461655 wikitext text/x-wiki 4z17i8nyl3dxaqt0ha6p53hleqazfqu 2461656 2461655 2026-09-29T10:55:43Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2461656 wikitext text/x-wiki b4ivnbrcycpws2ywshx4d733ti12md8 2461657 2461656 2026-09-29T10:55:46Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2461657 wikitext text/x-wiki 4v3rzle8xqkew47zr4ae01p8itknz0w 2461658 2461657 2026-09-29T10:56:25Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2461658 wikitext text/x-wiki is553gs5gax4mkpny9fpu0e32mfztxz 2461659 2461658 2026-09-29T10:56:34Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2461659 wikitext text/x-wiki 431phog3o6y2czy3rg923mdzb03gzwf 2461660 2461659 2026-09-29T10:56:37Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2461660 wikitext text/x-wiki pekfgbv2st4xb2qd1nb10x1rs90birm 2 13498 2461534 129859 2026-09-29T02:24:04Z Ahri Boy 39289 /* */ 2461534 wikitext text/x-wiki ruyjj6byl94ml9u55bwxyjkhyjx557i 2461602 2461534 2026-09-29T08:10:06Z JJMC89 7474 Reverted 1 edit by [[Special:Contributions/Ahri Boy|Ahri Boy]] ([[User talk:Ahri Boy|talk]]): Not up to you 2461602 wikitext text/x-wiki aymh3das9e07ighxy4qeq26qv03rfti 0 17290 2461563 2461135 2026-09-29T06:58:15Z Stashbot 7414 codders: integration: integration-castor06: rm -fR /srv/castor/castor-mw-ext-and-skins/master/mediawiki-node24 2461563 wikitext text/x-wiki fkl0g1h3ppm4e8aj0ks083phuux0wxa 0 21478 2461388 2443287 2026-09-28T14:40:33Z FNegri-WMF 32595 /* List of components */ Add new component: Alerting service 2461388 wikitext text/x-wiki 4g6lg09ez0b96nu6at0qe4ifaieybyn 0 23733 2461480 2454544 2026-09-28T21:05:31Z Wargo 15859 /* Private data checks */ updated link 2461480 wikitext text/x-wiki 6o8laot6ea7dugpvxtxrdppe3s32hb4 498 30942 2461390 2461249 2026-09-28T14:46:02Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.depool_and_destroy (T429387) 2461390 wikitext text/x-wiki 1nc1bnj7j3lt39n5gb3jz91oow82c8h 2461513 2461390 2026-09-29T00:48:22Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=99) (T429387) 2461513 wikitext text/x-wiki s54kq654cv7377dt5afqhwf6pypqlkb 2461523 2461513 2026-09-29T01:35:18Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.bootstrap_and_add 2461523 wikitext text/x-wiki 9j5fx770exuon1r9l8odh3mksmul9p0 2461524 2461523 2026-09-29T01:35:21Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=0) 2461524 wikitext text/x-wiki 8sd5bsx23aa074rjvqerx71wtcf3cnm 2461525 2461524 2026-09-29T01:36:02Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.bootstrap_and_add 2461525 wikitext text/x-wiki m8anthnc1qivywcruewyr0zmhumj83b 2461526 2461525 2026-09-29T01:36:06Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=0) 2461526 wikitext text/x-wiki rqkn887e7j97tp231i57p8ygun2s294 2461527 2461526 2026-09-29T01:39:17Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.bootstrap_and_add 2461527 wikitext text/x-wiki 17yygfo6t0fkygvw85f8hhmdupid2va 2461528 2461527 2026-09-29T01:39:20Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=0) 2461528 wikitext text/x-wiki ksom77pzokiwrkp33d7p5xtcwvjwtfn 2461529 2461528 2026-09-29T01:46:25Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.bootstrap_and_add 2461529 wikitext text/x-wiki jxs5awyl1h0kee2hz8271uq89ite5p3 2461531 2461529 2026-09-29T01:56:49Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=0) 2461531 wikitext text/x-wiki j6c00d6lu9n6d1aurdi0juhmwsowhmv 498 46253 2461421 2457631 2026-09-28T17:45:22Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: bin/stashbot.sh restart 2461421 wikitext text/x-wiki l1v4r7vsrtztalq8fhinh4294axdgua 498 55577 2461333 2457620 2026-09-28T12:42:14Z Stashbot 7414 dhinus: hard-reboot node-[234] from horizon, as they were NotReady and hub-paws was unavailable 2461333 wikitext text/x-wiki ddx30y8fycjolncy97upugh7ad0czyf 2461334 2461333 2026-09-28T12:44:49Z Stashbot 7414 fnegri@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.vm_console 2461334 wikitext text/x-wiki k6sew0pp1p3sh35apqbhv2d4iwga0mg 2461335 2461334 2026-09-28T12:45:47Z Stashbot 7414 fnegri@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=0) 2461335 wikitext text/x-wiki loiilsy8api0dxobz342l4wrbdpwfl8 0 91251 2461363 2461226 2026-09-28T13:46:39Z MMuhlenhoff (WMF) 5268 /* Troubleshooting */ Update status, we currently run bookworm on the URL downloaders 2461363 wikitext text/x-wiki 7ucp52sebmlqbdeheejlomn4usvp2zi 0 443307 2461519 2460176 2026-09-29T01:11:19Z BCornwall-WMF 31521 /* Architecture */ Add cert lifecycle docs 2461519 wikitext text/x-wiki ffjt5u5o61d4oc0zav042ockvs2yaoi 2461520 2461519 2026-09-29T01:16:30Z BCornwall-WMF 31521 /* Certificate lifecycle */ Add renewal section 2461520 wikitext text/x-wiki b27gt534evxqvcg6mbi4nzpvtxbkuf0 498 443949 2461413 2460906 2026-09-28T16:45:59Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 16289b6 (Fix run-tick strip vertical alignment on the browse page) 2461413 wikitext text/x-wiki 7z1tgv3xat9ogvhmon8ya0ok3c2u5rc 2461414 2461413 2026-09-28T16:46:02Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 6b7ab01 (Use Bootstrap 5 theme variables for run-tick and chart colours) for T439032 2461414 wikitext text/x-wiki mdo8f8smi271kl3jhcypbaihm4v3o7l 2461415 2461414 2026-09-28T16:46:04Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy f21bb92 (Build the stat cards on the Bootstrap .card component) for T439032 2461415 wikitext text/x-wiki c6yqqf90g5bk35ocsxx2zx5ep5qsxsf 2461416 2461415 2026-09-28T16:46:07Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 4c7f812 (Theme Chart.js chart chrome and the tick hover outline) for T439446 2461416 wikitext text/x-wiki isjql91ang77gh7a25t6vigs41yuskc 2461417 2461416 2026-09-28T16:46:09Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 474239d (Add a light/dark theme toggle) for T439446 2461417 wikitext text/x-wiki oqks2xeydd2acgprvxencm5hztbzr6g 0 445717 2461382 2430535 2026-09-28T14:10:14Z BRouberol-WMF 39141 2461382 wikitext text/x-wiki 73akk0bykrdr52gqhs44zb9coyp8m37 498 446211 2461663 2456935 2026-09-29T11:18:03Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/36560726793 (https://github.com/cluebotng/component-configs/commits/8638ec82624573a20aa5fbc7d9b44374a34b35e4) 2461663 wikitext text/x-wiki 1okxjjp4a6xu9pdyjbmhcviuhzwskpo 498 447034 2461422 2455349 2026-09-28T17:45:28Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: deployed 8fa72d2beb (upgrade dependencies) 2461422 wikitext text/x-wiki 9wzu0xzuc79itispyq2zigroc5oncir 2461426 2461422 2026-09-28T17:54:33Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: deployed 99e1be5dee (Toolforge Components Service, push-to-deploy) 2461426 wikitext text/x-wiki 2ngkbek0w9fx5iwhbwy3sdqpjgzcjr0 0 449160 2461506 2461144 2026-09-29T00:01:55Z Dexbot 30554 Bot: Updating the report 2461506 wikitext text/x-wiki r537qsl9gchzo9293d56t050q6cthhp 0 451093 2461429 2374008 2026-09-28T18:15:19Z KHerron (WMF) 10463 Add high level change deployment instructions 2461429 wikitext text/x-wiki mqgezht5gk1m717nu57qtemzuxzhgvj 0 453813 2461476 2458087 2026-09-28T20:58:35Z PFischer-WMF 38527 Revise SLIs: add availability, weighted tags query latency and update lag using the standard SLI wordings, document the namespace scoping and the reasoning behind each indicator here rather than in slothslos, move coverage and caveats into their own subsection, drop the unmeasured render-time latency SLIs, rename Elasticsearch to OpenSearch, refresh Monitoring, fill in realistic and ideal targets, link the Sloth definitions 2461476 wikitext text/x-wiki ksg8ubu65vcf6r9v0oc4v0re69i3zwl 2461632 2461476 2026-09-29T09:56:08Z PFischer-WMF 38527 Revise SLIs: add availability, weighted tags query latency and update lag using the standard SLI wordings, document the namespace scoping and the reasoning behind each indicator here rather than in slothslos, move coverage and caveats into their own subsection, drop the unmeasured render-time latency SLIs, rename Elasticsearch to OpenSearch, refresh Monitoring, fill in realistic and ideal targets, link the Sloth definitions 2461632 wikitext text/x-wiki 97laridvf86uj1m0knjzjqh0971yrji 2461664 2461632 2026-09-29T11:49:38Z PFischer-WMF 38527 Trim: refresh measurements with a footnote, replace the Troubleshooting and Deployment prose with links to the OpenSearch admin pages, fold metric details into Query details, and move target derivation and the paging rationale to T431145 2461664 wikitext text/x-wiki amcfvc9ayzhav0tpeudtfabuxy0qgt9 116 453906 2461510 2461142 2026-09-29T00:24:38Z Gitlabaccountapprovalbot 37332 @balance3641 was approved. 2461510 wikitext text/x-wiki ml4z7d20z3o2nuvqnlzvx8lkqcqhxyk 0 454545 2461348 2403871 2026-09-28T13:25:16Z BTullis (WMF) 25295 /* Data platform infrastructure */ Added links to new Grafana dashboards 2461348 wikitext text/x-wiki p7r5b006nt8ybn4pcsozutm2sjmotzc 0 457955 2461498 2456041 2026-09-28T22:35:55Z LFrost-WMF 59983 /* Tips and tricks */ fix config file path 2461498 wikitext text/x-wiki p8xycl6bkczqwyntv8ag43assi7oezo 0 459290 2461629 2461030 2026-09-29T09:42:15Z AQuhen (WMF) 29318 next deploy 2461629 wikitext text/x-wiki 1zqa601byz44r2dhyyl20uvsopvxeue 2461630 2461629 2026-09-29T09:44:12Z AQuhen (WMF) 29318 new deploy 2461630 wikitext text/x-wiki 8s4chf98k8wrfxmqqe2u6mkx06lak99 2461631 2461630 2026-09-29T09:45:14Z AQuhen (WMF) 29318 fix link in deploy 2461631 wikitext text/x-wiki oamul7qh0o6aiyneqy093j6xzu9fmvh 0 459699 2461477 2460787 2026-09-28T20:58:50Z Stashbot 7414 eileen: config revision changed from b10d8cc7 to 2264ae69 2461477 wikitext text/x-wiki 5s1qzyvn0vm2m51s7ob6v2sk3h2dulb 2461535 2461477 2026-09-29T02:47:32Z Stashbot 7414 larssandergreen: civicrm upgraded from 11d70b96 to a7d8ba32 2461535 wikitext text/x-wiki k4tygnjyrqqqw7e13ikofgzw361clw3 0 460052 2461447 2456541 2026-09-28T19:37:16Z KReid-WMF 49588 Add info on where to go for the GrowthBook user guide, since this is the first search result for GrowthBook but the user guide is the page many new users will want. 2461447 wikitext text/x-wiki 4w7dfk6cf7kr6gjei7iv49k12b9c5zz 0 460232 2461448 2458232 2026-09-28T19:38:08Z KReid-WMF 49588 /* Access GrowthBook */ 2461448 wikitext text/x-wiki 47x7pv0ntujrtsbk0y4dbn4yocl10a7 2461450 2461448 2026-09-28T19:39:30Z KReid-WMF 49588 /* Exclude bots from results */ 2461450 wikitext text/x-wiki k2gls8ewtldidtgdkisg8dgrzfv172q 0 460234 2461452 2458226 2026-09-28T19:42:21Z KReid-WMF 49588 2461452 wikitext text/x-wiki 3osd6q5fqydjka3dqknggidmkbm3b5z 116 460429 2461633 2434127 2026-09-29T10:08:41Z Sebastian Berlin (WMSE) 7884 Change tool URL 2461633 wikitext text/x-wiki kcxh38xwzenj6hzw9yp5bzxh2jgssp2 0 460710 2461514 2461150 2026-09-29T00:51:00Z AWesterinen-WMF 54189 /* Complex named subquery */ 2461514 wikitext text/x-wiki sfubr97n8csdw3x82mcslpibth27our 2461515 2461514 2026-09-29T01:04:42Z AWesterinen-WMF 54189 /* Named subqueries */ 2461515 wikitext text/x-wiki qq9tldjf27doi6t685dwt0d3pygx6fe 2461516 2461515 2026-09-29T01:09:25Z AWesterinen-WMF 54189 2461516 wikitext text/x-wiki k744kr4uc6dxxw89kagpx32990cbh1j 2461517 2461516 2026-09-29T01:09:41Z AWesterinen-WMF 54189 2461517 wikitext text/x-wiki g1hdanhl8g9deq6basszz7f3v0m5118 2461518 2461517 2026-09-29T01:11:00Z AWesterinen-WMF 54189 2461518 wikitext text/x-wiki tcihjxfnuybdnth1ivkgsciwpwlac5n 2461521 2461518 2026-09-29T01:24:53Z AWesterinen-WMF 54189 /* Named subqueries */ 2461521 wikitext text/x-wiki dbmjzen7ftjjshns6snwg3m8ge1q08f 2461522 2461521 2026-09-29T01:25:54Z AWesterinen-WMF 54189 /* Named subqueries */ 2461522 wikitext text/x-wiki 7vipfuz5eoxgzfgdls8kep2smya5u7h 12 460726 2461592 2461140 2026-09-29T07:34:51Z SSapaty (WMF) 28955 /* Add a GitLab CI configuration */ remove duplicate text 2461592 wikitext text/x-wiki 7df5yeuockvrjuwsi8ucr643mazsdu3 2 460731 2461566 2461200 2026-09-29T07:02:49Z SSapaty (WMF) 28955 /* Create the continuous program */ 2461566 wikitext text/x-wiki 44so0gbcu9rnjo1s9ywbcjhly4jhqxq 2461568 2461566 2026-09-29T07:05:33Z SSapaty (WMF) 28955 /* Configure the scheduled component */ 2461568 wikitext text/x-wiki emutnl3c17vtwa0vdgxzwjhwa4ge3ez 2461569 2461568 2026-09-29T07:07:24Z SSapaty (WMF) 28955 2461569 wikitext text/x-wiki 4o7soz7ezxq9l2t8hhcjtznet3woaqe 2461573 2461569 2026-09-29T07:18:27Z SSapaty (WMF) 28955 /* Configure the scheduled component */ 2461573 wikitext text/x-wiki 9o7jvf8mlc3zz3mfqfv9a3fxwfle8kt 2461576 2461573 2026-09-29T07:19:06Z SSapaty (WMF) 28955 /* Before you begin */ 2461576 wikitext text/x-wiki mupy48fyfsljp4k6lr7p10n7wedsp7d 2461577 2461576 2026-09-29T07:19:51Z SSapaty (WMF) 28955 /* Create the complete tool configuration */ 2461577 wikitext text/x-wiki a1fvsovltuxthd36943ldeq9o28oyo7 2461578 2461577 2026-09-29T07:21:04Z SSapaty (WMF) 28955 /* Understand continuous restart behavior */ 2461578 wikitext text/x-wiki hbis86cgoh914mm2h8grh54qche7n96 2461579 2461578 2026-09-29T07:21:39Z SSapaty (WMF) 28955 /* Optional: publish the continuous component */ 2461579 wikitext text/x-wiki dlcdylunqdbxpgp5zpgiej1vgqhoo1a 2461594 2461579 2026-09-29T07:37:04Z SSapaty (WMF) 28955 /* Inspect the resulting jobs */ 2461594 wikitext text/x-wiki nvunqz41h4sqcpvb6280uke7h1i8860 2461596 2461594 2026-09-29T07:41:47Z SSapaty (WMF) 28955 /* Inspect the resulting jobs */ 2461596 wikitext text/x-wiki 6gatke6t6m8n6sfoul23qvtadc6js3j 0 460733 2461312 2026-09-28T12:06:44Z AYounsi (WMF) 10040 Created page with " = Background = As of today, most of the BGP configurations on both the switches and the routers are generated through various mechanisms and data sources. Some of the BGP sessions are still managed manually. {| class="wikitable" |'''Sessions types''' |'''# of sessions''' |'''Source of truth''' |'''Automation''' |- |Peering |~1800 |None |Cookbook (partial) |- |Servers |~2000 |Netbox |Homer |- |Transit |72 |Homer-public (YAML) |Homer |- |Internal WAN |~50 |None |None |- |..." 2461312 wikitext text/x-wiki fxkt5mgvd2k8e852m8catafgswpodnx 2461336 2461312 2026-09-28T12:51:51Z Taavi-WMF 41365 /* Background */ fix table headers 2461336 wikitext text/x-wiki hs8vkbu0b7128hw56t78ju6vy835o4w 2461337 2461336 2026-09-28T12:52:57Z Taavi-WMF 41365 fix heading levels 2461337 wikitext text/x-wiki nuumypweitz5m313ur8qet52d5wbjm1 0 460734 2461389 2026-09-28T14:42:25Z FNegri-WMF 32595 Add placeholder page, more details coming soon. 2461389 wikitext text/x-wiki bh7bompv8ilvv8kvgi7smwzwicgpqks 12 460735 2461395 2026-09-28T15:16:41Z FNegri-WMF 32595 Add first version of help page for new Toolforge alerting feature (T432860) 2461395 wikitext text/x-wiki 89gxzlylgkchxaoazul0kg4yh83b0vd 1 460736 2461465 2026-09-28T20:24:28Z BCornwall-WMF 31521 /* Don't think this belongs here */ new section 2461465 wikitext text/x-wiki tojjdja6pnlnb6a3v5qj8t364t7y86y 3 460737 2461500 2026-09-28T23:38:21Z StrikerBot 8475 Welcome to Toolforge! 2461500 wikitext text/x-wiki sozfxdw4c0bqs26n4g06gwcso4kqsw1 3 460738 2461501 2026-09-28T23:42:19Z StrikerBot 8475 Welcome to Toolforge! 2461501 wikitext text/x-wiki 3sv9rx6tk6cnq6y2tme01oc7zsszr89 3 460739 2461502 2026-09-28T23:43:18Z StrikerBot 8475 Welcome to Toolforge! 2461502 wikitext text/x-wiki jfw1cjo41qiiudcbpz42nxibt6uhgcf 3 460740 2461504 2026-09-28T23:59:51Z StrikerBot 8475 Welcome to Toolforge! 2461504 wikitext text/x-wiki nz76iqmtvsgyo80mblbdeqngvuplcc8 3 460741 2461507 2026-09-29T00:02:12Z StrikerBot 8475 Welcome to Toolforge! 2461507 wikitext text/x-wiki lz1fns0jjop4vjnmtf9ec7qasb0uo0c 2 460742 2461511 2026-09-29T00:24:41Z Mutante 20 Created page with " == Reimage fails: installer stuck on leftover LVM/RAID from previous install == === Symptoms === * The <code>sre.hosts.reimage</code> cookbook fails, then waits at a prompt saying it cannot verify the host status and suggesting you check the console to see whether it is still in the Debian installer. * <code>install-console <host></code> only gives a BusyBox shell, not the installer screen. * Other hosts with the same hardware reimage fine. * <code>/proc..." 2461511 wikitext text/x-wiki 6c2fsh2yg2bldalzmif7t109kkxhcod 2461512 2461511 2026-09-29T00:28:21Z Mutante 20 2461512 wikitext text/x-wiki 0caqyifq0jchql61egtcsk3tkg0vknd