Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.6 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk Nova Resource:Tools/SAL 498 3086 2426244 2424722 2026-06-11T13:18:19Z Stashbot 7414 fnegri@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component jobs-api (T428449) 2426244 wikitext text/x-wiki d3pm7kbwjqa29mijq1rxzodx0g0myr1 2426262 2426244 2026-06-11T13:31:15Z Stashbot 7414 fnegri@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api (T428449) 2426262 wikitext text/x-wiki tdte465aa4i6i973e9zba3mhlehp0ge Logmsgbot 0 3739 2426490 2020198 2026-06-11T21:48:22Z BCornwall-WMF 31521 /* Restart */ Rm ancient message about using stretch, and fluff about how to use systemd restarts 2426490 wikitext text/x-wiki kb2qzhodfyzjy9trn1h0i3rs0armo0e Deployments 0 4108 2426212 2426145 2026-06-11T12:54:52Z ScheduleDeploymentBot 37566 Add [[gerrit:1300787]] to Thursday, June 11 UTC afternoon backport window 2426212 wikitext text/x-wiki cyiaah4fk9t512qunx0rm8ll6a1vyt8 2426271 2426212 2026-06-11T13:37:09Z ScheduleDeploymentBot 37566 Add [[gerrit:1300733]] to Thursday, June 11 UTC afternoon backport window 2426271 wikitext text/x-wiki jx4enhtbhvz2tyufx8ba1thfrau1gm7 2426330 2426271 2026-06-11T15:02:19Z ScheduleDeploymentBot 37566 Add [[gerrit:1300822]] to Thursday, June 11 UTC late backport window 2426330 wikitext text/x-wiki eaa722steqavjl7ualbmq47l6kwezdu 2426417 2426330 2026-06-11T16:47:48Z ScheduleDeploymentBot 37566 Add [[gerrit:1300842]] to Thursday, June 11 UTC late backport window 2426417 wikitext text/x-wiki j2rh2ek3otgpsfpd65pcwrozwpndc53 2426418 2426417 2026-06-11T16:47:59Z ScheduleDeploymentBot 37566 Add [[gerrit:1300843]] to Thursday, June 11 UTC late backport window 2426418 wikitext text/x-wiki 15agm545t9bfrtc8zvzp0uhsl9q04cq 2426425 2426418 2026-06-11T17:14:01Z ScheduleDeploymentBot 37566 Add [[gerrit:1293173]] to Monday, June 15 UTC afternoon backport window 2426425 wikitext text/x-wiki o4xvv4qayvyvzldil4bx2sxzqjq351j 2426453 2426425 2026-06-11T17:55:14Z ScheduleDeploymentBot 37566 Add [[gerrit:1300873]] to Monday, June 15 UTC afternoon backport window 2426453 wikitext text/x-wiki aezrn6skj45r88uf5jlo72u24f7b1bq 2426467 2426453 2026-06-11T19:33:08Z ScheduleDeploymentBot 37566 Add [[gerrit:1300896]] to Thursday, June 11 UTC late backport window 2426467 wikitext text/x-wiki k2g3q9aniigjmuc2f9z4ri9mrxbk4j6 2426471 2426467 2026-06-11T20:20:19Z ScheduleDeploymentBot 37566 Add [[gerrit:1300905]] to Thursday, June 11 UTC late backport window 2426471 wikitext text/x-wiki 80lyeoywsck95jxiyur84tu6y281fsq 2426475 2426471 2026-06-11T20:50:26Z ScheduleDeploymentBot 37566 Add [[gerrit:1300911]] to Thursday, June 11 UTC late backport window 2426475 wikitext text/x-wiki 2f7g7opxxihlpcirn2rnoiwxvp0hbo8 2426478 2426475 2026-06-11T20:59:29Z ScheduleDeploymentBot 37566 Add [[gerrit:1300913]] to Thursday, June 11 UTC late backport window 2426478 wikitext text/x-wiki 4erl0zba1xwt1v96xwqj5exmpg82tl1 Nova Resource:Toolsbeta/SAL 498 6726 2426213 2424175 2026-06-11T12:55:54Z Stashbot 7414 fnegri@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component jobs-api (T428449) 2426213 wikitext text/x-wiki l3kgx2jdm0ozy1ljorvqzw4947cp3sh 2426221 2426213 2026-06-11T13:08:18Z Stashbot 7414 fnegri@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api (T428449) 2426221 wikitext text/x-wiki 7zdjddkdj7ah2yhbo4gu3qiq4j54ku0 Server Admin Log 0 7919 2426185 2426184 2026-06-11T11:59:13Z Stashbot 7414 urbanecm@deploy1003: urbanecm: Continuing with deployment 2426185 wikitext text/x-wiki 8umcdk9hm89dgekzrq9hvzy3oai4lfz 2426186 2426185 2026-06-11T12:03:42Z Stashbot 7414 urbanecm@deploy1003: Finished scap sync-world: Backport for [[gerrit:1300764|Remove GrowthExperiments extension from closed wikis (T428884)]] (duration: 06m 53s) 2426186 wikitext text/x-wiki tw3ctv1s2e5pvvv4smxkdyymz4k50ec 2426187 2426186 2026-06-11T12:10:30Z Stashbot 7414 moritzm: installing openjdk-21 security updates on Bookworm 2426187 wikitext text/x-wiki gwwoh9xk6q69y3g10mynzkl3qyc4tml 2426188 2426187 2026-06-11T12:17:21Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti5006.eqsin.wmnet 2426188 wikitext text/x-wiki cvaz91dmobi7m0m5f45x3ug9nrwqx2w 2426189 2426188 2026-06-11T12:21:31Z Stashbot 7414 moritzm: remove ganeti5006 from eqsin cluster for reimage T428229 2426189 wikitext text/x-wiki qa7aj2spaskikz83z53gl07kms3irqv 2426190 2426189 2026-06-11T12:26:10Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reimage for host ganeti5006.eqsin.wmnet with OS bookworm 2426190 wikitext text/x-wiki ls57ux6ptzssxx9vgpqafkbn51xknfj 2426191 2426190 2026-06-11T12:26:45Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.move-vlan for host ganeti5006 2426191 wikitext text/x-wiki 3tb4lrk2vri2r65zqgcdhzbfwqjhr6l 2426192 2426191 2026-06-11T12:27:59Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.dns.netbox 2426192 wikitext text/x-wiki 9wbyw6z02k1erw8lq4ssztj077fee43 2426193 2426192 2026-06-11T12:28:13Z Stashbot 7414 oblivian@cumin1003: START - Cookbook sre.deploy.hiddenparma Hiddenparma deployment to the alerting hosts with reason: "UX improvements - oblivian@cumin1003" 2426193 wikitext text/x-wiki ghyhoqt3ybija8co9a3wzoziqba5fxg 2426194 2426193 2026-06-11T12:28:15Z Stashbot 7414 oblivian@cumin1003: START - Cookbook sre.deploy.python-code hiddenparma to alert[1002,2002].wikimedia.org with reason: UX improvements - oblivian@cumin1003 2426194 wikitext text/x-wiki 79sg8rnnxy6nepla25xnftwn4sr20tb 2426195 2426194 2026-06-11T12:28:34Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1232: Migration of db1232.eqiad.wmnet completed 2426195 wikitext text/x-wiki 8hztrwqd0p4dyvd4xvx7ihmklbhswdm 2426196 2426195 2026-06-11T12:28:37Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2426196 wikitext text/x-wiki 2nid6j4ph5jnralxibnldywojs31xtz 2426197 2426196 2026-06-11T12:29:05Z Stashbot 7414 oblivian@cumin1003: END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) hiddenparma to alert[1002,2002].wikimedia.org with reason: UX improvements - oblivian@cumin1003 2426197 wikitext text/x-wiki io8jl3nl1xsvzwzrnx4y9vv5p41r8vs 2426198 2426197 2026-06-11T12:29:10Z Stashbot 7414 oblivian@cumin1003: END (PASS) - Cookbook sre.deploy.hiddenparma (exit_code=0) Hiddenparma deployment to the alerting hosts with reason: "UX improvements - oblivian@cumin1003" 2426198 wikitext text/x-wiki ccq4wvo65yr1z9ikxj02j65k7tpsl8j 2426199 2426198 2026-06-11T12:31:49Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2188: Migration of db2188.codfw.wmnet completed 2426199 wikitext text/x-wiki gtta5bvkfqqcfeef14ubr80ktaxtcp0 2426200 2426199 2026-06-11T12:31:52Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2426200 wikitext text/x-wiki rhkkw7yesrmckx9r3wprmeede3rqcx1 2426201 2426200 2026-06-11T12:44:09Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.major-upgrade 2426201 wikitext text/x-wiki aasw9ccw3frwakinci0comro1e1h11v 2426202 2426201 2026-06-11T12:44:29Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.depool depool db1234: Upgrading db1234.eqiad.wmnet 2426202 wikitext text/x-wiki 40ksmy1940u83x60mo0t5mwtv6rujv2 2426203 2426202 2026-06-11T12:44:50Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1234: Upgrading db1234.eqiad.wmnet 2426203 wikitext text/x-wiki c031ntk49l3rnh1ijrlf9i8740nta6j 2426204 2426203 2026-06-11T12:46:04Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host ganeti5006 - jmm@cumin2002" 2426204 wikitext text/x-wiki o9j2b1eolfcz8lewo05f10h201gjh55 2426205 2426204 2026-06-11T12:46:09Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host ganeti5006 - jmm@cumin2002" 2426205 wikitext text/x-wiki pajebs0t4y1yaf7x9ywq0d0a9fg4hzu 2426206 2426205 2026-06-11T12:46:12Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2426206 wikitext text/x-wiki h35u3sva161lk7k5ugtcv1wa2thowi6 2426207 2426206 2026-06-11T12:46:15Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.dns.wipe-cache ganeti5006.eqsin.wmnet 9.0.132.10.in-addr.arpa 9.0.0.0.0.0.0.0.2.3.1.0.0.1.0.0.1.0.1.0.0.0.5.e.2.f.d.0.1.0.0.2.ip6.arpa on all recursors 2426207 wikitext text/x-wiki 7v887wfoeert6v4ji1uv7oa2eaf8qd0 2426208 2426207 2026-06-11T12:46:17Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) ganeti5006.eqsin.wmnet 9.0.132.10.in-addr.arpa 9.0.0.0.0.0.0.0.2.3.1.0.0.1.0.0.1.0.1.0.0.0.5.e.2.f.d.0.1.0.0.2.ip6.arpa on all recursors 2426208 wikitext text/x-wiki 1cwes0qvlgfgwyqz9uw9h1aj0vfn1yv 2426209 2426208 2026-06-11T12:46:19Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host ganeti5006 2426209 wikitext text/x-wiki ohkf7a7z3wk2uksqugbtuy3vpy3s0kj 2426210 2426209 2026-06-11T12:47:20Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ganeti5006 2426210 wikitext text/x-wiki 2pr4yrz9kgc8o95p1h0izjqxgw2kgm0 2426211 2426210 2026-06-11T12:47:23Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host ganeti5006 2426211 wikitext text/x-wiki hi71u6imkavxlmziwydo34wzmov1caj 2426214 2426211 2026-06-11T12:55:57Z Stashbot 7414 moritzm: installing Exim security updates on Bullseye 2426214 wikitext text/x-wiki d6qdk5lr6azi1izkltc0t7kzlvhhqgb 2426215 2426214 2026-06-11T12:57:27Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reimage for host db1234.eqiad.wmnet with OS trixie 2426215 wikitext text/x-wiki bc4vut0h02st7xb88kccv7ze4vs0g9g 2426216 2426215 2026-06-11T13:00:33Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.major-upgrade 2426216 wikitext text/x-wiki qr60l5o3idtx6qlbtr54vvygtfx5v7t 2426217 2426216 2026-06-11T13:02:10Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reimage for host db2202.codfw.wmnet with OS trixie 2426217 wikitext text/x-wiki o6e7jqd0qkb8du58fsohkkkjlastgf0 2426218 2426217 2026-06-11T13:04:51Z Stashbot 7414 gkyziridis@deploy1003: Started scap sync-world: Backport for [[gerrit:1300731|wgRestSandboxSpecs: Add Lift Wing API to documentation wikis (T427902)]] 2426218 wikitext text/x-wiki r1d8pjtrnlw6vim0z92bjn5b27zji6e 2426219 2426218 2026-06-11T13:06:55Z Stashbot 7414 claime: echo 'https://api.wikimedia.org/service/lw/specs/openapi.yaml' | mwscript-k8s --attach -- purgeList.php 2426219 wikitext text/x-wiki 681dnfmqfeqsqi9vspl2diok3w4eayh 2426220 2426219 2026-06-11T13:06:59Z Stashbot 7414 gkyziridis@deploy1003: gkyziridis: Backport for [[gerrit:1300731|wgRestSandboxSpecs: Add Lift Wing API to documentation wikis (T427902)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2426220 wikitext text/x-wiki 41u7vjvvrylxgkr9xzvjm128l7vfz1n 2426222 2426220 2026-06-11T13:09:13Z Stashbot 7414 gkyziridis@deploy1003: gkyziridis: Continuing with deployment 2426222 wikitext text/x-wiki f041xppco1ypda1v4l76q72in08gl5g 2426223 2426222 2026-06-11T13:10:13Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply 2426223 wikitext text/x-wiki oczexz2tp98h4jsxis5d8uqoz5c0g1z 2426224 2426223 2026-06-11T13:10:20Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply 2426224 wikitext text/x-wiki l5n2in1g023emvt8oncagc12ueen6dq 2426225 2426224 2026-06-11T13:11:08Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply 2426225 wikitext text/x-wiki 4g4vihhxqpcppx6int9qt3icuwe4rp6 2426226 2426225 2026-06-11T13:11:29Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply 2426226 wikitext text/x-wiki ljefly9d7clz4c8mvogqr2nlam022hq 2426227 2426226 2026-06-11T13:11:32Z Stashbot 7414 cgoubert@deploy1003: helmfile [staging] START helmfile.d/services/rest-gateway: apply 2426227 wikitext text/x-wiki q00rinaoynq4cx85yncxdbro5fev1eh 2426228 2426227 2026-06-11T13:11:45Z Stashbot 7414 cgoubert@deploy1003: helmfile [staging] DONE helmfile.d/services/rest-gateway: apply 2426228 wikitext text/x-wiki 452vbojymwaqhuxhmmy80jivoj3ckzj 2426229 2426228 2026-06-11T13:11:50Z Stashbot 7414 cgoubert@deploy1003: helmfile [codfw] START helmfile.d/services/rest-gateway: apply 2426229 wikitext text/x-wiki pqmo355s0v15gzmrymkqwocwj6tpvhi 2426230 2426229 2026-06-11T13:12:19Z Stashbot 7414 cgoubert@deploy1003: helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply 2426230 wikitext text/x-wiki 6ls2hy5vuz3ac2zyj97rp2jf6tytr1o 2426231 2426230 2026-06-11T13:12:24Z Stashbot 7414 cgoubert@deploy1003: helmfile [eqiad] START helmfile.d/services/rest-gateway: apply 2426231 wikitext text/x-wiki npel4zlj9xj84ag4hzi761i0zsidhof 2426232 2426231 2026-06-11T13:12:46Z Stashbot 7414 urbanecm@deploy1003: mwscript-k8s job started: extensions/Translate/scripts/moveTranslatableBundle.php --wiki=mediawikiwiki '--reason=per [[:phab:T428900]]' Wikimedia_Apps/iOS_FAQ 'Wikimedia Apps/FAQ/iOS' 'Martin Urbanec (WMF)' # T428900 2426232 wikitext text/x-wiki mspta3luqh9ds1fyrimvnxj854t75u9 2426233 2426232 2026-06-11T13:12:49Z Stashbot 7414 cgoubert@deploy1003: helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply 2426233 wikitext text/x-wiki 751f7exysiigbee148bmqn2tvad5vfg 2426234 2426233 2026-06-11T13:12:53Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1234.eqiad.wmnet with reason: host reimage 2426234 wikitext text/x-wiki hcdrvlhjx7bjwvyk9seu3dinkj29yw7 2426235 2426234 2026-06-11T13:13:09Z Stashbot 7414 andrewbogott: sudo -i reprepro --noskipold --component thirdparty/openstack-trixie-flamingo-backports update trixie-wikimedia 2426235 wikitext text/x-wiki 9mzu4kqxep7yuoq2r0qb3navxysfg93 2426236 2426235 2026-06-11T13:13:38Z Stashbot 7414 gkyziridis@deploy1003: Finished scap sync-world: Backport for [[gerrit:1300731|wgRestSandboxSpecs: Add Lift Wing API to documentation wikis (T427902)]] (duration: 08m 47s) 2426236 wikitext text/x-wiki n0m0omsdf8lznawvtws06a8n8x3fq34 2426237 2426236 2026-06-11T13:13:57Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2426237 wikitext text/x-wiki nj5ssuff7edpipd5gfx8m4fo2rvh63g 2426238 2426237 2026-06-11T13:14:29Z Stashbot 7414 urbanecm@deploy1003: mwscript-k8s job started: extensions/Translate/scripts/moveTranslatableBundle.php --wiki=mediawikiwiki '--reason=per [[:phab:T428900]]' Wikimedia_Apps/Android_FAQ 'Wikimedia Apps/FAQ/Android' 'Martin Urbanec (WMF)' # T428900 2426238 wikitext text/x-wiki ngwdgcsac0pro8rpv2yj1vcqclr8w4n 2426239 2426238 2026-06-11T13:15:45Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on ganeti5006.eqsin.wmnet with reason: host reimage 2426239 wikitext text/x-wiki 939lu2n8vevjver2krennxcxxeo0pqw 2426240 2426239 2026-06-11T13:16:07Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Started scap sync-world: Backport for [[gerrit:1300736|fix: correct intake-url and payload type for NCS experiment events (T422295)]] 2426240 wikitext text/x-wiki 9qatt44xqzxuxk4bghx8qp1242c2tf0 2426241 2426240 2026-06-11T13:17:47Z Stashbot 7414 cgoubert@deploy1003: helmfile [eqiad] START helmfile.d/services/rest-gateway: apply 2426241 wikitext text/x-wiki c239hpbchxnofmibhjck4ley5rfovv5 2426242 2426241 2026-06-11T13:18:07Z Stashbot 7414 cgoubert@deploy1003: helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply 2426242 wikitext text/x-wiki l72ljy6g53sc4woi4fceu9xufitxeaz 2426243 2426242 2026-06-11T13:18:12Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: lucaswerkmeister-wmde, migr: Backport for [[gerrit:1300736|fix: correct intake-url and payload type for NCS experiment events (T422295)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2426243 wikitext text/x-wiki 4cuc20f35bjrea9tftl0wobs5cuxoew 2426245 2426243 2026-06-11T13:18:22Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db2202.codfw.wmnet with reason: host reimage 2426245 wikitext text/x-wiki m3l36o2snmd3mp37c7gr3jpidkwphcc 2426246 2426245 2026-06-11T13:18:38Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: lucaswerkmeister-wmde, migr: Continuing with deployment 2426246 wikitext text/x-wiki 8n93o0xsj6fiehox5ea48s3end14tts 2426247 2426246 2026-06-11T13:18:51Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1234.eqiad.wmnet with reason: host reimage 2426247 wikitext text/x-wiki oy0dykshvgi9rp0pre6kix2hlqc6f6x 2426248 2426247 2026-06-11T13:22:38Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ganeti5006.eqsin.wmnet with reason: host reimage 2426248 wikitext text/x-wiki 43tqws0nj9nk1xw2i1rbazueml2t97a 2426249 2426248 2026-06-11T13:22:58Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Finished scap sync-world: Backport for [[gerrit:1300736|fix: correct intake-url and payload type for NCS experiment events (T422295)]] (duration: 06m 51s) 2426249 wikitext text/x-wiki exzmzyyjmdb32ili0vstjmd2gei2m1v 2426250 2426249 2026-06-11T13:24:18Z Stashbot 7414 urbanecm@deploy1003: mwscript-k8s job started: extensions/Translate/scripts/moveTranslatableBundle.php --wiki=mediawikiwiki '--reason=per [[:phab:T428900]]' Wikimedia_Apps/Android_FAQ 'Wikimedia Apps/FAQ/Android' 'Martin Urbanec (WMF)' # T428900 2426250 wikitext text/x-wiki 3cmi1gky92hh7a3xz7gr2x436jd6e8a 2426251 2426250 2026-06-11T13:25:31Z Stashbot 7414 urbanecm@deploy1003: mwscript-k8s job started: extensions/Translate/scripts/moveTranslatableBundle.php --wiki=mediawikiwiki '--reason=per [[:phab:T428900]]' Wikimedia_Apps/Android_FAQ 'Wikimedia Apps/FAQ/Android' 'Martin Urbanec (WMF)' # T428900 2426251 wikitext text/x-wiki jyl4xux3f22eszvdj1khbkgfttu3un8 2426252 2426251 2026-06-11T13:25:43Z Stashbot 7414 dreamyjazz@deploy1003: Started scap sync-world: Backport for [[gerrit:1300787|hCaptcha: Enable for MobileFrontend on all group1 wikis (T425940)]] 2426252 wikitext text/x-wiki 8bqnple8uy1b6lc0snc48iafjk5qxyj 2426253 2426252 2026-06-11T13:26:54Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2202.codfw.wmnet with reason: host reimage 2426253 wikitext text/x-wiki okai7tjvp7r05g83iw7pjcvz0f1mu0y 2426254 2426253 2026-06-11T13:27:50Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Backport for [[gerrit:1300787|hCaptcha: Enable for MobileFrontend on all group1 wikis (T425940)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2426254 wikitext text/x-wiki t9nkdyf1ty3kpr1nnn62rzwtvim73p7 2426255 2426254 2026-06-11T13:28:20Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Continuing with deployment 2426255 wikitext text/x-wiki 0rds32z3x1hlaxwo4x27e4ixeidkzm3 2426256 2426255 2026-06-11T13:28:53Z Stashbot 7414 cgoubert@deploy1003: helmfile [staging] START helmfile.d/services/rest-gateway: apply 2426256 wikitext text/x-wiki madaomuxy7dvhf7fbnyn6qquq1ct589 2426257 2426256 2026-06-11T13:28:58Z Stashbot 7414 cgoubert@deploy1003: helmfile [staging] DONE helmfile.d/services/rest-gateway: apply 2426257 wikitext text/x-wiki b7gxmlvp01dnk3upjiga5wgx0yksovp 2426258 2426257 2026-06-11T13:29:12Z Stashbot 7414 cgoubert@deploy1003: helmfile [staging] START helmfile.d/services/rest-gateway: apply 2426258 wikitext text/x-wiki 4k3thxlg39jeyorfhfpynhxr90uh13r 2426259 2426258 2026-06-11T13:29:24Z Stashbot 7414 cgoubert@deploy1003: helmfile [staging] DONE helmfile.d/services/rest-gateway: apply 2426259 wikitext text/x-wiki ce82iqrzhwnuimxkpqdvtwrv073vkrd 2426260 2426259 2026-06-11T13:29:29Z Stashbot 7414 cgoubert@deploy1003: helmfile [codfw] START helmfile.d/services/rest-gateway: apply 2426260 wikitext text/x-wiki pbiuzwt0l53sccpbjy98rxe1n4vzgfv 2426261 2426260 2026-06-11T13:29:49Z Stashbot 7414 cgoubert@deploy1003: helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply 2426261 wikitext text/x-wiki jytvxxczjaqf6cquzopdd12c679ao29 2426263 2426261 2026-06-11T13:32:42Z Stashbot 7414 dreamyjazz@deploy1003: Finished scap sync-world: Backport for [[gerrit:1300787|hCaptcha: Enable for MobileFrontend on all group1 wikis (T425940)]] (duration: 06m 59s) 2426263 wikitext text/x-wiki e3iy912ew8mwbnxh2woq0ffjrb343es 2426264 2426263 2026-06-11T13:34:01Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2426264 wikitext text/x-wiki 4gp5xndcdcct3u506o7mpcrwv57seoq 2426265 2426264 2026-06-11T13:34:20Z Stashbot 7414 slyngshede@dns1004: START - running authdns-update 2426265 wikitext text/x-wiki h9ecurjmux9qvoe7oz8xxqbs8dwcpdi 2426266 2426265 2026-06-11T13:34:57Z Stashbot 7414 moritzm: installing dovecot security updates 2426266 wikitext text/x-wiki rl3tqpnj5dhh3rwnsxsfzv10cxkztwt 2426268 2426266 2026-06-11T13:35:57Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1234.eqiad.wmnet with OS trixie 2426268 wikitext text/x-wiki 0dvbtq6s42g9wmnjok1b9urjokirsf4 2426269 2426268 2026-06-11T13:36:07Z Stashbot 7414 slyngshede@dns1004: END - running authdns-update 2426269 wikitext text/x-wiki tirrrsrjttx3sdffv1fsh8m0dfmd7yv 2426270 2426269 2026-06-11T13:36:39Z Stashbot 7414 alexsanford@deploy1003: Started scap sync-world: Backport for [[gerrit:1298890|Add 2FA enforcement demotion config for phase 3 groups (T423120)]] 2426270 wikitext text/x-wiki o15uhwrlamy9gc94kt011tmo90dqhc1 2426272 2426270 2026-06-11T13:38:46Z Stashbot 7414 alexsanford@deploy1003: alexsanford: Backport for [[gerrit:1298890|Add 2FA enforcement demotion config for phase 3 groups (T423120)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2426272 wikitext text/x-wiki tvv7epagebrad79mjq28o5qlbch3rzx 2426273 2426272 2026-06-11T13:39:41Z Stashbot 7414 alexsanford@deploy1003: alexsanford: Continuing with deployment 2426273 wikitext text/x-wiki am2ur0rmmfag4zihsx3cpgj2eo0kufw 2426276 2426273 2026-06-11T13:43:59Z Stashbot 7414 alexsanford@deploy1003: Finished scap sync-world: Backport for [[gerrit:1298890|Add 2FA enforcement demotion config for phase 3 groups (T423120)]] (duration: 07m 19s) 2426276 wikitext text/x-wiki e2xmdauxv7mmr7b9pjoqsdzfhudl96j 2426277 2426276 2026-06-11T13:44:20Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2202.codfw.wmnet with OS trixie 2426277 wikitext text/x-wiki kil57o8qosf7bvrn99mpmbcthwrsaq5 2426278 2426277 2026-06-11T13:45:31Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2426278 wikitext text/x-wiki 3vjbcj5ua372zmgad1vqiqbb91edvqu 2426279 2426278 2026-06-11T13:46:00Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2426279 wikitext text/x-wiki hlry5elnfcrcxeetgsec05nlbwrn371 2426280 2426279 2026-06-11T13:46:03Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2426280 wikitext text/x-wiki f98fp0eeko6su369wt6p1153re78erq 2426281 2426280 2026-06-11T13:46:22Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.pool pool db1234: Migration of db1234.eqiad.wmnet completed 2426281 wikitext text/x-wiki q92el7yy69n6f5na9ap5tjx7fg4c64q 2426282 2426281 2026-06-11T13:46:25Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti5006.eqsin.wmnet with OS bookworm 2426282 wikitext text/x-wiki jaml226fh6wodwk0quidmh88vfzbh7s 2426283 2426282 2026-06-11T13:46:30Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2426283 wikitext text/x-wiki f4a1f6ctwmwyhj7p56dhel93vbw1x6u 2426286 2426283 2026-06-11T13:49:21Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2426286 wikitext text/x-wiki 8jiolwlsgr0g3k9abnkjg7cdqxjyv3g 2426287 2426286 2026-06-11T13:50:29Z Stashbot 7414 moritzm: installing openssl security updates 2426287 wikitext text/x-wiki pn3vq0jyn5j6eiu8t3imwdwdowuy7g3 2426288 2426287 2026-06-11T13:50:31Z Stashbot 7414 slyngs: reloading liberica config on lvs5004 2426288 wikitext text/x-wiki tpxtsn2o6gf7na2xwocp5ax6xh2a6l1 2426289 2426288 2026-06-11T13:50:43Z Stashbot 7414 slyngshede@cumin1003: START - Cookbook sre.loadbalancer.admin config_reloading P{lvs5004*} and A:liberica 2426289 wikitext text/x-wiki e8sg5jvbnctplzqindci910nzv8d8ob 2426290 2426289 2026-06-11T13:50:48Z Stashbot 7414 javiermonton@deploy1003: Started scap sync-world: Backport for [[gerrit:1300733|stream: webrequest.page_view_stats.dev0 (T428725)]] 2426290 wikitext text/x-wiki ixbjoq9nzx6hrz8l2191teq9v239qfl 2426291 2426290 2026-06-11T13:51:03Z Stashbot 7414 slyngshede@cumin1003: END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) config_reloading P{lvs5004*} and A:liberica 2426291 wikitext text/x-wiki 6ccm4nv7hw4jiwsxnwnlfo43910opvr 2426293 2426291 2026-06-11T13:52:56Z Stashbot 7414 javiermonton@deploy1003: javiermonton: Backport for [[gerrit:1300733|stream: webrequest.page_view_stats.dev0 (T428725)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2426293 wikitext text/x-wiki 7or0sxxufwiq8r6kbryiw89561yztd4 2426294 2426293 2026-06-11T13:54:41Z Stashbot 7414 javiermonton@deploy1003: javiermonton: Continuing with deployment 2426294 wikitext text/x-wiki 1vaqo21qqq7isf91cwbny855y8cei3m 2426295 2426294 2026-06-11T13:55:40Z Stashbot 7414 fabfur@cumin1003: conftool action : set/pooled=yes; selector: name=cp5020.* 2426295 wikitext text/x-wiki 1c71c6cx0ma8m7wfj5ztz40tn02p3qp 2426296 2426295 2026-06-11T13:55:56Z Stashbot 7414 slyngshede@cumin1003: conftool action : set/pooled=yes; selector: name=cp5024.* 2426296 wikitext text/x-wiki bi2jwqv9ikujvunaqttml20zm9z4yyv 2426297 2426296 2026-06-11T13:57:15Z Stashbot 7414 fabfur@cumin1003: conftool action : set/pooled=yes; selector: name=cp5024.* 2426297 wikitext text/x-wiki 2jvddi0cjh9x7eba35bjjfxfnd8k82a 2426300 2426297 2026-06-11T13:59:00Z Stashbot 7414 javiermonton@deploy1003: Finished scap sync-world: Backport for [[gerrit:1300733|stream: webrequest.page_view_stats.dev0 (T428725)]] (duration: 08m 12s) 2426300 wikitext text/x-wiki me0z2r3mf2suoooys0ugr03mtcyfcd6 2426303 2426300 2026-06-11T14:00:48Z Stashbot 7414 Lucas_WMDE: UTC afternoon backport+config window done 2426303 wikitext text/x-wiki 5pj3uh27h5tv70lil2eh4yypqts4d5g 2426306 2426303 2026-06-11T14:08:44Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host ganeti5006.eqsin.wmnet 2426306 wikitext text/x-wiki 0ot8sff8uh015prcyfdogkr567mtbj5 2426307 2426306 2026-06-11T14:18:21Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti5006.eqsin.wmnet 2426307 wikitext text/x-wiki 8v97pds8fx9yo2e6gk59yxgmcsq44ha 2426309 2426307 2026-06-11T14:23:47Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-ttmserver-test: apply 2426309 wikitext text/x-wiki f8mj5rv3zrofuttc7fyrqmowo15uvrp 2426310 2426309 2026-06-11T14:23:51Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-ttmserver-test: apply 2426310 wikitext text/x-wiki 7nlsoie7x76hbyr6nkve7ldsw6dwlv1 2426312 2426310 2026-06-11T14:24:14Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.addnode for new host ganeti5006.eqsin.wmnet to cluster eqsin02 and group 01 2426312 wikitext text/x-wiki n1w5bjnkeu6xcryqpetdkai9p69uqna 2426313 2426312 2026-06-11T14:26:07Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.addnode (exit_code=0) for new host ganeti5006.eqsin.wmnet to cluster eqsin02 and group 01 2426313 wikitext text/x-wiki s72wbou2y7g7id85mnrphydxaite56h 2426314 2426313 2026-06-11T14:31:54Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1234: Migration of db1234.eqiad.wmnet completed 2426314 wikitext text/x-wiki tao4uw9h1cip0xp90m18rgu5j012nbb 2426315 2426314 2026-06-11T14:31:56Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2426315 wikitext text/x-wiki d316olmivpgshr44zdhxybxtrdx12eh 2426316 2426315 2026-06-11T14:32:58Z Stashbot 7414 hnowlan@deploy1003: helmfile [staging] START helmfile.d/services/thumbor: apply 2426316 wikitext text/x-wiki 0mzpbqsagcib56wukluppnfw2pf7xl8 2426317 2426316 2026-06-11T14:33:05Z Stashbot 7414 hnowlan@deploy1003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2426317 wikitext text/x-wiki o5omazxl2k7n15x8gbq6pyx9d2ojckl 2426318 2426317 2026-06-11T14:33:24Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-ttmserver-test: apply 2426318 wikitext text/x-wiki pedgw0ia40bss8dcirw4x56v2oggnj3 2426319 2426318 2026-06-11T14:33:28Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-ttmserver-test: apply 2426319 wikitext text/x-wiki rtazbgijo3poa3aqaguzzqbt8q51gqh 2426321 2426319 2026-06-11T14:43:26Z Stashbot 7414 moritzm: installing Poppler security updates 2426321 wikitext text/x-wiki 1khb6228w4rpm8usfmmm7difcxatmh4 2426324 2426321 2026-06-11T14:48:46Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.misc-clusters.roll-restart-reboot-docker-registry rolling restart_daemons on A:docker-registry 2426324 wikitext text/x-wiki ho11ab0dh83v4ib3jpewv8423797t79 2426325 2426324 2026-06-11T14:51:10Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.misc-clusters.roll-restart-reboot-docker-registry (exit_code=0) rolling restart_daemons on A:docker-registry 2426325 wikitext text/x-wiki nxqf1p4kl0la7i081c6qb2pbhek97rh 2426326 2426325 2026-06-11T14:53:05Z Stashbot 7414 moritzm: installing Bind security updates (just client-side tools/libraries) 2426326 wikitext text/x-wiki paz4lz5j1zlhr3x2fo1bf4xqb3frt81 2426332 2426326 2026-06-11T15:13:15Z Stashbot 7414 moritzm: installing libdbi-perl security updates 2426332 wikitext text/x-wiki 13lvodtdrskq19k33mp5fwv6b7khgbz 2426333 2426332 2026-06-11T15:13:18Z Stashbot 7414 hnowlan@deploy1003: helmfile [staging] START helmfile.d/services/thumbor: apply 2426333 wikitext text/x-wiki f6hcg68z4b0p4wcssqme6q93eyk64mh 2426334 2426333 2026-06-11T15:13:21Z Stashbot 7414 hnowlan@deploy1003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2426334 wikitext text/x-wiki 83lewxuz50pritouvyv3whwv7nkq3di 2426335 2426334 2026-06-11T15:17:55Z Stashbot 7414 hnowlan@deploy1003: helmfile [staging] START helmfile.d/services/thumbor: apply 2426335 wikitext text/x-wiki tjb35xxbe5z4brk8nqmvp3r38p31z3z 2426336 2426335 2026-06-11T15:18:02Z Stashbot 7414 hnowlan@deploy1003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2426336 wikitext text/x-wiki 2wu6zs59l6ps5y2wbprz8gi7f8avi13 2426337 2426336 2026-06-11T15:19:19Z Stashbot 7414 cscott@deploy1003: Started scap sync-world: Backport for [[gerrit:1300822|T428849: temporarily disable noisy warnings in HandleParsoidSectionLinks (T428849 T417530)]] 2426337 wikitext text/x-wiki oqng17jhjo1ictnsjk35pc9ov4uk0f7 2426338 2426337 2026-06-11T15:21:23Z Stashbot 7414 cscott@deploy1003: cscott: Backport for [[gerrit:1300822|T428849: temporarily disable noisy warnings in HandleParsoidSectionLinks (T428849 T417530)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2426338 wikitext text/x-wiki hnx5ftl868kudtodtx2g451g8h1az5r 2426339 2426338 2026-06-11T15:25:39Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.major-upgrade 2426339 wikitext text/x-wiki nv2b10puxfhgz6jixmm8n5fx2iib4fo 2426340 2426339 2026-06-11T15:25:58Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.depool depool db1235: Upgrading db1235.eqiad.wmnet 2426340 wikitext text/x-wiki 92vdli0360ylbzscknxqwwo6510xc9b 2426341 2426340 2026-06-11T15:26:18Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1235: Upgrading db1235.eqiad.wmnet 2426341 wikitext text/x-wiki bjbi4078zondm4g2eq91lhp8wsciexs 2426342 2426341 2026-06-11T15:26:27Z Stashbot 7414 cscott@deploy1003: cscott: Continuing with deployment 2426342 wikitext text/x-wiki o6dbhert59h6bci9fo2klpho74mbs5q 2426343 2426342 2026-06-11T15:26:38Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.major-upgrade 2426343 wikitext text/x-wiki 09rbh7pqikqdedahl23qs5r4dpy7oey 2426344 2426343 2026-06-11T15:26:48Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.depool depool db2212: Upgrading db2212.codfw.wmnet 2426344 wikitext text/x-wiki 1tvmbcbsyu419d6nab4f65wu9i6iscg 2426345 2426344 2026-06-11T15:27:20Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2212: Upgrading db2212.codfw.wmnet 2426345 wikitext text/x-wiki jcmyiknubbsgt9tbkkdtslbmeyrgpv5 2426346 2426345 2026-06-11T15:30:48Z Stashbot 7414 cscott@deploy1003: Finished scap sync-world: Backport for [[gerrit:1300822|T428849: temporarily disable noisy warnings in HandleParsoidSectionLinks (T428849 T417530)]] (duration: 11m 29s) 2426346 wikitext text/x-wiki pr3yfrov0d6g29pfk7h6so4n0g8fw9t 2426347 2426346 2026-06-11T15:31:56Z Stashbot 7414 cwilliams@cumin1003: END (FAIL) - Cookbook sre.mysql.major-upgrade (exit_code=99) 2426347 wikitext text/x-wiki pr1km238pa614lcxqlatmw4opqgqp7o 2426348 2426347 2026-06-11T15:32:12Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.major-upgrade 2426348 wikitext text/x-wiki 7a1b5s46mhdbdweofpxq2v4tyk16xe5 2426349 2426348 2026-06-11T15:32:15Z Stashbot 7414 cwilliams@cumin1003: END (FAIL) - Cookbook sre.mysql.major-upgrade (exit_code=99) 2426349 wikitext text/x-wiki jrfz4637s20mvpm0afbhin12952r6tl 2426351 2426349 2026-06-11T15:35:18Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.major-upgrade 2426351 wikitext text/x-wiki op24yazq8pn2ld392k911zv3ez6xxol 2426352 2426351 2026-06-11T15:35:28Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.depool depool db1235: Upgrading db1235.eqiad.wmnet 2426352 wikitext text/x-wiki s7j8hltjzp197l5zjcf9cdvgme9iran 2426353 2426352 2026-06-11T15:35:31Z Stashbot 7414 hnowlan@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2426353 wikitext text/x-wiki cw0syqvog3t6syhncuud0bllzpllray 2426354 2426353 2026-06-11T15:35:38Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1235: Upgrading db1235.eqiad.wmnet 2426354 wikitext text/x-wiki khg6vp4e27fxubws4aox1vcjxn77afp 2426355 2426354 2026-06-11T15:36:49Z Stashbot 7414 hnowlan@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2426355 wikitext text/x-wiki henov0sfn026q8wdt3my4p69ky541tj 2426356 2426355 2026-06-11T15:39:16Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reimage for host db1235.eqiad.wmnet with OS trixie 2426356 wikitext text/x-wiki e75sijpajx222c19elfs8l3wnfqqm4w 2426357 2426356 2026-06-11T15:39:28Z Stashbot 7414 hnowlan@deploy1003: helmfile [eqiad] START helmfile.d/services/thumbor: apply 2426357 wikitext text/x-wiki fbsg0ba066p2yg37cw0az63xvwck7w2 2426358 2426357 2026-06-11T15:40:27Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reimage for host db2212.codfw.wmnet with OS trixie 2426358 wikitext text/x-wiki 7utlkmyuwp7nu3o34o0vs84viyz3kec 2426359 2426358 2026-06-11T15:40:40Z Stashbot 7414 hnowlan@deploy1003: helmfile [eqiad] DONE helmfile.d/services/thumbor: apply 2426359 wikitext text/x-wiki 359k5fullzyowao997xxj4ktoruy532 2426360 2426359 2026-06-11T15:53:40Z Stashbot 7414 kamila@deploy1003: helmfile [staging] START helmfile.d/services/shellbox: apply 2426360 wikitext text/x-wiki qqqa3e287bsn7dqzgqolx4hcxizczr4 2426361 2426360 2026-06-11T15:53:48Z Stashbot 7414 kamila@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox: apply 2426361 wikitext text/x-wiki r3xjim85giokcgbnc1gt0dse2434nw8 2426362 2426361 2026-06-11T15:54:13Z Stashbot 7414 kamila@deploy1003: helmfile [staging] START helmfile.d/services/shellbox: apply 2426362 wikitext text/x-wiki 4n3civ19db6fhkccznp36r54a2f374h 2426363 2426362 2026-06-11T15:54:27Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1235.eqiad.wmnet with reason: host reimage 2426363 wikitext text/x-wiki k069n7qacy6xcdy3yycvyfwl0tg4ye6 2426364 2426363 2026-06-11T15:54:47Z Stashbot 7414 kamila@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox: apply 2426364 wikitext text/x-wiki sydenifzj2i8tal3gm5xcnc4tgqn6a3 2426365 2426364 2026-06-11T15:55:02Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.decommission for hosts rdb2007.codfw.wmnet 2426365 wikitext text/x-wiki pv0eq3b9poqmizqexz29qy8pf2y0yaw 2426366 2426365 2026-06-11T15:55:12Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2426366 wikitext text/x-wiki 8lt182mchbwz72n31gy2709h81kzpr7 2426367 2426366 2026-06-11T15:55:22Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.decommission for hosts rdb1011.eqiad.wmnet 2426367 wikitext text/x-wiki 07l5rsvkdwvxwavof5yptnqxen0ty9c 2426368 2426367 2026-06-11T15:55:45Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2426368 wikitext text/x-wiki br68z4ax8cnsl2a8ytfi1lb78dy92yw 2426369 2426368 2026-06-11T15:56:05Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.decommission for hosts rdb2009.codfw.wmnet 2426369 wikitext text/x-wiki 162an3snhi0r71hs4v2kgy52f23g1xo 2426370 2426369 2026-06-11T15:57:39Z Stashbot 7414 dbrant@deploy1003: helmfile [staging] START helmfile.d/services/wikifeeds: apply 2426370 wikitext text/x-wiki deo98yjanzni1hxe2lzhzrfmpxuw9hz 2426371 2426370 2026-06-11T15:57:51Z Stashbot 7414 kamila@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox: apply 2426371 wikitext text/x-wiki p9e28emftky9a8ztdhxpaxy0y7i92vs 2426372 2426371 2026-06-11T15:57:54Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. 2426372 wikitext text/x-wiki 4ex6s08gb7zuhcwwfsx7n52f570znxm 2426373 2426372 2026-06-11T15:57:58Z Stashbot 7414 dbrant@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifeeds: apply 2426373 wikitext text/x-wiki qid9esz9c6ofz382ur52xb2ir8ajbnt 2426374 2426373 2026-06-11T15:58:34Z Stashbot 7414 kamila@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox: apply 2426374 wikitext text/x-wiki ocht2tuf1fmugicxxna2tg8h9b6qil9 2426375 2426374 2026-06-11T15:58:45Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. 2426375 wikitext text/x-wiki 7626rpny919x5i3c37as7b5udzp3aa5 2426376 2426375 2026-06-11T15:59:12Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1235.eqiad.wmnet with reason: host reimage 2426376 wikitext text/x-wiki mbo1m4hpqp8hvjyie8d0k1z20zdgwqm 2426377 2426376 2026-06-11T16:00:02Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db2212.codfw.wmnet with reason: host reimage 2426377 wikitext text/x-wiki dxx4k5buklczwtbjekwz54zrc0vjfgn 2426378 2426377 2026-06-11T16:00:22Z Stashbot 7414 dbrant@deploy1003: helmfile [eqiad] START helmfile.d/services/wikifeeds: apply 2426378 wikitext text/x-wiki btx5ieuxpgco9m79vjqv3g2uq5s0m7t 2426379 2426378 2026-06-11T16:00:28Z Stashbot 7414 kamila@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox: apply 2426379 wikitext text/x-wiki jtv2d82y8bk9r1zqd62z3zwb0op4xce 2426380 2426379 2026-06-11T16:00:56Z Stashbot 7414 dbrant@deploy1003: helmfile [eqiad] DONE helmfile.d/services/wikifeeds: apply 2426380 wikitext text/x-wiki smijbiy95llrhnftk5nc41vdbuhib77 2426381 2426380 2026-06-11T16:01:11Z Stashbot 7414 kamila@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox: apply 2426381 wikitext text/x-wiki blaje1dphi0d4g4lup26pc23fwtlppq 2426382 2426381 2026-06-11T16:01:19Z Stashbot 7414 dbrant@deploy1003: helmfile [codfw] START helmfile.d/services/wikifeeds: apply 2426382 wikitext text/x-wiki sb7wu2a7blbsd0j7og1lzd3b3wmamly 2426383 2426382 2026-06-11T16:01:32Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.dns.netbox 2426383 wikitext text/x-wiki c4of2v4asxu4whm2rxpjbk1ybi3u2cv 2426384 2426383 2026-06-11T16:01:50Z Stashbot 7414 dbrant@deploy1003: helmfile [codfw] DONE helmfile.d/services/wikifeeds: apply 2426384 wikitext text/x-wiki a630zp8o0orzxtzy6w1ysbq66z4wbyr 2426385 2426384 2026-06-11T16:04:10Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2212.codfw.wmnet with reason: host reimage 2426385 wikitext text/x-wiki eeojuyk8g39g2amv7rjreea1lmddoo4 2426386 2426385 2026-06-11T16:04:36Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2426386 wikitext text/x-wiki 0teqdry6ogcpaq458wgab9q4h1miqdo 2426387 2426386 2026-06-11T16:05:19Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2426387 wikitext text/x-wiki omvod4u724hpwjm4qll0fyhac37386w 2426388 2426387 2026-06-11T16:06:01Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-ttmserver-test: apply 2426388 wikitext text/x-wiki 1blmypeeh505wbqt6myau0jnuimu7xi 2426389 2426388 2026-06-11T16:06:05Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-ttmserver-test: apply 2426389 wikitext text/x-wiki ldyxwp76op142la0xvg0lp78vm4uavj 2426390 2426389 2026-06-11T16:07:10Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.dns.netbox 2426390 wikitext text/x-wiki 92vg7xrg1be4g9nkzj8tg0xl5pitw8o 2426392 2426390 2026-06-11T16:13:12Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.dns.netbox 2426392 wikitext text/x-wiki pkc6fndep6lm4boh94oh1yqmv7i9gok 2426394 2426392 2026-06-11T16:15:49Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1235.eqiad.wmnet with OS trixie 2426394 wikitext text/x-wiki 9ocj6xnk6c07r2mtdlbs6xze7cta3ms 2426396 2426394 2026-06-11T16:21:23Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2212.codfw.wmnet with OS trixie 2426396 wikitext text/x-wiki pz9mvmdfxviut5nb4quvq7i9e6hz7fl 2426398 2426396 2026-06-11T16:27:32Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.pool pool db1235: Migration of db1235.eqiad.wmnet completed 2426398 wikitext text/x-wiki 462pp2r9bgfeooj82faeklzkojfqbsx 2426399 2426398 2026-06-11T16:27:55Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: rdb2009.codfw.wmnet decommissioned, removing all IPs except the asset tag one - jiji@cumin1003" 2426399 wikitext text/x-wiki or8ayr6nn77nzl4n5musvfxmquttx9k 2426402 2426399 2026-06-11T16:33:55Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.pool pool db2212: Migration of db2212.codfw.wmnet completed 2426402 wikitext text/x-wiki 9ndgntb16rhbq1txyoprnrzyr862kbz 2426403 2426402 2026-06-11T16:34:54Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: rdb2009.codfw.wmnet decommissioned, removing all IPs except the asset tag one - jiji@cumin1003" 2426403 wikitext text/x-wiki gd2x8rrwg2go61cqumoqioxt3zhjzo6 2426404 2426403 2026-06-11T16:34:57Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2426404 wikitext text/x-wiki d1lfqa80texdamplud2uucyfdscgb58 2426405 2426404 2026-06-11T16:34:59Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts rdb2009.codfw.wmnet 2426405 wikitext text/x-wiki 1w21yknlpf51w68sbrkd02k301lrl6o 2426406 2426405 2026-06-11T16:35:05Z Stashbot 7414 jiji@cumin1003: END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) 2426406 wikitext text/x-wiki izfp1uodph7allet9c0wie101qzjwgq 2426407 2426406 2026-06-11T16:35:07Z Stashbot 7414 jiji@cumin1003: END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts rdb1011.eqiad.wmnet 2426407 wikitext text/x-wiki 4mgmn8ow70atjrgoc8i7xra7q1us19p 2426408 2426407 2026-06-11T16:35:09Z Stashbot 7414 jiji@cumin1003: END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) 2426408 wikitext text/x-wiki meh8vjdmxlkk5eam3s2konbb0g8gsca 2426409 2426408 2026-06-11T16:35:12Z Stashbot 7414 jiji@cumin1003: END (FAIL) - Cookbook sre.hosts.decommission (exit_code=1) for hosts rdb2007.codfw.wmnet 2426409 wikitext text/x-wiki 049yapv10430tu8fgmo6dg11y38ywxz 2426412 2426409 2026-06-11T16:41:42Z Stashbot 7414 mutante: releases.wikimedia.org - switching backend from codfw to eqiad - releases1003 is now the source of rsync for uploaded releases files (use releases.discovery.wmnet to not have to think about it) - T418299 2426412 wikitext text/x-wiki 6fc5eeeke53szuba83bzdg4vgct5sr3 2426413 2426412 2026-06-11T16:41:57Z Stashbot 7414 dzahn@dns1005: START - running authdns-update 2426413 wikitext text/x-wiki cnfm60attkjz2q5lnxo2e833ho4piay 2426414 2426413 2026-06-11T16:42:34Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.dns.netbox 2426414 wikitext text/x-wiki 080kt4c9ama7ay93s3pisy8ue27c0kq 2426415 2426414 2026-06-11T16:43:51Z Stashbot 7414 dzahn@dns1005: END - running authdns-update 2426415 wikitext text/x-wiki osz8lyimaxnemthw1vkmzo6jnaodelg 2426416 2426415 2026-06-11T16:45:29Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2426416 wikitext text/x-wiki c0a7qfaao8dvnegzpivl58awm09uqhs 2426421 2426416 2026-06-11T17:08:53Z Stashbot 7414 ozge@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . 2426421 wikitext text/x-wiki rtx8n8lf2cpfw3kpzdejp61x1ek4oxu 2426423 2426421 2026-06-11T17:13:02Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1235: Migration of db1235.eqiad.wmnet completed 2426423 wikitext text/x-wiki m85t8tf6tefspeiohrfvaz9ew46z94u 2426424 2426423 2026-06-11T17:13:05Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2426424 wikitext text/x-wiki ear83c6x3m4gqwlzojq5geovcx8uh3n 2426428 2426424 2026-06-11T17:19:24Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2212: Migration of db2212.codfw.wmnet completed 2426428 wikitext text/x-wiki 0ikutloanramfpw8x85z50h5tbj9bu6 2426429 2426428 2026-06-11T17:19:26Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2426429 wikitext text/x-wiki 46q7zu1vwwb256pl9oge15urknpfy2s 2426430 2426429 2026-06-11T17:20:05Z Stashbot 7414 blake@deploy1003: Started scap sync-world: apache config update (T428772) 2426430 wikitext text/x-wiki djwm2dpy2z1dfb4er4xiyjsbxq47upe 2426431 2426430 2026-06-11T17:20:56Z Stashbot 7414 blake@deploy1003: blake: apache config update (T428772) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2426431 wikitext text/x-wiki 3ln0101z8mxgciu8udsmsjz6j36e0gj 2426432 2426431 2026-06-11T17:23:02Z Stashbot 7414 bd808@deploy1003: helmfile [staging] START helmfile.d/services/developer-portal: apply 2426432 wikitext text/x-wiki jx7cikgctlqp3vf5x44z0u28ftswgue 2426433 2426432 2026-06-11T17:23:15Z Stashbot 7414 bd808@deploy1003: helmfile [staging] DONE helmfile.d/services/developer-portal: apply 2426433 wikitext text/x-wiki 356nmwcrtjyib0xl907rph9x8dnn10x 2426434 2426433 2026-06-11T17:23:33Z Stashbot 7414 jforrester@deploy1003: helmfile [staging] START helmfile.d/services/wikifunctions: apply 2426434 wikitext text/x-wiki p92w2p7bccihun3fa1uafwdqahtvfn8 2426435 2426434 2026-06-11T17:23:45Z Stashbot 7414 bd808@deploy1003: helmfile [codfw] START helmfile.d/services/developer-portal: apply 2426435 wikitext text/x-wiki jw1y7m38mz6c721q43uzewcnu1abksw 2426436 2426435 2026-06-11T17:23:50Z Stashbot 7414 jforrester@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifunctions: apply 2426436 wikitext text/x-wiki tnw9lwtxz1jcvem9ofdt3aez056qouk 2426437 2426436 2026-06-11T17:24:00Z Stashbot 7414 jforrester@deploy1003: helmfile [codfw] START helmfile.d/services/wikifunctions: apply 2426437 wikitext text/x-wiki 0bhxm17id72bjwgivby8nhqhb9wde6y 2426438 2426437 2026-06-11T17:24:18Z Stashbot 7414 bd808@deploy1003: helmfile [codfw] DONE helmfile.d/services/developer-portal: apply 2426438 wikitext text/x-wiki jp3q85f6fx0b5a2bvqr0qvovqtj1a1c 2426439 2426438 2026-06-11T17:24:42Z Stashbot 7414 jforrester@deploy1003: helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply 2426439 wikitext text/x-wiki erei48gwhbh0riz8c45boc19t5ed7zd 2426440 2426439 2026-06-11T17:24:46Z Stashbot 7414 bd808@deploy1003: helmfile [eqiad] START helmfile.d/services/developer-portal: apply 2426440 wikitext text/x-wiki 53tvxjjzhsyjheftb2dga4l136pu86z 2426441 2426440 2026-06-11T17:24:54Z Stashbot 7414 jforrester@deploy1003: helmfile [eqiad] START helmfile.d/services/wikifunctions: apply 2426441 wikitext text/x-wiki ofbmwbis3tepkcl202a1jnvzmryvhl7 2426442 2426441 2026-06-11T17:25:27Z Stashbot 7414 jforrester@deploy1003: helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply 2426442 wikitext text/x-wiki 9pdhphtv8gyal06jn9v0839k9wg9rnu 2426443 2426442 2026-06-11T17:25:47Z Stashbot 7414 blake@deploy1003: Scap cancelled without rolling back. 2426443 wikitext text/x-wiki g7xkmpjx8l6g17auyxphz66o04k8ksr 2426444 2426443 2026-06-11T17:26:08Z Stashbot 7414 bd808@deploy1003: helmfile [eqiad] DONE helmfile.d/services/developer-portal: apply 2426444 wikitext text/x-wiki lyqdta2gdtp84mdhk51yqkqa0pgv9k0 2426446 2426444 2026-06-11T17:44:34Z Stashbot 7414 reedy@deploy1003: Started scap sync-world: Backport for [[gerrit:1300865|UploadWizard.config.php: Fix cc-by-4.0-heirs msg issue (T428935 T405146)]] 2426446 wikitext text/x-wiki 8w313dv9ndohau4gnpthz1kq5yt9nl9 2426448 2426446 2026-06-11T17:46:44Z Stashbot 7414 reedy@deploy1003: reedy: Backport for [[gerrit:1300865|UploadWizard.config.php: Fix cc-by-4.0-heirs msg issue (T428935 T405146)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2426448 wikitext text/x-wiki 37cpb1ssvhhkddk4wm7kq3ijay8vbra 2426450 2426448 2026-06-11T17:48:22Z Stashbot 7414 reedy@deploy1003: reedy: Continuing with deployment 2426450 wikitext text/x-wiki l82lvvhjyg3dnea0wt52clftco6bnby 2426451 2426450 2026-06-11T17:52:49Z Stashbot 7414 reedy@deploy1003: Finished scap sync-world: Backport for [[gerrit:1300865|UploadWizard.config.php: Fix cc-by-4.0-heirs msg issue (T428935 T405146)]] (duration: 08m 15s) 2426451 wikitext text/x-wiki 3cddhp6lzwdbq01a1tnlik6wapghu7d 2426454 2426451 2026-06-11T18:12:20Z Stashbot 7414 ozge@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2426454 wikitext text/x-wiki q4aceuoomxuf81ncmtx6j52ygeqwny8 2426455 2426454 2026-06-11T18:12:30Z Stashbot 7414 ozge@deploy1003: helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . 2426455 wikitext text/x-wiki riec86lds18u4jbp87p7vlnllt31l5q 2426466 2426455 2026-06-11T19:12:47Z Stashbot 7414 dduvall@deploy1003: rebuilt and synchronized wikiversions files: group2 to 1.47.0-wmf.6 refs T423915 2426466 wikitext text/x-wiki sfmkj6qi70goswq7w8qjopctptb6nr0 2426470 2426466 2026-06-11T20:17:37Z Stashbot 7414 jdrewniak@deploy1003: Started scap sync-world: Backport for [[gerrit:1300842|Donor Delight Badge: Unify on "Remove badge" language across treatments (T427313)]], [[gerrit:1300843|[A11y] Donor Badge: Remove Badge button disappears too quickly (T428646)]], [[gerrit:1300896|Donor Delight Badge, styles: Amending to final design review feedback (T427313)]] 2426470 wikitext text/x-wiki o2lba2ncph8jzyszotazk4ttuuq4lqr 2426472 2426470 2026-06-11T20:34:56Z Stashbot 7414 jdrewniak@deploy1003: annet, jdrewniak: Backport for [[gerrit:1300842|Donor Delight Badge: Unify on "Remove badge" language across treatments (T427313)]], [[gerrit:1300843|[A11y] Donor Badge: Remove Badge button disappears too quickly (T428646)]], [[gerrit:1300896|Donor Delight Badge, styles: Amending to final design review feedback (T427313)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug 2426472 wikitext text/x-wiki sb3f89eo48345vg1i6ubujsmvol0gsf 2426473 2426472 2026-06-11T20:36:00Z Stashbot 7414 dzahn@cumin2002: START - Cookbook sre.hosts.reimage for host releases2003.codfw.wmnet with OS trixie 2426473 wikitext text/x-wiki sra9iwhsvvfmixtzu4c2xzevsepn5le 2426474 2426473 2026-06-11T20:39:17Z Stashbot 7414 jdrewniak@deploy1003: annet, jdrewniak: Continuing with deployment 2426474 wikitext text/x-wiki 7jlmcm0db8o7ot3xyg43zo75jm3cie1 2426476 2426474 2026-06-11T20:51:46Z Stashbot 7414 jdrewniak@deploy1003: Finished scap sync-world: Backport for [[gerrit:1300842|Donor Delight Badge: Unify on "Remove badge" language across treatments (T427313)]], [[gerrit:1300843|[A11y] Donor Badge: Remove Badge button disappears too quickly (T428646)]], [[gerrit:1300896|Donor Delight Badge, styles: Amending to final design review feedback (T427313)]] (duration: 34m 10s) 2426476 wikitext text/x-wiki qezb811p82dq5ooqnpg8v4ifeht3ugs 2426477 2426476 2026-06-11T20:56:44Z Stashbot 7414 dreamyjazz@deploy1003: Started scap sync-world: Backport for [[gerrit:1300911|hCaptcha: Enable for badlogin for all small wikis (T426875)]], [[gerrit:1300905|RadioRangeBallot: Fix strict mode issue (T428947)]] 2426477 wikitext text/x-wiki n1qsh6d6czezf60ax163xbkc3s4vazi 2426479 2426477 2026-06-11T21:00:29Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Backport for [[gerrit:1300911|hCaptcha: Enable for badlogin for all small wikis (T426875)]], [[gerrit:1300905|RadioRangeBallot: Fix strict mode issue (T428947)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2426479 wikitext text/x-wiki 4j4mqkju2vgnq8dwpjompi1tvan09gu 2426480 2426479 2026-06-11T21:01:04Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Continuing with deployment 2426480 wikitext text/x-wiki jkbd09tl7koe3e2rz2tqhp54ejjqdob 2426481 2426480 2026-06-11T21:06:43Z Stashbot 7414 bblack@cumin1003: END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on A:cp-text and not P{cp7008*} and A:cp - Upgrade wmfuniq to 0.3.0 () 2426481 wikitext text/x-wiki iaszq17lpi670oua143ndb349uatxhb 2426482 2426481 2026-06-11T21:07:27Z Stashbot 7414 dreamyjazz@deploy1003: Finished scap sync-world: Backport for [[gerrit:1300911|hCaptcha: Enable for badlogin for all small wikis (T426875)]], [[gerrit:1300905|RadioRangeBallot: Fix strict mode issue (T428947)]] (duration: 10m 43s) 2426482 wikitext text/x-wiki 16zj8fugao5wkjxlemysah30ovj7b2x 2426483 2426482 2026-06-11T21:20:40Z Stashbot 7414 arlolra@deploy1003: Started scap sync-world: Backport for [[gerrit:1300913|Avoid the escaping from nowiki processing (T398967)]] 2426483 wikitext text/x-wiki rvlqtrt08kizb34e9ppzn1kg5kv1h96 2426484 2426483 2026-06-11T21:22:26Z Stashbot 7414 arlolra@deploy1003: arlolra: Backport for [[gerrit:1300913|Avoid the escaping from nowiki processing (T398967)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2426484 wikitext text/x-wiki 88z5izfyjdckfmwc1ekq4558mw573lo 2426485 2426484 2026-06-11T21:25:32Z Stashbot 7414 arlolra@deploy1003: arlolra: Continuing with deployment 2426485 wikitext text/x-wiki 8tfyo299pogy643uvtmhrfgasrc5c0d 2426486 2426485 2026-06-11T21:28:48Z Stashbot 7414 dzahn@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on releases2003.codfw.wmnet with reason: host reimage 2426486 wikitext text/x-wiki dz30gs6ylvf8d1hu1fvu47n217heg4x 2426487 2426486 2026-06-11T21:29:49Z Stashbot 7414 arlolra@deploy1003: Finished scap sync-world: Backport for [[gerrit:1300913|Avoid the escaping from nowiki processing (T398967)]] (duration: 09m 09s) 2426487 wikitext text/x-wiki syym497q6v30m21ywzt3dpj4rrrpo81 2426488 2426487 2026-06-11T21:34:04Z Stashbot 7414 dzahn@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on releases2003.codfw.wmnet with reason: host reimage 2426488 wikitext text/x-wiki palxps0p2jh3g8c5me79q6qe6te6diq 2426489 2426488 2026-06-11T21:34:30Z Stashbot 7414 egardner@deploy1003: Started scap sync-world: Backport for [[gerrit:1300906|Restore MediaViewer toggle in Special:Preferences (T428742)]] 2426489 wikitext text/x-wiki 2jwev52w2nbs0e556x02q5fiumflv2g 2426491 2426489 2026-06-11T21:51:43Z Stashbot 7414 egardner@deploy1003: egardner: Backport for [[gerrit:1300906|Restore MediaViewer toggle in Special:Preferences (T428742)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2426491 wikitext text/x-wiki 3k0ddb8ejc0eiv7k1kksw4yj2746m6r 2426492 2426491 2026-06-11T21:52:26Z Stashbot 7414 egardner@deploy1003: egardner: Continuing with deployment 2426492 wikitext text/x-wiki libcm9srfcrkg20p6rl2pumjbd3f70i 2426493 2426492 2026-06-11T21:58:59Z Stashbot 7414 dzahn@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host releases2003.codfw.wmnet with OS trixie 2426493 wikitext text/x-wiki 6iobdzi1z4w3uq6be9970pi4slrtzsm 2426494 2426493 2026-06-11T22:05:22Z Stashbot 7414 egardner@deploy1003: Finished scap sync-world: Backport for [[gerrit:1300906|Restore MediaViewer toggle in Special:Preferences (T428742)]] (duration: 30m 51s) 2426494 wikitext text/x-wiki ez7cq9ic3hdf23e8kd7tsslm0cf742c 2426495 2426494 2026-06-11T22:13:59Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-ttmserver-test: apply 2426495 wikitext text/x-wiki 5ckvlba5opd0oiweiebzk5daqw68ib8 2426496 2426495 2026-06-11T22:14:03Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-ttmserver-test: apply 2426496 wikitext text/x-wiki 1dbhe8jvezbzwl0wfifstzrc5e0msck 2426497 2426496 2026-06-11T22:26:04Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2426497 wikitext text/x-wiki qno8p4bbowyakpjfkiai77oz3t13b9s 2426498 2426497 2026-06-11T22:27:07Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2426498 wikitext text/x-wiki 9z0kb96w7fhd9wjdts6uq8bvj4dkjev 2426500 2426498 2026-06-12T00:00:12Z Stashbot 7414 bblack@cumin1003: END (PASS) - Cookbook sre.cdn.roll-upgrade-varnish (exit_code=0) rolling upgrade of Varnish on A:cp-upload and not P{cp7008.magru.wmnet} and A:cp - Upgrade wmfuniq to 0.3.0 () 2426500 wikitext text/x-wiki j5kspppt1x00knf69z565w4eptpoeec 2426503 2426500 2026-06-12T02:00:22Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2426503 wikitext text/x-wiki rkdkp4ivj93yf66vt6smufdpoeaxl8n 2426504 2426503 2026-06-12T02:01:35Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 01m 13s) 2426504 wikitext text/x-wiki nf1o5seowoytthavkgxmet29edcaui3 2426505 2426504 2026-06-12T03:06:27Z Stashbot 7414 ryankemper: T427951 Deleted all 20 unused dev/test topics on kafka-jumbo (verified empty first); 2 (`[eqiad,codfw]page_html_content_change.rc0`) were immediately auto-recreated empty by a still-running `dse-k8s` enrichment consumer; awaiting owner confirmation before final re-delete 2426505 wikitext text/x-wiki 8yuimiq0vah9kwr4l14b0wc6mj14sl3 2426506 2426505 2026-06-12T03:07:16Z Stashbot 7414 ryankemper: T427951 sorry, `[eqiad,codfw].mediawiki.page_html_content_change.rc0` (accidentally a word) 2426506 wikitext text/x-wiki kktcqw9ea5gqkx3wt7lmevqhytra00v 2426508 2426506 2026-06-12T06:11:57Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.puppet.disable-merges 2426508 wikitext text/x-wiki kpfgunkk8dbp79i3zo5t4myah8dtf3n 2426509 2426508 2026-06-12T06:13:22Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.puppet.disable-merges (exit_code=0) 2426509 wikitext text/x-wiki mzpeultzyds6db11ir38etqehd4plww 2426511 2426509 2026-06-12T09:57:28Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-staging-codfw] 'sync' command on namespace 'liftwing-openapi-server' for release 'main' . 2426511 wikitext text/x-wiki ouwgda5q1sr81qrut94gwjug1s68fpz 2426512 2426511 2026-06-12T09:58:37Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-serve-eqiad] 'sync' command on namespace 'liftwing-openapi-server' for release 'main' . 2426512 wikitext text/x-wiki hzhobpg0p39lt848e240oo6ydhb33fl 2426513 2426512 2026-06-12T09:59:04Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-serve-codfw] 'sync' command on namespace 'liftwing-openapi-server' for release 'main' . 2426513 wikitext text/x-wiki hthhj3xf4apohg4wx5ijlue2vev0oxa 2426514 2426513 2026-06-12T10:08:50Z Stashbot 7414 jelto@cumin1003: START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1004.wikimedia.org with reason: Upgrade GitLab 2426514 wikitext text/x-wiki c7zca6jlc94vsuna3hxpk35mcg1atuv 2426515 2426514 2026-06-12T10:12:33Z Stashbot 7414 atsuko@deploy1003: helmfile [staging] START helmfile.d/services/toolhub: apply 2426515 wikitext text/x-wiki 55nxazdzssyid0y4q04hv1p2fthi7xg 2426516 2426515 2026-06-12T10:12:43Z Stashbot 7414 atsuko@deploy1003: helmfile [staging] DONE helmfile.d/services/toolhub: apply 2426516 wikitext text/x-wiki 0i8cnr71k6fbm9w03ypovyobiqw1jl1 2426518 2426516 2026-06-12T10:35:32Z Stashbot 7414 cgoubert@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-debug: apply 2426518 wikitext text/x-wiki lvp3kmdls9l874sg748lqlszgvjnru2 2426519 2426518 2026-06-12T10:35:35Z Stashbot 7414 cgoubert@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-debug: apply 2426519 wikitext text/x-wiki f4mb74dy6e25fw5djpattzko10eo82r 2426520 2426519 2026-06-12T10:35:59Z Stashbot 7414 cgoubert@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-debug: apply 2426520 wikitext text/x-wiki r9o4cri212hpzrhyer3p9p7q4x52j4u 2426521 2426520 2026-06-12T10:36:17Z Stashbot 7414 cgoubert@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-debug: apply 2426521 wikitext text/x-wiki n85ifq2huo5rzhf5pjkfzhj1iqo50zi 2426522 2426521 2026-06-12T10:37:53Z Stashbot 7414 cgoubert@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-debug: apply 2426522 wikitext text/x-wiki 3rfas7rqfjq1151pty2h7qfuoepxy4l 2426523 2426522 2026-06-12T10:40:13Z Stashbot 7414 cgoubert@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-debug: apply 2426523 wikitext text/x-wiki t4rpx4jc60274kjagg094dqu4tfg4hv 2426524 2426523 2026-06-12T10:49:14Z Stashbot 7414 atsuko@deploy1003: helmfile [staging] START helmfile.d/services/toolhub: apply 2426524 wikitext text/x-wiki sosrdilucoj69v0kpplumo4q1emt1j6 2426525 2426524 2026-06-12T10:49:23Z Stashbot 7414 atsuko@deploy1003: helmfile [staging] DONE helmfile.d/services/toolhub: apply 2426525 wikitext text/x-wiki omz89jol15uetimvpfl752w2suzif2z 2426526 2426525 2026-06-12T10:56:00Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2426526 wikitext text/x-wiki g04akwc0nst8y8i87lj3zdf45w0k85x 2426527 2426526 2026-06-12T10:56:08Z Stashbot 7414 atsuko@deploy1003: helmfile [staging] START helmfile.d/services/toolhub: apply 2426527 wikitext text/x-wiki gyl3iq8pmklxcmvp6nh4kb37hioeulv 2426528 2426527 2026-06-12T10:56:16Z Stashbot 7414 atsuko@deploy1003: helmfile [staging] DONE helmfile.d/services/toolhub: apply 2426528 wikitext text/x-wiki ddrk0rzrz9717mj3uc6azdq7r77lzg1 2426529 2426528 2026-06-12T11:07:52Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2426529 wikitext text/x-wiki tjihuea16e59q20nd99p8k1l9vksaj7 2426530 2426529 2026-06-12T11:24:39Z Stashbot 7414 jelto@cumin1003: END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1004.wikimedia.org with reason: Upgrade GitLab 2426530 wikitext text/x-wiki e46852op24kowh64cwfnehboh490a60 2426531 2426530 2026-06-12T11:34:54Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2426531 wikitext text/x-wiki gwvwwi5vaya99sspkmkxstry28b6t41 2426532 2426531 2026-06-12T11:35:26Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2426532 wikitext text/x-wiki acwz2nas6msj4bkihkw5a2hopbqu5q2 2426533 2426532 2026-06-12T11:35:58Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. 2426533 wikitext text/x-wiki clkv5x5ysmkafds4n1dtx5k0qi3zfjt 2426534 2426533 2026-06-12T11:36:51Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. 2426534 wikitext text/x-wiki qstz8ztzk1lde3szssvkaovyqgrqc21 2426535 2426534 2026-06-12T11:40:54Z Stashbot 7414 moritzm: installing Linux 5.10.257 on Bullseye hosts 2426535 wikitext text/x-wiki 70mookr7h8i71lagwh5kebtcirpxuxc SRE/Clinic Duty 0 7942 2426422 2381676 2026-06-11T17:10:29Z BCornwall-WMF 31521 /* Expectations */ it's thu-wed nowadays, not mon-fri 2426422 wikitext text/x-wiki l1hnno2d4y5ji13434uzcgt8svjh571 User talk:Lokal Profil 3 11976 2426502 2425862 2026-06-12T00:05:25Z Lokal Profil 937 /* Interested in adding your toolviews visualization to toolviews.toolforge.org? */ Reply 2426502 wikitext text/x-wiki fq83a9rvtd92xo7jjy5k9hpie3fdjzp Releases.wikimedia.org 0 12914 2426426 2363198 2026-06-11T17:17:14Z Mutante 20 /* Failing over */ 2426426 wikitext text/x-wiki a5b9vpmoknlsg4ikmlwm6bymlhbawib Fundraising/tech/Alerts 0 16165 2426499 120999 2026-06-11T22:42:37Z DWisehaupt (WMF) 14911 Update alerts documentation to be current. 2426499 wikitext text/x-wiki 2zqxzs7u8ucbxxir1pms51gu7q54tun Release Engineering/SAL 0 17290 2426322 2426083 2026-06-11T14:46:15Z Stashbot 7414 hashar: On all MediaWiki repos, converting old release branches up to REL1_42 included to tags. Last time I missed non wmf repo # T380841 | T428864 2426322 wikitext text/x-wiki iw8sm8twnhptfltrgovvs66redq1jg0 2426323 2426322 2026-06-11T14:46:51Z Stashbot 7414 hashar: for minor in $(seq 21 42); do ./.tox/make-release/bin/python -u ./make-release/branch.py --delete --abandon --bundle '*' "REL1_$minor"; done; 2426323 wikitext text/x-wiki p0lpkmrzjockgfpxbfu1vmda8oou7to 2426517 2426323 2026-06-12T10:21:42Z Stashbot 7414 Krinkle: `krinkle@{doc1004,doc2003}:/srv/doc/mediawiki-core$ sudo -u doc-uploader rm -rf list/` - remove doc build for git-tag test. 2426517 wikitext text/x-wiki ltlis2y7vb8smtnunodsu5k45toxfyc Nova Resource:Admin/SAL 498 30942 2426305 2425040 2026-06-11T14:05:18Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol2005-dev.codfw.wmnet' (T428549) 2426305 wikitext text/x-wiki 17xadon4kdono6m7aetfgfg40s4ozjf 2426308 2426305 2026-06-11T14:22:15Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudcontrol2005-dev.codfw.wmnet' (T428549) 2426308 wikitext text/x-wiki 9rpw8h5e0e0iz5zvf3b7ize4jhydxs9 2426311 2426308 2026-06-11T14:24:09Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol2006-dev.codfw.wmnet' (T428549) 2426311 wikitext text/x-wiki k8cq7nwb6k8fpxz46v7192tb9sjmgzk 2426320 2426311 2026-06-11T14:41:32Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudcontrol2006-dev.codfw.wmnet' (T428549) 2426320 wikitext text/x-wiki 5fiyrcar14gslgzsteg6haz09uwz5ef 2426327 2426320 2026-06-11T14:58:09Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol2010-dev.codfw.wmnet' (T428549) 2426327 wikitext text/x-wiki lxkg9z19v4nx4c4www3tv2pi2ekj7ri 2426331 2426327 2026-06-11T15:11:07Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudcontrol2010-dev.codfw.wmnet' (T428549) 2426331 wikitext text/x-wiki 3b1y7x4vv6f6mc7nx10rqpjh73vmcef 2426400 2426331 2026-06-11T16:33:08Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol2006.eqiad.wmnet' (T428549) 2426400 wikitext text/x-wiki 6yzia8mb26ihuzm2gybl73z3u7cwinn 2426401 2426400 2026-06-11T16:33:12Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=99) on host 'cloudcontrol2006.eqiad.wmnet' (T428549) 2426401 wikitext text/x-wiki awn5u3g0tapipr3txv24s6sp33bp41x 2426411 2426401 2026-06-11T16:37:35Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol1006.eqiad.wmnet' (T428549) 2426411 wikitext text/x-wiki m959cicezpnr6rftcmjaxw7bldb229l 2426419 2426411 2026-06-11T16:50:20Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudcontrol1006.eqiad.wmnet' (T428549) 2426419 wikitext text/x-wiki h55oe6bwdtfs5500zkpk7iiqeggc2xb 2426420 2426419 2026-06-11T17:05:26Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol1007.eqiad.wmnet' (T428549) 2426420 wikitext text/x-wiki 7am81ekfxnrqiccb73vo6yt5d9c142h 2426427 2426420 2026-06-11T17:19:01Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudcontrol1007.eqiad.wmnet' (T428549) 2426427 wikitext text/x-wiki 4t7n4jrnq79adpj5mn46rhyzgtzgdph 2426445 2426427 2026-06-11T17:39:53Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol1011.eqiad.wmnet' (T428549) 2426445 wikitext text/x-wiki 9jxi2sz30ojbxkopzb9d45ha2uhi5jb 2426452 2426445 2026-06-11T17:53:26Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudcontrol1011.eqiad.wmnet' (T428549) 2426452 wikitext text/x-wiki ekfv25sparrgvhzd136d0i3vcmu7wm5 Wikimedia site requests 0 101190 2426510 2401084 2026-06-12T09:21:36Z AKlapper (WMF) 421 Fix everchanging paths 2426510 wikitext text/x-wiki tt5ztwzz5zv16pe200vff8ygjxeu7nh Nova Resource:Tools.lexeme-forms/SAL 498 443946 2426468 2424018 2026-06-11T19:59:28Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: deployed 3358ae7e8c (l10n updates: ar, fi, frp, it, ko, nl, sk, zh-hans; using the previously deployed {{GENDER:}} support in duplicates-instructions) 2426468 wikitext text/x-wiki cojvkk9g3d4524sl7j4q9erw7wrxdz0 Event Platform/Producing events 0 446051 2426457 2422583 2026-06-11T18:35:25Z Ottomata 88 /* Producing with EventBus */ 2426457 wikitext text/x-wiki nw98ms5x4suc4j7h1jczkcse7f2i4rj Nova Resource:Tools.ranker/SAL 498 447034 2426469 2421948 2026-06-11T20:10:10Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: deployed 1ef5b049d2 (l10n updates: ps) 2426469 wikitext text/x-wiki oues3nq8jojis2nfjatdgo23quouerf Test Kitchen 0 447310 2426275 2425696 2026-06-11T13:43:23Z Phuedx (WMF) 47850 /* Test Kitchen maintainer documentation */ 2426275 wikitext text/x-wiki piodzni717z97j7mt7ynsbx304qxypp 2426285 2426275 2026-06-11T13:47:10Z Phuedx (WMF) 47850 /* Test Kitchen maintainer documentation */ 2426285 wikitext text/x-wiki 54gz1b1pvm89v64p3nphjisyomdvo0d 2426302 2426285 2026-06-11T14:00:16Z Phuedx (WMF) 47850 /* Test Kitchen maintainer documentation */ 2426302 wikitext text/x-wiki gelt169vdfx0z813ugfx66q3k014o8e Map of database maintenance 0 449160 2426501 2425978 2026-06-12T00:01:55Z Dexbot 30554 Bot: Updating the report 2426501 wikitext text/x-wiki 0zihcka6j6xnkngpcyyud91njijkd0l Help:Managed Kubernetes 12 452086 2426456 2377514 2026-06-11T18:19:05Z AndrewBogott (WMF) 51047 /* Notes */ 2426456 wikitext text/x-wiki jizy9lblqt0n1jft06gcebc2mo7nk0w 2426458 2426456 2026-06-11T18:38:03Z AndrewBogott (WMF) 51047 /* Create a template */ 2426458 wikitext text/x-wiki nis541as6sh5io55iw9gxi0pcevvohu 2426459 2426458 2026-06-11T18:38:25Z AndrewBogott (WMF) 51047 /* Example Templates, Cluster-api driver */ 2426459 wikitext text/x-wiki o9dbs3wif8my2eujch6xifa0tpsr9im 2426460 2426459 2026-06-11T18:39:38Z AndrewBogott (WMF) 51047 /* Template options */ 2426460 wikitext text/x-wiki 5zsoufmff8w30b9y3ywb6wezafpf08b 2426461 2426460 2026-06-11T18:39:47Z AndrewBogott (WMF) 51047 /* Example Templates, Heat driver */ 2426461 wikitext text/x-wiki tlb74vpicmexo3u1n5dvqccp862pg6t 2426463 2426461 2026-06-11T18:56:22Z AndrewBogott (WMF) 51047 2426463 wikitext text/x-wiki 4twvprv6hfqlt3d85r4akhe299f7zl0 2426464 2426463 2026-06-11T18:56:55Z AndrewBogott (WMF) 51047 /* Example Templates, Cluster-api driver */ 2426464 wikitext text/x-wiki a2fki88q3828zhtxz8u1kox7b52vywh 2426465 2426464 2026-06-11T18:57:37Z AndrewBogott (WMF) 51047 /* Hints and tips for the cluster-api driver */ 2426465 wikitext text/x-wiki da5n2ifxpxwgw0v7461se691rk2w3eu Nova Resource:Tools.cluebotng-review/SAL 498 452890 2426267 2425671 2026-06-11T13:35:02Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/27350281127 (https://github.com/cluebotng/component-configs/commits/41e666d399f22121043fa8132a3e8bf6368e5181) 2426267 wikitext text/x-wiki du4ac89ih3w6iaujxnirludf7zzogkr Talk:ORES 1 453368 2426397 2161085 2026-06-11T16:21:36Z APaskulin (WMF) 14880 Update link to Lift Wing API docs 2426397 wikitext text/x-wiki pbtowqk0tyb5728kwf4y6am7alkkfzg Test Kitchen/Deploy client libraries 0 453763 2426284 2373002 2026-06-11T13:46:43Z Phuedx (WMF) 47850 Mark the page as deprecated 2426284 wikitext text/x-wiki guqmyhnff86kmnunpk8osh7d152khah Test Kitchen/Archive/Validate events 0 453771 2426298 2401079 2026-06-11T13:58:43Z Phuedx (WMF) 47850 Phuedx (WMF) moved page [[Test Kitchen/Validate events]] to [[Test Kitchen/Archive/Validate events]]: This page is superseded by https://wikitech.wikimedia.org/wiki/Test_Kitchen/Local_development_setup 2401079 wikitext text/x-wiki hnkholc3yyrbkm1uifqjjdo4ooo04n6 2426301 2426298 2026-06-11T14:00:01Z Phuedx (WMF) 47850 2426301 wikitext text/x-wiki mln1ke4o3fn7wef0sjrtrd7qx2h96zc Test Kitchen/Maintainer introduction 0 454026 2426304 2426153 2026-06-11T14:01:26Z Phuedx (WMF) 47850 Remove Setup as it's duplicated in https://wikitech.wikimedia.org/wiki/Test_Kitchen/Local_development_setup 2426304 wikitext text/x-wiki cwrkcyj5pbono3hoiik9sf68o183r7m Test Kitchen/Local development setup 0 454129 2426292 2401829 2026-06-11T13:52:20Z Phuedx (WMF) 47850 /* Writing the first instrument */ 2426292 wikitext text/x-wiki conda7bajpc4zb0xbt2gabe0g83xrhb Test Kitchen/Archive/Custom data monitor 0 454585 2426274 2377224 2026-06-11T13:43:10Z Phuedx (WMF) 47850 Mark the tool as deprecated. 2426274 wikitext text/x-wiki hncks7ctl8wqjyl0j9kejwgt1aa468d 2426328 2426274 2026-06-11T15:01:36Z Phuedx (WMF) 47850 Phuedx (WMF) moved page [[Test Kitchen/Custom Data Monitor]] to [[Test Kitchen/Archive/Custom data monitor]]: Archiving 2426274 wikitext text/x-wiki hncks7ctl8wqjyl0j9kejwgt1aa468d API Portal/Deprecation 0 459695 2426410 2423961 2026-06-11T16:37:33Z APaskulin (WMF) 14880 Update links to Lift Wing API docs 2426410 wikitext text/x-wiki ktsstof5ksd5doyle6ev0t9sg1go1yi 2426447 2426410 2026-06-11T17:44:41Z APaskulin (WMF) 14880 /* Timeline */ Add shut down timeline 2426447 wikitext text/x-wiki d1uls3sdcgo1xpoyvugrm1w921zx9k7 Fundraising/SAL 0 459699 2426462 2425975 2026-06-11T18:56:04Z Stashbot 7414 jgleeson: payments-wiki upgraded from aef3d25d to 1f5f40f9 2426462 wikitext text/x-wiki 1aqvnq9yzz9yqdx3fe4yg1u3thvleir 2426507 2426462 2026-06-12T03:42:40Z Stashbot 7414 eileen: civicrm upgraded from 0b8db587 to 69a60dcb 2426507 wikitext text/x-wiki 0krvyah7qmj1enaxo96ybh2yy6l2ebe Machine Learning/LiftWing/API/Internal usage 0 459991 2426395 2395294 2026-06-11T16:16:39Z APaskulin (WMF) 14880 Link to new reference docs location 2426395 wikitext text/x-wiki dc4n80rlkt3x47jvo2pgy963nt4jjdx Machine Learning/LiftWing/API/External usage 0 459992 2426393 2397609 2026-06-11T16:13:17Z APaskulin (WMF) 14880 Link to new location for reference docs 2426393 wikitext text/x-wiki c8eia3p5unrahfr50n0h65zql0ml24i Machine Learning/LiftWing/API 0 459994 2426391 2395300 2026-06-11T16:08:17Z APaskulin (WMF) 14880 Link to new reference docs location; update link text for various links 2426391 wikitext text/x-wiki r40s4zkqv6y6u8ytxppkltaaule19hi Data Platform/Systems/OpenSearch-on-K8s/TTMServer 0 460318 2426350 2426068 2026-06-11T15:33:18Z Atsuko-WMF 54082 /* Dashboards */ istio + links formatting 2426350 wikitext text/x-wiki 94zcdoxoebs03pdvltqi86u14j1f22v Test Kitchen/Validate events 0 460325 2426299 2026-06-11T13:58:43Z Phuedx (WMF) 47850 Phuedx (WMF) moved page [[Test Kitchen/Validate events]] to [[Test Kitchen/Archive/Validate events]]: This page is superseded by https://wikitech.wikimedia.org/wiki/Test_Kitchen/Local_development_setup 2426299 wikitext text/x-wiki 4hosxb46jftsx3a2kb1u09vp2vuy65p Test Kitchen/Custom Data Monitor 0 460326 2426329 2026-06-11T15:01:36Z Phuedx (WMF) 47850 Phuedx (WMF) moved page [[Test Kitchen/Custom Data Monitor]] to [[Test Kitchen/Archive/Custom data monitor]]: Archiving 2426329 wikitext text/x-wiki t6rclzhvl7qo5dgs48pcv6vmpx9y6is User talk:Ordiopside 3 460327 2426449 2026-06-11T17:46:57Z StrikerBot 8475 Welcome to Toolforge! 2426449 wikitext text/x-wiki fxilu7yyq821c50lg5e8irzq7ipx3be