Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.20 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 1380 2459003 2453278 2026-09-21T15:12:24Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.openstack.quota_increase by 400 gigabytes (T438516) 2459003 wikitext text/x-wiki 6c0jq9syvj0bctm444u3vm518pyoov2 2459004 2459003 2026-09-21T15:12:31Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0) by 400 gigabytes (T438516) 2459004 wikitext text/x-wiki pxc1us8h788qjsbyublysm9tgvllqku 498 3086 2459179 2458872 2026-09-22T07:36:10Z Stashbot 7414 tlepage@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-api 2459179 wikitext text/x-wiki j79p3a177rkmyu87ljr7t8tivqkjk5u 2459180 2459179 2026-09-22T07:45:13Z Stashbot 7414 godog: hard reboot tools-k8s-worker-nfs-70 - ran out of memory 2459180 wikitext text/x-wiki ca1o93f1uafrla8fuhoej2rdr1nyzhj 2459181 2459180 2026-09-22T07:48:19Z Stashbot 7414 tlepage@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-api 2459181 wikitext text/x-wiki j0cg7anci7waredwm6my2py6rinrotm 2459183 2459181 2026-09-22T07:51:55Z Stashbot 7414 godog: correction that's tools-k8s-worker-nfs-74 2459183 wikitext text/x-wiki 74qqy7e6vh92ao1tsu3vjkjiexsbs13 2459292 2459183 2026-09-22T10:48:44Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.refresh_puppet_certs on tools--k8s-backup-1.tools.eqiad1.wikimedia.cloud 2459292 wikitext text/x-wiki jzjmzm3deagf5jjj7w7jfn3sooi4tpu 2459293 2459292 2026-09-22T10:48:46Z Stashbot 7414 taavi@cloudcumin1001: END (FAIL) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=99) on tools--k8s-backup-1.tools.eqiad1.wikimedia.cloud 2459293 wikitext text/x-wiki 9821nn98kepmgvd4ixv01mt4wguisy3 2459294 2459293 2026-09-22T10:48:47Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.refresh_puppet_certs on tools-k8s-backup-1.tools.eqiad1.wikimedia.cloud 2459294 wikitext text/x-wiki tlf061fz9d4gx8askk7kw1m9fb630lx 2459295 2459294 2026-09-22T10:50:08Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=0) on tools-k8s-backup-1.tools.eqiad1.wikimedia.cloud 2459295 wikitext text/x-wiki sbpnzcpxk1g0g3qd3nddcq92rio7fmv 0 4108 2458960 2458795 2026-09-21T13:42:48Z SLyngshede-WMF 31501 /* Tuesday, September 22 */ Update to reflect DC switchover task. Cancell UTC afternoon backport deployment 2458960 wikitext text/x-wiki 780e1vtrhrao3nws1e891f1fgo2az3n 2458967 2458960 2026-09-21T13:46:36Z SLyngshede-WMF 31501 /* Tuesday, September 22 */ Remove test-kitchen deployments as to not conflict with DC switchover 2458967 wikitext text/x-wiki 0eiyexb9du6yahbe2806hl5ssz6j5wp 2458972 2458967 2026-09-21T13:59:44Z SLyngshede-WMF 31501 /* Wednesday, September 23 */ Moving DC switchover change into the auto-generated week to avoid confusion. 2458972 wikitext text/x-wiki 1srsx6qez3nqn1f6w90o6lg91q37mqn 2458973 2458972 2026-09-21T14:00:14Z SLyngshede-WMF 31501 /* Week of September 21 */ Remove redundant week entry 2458973 wikitext text/x-wiki iqxsh5m0671kkbsa0fhevhq5ld6dvzq 2458977 2458973 2026-09-21T14:07:55Z ScheduleDeploymentBot 37566 Add [[gerrit:1343347]] to Tuesday, September 22 UTC morning backport window 2458977 wikitext text/x-wiki 5rey937ltnoatj0i1bi5el1hi8bbl5k 2459080 2458977 2026-09-21T18:52:54Z ScheduleDeploymentBot 37566 Add [[gerrit:1342285]] to Monday, September 21 UTC late backport window 2459080 wikitext text/x-wiki h5auq697a405obpud6g388z5ydte6d0 2459139 2459080 2026-09-22T01:20:21Z ScheduleDeploymentBot 37566 Add [[gerrit:1342825]] to Tuesday, September 22 UTC late backport window 2459139 wikitext text/x-wiki 3mf7yrpqxizb6tffs9buwjw8eg383jy 2459142 2459139 2026-09-22T02:38:28Z ScheduleDeploymentBot 37566 Add [[gerrit:1313951]] to Tuesday, September 22 UTC morning backport window 2459142 wikitext text/x-wiki a7mq21vu9m1kihi0p755w7eonsrcyby 2459182 2459142 2026-09-22T07:51:39Z SLyngshede-WMF 31501 /* Thursday, September 24 */ Schedule deployment server switchover to codfw 2459182 wikitext text/x-wiki 6bgztyi6ghuikfk6nghxqi15ks4g9bv 498 6726 2458992 2458856 2026-09-21T14:54:32Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.refresh_puppet_certs on toolsbeta-test-k8s-backup-1.toolsbeta.eqiad1.wikimedia.cloud 2458992 wikitext text/x-wiki bh8whuw60y40kq4bt6n5pp31cnreaf1 2458993 2458992 2026-09-21T14:55:51Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=0) on toolsbeta-test-k8s-backup-1.toolsbeta.eqiad1.wikimedia.cloud 2458993 wikitext text/x-wiki 88p6xxaexp5n3249oo7w6eyuhel1oby 2459169 2458993 2026-09-22T07:15:36Z Stashbot 7414 tlepage@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-api 2459169 wikitext text/x-wiki 3fzu5g5vloboqq2y570j6spalu67mx6 2459172 2459169 2026-09-22T07:22:06Z Stashbot 7414 tlepage@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component logs-api 2459172 wikitext text/x-wiki 25ecvxfte1qt0iwg5zor7k9ctltiaot 2459175 2459172 2026-09-22T07:24:02Z Stashbot 7414 tlepage@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-api 2459175 wikitext text/x-wiki a2bzbakhcudayaa14ai6jdwzc9yyv80 2459178 2459175 2026-09-22T07:35:15Z Stashbot 7414 tlepage@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-api 2459178 wikitext text/x-wiki 9dw108h1b5dxz2dbfxm1hwxxeb8hm2l 0 7919 2458918 2458917 2026-09-21T12:05:25Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dse-k8s-worker2005.codfw.wmnet 2458918 wikitext text/x-wiki t4a10a3bxconrrebjfs1eddjgznp971 2458921 2458918 2026-09-21T12:23:07Z Stashbot 7414 jelto@cumin1004: START - Cookbook sre.loadbalancer.migrate-service-ipip for alias: wikikube-worker-codfw@codfw 2458921 wikitext text/x-wiki kxaflmrsz5rx6s41imvbepkq6pse2ny 2458924 2458921 2026-09-21T12:27:28Z Stashbot 7414 jelto@cumin1004: START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on (A:lvs-low-traffic-codfw or A:lvs-secondary-codfw) and A:bullseye and A:lvs 2458924 wikitext text/x-wiki f176pgg2gk516w5dyjst5qxic8atkq5 2458925 2458924 2026-09-21T12:28:27Z Stashbot 7414 jelto@cumin1004: END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on (A:lvs-low-traffic-codfw or A:lvs-secondary-codfw) and A:bullseye and A:lvs 2458925 wikitext text/x-wiki cbrjmtezt7e6aw1lm76q8dg2jgpq6i7 2458926 2458925 2026-09-21T12:28:28Z Stashbot 7414 jelto@cumin1004: END (PASS) - Cookbook sre.loadbalancer.migrate-service-ipip (exit_code=0) for alias: wikikube-worker-codfw@codfw 2458926 wikitext text/x-wiki a1n8jszf41qjedabel0zak6zgjb93hr 2458927 2458926 2026-09-21T12:29:41Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply 2458927 wikitext text/x-wiki cl4scm7kzqmmrguu5etns0qdhx2zoi6 2458928 2458927 2026-09-21T12:30:51Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs-next: apply 2458928 wikitext text/x-wiki 4rmmch1rzfy4k9uqj3wvdueaciymxhl 2458929 2458928 2026-09-21T12:36:02Z Stashbot 7414 XioNoX: delete BGP sessions to 15305 in Equinix Ashburn (peer leaving the IX) 2458929 wikitext text/x-wiki alogtmjflbistr06ydw666dg064do6y 2458931 2458929 2026-09-21T12:48:01Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2458931 wikitext text/x-wiki h7k0u5d9z6jk7r7t5g673dufzph8g5c 2458932 2458931 2026-09-21T12:48:11Z Stashbot 7414 jelto@cumin1004: START - Cookbook sre.loadbalancer.migrate-service-ipip for alias: wikikube-worker-eqiad@eqiad 2458932 wikitext text/x-wiki 4deytcpm7u9lho808xbbwz07j4iowi9 2458933 2458932 2026-09-21T12:48:31Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2458933 wikitext text/x-wiki 6t6wivz9iyqbv6dbkr494qippxbe69i 2458934 2458933 2026-09-21T12:51:20Z Stashbot 7414 jelto@cumin1004: START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on (A:lvs-low-traffic-eqiad or A:lvs-secondary-eqiad) and A:bullseye and A:lvs 2458934 wikitext text/x-wiki of5fukq3twe476w3g041o46bbrtapn8 2458935 2458934 2026-09-21T12:53:46Z Stashbot 7414 jelto@cumin1004: END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on (A:lvs-low-traffic-eqiad or A:lvs-secondary-eqiad) and A:bullseye and A:lvs 2458935 wikitext text/x-wiki iql1djfx556dfvj6ypz7mrnemb8d6j9 2458936 2458935 2026-09-21T12:53:47Z Stashbot 7414 jelto@cumin1004: END (PASS) - Cookbook sre.loadbalancer.migrate-service-ipip (exit_code=0) for alias: wikikube-worker-eqiad@eqiad 2458936 wikitext text/x-wiki 6uv6gvrfmkrl63hcuoj1apj456mchxu 2458937 2458936 2026-09-21T12:54:21Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs-next: apply 2458937 wikitext text/x-wiki c06yu08ynv4rdf54x8umd1r86gyfsb7 2458938 2458937 2026-09-21T12:54:43Z Stashbot 7414 jclark@cumin1004: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ml-serve1016.eqiad.wmnet with OS trixie 2458938 wikitext text/x-wiki 6va0q6baisxm1h47f86hcmmvu2o5fsd 2458939 2458938 2026-09-21T12:54:54Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs-next: apply 2458939 wikitext text/x-wiki h61zzdpjqlqw2ax63zle6kyykdn9cb1 2458940 2458939 2026-09-21T12:57:50Z Stashbot 7414 brouberol@cumin1003: START - Cookbook sre.ganeti.reboot-vm for VM archiva1002.wikimedia.org 2458940 wikitext text/x-wiki op62c1jl145eidb01c9ehebxoaleq1e 2458941 2458940 2026-09-21T12:59:18Z Stashbot 7414 filippo@cumin1004: START - Cookbook sre.hosts.reboot-single for host cloudvirt1063.eqiad.wmnet 2458941 wikitext text/x-wiki g3k1uoppa1obktqaz0m4xay89c4vxin 2458942 2458941 2026-09-21T13:01:50Z Stashbot 7414 brouberol@cumin1003: END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM archiva1002.wikimedia.org 2458942 wikitext text/x-wiki ct9og37zj67kay83n4iuq43f1hsih8d 2458943 2458942 2026-09-21T13:07:44Z Stashbot 7414 mfossati@deploy1003: Started scap sync-world: Backport for [[gerrit:1343122|Let AA measure eligible readers w/o beta opt-in (T437076)]] 2458943 wikitext text/x-wiki esbpsr5q67lzad5a0w4egaaptvrn4zs 2458944 2458943 2026-09-21T13:10:45Z Stashbot 7414 filippo@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudvirt1063.eqiad.wmnet 2458944 wikitext text/x-wiki 1a97i9g6101dqav8t8k2ezzbcw90m3z 2458946 2458944 2026-09-21T13:14:10Z Stashbot 7414 mfossati@deploy1003: mfossati: Backport for [[gerrit:1343122|Let AA measure eligible readers w/o beta opt-in (T437076)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2458946 wikitext text/x-wiki 1tzwt2oiki08lfng14zh516xg7ao8j6 2458947 2458946 2026-09-21T13:15:14Z Stashbot 7414 mfossati@deploy1003: mfossati: Continuing with deployment 2458947 wikitext text/x-wiki d0edhcupvf1w64b6zyve5ycazyokjyz 2458949 2458947 2026-09-21T13:22:03Z Stashbot 7414 mfossati@deploy1003: Finished scap sync-world: Backport for [[gerrit:1343122|Let AA measure eligible readers w/o beta opt-in (T437076)]] (duration: 14m 19s) 2458949 wikitext text/x-wiki 01084kladsmlvqvy3r70ef0s4uh5hwh 2458950 2458949 2026-09-21T13:29:02Z Stashbot 7414 samtar@deploy1003: Started scap sync-world: Backport for [[gerrit:1343319|arywiki: Create patroller and autopatrolled user groups (T438421)]] 2458950 wikitext text/x-wiki g8k9m7pw4ps35e0nnv388ei4v70ogfu 2458951 2458950 2026-09-21T13:33:16Z Stashbot 7414 samtar@deploy1003: samtar, tryvix1509: Backport for [[gerrit:1343319|arywiki: Create patroller and autopatrolled user groups (T438421)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2458951 wikitext text/x-wiki d4whte5kpwu9ckzfphgeysnvj4c5454 2458952 2458951 2026-09-21T13:33:36Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs-next: apply 2458952 wikitext text/x-wiki 2b1895e4aq73yq5cz50t2jf05bmve5g 2458953 2458952 2026-09-21T13:36:07Z Stashbot 7414 samtar@deploy1003: samtar, tryvix1509: Continuing with deployment 2458953 wikitext text/x-wiki 8vjsi4v0wvx7er6nl3fk0az0u7yk9h4 2458954 2458953 2026-09-21T13:40:42Z Stashbot 7414 samtar@deploy1003: Finished scap sync-world: Backport for [[gerrit:1343319|arywiki: Create patroller and autopatrolled user groups (T438421)]] (duration: 11m 40s) 2458954 wikitext text/x-wiki nqm53bwu2v3tv9ednjylu1ut4qenros 2458956 2458954 2026-09-21T13:41:30Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.dns.netbox 2458956 wikitext text/x-wiki capa9kdf7d8mdjania2a9zrxxmufzjn 2458957 2458956 2026-09-21T13:41:32Z Stashbot 7414 javiermonton@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/webrequest-pageview: apply 2458957 wikitext text/x-wiki amuoskuazq750d33lxvbzw37gpieuag 2458958 2458957 2026-09-21T13:41:39Z Stashbot 7414 javiermonton@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/webrequest-pageview: apply 2458958 wikitext text/x-wiki io6qi6jhdatgrk13s6gvu80nvl93c9r 2458961 2458958 2026-09-21T13:43:04Z Stashbot 7414 dreamyjazz@deploy1003: Started scap sync-world: Backport for [[gerrit:1337580|nlwiki: enable SecurePoll local elections (T434045)]] 2458961 wikitext text/x-wiki il31yyyat90mqlju8hed2ec9o7cm5et 2458962 2458961 2026-09-21T13:43:29Z Stashbot 7414 zabe: reconcile wbc_entity_usage from local cluster to x1 for mediawikiwiki # T438716 2458962 wikitext text/x-wiki asm8wt8ro9nek8jkmaehh180lbckee5 2458963 2458962 2026-09-21T13:45:30Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add entries for new eqiad links - cmooney@cumin1004" 2458963 wikitext text/x-wiki 8o7upbn30pxjd012zypz910odvjx3ud 2458964 2458963 2026-09-21T13:45:33Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add entries for new eqiad links - cmooney@cumin1004" 2458964 wikitext text/x-wiki jw2znrfd48qhbpbf2j0ruxwuflrjawx 2458965 2458964 2026-09-21T13:45:34Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2458965 wikitext text/x-wiki dr1yqrk9on5t9wk72e82tk2txc9iumw 2458968 2458965 2026-09-21T13:47:37Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz, novemlinguae: Backport for [[gerrit:1337580|nlwiki: enable SecurePoll local elections (T434045)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2458968 wikitext text/x-wiki nmx9gysjtv3aicn88b7srp3hym03h0f 2458969 2458968 2026-09-21T13:51:05Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz, novemlinguae: Continuing with deployment 2458969 wikitext text/x-wiki 78ovio819csn2349nmbr1rx0pam9d64 2458970 2458969 2026-09-21T13:55:35Z Stashbot 7414 dreamyjazz@deploy1003: Finished scap sync-world: Backport for [[gerrit:1337580|nlwiki: enable SecurePoll local elections (T434045)]] (duration: 12m 30s) 2458970 wikitext text/x-wiki otamzuiw9u45j773shfnb6egftmlvvr 2458974 2458970 2026-09-21T14:01:12Z Stashbot 7414 zabe@deploy1003: Started scap sync-world: Backport for [[gerrit:1343542|Move wbc_entity_usage to x1 for mediawikiwiki (T438716)]], [[gerrit:1343556|Set db explicitly to false for virtual-wikibase-entityusage]] 2458974 wikitext text/x-wiki hffu2l0m1qq4i9e0d337al277zhuytz 2458975 2458974 2026-09-21T14:05:10Z Stashbot 7414 zabe@deploy1003: Started scap sync-world: Backport for [[gerrit:1343542|Move wbc_entity_usage to x1 for mediawikiwiki (T438716)]], [[gerrit:1343556|Set db explicitly to false for virtual-wikibase-entityusage]] 2458975 wikitext text/x-wiki 4l1e8921qgro6ch8yqnous446cmg6bm 2458976 2458975 2026-09-21T14:07:24Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hosts.reimage for host ncredir3006.esams.wmnet with OS trixie 2458976 wikitext text/x-wiki hlfd7c52fmwaqypy31v5nqbw48yav03 2458978 2458976 2026-09-21T14:08:21Z Stashbot 7414 zabe@deploy1003: zabe: Backport for [[gerrit:1343542|Move wbc_entity_usage to x1 for mediawikiwiki (T438716)]], [[gerrit:1343556|Set db explicitly to false for virtual-wikibase-entityusage]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2458978 wikitext text/x-wiki qziadbdpk6bsbdgbrm2bska5ymfy0r9 2458979 2458978 2026-09-21T14:08:55Z Stashbot 7414 zabe@deploy1003: zabe: Continuing with deployment 2458979 wikitext text/x-wiki 0o1ruk7vur8v080fbdvh6hs81zp4mmi 2458980 2458979 2026-09-21T14:13:19Z Stashbot 7414 zabe@deploy1003: Finished scap sync-world: Backport for [[gerrit:1343542|Move wbc_entity_usage to x1 for mediawikiwiki (T438716)]], [[gerrit:1343556|Set db explicitly to false for virtual-wikibase-entityusage]] (duration: 08m 09s) 2458980 wikitext text/x-wiki mm4gq9dms12u0e230sthreb9msrgcj0 2458981 2458980 2026-09-21T14:20:50Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.provision for host ml-serve1016.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2458981 wikitext text/x-wiki hcfll44alusl9ige7eyj5bzqvs2p41k 2458983 2458981 2026-09-21T14:26:13Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ml-serve1016.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2458983 wikitext text/x-wiki bv9u7l1vjp92413bc7h6ycv2wzv1gu6 2458985 2458983 2026-09-21T14:34:16Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on ncredir3006.esams.wmnet with reason: host reimage 2458985 wikitext text/x-wiki gkntgekl9u34juo8b4xm4b2e3549ulk 2458987 2458985 2026-09-21T14:36:18Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.reimage for host ml-serve1016.eqiad.wmnet with OS trixie 2458987 wikitext text/x-wiki spqnpee168k6k35xy2na77h3q2qzycl 2458988 2458987 2026-09-21T14:39:42Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ncredir3006.esams.wmnet with reason: host reimage 2458988 wikitext text/x-wiki 12jymyg3vgs6l7knsh1sr2vixv5jjxw 2458990 2458988 2026-09-21T14:47:10Z Stashbot 7414 elukey@cumin1004: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host ml-serve1016.eqiad.wmnet with OS trixie 2458990 wikitext text/x-wiki nblbshyd2ltgdiwctlwe94opmbr2urw 2458996 2458990 2026-09-21T15:01:37Z Stashbot 7414 slyngshede@deploy1003: helmfile [codfw] START helmfile.d/services/mw-api-ext: apply 2458996 wikitext text/x-wiki qzi2ihhcsul3trowja8iulthqh04hz5 2458997 2458996 2026-09-21T15:01:56Z Stashbot 7414 slyngshede@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-api-ext: apply 2458997 wikitext text/x-wiki 54v4ptr1qkkbvhal7ginriq3t80nbae 2458998 2458997 2026-09-21T15:03:50Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ncredir3006.esams.wmnet with OS trixie 2458998 wikitext text/x-wiki 9qjx55t40pkzlivohqj3o4omsdzmfub 2458999 2458998 2026-09-21T15:07:13Z Stashbot 7414 slyngshede@deploy1003: helmfile [codfw] START helmfile.d/services/mw-web: apply 2458999 wikitext text/x-wiki p7gi7tc4k97qt7cqsm5y05xp1rc3ylh 2459000 2458999 2026-09-21T15:07:43Z Stashbot 7414 slyngshede@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-web: apply 2459000 wikitext text/x-wiki 0kkqwg7hfebbzjhw4srov1ej3gfm3ui 2459002 2459000 2026-09-21T15:11:08Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2459002 wikitext text/x-wiki 64dj71omk8hypkln6wbfl3n1i51rmad 2459005 2459002 2026-09-21T15:16:31Z Stashbot 7414 cdobbins@cumin1004: conftool action : set/pooled=yes; selector: name=ncredir3006.* 2459005 wikitext text/x-wiki i6lq0m3qwelhxxab3qwp79tsfwxzdhb 2459006 2459005 2026-09-21T15:18:32Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.reimage for host registry2004.codfw.wmnet with OS trixie 2459006 wikitext text/x-wiki jticcm6you1xifyf8cq8vam22fap3yw 2459007 2459006 2026-09-21T15:19:29Z Stashbot 7414 elukey@puppetserver1001: conftool action : set/pooled=false; selector: name=registry2004.* 2459007 wikitext text/x-wiki do4zsr5e0khpflh6yde3js29sxik2hl 2459008 2459007 2026-09-21T15:32:21Z Stashbot 7414 jdlrobson@deploy1003: Started scap sync-world: Backport for [[gerrit:1343579|Fixes: '.action_context' should be string (T437122)]] 2459008 wikitext text/x-wiki 2xftwj9ub07wgkm2nxrlygak9gzjc17 2459009 2459008 2026-09-21T15:32:50Z Stashbot 7414 slyngshede@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-api-ext: apply 2459009 wikitext text/x-wiki 7lwajqiiy3a085bugnv9168z30grno6 2459010 2459009 2026-09-21T15:33:03Z Stashbot 7414 slyngshede@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-api-ext: apply 2459010 wikitext text/x-wiki 5vpyyphd4t4xgwbazh9gn59usxcn3bw 2459011 2459010 2026-09-21T15:36:26Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Backport for [[gerrit:1343579|Fixes: '.action_context' should be string (T437122)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2459011 wikitext text/x-wiki bi6r9jcydfl4sbopf5adb3mr8gd9uuz 2459012 2459011 2026-09-21T15:38:09Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on registry2004.codfw.wmnet with reason: host reimage 2459012 wikitext text/x-wiki 5n3urblpxhc5vv54yqlobivkp5r9hdv 2459013 2459012 2026-09-21T15:39:34Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hosts.reimage for host ncredir6002.drmrs.wmnet with OS trixie 2459013 wikitext text/x-wiki gxuro87z0x27hsb7j7yo4iiffnxv4im 2459014 2459013 2026-09-21T15:40:00Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Continuing with deployment 2459014 wikitext text/x-wiki eleehofje0i2w5wfukvtnocp8qe47rg 2459017 2459014 2026-09-21T15:42:46Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on registry2004.codfw.wmnet with reason: host reimage 2459017 wikitext text/x-wiki 3j9fn2r76ck0t320bc1fp54mfmh0h66 2459018 2459017 2026-09-21T15:45:01Z Stashbot 7414 jdlrobson@deploy1003: Finished scap sync-world: Backport for [[gerrit:1343579|Fixes: '.action_context' should be string (T437122)]] (duration: 12m 40s) 2459018 wikitext text/x-wiki 9hy5z1pp1x84agjln2whjpffb7egg3z 2459019 2459018 2026-09-21T15:49:17Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2459019 wikitext text/x-wiki dy9zllufeu1c5cxtvt3k2zvytvdbe0r 2459021 2459019 2026-09-21T15:54:52Z Stashbot 7414 cklimas@deploy1003: helmfile [staging] START helmfile.d/services/wikifeeds: apply 2459021 wikitext text/x-wiki pb4a7dqmfjovya5s8njiw5lhtaa7yts 2459022 2459021 2026-09-21T15:55:10Z Stashbot 7414 cklimas@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifeeds: apply 2459022 wikitext text/x-wiki 4322vtlo8pqfwq5y12yzxiyoc2q5yr7 2459025 2459022 2026-09-21T16:00:05Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host registry2004.codfw.wmnet with OS trixie 2459025 wikitext text/x-wiki 1favusaba0e6s4s9dv4bkr0wbua6rvm 2459026 2459025 2026-09-21T16:00:06Z Stashbot 7414 cklimas@deploy1003: helmfile [eqiad] START helmfile.d/services/wikifeeds: apply 2459026 wikitext text/x-wiki jpauqepeuux4pi43yqjzwdowi03kx0c 2459027 2459026 2026-09-21T16:00:38Z Stashbot 7414 cklimas@deploy1003: helmfile [eqiad] DONE helmfile.d/services/wikifeeds: apply 2459027 wikitext text/x-wiki c9pf19pvh32lkorp6c1i6yuylmf72bp 2459028 2459027 2026-09-21T16:00:54Z Stashbot 7414 cklimas@deploy1003: helmfile [codfw] START helmfile.d/services/wikifeeds: apply 2459028 wikitext text/x-wiki tpe8cy93l9lxwtmgwpe4iplv2e5lgts 2459029 2459028 2026-09-21T16:01:24Z Stashbot 7414 cklimas@deploy1003: helmfile [codfw] DONE helmfile.d/services/wikifeeds: apply 2459029 wikitext text/x-wiki oaatnhe5x0k4ohv3hj58fdh46f2rkgp 2459030 2459029 2026-09-21T16:09:16Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on ncredir6002.drmrs.wmnet with reason: host reimage 2459030 wikitext text/x-wiki de0cbinvcgawo1eq3nkrbx7oh8u7sxo 2459031 2459030 2026-09-21T16:10:49Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.dns.netbox 2459031 wikitext text/x-wiki nvv6hneoc2hezvaixhfz1v4ce4rg5b1 2459032 2459031 2026-09-21T16:13:20Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ncredir6002.drmrs.wmnet with reason: host reimage 2459032 wikitext text/x-wiki p0lt385af273wdtauuwuvrqb7526ehp 2459033 2459032 2026-09-21T16:15:56Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add entries for new eqiad links - cmooney@cumin1004" 2459033 wikitext text/x-wiki s7ysfzn3uwbv9pengymoe6m1rrs7gme 2459034 2459033 2026-09-21T16:15:59Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add entries for new eqiad links - cmooney@cumin1004" 2459034 wikitext text/x-wiki kpfqdo0ncab5jkgrxr2s51qno39rztl 2459035 2459034 2026-09-21T16:16:00Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2459035 wikitext text/x-wiki 1k53yfpq264ide3titf5pllonqk0q15 2459038 2459035 2026-09-21T16:22:10Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.hosts.provision for host sessionstore1005.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2459038 wikitext text/x-wiki mfwnhi7uttaq1zewtxpf6ngmdb6yenm 2459039 2459038 2026-09-21T16:23:37Z Stashbot 7414 jclark@cumin1004: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sessionstore1005.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2459039 wikitext text/x-wiki i6l76wm864xu1f48e6gsxyrvdqw88b9 2459041 2459039 2026-09-21T16:27:06Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.hosts.provision for host sessionstore1005.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2459041 wikitext text/x-wiki n61ulk3qel840wi5iw4ph2rii46z0wh 2459042 2459041 2026-09-21T16:27:30Z Stashbot 7414 jclark@cumin1004: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sessionstore1005.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2459042 wikitext text/x-wiki hqvrtserra8gili0zs0w6ia9z6nuzg9 2459043 2459042 2026-09-21T16:32:10Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.hosts.provision for host sessionstore1005.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2459043 wikitext text/x-wiki oylsboe7r8ox3pjhchhrl798gh8mzlw 2459044 2459043 2026-09-21T16:36:26Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ncredir6002.drmrs.wmnet with OS trixie 2459044 wikitext text/x-wiki dcakubyew4wauwmrmcop2dethnezb13 2459046 2459044 2026-09-21T16:44:08Z Stashbot 7414 tappof@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5 days, 0:00:00 on kafka-logging1003.eqiad.wmnet with reason: migrating to kafka-logging1006 2459046 wikitext text/x-wiki s97tsayv8tmpyo6s2q0dr1qw54n25jk 2459047 2459046 2026-09-21T16:44:15Z Stashbot 7414 jclark@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sessionstore1005.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2459047 wikitext text/x-wiki 833mewx55kbl5ifxqg0h6o823km8ghi 2459050 2459047 2026-09-21T16:46:42Z Stashbot 7414 cdobbins@cumin1004: conftool action : set/pooled=yes; selector: name=ncredir6002.* 2459050 wikitext text/x-wiki by7bgfkobws3u1mv9ltztj1k8qy15qd 2459056 2459050 2026-09-21T16:54:04Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hosts.reimage for host ncredir5003.eqsin.wmnet with OS trixie 2459056 wikitext text/x-wiki 5px5fwof06k6oj1wfoan5kr0pqy2igi 2459057 2459056 2026-09-21T16:56:48Z Stashbot 7414 ebernhardson@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-semantic-search-test: apply 2459057 wikitext text/x-wiki j3unoh8tafnoppd4g95urqzqs94crqx 2459058 2459057 2026-09-21T16:56:53Z Stashbot 7414 ebernhardson@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search-test: apply 2459058 wikitext text/x-wiki tltgrhqipwzsaa9vp0pmmhf79kzo30d 2459059 2459058 2026-09-21T17:00:13Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.hosts.reimage for host sessionstore1005.eqiad.wmnet with OS bookworm 2459059 wikitext text/x-wiki 0jqxxcy5fkuyqj9v3pgkesy3agb5h6a 2459060 2459059 2026-09-21T17:12:43Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.hosts.provision for host sessionstore1005.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2459060 wikitext text/x-wiki p2p7iq7ldwlzlw8yy0azmeu3646ynuw 2459061 2459060 2026-09-21T17:26:01Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on sessionstore1005.eqiad.wmnet with reason: host reimage 2459061 wikitext text/x-wiki k81ugt0u5w4vb2kga66glz6o2nco9n2 2459062 2459061 2026-09-21T17:29:55Z Stashbot 7414 jclark@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sessionstore1005.eqiad.wmnet with reason: host reimage 2459062 wikitext text/x-wiki kyjb6mmw6gnrnrojdomznybkjvsrv3s 2459063 2459062 2026-09-21T17:30:00Z Stashbot 7414 jclark@cumin1004: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sessionstore1005.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2459063 wikitext text/x-wiki kchgulj0f1lt09ffw4p3xe1jyp3o9ji 2459064 2459063 2026-09-21T17:40:03Z Stashbot 7414 jclark@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sessionstore1005.eqiad.wmnet with OS bookworm 2459064 wikitext text/x-wiki fhvxlojetrerxptmsusmu56x553g4zf 2459066 2459064 2026-09-21T17:50:40Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on ncredir5003.eqsin.wmnet with reason: host reimage 2459066 wikitext text/x-wiki 2x66dcdexcb2gbtiwxogtf4ezlmhaih 2459067 2459066 2026-09-21T17:54:23Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ncredir5003.eqsin.wmnet with reason: host reimage 2459067 wikitext text/x-wiki b1qqod6j9p0rkmthoe6uazb2dsu86g0 2459071 2459067 2026-09-21T18:24:29Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ncredir5003.eqsin.wmnet with OS trixie 2459071 wikitext text/x-wiki kz2t8r4h5bmjzowiqdgv1ibwtp8i1od 2459072 2459071 2026-09-21T18:25:43Z Stashbot 7414 ebernhardson@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-semantic-search-test: apply 2459072 wikitext text/x-wiki lc52xhyga3yabuic8enm6sgfxur0s5b 2459073 2459072 2026-09-21T18:25:47Z Stashbot 7414 ebernhardson@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search-test: apply 2459073 wikitext text/x-wiki cpueepjgjxtzu61g6hpmorl5enaivex 2459074 2459073 2026-09-21T18:27:23Z Stashbot 7414 mvernon@cumin1004: START - Cookbook sre.discovery.service-route check sessionstore: maintenance 2459074 wikitext text/x-wiki htmhtz7qzmrv1eehbihyi4fvpx9hv3a 2459075 2459074 2026-09-21T18:27:24Z Stashbot 7414 mvernon@cumin1004: END (PASS) - Cookbook sre.discovery.service-route (exit_code=0) check sessionstore: maintenance 2459075 wikitext text/x-wiki fp25nb0nbao8cq89hapn2817cco7n97 2459076 2459075 2026-09-21T18:30:16Z Stashbot 7414 mvernon@cumin1004: START - Cookbook sre.discovery.service-route pool sessionstore in eqiad: sessionstore1005 repaired 2459076 wikitext text/x-wiki 2cbdehfqryxal6u7h5kg0p62viuclf6 2459077 2459076 2026-09-21T18:30:39Z Stashbot 7414 Emperor: repool eqiad sessionstore T437915 2459077 wikitext text/x-wiki f37wztmo45a74u8n1ahhry1xo1141tk 2459078 2459077 2026-09-21T18:32:07Z Stashbot 7414 cdobbins@cumin1004: conftool action : set/pooled=yes; selector: name=ncredir5003.* 2459078 wikitext text/x-wiki holjh6k3a2lszac2khqbe4h3ecny4ht 2459079 2459078 2026-09-21T18:35:20Z Stashbot 7414 mvernon@cumin1004: END (PASS) - Cookbook sre.discovery.service-route (exit_code=0) pool sessionstore in eqiad: sessionstore1005 repaired 2459079 wikitext text/x-wiki eaqld4001d41x48qtjeoho9crbi7kq3 2459081 2459079 2026-09-21T18:59:24Z Stashbot 7414 ebernhardson@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-semantic-search-test: apply 2459081 wikitext text/x-wiki awhlzlq39l9cgk9ciluk4tthmvd3bdd 2459082 2459081 2026-09-21T18:59:28Z Stashbot 7414 ebernhardson@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search-test: apply 2459082 wikitext text/x-wiki 4jicu4gd6cg7ohz1fovv07ic6igognp 2459083 2459082 2026-09-21T19:02:03Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/test-kitchen-next: apply 2459083 wikitext text/x-wiki 1u15sc3j5nqwv90qctjcl192wzwot9a 2459084 2459083 2026-09-21T19:02:30Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/test-kitchen-next: apply 2459084 wikitext text/x-wiki 7u69xix6we6xyn6njin6jo4ltcylbx7 2459106 2459084 2026-09-21T20:19:38Z Stashbot 7414 cjming@deploy1003: Started scap sync-world: Backport for [[gerrit:1343100|Disable wgMFCustomSiteModules on German Wikipedia (T403380)]] 2459106 wikitext text/x-wiki 28wn7j91nd7qg77faldaq5mpx8h1p4n 2459110 2459106 2026-09-21T20:23:38Z Stashbot 7414 cjming@deploy1003: ameisenigel, cjming: Backport for [[gerrit:1343100|Disable wgMFCustomSiteModules on German Wikipedia (T403380)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2459110 wikitext text/x-wiki o0q36w1bfcudvhggln8ud9juf2dokiy 2459113 2459110 2026-09-21T20:25:26Z Stashbot 7414 ihurbain@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2459113 wikitext text/x-wiki 5lnp5nzs6r3a69v47300bez1e4vurmm 2459114 2459113 2026-09-21T20:25:56Z Stashbot 7414 ihurbain@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2459114 wikitext text/x-wiki fci839a6cfwofrb68b5y8m8h72fq74z 2459115 2459114 2026-09-21T20:25:57Z Stashbot 7414 ihurbain@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2459115 wikitext text/x-wiki 3vej1qlh7seprmpy51bokdasenwn4j5 2459116 2459115 2026-09-21T20:26:27Z Stashbot 7414 ihurbain@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2459116 wikitext text/x-wiki 37n4z12c36ihnhcdfmooj9j0yi9fsys 2459117 2459116 2026-09-21T20:30:38Z Stashbot 7414 cjming@deploy1003: ameisenigel, cjming: Continuing with deployment 2459117 wikitext text/x-wiki 4qyazjbaw3lsaik4rvjxirvh3l8n7rz 2459119 2459117 2026-09-21T20:35:34Z Stashbot 7414 cjming@deploy1003: Finished scap sync-world: Backport for [[gerrit:1343100|Disable wgMFCustomSiteModules on German Wikipedia (T403380)]] (duration: 15m 56s) 2459119 wikitext text/x-wiki t4lgfcg0uq2wvgrpohixlg7a1aa3w9f 2459126 2459119 2026-09-21T21:18:38Z Stashbot 7414 maryum: Deployed security fix for T437708 2459126 wikitext text/x-wiki cugvyixlnzgflhfvogf58yq28c250ly 2459127 2459126 2026-09-21T22:05:43Z Stashbot 7414 rzl@deploy1003: helmfile [staging-codfw] START helmfile.d/admin 'apply'. 2459127 wikitext text/x-wiki 1mivpzevf1kd50j9sl7fy09rkj2s3rd 2459128 2459127 2026-09-21T22:06:43Z Stashbot 7414 rzl@deploy1003: helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. 2459128 wikitext text/x-wiki fcopylmnzy4nt7de9t4r7k6xgn7ga4c 2459129 2459128 2026-09-21T22:07:44Z Stashbot 7414 rzl@deploy1003: helmfile [staging-eqiad] START helmfile.d/admin 'apply'. 2459129 wikitext text/x-wiki eksewgd9fty9n4smyayaunug575p0v3 2459130 2459129 2026-09-21T22:08:21Z Stashbot 7414 rzl@deploy1003: helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. 2459130 wikitext text/x-wiki gb8an7cplnns44om8ko0y9369ewvgdg 2459131 2459130 2026-09-21T22:08:57Z Stashbot 7414 rzl@deploy1003: helmfile [codfw] START helmfile.d/admin 'apply'. 2459131 wikitext text/x-wiki ft57pauded1h5gdnkesv6khw9lxs6qt 2459132 2459131 2026-09-21T22:09:55Z Stashbot 7414 rzl@deploy1003: helmfile [codfw] DONE helmfile.d/admin 'apply'. 2459132 wikitext text/x-wiki 3h5fqqrjy9jq52fqzklj5lni44favu4 2459133 2459132 2026-09-21T22:10:46Z Stashbot 7414 rzl@deploy1003: helmfile [eqiad] START helmfile.d/admin 'apply'. 2459133 wikitext text/x-wiki 863zpdzgidozd0eh59s7kr4lrcybio9 2459134 2459133 2026-09-21T22:11:25Z Stashbot 7414 rzl@deploy1003: helmfile [eqiad] DONE helmfile.d/admin 'apply'. 2459134 wikitext text/x-wiki jhyzxsch3isxawq3uif3fwgmqjlrjoq 2459140 2459134 2026-09-22T02:00:59Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2459140 wikitext text/x-wiki ijz7p8nyhei9im6jedoowztdpclx93a 2459141 2459140 2026-09-22T02:08:29Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 07m 30s) 2459141 wikitext text/x-wiki nqpr2qqzl7c6ivrwbb2wc7zdz9pk7t1 2459143 2459141 2026-09-22T03:03:17Z Stashbot 7414 mwpresync@deploy1003: Started scap sync-world: testwikis to 1.47.0-wmf.21 refs T438217 2459143 wikitext text/x-wiki clr1te5gzxl8lcf47xg38ogygshxhdp 2459144 2459143 2026-09-22T03:39:09Z Stashbot 7414 mwpresync@deploy1003: Finished scap sync-world: testwikis to 1.47.0-wmf.21 refs T438217 (duration: 35m 52s) 2459144 wikitext text/x-wiki 41yuoglhvwo5hm7qxr48n7zpay3k9f6 2459146 2459144 2026-09-22T04:02:34Z Stashbot 7414 mwpresync@deploy1003: Pruned MediaWiki: 1.47.0-wmf.18 (duration: 02m 28s) 2459146 wikitext text/x-wiki bstz7lo9hbto27k3jtxqadr3mklc683 2459160 2459146 2026-09-22T07:02:05Z Stashbot 7414 moritzm: installing pyasn1 security updates 2459160 wikitext text/x-wiki 80wpnh5xt90folqfcn87z89v5jyyq1w 2459162 2459160 2026-09-22T07:05:02Z Stashbot 7414 awight@deploy1003: Started scap sync-world: Backport for [[gerrit:1343347|Config change for launch of stopping sending LL notifications. (T438463)]], [[gerrit:1313951|Change feedback URLs for EditCheck TextMatch on ruwiki (T426271)]] 2459162 wikitext text/x-wiki hcrtqsysojlfc8ad8rajb0euskow4no 2459165 2459162 2026-09-22T07:09:31Z Stashbot 7414 awight@deploy1003: seanleong-wmde, esanders, awight: Backport for [[gerrit:1343347|Config change for launch of stopping sending LL notifications. (T438463)]], [[gerrit:1313951|Change feedback URLs for EditCheck TextMatch on ruwiki (T426271)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2459165 wikitext text/x-wiki 7kiiit0e8wbfvw0gsgju8bft6znuc99 2459168 2459165 2026-09-22T07:15:32Z Stashbot 7414 awight@deploy1003: seanleong-wmde, esanders, awight: Continuing with deployment 2459168 wikitext text/x-wiki qci5vucniq9o0a9g1ruibhib5jxyab8 2459173 2459168 2026-09-22T07:22:48Z Stashbot 7414 awight@deploy1003: Finished scap sync-world: Backport for [[gerrit:1343347|Config change for launch of stopping sending LL notifications. (T438463)]], [[gerrit:1313951|Change feedback URLs for EditCheck TextMatch on ruwiki (T426271)]] (duration: 17m 46s) 2459173 wikitext text/x-wiki cktcfui7ki3p5x8wzq1fuhs1a1if1kn 2459174 2459173 2026-09-22T07:23:14Z Stashbot 7414 awight: UTC morning deployment window complete 2459174 wikitext text/x-wiki od9lua6ihnr0pcm5h7gt4mx0zzjh3pq 2459184 2459174 2026-09-22T07:59:28Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.dns.admin DNS admin: depool esams [reason: switch reboot, T437984] 2459184 wikitext text/x-wiki fpqcel6h6p2bq1pvzem6vs2toe8cx5p 2459185 2459184 2026-09-22T07:59:30Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: depool esams [reason: switch reboot, T437984] 2459185 wikitext text/x-wiki 6wrt0x4b8o5ybi3e27bcadt25nqz6vb 2459186 2459185 2026-09-22T08:01:05Z Stashbot 7414 ayounsi@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on asw1-bw27-esams,asw1-bw27-esams IPv6,asw1-bw27-esams.mgmt with reason: Switch reboot 2459186 wikitext text/x-wiki hoeius0d1yb9lx88hk4epzp2w052u9l 2459187 2459186 2026-09-22T08:01:23Z Stashbot 7414 arthurtaylor@deploy1003: helmfile [staging] START helmfile.d/services/wikidata-query-gui: apply 2459187 wikitext text/x-wiki gpihvzxu7ioymbqpfo3dw9weq0yfxyj 2459188 2459187 2026-09-22T08:01:37Z Stashbot 7414 ayounsi@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 13 hosts with reason: Switch reboot 2459188 wikitext text/x-wiki iw0vb8nu31vjql6g11um0sq14pcx6i8 2459189 2459188 2026-09-22T08:01:57Z Stashbot 7414 arthurtaylor@deploy1003: helmfile [staging] DONE helmfile.d/services/wikidata-query-gui: apply 2459189 wikitext text/x-wiki q6e6dkztkumu7w8qjqu4d8c6xfu3tv5 2459190 2459189 2026-09-22T08:04:38Z Stashbot 7414 arthurtaylor@deploy1003: helmfile [codfw] START helmfile.d/services/wikidata-query-gui: apply 2459190 wikitext text/x-wiki rgx6q3g5vjtu417rd167s1n53ji1an0 2459191 2459190 2026-09-22T08:05:00Z Stashbot 7414 arthurtaylor@deploy1003: helmfile [codfw] DONE helmfile.d/services/wikidata-query-gui: apply 2459191 wikitext text/x-wiki 1kcyyu39c429mzocjdw4pktzcl1bj9v 2459192 2459191 2026-09-22T08:05:04Z Stashbot 7414 jelto@cumin1004: START - Cookbook sre.loadbalancer.migrate-service-ipip for alias: wikikube-worker-codfw@codfw 2459192 wikitext text/x-wiki 5kep75hyj7f4dhnjcdvmvzdlirimbah 2459193 2459192 2026-09-22T08:05:08Z Stashbot 7414 arthurtaylor@deploy1003: helmfile [eqiad] START helmfile.d/services/wikidata-query-gui: apply 2459193 wikitext text/x-wiki 0p5e2pyze08finv973yo1onjlqphldh 2459194 2459193 2026-09-22T08:05:27Z Stashbot 7414 arthurtaylor@deploy1003: helmfile [eqiad] DONE helmfile.d/services/wikidata-query-gui: apply 2459194 wikitext text/x-wiki 01hpi00dbwes3xg6ozg11de922ii4gv 2459195 2459194 2026-09-22T08:09:53Z Stashbot 7414 jelto@cumin1004: START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on (A:lvs-low-traffic-codfw or A:lvs-secondary-codfw) and A:bullseye and A:lvs 2459195 wikitext text/x-wiki mex1b52lwpur2nma8zq59m0f5up5suf 2459196 2459195 2026-09-22T08:10:52Z Stashbot 7414 jelto@cumin1004: END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on (A:lvs-low-traffic-codfw or A:lvs-secondary-codfw) and A:bullseye and A:lvs 2459196 wikitext text/x-wiki p2w1gstp12btnbdb9ymyzdjz8v9bvub 2459197 2459196 2026-09-22T08:10:53Z Stashbot 7414 jelto@cumin1004: END (PASS) - Cookbook sre.loadbalancer.migrate-service-ipip (exit_code=0) for alias: wikikube-worker-codfw@codfw 2459197 wikitext text/x-wiki du9vn4kck4iq3fqrbihdqr5voo0wadl 2459198 2459197 2026-09-22T08:18:35Z Stashbot 7414 moritzm: installing gst-plugins-base1.0 security updates 2459198 wikitext text/x-wiki 1af6ttlg8s5d0fzlap6k2va9unqcb2g 2459201 2459198 2026-09-22T08:22:39Z Stashbot 7414 jelto@cumin1004: START - Cookbook sre.loadbalancer.migrate-service-ipip for alias: wikikube-worker-eqiad@eqiad 2459201 wikitext text/x-wiki os8v8roeczyiwyi6pm2p9ukv01uh4bb 2459202 2459201 2026-09-22T08:24:21Z Stashbot 7414 dcausse@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-semantic-search-test: apply 2459202 wikitext text/x-wiki d761t97zftihgwjvybw11ca3f491rkc 2459203 2459202 2026-09-22T08:24:28Z Stashbot 7414 dcausse@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search-test: apply 2459203 wikitext text/x-wiki l6fxntvio1wroatca4yx9qie2v0s6t8 2459204 2459203 2026-09-22T08:26:22Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.network.depool-rack with action 'depool' for esams rack BW27 2459204 wikitext text/x-wiki n9209qour1pgvi9xlbq7j6bzg0q9cuw 2459205 2459204 2026-09-22T08:26:33Z Stashbot 7414 jelto@cumin1004: END (FAIL) - Cookbook sre.loadbalancer.migrate-service-ipip (exit_code=99) for alias: wikikube-worker-eqiad@eqiad 2459205 wikitext text/x-wiki 5s8lszsjixjnozpze6sj7z0ejedj8zw 2459206 2459205 2026-09-22T08:27:21Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.network.depool-rack (exit_code=0) with action 'depool' for esams rack BW27 2459206 wikitext text/x-wiki gr5tqzanrdu5ahng0liid1ydf3l0h7x 2459207 2459206 2026-09-22T08:28:22Z Stashbot 7414 jelto@cumin1004: START - Cookbook sre.loadbalancer.migrate-service-ipip for alias: wikikube-worker-eqiad@eqiad 2459207 wikitext text/x-wiki 6oqu7p002tq60d8jplcy3mmldmijcu1 2459208 2459207 2026-09-22T08:29:57Z Stashbot 7414 XioNoX: asw1-bw27-esams> request system reboot - T437984 2459208 wikitext text/x-wiki ehn7115c27bw0ftpgh5k9s51qa8ejfh 2459209 2459208 2026-09-22T08:30:43Z Stashbot 7414 jelto@cumin1004: END (FAIL) - Cookbook sre.loadbalancer.migrate-service-ipip (exit_code=99) for alias: wikikube-worker-eqiad@eqiad 2459209 wikitext text/x-wiki q3zruhx1gvef9h2mii4761wa45ux46u 2459210 2459209 2026-09-22T08:32:16Z Stashbot 7414 moritzm: installig zip security updates 2459210 wikitext text/x-wiki skpbwse8ejnq84618wplx5tv7unfyd2 2459211 2459210 2026-09-22T08:37:05Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply 2459211 wikitext text/x-wiki sw7gbyn4660jp8c0o046uc9hv88c3iy 2459212 2459211 2026-09-22T08:37:20Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply 2459212 wikitext text/x-wiki 8psoa4kpyji8zm3p3wiqm6ocoqlcyzd 2459213 2459212 2026-09-22T08:39:08Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs-next: apply 2459213 wikitext text/x-wiki k75nffgbwslnwykz5hinma34pk38pdg 2459215 2459213 2026-09-22T08:39:24Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs-next: apply 2459215 wikitext text/x-wiki hzr195pxa4c6kz0q4brv0dls5ju8exq 2459216 2459215 2026-09-22T08:44:31Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.hosts.remove-downtime for 13 hosts 2459216 wikitext text/x-wiki k8er1hb9ikeecmhqinabhsl37yd85lq 2459217 2459216 2026-09-22T08:44:38Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for 13 hosts 2459217 wikitext text/x-wiki 77rmpyytpamy4fro3gqz4gu69k443ix 2459218 2459217 2026-09-22T08:44:56Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.hosts.remove-downtime for asw1-bw27-esams,asw1-bw27-esams IPv6,asw1-bw27-esams.mgmt 2459218 wikitext text/x-wiki tc0x49esrvkvhzu5su0dd6p4yclb315 2459219 2459218 2026-09-22T08:44:58Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for asw1-bw27-esams,asw1-bw27-esams IPv6,asw1-bw27-esams.mgmt 2459219 wikitext text/x-wiki pwidrjefjf1ynr0cmhwswe5yfoapovn 2459220 2459219 2026-09-22T08:45:55Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.dns.admin DNS admin: pool esams [reason: switch reboot, T437984] 2459220 wikitext text/x-wiki qm40003n89yeckzc8b3lw5x0q7d57ki 2459221 2459220 2026-09-22T08:45:57Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: pool esams [reason: switch reboot, T437984] 2459221 wikitext text/x-wiki o4hav195gbbw74hd2m9woezaa531uqr 2459222 2459221 2026-09-22T08:49:14Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs: apply 2459222 wikitext text/x-wiki 7dd45p6n1ls9v4k12p3vlgo8cgyseap 2459224 2459222 2026-09-22T08:52:36Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply 2459224 wikitext text/x-wiki 0cwjwv0ee0s2bxvqzlnnowuy6igh875 2459227 2459224 2026-09-22T08:55:13Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2459227 wikitext text/x-wiki 3z9sr8nebsjd724tuyuljwghlt63rb1 2459229 2459227 2026-09-22T08:58:48Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2459229 wikitext text/x-wiki d3qec1hwjeeob5pnymiclh0qoqfsszj 2459230 2459229 2026-09-22T09:02:33Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section x1 2459230 wikitext text/x-wiki tqwllj4r6bsf5w10um1j0f6b7lmrjw8 2459231 2459230 2026-09-22T09:04:11Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section x1 2459231 wikitext text/x-wiki 2b4kldl6a1iti7q325td6srw7u6ch6y 2459232 2459231 2026-09-22T09:05:13Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section x3 2459232 wikitext text/x-wiki kvponw5ykw6nwxleej298ya5a8v486q 2459233 2459232 2026-09-22T09:09:48Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.network.peering with action 'email' for AS: 52320 2459233 wikitext text/x-wiki fsdcrds890ljsdln2afmcurxvx4nk3x 2459234 2459233 2026-09-22T09:10:26Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 52320 2459234 wikitext text/x-wiki fnk9g45ou3usvyfu48ejkb3w311qiqi 2459235 2459234 2026-09-22T09:11:13Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section x3 2459235 wikitext text/x-wiki adn0lr0ptkbbhf8iyl2hpti8lr4315a 2459236 2459235 2026-09-22T09:11:39Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section x4 2459236 wikitext text/x-wiki peu2sre12kd1gpomeu47799quz4tpjk 2459237 2459236 2026-09-22T09:12:54Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section x4 2459237 wikitext text/x-wiki hqqc9bxlgx0g87fuw3ladqnr3bualwi 2459238 2459237 2026-09-22T09:14:12Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section es6 2459238 wikitext text/x-wiki 6z4xur3csay1cpkxmxazacy7vvc3qna 2459239 2459238 2026-09-22T09:15:17Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section es6 2459239 wikitext text/x-wiki gxsk1rs6kj9486617jct0wxcr5ukzfi 2459240 2459239 2026-09-22T09:16:38Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section es7 2459240 wikitext text/x-wiki 236ti2yqj0yu5rnm8ar20w6mhh1kx0y 2459241 2459240 2026-09-22T09:20:43Z Stashbot 7414 jelto@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on wikikube-worker1152.eqiad.wmnet with reason: hardware/networking issues 2459241 wikitext text/x-wiki ipfh19e7krb3p4290k567gk8mfrfx7n 2459242 2459241 2026-09-22T09:23:29Z Stashbot 7414 jelto@cumin1004: conftool action : set/pooled=no; selector: name=wikikube-worker1152.eqiad.wmnet 2459242 wikitext text/x-wiki 3qvyper1n9rillqitf5t8ve01ht8ok0 2459243 2459242 2026-09-22T09:23:33Z Stashbot 7414 btullis@dns1004: START - running authdns-update 2459243 wikitext text/x-wiki me0bgmcynmtoi2w9zvuf1273vupfigy 2459244 2459243 2026-09-22T09:24:34Z Stashbot 7414 jelto@cumin1004: START - Cookbook sre.loadbalancer.migrate-service-ipip for alias: wikikube-worker-eqiad@eqiad 2459244 wikitext text/x-wiki c071yygysgjpeia4yn7z86mzir4kv5b 2459245 2459244 2026-09-22T09:26:01Z Stashbot 7414 btullis@dns1004: END - running authdns-update 2459245 wikitext text/x-wiki 0wlbeu5dlx1h2b336ry32mv9i9t7grt 2459246 2459245 2026-09-22T09:28:23Z Stashbot 7414 jelto@cumin1004: END (FAIL) - Cookbook sre.loadbalancer.migrate-service-ipip (exit_code=99) for alias: wikikube-worker-eqiad@eqiad 2459246 wikitext text/x-wiki jz9duv7n6cctkp18b3onv5y20q6jdgi 2459247 2459246 2026-09-22T09:28:41Z Stashbot 7414 jelto@cumin1004: conftool action : set/pooled=inactive; selector: name=wikikube-worker1152.eqiad.wmnet 2459247 wikitext text/x-wiki dv5ybt5qd76zbhht1g3ej7hya1qosvn 2459248 2459247 2026-09-22T09:30:25Z Stashbot 7414 jelto@cumin1004: START - Cookbook sre.loadbalancer.migrate-service-ipip for alias: wikikube-worker-eqiad@eqiad 2459248 wikitext text/x-wiki iub370o5bjughfy92pnddsdwmsdpv1t 2459249 2459248 2026-09-22T09:31:57Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 8 hosts with reason: dc preparations 2459249 wikitext text/x-wiki dh9mzqzdozcnm463zeej1kh6y2v3j5d 2459250 2459249 2026-09-22T09:32:40Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.mysql.depool depool es1035: issues 2459250 wikitext text/x-wiki lm023bp1ihidl9t03nejd178kj7gl45 2459251 2459250 2026-09-22T09:32:41Z Stashbot 7414 jelto@cumin1004: END (FAIL) - Cookbook sre.loadbalancer.migrate-service-ipip (exit_code=99) for alias: wikikube-worker-eqiad@eqiad 2459251 wikitext text/x-wiki j62fsu35l1q7bf5bsrw1uzcpagk2m2f 2459252 2459251 2026-09-22T09:32:42Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1035: issues 2459252 wikitext text/x-wiki 6xd2wjnotmd7z3ddmy0sk7vsfmu48r5 2459253 2459252 2026-09-22T09:39:25Z Stashbot 7414 vgutierrez: fetch haproxy 3.2.23 on thirdparty/haproxy32 for trixie (apt.wm.o) - T438828 2459253 wikitext text/x-wiki anajvcb3g93gr0hse2j0zuis94unwp1 2459254 2459253 2026-09-22T09:40:19Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section es7 2459254 wikitext text/x-wiki 84eev41yvld25te3ecy2dthbnf7hoz4 2459255 2459254 2026-09-22T09:41:29Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.reimage for host registry2005.codfw.wmnet with OS trixie 2459255 wikitext text/x-wiki 4ozpom6vhgqwa3pq2awylbztvmevk78 2459256 2459255 2026-09-22T09:41:52Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-staging-codfw] 'sync' command on namespace 'tts-section-generator' for release 'main' . 2459256 wikitext text/x-wiki 7jd6y60mo35meab3hods19k8ciycy6e 2459257 2459256 2026-09-22T09:42:53Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section es7 2459257 wikitext text/x-wiki 0y30zfjgnf1w7h6z5u0sies52ucgm3o 2459258 2459257 2026-09-22T09:43:17Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-serve-eqiad] 'sync' command on namespace 'tts-section-generator' for release 'main' . 2459258 wikitext text/x-wiki egz7uh45ceil1eza1wr1u5l2yefxqc4 2459259 2459258 2026-09-22T09:44:07Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-serve-codfw] 'sync' command on namespace 'tts-section-generator' for release 'main' . 2459259 wikitext text/x-wiki 80767uttw8p1p24z9x7fmdvvbyub9bc 2459260 2459259 2026-09-22T09:44:25Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on P{cp[7010,7016].*} and A:cp - 3.2.23 upgrade (T438828) 2459260 wikitext text/x-wiki lyuh0b6qrz8aqq0pd082ex1s3hqkt6b 2459261 2459260 2026-09-22T09:44:43Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section es7 2459261 wikitext text/x-wiki i6f6ug8l32la63s4tscdfik661r5n14 2459262 2459261 2026-09-22T09:46:58Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.mysql.pool pool es1035: issues 2459262 wikitext text/x-wiki r0s5189ldjtq0yipacm92d9qqdr38xw 2459263 2459262 2026-09-22T09:47:01Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool es1035: issues 2459263 wikitext text/x-wiki s74wzdhu00lncooczblno2ql04it2vj 2459264 2459263 2026-09-22T09:47:18Z Stashbot 7414 elukey: uploaded spicerack_13.3.0 to apt.wikimedia.org bookworm-wikimedia,trixie-wikimedia 2459264 wikitext text/x-wiki 1ibtqvzc9rrweg4rix1ge6kj306qboo 2459265 2459264 2026-09-22T09:50:59Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section s6 2459265 wikitext text/x-wiki cibv6x48gjok6myplpy00bii736xw3b 2459266 2459265 2026-09-22T09:51:17Z Stashbot 7414 elukey: install spicerack 13.3.0 on cumin1004 and cumin2003 2459266 wikitext text/x-wiki ikeas76p679a48r0vvccxf282swfw0r 2459267 2459266 2026-09-22T09:53:18Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section s6 2459267 wikitext text/x-wiki 5fj46wui2ef4b4dn4e8andjs1r4ov7k 2459268 2459267 2026-09-22T09:55:31Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section s5 2459268 wikitext text/x-wiki a5akldc0uxtfvbc9ji8mylykf2ghzp9 2459269 2459268 2026-09-22T09:56:53Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on P{cp[7010,7016].*} and A:cp - 3.2.23 upgrade (T438828) 2459269 wikitext text/x-wiki bracnpiz0fqpllmnige1zdn7ppr156g 2459270 2459269 2026-09-22T09:57:34Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section s5 2459270 wikitext text/x-wiki 6rg58wwqjnzl43owulk1zplsbwint30 2459271 2459270 2026-09-22T09:58:06Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on registry2005.codfw.wmnet with reason: host reimage 2459271 wikitext text/x-wiki 72px9hc6kzsesxj4zm7kxwbfdgahohf 2459272 2459271 2026-09-22T09:58:27Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section s2 2459272 wikitext text/x-wiki 85kbq2brtfazh34uodthn04i2xl3plz 2459273 2459272 2026-09-22T10:00:11Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section s2 2459273 wikitext text/x-wiki 0s9gu3ecbwehgocp7qm5cf3ezt1w0as 2459274 2459273 2026-09-22T10:01:06Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section s3 2459274 wikitext text/x-wiki c8cyr8dt6ymmcrvsgulz0epw2anay0l 2459275 2459274 2026-09-22T10:02:48Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section s3 2459275 wikitext text/x-wiki 721k5jby2xa5evh39y8qksaxdmeqv2j 2459276 2459275 2026-09-22T10:02:52Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on registry2005.codfw.wmnet with reason: host reimage 2459276 wikitext text/x-wiki kcie5f09wz39f8c00rgzvuivhmhujiz 2459277 2459276 2026-09-22T10:03:50Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section s7 2459277 wikitext text/x-wiki bq3wgf8ar3ai24fjcolrdi0w3x0h1rl 2459278 2459277 2026-09-22T10:05:44Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section s7 2459278 wikitext text/x-wiki rqtb78tno07tjwcpu3wa4d4by2f0vmo 2459279 2459278 2026-09-22T10:06:31Z Stashbot 7414 moritzm: installing libcap2 security updates 2459279 wikitext text/x-wiki 9xfeb0risnm80i93ds41ijtfona3qry 2459281 2459279 2026-09-22T10:06:45Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section s8 2459281 wikitext text/x-wiki t9jbyfcm7ul00ug69bzxzfrep7lxjxk 2459282 2459281 2026-09-22T10:08:19Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section s8 2459282 wikitext text/x-wiki cux5yz0o71agyeuex1rh9ss4jl2bel1 2459283 2459282 2026-09-22T10:09:01Z Stashbot 7414 gmodena@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply 2459283 wikitext text/x-wiki 981cq0ptb9aa7lb1w5grx02jehooau0 2459284 2459283 2026-09-22T10:09:07Z Stashbot 7414 gmodena@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply 2459284 wikitext text/x-wiki 7uedt36f3e221r1r8zw57autkmt0pql 2459285 2459284 2026-09-22T10:09:10Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section s4 2459285 wikitext text/x-wiki 5na611gmnuq4p9ni9qf27u0ln4s7uny 2459286 2459285 2026-09-22T10:09:55Z Stashbot 7414 gmodena@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs-next: apply 2459286 wikitext text/x-wiki t3jxsf6uuqrc43pd4sc2s09275i9axp 2459287 2459286 2026-09-22T10:10:07Z Stashbot 7414 gmodena@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs-next: apply 2459287 wikitext text/x-wiki 43i7mr57zo7fty3ptyt174op46xwhex 2459288 2459287 2026-09-22T10:10:56Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section s4 2459288 wikitext text/x-wiki nixvy0lwxz7ndksopxpnxeek7ata8v1 2459289 2459288 2026-09-22T10:11:51Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.switchdc.databases.prepare for the switch from eqiad to codfw for section s1 2459289 wikitext text/x-wiki fdedh5tzqn1tg1wmv3ai6bqvgtl65fd 2459290 2459289 2026-09-22T10:13:35Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.switchdc.databases.prepare (exit_code=0) for the switch from eqiad to codfw for section s1 2459290 wikitext text/x-wiki t9anekrup6ht54e86bvpplulnmxbf9x 2459291 2459290 2026-09-22T10:20:23Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host registry2005.codfw.wmnet with OS trixie 2459291 wikitext text/x-wiki punm728p75a0u8vrtwi4sqlluaapne6 2459296 2459291 2026-09-22T10:51:29Z Stashbot 7414 kharlan@deploy1003: Started scap sync-world: Backport for [[gerrit:1343952|AbuseReview: Allow interaction with verdict buttons on closed rows (T438808)]] 2459296 wikitext text/x-wiki oosf660ggdk2rg3nrtftf98edpr5mdm 2459298 2459296 2026-09-22T10:52:31Z Stashbot 7414 topranks: enable rule cache-upload/eqsin_originals_scraper_20260922 2459298 wikitext text/x-wiki cqwsjj7pd50swk2qs07l9yojg0w6lpr 2459299 2459298 2026-09-22T10:53:15Z Stashbot 7414 gmodena@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs-next: apply 2459299 wikitext text/x-wiki 8myxcowu3t4v09x9ggrmzvcok7ydkt8 2459300 2459299 2026-09-22T10:53:28Z Stashbot 7414 gmodena@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs-next: apply 2459300 wikitext text/x-wiki 7cgcxryix570ftiiiayl3hzi6dey2aj 2459301 2459300 2026-09-22T10:54:15Z Stashbot 7414 gmodena@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply 2459301 wikitext text/x-wiki t20jk5hmbobv507rvw8k3zn9zf3uwfr 2459302 2459301 2026-09-22T10:54:24Z Stashbot 7414 gmodena@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply 2459302 wikitext text/x-wiki r2y3u3uw4ayluc963l8t11jtvi2j18u 2459303 2459302 2026-09-22T11:12:05Z Stashbot 7414 kharlan@deploy1003: kharlan: Backport for [[gerrit:1343952|AbuseReview: Allow interaction with verdict buttons on closed rows (T438808)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2459303 wikitext text/x-wiki qopm86o0hy8wuoskgkabzxy67vs2d8j 2459304 2459303 2026-09-22T11:13:05Z Stashbot 7414 kharlan@deploy1003: kharlan: Continuing with deployment 2459304 wikitext text/x-wiki pina0c077gi1xwtrophz50bmnn73i3d 2459305 2459304 2026-09-22T11:19:04Z Stashbot 7414 jelto@cumin1004: START - Cookbook sre.loadbalancer.migrate-service-ipip for alias: wikikube-worker-eqiad@eqiad 2459305 wikitext text/x-wiki opdpifmjiuqa8wgph3ukbj4ju8n0sgf 2459306 2459305 2026-09-22T11:22:27Z Stashbot 7414 jelto@cumin1004: START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on (A:lvs-low-traffic-eqiad or A:lvs-secondary-eqiad) and A:bullseye and A:lvs 2459306 wikitext text/x-wiki cr1358s4zr3q1lj76w17bwcuo2cu3fj 2459307 2459306 2026-09-22T11:24:30Z Stashbot 7414 jelto@cumin1004: END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on (A:lvs-low-traffic-eqiad or A:lvs-secondary-eqiad) and A:bullseye and A:lvs 2459307 wikitext text/x-wiki niexaw48psjf55446qyr48ggc32skbl 2459308 2459307 2026-09-22T11:24:31Z Stashbot 7414 jelto@cumin1004: END (PASS) - Cookbook sre.loadbalancer.migrate-service-ipip (exit_code=0) for alias: wikikube-worker-eqiad@eqiad 2459308 wikitext text/x-wiki 6dggepv2rseq0q500nxf31eetnozrfv 2459309 2459308 2026-09-22T11:24:38Z Stashbot 7414 kharlan@deploy1003: Finished scap sync-world: Backport for [[gerrit:1343952|AbuseReview: Allow interaction with verdict buttons on closed rows (T438808)]] (duration: 33m 09s) 2459309 wikitext text/x-wiki d9sl8wsoy7bytcdehry2s1kiwwscad5 2459310 2459309 2026-09-22T11:27:19Z Stashbot 7414 kharlan@deploy1003: Started scap sync-world: Backport for [[gerrit:1343960|AbuseReview: Hide Echo banner when user cannot see personal info (T438477)]] 2459310 wikitext text/x-wiki rx44el0wt10vafsw902pg3ahe6wfuyv 2459311 2459310 2026-09-22T11:33:40Z Stashbot 7414 kharlan@deploy1003: kharlan: Backport for [[gerrit:1343960|AbuseReview: Hide Echo banner when user cannot see personal info (T438477)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2459311 wikitext text/x-wiki c38m7za2hupctx881mlx0lg6x48rcg6 2459312 2459311 2026-09-22T11:34:07Z Stashbot 7414 kharlan@deploy1003: kharlan: Continuing with deployment 2459312 wikitext text/x-wiki kz1erorgvgrpyrsilwpqraefkef9kem 2459313 2459312 2026-09-22T11:41:06Z Stashbot 7414 kharlan@deploy1003: Finished scap sync-world: Backport for [[gerrit:1343960|AbuseReview: Hide Echo banner when user cannot see personal info (T438477)]] (duration: 13m 46s) 2459313 wikitext text/x-wiki on7dqsw59dlnq0h6g468sqbyc19fxaj 2459314 2459313 2026-09-22T11:46:37Z Stashbot 7414 kharlan@deploy1003: Started scap sync-world: Backport for [[gerrit:1343953|AbuseReview: Hide recently saved revisions from the vandalism queue (T438235)]] 2459314 wikitext text/x-wiki m8p5g45wnwkzssuctqb7d934tf1ksxo 2459315 2459314 2026-09-22T11:52:27Z Stashbot 7414 jnuche@deploy1003: Started deploy [releng/jenkins-deploy@ddb3f1a] (releasing): T435791 to backup host 2459315 wikitext text/x-wiki ky1mxm5gycxui16jivyk2e4xzndr95o 2459316 2459315 2026-09-22T11:52:32Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.reboot-nodes rolling reboot on P{dse-k8s-worker1001.eqiad.wmnet} and (A:dse-k8s-master-eqiad or A:dse-k8s-worker-eqiad) 2459316 wikitext text/x-wiki t0hs56bum1j1bbjsdswma36tfa53xrc 2459317 2459316 2026-09-22T11:52:36Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host dse-k8s-worker1001.eqiad.wmnet 2459317 wikitext text/x-wiki h208f6nstxb9vjjvwl0tv7ffanu4o61 2459318 2459317 2026-09-22T11:52:54Z Stashbot 7414 jnuche@deploy1003: Finished deploy [releng/jenkins-deploy@ddb3f1a] (releasing): T435791 to backup host (duration: 01m 01s) 2459318 wikitext text/x-wiki f9d2j7101e0ohetfql3s3z7rfhsvvjz 2459319 2459318 2026-09-22T11:54:12Z Stashbot 7414 jnuche@deploy1003: Started deploy [releng/jenkins-deploy@ddb3f1a] (releasing): T435791 to production host 2459319 wikitext text/x-wiki 347mnkopon5kjww184iuhvwpdmn1w6a 2459320 2459319 2026-09-22T11:54:51Z Stashbot 7414 jnuche@deploy1003: Finished deploy [releng/jenkins-deploy@ddb3f1a] (releasing): T435791 to production host (duration: 00m 54s) 2459320 wikitext text/x-wiki 1nvzyjdgb4d80laemjrky0uq2a8wfiw 0 14060 2459280 2458690 2026-09-22T10:06:36Z AKlapper (WMF) 421 Remove irrelevant pub quiz knowledge 2459280 wikitext text/x-wiki jzap0fhiogxbhttj3d3ae6bvrvptj64 498 16087 2458991 2432909 2026-09-21T14:49:02Z Stashbot 7414 andrewbogott: moving quarry.wmcloud.org proxy to k8s-clusterapi-cluster-magnum-system-kube-i98u3-kubeapi load balancer in front of new quarry cluster 2458991 wikitext text/x-wiki 82k6cj4m117qroh0rzxm7i19ow9dd7a 0 17290 2458971 2458886 2026-09-21T13:56:15Z Stashbot 7414 awight: Purging opcache on deployment-jobrunner06 2458971 wikitext text/x-wiki jv83vuar4rqldvlnz4wq51zy6ii83j4 2459020 2458971 2026-09-21T15:54:15Z Stashbot 7414 hashar: gerrit: on mediawiki/extensions/QuickSurveys deleted branch `master-backup` which was pointing at 1ad54717c059bcd49093d902eab2c098b4efe91a (which is in `master`) 2459020 wikitext text/x-wiki f7q8xnsvvk125tc2bzazehmpp34sn01 2459171 2459020 2026-09-22T07:21:54Z Stashbot 7414 awight: Purge opcache on deployment-jobrunner06.deployment-prep 2459171 wikitext text/x-wiki 7om6mn11tpx1j9y17xjvbyjz920lth0 2459226 2459171 2026-09-22T08:53:21Z Stashbot 7414 hashar: Restarted CI Jenkins on contint1003 to apply https://gerrit.wikimedia.org/r/c/operations/puppet/+/1343675 "jenkins: exit the JVM on OutOfMemoryError" # T435791 2459226 wikitext text/x-wiki iovn6pz3gc8mabo6bw3oqmjowtk8sta 0 22139 2459069 2458742 2026-09-21T18:02:13Z Neil Shah-Quinn (WMF) 36601 Add Spark 3.5.8 documentation links 2459069 wikitext text/x-wiki 7y55zjul7o3c9z0v613j63qsdmkusqz 498 30942 2459065 2458842 2026-09-21T17:41:27Z Stashbot 7414 andrewbogott: systemctl restart mariadb@s3.service mariadb@x3.service on clouddb1022; running close to 100% RAM again T438200 2459065 wikitext text/x-wiki 84urm8is852f1t5hs5shm9wy730c7e6 0 443761 2458955 2333597 2026-09-21T13:40:57Z Taavi-WMF 41365 alphasort, s/puppetmaster/puppetserver 2458955 wikitext text/x-wiki 089txqnstx63n5p4ekl3g4fhc2f9vm7 2458959 2458955 2026-09-21T13:42:39Z Taavi-WMF 41365 add backup+etcd 2458959 wikitext text/x-wiki m8zn84fszft699cf2d5ah0zouu21690 2458966 2458959 2026-09-21T13:46:15Z Taavi-WMF 41365 document missing host types 2458966 wikitext text/x-wiki 2oqqfhh2y5olh2st7oka6ohhofu571t 498 443947 2458919 2452976 2026-09-21T12:15:58Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: deployed 45d853810e (l10n updates: pl) 2458919 wikitext text/x-wiki 486kjuwvunrig2nk8nu11dwm8vbudar 0 447310 2459099 2458674 2026-09-21T19:49:41Z MPopov (WMF) 5891 /* Test Kitchen maintainer documentation */ Links to data pipelines docs 2459099 wikitext text/x-wiki p9uks8fufh2mieiou962k4yzt295653 2459111 2459099 2026-09-21T20:23:54Z KReid-WMF 49588 /* Guides */ Reorganizing to emphasize the most common guides, and remove deprecated ones. 2459111 wikitext text/x-wiki nz566ni48dqdazp79dnvle79fexovsv 0 448075 2458930 2395339 2026-09-21T12:36:20Z SLyngshede-WMF 31501 Make it more clear who communicates where. 2458930 wikitext text/x-wiki jtnj3nkxp1imo0jyxbhydbzb2qpwzzd 0 449160 2459136 2458741 2026-09-22T00:01:12Z Dexbot 30554 Bot: Updating the report 2459136 wikitext text/x-wiki q3mnqgmz1cqeh0cev7u0uui5zj6kgrl 0 451075 2459122 2455829 2026-09-21T20:44:04Z DAdedoyin (WMF) 39150 Rotation for sprint R 2459122 wikitext text/x-wiki 8qawiiehqjk7vc4cspnxnz0g49p0f4q 2459138 2459122 2026-09-22T00:10:45Z WFan (WMF) 38087 2459138 wikitext text/x-wiki nzh6lz7dnxuzicbvhqyp36846xbohy1 828 452250 2458945 2439885 2026-09-21T13:12:25Z Toolforge Image Bot 35765 Bot: Updating available container images 2458945 json application/json 1prg5405d6e1lssq34uziflsw5vetpp 0 452860 2458984 2456052 2026-09-21T14:33:45Z Krinkle 44 /* LDAP */ new section 2458984 wikitext text/x-wiki tgcgpza04x0i0vc7nct9wsj94eb3na2 2458986 2458984 2026-09-21T14:36:15Z Krinkle 44 /* LDAP */ 2458986 wikitext text/x-wiki t74p7c60266levypynhidorvjg90l4f 116 453426 2459088 2456980 2026-09-21T19:17:30Z Phabbanbot 37210 ---2044-50775-60 was disabled by JJMC89 2459088 wikitext text/x-wiki t5iyalxnlqmurwwylfjl8sljv7n0kb0 0 455989 2459118 2458683 2026-09-21T20:32:24Z KReid-WMF 49588 /* Measurement plan */ Add where to find templates 2459118 wikitext text/x-wiki qynn3aarrwjsbejtcx1xs1ef3nlearv 2459120 2459118 2026-09-21T20:37:31Z KReid-WMF 49588 /* Measurement plan */ Add intro text 2459120 wikitext text/x-wiki sn17njp415aiy9b2n0p2oivh41uaes7 0 456086 2458989 2458637 2026-09-21T14:43:52Z FCeratto-WMF 39104 Update dashboard 2458989 wikitext text/x-wiki a900d9qzote9n09hm2lsxohro8131aj 2459023 2458989 2026-09-21T15:57:33Z FCeratto-WMF 39104 Improve docs 2459023 wikitext text/x-wiki iik9hbn26ntalp31widd9c45magbygm 2459024 2459023 2026-09-21T15:59:09Z FCeratto-WMF 39104 2459024 wikitext text/x-wiki c8jmz3u6n046t2f8ygp23l2f1gor7ku 0 459290 2459045 2458633 2026-09-21T16:44:03Z AStein-WMF 39485 2459045 wikitext text/x-wiki mofudecdg53p45nkpx2skszeb2pi0tk 0 459560 2459297 2456055 2026-09-22T10:51:31Z DAdedoyin (WMF) 39150 Test 2459297 wikitext text/x-wiki lvbfa02ew8gjv4f3s1plus7rpl22y8i 0 459699 2458982 2458574 2026-09-21T14:24:11Z Stashbot 7414 ejegg: fundraising civicrm upgraded from ef52f0c1 to c80b7fb5 2458982 wikitext text/x-wiki 3vg0cjsohut1ayu0e75j32oitm7hq06 2458994 2458982 2026-09-21T14:57:00Z Stashbot 7414 ejegg: payments-wiki upgraded from 60a7b7af to 0686eda1 2458994 wikitext text/x-wiki guwr5nfg4buyub83f7rf8m2y94x45ct 2459109 2458994 2026-09-21T20:23:01Z Stashbot 7414 eileen: SmashPig upgraded from b4182208 to d9e16709 2459109 wikitext text/x-wiki tlgluabqqx6qkz4bx2l827i6edxmrp3 2459137 2459109 2026-09-22T00:10:42Z Stashbot 7414 eileen: * SmashPig upgraded from d9e16709 to f4dff92c 2459137 wikitext text/x-wiki 3jvdgzfxjegzeb2ia9haezmzpiu0s57 2459214 2459137 2026-09-22T08:39:13Z Stashbot 7414 damilare: SmashPig upgraded from f4dff92c to cbbb2d54 2459214 wikitext text/x-wiki snbkmojmwqcezt925tcnbxcs195pi95 2 460230 2458922 2443913 2026-09-21T12:23:59Z SLyngshede-WMF 31501 2458922 wikitext text/x-wiki cb5o90cdjnwl9m68bm9eygbp4upeetm 2458923 2458922 2026-09-21T12:24:29Z SLyngshede-WMF 31501 2458923 wikitext text/x-wiki r11bht11agnw8a7ihpsw24yb5yex7cf 0 460233 2459070 2452576 2026-09-21T18:02:55Z MPopov (WMF) 5891 Moved data flow overviews to [[Test Kitchen/Data pipelines]] 2459070 wikitext text/x-wiki b0094mhgdijrksw04b56c5joed5wjq4 0 460366 2459093 2458156 2026-09-21T19:38:33Z TBurmeister (WMF) 27417 Add template 2459093 wikitext text/x-wiki eakq2ayx0iodbcfzmzmv00i4jegjpbf 0 460376 2459095 2458723 2026-09-21T19:44:10Z TBurmeister (WMF) 27417 Add template 2459095 wikitext text/x-wiki hvnzv3389t9uhfj2mpn6xslq32xog5q 0 460377 2459102 2451144 2026-09-21T20:03:03Z TBurmeister (WMF) 27417 Add template 2459102 wikitext text/x-wiki dndhzx7z9s6ap74oevelttrawi337eu 3 460381 2459199 2430738 2026-09-22T08:19:32Z S.Marchenko 51924 S.Marchenko moved page [[User talk:Shadabgdg]] to [[User talk:Shadab]]: Automatically moved page while renaming the user "[[Special:CentralAuth/Shadabgdg|Shadabgdg]]" to "[[Special:CentralAuth/Shadab|Shadab]]" 2430738 wikitext text/x-wiki jjo45vaqscucrjqixrptf0ppsjp26w7 0 460424 2459176 2458126 2026-09-22T07:29:10Z RCoccioli (WMF) 7416 Add security review outcome 2459176 wikitext text/x-wiki 2hboj58of9zeb7amstywsg8hezok67n 2459177 2459176 2026-09-22T07:32:52Z RCoccioli (WMF) 7416 Marking the SCROLL as completed as all items have been discussed/verified 2459177 wikitext text/x-wiki 7ahy4z12h6n4hbq5ajrgdcemr6ph3qv 0 460470 2459085 2445087 2026-09-21T19:11:07Z JHathaway (WMF) 28372 2459085 wikitext text/x-wiki h0e6v5fscmgkrsyx0itxyzuilfq0khk 2459086 2459085 2026-09-21T19:16:13Z JHathaway (WMF) 28372 2459086 wikitext text/x-wiki 4naa5hovrxn7ya9gzbdpd8jp2qj6mh3 2459087 2459086 2026-09-21T19:17:28Z JHathaway (WMF) 28372 2459087 wikitext text/x-wiki hwvmecnvbgjylt7bq7szpnvkmr8cgmm 2459089 2459087 2026-09-21T19:29:15Z JHathaway (WMF) 28372 2459089 wikitext text/x-wiki 3467ikfwd82eal9wdq6v41sfqkch6fj 2459091 2459089 2026-09-21T19:35:13Z JHathaway (WMF) 28372 2459091 wikitext text/x-wiki 5hu7m3uybicqyocvt5zaooxxy278dm1 2459108 2459091 2026-09-21T20:20:15Z JHathaway (WMF) 28372 2459108 wikitext text/x-wiki fst7llet5lqkzrk9syba7tgdgb3dztt 2459112 2459108 2026-09-21T20:25:10Z JHathaway (WMF) 28372 2459112 wikitext text/x-wiki llxtosw7lyxvgibfl3kvtgfrlbm02cz 2459121 2459112 2026-09-21T20:40:29Z JHathaway (WMF) 28372 2459121 wikitext text/x-wiki susoy86ok9u51226n7c5ecpiiutqwju 2459123 2459121 2026-09-21T20:46:55Z JHathaway (WMF) 28372 2459123 wikitext text/x-wiki cp77c9e98bgcq36k5w9yf43c5t39kga 2459124 2459123 2026-09-21T20:48:46Z JHathaway (WMF) 28372 2459124 wikitext text/x-wiki qljpsu1tvicshzowhwc7na9dyf8enq6 2459125 2459124 2026-09-21T20:51:57Z JHathaway (WMF) 28372 2459125 wikitext text/x-wiki qvcsrsx0irymnut8ulr88hfp3mlc7yw 0 460585 2459105 2451150 2026-09-21T20:18:48Z TBurmeister (WMF) 27417 Update page to provide more effective navigation to relevant migration query rewrite pages 2459105 wikitext text/x-wiki jal2brxa3o7gb044etm6s0dc7dpq1ch 2459107 2459105 2026-09-21T20:20:06Z TBurmeister (WMF) 27417 Fix table header formatting 2459107 wikitext text/x-wiki oah6xf98wnkh0atzzbuj8x2b8926lkb 0 460602 2459094 2457248 2026-09-21T19:39:00Z TBurmeister (WMF) 27417 Add template 2459094 wikitext text/x-wiki 6xzllhuvsalldg0x0e8cc17gfv2fhqw 0 460667 2459048 2458733 2026-09-21T16:46:34Z TBurmeister (WMF) 27417 TBurmeister (WMF) moved page [[Blazegraph Migration: Example Rewrites of the Label Service]] to [[Rewrite of Label Service/Examples]]: Put query rewrite example docs under appropriate parent page 2458733 wikitext text/x-wiki 1dh8shnivj2hqnx5udi2mt3vp0kw95s 2459051 2459048 2026-09-21T16:47:33Z TBurmeister (WMF) 27417 TBurmeister (WMF) moved page [[Rewrite of Label Service/Examples]] to [[Wikidata Query Service/Migration/Rewrite of Label Service/Examples]]: I moved it to the wrong place previously 2458733 wikitext text/x-wiki 1dh8shnivj2hqnx5udi2mt3vp0kw95s 2459096 2459051 2026-09-21T19:44:33Z TBurmeister (WMF) 27417 Add template 2459096 wikitext text/x-wiki preoijjveybfvddsm37b9twf4mrgd6y 2459145 2459096 2026-09-22T03:59:39Z AWesterinen-WMF 54189 /* Manual mode involving nested scopes */ 2459145 wikitext text/x-wiki olkgsybfx2xsu102z5cjnhdkdgxmo99 2459147 2459145 2026-09-22T04:40:27Z AWesterinen-WMF 54189 2459147 wikitext text/x-wiki 092yjjhrksw8ghvs93j0mgzhf6pgeb6 2459148 2459147 2026-09-22T04:41:00Z AWesterinen-WMF 54189 /* Manual mode involving nested scopes */ 2459148 wikitext text/x-wiki 92fo2fodass7yxx18tvy5aez60lo2l4 2459149 2459148 2026-09-22T04:41:12Z AWesterinen-WMF 54189 /* Automatic mode involving nested scopes */ 2459149 wikitext text/x-wiki n6zpjtad6yzs6l5v2a6jrz27ml49mxv 2459150 2459149 2026-09-22T04:42:21Z AWesterinen-WMF 54189 /* Automatic mode involving nested scopes */ 2459150 wikitext text/x-wiki drsf5u5i34ofpwa5k73oqrczrx13l37 2459151 2459150 2026-09-22T04:44:31Z AWesterinen-WMF 54189 /* Manual mode retrieving rdfs:label */ 2459151 wikitext text/x-wiki 3tgmnacvcx8ykr4dxshbfxv0me24pgm 2459152 2459151 2026-09-22T05:03:11Z AWesterinen-WMF 54189 2459152 wikitext text/x-wiki eedcmigjbb7jbzwadgxxfckn5osnr5q 2459153 2459152 2026-09-22T05:03:56Z AWesterinen-WMF 54189 /* Manual mode involving nested scopes */ 2459153 wikitext text/x-wiki eb02u0cczc58cdd1419bptsp4rc7smy 2459154 2459153 2026-09-22T05:04:31Z AWesterinen-WMF 54189 /* Mix of manual and automatic modes in different scopes */ 2459154 wikitext text/x-wiki ovhhjx5u3zr6jg25imbhsmqkuzi0b7w 2459155 2459154 2026-09-22T05:06:00Z AWesterinen-WMF 54189 /* Automatic mode involving nested scopes */ 2459155 wikitext text/x-wiki 99k7x0zw1nopxbmgj8bgy6ys88nn4dz 2 460671 2459036 2458428 2026-09-21T16:20:21Z CKlimas-WMF 59190 2459036 wikitext text/x-wiki to65dralshp5fp8klyliiesjcen9r1g 2459037 2459036 2026-09-21T16:21:59Z CKlimas-WMF 59190 2459037 wikitext text/x-wiki hwf9t9ao74h2cyhw5bimggj9wu9g20o 2459040 2459037 2026-09-21T16:26:02Z CKlimas-WMF 59190 2459040 wikitext text/x-wiki ezdx2qxtkfbqnms51ncx2h0qvukd7aj 2 460699 2459156 2458820 2026-09-22T06:52:17Z SSapaty (WMF) 28955 /* Inspect your existing job */ 2459156 wikitext text/x-wiki ster22vo7fmbqq2xzn51hub3qn151ps 2459157 2459156 2026-09-22T06:53:02Z SSapaty (WMF) 28955 /* Generate a Components configuration */ 2459157 wikitext text/x-wiki jl0jjo61aeyk0qgoe5fbnvpongotlox 2459158 2459157 2026-09-22T06:57:07Z SSapaty (WMF) 28955 /* Create the Components configuration */ 2459158 wikitext text/x-wiki nm0xbmdqkvihis26tzttu7v9wj10l5t 2459159 2459158 2026-09-22T07:00:47Z SSapaty (WMF) 28955 /* Test the migration with a manual deployment */ 2459159 wikitext text/x-wiki jw4j0onh5mqi53oi4xjuxypdhpu0d6x 2459161 2459159 2026-09-22T07:03:35Z SSapaty (WMF) 28955 /* Test the migration with a manual deployment */ 2459161 wikitext text/x-wiki 86y6ervdhia9d0kvm14ly3s1cuygbav 2459163 2459161 2026-09-22T07:05:33Z SSapaty (WMF) 28955 /* Test Push-to-Deploy */ 2459163 wikitext text/x-wiki f6kjgq50g5suktg1ry6gddydnlm171g 2459164 2459163 2026-09-22T07:08:46Z SSapaty (WMF) 28955 /* Troubleshooting */ 2459164 wikitext text/x-wiki rn2ciacktvi4xztawfnb9790z7i8ul7 2459166 2459164 2026-09-22T07:13:38Z SSapaty (WMF) 28955 /* Inspect your existing job */ 2459166 wikitext text/x-wiki 8em2b9pqvkon088xbgx79jf9wisejev 2459167 2459166 2026-09-22T07:14:45Z SSapaty (WMF) 28955 /* Verify the migrated component */ 2459167 wikitext text/x-wiki sq6v8vi616vtdwgy1cxv7atswh6trhh 2459170 2459167 2026-09-22T07:15:50Z SSapaty (WMF) 28955 /* Test Push-to-Deploy */ 2459170 wikitext text/x-wiki 5fwlb3idpdvtfixrjhsy1gnr64wcpzn 2 460701 2458920 2026-09-21T12:22:49Z SLyngshede-WMF 31501 Created page with "'''Draft'''" 2458920 wikitext text/x-wiki cxmrz4y4auu0z4eglaj0k0xiagbsni2 2458948 2458920 2026-09-21T13:15:18Z SLyngshede-WMF 31501 2458948 wikitext text/x-wiki ozz0xfnt4yoymfkpy4nijrgaqbww5e3 3 460702 2458995 2026-09-21T14:57:49Z StrikerBot 8475 Welcome to Toolforge! 2458995 wikitext text/x-wiki 4deveca37ap39gvxw4e6tvzh9vyb1ir 3 460703 2459001 2026-09-21T15:09:27Z StrikerBot 8475 Welcome to Toolforge! 2459001 wikitext text/x-wiki ep8hnvqrps26fa3k000n38zvlka7ld3 498 460704 2459015 2026-09-21T15:40:14Z Labslogbot 55 Auto update of instance info. 2459015 wikitext text/x-wiki 17z3gim1q6o2w42qt37ev2pczt14t85 498 460705 2459016 2026-09-21T15:41:04Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.create_project (exit_code=0) for trove-only project bier-db in eqiad1 (T438363) 2459016 wikitext text/x-wiki 5cklgmuqgg6v3cliozzr5z2fgemi2a4 0 460706 2459049 2026-09-21T16:46:34Z TBurmeister (WMF) 27417 TBurmeister (WMF) moved page [[Blazegraph Migration: Example Rewrites of the Label Service]] to [[Rewrite of Label Service/Examples]]: Put query rewrite example docs under appropriate parent page 2459049 wikitext text/x-wiki 08golktg196tqfl1ayuqqsthtuggtj2 2459135 2459049 2026-09-21T22:16:41Z JJMC89 7474 Changed redirect target from [[Rewrite of Label Service/Examples]] to [[Wikidata Query Service/Migration/Rewrite of Label Service/Examples]] 2459135 wikitext text/x-wiki k0xtjbbugsegililfnl6acnp2dy6gwv 0 460708 2459053 2026-09-21T16:49:35Z TBurmeister (WMF) 27417 Create placeholder page 2459053 wikitext text/x-wiki 31c5xfz6tkpqg29cba809i0msc0rbgx 2459103 2459053 2026-09-21T20:03:26Z TBurmeister (WMF) 27417 Add template 2459103 wikitext text/x-wiki 97g3rhbrxbe3jz3jvvs3kztjgjrfj8s 0 460709 2459054 2026-09-21T16:50:21Z TBurmeister (WMF) 27417 Create placeholder page 2459054 wikitext text/x-wiki 31c5xfz6tkpqg29cba809i0msc0rbgx 0 460710 2459055 2026-09-21T16:50:56Z TBurmeister (WMF) 27417 Create placeholder page 2459055 wikitext text/x-wiki 31c5xfz6tkpqg29cba809i0msc0rbgx 0 460711 2459068 2026-09-21T18:01:09Z MPopov (WMF) 5891 High-level overview 2459068 wikitext text/x-wiki cdkvof651ujjrcp1cbu8hui3yp0y129 2459097 2459068 2026-09-21T19:47:45Z MPopov (WMF) 5891 Full process of updating queries/pipelines 2459097 wikitext text/x-wiki 54abw6f2yhsidphw8wu5gdarc2z0fki 2459104 2459097 2026-09-21T20:17:59Z KReid-WMF 49588 /* LDAP roles sync */ 2459104 wikitext text/x-wiki 59f4pg32plaz55izq9a8jhk433a2y6c 10 460713 2459100 2026-09-21T19:50:15Z TBurmeister (WMF) 27417 Create page 2459100 wikitext text/x-wiki llbqgfynylhwxtd7qau436etmmq5s7r 3 460714 2459200 2026-09-22T08:19:32Z S.Marchenko 51924 S.Marchenko moved page [[User talk:Shadabgdg]] to [[User talk:Shadab]]: Automatically moved page while renaming the user "[[Special:CentralAuth/Shadabgdg|Shadabgdg]]" to "[[Special:CentralAuth/Shadab|Shadab]]" 2459200 wikitext text/x-wiki skrxpy4pzxs5q67j4ypwt4triivzx7s 3 460715 2459223 2026-09-22T08:51:30Z StrikerBot 8475 Welcome to Toolforge! 2459223 wikitext text/x-wiki iqg7sqrs4v7q89akr77ktmskatg2zqv 3 460716 2459225 2026-09-22T08:53:14Z StrikerBot 8475 Welcome to Toolforge! 2459225 wikitext text/x-wiki 6cdmgewfzddttl4h31rnimzsla18mn8 3 460717 2459228 2026-09-22T08:55:40Z StrikerBot 8475 Welcome to Toolforge! 2459228 wikitext text/x-wiki p20fhtzlabkxvq5ebgrhilw9x7vxusp