Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.1 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 3086 2411755 2409265 2026-05-07T12:02:56Z Stashbot 7414 taavi: draining tools-k8s-worker-106 to investigate T425172 2411755 wikitext text/x-wiki px5z5tsfzeufw88f48wrnknn0vstc0v 0 4108 2411788 2411737 2026-05-07T13:06:46Z Jdforrester (WMF) 468 /* {{Deployment_day|date=2026-05-07}} */ Two done (plus earlier today's). 2411788 wikitext text/x-wiki shq9noomjx37fotx8qzfapmcy8pi00e 2411793 2411788 2026-05-07T13:30:02Z ScheduleDeploymentBot 37566 Add [[gerrit:1270482]] to Monday, May 11 UTC afternoon backport window 2411793 wikitext text/x-wiki b53w91faplhsjrrmfctds1bzniz9qmw 2411875 2411793 2026-05-07T15:31:01Z ScheduleDeploymentBot 37566 Add [[gerrit:1284687]] to Thursday, May 07 UTC late backport window 2411875 wikitext text/x-wiki 9717sjjb0ezc019blzzkzyi37rkx7kz 2411887 2411875 2026-05-07T16:12:43Z ScheduleDeploymentBot 37566 Add [[gerrit:1284575]] to Thursday, May 07 UTC late backport window 2411887 wikitext text/x-wiki 701ilgzwvarezyt8khnmfcnw5h5j5rg 2411894 2411887 2026-05-07T16:15:48Z ScheduleDeploymentBot 37566 Add [[gerrit:1284702]] to Thursday, May 07 UTC late backport window 2411894 wikitext text/x-wiki 3pv4o6n85xuped4qjxnojia4xvi1p44 2411895 2411894 2026-05-07T16:15:55Z ScheduleDeploymentBot 37566 Add [[gerrit:1284703]] to Thursday, May 07 UTC late backport window 2411895 wikitext text/x-wiki o7rry5ync6fp6spgdhcfam4m8tth75p 2411924 2411895 2026-05-07T18:15:47Z ScheduleDeploymentBot 37566 Add [[gerrit:1284771]] to Thursday, May 07 UTC late backport window 2411924 wikitext text/x-wiki elge00afqml6p0gjz2rav0xy1waztmr 2411956 2411924 2026-05-07T20:22:47Z ScheduleDeploymentBot 37566 Add [[gerrit:1284834]] to Thursday, May 07 UTC late backport window 2411956 wikitext text/x-wiki jh0rr039jeflct7b36tt3lc2rcvey4k 2411957 2411956 2026-05-07T20:23:16Z ScheduleDeploymentBot 37566 Add [[gerrit:1284837]] to Thursday, May 07 UTC late backport window 2411957 wikitext text/x-wiki a12gc9h45xvvoh3j3q73g3iw4q1kz1r 2411958 2411957 2026-05-07T20:25:17Z Cscott 41391 Add vendor patches 2411958 wikitext text/x-wiki hgtfh3gnr7oae8e4krqnoi8sqo7dj4t 0 4648 2411947 2377873 2026-05-07T19:41:07Z Cscott 41391 /* Prepare the vendor patch */ Update for 0.24! 2411947 wikitext text/x-wiki 1020wqhkc9q81k8s1hsj6we19qgoxod 0 6479 2412073 2381193 2026-05-08T09:43:28Z Effie Mouzeli (WMF) 12880 /* Pair 2 (rdb1011 and rdb2009) */ 2412073 wikitext text/x-wiki anxeqq1iywpxomwjgj2wyqvedcfevy7 2412075 2412073 2026-05-08T09:47:15Z Effie Mouzeli (WMF) 12880 2412075 wikitext text/x-wiki q6079k38v1ny7fbtojtolgnws85a0qb 0 7919 2411751 2411750 2026-05-07T12:00:13Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on install5004.wikimedia.org with reason: host reimage 2411751 wikitext text/x-wiki 6viwods7mqnhkaxdi1x5twcb61hc4ph 2411752 2411751 2026-05-07T12:02:15Z Stashbot 7414 root@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1205.eqiad.wmnet with reason: host reimage 2411752 wikitext text/x-wiki b49f38mkc5vkfyzd9z5gbqbbv2rrqcy 2411753 2411752 2026-05-07T12:02:32Z Stashbot 7414 daniel@deploy1003: helmfile [staging] START helmfile.d/services/rest-gateway: apply 2411753 wikitext text/x-wiki bdwr0wj7nsmmaghvdqtsjrrznmigxsu 2411754 2411753 2026-05-07T12:02:48Z Stashbot 7414 daniel@deploy1003: helmfile [staging] DONE helmfile.d/services/rest-gateway: apply 2411754 wikitext text/x-wiki lnqtdv4p26dhj6wkneq95zjygt8rgrd 2411756 2411754 2026-05-07T12:05:32Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on install5004.wikimedia.org with reason: host reimage 2411756 wikitext text/x-wiki 9vlyl8izthr0u2wu61bxn6c96x5ytzl 2411757 2411756 2026-05-07T12:06:11Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2168: after reimage to trixie 2411757 wikitext text/x-wiki 9gtc8lkp8g2nmgyteotzy0o9t4jzduo 2411758 2411757 2026-05-07T12:08:14Z Stashbot 7414 root@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1205.eqiad.wmnet with reason: host reimage 2411758 wikitext text/x-wiki s4i8t3o3spc7xcbrcobgzz6a8ir6z1d 2411759 2411758 2026-05-07T12:11:05Z Stashbot 7414 slyngshede@cumin1003: conftool action : set/pooled=yes; selector: cluster=dnsbox,dc=ulsfo,service=authdns-update [reason: ulsfo switch refresh T408892] 2411759 wikitext text/x-wiki huu74oblx4pub6pzci5htz7hwznrnnn 2411760 2411759 2026-05-07T12:11:11Z Stashbot 7414 daniel@deploy1003: helmfile [eqiad] START helmfile.d/services/rest-gateway: apply 2411760 wikitext text/x-wiki a6zteqp7rt1djhfqioj02pqo9xb27la 2411761 2411760 2026-05-07T12:11:32Z Stashbot 7414 daniel@deploy1003: helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply 2411761 wikitext text/x-wiki eey2xwegrv6ooxdbf4bw5umbjfwmyk6 2411762 2411761 2026-05-07T12:11:35Z Stashbot 7414 slyngshede@dns1004: START - running authdns-update 2411762 wikitext text/x-wiki jsmw4qmqicnl4ffbgpqgyyd2k9inr7v 2411763 2411762 2026-05-07T12:12:56Z Stashbot 7414 slyngshede@dns1004: FAIL - running authdns-update 2411763 wikitext text/x-wiki da75xw8g65xqfzrkvint67cse25k3kq 2411764 2411763 2026-05-07T12:17:59Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "add lswtest back as being planned won't work - cmooney@cumin1003" 2411764 wikitext text/x-wiki 9v36d1219gqvrgyw5svad7o1wpkxfta 2411765 2411764 2026-05-07T12:18:23Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "add lswtest back as being planned won't work - cmooney@cumin1003" 2411765 wikitext text/x-wiki pmb8w6emccy93d3dwke8zqbitjv34m9 2411766 2411765 2026-05-07T12:18:32Z Stashbot 7414 moritzm: installing init-system-helpers bugfix updates from Bookworm point release 2411766 wikitext text/x-wiki cqwvo9kdg9h1isil7jcws4kisd05dkm 2411767 2411766 2026-05-07T12:21:44Z Stashbot 7414 slyngshede@dns1004: START - running authdns-update 2411767 wikitext text/x-wiki 5u1m2dhxqjhxvir5o2f1aa8032vmyuo 2411768 2411767 2026-05-07T12:23:04Z Stashbot 7414 slyngshede@dns1004: FAIL - running authdns-update 2411768 wikitext text/x-wiki ku42ms6kcuciu98e5ys7lpd7jj3ujf8 2411769 2411768 2026-05-07T12:24:31Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host install5004.wikimedia.org with OS bookworm 2411769 wikitext text/x-wiki fwhhal21k3e96xj9dk8lwvhgj9gtezm 2411770 2411769 2026-05-07T12:24:32Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host install5004.wikimedia.org 2411770 wikitext text/x-wiki p1a8ywmox2eb8hdvg4hyxbr72hc6byt 2411771 2411770 2026-05-07T12:30:11Z Stashbot 7414 root@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1205.eqiad.wmnet with OS trixie 2411771 wikitext text/x-wiki 03gcnmdxabx5y99j3awskrkfpicvsgl 2411774 2411771 2026-05-07T12:44:20Z Stashbot 7414 sukhe@dns1004: START - running authdns-update 2411774 wikitext text/x-wiki 8ww0hhugpis6e3yfmlwsjylnklpc44c 2411775 2411774 2026-05-07T12:45:40Z Stashbot 7414 sukhe@dns1004: FAIL - running authdns-update 2411775 wikitext text/x-wiki 0xfg1cnz5slh9dtl1yfzgp0alge7cu9 2411777 2411775 2026-05-07T12:50:38Z Stashbot 7414 jforrester@deploy1003: helmfile [eqiad] START helmfile.d/services/wikifunctions: apply 2411777 wikitext text/x-wiki 256bzfb6whn4c9m4384f76ekedyl3at 2411778 2411777 2026-05-07T12:51:16Z Stashbot 7414 jforrester@deploy1003: helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply 2411778 wikitext text/x-wiki asmdkvj6bxe62p4y99rg9wazb9gm6qa 2411779 2411778 2026-05-07T12:51:22Z Stashbot 7414 jforrester@deploy1003: helmfile [codfw] START helmfile.d/services/wikifunctions: apply 2411779 wikitext text/x-wiki 8m0nd2qv7wgfimaatieyvzhfpvpujge 2411780 2411779 2026-05-07T12:51:56Z Stashbot 7414 jforrester@deploy1003: helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply 2411780 wikitext text/x-wiki 5hia956soq341rrwaalyaf9fe59fh5u 2411782 2411780 2026-05-07T12:55:29Z Stashbot 7414 sukhe@cumin1003: START - Cookbook sre.dns.netbox 2411782 wikitext text/x-wiki 6w1yvvmwt1srfbaklyn23eyfjgh184q 2411783 2411782 2026-05-07T12:58:13Z Stashbot 7414 sukhe@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2411783 wikitext text/x-wiki t505ax0u76pvnzqheootc7y636hzpg2 2411784 2411783 2026-05-07T13:02:53Z Stashbot 7414 slyngshede@cumin1003: conftool action : set/pooled=yes; selector: name=dns4004.wikimedia.org [reason: ulsfo switch refresh T408892] 2411784 wikitext text/x-wiki ige7dy5obrqfqknhhjfz8egsugmnjk9 2411785 2411784 2026-05-07T13:03:48Z Stashbot 7414 jforrester@deploy1003: Started scap sync-world: Backport for [[gerrit:1284547|Remove the progress bar]], [[gerrit:1275467|mc: Set server, instead of host and port, for wgWikiLambdaObjectCaches (T423311)]] 2411785 wikitext text/x-wiki 9tkssjiemddcpbhpc8d4bym9zc3tui3 2411786 2411785 2026-05-07T13:05:45Z Stashbot 7414 jforrester@deploy1003: rzl, jforrester, hartman: Backport for [[gerrit:1284547|Remove the progress bar]], [[gerrit:1275467|mc: Set server, instead of host and port, for wgWikiLambdaObjectCaches (T423311)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2411786 wikitext text/x-wiki f2npqbjy3kyct38zx7p7vkrajjjklvo 2411787 2411786 2026-05-07T13:06:29Z Stashbot 7414 jforrester@deploy1003: rzl, jforrester, hartman: Continuing with deployment 2411787 wikitext text/x-wiki nodjsn7g0niyq8b5mwlz20odixmevmq 2411789 2411787 2026-05-07T13:10:43Z Stashbot 7414 jforrester@deploy1003: Finished scap sync-world: Backport for [[gerrit:1284547|Remove the progress bar]], [[gerrit:1275467|mc: Set server, instead of host and port, for wgWikiLambdaObjectCaches (T423311)]] (duration: 06m 55s) 2411789 wikitext text/x-wiki 2t8clhbp9rwfi1itpld2mhwxeck8gcp 2411790 2411789 2026-05-07T13:23:35Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2411790 wikitext text/x-wiki d7obhj8epa8i50zfpyykibmdeyn2bfb 2411791 2411790 2026-05-07T13:25:29Z Stashbot 7414 stran@deploy1003: Started scap sync-world: Backport for [[gerrit:1284553|Enable staggered rollout for IRS on enwiki (T424008)]], [[gerrit:1284569|Fix when user is considered exposed to the feature in the experiment (T424075)]] 2411791 wikitext text/x-wiki n9vogc1xzfh2e87v7xmlnw9tusao3k3 2411792 2411791 2026-05-07T13:27:27Z Stashbot 7414 stran@deploy1003: stran: Backport for [[gerrit:1284553|Enable staggered rollout for IRS on enwiki (T424008)]], [[gerrit:1284569|Fix when user is considered exposed to the feature in the experiment (T424075)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2411792 wikitext text/x-wiki 4x6b5joe3y61hyz3jgfd5nl51tb40y6 2411794 2411792 2026-05-07T13:30:22Z Stashbot 7414 stran@deploy1003: stran: Continuing with deployment 2411794 wikitext text/x-wiki ti1hp280lnwtkzhwr6vzriunen95a27 2411795 2411794 2026-05-07T13:34:35Z Stashbot 7414 stran@deploy1003: Finished scap sync-world: Backport for [[gerrit:1284553|Enable staggered rollout for IRS on enwiki (T424008)]], [[gerrit:1284569|Fix when user is considered exposed to the feature in the experiment (T424075)]] (duration: 09m 05s) 2411795 wikitext text/x-wiki qitdjikjrnueg31x6bgenbddsm4b6nn 2411798 2411795 2026-05-07T13:53:32Z Stashbot 7414 jasmine@cumin2002: START - Cookbook sre.kafka.roll-restart-reboot-brokers rolling restart_daemons on A:kafka-main-codfw 2411798 wikitext text/x-wiki gkiwrhtyosgvthgzrsy79ifgvrrhwr5 2411799 2411798 2026-05-07T14:10:20Z Stashbot 7414 ebysans@deploy1003: helmfile [staging] START helmfile.d/services/device-analytics: apply 2411799 wikitext text/x-wiki qhtodnpbs21rc75i4f7rkgjlgdvq93i 2411800 2411799 2026-05-07T14:10:28Z Stashbot 7414 ebysans@deploy1003: helmfile [staging] DONE helmfile.d/services/device-analytics: apply 2411800 wikitext text/x-wiki j91k9atb3qgifrxc6taikfp3tzybfbk 2411801 2411800 2026-05-07T14:12:06Z Stashbot 7414 ebysans@deploy1003: helmfile [eqiad] START helmfile.d/services/device-analytics: apply 2411801 wikitext text/x-wiki e8yy234buwjvskxot4h4ds7qsxuu0on 2411802 2411801 2026-05-07T14:12:21Z Stashbot 7414 ebysans@deploy1003: helmfile [eqiad] DONE helmfile.d/services/device-analytics: apply 2411802 wikitext text/x-wiki ak30b51aw3mgfswgmzo749vkh0r3di8 2411803 2411802 2026-05-07T14:12:23Z Stashbot 7414 jasmine@cumin2002: END (PASS) - Cookbook sre.kafka.roll-restart-reboot-brokers (exit_code=0) rolling restart_daemons on A:kafka-main-codfw 2411803 wikitext text/x-wiki 4n7masbzzteoigkl1ztusivalnkrbh6 2411805 2411803 2026-05-07T14:24:37Z Stashbot 7414 slyngshede@cumin1003: START - Cookbook sre.dns.netbox 2411805 wikitext text/x-wiki 5s7mqj9d287ut7ufn00ayizejl6ppks 2411806 2411805 2026-05-07T14:25:11Z Stashbot 7414 ebysans@deploy1003: helmfile [codfw] START helmfile.d/services/device-analytics: apply 2411806 wikitext text/x-wiki e3rqvwjky2zvwm0n8sl7ayfxysbjlz2 2411807 2411806 2026-05-07T14:25:14Z Stashbot 7414 ebysans@deploy1003: helmfile [codfw] DONE helmfile.d/services/device-analytics: apply 2411807 wikitext text/x-wiki fpxxqwmx9kyareo449123m8scf2tvjr 2411808 2411807 2026-05-07T14:26:04Z Stashbot 7414 ebysans@deploy1003: helmfile [staging] START helmfile.d/services/edit-analytics: apply 2411808 wikitext text/x-wiki 20rzgoe8mpxigc62uumwjt6n9o3nzi6 2411809 2411808 2026-05-07T14:26:20Z Stashbot 7414 ebysans@deploy1003: helmfile [staging] DONE helmfile.d/services/edit-analytics: apply 2411809 wikitext text/x-wiki lytmvwo5n4o2p3kmj999xevws3hepqo 2411810 2411809 2026-05-07T14:28:26Z Stashbot 7414 slyngshede@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: updating DNS snippets - slyngshede@cumin1003" 2411810 wikitext text/x-wiki 7kcxfkszlxhqg560uqj20ghwsvscq8c 2411811 2411810 2026-05-07T14:28:31Z Stashbot 7414 slyngshede@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: updating DNS snippets - slyngshede@cumin1003" 2411811 wikitext text/x-wiki q3m0nnz4q04sdifa5p0y06p7u68b32x 2411812 2411811 2026-05-07T14:28:32Z Stashbot 7414 slyngshede@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2411812 wikitext text/x-wiki ljwvcgdyv4w989s5rfe4aw6s5cb9ehn 2411813 2411812 2026-05-07T14:28:47Z Stashbot 7414 jmm@dns1004: START - running authdns-update 2411813 wikitext text/x-wiki r63krpo1pahuhsz437vchpcilq73uvn 2411814 2411813 2026-05-07T14:28:51Z Stashbot 7414 ebysans@deploy1003: helmfile [eqiad] START helmfile.d/services/edit-analytics: apply 2411814 wikitext text/x-wiki 6nv5wtbybvw25cvqgxuoo55pu52uo7m 2411815 2411814 2026-05-07T14:29:07Z Stashbot 7414 ebysans@deploy1003: helmfile [eqiad] DONE helmfile.d/services/edit-analytics: apply 2411815 wikitext text/x-wiki jjmpk42y9keq5yndif812psvx70aqqn 2411816 2411815 2026-05-07T14:30:12Z Stashbot 7414 jmm@dns1004: END - running authdns-update 2411816 wikitext text/x-wiki jw6rjdqpnt020blsdcussm7bgse32ab 2411817 2411816 2026-05-07T14:30:25Z Stashbot 7414 akhatun: Deploying Refinery at 4734c67 for weekly deployment train 2411817 wikitext text/x-wiki bfoj9834qkm5tyc8j52xc33t63j5ej9 2411818 2411817 2026-05-07T14:30:36Z Stashbot 7414 ebysans@deploy1003: helmfile [codfw] START helmfile.d/services/edit-analytics: apply 2411818 wikitext text/x-wiki 8802cyvkr0he6hnh7vtyjzemhlz2cjg 2411819 2411818 2026-05-07T14:30:39Z Stashbot 7414 ebysans@deploy1003: helmfile [codfw] DONE helmfile.d/services/edit-analytics: apply 2411819 wikitext text/x-wiki fuo226l3stq8730qhx5fup05af13f0i 2411820 2411819 2026-05-07T14:30:53Z Stashbot 7414 slyngshede@dns1004: START - running authdns-update 2411820 wikitext text/x-wiki mo0nqcrq5uc6abbahx5gslaj7wqbxp4 2411821 2411820 2026-05-07T14:30:59Z Stashbot 7414 ebysans@deploy1003: helmfile [staging] START helmfile.d/services/editor-analytics: apply 2411821 wikitext text/x-wiki pfyhkv05lpkt3exslzv3p84hj6oxm2e 2411822 2411821 2026-05-07T14:31:07Z Stashbot 7414 ebysans@deploy1003: helmfile [staging] DONE helmfile.d/services/editor-analytics: apply 2411822 wikitext text/x-wiki 17b8ctkvfqf5toqown0t8atwedlq6ud 2411823 2411822 2026-05-07T14:31:24Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply 2411823 wikitext text/x-wiki t78usa6e27phb7aovnop25o17l4d4fr 2411824 2411823 2026-05-07T14:31:59Z Stashbot 7414 akhatun@deploy1003: Started deploy [analytics/refinery@4734c67] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@4734c67c] 2411824 wikitext text/x-wiki 9a21amdtpd7mmzkbxf6i83jdj2rnxte 2411825 2411824 2026-05-07T14:32:02Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply 2411825 wikitext text/x-wiki 7bs5skhv4hq1pngwofycov5ma3217bd 2411826 2411825 2026-05-07T14:32:13Z Stashbot 7414 slyngshede@dns1004: END - running authdns-update 2411826 wikitext text/x-wiki smrpyzfpm7r8zwa6nos06os2lhz37ag 2411827 2411826 2026-05-07T14:32:49Z Stashbot 7414 slyngshede@cumin1003: conftool action : set/pooled=yes; selector: cluster=dnsbox,dc=ulsfo [reason: ulsfo switch refresh T408892] 2411827 wikitext text/x-wiki qo2sognb4k8rpe46ftgcxbmcdvhdqze 2411828 2411827 2026-05-07T14:33:53Z Stashbot 7414 akhatun@deploy1003: Finished deploy [analytics/refinery@4734c67] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@4734c67c] (duration: 01m 54s) 2411828 wikitext text/x-wiki lpb3e7hhkjkzcv93t1631praphe5mhs 2411829 2411828 2026-05-07T14:35:36Z Stashbot 7414 ebysans@deploy1003: helmfile [eqiad] START helmfile.d/services/editor-analytics: apply 2411829 wikitext text/x-wiki 3qpc9t68hqv1g44vy2eudk7pwoulufi 2411830 2411829 2026-05-07T14:35:50Z Stashbot 7414 ebysans@deploy1003: helmfile [eqiad] DONE helmfile.d/services/editor-analytics: apply 2411830 wikitext text/x-wiki m9ftnroxmzdz9wr8iqhjhr7avpbjbrg 2411831 2411830 2026-05-07T14:36:02Z Stashbot 7414 akhatun@deploy1003: Started deploy [analytics/refinery@4734c67]: Regular analytics weekly train [analytics/refinery@4734c67c] 2411831 wikitext text/x-wiki o35dwc7mjqixsvr8dqmf7wyos7jlw7d 2411832 2411831 2026-05-07T14:36:59Z Stashbot 7414 ebysans@deploy1003: helmfile [staging] START helmfile.d/services/geo-analytics: apply 2411832 wikitext text/x-wiki sze7jlygm2fgz9bjlsrthhmn5n7acmb 2411833 2411832 2026-05-07T14:37:08Z Stashbot 7414 ebysans@deploy1003: helmfile [staging] DONE helmfile.d/services/geo-analytics: apply 2411833 wikitext text/x-wiki d4g82779y8w9j9luuy4xzasuw2djrd3 2411834 2411833 2026-05-07T14:40:07Z Stashbot 7414 jasmine@cumin2002: START - Cookbook sre.kafka.roll-restart-reboot-brokers rolling restart_daemons on A:kafka-main-eqiad 2411834 wikitext text/x-wiki 675sc0yait2q6f6pv9tq49wrtfli1uv 2411835 2411834 2026-05-07T14:40:40Z Stashbot 7414 akhatun@deploy1003: Finished deploy [analytics/refinery@4734c67]: Regular analytics weekly train [analytics/refinery@4734c67c] (duration: 04m 38s) 2411835 wikitext text/x-wiki 4vxzgjqtkwrggg3iinodj3vrablx7vl 2411836 2411835 2026-05-07T14:42:02Z Stashbot 7414 akhatun@deploy1003: Started deploy [analytics/refinery@4734c67] (thin): Regular analytics weekly train THIN [analytics/refinery@4734c67c] 2411836 wikitext text/x-wiki 8z2xy34aly9w63i50yn5zd1f02e3ssq 2411837 2411836 2026-05-07T14:43:13Z Stashbot 7414 ebysans@deploy1003: helmfile [eqiad] START helmfile.d/services/geo-analytics: apply 2411837 wikitext text/x-wiki csg90m315anng5yfdgvwu19j4dic9t2 2411838 2411837 2026-05-07T14:43:30Z Stashbot 7414 ebysans@deploy1003: helmfile [eqiad] DONE helmfile.d/services/geo-analytics: apply 2411838 wikitext text/x-wiki 2kmd2obmhrxfn8z7xxpd57zhj4rjpdi 2411839 2411838 2026-05-07T14:44:03Z Stashbot 7414 akhatun@deploy1003: Finished deploy [analytics/refinery@4734c67] (thin): Regular analytics weekly train THIN [analytics/refinery@4734c67c] (duration: 02m 01s) 2411839 wikitext text/x-wiki 4jvnhry5nsoahg4k9jbk8xm9qn0qdbm 2411840 2411839 2026-05-07T14:50:51Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2411840 wikitext text/x-wiki pjp0wfe20aw0qybn741mmznqezgr97x 2411841 2411840 2026-05-07T14:52:14Z Stashbot 7414 ebysans@deploy1003: helmfile [eqiad] START helmfile.d/services/media-analytics: apply 2411841 wikitext text/x-wiki 59ov6igx1zqpu8t52u7v6vi5jr2ix3a 2411842 2411841 2026-05-07T14:52:30Z Stashbot 7414 ebysans@deploy1003: helmfile [eqiad] DONE helmfile.d/services/media-analytics: apply 2411842 wikitext text/x-wiki dkqvczqiy1bekoiuozo3if0vw95odvp 2411843 2411842 2026-05-07T14:52:31Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2411843 wikitext text/x-wiki fay40sikv1s0774hvong8fovjuu0f2p 2411845 2411843 2026-05-07T14:53:28Z Stashbot 7414 ebysans@deploy1003: helmfile [codfw] START helmfile.d/services/media-analytics: apply 2411845 wikitext text/x-wiki fucob55tpixu8c4krfoaqladv2ngj86 2411846 2411845 2026-05-07T14:53:31Z Stashbot 7414 ebysans@deploy1003: helmfile [codfw] DONE helmfile.d/services/media-analytics: apply 2411846 wikitext text/x-wiki kmhuftnp689gdw638lqh8e41t8n8aig 2411847 2411846 2026-05-07T14:54:05Z Stashbot 7414 ebysans@deploy1003: helmfile [staging] START helmfile.d/services/page-analytics: apply 2411847 wikitext text/x-wiki 0s67xwb3fp31g6pzjg7lliw6wja3yul 2411848 2411847 2026-05-07T14:54:13Z Stashbot 7414 ebysans@deploy1003: helmfile [staging] DONE helmfile.d/services/page-analytics: apply 2411848 wikitext text/x-wiki c4rn9fnhtgyed6kl1nkl7g7pogdqnxu 2411849 2411848 2026-05-07T14:54:24Z Stashbot 7414 ebysans@deploy1003: helmfile [eqiad] START helmfile.d/services/page-analytics: apply 2411849 wikitext text/x-wiki 35tyvug4qhezyfqktehh5eqx6fbo6fx 2411850 2411849 2026-05-07T14:54:40Z Stashbot 7414 ebysans@deploy1003: helmfile [eqiad] DONE helmfile.d/services/page-analytics: apply 2411850 wikitext text/x-wiki 6w3vb4u4rujxgueiylhsr28ux89t4dx 2411851 2411850 2026-05-07T14:58:59Z Stashbot 7414 jasmine@cumin2002: END (PASS) - Cookbook sre.kafka.roll-restart-reboot-brokers (exit_code=0) rolling restart_daemons on A:kafka-main-eqiad 2411851 wikitext text/x-wiki ndc5vk3xy9yiauru62u9g67et9b9nkb 2411852 2411851 2026-05-07T15:01:23Z Stashbot 7414 akhatun: Deployed refinery using scap, then deployed onto hdfs 2411852 wikitext text/x-wiki f8tqha2rqqoktzr4zk2q9rxdxnysxzb 2411853 2411852 2026-05-07T15:03:07Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2411853 wikitext text/x-wiki f4lb85dmoddisvposm2y1b7uvt3csmu 2411854 2411853 2026-05-07T15:03:08Z Stashbot 7414 ebysans@deploy1003: helmfile [staging] START helmfile.d/services/edit-analytics: apply 2411854 wikitext text/x-wiki pbj5smhzyn4kevxsj9ltp5zvsmx9e0g 2411855 2411854 2026-05-07T15:03:17Z Stashbot 7414 ebysans@deploy1003: helmfile [staging] DONE helmfile.d/services/edit-analytics: apply 2411855 wikitext text/x-wiki 3qpb6anaeea6riti9b6dcjqfrhgmyrf 2411857 2411855 2026-05-07T15:05:08Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2411857 wikitext text/x-wiki kfn6nibjsz5qo5l18hnf032xzz6ba5r 2411858 2411857 2026-05-07T15:05:47Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply 2411858 wikitext text/x-wiki f38b3l9rg5jeyz7d790exeza67qrhfd 2411859 2411858 2026-05-07T15:06:16Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply 2411859 wikitext text/x-wiki lrvzitvg6esr9yie4qeg1wswpd3majk 2411860 2411859 2026-05-07T15:06:29Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/services/miscweb: apply 2411860 wikitext text/x-wiki if94h7k1j5n8s7ibsa4j9ea4ugfr5x6 2411861 2411860 2026-05-07T15:06:57Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/services/miscweb: apply 2411861 wikitext text/x-wiki cig3wwg2s8waol1ie0stn13u5wsbdgn 2411862 2411861 2026-05-07T15:12:41Z Stashbot 7414 sukhe@cumin1003: START - Cookbook sre.dns.admin DNS admin: depool ulsfo for service: upload-addrs [reason: no reason specified, no task ID specified] 2411862 wikitext text/x-wiki 3antqt579oyq5fxu6l8olpsgkcw932n 2411863 2411862 2026-05-07T15:12:44Z Stashbot 7414 sukhe@cumin1003: END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: depool ulsfo for service: upload-addrs [reason: no reason specified, no task ID specified] 2411863 wikitext text/x-wiki 7qnrtadyebgnrweq1wbj1n88q67ct6n 2411864 2411863 2026-05-07T15:15:22Z Stashbot 7414 sukhe@puppetserver1001: conftool action : set/pooled=yes; selector: name=cp4050.ulsfo.wmnet 2411864 wikitext text/x-wiki ekdb03adntonlb5zj73hyrf9j6n09rc 2411865 2411864 2026-05-07T15:18:19Z Stashbot 7414 sukhe@cumin1003: START - Cookbook sre.loadbalancer.admin config_reloading P{lvs4009*} and A:liberica 2411865 wikitext text/x-wiki hgw2kt41lsyz98bt9m9z3zcuylcka3g 2411866 2411865 2026-05-07T15:18:27Z Stashbot 7414 sukhe@cumin1003: END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) config_reloading P{lvs4009*} and A:liberica 2411866 wikitext text/x-wiki 8bub9owpwo9gnuuqjhandvmx0tcr9vw 2411867 2411866 2026-05-07T15:22:01Z Stashbot 7414 sukhe@cumin1003: START - Cookbook sre.hosts.remove-downtime for 39 hosts 2411867 wikitext text/x-wiki 17f9rac9d5i7pgl83oq1gbrje29g3pf 2411868 2411867 2026-05-07T15:22:25Z Stashbot 7414 sukhe@cumin1003: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for 39 hosts 2411868 wikitext text/x-wiki hbsphioy08bnxmmhzczuayenr9hhvkc 2411869 2411868 2026-05-07T15:23:05Z Stashbot 7414 sukhe@cumin1003: START - Cookbook sre.loadbalancer.upgrade restart P{lvs4009*} and A:liberica 2411869 wikitext text/x-wiki akutw0ahybw4cylewlmydcdlv874jul 2411870 2411869 2026-05-07T15:23:20Z Stashbot 7414 sukhe@cumin1003: START - Cookbook sre.loadbalancer.admin depooling P{lvs4009.ulsfo.wmnet} and A:liberica 2411870 wikitext text/x-wiki q9aouai3zbt5h4nhyy9enqh16x13lu2 2411871 2411870 2026-05-07T15:23:33Z Stashbot 7414 sukhe@cumin1003: END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) depooling P{lvs4009.ulsfo.wmnet} and A:liberica 2411871 wikitext text/x-wiki 61nplme8fa91dbl4wxj0z1hizgt09yn 2411872 2411871 2026-05-07T15:23:42Z Stashbot 7414 sukhe@cumin1003: START - Cookbook sre.loadbalancer.admin pooling P{lvs4009.ulsfo.wmnet} and A:liberica 2411872 wikitext text/x-wiki i4roikzhv44322hjc5rk1hvhorg8qg6 2411873 2411872 2026-05-07T15:24:03Z Stashbot 7414 sukhe@cumin1003: END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) pooling P{lvs4009.ulsfo.wmnet} and A:liberica 2411873 wikitext text/x-wiki 1m5c6h9os4beg4qp6efjkskfipj8pmn 2411874 2411873 2026-05-07T15:24:06Z Stashbot 7414 sukhe@cumin1003: END (PASS) - Cookbook sre.loadbalancer.upgrade (exit_code=0) restart P{lvs4009*} and A:liberica 2411874 wikitext text/x-wiki l5gxz08bd5ezltm0ahodm03p0fc5t7h 2411876 2411874 2026-05-07T15:31:39Z Stashbot 7414 ebysans@deploy1003: helmfile [eqiad] START helmfile.d/services/edit-analytics: apply 2411876 wikitext text/x-wiki fueltm7mjle6xs8c59yxlg2jhgfamlf 2411877 2411876 2026-05-07T15:31:55Z Stashbot 7414 sukhe@cumin1003: START - Cookbook sre.dns.admin DNS admin: pool ulsfo for service: upload-addrs [reason: no reason specified, no task ID specified] 2411877 wikitext text/x-wiki mayoo5aulyr4dd6lcp2eclajphrqmrn 2411878 2411877 2026-05-07T15:31:56Z Stashbot 7414 ebysans@deploy1003: helmfile [eqiad] DONE helmfile.d/services/edit-analytics: apply 2411878 wikitext text/x-wiki 807i5xg7c15n76ush1lg51eblufeubp 2411879 2411878 2026-05-07T15:31:57Z Stashbot 7414 sukhe@cumin1003: END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: pool ulsfo for service: upload-addrs [reason: no reason specified, no task ID specified] 2411879 wikitext text/x-wiki 9vv63c1ipoowgsd5x8gyrhtsq2q32qg 2411880 2411879 2026-05-07T15:32:41Z Stashbot 7414 ebysans@deploy1003: helmfile [codfw] START helmfile.d/services/edit-analytics: apply 2411880 wikitext text/x-wiki 2khmhsgh4xthl87uqs1ycpkxomf6tmi 2411881 2411880 2026-05-07T15:32:56Z Stashbot 7414 ebysans@deploy1003: helmfile [codfw] DONE helmfile.d/services/edit-analytics: apply 2411881 wikitext text/x-wiki odtp07eu0p40e31o35deqygdz902swh 2411883 2411881 2026-05-07T15:44:20Z Stashbot 7414 sukhe@cumin1003: START - Cookbook sre.dns.roll-restart-ntp rolling restart_daemons on A:dnsbox and A:ulsfo and (A:dnsbox) 2411883 wikitext text/x-wiki 5r6odw0v6yeqcjygfct9z09keim6jzp 2411884 2411883 2026-05-07T15:50:34Z Stashbot 7414 jynus@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on ms-backup[2003-2004].codfw.wmnet,ms-backup[1003-1004].eqiad.wmnet with reason: restart 2411884 wikitext text/x-wiki 1daflymydhtrtwlwp0d4e0dn7a9umuo 2411885 2411884 2026-05-07T16:01:26Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/services/miscweb: apply 2411885 wikitext text/x-wiki nc8rmuvhc0tvvsh475fph3zyrrce8vt 2411886 2411885 2026-05-07T16:02:15Z Stashbot 7414 sukhe@cumin1003: END (PASS) - Cookbook sre.dns.roll-restart-ntp (exit_code=0) rolling restart_daemons on A:dnsbox and A:ulsfo and (A:dnsbox) 2411886 wikitext text/x-wiki ag1no8p5qvzsibbfbd4sktfjvhs5n4h 2411888 2411886 2026-05-07T16:12:56Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/services/miscweb: apply 2411888 wikitext text/x-wiki 5yezyqwjuvsnjetca14udnnbrg9d421 2411889 2411888 2026-05-07T16:13:01Z Stashbot 7414 sukhe@dns1004: START - running authdns-update 2411889 wikitext text/x-wiki hm7n17wx1djx1d8s018ioepmmc6qm3u 2411890 2411889 2026-05-07T16:13:07Z Stashbot 7414 sukhe@dns1004: START - running authdns-update 2411890 wikitext text/x-wiki 6cpac0dtqxtbf304r7tf3yyiboo19v5 2411892 2411890 2026-05-07T16:14:50Z Stashbot 7414 sukhe@dns1004: END - running authdns-update 2411892 wikitext text/x-wiki elwampingd1bt3al7qv6i7bckwskyaf 2411900 2411892 2026-05-07T16:25:21Z Stashbot 7414 jynus@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on 36 hosts with reason: restart 2411900 wikitext text/x-wiki s4qeyvxyzy5e3pwes4rkjxlsmgabecw 2411901 2411900 2026-05-07T16:30:24Z Stashbot 7414 jynus@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2183.codfw.wmnet,db1204.eqiad.wmnet with reason: restart 2411901 wikitext text/x-wiki ia3mu0lvrlp85jnsz46o0g0fkkzifn9 2411902 2411901 2026-05-07T16:32:35Z Stashbot 7414 jynus: restarting backup1-* database primary hosts 2411902 wikitext text/x-wiki 6rdpr1049selch949mqb7jf6axptqhy 2411903 2411902 2026-05-07T16:33:52Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/services/miscweb: apply 2411903 wikitext text/x-wiki rwi3oxznzx3hdd90i2or9y0936e6ozr 2411904 2411903 2026-05-07T16:34:15Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/services/miscweb: apply 2411904 wikitext text/x-wiki lu8cb75hy40kfb9uya2ydda57y10zwr 2411905 2411904 2026-05-07T16:35:58Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply 2411905 wikitext text/x-wiki fw187fm6ybzib3561bes6c7ywwszt0j 2411906 2411905 2026-05-07T16:47:03Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply 2411906 wikitext text/x-wiki 1vgmdbi0rx2xrlhwgf8jfa151lsu3fh 2411907 2411906 2026-05-07T16:48:11Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply 2411907 wikitext text/x-wiki e44se7x5ru4pullp3tu5z8q36fbgjne 2411908 2411907 2026-05-07T16:48:47Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply 2411908 wikitext text/x-wiki 8etuu5de0x45lklfyi9yfhyspl978ps 2411909 2411908 2026-05-07T16:50:19Z Stashbot 7414 jynus@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2199.codfw.wmnet,db1245.eqiad.wmnet with reason: restart 2411909 wikitext text/x-wiki 4znw2ytlccohhqg6pns8kthgpkiv6ss 2411910 2411909 2026-05-07T17:06:54Z Stashbot 7414 jynus@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on db2200.codfw.wmnet,db1216.eqiad.wmnet with reason: restart 2411910 wikitext text/x-wiki q56bkq8jux8b31qu7c0wn05ahmscnun 2411911 2411910 2026-05-07T17:32:45Z Stashbot 7414 ebysans@deploy1003: helmfile [staging] START helmfile.d/services/geo-analytics: apply 2411911 wikitext text/x-wiki 40p5fb3djvjweh0i78manq2zc8v0zbh 2411912 2411911 2026-05-07T17:32:58Z Stashbot 7414 ebysans@deploy1003: helmfile [staging] DONE helmfile.d/services/geo-analytics: apply 2411912 wikitext text/x-wiki rrpaeask42begh92jq8x3a67dc3ht6i 2411913 2411912 2026-05-07T17:33:34Z Stashbot 7414 krinkle@deploy1003: Started scap sync-world: Backport for [[gerrit:1237662|Profiler: Set explicit "excimer-wall" redis channel instead of concat]] 2411913 wikitext text/x-wiki ll6x50fhw4k17jyv1j61x8gg8yvrlsd 2411914 2411913 2026-05-07T17:45:44Z Stashbot 7414 ebysans@deploy1003: helmfile [staging] START helmfile.d/services/editor-analytics: apply 2411914 wikitext text/x-wiki e09lmhpimsl6itkneg8jhrq8zg3dcmp 2411915 2411914 2026-05-07T17:45:56Z Stashbot 7414 ebysans@deploy1003: helmfile [staging] DONE helmfile.d/services/editor-analytics: apply 2411915 wikitext text/x-wiki 4q9mfkjuqo0u73oq1y7nlvv4hn3xgt7 2411916 2411915 2026-05-07T17:50:54Z Stashbot 7414 krinkle@deploy1003: krinkle: Backport for [[gerrit:1237662|Profiler: Set explicit "excimer-wall" redis channel instead of concat]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2411916 wikitext text/x-wiki h9r0h9egm8dq5i75r6qa4k5cndn82w1 2411917 2411916 2026-05-07T17:51:15Z Stashbot 7414 krinkle@deploy1003: krinkle: Continuing with deployment 2411917 wikitext text/x-wiki oea92d07i9b9g54b9nw4llz8hgym618 2411918 2411917 2026-05-07T17:58:58Z Stashbot 7414 ebysans@deploy1003: helmfile [staging] START helmfile.d/services/device-analytics: apply 2411918 wikitext text/x-wiki n1nq43pryd1nkbclf210k5nue6uh29n 2411919 2411918 2026-05-07T17:59:08Z Stashbot 7414 ebysans@deploy1003: helmfile [staging] DONE helmfile.d/services/device-analytics: apply 2411919 wikitext text/x-wiki a6n9edb9vxaksfc1q5pww77lliokt1p 2411920 2411919 2026-05-07T18:02:10Z Stashbot 7414 brennen: 1.47.0-wmf.1 train status (T423910): blockers resolved, rolling to all wikis 2411920 wikitext text/x-wiki inb6p7fvj233fvnxk1bruf9wsp7emev 2411921 2411920 2026-05-07T18:02:59Z Stashbot 7414 krinkle@deploy1003: Finished scap sync-world: Backport for [[gerrit:1237662|Profiler: Set explicit "excimer-wall" redis channel instead of concat]] (duration: 29m 24s) 2411921 wikitext text/x-wiki oozi4vu29x2j0k1ankwv3rdoxcfc2ab 2411922 2411921 2026-05-07T18:04:30Z Stashbot 7414 cdanis@dns1005: START - running authdns-update 2411922 wikitext text/x-wiki b0rwq6fbpcjsfm9dnmxfj452itszo8f 2411923 2411922 2026-05-07T18:06:10Z Stashbot 7414 cdanis@dns1005: END - running authdns-update 2411923 wikitext text/x-wiki ovype45m1n6l9a92kfkaduca30t1a3z 2411925 2411923 2026-05-07T18:17:18Z Stashbot 7414 brennen@deploy1003: rebuilt and synchronized wikiversions files: group2 to 1.47.0-wmf.1 refs T423910 2411925 wikitext text/x-wiki tcxzmzby375nunu08zg6ngjg66p6c19 2411926 2411925 2026-05-07T18:18:44Z Stashbot 7414 ebysans@deploy1003: helmfile [eqiad] START helmfile.d/services/geo-analytics: apply 2411926 wikitext text/x-wiki mjtly07dp3t2fy07qmdf8u27i1u1s4g 2411927 2411926 2026-05-07T18:19:04Z Stashbot 7414 ebysans@deploy1003: helmfile [eqiad] DONE helmfile.d/services/geo-analytics: apply 2411927 wikitext text/x-wiki 98rzielb3nvstd7emg7dp2vft7ror26 2411928 2411927 2026-05-07T18:19:53Z Stashbot 7414 ebysans@deploy1003: helmfile [codfw] START helmfile.d/services/geo-analytics: apply 2411928 wikitext text/x-wiki gwd1slhjef2533xxkzjnhqitlh3m3tl 2411929 2411928 2026-05-07T18:20:09Z Stashbot 7414 ebysans@deploy1003: helmfile [codfw] DONE helmfile.d/services/geo-analytics: apply 2411929 wikitext text/x-wiki 4akp8xmtlf4hnx0jo000zkn494vp6f8 2411930 2411929 2026-05-07T18:21:37Z Stashbot 7414 ebysans@deploy1003: helmfile [eqiad] START helmfile.d/services/device-analytics: apply 2411930 wikitext text/x-wiki 2bxiwg2ozllqtbjg8d0lyswkfos26pa 2411931 2411930 2026-05-07T18:21:50Z Stashbot 7414 ebysans@deploy1003: helmfile [eqiad] DONE helmfile.d/services/device-analytics: apply 2411931 wikitext text/x-wiki meaczcjclm20sofrazgntlhsys3kalu 2411932 2411931 2026-05-07T18:22:30Z Stashbot 7414 ebysans@deploy1003: helmfile [codfw] START helmfile.d/services/device-analytics: apply 2411932 wikitext text/x-wiki 6z740g9blgmt3tm1r1hw4xyzwhic23z 2411933 2411932 2026-05-07T18:22:44Z Stashbot 7414 ebysans@deploy1003: helmfile [codfw] DONE helmfile.d/services/device-analytics: apply 2411933 wikitext text/x-wiki q5pj9be3eaui5e6c3edgbp5subawd6i 2411934 2411933 2026-05-07T18:24:49Z Stashbot 7414 ebysans@deploy1003: helmfile [eqiad] START helmfile.d/services/editor-analytics: apply 2411934 wikitext text/x-wiki lqhvijer3rjdktp1t8jiypw4t4jqfg5 2411935 2411934 2026-05-07T18:25:12Z Stashbot 7414 ebysans@deploy1003: helmfile [eqiad] DONE helmfile.d/services/editor-analytics: apply 2411935 wikitext text/x-wiki mjfqlxxssl1lpfz9xgkjs54flca9pgj 2411936 2411935 2026-05-07T18:26:15Z Stashbot 7414 ebysans@deploy1003: helmfile [codfw] START helmfile.d/services/editor-analytics: apply 2411936 wikitext text/x-wiki elrhu713u0xf02tkn2mp5s9qhimuued 2411937 2411936 2026-05-07T18:26:30Z Stashbot 7414 ebysans@deploy1003: helmfile [codfw] DONE helmfile.d/services/editor-analytics: apply 2411937 wikitext text/x-wiki oghlyc9dznatgq7t0i31rzbdc4p4ois 2411938 2411937 2026-05-07T18:45:31Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.dns.netbox 2411938 wikitext text/x-wiki t0lhgk2nekfnyjbck3xnvwqjuccgmjk 2411939 2411938 2026-05-07T18:49:11Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [pc1022~] - vriley@cumin1003" 2411939 wikitext text/x-wiki mm8gnyj2mf9mj8y2s483s1o3r6u3xkq 2411940 2411939 2026-05-07T18:49:17Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [pc1022~] - vriley@cumin1003" 2411940 wikitext text/x-wiki bib0x7b6orsrcqdnj4u8vb6mv7bz1av 2411941 2411940 2026-05-07T18:49:19Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2411941 wikitext text/x-wiki pqbq5jtrn72jttqhunrq74vxzx7xn26 2411942 2411941 2026-05-07T18:49:42Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host pc1022 2411942 wikitext text/x-wiki jfil5m6v51reqket9m40i4iaobbtho4 2411943 2411942 2026-05-07T18:51:18Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host pc1022 2411943 wikitext text/x-wiki 0u2bxg8vvhwuhtqtz45oekyzmbpr5w7 2411944 2411943 2026-05-07T18:52:02Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.provision for host pc1022.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2411944 wikitext text/x-wiki f2dp4ewy18mz1m5i102811oee76z7ef 2411945 2411944 2026-05-07T19:04:54Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host pc1022.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2411945 wikitext text/x-wiki oj8me5est2l5xztgr8t4jx4qwvtp7qj 2411946 2411945 2026-05-07T19:09:37Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.reimage for host pc1022.eqiad.wmnet with OS trixie 2411946 wikitext text/x-wiki c6qflwqql8t118bjc12oqpdb25ngic3 2411948 2411946 2026-05-07T19:57:46Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.provision for host kafka-logging1008.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2411948 wikitext text/x-wiki orx82c46074dod9qzry28veiokqg3ey 2411949 2411948 2026-05-07T19:59:17Z Stashbot 7414 jclark@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host kafka-logging1008.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2411949 wikitext text/x-wiki frfz6gx16h37ed6g5mrhomkzp28sso5 2411950 2411949 2026-05-07T20:02:58Z Stashbot 7414 vriley@cumin1003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host pc1022.eqiad.wmnet with OS trixie 2411950 wikitext text/x-wiki 56vumjrtvpjv5dbvek5q1lm1lmhmdw2 2411951 2411950 2026-05-07T20:07:38Z Stashbot 7414 arlolra@deploy1003: Started scap sync-world: Backport for [[gerrit:1284687|Provide page context for LintErrorChecker (T419596)]], [[gerrit:1284771|Make email confirmation banner a standalone RL module (T425677)]] 2411951 wikitext text/x-wiki 6o10exbfad8ebo6glbq976xubwu24at 2411952 2411951 2026-05-07T20:09:26Z Stashbot 7414 arlolra@deploy1003: arlolra, mmartorana: Backport for [[gerrit:1284687|Provide page context for LintErrorChecker (T419596)]], [[gerrit:1284771|Make email confirmation banner a standalone RL module (T425677)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2411952 wikitext text/x-wiki aarckglglfpyv4o62nsqt2rwrmi460m 2411953 2411952 2026-05-07T20:10:11Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.reimage for host pc1021.eqiad.wmnet with OS trixie 2411953 wikitext text/x-wiki 0cijsplixxlaixcq7k9x38e03tdgluo 2411954 2411953 2026-05-07T20:10:39Z Stashbot 7414 arlolra@deploy1003: arlolra, mmartorana: Continuing with deployment 2411954 wikitext text/x-wiki rizmxk9qdugpabujt00u54ubg80vna3 2411955 2411954 2026-05-07T20:14:55Z Stashbot 7414 arlolra@deploy1003: Finished scap sync-world: Backport for [[gerrit:1284687|Provide page context for LintErrorChecker (T419596)]], [[gerrit:1284771|Make email confirmation banner a standalone RL module (T425677)]] (duration: 07m 18s) 2411955 wikitext text/x-wiki 09a3x5qpqevgg18qwu43lc4k3zskkqf 2411959 2411955 2026-05-07T20:28:30Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.provision for host kafka-logging1008.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2411959 wikitext text/x-wiki dpn1tei6q8in10irjhsi8kes0dv5zgm 2411960 2411959 2026-05-07T20:29:13Z Stashbot 7414 jclark@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host kafka-logging1008.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2411960 wikitext text/x-wiki ovuaw6yuiag3fiubdxoeooufgwf04jp 2411961 2411960 2026-05-07T20:30:53Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on pc1021.eqiad.wmnet with reason: host reimage 2411961 wikitext text/x-wiki l1wo2xif2twemcjdobwyd2ew3ypgvr0 2411962 2411961 2026-05-07T20:34:06Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on pc1021.eqiad.wmnet with reason: host reimage 2411962 wikitext text/x-wiki acu4f4waogwyrhz7trgpkck5z5s59j5 2411963 2411962 2026-05-07T20:41:52Z Stashbot 7414 Krinkle: krinkle@deploy1003$ mwscript deleteEqualMessages.php nlwiki 2411963 wikitext text/x-wiki h79lk6urpwyfl2sa2see9ujg85t534f 2411964 2411963 2026-05-07T20:41:57Z Stashbot 7414 Krinkle: krinkle@deploy1003$ mwscript deleteEqualMessages.php commonswiki 2411964 wikitext text/x-wiki ogw5m1gyhhwrd0yd4r2zdpasbkng2uv 2411965 2411964 2026-05-07T20:42:37Z Stashbot 7414 kemayo@deploy1003: Started scap sync-world: Backport for [[gerrit:1284575|Revert "Enable mobile editor abandonment survey on enwiki" (T424102)]], [[gerrit:1284702|Remove duplicate definition of EditCheckAction#isTagged (T425583)]], [[gerrit:1284703|Save action filtering info in ContentBranchNodeCheck#onDocumentChange (T425583)]] 2411965 wikitext text/x-wiki 1sb1x01t9bye7cyl1wz2dc421nuh6ar 2411966 2411965 2026-05-07T20:44:18Z Stashbot 7414 kemayo@deploy1003: esanders, kemayo: Backport for [[gerrit:1284575|Revert "Enable mobile editor abandonment survey on enwiki" (T424102)]], [[gerrit:1284702|Remove duplicate definition of EditCheckAction#isTagged (T425583)]], [[gerrit:1284703|Save action filtering info in ContentBranchNodeCheck#onDocumentChange (T425583)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be v 2411966 wikitext text/x-wiki slbyl84x00pwh054hbyj07z04rh1fh6 2411967 2411966 2026-05-07T20:45:04Z Stashbot 7414 kemayo@deploy1003: esanders, kemayo: Continuing with deployment 2411967 wikitext text/x-wiki 7uilycyfixefdg3gbs0ptyg5n05vm46 2411968 2411967 2026-05-07T20:48:05Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2411968 wikitext text/x-wiki 533vq6m4qhjn6l7iq46iw4f7vir7lj9 2411969 2411968 2026-05-07T20:49:15Z Stashbot 7414 kemayo@deploy1003: Finished scap sync-world: Backport for [[gerrit:1284575|Revert "Enable mobile editor abandonment survey on enwiki" (T424102)]], [[gerrit:1284702|Remove duplicate definition of EditCheckAction#isTagged (T425583)]], [[gerrit:1284703|Save action filtering info in ContentBranchNodeCheck#onDocumentChange (T425583)]] (duration: 06m 38s) 2411969 wikitext text/x-wiki p7qhld70ci6kk8jeqxjhkbqoi73o65a 2411970 2411969 2026-05-07T20:53:47Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2411970 wikitext text/x-wiki a2ygmvbkl4cqqxov23usmuroxk8gx4h 2411971 2411970 2026-05-07T20:53:49Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host pc1021.eqiad.wmnet with OS trixie 2411971 wikitext text/x-wiki tpms41nyhvk8clbsst1wzze4cl5h7m2 2411972 2411971 2026-05-07T21:16:12Z Stashbot 7414 cscott@deploy1003: Started scap sync-world: Backport for [[gerrit:1284828|Upgrading webonyx/graphql-php (v15.31.5 => v15.32.3)]], [[gerrit:1284834|composer.json: Update webonyx/graphql-php to ^15.32.3]], [[gerrit:1284832|Bump wikimedia/parsoid to 0.24.0-a2 (T319058 T368724 T373384 T420336 T423241 T423701 T424446 T424773 T425008 T425056 T425107 T425731)]], [[gerrit:1284837|Bump wikimedia/parsoid to 0.24.0-a2 (T425731)] 2411972 wikitext text/x-wiki l8olst1of92pc43ohetr3wtnb3khho7 2411973 2411972 2026-05-07T21:17:45Z Stashbot 7414 cscott@deploy1003: cscott: Backport for [[gerrit:1284828|Upgrading webonyx/graphql-php (v15.31.5 => v15.32.3)]], [[gerrit:1284834|composer.json: Update webonyx/graphql-php to ^15.32.3]], [[gerrit:1284832|Bump wikimedia/parsoid to 0.24.0-a2 (T319058 T368724 T373384 T420336 T423241 T423701 T424446 T424773 T425008 T425056 T425107 T425731)]], [[gerrit:1284837|Bump wikimedia/parsoid to 0.24.0-a2 (T425731)]] synced to the t 2411973 wikitext text/x-wiki ozcfgj432enu6oxixkr7ik8ewe382vi 2411974 2411973 2026-05-07T21:23:23Z Stashbot 7414 cscott@deploy1003: cscott: Continuing with deployment 2411974 wikitext text/x-wiki jin3ljqf28tokigjhze990rr174c9l9 2411975 2411974 2026-05-07T21:27:52Z Stashbot 7414 cscott@deploy1003: Finished scap sync-world: Backport for [[gerrit:1284828|Upgrading webonyx/graphql-php (v15.31.5 => v15.32.3)]], [[gerrit:1284834|composer.json: Update webonyx/graphql-php to ^15.32.3]], [[gerrit:1284832|Bump wikimedia/parsoid to 0.24.0-a2 (T319058 T368724 T373384 T420336 T423241 T423701 T424446 T424773 T425008 T425056 T425107 T425731)]], [[gerrit:1284837|Bump wikimedia/parsoid to 0.24.0-a2 (T425731) 2411975 wikitext text/x-wiki dbk2xlxe9b32d68h2z7rrxltghegj1m 2411977 2411975 2026-05-07T22:16:48Z Stashbot 7414 amastilovic@deploy1003: Started deploy [analytics/refinery@b38efb1] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@b38efb19] 2411977 wikitext text/x-wiki 88plmcs2rc0xly5c9xb8agzx0pli4cl 2411978 2411977 2026-05-07T22:18:43Z Stashbot 7414 amastilovic@deploy1003: Finished deploy [analytics/refinery@b38efb1] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@b38efb19] (duration: 01m 55s) 2411978 wikitext text/x-wiki pr75spgf2nxkapi4piv8r4aeo7fgvfz 2411979 2411978 2026-05-07T22:19:11Z Stashbot 7414 amastilovic@deploy1003: Started deploy [analytics/refinery@b38efb1]: Regular analytics weekly train [analytics/refinery@b38efb19] 2411979 wikitext text/x-wiki 8txt77ei15walyiarghp1vpnme4hm1z 2411980 2411979 2026-05-07T22:23:03Z Stashbot 7414 amastilovic@deploy1003: Finished deploy [analytics/refinery@b38efb1]: Regular analytics weekly train [analytics/refinery@b38efb19] (duration: 03m 52s) 2411980 wikitext text/x-wiki b8dxumwxxrgy0160cr1cyghanexnao9 2411981 2411980 2026-05-07T22:23:09Z Stashbot 7414 amastilovic@deploy1003: Started deploy [analytics/refinery@b38efb1] (thin): Regular analytics weekly train THIN [analytics/refinery@b38efb19] 2411981 wikitext text/x-wiki nac0nqueodnseqqk9m5zx2v10efbkv3 2411982 2411981 2026-05-07T22:25:02Z Stashbot 7414 amastilovic@deploy1003: Finished deploy [analytics/refinery@b38efb1] (thin): Regular analytics weekly train THIN [analytics/refinery@b38efb19] (duration: 01m 53s) 2411982 wikitext text/x-wiki pugdp0fij01ob3s45p4w0gthrsouugg 2411984 2411982 2026-05-07T22:53:34Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.reimage for host pc1022.eqiad.wmnet with OS trixie 2411984 wikitext text/x-wiki mvdl3xdstvgft9ffvbyiydipyu6shzf 2411985 2411984 2026-05-07T23:05:28Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on pc1022.eqiad.wmnet with reason: host reimage 2411985 wikitext text/x-wiki 1g8wz5s6bq3ycxylfq1xsemwftmae4j 2411986 2411985 2026-05-07T23:09:43Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on pc1022.eqiad.wmnet with reason: host reimage 2411986 wikitext text/x-wiki mwa6zme4pn81xbnjc18ug9w4vlahnk7 2411987 2411986 2026-05-07T23:24:29Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2411987 wikitext text/x-wiki nf7n4bkmqvisd9ea3e2084hngt5o2h2 2411988 2411987 2026-05-07T23:25:22Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2411988 wikitext text/x-wiki cbyiswwoyqluajlm0egiq9y0ks6791c 2411989 2411988 2026-05-07T23:25:23Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host pc1022.eqiad.wmnet with OS trixie 2411989 wikitext text/x-wiki fhwo8jti2srcqhjqvjgv5szr0f23wc1 2411993 2411989 2026-05-08T00:20:48Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.dns.netbox 2411993 wikitext text/x-wiki atbf3946kimn1st2ihfuyqv9ihw3uy6 2411994 2411993 2026-05-08T00:27:41Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [pc1023] - vriley@cumin1003" 2411994 wikitext text/x-wiki ghwrazx51wz6a0u1ngptkhjkem2wz4r 2411995 2411994 2026-05-08T00:27:48Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [pc1023] - vriley@cumin1003" 2411995 wikitext text/x-wiki iq5mosf8hjjhub9sa8omummuresnty7 2411996 2411995 2026-05-08T00:27:50Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2411996 wikitext text/x-wiki enbyhy7qbp6yj5a0lzz0um6jma84dng 2411997 2411996 2026-05-08T00:36:57Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host pc1023 2411997 wikitext text/x-wiki 2s6324xyww5kd4l2gisnchg7l3z0m8d 2411998 2411997 2026-05-08T00:37:16Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host pc1023 2411998 wikitext text/x-wiki 3u5zpb2tc0wfy24qtzhqjcpyraron4u 2411999 2411998 2026-05-08T00:37:59Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.provision for host pc1023.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2411999 wikitext text/x-wiki 6et17vud4lgf10z3kh915b2edscat2g 2412000 2411999 2026-05-08T00:49:03Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host pc1023.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2412000 wikitext text/x-wiki blxfemm5hlu3nd5x03iyqau1klbmayk 2412001 2412000 2026-05-08T00:59:03Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.reimage for host pc1023.eqiad.wmnet with OS trixie 2412001 wikitext text/x-wiki lelldxtwqbbd2rx5u2icuivg8j1u0fl 2412002 2412001 2026-05-08T01:11:32Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on pc1023.eqiad.wmnet with reason: host reimage 2412002 wikitext text/x-wiki hfuynf5jcc31e0cp4ishmy4woolgkqv 2412003 2412002 2026-05-08T01:15:24Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on pc1023.eqiad.wmnet with reason: host reimage 2412003 wikitext text/x-wiki fu12dfc6adc6ledmppfyrm4oveeb6vp 2412004 2412003 2026-05-08T01:30:08Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2412004 wikitext text/x-wiki byaj0b3k2rfkmaxo9fi1rvq9993n3vx 2412005 2412004 2026-05-08T01:52:27Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2412005 wikitext text/x-wiki g5q1jh7onqr75sa0hm18mx1vampliwr 2412006 2412005 2026-05-08T01:52:28Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host pc1023.eqiad.wmnet with OS trixie 2412006 wikitext text/x-wiki p9kywr2lhlww8y99u14bwx2lnnr4mmw 2412007 2412006 2026-05-08T02:01:05Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.dns.netbox 2412007 wikitext text/x-wiki bsi3v23o4ztz6lxfssszcdwfjy46dt6 2412008 2412007 2026-05-08T02:04:49Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [pc1024] - vriley@cumin1003" 2412008 wikitext text/x-wiki mqb1yg6anxqm6k7tox934vk80fu42ze 2412009 2412008 2026-05-08T02:04:56Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [pc1024] - vriley@cumin1003" 2412009 wikitext text/x-wiki bl80zhxo0osyi0ttopi0bkeshmcs4i8 2412010 2412009 2026-05-08T02:04:57Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2412010 wikitext text/x-wiki njtwiu3fkwch02lyl59zm3dtljs6dat 2412011 2412010 2026-05-08T02:05:18Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host pc1024 2412011 wikitext text/x-wiki flkpb4gv54va699eftvjdfwut5xncno 2412012 2412011 2026-05-08T02:07:30Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host pc1024 2412012 wikitext text/x-wiki bwf2ntzdcz1v29cda2akvdtozhh5gdw 2412013 2412012 2026-05-08T02:07:58Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.provision for host pc1024.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2412013 wikitext text/x-wiki kdroxg2nlam88zsajtbvsf0rm1mqp4c 2412014 2412013 2026-05-08T02:23:37Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host pc1024.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2412014 wikitext text/x-wiki 6xb24ayqm5bvwo43eij43nz047s0aii 2412015 2412014 2026-05-08T02:32:09Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.reimage for host pc1024.eqiad.wmnet with OS trixie 2412015 wikitext text/x-wiki jwxnq412u24esku1sibfri4mdz7b17p 2412016 2412015 2026-05-08T02:45:09Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on pc1024.eqiad.wmnet with reason: host reimage 2412016 wikitext text/x-wiki bc8xrbd4i11w863fij4ocjephddzpnb 2412017 2412016 2026-05-08T02:50:00Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on pc1024.eqiad.wmnet with reason: host reimage 2412017 wikitext text/x-wiki qzuqr47fpxbib4mw5rovh4t9hj6inko 2412018 2412017 2026-05-08T03:04:27Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2412018 wikitext text/x-wiki ey2g9t1mobtkcdpgal3tqu262gs4bli 2412019 2412018 2026-05-08T03:04:52Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - vriley@cumin1003" 2412019 wikitext text/x-wiki 6n681i0dijrqm9j3ey8ncefoln7ij54 2412020 2412019 2026-05-08T03:04:53Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host pc1024.eqiad.wmnet with OS trixie 2412020 wikitext text/x-wiki o54bezx189911gsr1alorep5cntfwaj 2412022 2412020 2026-05-08T05:25:32Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2159.codfw.wmnet with reason: Reimage to Trixie 2412022 wikitext text/x-wiki 2bxsxd2xjs7nwqc2cxtx1wgdrrx8xr9 2412023 2412022 2026-05-08T05:25:38Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool db2159: Reimage to Trixie 2412023 wikitext text/x-wiki e6qgx32n60353w34iurwnosap54wsxg 2412024 2412023 2026-05-08T05:25:56Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2159: Reimage to Trixie 2412024 wikitext text/x-wiki pjefv4aafwlobgcajehhcoes5b5m4jl 2412025 2412024 2026-05-08T05:27:50Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.reimage for host db2159.codfw.wmnet with OS trixie 2412025 wikitext text/x-wiki cabcpuh55b50wd1lyt9l9u9b0m1zsm6 2412026 2412025 2026-05-08T05:46:45Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db2159.codfw.wmnet with reason: host reimage 2412026 wikitext text/x-wiki rl30jp1mrefywcupcfytadgd9c4wx1g 2412027 2412026 2026-05-08T05:51:12Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2159.codfw.wmnet with reason: host reimage 2412027 wikitext text/x-wiki s4k62b49i7mzjhnlveeyqr6y493k7dt 2412031 2412027 2026-05-08T06:11:18Z Stashbot 7414 moritzm: installing postorius security updates 2412031 wikitext text/x-wiki ebzbwgz13xu8p6aw2ese1nlxerxib5t 2412032 2412031 2026-05-08T06:14:06Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2159.codfw.wmnet with OS trixie 2412032 wikitext text/x-wiki o157fbm7sxqj6khcpijtnm72hjajcut 2412033 2412032 2026-05-08T06:18:01Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool db2159: after reimage to trixie 2412033 wikitext text/x-wiki myzejc8gp216gf51ydbtamxkdnfb8ct 2412035 2412033 2026-05-08T06:57:07Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.decommission for hosts install5003.wikimedia.org 2412035 wikitext text/x-wiki iwqjt7tcm90dcrlwg319l9ubwz29coq 2412036 2412035 2026-05-08T07:03:25Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2159: after reimage to trixie 2412036 wikitext text/x-wiki 96apr91ir3r9yyzyq3kurg80jrluomn 2412038 2412036 2026-05-08T07:09:06Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.dns.netbox 2412038 wikitext text/x-wiki 1pfrnf3zh79u8b68v1kllpbq8o66ucq 2412039 2412038 2026-05-08T07:13:38Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: install5003.wikimedia.org decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" 2412039 wikitext text/x-wiki s2omhvfacd1wtkt49lvfqumnadouwez 2412040 2412039 2026-05-08T07:43:03Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: install5003.wikimedia.org decommissioned, removing all IPs except the asset tag one - jmm@cumin2002" 2412040 wikitext text/x-wiki m1ievxxj0yl5vfvtd6buh1gcv3j8xx8 2412041 2412040 2026-05-08T07:43:04Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2412041 wikitext text/x-wiki 9yuou68rtlwr1gegfn2zyh75icsjwcu 2412042 2412041 2026-05-08T07:43:05Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts install5003.wikimedia.org 2412042 wikitext text/x-wiki 6c0k4p13mej92wot44lenfxvi67v003 2412043 2412042 2026-05-08T07:56:10Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply 2412043 wikitext text/x-wiki hxg6cyselvzwx37rm6yh2ueczuvpqpg 2412044 2412043 2026-05-08T07:59:21Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply 2412044 wikitext text/x-wiki m5ohrcmstw0mng3oixlmbx7d7kmlrn0 2412045 2412044 2026-05-08T08:04:31Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2207.codfw.wmnet with reason: Maintenance 2412045 wikitext text/x-wiki ouf577aphoo2pzz3skig63uj5bc5xxf 2412046 2412045 2026-05-08T08:04:40Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db2207 (T419635)', diff saved to https://phabricator.wikimedia.org/P92427 and previous config saved to /var/cache/conftool/dbconfig/20260508-080438-fceratto.json 2412046 wikitext text/x-wiki ngz89msgjfeudywwxtitlasfnj16913 2412048 2412046 2026-05-08T08:17:50Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply 2412048 wikitext text/x-wiki bghmb1zivw2368g2dj118c3921zuvo2 2412049 2412048 2026-05-08T08:18:13Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply 2412049 wikitext text/x-wiki ennsbx9pczvlzhjt7wusl6f72uejngi 2412050 2412049 2026-05-08T08:19:57Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db2207 (T419635)', diff saved to https://phabricator.wikimedia.org/P92428 and previous config saved to /var/cache/conftool/dbconfig/20260508-081954-fceratto.json 2412050 wikitext text/x-wiki 2nymkpwm8ru5bmecfn5w4wztwdat8ly 2412051 2412050 2026-05-08T08:30:04Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db2207', diff saved to https://phabricator.wikimedia.org/P92429 and previous config saved to /var/cache/conftool/dbconfig/20260508-083003-fceratto.json 2412051 wikitext text/x-wiki lc84bpolkj1rjq945qf0udp24otadbi 2412052 2412051 2026-05-08T08:40:12Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db2207', diff saved to https://phabricator.wikimedia.org/P92430 and previous config saved to /var/cache/conftool/dbconfig/20260508-084010-fceratto.json 2412052 wikitext text/x-wiki arkkl9h26vmdrzgs12sr4pt187rav08 2412053 2412052 2026-05-08T08:50:21Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db2207 (T419635)', diff saved to https://phabricator.wikimedia.org/P92431 and previous config saved to /var/cache/conftool/dbconfig/20260508-085018-fceratto.json 2412053 wikitext text/x-wiki gmrpu4zkrpsd0h5ie40lvqov921yauf 2412054 2412053 2026-05-08T08:52:10Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1189.eqiad.wmnet with reason: Maintenance 2412054 wikitext text/x-wiki b1ygzbtusr0fq2uho1gwfso0p8pwcg6 2412055 2412054 2026-05-08T08:52:19Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1189 (T419635)', diff saved to https://phabricator.wikimedia.org/P92432 and previous config saved to /var/cache/conftool/dbconfig/20260508-085217-fceratto.json 2412055 wikitext text/x-wiki k8246ym9x0oghr3zpdej1f6g2v4ugt8 2412057 2412055 2026-05-08T09:02:33Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1189 (T419635)', diff saved to https://phabricator.wikimedia.org/P92433 and previous config saved to /var/cache/conftool/dbconfig/20260508-090230-fceratto.json 2412057 wikitext text/x-wiki taqbud0rxujwuri9op6g4kkdq66jelj 2412058 2412057 2026-05-08T09:12:39Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1189', diff saved to https://phabricator.wikimedia.org/P92434 and previous config saved to /var/cache/conftool/dbconfig/20260508-091238-fceratto.json 2412058 wikitext text/x-wiki dn7d8v209premgt0glq0ds0ad9jfl3q 2412059 2412058 2026-05-08T09:22:45Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1189', diff saved to https://phabricator.wikimedia.org/P92435 and previous config saved to /var/cache/conftool/dbconfig/20260508-092243-fceratto.json 2412059 wikitext text/x-wiki lpgxxlwcjz4iilm8nbnbur9gg6v8bv9 2412061 2412059 2026-05-08T09:32:54Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1189 (T419635)', diff saved to https://phabricator.wikimedia.org/P92437 and previous config saved to /var/cache/conftool/dbconfig/20260508-093251-fceratto.json 2412061 wikitext text/x-wiki patzk5g8v524kb29de2io18ogjyqrp2 2412062 2412061 2026-05-08T09:35:46Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply 2412062 wikitext text/x-wiki f4on9g1dz7na6xunokl9qc0z3uaee5q 2412063 2412062 2026-05-08T09:36:23Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply 2412063 wikitext text/x-wiki aba785cehrxus84sth3glfd2h3x7cm6 2412064 2412063 2026-05-08T09:36:34Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/services/miscweb: apply 2412064 wikitext text/x-wiki snmp3jvlx72w55vlftoplbckwjb7ohs 2412065 2412064 2026-05-08T09:37:00Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/services/miscweb: apply 2412065 wikitext text/x-wiki ijxd9ys85rlu70vi6q5cjm9u77exx0p 2412066 2412065 2026-05-08T09:40:28Z Stashbot 7414 btullis@cumin1003: conftool action : set/pooled=false; selector: dnsdisc=wdqs-main,name=eqiad 2412066 wikitext text/x-wiki 47lpih3gba5vki6qmtf00zvbuz6qb1s 2412067 2412066 2026-05-08T09:40:35Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply 2412067 wikitext text/x-wiki mr4d3s5bp5qk86qrkzbcx6gm9jupprx 2412068 2412067 2026-05-08T09:40:44Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply 2412068 wikitext text/x-wiki 3vy3gn95bsaowp0zazza0f4eicba1ni 2412069 2412068 2026-05-08T09:41:05Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply 2412069 wikitext text/x-wiki 53u75hdhevx0czwijlzsrpfeprbpuuh 2412070 2412069 2026-05-08T09:41:29Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply 2412070 wikitext text/x-wiki th6xtfm7m7879yc50f9l9jhljzk7nhj 2412071 2412070 2026-05-08T09:41:36Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/services/miscweb: apply 2412071 wikitext text/x-wiki rnrb12ypwf942qfd0ntskig5m2jv8w2 2412072 2412071 2026-05-08T09:41:59Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/services/miscweb: apply 2412072 wikitext text/x-wiki dbrmytipvq7bhluths5idtgmcne868s 2412074 2412072 2026-05-08T09:45:00Z Stashbot 7414 btullis: depooled wdqs-main in eqiad for T425758 2412074 wikitext text/x-wiki 61ckktujzwj8ljq2u8uvs98aknvo25s 2412079 2412074 2026-05-08T10:09:05Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/services/miscweb: apply 2412079 wikitext text/x-wiki necvcyre5u372f11nuloqy8rw8x095r 2412080 2412079 2026-05-08T10:09:46Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/services/miscweb: apply 2412080 wikitext text/x-wiki rbo07jdolr0oy5i9ljo2e6tu6w8c96e 2412081 2412080 2026-05-08T10:11:35Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/services/miscweb: apply 2412081 wikitext text/x-wiki bvfkxnjt4235u3p1djv1uylgisbikk1 2412082 2412081 2026-05-08T10:11:59Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/services/miscweb: apply 2412082 wikitext text/x-wiki bli2j0m593h6p09e66k9dft00v8h5fc 2412083 2412082 2026-05-08T10:12:24Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply 2412083 wikitext text/x-wiki idsqavw84bm8aeej1lfjxlwczf3clfn 2412084 2412083 2026-05-08T10:12:47Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply 2412084 wikitext text/x-wiki kfcc3r7uugpgk20d754zt5ll9nwghdn 2412085 2412084 2026-05-08T10:14:42Z Stashbot 7414 jynus@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on backup1007.eqiad.wmnet with reason: restart 2412085 wikitext text/x-wiki 5fg12m461ozj0nlmu59x8rcp6906s9e 2412086 2412085 2026-05-08T10:15:05Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply 2412086 wikitext text/x-wiki djqoymh9ttagnfjzfe47h7jgi5g1wzx 2412087 2412086 2026-05-08T10:15:33Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply 2412087 wikitext text/x-wiki o76e8qgajvmrtbva8623o669btxihht 2412088 2412087 2026-05-08T10:15:39Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/services/miscweb: apply 2412088 wikitext text/x-wiki sq8uwnr5iz4t5sw6voeabmhz17ndav5 2412089 2412088 2026-05-08T10:16:00Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/services/miscweb: apply 2412089 wikitext text/x-wiki 4lh7liyj12g8dan5rax2h92ta4zzh3x 2412091 2412089 2026-05-08T10:50:43Z Stashbot 7414 btullis@cumin1003: conftool action : set/pooled=true; selector: dnsdisc=wdqs-main,name=eqiad 2412091 wikitext text/x-wiki 9jvmzsfu0plxukcyz0p27v52e7fqvss 2412092 2412091 2026-05-08T10:51:12Z Stashbot 7414 btullis: re-pooled wdqs-main in eqiad for T425758 2412092 wikitext text/x-wiki 6ijq8du5ozv8srbi3sqowt28hy89yc8 0 11689 2411844 2409589 2026-05-07T14:53:06Z JKilani-WMF 37651 Note on broker.id mapping. 2411844 wikitext text/x-wiki h72tbv72lutl7qinw7qpyvy14m6xw6p 0 17290 2411983 2411269 2026-05-07T22:53:00Z Stashbot 7414 brennen: Updating development images on contint primary for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/105 2411983 wikitext text/x-wiki g78fjmikdwxzo55t1o59uivubs28fel 2 26362 2411772 2411336 2026-05-07T12:33:48Z Urhixidur 5948 Dungeon Universalis -- 2411772 wikitext text/x-wiki h47ekbltgaslvovpi53a624qgz0qejm 2411776 2411772 2026-05-07T12:49:06Z Urhixidur 5948 Eclipse wiki -- 2411776 wikitext text/x-wiki aoc0mv2kulpv4qvtoup9pft9q3qmf21 498 55577 2411976 2406733 2026-05-07T21:29:45Z Stashbot 7414 andrewbogott: rebooting all worker nodes to pick up modprobe changes 2411976 wikitext text/x-wiki nnab53r35ksckive2yfgt2usabwujpo 498 443628 2411882 2411279 2026-05-07T15:34:22Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/25505647057 (https://github.com/cluebotng/component-configs/commits/874d7f6f407fc9a3995f52f40312cd7d3a712176) 2411882 wikitext text/x-wiki ht8qumot8i6p6g3t9dcf55neyvd9yfn 498 443949 2411781 2411743 2026-05-07T12:54:19Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 6f644fd (Add --warm-cache-only option to populate Redis without running queries) 2411781 wikitext text/x-wiki on2q82236nljgovu35tjfdtyedec9ch 0 447757 2412094 2395465 2026-05-08T11:48:18Z Krinkle 44 /* udp2log/mwlog */ 2412094 wikitext text/x-wiki lu8b0zdhccnscc1afgs23yljk00lz96 0 449063 2411891 2402806 2026-05-07T16:14:10Z MLechvien-WMF 49197 /* Template */ 2411891 wikitext text/x-wiki r6bchiftz99s592ugp7rnsarr35dvii 2411893 2411891 2026-05-07T16:15:40Z MLechvien-WMF 49197 /* Walkthrough the incident */ 2411893 wikitext text/x-wiki 6lyxr236cllycrlj5an72t5xb3xl24n 2411896 2411893 2026-05-07T16:17:53Z MLechvien-WMF 49197 /* Assign a person running the ritual */ 2411896 wikitext text/x-wiki 5m2byfisudjfwgo15bjswlzd5gt31x9 0 449160 2411992 2411672 2026-05-08T00:01:57Z Dexbot 30554 Bot: Updating the report 2411992 wikitext text/x-wiki t0brdhb8qqnxgqp8xdvqj5sydki10kd 2412047 2411992 2026-05-08T08:05:52Z Dexbot 30554 Bot: Updating the report 2412047 wikitext text/x-wiki 2lw3nym6fsyeo8nb76mvr6786udewx8 2412056 2412047 2026-05-08T08:53:58Z Dexbot 30554 Bot: Updating the report 2412056 wikitext text/x-wiki l6n9bg2n7ds4g35s89mlayyr91tjmxb 116 453906 2411804 2411015 2026-05-07T14:15:18Z Gitlabaccountapprovalbot 37332 rehankhan78 was rejected. 2411804 wikitext text/x-wiki rgcs30l3236rfcw7nfcvodwh7706zh5 2412060 2411804 2026-05-08T09:24:27Z Gitlabaccountapprovalbot 37332 @cwilliams was approved. 2412060 wikitext text/x-wiki e2dp747dn5zxfyszr3cheo7vwa3rinv 0 458675 2412076 2411234 2026-05-08T10:05:54Z CMooney (WMF) 24288 /* Show BGP routes rejected */ 2412076 wikitext text/x-wiki gfsb7v168gons41259ihjxtujg9tvft 2412078 2412076 2026-05-08T10:07:11Z CMooney (WMF) 24288 /* Show Outbound Queue Counters */ 2412078 wikitext text/x-wiki 5lr1vohzkcgr7zel7zcjwe0bcueojyv 498 458787 2412021 2407768 2026-05-08T05:03:01Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/25537718177 (https://github.com/cluebotng/component-configs/commits/ef11c0e9dcb6c448a2eaeb147343007003b2874f) 2412021 wikitext text/x-wiki 88en3kp21gns2m4r5mpdv4bm4mefyq7 0 458856 2412077 2408655 2026-05-08T10:06:33Z Effie Mouzeli (WMF) 12880 /* Getting a shell in the mw-experimental pod, running maintenance scripts */ 2412077 wikitext text/x-wiki 00bsyxkxc61wi3fft0drl70cv50f3qs 0 459290 2411856 2409609 2026-05-07T15:04:47Z AKhatun (WMF) 50461 Weekly train deployment update 2411856 wikitext text/x-wiki 8rugi5f4tq8wpyh5vzle18vptzoy48y 0 459743 2411773 2409207 2026-05-07T12:43:38Z LErickson-WMF 51715 /* Monitoring, SLO */ 2411773 wikitext text/x-wiki bhnu8rjqldrm505i3s62i8f9uz95gcz 0 459783 2412037 2407963 2026-05-08T07:03:46Z Duesentrieb 52342 /* Ratelimit Classes */ document more classes 2412037 wikitext text/x-wiki c8hcrpvuuzp08ztztk1rm0lrj7rewr9 2 460122 2412029 2409038 2026-05-08T05:59:42Z Udehb-WMF 40856 2412029 wikitext text/x-wiki d9d0rgmcndh09xl0bztslwy5iwcvmx4 498 460126 2411897 2411289 2026-05-07T16:21:29Z Stashbot 7414 wmbot~gergesshamon@tools-bastion-15: [DEPLOY] Starting deployment | ref=v1.5.5 2411897 wikitext text/x-wiki afaxrpf5nu5rth3g5z9f0t30m1jlqkp 2411898 2411897 2026-05-07T16:23:10Z Stashbot 7414 wmbot~gergesshamon@tools-bastion-15: [DEPLOY] Build triggered successfully | ref=v1.5.5 2411898 wikitext text/x-wiki 0sbl5t742z7c2p3c1cs9t3uv541oiie 2411899 2411898 2026-05-07T16:23:11Z Stashbot 7414 wmbot~gergesshamon@tools-bastion-15: [DEPLOY] Restarting buildservice | ref=v1.5.5 2411899 wikitext text/x-wiki h54aq5hn1774ioydfj01mm1kfedg2xm 2 460150 2411796 2026-05-07T13:42:05Z TheresNoTime 6011 c 2411796 wikitext text/x-wiki 4sgkauvmh76cqhfzelo8wrojv25dunb 2411797 2411796 2026-05-07T13:43:55Z TheresNoTime 6011 /* In production, we run */ 2411797 wikitext text/x-wiki a004h7xqchhmzh84wp11ud3vvpa2v15 3 460151 2411990 2026-05-07T23:26:19Z StrikerBot 8475 Welcome to Toolforge! 2411990 wikitext text/x-wiki 4l81x2e1xn686i0njr0uwcmatjrpz9s 3 460152 2411991 2026-05-07T23:26:54Z StrikerBot 8475 Welcome to Toolforge! 2411991 wikitext text/x-wiki fioi9awos6de7rfww0t0zvwnkjx5ntm 10 460153 2412028 2026-05-08T05:58:46Z Udehb-WMF 40856 Created page with "<div style=" background:#f8f9fa; border:1px solid #c8ccd1; padding:10px; margin-bottom:15px; text-align:center; font-size:100%; "> [[File:Home free icon.svg|26px]] [[Wikidata:SPARQL_query_service/WDQS_backend_update|Home]] [[File:Crystal128-vcs-update.svg|26px]] [[D:Wikidata:SPARQL_query_service/WDQS_backend_update#Monthly_Updates|Updates]] [[File:Twemoji2_1f532.svg|26px]] [[D:Wikidata:SPARQL_query_service/WDQS_backend_update/Backend_Replacement|Backend Replacement]] ..." 2412028 wikitext text/x-wiki g2m626p7i5wi9te5lqo44z95vz5x2lp 2412030 2412028 2026-05-08T06:00:56Z Udehb-WMF 40856 2412030 wikitext text/x-wiki 8uh7xblsiuayawpfkthrwjtbd9e9vsd 2412034 2412030 2026-05-08T06:28:24Z Udehb-WMF 40856 2412034 wikitext text/x-wiki biutekftcj6yjohkoocjmcy3rbnkq91 0 460154 2412090 2026-05-08T10:30:58Z PFischer-WMF 38527 Created page with "= Highlights = * [https://docs.google.com/document/d/1kM1aTar35pOq3mizCGQGhW5kK7BnjOIQjKiUVSjcNVE/edit?tab=t.0#heading=h.vtuy0vpwrli1 CloudElastic performance issues ] see also [https://phabricator.wikimedia.org/T424852 T424852] == Shipped: did we release anything this week? == * [https://phabricator.wikimedia.org/T425018 T425018 Enable Latin-to-Devanagari Transliteration second-try search on Hindi Wikis] (Open) * [https://phabricator.wikimedia.org/T418130 T418130 Ana..." 2412090 wikitext text/x-wiki dmtgia5re41tz2ar7ua0fxibw12f5us 2412093 2412090 2026-05-08T11:17:26Z PFischer-WMF 38527 2412093 wikitext text/x-wiki e4leof8pl2vvc01zbgdnbfcmhwfuvg8