Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.5 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 3086 2423660 2422543 2026-06-04T12:01:52Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.kyverno.copy_images_to_registry 2423660 wikitext text/x-wiki faa17r2um3ab1akzxl755cpgnrd50ht 2423661 2423660 2026-06-04T12:01:54Z Stashbot 7414 taavi@cloudcumin1001: Updating container image docker-registry.svc.toolforge.org/toolforge-kyverno-kyverno:v1.16.4 2423661 wikitext text/x-wiki 20byl2oztx6axjfvolexfulh0rnoorf 2423662 2423661 2026-06-04T12:02:23Z Stashbot 7414 taavi@cloudcumin1001: Updating container image docker-registry.svc.toolforge.org/toolforge-kyverno-kyverno-cli:v1.16.4 2423662 wikitext text/x-wiki 4y04oodlvv6d5wq4bf5pn3qktc7qc7n 2423663 2423662 2026-06-04T12:02:40Z Stashbot 7414 taavi@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.k8s.kyverno.copy_images_to_registry (exit_code=99) 2423663 wikitext text/x-wiki 5kmkkahwak3vp58m90h9gq7tk4iad9u 2423664 2423663 2026-06-04T12:03:37Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.kyverno.copy_images_to_registry 2423664 wikitext text/x-wiki 2azz0j1l4q91q32hut7f2yhrbzqb8w6 2423665 2423664 2026-06-04T12:03:39Z Stashbot 7414 taavi@cloudcumin1001: Updating container image docker-registry.svc.toolforge.org/toolforge-kyverno-kyverno:v1.16.4 2423665 wikitext text/x-wiki eelwyqtlv365bxev4jnkbht903ilo91 2423666 2423665 2026-06-04T12:03:42Z Stashbot 7414 taavi@cloudcumin1001: Updating container image docker-registry.svc.toolforge.org/toolforge-kyverno-kyverno-cli:v1.16.4 2423666 wikitext text/x-wiki 6hvv0ngv3aaige79v1yqhqf0dl9y6xz 2423668 2423666 2026-06-04T12:04:25Z Stashbot 7414 taavi@cloudcumin1001: Updating container image docker-registry.svc.toolforge.org/toolforge-kyverno-kyvernopre:v1.16.4 2423668 wikitext text/x-wiki s82wjteyzc8hute07tb2ac67lz2rerq 2423670 2423668 2026-06-04T12:04:47Z Stashbot 7414 taavi@cloudcumin1001: Updating container image docker-registry.svc.toolforge.org/toolforge-kyverno-background-controller:v1.16.4 2423670 wikitext text/x-wiki 7vyv6qeatk52molu4037uqf3yzhdlaq 2423672 2423670 2026-06-04T12:05:16Z Stashbot 7414 taavi@cloudcumin1001: Updating container image docker-registry.svc.toolforge.org/toolforge-kyverno-cleanup-controller:v1.16.4 2423672 wikitext text/x-wiki mkow8e7yzc3xs0tfiba2ukgzqacxn05 2423673 2423672 2026-06-04T12:05:38Z Stashbot 7414 taavi@cloudcumin1001: Updating container image docker-registry.svc.toolforge.org/toolforge-kyverno-reports-controller:v1.16.4 2423673 wikitext text/x-wiki 2zyr3qmi0h9wi45dye6tgzac0iaigv6 2423674 2423673 2026-06-04T12:06:02Z Stashbot 7414 taavi@cloudcumin1001: Updating container image docker-registry.svc.toolforge.org/kubectl:v1.32.7 2423674 wikitext text/x-wiki nxu5wge0p3dgfvbl2mr9bilz6kyokli 2423675 2423674 2026-06-04T12:06:18Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.k8s.kyverno.copy_images_to_registry (exit_code=0) 2423675 wikitext text/x-wiki f39ojpyx7666vv7oheu39lxdik068vu 2423677 2423675 2026-06-04T12:15:29Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component istio-gateway 2423677 wikitext text/x-wiki q7wplqtaf43dvi6fjmraouu4p18kuop 2423678 2423677 2026-06-04T12:15:33Z Stashbot 7414 taavi@cloudcumin1001: END (ERROR) - Cookbook wmcs.toolforge.component.deploy (exit_code=97) for component istio-gateway 2423678 wikitext text/x-wiki qh585fqkoferhqiheikyxhilw4w48p8 2423696 2423678 2026-06-04T12:56:01Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component istio-gateway 2423696 wikitext text/x-wiki r3kz19svorpzauxd4nep1kj380dntd0 2423702 2423696 2026-06-04T13:02:12Z Stashbot 7414 taavi@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component istio-gateway 2423702 wikitext text/x-wiki izqva41c3ilmkv43gy4736lb7q7ap0v 0 4108 2423703 2423544 2026-06-04T13:02:37Z ScheduleDeploymentBot 37566 Add [[gerrit:1295978]] to Thursday, June 04 UTC afternoon backport window 2423703 wikitext text/x-wiki 3wrshfknocdn51qx4uzazzvg1ikd77c 2423716 2423703 2026-06-04T13:28:30Z ScheduleDeploymentBot 37566 Add [[gerrit:1297692]] to Thursday, June 04 UTC afternoon backport window 2423716 wikitext text/x-wiki tv6o5f68xucdqclzng93wy3yagkm6uo 2423717 2423716 2026-06-04T13:29:13Z WBrown (WMF) 37696 /* {{Deployment_day|date=2026-06-04}} */ mark as not done 2423717 wikitext text/x-wiki hek8zvtclosmzywy0z48gy16wv5mkbn 2423718 2423717 2026-06-04T13:29:55Z WBrown (WMF) 37696 /* {{Deployment_day|date=2026-06-04}} */ fix 2423718 wikitext text/x-wiki d6v4ygduhwygdg6l14r5jnj5x4ruouw 2423727 2423718 2026-06-04T13:40:08Z WBrown (WMF) 37696 /* {{Deployment_day|date=2026-06-04}} */ reverted at test stage 2423727 wikitext text/x-wiki n9950z06ecco87vabpsdtmww87n1cfv 2423756 2423727 2026-06-04T14:12:22Z ScheduleDeploymentBot 37566 Add [[gerrit:1296015]] to Thursday, June 04 UTC late backport window 2423756 wikitext text/x-wiki 2sf7zm5vbkssr8v2j8gifebic218a6v 2423799 2423756 2026-06-04T15:26:14Z ScheduleDeploymentBot 37566 Add [[gerrit:1297644]] to Thursday, June 04 UTC late backport window 2423799 wikitext text/x-wiki gm4uany2l3u0ixxzb7t0j4msu5vfkhc 2423913 2423799 2026-06-05T08:40:33Z ScheduleDeploymentBot 37566 Add [[gerrit:1297681]] to Monday, June 08 UTC morning backport window 2423913 wikitext text/x-wiki 3d6csyerb2u85uqnbln9ggxtqycss0m 12 5649 2423729 2423644 2026-06-04T13:40:25Z Beta16 967 /* Constraints of Toolforge */ typos 2423729 wikitext text/x-wiki aa7u4xswkaz1n7qmnd1t44gg9bakk4l 498 6726 2423679 2422527 2026-06-04T12:15:37Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component istio-gateway 2423679 wikitext text/x-wiki 16jir87nyxxe4u625hhke2slbrn1jic 2423680 2423679 2026-06-04T12:15:49Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component istio-gateway 2423680 wikitext text/x-wiki t1g2aymnjqq2u84ppjki9msc6ab33zd 2423687 2423680 2026-06-04T12:40:33Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component istio-gateway 2423687 wikitext text/x-wiki jst4wt0325txkz5s88awctohmyenb2s 2423695 2423687 2026-06-04T12:55:29Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component istio-gateway 2423695 wikitext text/x-wiki ofqg94zgbdojt7cya4a29gtfqupojd0 2423712 2423695 2026-06-04T13:18:49Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component kyverno 2423712 wikitext text/x-wiki stljpec96j6fe4fq2f0pgboc0z8ud0s 2423728 2423712 2026-06-04T13:40:12Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component kyverno 2423728 wikitext text/x-wiki h9kujpwu9xesob7zupx8aj0y230rlaw 0 7919 2423658 2423653 2026-06-04T11:59:32Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1220.eqiad.wmnet with reason: host reimage 2423658 wikitext text/x-wiki qiiw0sndehi7txd4b0wafn6mbxv1hsg 2423667 2423658 2026-06-04T12:04:14Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1220.eqiad.wmnet with reason: host reimage 2423667 wikitext text/x-wiki 41262423stcofrpxditg64cayf0ltu0 2423669 2423667 2026-06-04T12:04:35Z Stashbot 7414 marostegui@cumin1003: END (FAIL) - Cookbook sre.mysql.major-upgrade (exit_code=99) 2423669 wikitext text/x-wiki bqlds6s4pryv6evvdye5oz4h44e4dfu 2423671 2423669 2026-06-04T12:04:48Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool es2050: repool after upgrade 2423671 wikitext text/x-wiki q10g5bj1ufg5ozx71x42g5ye1z3qufy 2423681 2423671 2026-06-04T12:20:45Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1220.eqiad.wmnet with OS trixie 2423681 wikitext text/x-wiki 0kpv8argawo8423ela5xd4ilz4mn96z 2423683 2423681 2026-06-04T12:28:09Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool db1220: Migration of db1220.eqiad.wmnet completed 2423683 wikitext text/x-wiki lk47pcvxbwlf9gbira7itdhdlqir8kb 2423685 2423683 2026-06-04T12:37:13Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/dse-k8s-services/kafka-ui: apply 2423685 wikitext text/x-wiki 1xce9zdgl1muy62dopylsgu6ct4rcyi 2423686 2423685 2026-06-04T12:37:31Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/dse-k8s-services/kafka-ui: apply 2423686 wikitext text/x-wiki n0oi3v752vqwn0vnkcgfw1oci2q5qcj 2423689 2423686 2026-06-04T12:48:27Z Stashbot 7414 dreamyjazz@deploy1003: Started scap sync-world: Backport for [[gerrit:1296557|wmf-config: Skip CAPTCHA for action=mcrundo (T427612)]] 2423689 wikitext text/x-wiki 696g6gm6qje79bx6tqhp1l9ylveatpk 2423690 2423689 2026-06-04T12:50:13Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool es2050: repool after upgrade 2423690 wikitext text/x-wiki eu5x4inexlsp4t8aaet53bryw9q5860 2423691 2423690 2026-06-04T12:50:27Z Stashbot 7414 dreamyjazz@deploy1003: mpostoronca, dreamyjazz: Backport for [[gerrit:1296557|wmf-config: Skip CAPTCHA for action=mcrundo (T427612)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423691 wikitext text/x-wiki efy8u2p1wnfa4ks16z9u5u8sc2k9qou 2423694 2423691 2026-06-04T12:52:41Z Stashbot 7414 dreamyjazz@deploy1003: mpostoronca, dreamyjazz: Continuing with deployment 2423694 wikitext text/x-wiki rj8i5ujdlcgth3dizslqs5jkozj2wxz 2423697 2423694 2026-06-04T12:57:03Z Stashbot 7414 dreamyjazz@deploy1003: Finished scap sync-world: Backport for [[gerrit:1296557|wmf-config: Skip CAPTCHA for action=mcrundo (T427612)]] (duration: 08m 30s) 2423697 wikitext text/x-wiki byeuvwt14q1gst9ots14bmdf5k2udbc 2423698 2423697 2026-06-04T12:59:35Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.major-upgrade 2423698 wikitext text/x-wiki jtsoddqsajxdn64vptcb7av8jfad9mk 2423699 2423698 2026-06-04T12:59:54Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool es1057: Upgrading es1057.eqiad.wmnet 2423699 wikitext text/x-wiki q82emmgdjtvvff2cue9g6ll5asy8w1z 2423700 2423699 2026-06-04T13:00:17Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1057: Upgrading es1057.eqiad.wmnet 2423700 wikitext text/x-wiki tq1c14mu6yrfcw0hsqzjmdv1quzqkyv 2423701 2423700 2026-06-04T13:00:43Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.reimage for host es1057.eqiad.wmnet with OS trixie 2423701 wikitext text/x-wiki h3gq28643w4pm4k9i0rwwdzmbf2eaps 2423704 2423701 2026-06-04T13:12:21Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Depool db1224', diff saved to https://phabricator.wikimedia.org/P93875 and previous config saved to /var/cache/conftool/dbconfig/20260604-131219-marostegui.json 2423704 wikitext text/x-wiki 3dsb782sop9tblfo205m802x10ev3p6 2423705 2423704 2026-06-04T13:12:48Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1224.eqiad.wmnet with reason: down 2423705 wikitext text/x-wiki h9cp98rykbfofgq9ja427y8o2gqevoq 2423706 2423705 2026-06-04T13:13:39Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1220: Migration of db1220.eqiad.wmnet completed 2423706 wikitext text/x-wiki a2ucyx4p1omznairjvco9887tk5epdk 2423707 2423706 2026-06-04T13:13:41Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2423707 wikitext text/x-wiki gnun4npqcpsp5exzx6lszbdyb8q18fa 2423708 2423707 2026-06-04T13:14:05Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Started scap sync-world: Backport for [[gerrit:1295978|Update config for WikiProjects linking prototype (T427804)]] 2423708 wikitext text/x-wiki 3ws7oj4w1rv2owqfas7yuls6aj4blph 2423709 2423708 2026-06-04T13:16:06Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: lucaswerkmeister-wmde, audreypenven: Backport for [[gerrit:1295978|Update config for WikiProjects linking prototype (T427804)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423709 wikitext text/x-wiki ljyqfhsm8ox55y3tb9te08dw9m7s1fu 2423711 2423709 2026-06-04T13:17:40Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on es1057.eqiad.wmnet with reason: host reimage 2423711 wikitext text/x-wiki 3if1vuqb2le16hh6nua1wqsnowt4j1y 2423713 2423711 2026-06-04T13:25:24Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es1057.eqiad.wmnet with reason: host reimage 2423713 wikitext text/x-wiki rgx8qbc7mbc2cpr9k831gzkxy2982x0 2423714 2423713 2026-06-04T13:26:04Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: lucaswerkmeister-wmde, audreypenven: Continuing with deployment 2423714 wikitext text/x-wiki r0zmqb16mdsz3dec3a0xtx2i7a8q77j 2423719 2423714 2026-06-04T13:31:17Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Finished scap sync-world: Backport for [[gerrit:1295978|Update config for WikiProjects linking prototype (T427804)]] (duration: 17m 13s) 2423719 wikitext text/x-wiki 31l6gzwmznzj3ncjuda07d5hucw6w8c 2423720 2423719 2026-06-04T13:33:12Z Stashbot 7414 dreamyjazz@deploy1003: Started scap sync-world: Backport for [[gerrit:1297692|hCaptcha: Provide always challenge sitekey for account creation (T421041)]] 2423720 wikitext text/x-wiki r0yh8lwfl93tkxcezyt7ealjzcjght0 2423722 2423720 2026-06-04T13:35:14Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Backport for [[gerrit:1297692|hCaptcha: Provide always challenge sitekey for account creation (T421041)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423722 wikitext text/x-wiki k72h18nx5zxhsyypdbatj3074xuhyrl 2423724 2423722 2026-06-04T13:36:28Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1224.eqiad.wmnet with reason: down 2423724 wikitext text/x-wiki 5pobeqn74mjcnbyjg249m9mavdmtll7 2423725 2423724 2026-06-04T13:38:08Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Rolling back deployment 2423725 wikitext text/x-wiki 6e71cd1rpankmlf78odn0beesdphl27 2423726 2423725 2026-06-04T13:38:39Z Stashbot 7414 dreamyjazz@deploy1003: Finished scap sync-world: Backport for [[gerrit:1297692|hCaptcha: Provide always challenge sitekey for account creation (T421041)]] (duration: 05m 27s) 2423726 wikitext text/x-wiki awubi6czuzrahgkrel7ng1ewf3zloa6 2423730 2423726 2026-06-04T13:40:58Z Stashbot 7414 dreamyjazz@deploy1003: Started scap sync-world: Backport for [[gerrit:1297700|Revert "hCaptcha: Provide always challenge sitekey for account creation"]] 2423730 wikitext text/x-wiki pgorjrngatqhwt6cajqet0tmjm4icxk 2423731 2423730 2026-06-04T13:41:53Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es1057.eqiad.wmnet with OS trixie 2423731 wikitext text/x-wiki d52uoikm9462fl42bgkv0alg6kcuyd6 2423732 2423731 2026-06-04T13:43:01Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Backport for [[gerrit:1297700|Revert "hCaptcha: Provide always challenge sitekey for account creation"]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423732 wikitext text/x-wiki td1av8absus8fzx1swyehewimd1q7mt 2423733 2423732 2026-06-04T13:43:56Z Stashbot 7414 marostegui@cumin1003: END (FAIL) - Cookbook sre.mysql.major-upgrade (exit_code=99) 2423733 wikitext text/x-wiki anuq2xy36vzx2cg17a9gz5ibtfk8mx4 2423734 2423733 2026-06-04T13:44:10Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool es1057: repool after upgrade 2423734 wikitext text/x-wiki i2ide68k594ni2gw5x7n9fw7dt65j63 2423735 2423734 2026-06-04T13:47:05Z Stashbot 7414 sukhe: sukhe@cp6011:~$ sudo -i varnish-frontend-restart 2423735 wikitext text/x-wiki 8dtvmqsd968cus81nzkcr2m6xz70lvz 2423736 2423735 2026-06-04T13:50:27Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Continuing with deployment 2423736 wikitext text/x-wiki mow8y1hnyj3lik43jby55brhgp1hsq6 2423737 2423736 2026-06-04T13:51:30Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2423737 wikitext text/x-wiki p2c6glx4dbvttl5ns05lsv5u3r19pc5 2423738 2423737 2026-06-04T13:54:36Z Stashbot 7414 dreamyjazz@deploy1003: Finished scap sync-world: Backport for [[gerrit:1297700|Revert "hCaptcha: Provide always challenge sitekey for account creation"]] (duration: 13m 38s) 2423738 wikitext text/x-wiki nsxw8lrb9au9s4w5m9j7e8fnfhxu2lm 2423739 2423738 2026-06-04T13:56:09Z Stashbot 7414 Dreamy_Jazz: Afternoon UTC backport window done 2423739 wikitext text/x-wiki r72nx67u4ssd1goahv8dyqvzufl30xz 2423740 2423739 2026-06-04T13:56:34Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Promote es2050 to es3 codfw primary T428050', diff saved to https://phabricator.wikimedia.org/P93878 and previous config saved to /var/cache/conftool/dbconfig/20260604-135631-marostegui.json 2423740 wikitext text/x-wiki ec7eg7u629iw2mon68tmmtmgj9orrlw 2423741 2423740 2026-06-04T13:56:38Z Stashbot 7414 _joe_: transferred requestctl api tokens for all ops to the db (T428119) 2423741 wikitext text/x-wiki 5gtp5iw5bt8gdi69g6tnt1i9v2dsz0e 2423745 2423741 2026-06-04T14:05:00Z Stashbot 7414 jgiannelos@deploy1003: helmfile [staging] START helmfile.d/services/tegola-vector-tiles: apply 2423745 wikitext text/x-wiki gp39ltzq5hr66rujnadpfejirbky5gf 2423746 2423745 2026-06-04T14:05:03Z Stashbot 7414 jgiannelos@deploy1003: helmfile [staging] DONE helmfile.d/services/tegola-vector-tiles: apply 2423746 wikitext text/x-wiki ccrlxxntcpn80htgl9m7fx3uzw7pck3 2423747 2423746 2026-06-04T14:05:24Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] START helmfile.d/services/tegola-vector-tiles: apply 2423747 wikitext text/x-wiki q3ia5goyt0cwel36v917hwuv1dxblcj 2423748 2423747 2026-06-04T14:06:06Z Stashbot 7414 tappof: bump space for prometheus k8s-aux in eqiad 2423748 wikitext text/x-wiki etyfwf42k2y9rcr7fa455s1kxrqephb 2423749 2423748 2026-06-04T14:06:11Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] DONE helmfile.d/services/tegola-vector-tiles: apply 2423749 wikitext text/x-wiki 2uo6cx4y7v83d98gxqufymh9nqo6y4s 2423750 2423749 2026-06-04T14:06:19Z Stashbot 7414 dreamyjazz@deploy1003: Started scap sync-world: Backport for [[gerrit:1297704|Use the globalblock-local-status right over globalblock-whitelist (T277942)]], [[gerrit:1296620|core-Permissions: Stop assigning unused globalblock-whitelist right (T277942)]] 2423750 wikitext text/x-wiki af9qg28vvnlpbkafyumcd56fks7pqxu 2423751 2423750 2026-06-04T14:06:58Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] START helmfile.d/services/tegola-vector-tiles: apply 2423751 wikitext text/x-wiki bwznte31qae1eos7m58b5wu3nv9kp4c 2423752 2423751 2026-06-04T14:07:35Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] DONE helmfile.d/services/tegola-vector-tiles: apply 2423752 wikitext text/x-wiki piak6z7jd3qs6ldo11aiqdcdw3bhqme 2423753 2423752 2026-06-04T14:08:24Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Backport for [[gerrit:1297704|Use the globalblock-local-status right over globalblock-whitelist (T277942)]], [[gerrit:1296620|core-Permissions: Stop assigning unused globalblock-whitelist right (T277942)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423753 wikitext text/x-wiki j9szok3tfvggpgawax7pzerr64c8nfu 2423754 2423753 2026-06-04T14:08:54Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Continuing with deployment 2423754 wikitext text/x-wiki l3srv0vtmgplt3jh2r2134tm2fyf27f 2423755 2423754 2026-06-04T14:10:24Z Stashbot 7414 ozge@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . 2423755 wikitext text/x-wiki do565kjabgmevon981acevpklztbccc 2423757 2423755 2026-06-04T14:13:06Z Stashbot 7414 dreamyjazz@deploy1003: Finished scap sync-world: Backport for [[gerrit:1297704|Use the globalblock-local-status right over globalblock-whitelist (T277942)]], [[gerrit:1296620|core-Permissions: Stop assigning unused globalblock-whitelist right (T277942)]] (duration: 06m 46s) 2423757 wikitext text/x-wiki a62dyrsl8l6dlzwy99004rpbtydfr3r 2423758 2423757 2026-06-04T14:15:38Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] START helmfile.d/services/tegola-vector-tiles: apply 2423758 wikitext text/x-wiki 7eiffddjlrdkk0xa88o6eeqtfwgva35 2423759 2423758 2026-06-04T14:15:41Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] DONE helmfile.d/services/tegola-vector-tiles: apply 2423759 wikitext text/x-wiki sce2rl86wgoqc8sblh5k43xih7r3bhz 2423760 2423759 2026-06-04T14:15:46Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] START helmfile.d/services/tegola-vector-tiles: apply 2423760 wikitext text/x-wiki m6dm74n0r7c7mzcixiwf4x6ei1ucphj 2423761 2423760 2026-06-04T14:16:28Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] DONE helmfile.d/services/tegola-vector-tiles: apply 2423761 wikitext text/x-wiki 0o1iqnao8zqe29k73lcgwuvlerdkvve 2423762 2423761 2026-06-04T14:16:32Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] START helmfile.d/services/tegola-vector-tiles: apply 2423762 wikitext text/x-wiki r5rc31xump91xz009xavez6k9jox72m 2423763 2423762 2026-06-04T14:16:35Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] DONE helmfile.d/services/tegola-vector-tiles: apply 2423763 wikitext text/x-wiki hejiqm1b867go50fuxmbo4kw2r6edbn 2423764 2423763 2026-06-04T14:16:38Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] START helmfile.d/services/tegola-vector-tiles: apply 2423764 wikitext text/x-wiki 2mrj04c0uax87oplqi2vapysvjhljnq 2423765 2423764 2026-06-04T14:16:42Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] DONE helmfile.d/services/tegola-vector-tiles: apply 2423765 wikitext text/x-wiki mxmd0lcqxw71b26xvmtwn1lth4k3mza 2423766 2423765 2026-06-04T14:20:27Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2423766 wikitext text/x-wiki ervpv05k3cda3o3qex5mfds4hq9ed06 2423768 2423766 2026-06-04T14:28:13Z Stashbot 7414 dreamyjazz@deploy1003: Started scap sync-world: Backport for [[gerrit:1297711|hCaptcha: Enable for MobileFrontend in some Group 2 wikis (T425940)]] 2423768 wikitext text/x-wiki qgwp90rsozvs8qs4ixfajtlq6zrkogl 2423769 2423768 2026-06-04T14:29:34Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool es1057: repool after upgrade 2423769 wikitext text/x-wiki rtxmhmhycbayj8gcahy5pffsdcoypkx 2423770 2423769 2026-06-04T14:30:16Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Backport for [[gerrit:1297711|hCaptcha: Enable for MobileFrontend in some Group 2 wikis (T425940)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423770 wikitext text/x-wiki jhd7n5mt9lr6mgigk8cxwjuqtp4g3mp 2423771 2423770 2026-06-04T14:32:25Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Continuing with deployment 2423771 wikitext text/x-wiki rwkmmslwn1zu41vv6fl9khlnkooj2qz 2423773 2423771 2026-06-04T14:36:33Z Stashbot 7414 dreamyjazz@deploy1003: Finished scap sync-world: Backport for [[gerrit:1297711|hCaptcha: Enable for MobileFrontend in some Group 2 wikis (T425940)]] (duration: 08m 20s) 2423773 wikitext text/x-wiki fixpflb0wmu9ssyexciy4wwuy8rxmgc 2423774 2423773 2026-06-04T14:39:49Z Stashbot 7414 zabe@deploy1003: Started scap sync-world: Backport for [[gerrit:1270513|Start reading from new file tables on commons (T416548)]] 2423774 wikitext text/x-wiki 462t64fsxr7iqasjc425lhirql8yf5h 2423775 2423774 2026-06-04T14:40:09Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.network.tls for network device lsw1-f1-codfw 2423775 wikitext text/x-wiki ka75fnyiqw2t2hn6junvt0n7ediyc53 2423776 2423775 2026-06-04T14:40:16Z Stashbot 7414 ayounsi@cumin1003: END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-f1-codfw 2423776 wikitext text/x-wiki 2ea634vj3im6a8x7lkv1jnhg9cthlgi 2423777 2423776 2026-06-04T14:41:52Z Stashbot 7414 zabe@deploy1003: zabe: Backport for [[gerrit:1270513|Start reading from new file tables on commons (T416548)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423777 wikitext text/x-wiki 6as3gffktcbi24c5yk8ki25s6w7kjuw 2423778 2423777 2026-06-04T14:43:10Z Stashbot 7414 zabe@deploy1003: zabe: Continuing with deployment 2423778 wikitext text/x-wiki mvx6s735vz3upes9x6iv860fjhmj63u 2423779 2423778 2026-06-04T14:43:47Z Stashbot 7414 zabe@deploy1003: sync-world aborted: Backport for [[gerrit:1270513|Start reading from new file tables on commons (T416548)]] (duration: 03m 58s) 2423779 wikitext text/x-wiki ox0b7zol5pkbmaxbg5j7ha0e0mblz5k 2423781 2423779 2026-06-04T14:49:39Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. 2423781 wikitext text/x-wiki e4ltoju3ii1vn7xxdd0z4o50jqd0cco 2423782 2423781 2026-06-04T14:50:16Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. 2423782 wikitext text/x-wiki atss2557mh5yiwz9orwxvg9e87a6jsl 2423783 2423782 2026-06-04T14:52:23Z Stashbot 7414 zabe@deploy1003: Started scap sync-world: T416548 2423783 wikitext text/x-wiki bq5syshkrtp1ne48bhb186u29dlkdc4 2423784 2423783 2026-06-04T14:56:06Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.hosts.reimage for host kafka-main2007.codfw.wmnet with OS trixie 2423784 wikitext text/x-wiki 7d0h8lkwk1seuqrkzfazv58gm3oynzc 2423786 2423784 2026-06-04T14:57:34Z Stashbot 7414 zabe@deploy1003: Finished scap sync-world: T416548 (duration: 05m 10s) 2423786 wikitext text/x-wiki gqlq8vaqnbc9ow5bbnp0eizdp2v8adh 2423787 2423786 2026-06-04T14:59:15Z Stashbot 7414 zabe@deploy1003: Started scap sync-world: Backport for [[gerrit:1297724|Revert "Start reading from new file tables on commons"]] 2423787 wikitext text/x-wiki 32gp89avtmucodpt5e4qr5nwjz0nioj 2423788 2423787 2026-06-04T15:01:29Z Stashbot 7414 zabe@deploy1003: zabe: Backport for [[gerrit:1297724|Revert "Start reading from new file tables on commons"]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423788 wikitext text/x-wiki qfxvyi96zz76gji2dduw590imu4sua4 2423789 2423788 2026-06-04T15:02:02Z Stashbot 7414 zabe@deploy1003: zabe: Continuing with deployment 2423789 wikitext text/x-wiki qc8jg6kfcdpsh0ub053yh3zvmvapfi8 2423790 2423789 2026-06-04T15:05:45Z Stashbot 7414 ladsgroup@cumin1003: START - Cookbook sre.wikireplicas.update-views 2423790 wikitext text/x-wiki nx0sa9yfwh9hog5glkdpela1mmxnx2c 2423791 2423790 2026-06-04T15:06:15Z Stashbot 7414 zabe@deploy1003: Finished scap sync-world: Backport for [[gerrit:1297724|Revert "Start reading from new file tables on commons"]] (duration: 07m 00s) 2423791 wikitext text/x-wiki t4gfaxbxynjd2yuthr74w2pzd4xyc55 2423792 2423791 2026-06-04T15:13:36Z Stashbot 7414 ladsgroup@cumin1003: END (PASS) - Cookbook sre.wikireplicas.update-views (exit_code=0) 2423792 wikitext text/x-wiki bkcqaonanc2mfndc43ictdgpwedqa7n 2423793 2423792 2026-06-04T15:17:24Z Stashbot 7414 sbisson@deploy1003: Started scap sync-world: Backport for [[gerrit:1297730|ptwiki: Disable Article Guidance experiment (T426871)]] 2423793 wikitext text/x-wiki f3s1i3tn9zi6h99ndv08qzbau05xqbg 2423794 2423793 2026-06-04T15:19:29Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on kafka-main2007.codfw.wmnet with reason: host reimage 2423794 wikitext text/x-wiki 2tkxf1ap9z3zoadmy2uh01bjuxw7w9z 2423795 2423794 2026-06-04T15:19:36Z Stashbot 7414 sbisson@deploy1003: sbisson: Backport for [[gerrit:1297730|ptwiki: Disable Article Guidance experiment (T426871)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423795 wikitext text/x-wiki 6o1lkmpvav5s76fgomq71maabulg9om 2423796 2423795 2026-06-04T15:20:39Z Stashbot 7414 sbisson@deploy1003: sbisson: Continuing with deployment 2423796 wikitext text/x-wiki b6ilxd0t9ygzy4do9fyxf9uusgxoyql 2423797 2423796 2026-06-04T15:24:22Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kafka-main2007.codfw.wmnet with reason: host reimage 2423797 wikitext text/x-wiki emkvx31mirchbktexl0cgmbx8bugw51 2423798 2423797 2026-06-04T15:24:50Z Stashbot 7414 sbisson@deploy1003: Finished scap sync-world: Backport for [[gerrit:1297730|ptwiki: Disable Article Guidance experiment (T426871)]] (duration: 07m 26s) 2423798 wikitext text/x-wiki olerwuw8sdbmxln85l6k69api4vqfm7 2423800 2423798 2026-06-04T15:28:56Z Stashbot 7414 ladsgroup@cumin1003: START - Cookbook sre.wikireplicas.update-views 2423800 wikitext text/x-wiki 3ozguwxdngihzbbab1kboemmovaugt4 2423801 2423800 2026-06-04T15:39:53Z Stashbot 7414 ladsgroup@cumin1003: END (PASS) - Cookbook sre.wikireplicas.update-views (exit_code=0) 2423801 wikitext text/x-wiki mkfm0dflp93324ll2saml59p7aq1qeq 2423802 2423801 2026-06-04T15:41:33Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kafka-main2007.codfw.wmnet with OS trixie 2423802 wikitext text/x-wiki 6s5ae6uwkd9o3tp69ahg9y0i2taaq7s 2423803 2423802 2026-06-04T15:44:49Z Stashbot 7414 brett@puppetserver1001: conftool action : set/pooled=no; selector: name=cp5030.* 2423803 wikitext text/x-wiki s2f6an8tyu7xlxq9ywwxlfyp95472pg 2423805 2423803 2026-06-04T15:53:33Z Stashbot 7414 dreamyjazz@deploy1003: Started scap sync-world: Backport for [[gerrit:1297740|hCaptcha: Move ConfirmEditCaptchaClass hook inside hCaptcha block (T428183)]] 2423805 wikitext text/x-wiki 30djtcjethktt5rvg0f195k4qeq8gnh 2423806 2423805 2026-06-04T15:55:38Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Backport for [[gerrit:1297740|hCaptcha: Move ConfirmEditCaptchaClass hook inside hCaptcha block (T428183)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423806 wikitext text/x-wiki fidvblz5pmwsg8ch3yhmjl470kwu57f 2423807 2423806 2026-06-04T15:59:26Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Continuing with deployment 2423807 wikitext text/x-wiki 01tvah6xa6a093yd3dujgvgv2s5gn32 2423808 2423807 2026-06-04T16:03:10Z Stashbot 7414 elukey: uploaded spicerack_12.7.0 to apt.wikimedia.org bookworm-wikimedia,trixie-wikimedia 2423808 wikitext text/x-wiki sxdjy38cfyev2on79zoqpu9gbzz0ptc 2423809 2423808 2026-06-04T16:03:54Z Stashbot 7414 dreamyjazz@deploy1003: Finished scap sync-world: Backport for [[gerrit:1297740|hCaptcha: Move ConfirmEditCaptchaClass hook inside hCaptcha block (T428183)]] (duration: 10m 21s) 2423809 wikitext text/x-wiki njx5j0ya8upospll41q230307bc526q 2423812 2423809 2026-06-04T16:17:26Z Stashbot 7414 ozge@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2423812 wikitext text/x-wiki 74vgpnksrafa951s5101bh2n16fde9x 2423813 2423812 2026-06-04T16:31:31Z Stashbot 7414 dreamyjazz@deploy1003: Started scap sync-world: Backport for [[gerrit:1297741|hCaptcha: Update MF interface name for instrumentation (T428178)]], [[gerrit:1297742|hCaptcha: Update MF interface name for instrumentation (T428178)]] 2423813 wikitext text/x-wiki cg1qkw897nnrrpm3ghg7cc3d7vms4r6 2423814 2423813 2026-06-04T16:33:30Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Backport for [[gerrit:1297741|hCaptcha: Update MF interface name for instrumentation (T428178)]], [[gerrit:1297742|hCaptcha: Update MF interface name for instrumentation (T428178)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423814 wikitext text/x-wiki eiaks4r78xg8ptqjstivzi01r7i5ax0 2423815 2423814 2026-06-04T16:41:18Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Continuing with deployment 2423815 wikitext text/x-wiki 872tf6ut14zvjfcg1yz8e4dkp06iiq9 2423816 2423815 2026-06-04T16:45:27Z Stashbot 7414 dreamyjazz@deploy1003: Finished scap sync-world: Backport for [[gerrit:1297741|hCaptcha: Update MF interface name for instrumentation (T428178)]], [[gerrit:1297742|hCaptcha: Update MF interface name for instrumentation (T428178)]] (duration: 13m 58s) 2423816 wikitext text/x-wiki bl94zx0i58vx1oq0l2fwn6zjke1odpy 2423817 2423816 2026-06-04T16:55:56Z Stashbot 7414 topranks: shift traffic off cr1-esams et-1/0/1 link to asw1-by27-esams T427056 2423817 wikitext text/x-wiki o4ss6h1kv7v5ws4cmdfri4dg0pwcfpx 2423818 2423817 2026-06-04T17:11:06Z Stashbot 7414 dreamyjazz@deploy1003: Started scap sync-world: Backport for [[gerrit:1297751|hCaptcha: Update MF interface name for instrumentation (T428178)]], [[gerrit:1297752|hCaptcha: Update MF interface name for instrumentation (T428178)]] 2423818 wikitext text/x-wiki 4l2r15i2dssw4nwpi4qkkjdbtw8biow 2423819 2423818 2026-06-04T17:13:08Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Backport for [[gerrit:1297751|hCaptcha: Update MF interface name for instrumentation (T428178)]], [[gerrit:1297752|hCaptcha: Update MF interface name for instrumentation (T428178)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423819 wikitext text/x-wiki 6wfyn3a75xxg5zqyec5e0p5i89l1l2w 2423820 2423819 2026-06-04T17:13:30Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Continuing with deployment 2423820 wikitext text/x-wiki khkntirlp9mdmvm2k4d6hp0s5l4wohu 2423821 2423820 2026-06-04T17:17:44Z Stashbot 7414 dreamyjazz@deploy1003: Finished scap sync-world: Backport for [[gerrit:1297751|hCaptcha: Update MF interface name for instrumentation (T428178)]], [[gerrit:1297752|hCaptcha: Update MF interface name for instrumentation (T428178)]] (duration: 06m 40s) 2423821 wikitext text/x-wiki 13x50ly78us0t9gmlqx3lgi5hcb98q2 2423822 2423821 2026-06-04T18:08:43Z Stashbot 7414 dancy@deploy1003: rebuilt and synchronized wikiversions files: group2 to 1.47.0-wmf.5 refs T423914 2423822 wikitext text/x-wiki 5dajaepe85b032ryptdhmtb5gfr7lf9 2423823 2423822 2026-06-04T18:36:21Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.netbox 2423823 wikitext text/x-wiki 9fm5eg2epbp4yoonnizb5gj5um4qdzi 2423824 2423823 2026-06-04T18:37:07Z Stashbot 7414 sukhe: sukhe@cp6013:~$ sudo traffic_server -C clear_cache 2423824 wikitext text/x-wiki 1n3uag09zlejsy492uw3v26agbzd4sv 2423825 2423824 2026-06-04T18:40:06Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: remove IPs that had been used for eqsin cr links - cmooney@cumin1003" 2423825 wikitext text/x-wiki f0to379hwepxjviaexidihdekxywx0c 2423826 2423825 2026-06-04T18:42:59Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: remove IPs that had been used for eqsin cr links - cmooney@cumin1003" 2423826 wikitext text/x-wiki em3rgdy2negkpddb467c3kvx9zkp3kp 2423827 2423826 2026-06-04T18:43:01Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2423827 wikitext text/x-wiki r7e0evbfe3wbtax83ts6djpkcg8eto1 2423828 2423827 2026-06-04T18:50:17Z Stashbot 7414 cmooney@dns2005: START - running authdns-update 2423828 wikitext text/x-wiki n4fczghvj5l530apsnmtrkgdo52aca2 2423829 2423828 2026-06-04T18:51:33Z Stashbot 7414 cmooney@dns2005: END - running authdns-update 2423829 wikitext text/x-wiki e3a7q09cv0so16l9m14dmavea3sdl6s 2423830 2423829 2026-06-04T19:08:08Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.hosts.reimage for host cp5030.eqsin.wmnet with OS trixie 2423830 wikitext text/x-wiki 3kxgyicjuaosxs081ndo3iq27d1g2jl 2423831 2423830 2026-06-04T19:08:38Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.hosts.move-vlan for host cp5030 2423831 wikitext text/x-wiki r7wylplsp9ni5cod5qbx203skrktcx7 2423832 2423831 2026-06-04T19:09:11Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.netbox 2423832 wikitext text/x-wiki tc0wcn2v5g4uzpwyakoq6nf3hta7b38 2423833 2423832 2026-06-04T19:13:16Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host cp5030 - cmooney@cumin1003" 2423833 wikitext text/x-wiki 2bhfqbz5lcx060vvjyrsg484ad878yr 2423834 2423833 2026-06-04T19:14:18Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host cp5030 - cmooney@cumin1003" 2423834 wikitext text/x-wiki 7sdhy1xu7mpjptqd5yi4fitpssw5lv5 2423835 2423834 2026-06-04T19:14:20Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2423835 wikitext text/x-wiki 5o7ep1kqpfmkphgmgjsbluih8284b3v 2423836 2423835 2026-06-04T19:14:22Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.wipe-cache cp5030.eqsin.wmnet 27.0.132.10.in-addr.arpa 7.2.0.0.0.0.0.0.2.3.1.0.0.1.0.0.1.0.1.0.0.0.5.e.2.f.d.0.1.0.0.2.ip6.arpa on all recursors 2423836 wikitext text/x-wiki ma3d0bqv24kpntlumc0pz15imwu080m 2423837 2423836 2026-06-04T19:14:24Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) cp5030.eqsin.wmnet 27.0.132.10.in-addr.arpa 7.2.0.0.0.0.0.0.2.3.1.0.0.1.0.0.1.0.1.0.0.0.5.e.2.f.d.0.1.0.0.2.ip6.arpa on all recursors 2423837 wikitext text/x-wiki d1ku391u4aygs8gs0q49wla4b1iln1q 2423838 2423837 2026-06-04T19:14:26Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host cp5030 2423838 wikitext text/x-wiki jmtqol4xa6gr5u4lk7gtebmxlh0iqp3 2423839 2423838 2026-06-04T19:15:08Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cp5030 2423839 wikitext text/x-wiki ljtt9twt7io8voagdim1dzqxeiojv7o 2423840 2423839 2026-06-04T19:15:09Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host cp5030 2423840 wikitext text/x-wiki 6534it13cns0671q5fngj0do3iug1kb 2423844 2423840 2026-06-04T19:43:50Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on cp5030.eqsin.wmnet with reason: host reimage 2423844 wikitext text/x-wiki 7zoxoxep51mmoys4p00kjp410f8pxyk 2423845 2423844 2026-06-04T19:49:53Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp5030.eqsin.wmnet with reason: host reimage 2423845 wikitext text/x-wiki 6cewa9fvmxfceyznzh7umtauekxg3cq 2423847 2423845 2026-06-04T20:02:50Z Stashbot 7414 arlolra@deploy1003: Started scap sync-world: Backport for [[gerrit:1296015|Deploy PRV to 6 wikis (T427851)]] 2423847 wikitext text/x-wiki mouhj9doj0o1lamau1fwdalce1mnd1s 2423848 2423847 2026-06-04T20:04:47Z Stashbot 7414 arlolra@deploy1003: arlolra: Backport for [[gerrit:1296015|Deploy PRV to 6 wikis (T427851)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423848 wikitext text/x-wiki sckmmqgpuhgb3ovz30oijlh0a5jg0lm 2423850 2423848 2026-06-04T20:06:13Z Stashbot 7414 arlolra@deploy1003: arlolra: Continuing with deployment 2423850 wikitext text/x-wiki mq41pazv74ak5ck6dsihjaz1mf6ww8t 2423851 2423850 2026-06-04T20:08:21Z Stashbot 7414 Dreamy_Jazz: Running `/usr/local/bin/foreachwikiindblist group2.dblist extensions/MediaModeration/maintenance/scanFilesInScanTable.php --use-jobqueue --sleep=1 --poll-sleep=10 --verbose` 2423851 wikitext text/x-wiki kig11dqspmq1l0lp4h1914ahouxcvlj 2423852 2423851 2026-06-04T20:10:29Z Stashbot 7414 arlolra@deploy1003: Finished scap sync-world: Backport for [[gerrit:1296015|Deploy PRV to 6 wikis (T427851)]] (duration: 07m 39s) 2423852 wikitext text/x-wiki s6nc2o8lzqeci776u7n8s4vakvyvwgs 2423853 2423852 2026-06-04T20:18:10Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp5030.eqsin.wmnet with OS trixie 2423853 wikitext text/x-wiki 1lrnppl8qieblh3hh7vcb4clhtcqqxj 2423854 2423853 2026-06-04T20:19:02Z Stashbot 7414 brett@dns1006: START - running authdns-update 2423854 wikitext text/x-wiki cj8qunf62p86djykbw136jt9ihcikn5 2423855 2423854 2026-06-04T20:20:32Z Stashbot 7414 brett@dns1006: END - running authdns-update 2423855 wikitext text/x-wiki cf8whmhk2geupd1m75i461bx56crk97 2423857 2423855 2026-06-04T20:26:57Z Stashbot 7414 sukhe@puppetserver1001: conftool action : set/pooled=yes; selector: name=cp6013.drmrs.wmnet,service=(cdn|ats-be) 2423857 wikitext text/x-wiki e1rpgjbh0jbn5gl5fghwwxyzgaoneot 2423858 2423857 2026-06-04T20:27:33Z Stashbot 7414 sukhe@puppetserver1001: conftool action : set/pooled=yes; selector: name=cp1100.eqiad.wmnet,service=(cdn|ats-be) 2423858 wikitext text/x-wiki iwm72uz3l2hhired1rs0cregwe6ui0c 2423859 2423858 2026-06-04T20:42:32Z Stashbot 7414 dzahn@cumin2002: START - Cookbook sre.hosts.reimage for host releases1003.eqiad.wmnet with OS trixie 2423859 wikitext text/x-wiki 0erc2ifbjsz0c7i7fth3dnimerxoofj 2423861 2423859 2026-06-04T20:50:55Z Stashbot 7414 brett@puppetserver1001: conftool action : set/pooled=yes; selector: name=cp5030.* 2423861 wikitext text/x-wiki caz92qw03326dv4sqf6nnm01l421e5k 2423862 2423861 2026-06-04T20:58:03Z Stashbot 7414 dzahn@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on releases1003.eqiad.wmnet with reason: host reimage 2423862 wikitext text/x-wiki f9qsjfvparvk37lkgf2fq969vyc8u1w 2423863 2423862 2026-06-04T21:04:19Z Stashbot 7414 dzahn@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on releases1003.eqiad.wmnet with reason: host reimage 2423863 wikitext text/x-wiki 738yxhoi5ht9gmwx6aj8lq5dr2cp2dq 2423864 2423863 2026-06-04T21:28:36Z Stashbot 7414 dzahn@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host releases1003.eqiad.wmnet with OS trixie 2423864 wikitext text/x-wiki cyfk65u4m3rhmi8o5p7laz8274u0wxj 2423875 2423864 2026-06-04T23:20:06Z Stashbot 7414 jasmine@cumin2002: START - Cookbook sre.hosts.reimage for host kafka-main1006.eqiad.wmnet with OS trixie 2423875 wikitext text/x-wiki b42pi5f4hyv6bprruopnl2ozhvoy0ys 2423876 2423875 2026-06-04T23:36:16Z Stashbot 7414 jasmine@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on kafka-main1006.eqiad.wmnet with reason: host reimage 2423876 wikitext text/x-wiki 1wkapa25wnabm8kipidyy4dvm0mzlfh 2423878 2423876 2026-06-04T23:40:27Z Stashbot 7414 jasmine@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kafka-main1006.eqiad.wmnet with reason: host reimage 2423878 wikitext text/x-wiki ml7okmthlix7k7s6mycd89454wxxmh4 2423879 2423878 2026-06-04T23:55:01Z Stashbot 7414 ladsgroup@deploy1003: Started scap sync-world: Backport for [[gerrit:1297268|Redirect unknown wikinews languages to portal (T427126)]] 2423879 wikitext text/x-wiki jv4i9vrwzhnd9pn8dl7z3o9aprgwds8 2423880 2423879 2026-06-04T23:57:01Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup, pppery: Backport for [[gerrit:1297268|Redirect unknown wikinews languages to portal (T427126)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423880 wikitext text/x-wiki 4pxvy044bo5dn96q87qm1za436agccm 2423881 2423880 2026-06-04T23:57:47Z Stashbot 7414 jasmine@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kafka-main1006.eqiad.wmnet with OS trixie 2423881 wikitext text/x-wiki odap6y3db6e884tpbxs9beo1wf6styb 2423882 2423881 2026-06-04T23:57:49Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup, pppery: Continuing with deployment 2423882 wikitext text/x-wiki lpq5011rudehbq41mwlgzoxyz81et88 2423883 2423882 2026-06-05T00:02:04Z Stashbot 7414 ladsgroup@deploy1003: Finished scap sync-world: Backport for [[gerrit:1297268|Redirect unknown wikinews languages to portal (T427126)]] (duration: 07m 02s) 2423883 wikitext text/x-wiki js5dljh0wisuw0kdaaj1gw5n06bupq9 2423885 2423883 2026-06-05T00:17:06Z Stashbot 7414 jasmine@cumin2002: START - Cookbook sre.hosts.reimage for host kafka-main1007.eqiad.wmnet with OS trixie 2423885 wikitext text/x-wiki baxji0p6dy0cgbva9lxwudbrqgko1z3 2423886 2423885 2026-06-05T00:33:28Z Stashbot 7414 jasmine@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on kafka-main1007.eqiad.wmnet with reason: host reimage 2423886 wikitext text/x-wiki 5whk9lhv9htnqcaxh8dd8ejdp27eh77 2423887 2423886 2026-06-05T00:40:03Z Stashbot 7414 jasmine@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kafka-main1007.eqiad.wmnet with reason: host reimage 2423887 wikitext text/x-wiki gy48vg2x8p5ymt6k2rp4zwzxnli1zkk 2423888 2423887 2026-06-05T00:56:40Z Stashbot 7414 jasmine@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kafka-main1007.eqiad.wmnet with OS trixie 2423888 wikitext text/x-wiki 35ztj0368ms5bi25zqj09lfgd32bfja 2423889 2423888 2026-06-05T01:16:22Z Stashbot 7414 jasmine@cumin2002: START - Cookbook sre.hosts.reimage for host kafka-main1010.eqiad.wmnet with OS trixie 2423889 wikitext text/x-wiki rkq8m6wew1wpgqy51rbldu6zrl5ct6b 2423890 2423889 2026-06-05T01:32:53Z Stashbot 7414 jasmine@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on kafka-main1010.eqiad.wmnet with reason: host reimage 2423890 wikitext text/x-wiki 6j57492ztr3uc1clycz2miaqocfjlt0 2423891 2423890 2026-06-05T01:39:12Z Stashbot 7414 jasmine@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kafka-main1010.eqiad.wmnet with reason: host reimage 2423891 wikitext text/x-wiki 8be6c3yixcjfkc1xc9ejuntxqbq26ym 2423892 2423891 2026-06-05T01:55:40Z Stashbot 7414 jasmine@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kafka-main1010.eqiad.wmnet with OS trixie 2423892 wikitext text/x-wiki 2rxhe6z9xx229axkjmfst1uljpyfscw 2423894 2423892 2026-06-05T05:20:53Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.major-upgrade 2423894 wikitext text/x-wiki 6xq470pm09j4c422trt1sxzap0l7wo2 2423895 2423894 2026-06-05T05:21:13Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool es1054: Upgrading es1054.eqiad.wmnet 2423895 wikitext text/x-wiki 9aq8yqpyagqp4z2mtc3iwlyal1nqycn 2423896 2423895 2026-06-05T05:21:32Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1054: Upgrading es1054.eqiad.wmnet 2423896 wikitext text/x-wiki 4n8h6u8965q8s7ma5f7pimoz4m4cwre 2423897 2423896 2026-06-05T05:22:16Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.reimage for host es1054.eqiad.wmnet with OS trixie 2423897 wikitext text/x-wiki axytbpj8effqfz37nlwhv4acy1ojhv1 2423898 2423897 2026-06-05T05:37:46Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on es1054.eqiad.wmnet with reason: host reimage 2423898 wikitext text/x-wiki 873hej4xa8vs5bkcz8cqw2o8vrtxyym 2423899 2423898 2026-06-05T05:45:18Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es1054.eqiad.wmnet with reason: host reimage 2423899 wikitext text/x-wiki 6sych7gu9g2twygpmcjwtc7clajeny6 2423900 2423899 2026-06-05T06:01:22Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es1054.eqiad.wmnet with OS trixie 2423900 wikitext text/x-wiki 57aq1vp7s5nvlgl2t88kh4g4raabky3 2423901 2423900 2026-06-05T07:07:57Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2423901 wikitext text/x-wiki nfuzogc6bbwpnnkv8fylt1c8ikdeuq7 2423902 2423901 2026-06-05T07:16:51Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/kafka-ui: apply 2423902 wikitext text/x-wiki 5ehfl70y4dz0j2e8nhpbg6p0wtk4dx7 2423903 2423902 2026-06-05T07:17:08Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/kafka-ui: apply 2423903 wikitext text/x-wiki q7e2n23juho1nwdfaec0m3xfi7bs88y 2423904 2423903 2026-06-05T07:17:18Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/dse-k8s-services/kafka-ui: apply 2423904 wikitext text/x-wiki 08kk6y2h9nynmix6wusw4lq0kd2i2m2 2423905 2423904 2026-06-05T07:17:35Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/dse-k8s-services/kafka-ui: apply 2423905 wikitext text/x-wiki dc99sn1idz64e0mc03yksrlm5wri9wb 2423906 2423905 2026-06-05T07:38:52Z Stashbot 7414 marostegui@cumin1003: END (FAIL) - Cookbook sre.mysql.major-upgrade (exit_code=99) 2423906 wikitext text/x-wiki 35hqqbfqxq5o7r9kmxdamsdifgnfa8h 2423907 2423906 2026-06-05T07:39:07Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool es1054: repool after upgrade 2423907 wikitext text/x-wiki h0h5t1pj6dn1ambuhm0hypxczmryxva 2423908 2423907 2026-06-05T08:07:25Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/kafka-ui: apply 2423908 wikitext text/x-wiki nawin79mghviivz7r6hj6n5kmf8628z 2423909 2423908 2026-06-05T08:07:41Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/kafka-ui: apply 2423909 wikitext text/x-wiki ifeprf8n2lgtw0gxba2fqii1q7md0ys 2423910 2423909 2026-06-05T08:07:48Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/dse-k8s-services/kafka-ui: apply 2423910 wikitext text/x-wiki cwcdzl9ztbquovdlhmspd9yppv3smsu 2423911 2423910 2026-06-05T08:08:05Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/dse-k8s-services/kafka-ui: apply 2423911 wikitext text/x-wiki 7z0si3sv6ct56hhhlkrmi8upodkbnrd 2423912 2423911 2026-06-05T08:24:29Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool es1054: repool after upgrade 2423912 wikitext text/x-wiki q34mf93y18ly9ijecs2iyhqs28dx5mh 2423914 2423912 2026-06-05T09:31:35Z Stashbot 7414 ozge@deploy1003: helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . 2423914 wikitext text/x-wiki 4t4rjp8fj5alwliiakxk9dst94ncfjy 2423917 2423914 2026-06-05T10:54:51Z Stashbot 7414 daniel@deploy1003: helmfile [staging] START helmfile.d/services/rest-gateway: apply 2423917 wikitext text/x-wiki 003swe6huagt6rr7yfssq7ikb8ewhqk 2423918 2423917 2026-06-05T10:55:45Z Stashbot 7414 daniel@deploy1003: helmfile [staging] DONE helmfile.d/services/rest-gateway: apply 2423918 wikitext text/x-wiki bqo4uu1uhg2fpamm79puk793qzj3act 2423920 2423918 2026-06-05T11:28:28Z Stashbot 7414 daniel@deploy1003: helmfile [staging] START helmfile.d/services/rest-gateway: apply 2423920 wikitext text/x-wiki mtktuikozqxoodahsnoxnpj3afi3yn5 2423921 2423920 2026-06-05T11:29:12Z Stashbot 7414 daniel@deploy1003: helmfile [staging] DONE helmfile.d/services/rest-gateway: apply 2423921 wikitext text/x-wiki 3qs7svz2x1npncro956ci893h6guyk9 0 17290 2423684 2423592 2026-06-04T12:31:00Z Stashbot 7414 Lucas_WMDE: ssh integration-castor06.integration.eqiad1.wikimedia.cloud sudo -u jenkins-deploy rm -rf /srv/castor/castor-mw-ext-and-skins/master/mwext-node24-rundoc # fix failure seen in mwext-node24-rundoc 4812 2423684 wikitext text/x-wiki gmfreeta16rojyq0ek0spmq7zc7x2ma 2423877 2423684 2026-06-04T23:39:30Z Stashbot 7414 jeena: Updating development images on contint primary for T424691 2423877 wikitext text/x-wiki dkete0asedqgbwisy9goj7dxhxkc2zt 0 442952 2423785 2423229 2026-06-04T14:57:31Z Raymond Ndibe 16522 updating Raymond's record 2423785 wikitext text/x-wiki 2xynjivf41vu47fuut6c4sbd4z8whhs 498 443628 2423868 2421822 2026-06-04T22:12:32Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/26982622098 (https://github.com/cluebotng/component-configs/commits/eb9cf1341e6e78387424cb9070a3aec87971e54d) 2423868 wikitext text/x-wiki 7pr2x59h96f81mpzfmaa1i2uu5yfk49 2423870 2423868 2026-06-04T22:16:13Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/26982622098 (https://github.com/cluebotng/component-configs/commits/eb9cf1341e6e78387424cb9070a3aec87971e54d) 2423870 wikitext text/x-wiki ogakd0cx4wwj7goaxe2d6ea9rvc6d2s 498 443946 2423846 2423400 2026-06-04T19:56:50Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: deployed 3c09a6963f (l10n updates: nl) 2423846 wikitext text/x-wiki a4ng98pkd9qi3jc1xocuw307d6cjf4i 498 443949 2423841 2419691 2026-06-04T19:17:42Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 73ac3a4 (Remove stray '>' character inside the <script> tag in base HTML template) 2423841 wikitext text/x-wiki sxc7ccobsq3tcpvenls1s90dqk93dns 2423842 2423841 2026-06-04T19:17:43Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy ac8d9f4 (Replace invalid nested <ul> tag in footer in base HTLM template) 2423842 wikitext text/x-wiki 7jn3sp8ptcvp2xuqggwdqgb9j8nldtx 2423843 2423842 2026-06-04T19:17:46Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy f07edf9 (Add Queries endpoint support for P1/Q2/P3 qualifier columns) for T251008 2423843 wikitext text/x-wiki 5pwvc6hhqnaffr7pqg63voemomueztn 2423849 2423843 2026-06-04T20:05:33Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy c5294b1 (Support ?grouping as qualifier column value) 2423849 wikitext text/x-wiki d2o1nvbpndg6ja3gsykvcdq6nj16zfl 0 444380 2423692 2420250 2026-06-04T12:50:46Z Ottomata 88 /* Incompatible changes to schemas not yet in use */ 2423692 wikitext text/x-wiki qajrlstkkqlcj3y51j1t1l0dqjzn1pr 2423693 2423692 2026-06-04T12:51:13Z Ottomata 88 /* Incompatible changes to schemas not yet in use */ 2423693 wikitext text/x-wiki 0u2j8ko1giuev0z27m9xl0glfj7te9f 498 445210 2423856 1856917 2026-06-04T20:23:52Z Stashbot 7414 dhinus: stopped the tool to investigate db issues T428139 2423856 wikitext text/x-wiki lysff0agcd0fdgbqsg0vhkyh6gt1ojm 0 446860 2423874 2247482 2026-06-04T22:39:04Z Star walker 40724 replaced underscore with space 2423874 wikitext text/x-wiki fn7cts7vsbwrmm3rvl6fipoetljedi3 6 447010 2423873 1900286 2026-06-04T22:35:51Z Star walker 40724 now commons 2423873 wikitext text/x-wiki io9ock29b3cloiec6lywntiep187nvr 0 447716 2423893 2399457 2026-06-05T03:02:22Z Adam Wight (WMDE) 3064 /* See also */ Mark a broken dashboard; add a link to superset Referer dashboard 2423893 wikitext text/x-wiki ajfhr874yn72vmqhcj5fayelck66v4p 0 449160 2423742 2423540 2026-06-04T13:57:49Z Dexbot 30554 Bot: Updating the report 2423742 wikitext text/x-wiki qjdzhhbwuzttr9kytbincs5xuf6sgzr 2423884 2423742 2026-06-05T00:02:05Z Dexbot 30554 Bot: Updating the report 2423884 wikitext text/x-wiki 887uk877bs1z6zb276vdxsn8sq9umvp 0 450809 2423916 2175050 2026-06-05T10:40:02Z AKlapper (WMF) 421 See also: [[Phabricator/Upstream_Rebase]] 2423916 wikitext text/x-wiki m6gt3na4uboi8gzaiye48hycibhglxp 10 451515 2423872 2200278 2026-06-04T22:34:40Z Star walker 40724 interlink 2423872 wikitext text/x-wiki 1qyjb4ci4t6p4s7lf4y9dh9xax61wf5 0 452105 2423676 2313324 2026-06-04T12:08:58Z CWilliams-WMF 55316 Removing --run; omg.py does not support arguments 2423676 wikitext text/x-wiki 45pig4kvvcq00ui02hkbxc6yyyf0cp2 2423682 2423676 2026-06-04T12:25:05Z CWilliams-WMF 55316 Undid revision [[Special:Diff/2423676|2423676]] by [[Special:Contributions/CWilliams-WMF|CWilliams-WMF]] ([[User talk:CWilliams-WMF|talk]]) 2423682 wikitext text/x-wiki gqex5sixawzkiapdk2zi5o204qou80d 498 452890 2423919 2421823 2026-06-05T11:17:34Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/27011683531 (https://github.com/cluebotng/component-configs/commits/7b3ba4bae58717e47510c281fdb60f00be6f7c92) 2423919 wikitext text/x-wiki 987j6sqbm7sf0viejxb7ib50tlmm3dc 2423922 2423919 2026-06-05T11:44:27Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/27012814543 (https://github.com/cluebotng/component-configs/commits/48e7143fc26338766785004996ec66dea5876b0e) 2423922 wikitext text/x-wiki 0hnkwp2ery4gvgw7lqam093g47niusd 116 453906 2423772 2423253 2026-06-04T14:33:12Z Gitlabaccountapprovalbot 37332 only-vikas was rejected. 2423772 wikitext text/x-wiki dooqsnfo27j42shkhijv7kry15dlxu7 0 459290 2423780 2421136 2026-06-04T14:46:26Z KCVelaga (WMF) 38150 /* YYYY-MM-DD NEXT TUESDAY TRAIN (REPLACE THIS AFTER DEPLOY) */ 2423780 wikitext text/x-wiki d8dugu78ohdzad02rasa98w2yl5rogw 0 460178 2423659 2423643 2026-06-04T12:01:25Z Effie Mouzeli (WMF) 12880 scrollbot update 2423659 wikitext text/x-wiki qnrh0ncbrokgdej76klymyt33kji0va 2423688 2423659 2026-06-04T12:43:40Z Effie Mouzeli (WMF) 12880 2423688 wikitext text/x-wiki 9o55tmt6gq4wllzbb7fvu92c437uq8k 0 460232 2423743 2422748 2026-06-04T13:59:54Z MPopov (WMF) 5891 2423743 wikitext text/x-wiki p9iqbhir7g827ohnt8wz23d4jho3fev 2423860 2423743 2026-06-04T20:47:35Z MPopov (WMF) 5891 Instructions for comparing treatments 2423860 wikitext text/x-wiki pfai2n1o8mysrbfadh62dq5dzihvb92 2423865 2423860 2026-06-04T21:54:18Z MPopov (WMF) 5891 /* View and understand experiment results */ 2423865 wikitext text/x-wiki 72ggnbzcxwci9wr594qnmgsoyaofplb 2423866 2423865 2026-06-04T21:55:45Z MPopov (WMF) 5891 Moved the warning 2423866 wikitext text/x-wiki e5wtsfluqhnemqhjulcmobr6mvqhly1 2423867 2423866 2026-06-04T21:57:07Z MPopov (WMF) 5891 2423867 wikitext text/x-wiki h7rhqy7yti253ohv1wim0ztmov74ud8 2423869 2423867 2026-06-04T22:13:08Z MPopov (WMF) 5891 /* Digging deeper with dimensions */ Link to data modeling guidelines 2423869 wikitext text/x-wiki kh4b4w8pzt0yv99ftg6kb6s22f47kgg 2423871 2423869 2026-06-04T22:17:38Z MPopov (WMF) 5891 Remove draft notice 2423871 wikitext text/x-wiki skscsd71swgksemznuv9m1yujtbp9f4 0 460233 2423710 2423464 2026-06-04T13:17:35Z MPopov (WMF) 5891 2423710 wikitext text/x-wiki paxf6toj14p6dm9bpiqky7htw3zhwrm 498 460285 2423715 2026-06-04T13:26:05Z Labslogbot 55 Auto update of instance info. 2423715 wikitext text/x-wiki 5sk3fujqvnxc9bb9a3wt544vftboaya 0 460286 2423721 2026-06-04T13:34:22Z DMburugu (WMF) 25135 Initial Draft 2423721 wikitext text/x-wiki byh8l2f7yq04hetulcqlrir4ooh9wea 2423723 2423721 2026-06-04T13:35:35Z DMburugu (WMF) 25135 /* Service */ team link correction 2423723 wikitext text/x-wiki hvgjem63sfgeos98x9njet7m4xarhbj 2423744 2423723 2026-06-04T14:03:53Z DMburugu (WMF) 25135 /* Service */ add teams title 2423744 wikitext text/x-wiki 9tqevsa95cwkiiq7qlmhzu676umzady 2423810 2423744 2026-06-04T16:06:51Z DMburugu (WMF) 25135 /* Service Level Objectives */ remove brackets 2423810 wikitext text/x-wiki qiob6x6kztcsyf6n1cfw5kpsn1mi1gc 0 460287 2423767 2026-06-04T14:27:20Z DMburugu (WMF) 25135 Initial Draft 2423767 wikitext text/x-wiki 682qv3pimud0gkula3qoottjd97n50h 2423804 2423767 2026-06-04T15:49:10Z DMburugu (WMF) 25135 /* Service */ link to the extension page 2423804 wikitext text/x-wiki mqq6b5v4nks1iy96j1nce76jp2rspq1 0 460288 2423811 2026-06-04T16:09:38Z DMburugu (WMF) 25135 Initial draft 2423811 wikitext text/x-wiki c667gqj7vd4q0uj479356qswp3nsehx 0 460289 2423915 2026-06-05T10:39:16Z AKlapper (WMF) 421 Put notes from last rebase somewhere 2423915 wikitext text/x-wiki trx496toommwfhh8lsfpbeh951hec56