Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.23 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 420 2465824 2463190 2026-10-08T17:55:31Z Shabe 40977 typo 2465824 wikitext text/x-wiki 1ee4ojsza1q12e1pbrruezjtqsb77n0 498 1380 2465668 2464730 2026-10-08T13:49:19Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.quota_increase by 50 cores, 6 instances, 138512 ram 2465668 wikitext text/x-wiki gbde6vor5jxvbbzbvuf2jvkfnrqdt6t 2465669 2465668 2026-10-08T13:49:26Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0) by 50 cores, 6 instances, 138512 ram 2465669 wikitext text/x-wiki 74gjo8qp94l3784s9psk8ltrpyuupsd 498 3086 2465729 2464867 2026-10-08T14:47:57Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2465729 wikitext text/x-wiki 6uswbao1lhrahvj9eu68auz796028me 2465736 2465729 2026-10-08T14:51:31Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api 2465736 wikitext text/x-wiki ag67jtkkc2ud69qvkadszk3f9qwxibb 2465801 2465736 2026-10-08T16:58:00Z Stashbot 7414 tlepage@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2465801 wikitext text/x-wiki md8qkz5fsh87tkuucotz5fsvj2rqryp 2465802 2465801 2026-10-08T17:01:22Z Stashbot 7414 tlepage@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api 2465802 wikitext text/x-wiki mctqdyk5bn5ybqsr9p7a6xj0w4ta0j9 0 4108 2465549 2465518 2026-10-08T12:19:25Z ScheduleDeploymentBot 37566 Add [[gerrit:1353160]] to Monday, October 12 UTC morning backport window 2465549 wikitext text/x-wiki mds3eql5l3efz53fbsutsvvgfueqfrq 2465572 2465549 2026-10-08T12:38:38Z ScheduleDeploymentBot 37566 Add [[gerrit:1352515]] to Thursday, October 08 UTC afternoon backport window 2465572 wikitext text/x-wiki 2d89ax5i6185jbzu7t1k606bels4ezq 2465580 2465572 2026-10-08T12:46:22Z ScheduleDeploymentBot 37566 Add [[gerrit:1353173]] to Monday, October 12 UTC morning backport window 2465580 wikitext text/x-wiki 5mm48uldbz23bzvvb09gim74lyyzwvo 2465581 2465580 2026-10-08T12:46:56Z ScheduleDeploymentBot 37566 Add [[gerrit:1353131]] to Monday, October 12 UTC morning backport window 2465581 wikitext text/x-wiki 9hq7tcif4stz4u3xd8w5hjbmlbejvpa 2465587 2465581 2026-10-08T12:49:16Z Christoph Jauera (WMDE) 3635 /* {{Deployment_day|date=2026-10-12}} */ Removing a misplaced backport and changing the order of another one 2465587 wikitext text/x-wiki acaheik0uhron0ms4rcu0olc4ydvjvx 2465617 2465587 2026-10-08T13:02:23Z ScheduleDeploymentBot 37566 Add [[gerrit:1353180]] to Wednesday, October 14 UTC morning backport window 2465617 wikitext text/x-wiki i5skv1esc0eemehrx1x5ep7ismxxc66 2465628 2465617 2026-10-08T13:10:49Z ScheduleDeploymentBot 37566 Add [[gerrit:1347373]] to Wednesday, October 14 UTC afternoon backport window 2465628 wikitext text/x-wiki ezg6qtzdbrrxllsm0qjfcjrd8r45dhu 2465650 2465628 2026-10-08T13:32:58Z DHardy-WMF 39108 Reschedule 1352018 and 1352019 to 10-13 afternoon backport window 2465650 wikitext text/x-wiki mmc59qzp7rnytjvvk7eal1lglh2x0j9 2465715 2465650 2026-10-08T14:42:04Z ScheduleDeploymentBot 37566 Add [[gerrit:1339561]] to Thursday, October 08 UTC late backport window 2465715 wikitext text/x-wiki 8993zs7n4hvxfkqsmof6b1wbxp43ha4 2465746 2465715 2026-10-08T14:59:37Z ScheduleDeploymentBot 37566 Add [[gerrit:1353257]] to Thursday, October 08 UTC late backport window 2465746 wikitext text/x-wiki tlvshab4limxva9cfmhqeswof91k9l6 2465748 2465746 2026-10-08T15:03:14Z ADancy (WMF) 17694 /* {{Deployment_day|date=2026-10-08}} */ Add 1352635 to puppet window 2465748 wikitext text/x-wiki 1xwnluc9hgsp863kbcclxgu9pzyogiy 2465766 2465748 2026-10-08T15:32:55Z ScheduleDeploymentBot 37566 Add [[gerrit:1353269]] to Thursday, October 08 UTC late backport window 2465766 wikitext text/x-wiki 7y8libvt54cxfa758lmem8jn8xym0ot 2465823 2465766 2026-10-08T17:54:22Z ScheduleDeploymentBot 37566 Add [[gerrit:1352261]] to Thursday, October 08 UTC late backport window 2465823 wikitext text/x-wiki 2nm29ql8xw6q3uyy60ohnwltfgm9gsl 2465849 2465823 2026-10-08T19:58:05Z ScheduleDeploymentBot 37566 Add [[gerrit:1351444]] to Thursday, October 08 UTC late backport window 2465849 wikitext text/x-wiki 9x5ij782hyn2ddtnlk0zhz7s4e0zbhq 2465851 2465849 2026-10-08T19:59:09Z ScheduleDeploymentBot 37566 Add [[gerrit:1353392]] to Thursday, October 08 UTC late backport window 2465851 wikitext text/x-wiki pjty86eia9rxcn3249a04l274xs96gu 0 4299 2465730 2379705 2026-10-08T14:48:04Z XCollazo-WMF 31846 Remove obsolete link 2465730 wikitext text/x-wiki k0j8p0yvy1dyqe78vfktt0sth7c25py 498 6726 2465717 2464784 2026-10-08T14:42:15Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2465717 wikitext text/x-wiki aj6jlfsctvn42x6akvhqe06gw6ypgue 2465726 2465717 2026-10-08T14:45:27Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api 2465726 wikitext text/x-wiki h99e6oiep2lehwgu8chb3sp2r88iyn8 2465798 2465726 2026-10-08T16:53:37Z Stashbot 7414 tlepage@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2465798 wikitext text/x-wiki o0xbmt9qbmgd34glyxv18qjiz9otq5g 2465799 2465798 2026-10-08T16:56:49Z Stashbot 7414 tlepage@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api 2465799 wikitext text/x-wiki hro53xypkpyrwnd0mjal2ng9u6gj17k 0 7919 2465526 2465525 2026-10-08T11:59:25Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1064.eqiad.wmnet 2465526 wikitext text/x-wiki 0pivciqtdd84wzpwplimqr37ej6rzbh 2465527 2465526 2026-10-08T11:59:45Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1064.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465527 wikitext text/x-wiki sfytlvvxhruq57ce2gn4lh8r4sxk8mj 2465528 2465527 2026-10-08T12:00:09Z Stashbot 7414 root@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-timeline: sync 2465528 wikitext text/x-wiki i1ahwzmrvcgd0z9jzxjfmufmox2waca 2465529 2465528 2026-10-08T12:00:19Z Stashbot 7414 root@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-timeline: sync 2465529 wikitext text/x-wiki c2t27ad5htd1cjnvv935frgb92nvsze 2465530 2465529 2026-10-08T12:00:34Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2173.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465530 wikitext text/x-wiki 1aq05n22a8506hjvcz0qb4rjrrz4s2m 2465531 2465530 2026-10-08T12:08:35Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1064.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465531 wikitext text/x-wiki r2j36peja5apae8qpx8rbb0nv022cu6 2465532 2465531 2026-10-08T12:08:54Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1064.eqiad.wmnet 2465532 wikitext text/x-wiki 9idvkolcdc3gzxgej4pjy25crnt7lwi 2465533 2465532 2026-10-08T12:08:58Z Stashbot 7414 ihurbain@deploy1003: helmfile [staging] START helmfile.d/services/mobileapps: apply 2465533 wikitext text/x-wiki t3x4w6dhd0jkzsxartu3ly9jwb84voy 2465534 2465533 2026-10-08T12:09:29Z Stashbot 7414 ihurbain@deploy1003: helmfile [staging] DONE helmfile.d/services/mobileapps: apply 2465534 wikitext text/x-wiki 43x9cg041v1y3qkt9uzy5qh6zxg9lar 2465535 2465534 2026-10-08T12:09:53Z Stashbot 7414 ihurbain@deploy1003: helmfile [eqiad] START helmfile.d/services/mobileapps: apply 2465535 wikitext text/x-wiki 3ibpiba3vy7jp62h8b3dtjcie6pthi2 2465536 2465535 2026-10-08T12:10:35Z Stashbot 7414 ihurbain@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply 2465536 wikitext text/x-wiki l79duf95u7c95qbz028z8tazx5codsl 2465537 2465536 2026-10-08T12:10:46Z Stashbot 7414 ihurbain@deploy1003: helmfile [codfw] START helmfile.d/services/mobileapps: apply 2465537 wikitext text/x-wiki 5vh1oqh554w4n9ew62aiq4qd9drroce 2465538 2465537 2026-10-08T12:11:33Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1064.eqiad.wmnet 2465538 wikitext text/x-wiki ouqmbukmrs528mt6o7pzfn0sd4lem02 2465539 2465538 2026-10-08T12:11:47Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1065.eqiad.wmnet 2465539 wikitext text/x-wiki 56uygd4cer3iifwan2nm4o3hwyas8kj 2465540 2465539 2026-10-08T12:11:57Z Stashbot 7414 ihurbain@deploy1003: helmfile [codfw] DONE helmfile.d/services/mobileapps: apply 2465540 wikitext text/x-wiki btjh2l8bb8ymak3bk8tkg7zdqucrl0d 2465541 2465540 2026-10-08T12:12:19Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1065.eqiad.wmnet 2465541 wikitext text/x-wiki 1cui5m4xu9n8us51jiwid3w8ajpjd5a 2465542 2465541 2026-10-08T12:12:34Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2173.codfw.wmnet 2465542 wikitext text/x-wiki t6m81xod4pyyng5pbd8qltrend9w7yq 2465543 2465542 2026-10-08T12:12:36Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2173.codfw.wmnet 2465543 wikitext text/x-wiki bnu48lhlf3uf6rsa8g34fno9msfb2ld 2465544 2465543 2026-10-08T12:12:38Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1065.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465544 wikitext text/x-wiki s6sefepqvuqxna4dj1kiyywhhl1vje4 2465545 2465544 2026-10-08T12:12:50Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2174.codfw.wmnet 2465545 wikitext text/x-wiki ic0wc800id9qlotn2dfzo8y1cewk120 2465546 2465545 2026-10-08T12:13:23Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2174.codfw.wmnet 2465546 wikitext text/x-wiki leotrzxd6k8052sr0ocoqusl764yy93 2465547 2465546 2026-10-08T12:13:44Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2174.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465547 wikitext text/x-wiki rymzw0vjx9g8vrvd4o54tndrk0jd73s 2465548 2465547 2026-10-08T12:18:57Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2174.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465548 wikitext text/x-wiki dfsmdrwrpu532zgjj9r4sdv1n5ijybw 2465550 2465548 2026-10-08T12:20:49Z Stashbot 7414 zabe@deploy1003: Started scap sync-world: Backport for [[gerrit:1353155|Use Hadoop for UnusedTemplates on commonswiki (T422443)]] 2465550 wikitext text/x-wiki 7d7c712lb2njpkstfdbcfb9gcmg17zl 2465551 2465550 2026-10-08T12:21:29Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1065.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465551 wikitext text/x-wiki 1gn6020z9pz19nq4voo6j0wifvjn28l 2465552 2465551 2026-10-08T12:21:56Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1065.eqiad.wmnet 2465552 wikitext text/x-wiki cz7h6qu0z8xddpqgizrtzau25x38xsq 2465553 2465552 2026-10-08T12:21:57Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1065.eqiad.wmnet 2465553 wikitext text/x-wiki 16vnr3o4dnkp9zt9l5c3bq9u7xa4oom 2465554 2465553 2026-10-08T12:22:11Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1066.eqiad.wmnet 2465554 wikitext text/x-wiki by3d50sd6pmeqaxao18ucksmjsxrxio 2465555 2465554 2026-10-08T12:22:42Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1066.eqiad.wmnet 2465555 wikitext text/x-wiki 3qx68ti2kwvp5ieldo319i8qct89keo 2465556 2465555 2026-10-08T12:23:02Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1066.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465556 wikitext text/x-wiki d4wkq5ubjnayrzrwy383coefcwyirhd 2465557 2465556 2026-10-08T12:24:45Z Stashbot 7414 zabe@deploy1003: zabe: Backport for [[gerrit:1353155|Use Hadoop for UnusedTemplates on commonswiki (T422443)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2465557 wikitext text/x-wiki ravec8pqtqwl1esqjpzbmhw06imruvo 2465558 2465557 2026-10-08T12:25:13Z Stashbot 7414 zabe@deploy1003: zabe: Continuing with deployment 2465558 wikitext text/x-wiki cqrxtkawk35if2ei4fzutgy6vvxytxz 2465559 2465558 2026-10-08T12:29:54Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2174.codfw.wmnet 2465559 wikitext text/x-wiki llkwz8efxom8n9y2adxffk3fh2ttkpp 2465560 2465559 2026-10-08T12:29:56Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2174.codfw.wmnet 2465560 wikitext text/x-wiki 5jmrefrh6xfxlfpp7p185huk6gazl9o 2465561 2465560 2026-10-08T12:30:10Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2175.codfw.wmnet 2465561 wikitext text/x-wiki 6rzr3p0q36b99falhx6yj4ptt09di9v 2465562 2465561 2026-10-08T12:30:36Z Stashbot 7414 zabe@deploy1003: Finished scap sync-world: Backport for [[gerrit:1353155|Use Hadoop for UnusedTemplates on commonswiki (T422443)]] (duration: 09m 47s) 2465562 wikitext text/x-wiki qnim6ro4yrs9qtwhq9nj7n19q6kg7o6 2465563 2465562 2026-10-08T12:30:44Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2175.codfw.wmnet 2465563 wikitext text/x-wiki o8e34gcgklytgxc8uf2wjczrrly231n 2465564 2465563 2026-10-08T12:31:04Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2175.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465564 wikitext text/x-wiki lmv8p8rzveem5twow1xebhccvas4lal 2465565 2465564 2026-10-08T12:32:23Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1066.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465565 wikitext text/x-wiki 1n3etbieqea1sf3lv4uhoemglnqxh73 2465566 2465565 2026-10-08T12:32:42Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1066.eqiad.wmnet 2465566 wikitext text/x-wiki cqrzsretklarpvo5l7y7tbeh41ooh84 2465567 2465566 2026-10-08T12:34:29Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1066.eqiad.wmnet 2465567 wikitext text/x-wiki aihekuam0h8p9iqpwa7nt48p8fkaj9d 2465568 2465567 2026-10-08T12:34:43Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1067.eqiad.wmnet 2465568 wikitext text/x-wiki oekxaz1f93gqngfgqf46cbq51x32qa2 2465569 2465568 2026-10-08T12:35:17Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1067.eqiad.wmnet 2465569 wikitext text/x-wiki qbe1fsq9smfqku6hsfv15clgmbi2hwq 2465570 2465569 2026-10-08T12:35:36Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1067.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465570 wikitext text/x-wiki o4hdklsrisjctjeushgx9gqxwfwvj5l 2465571 2465570 2026-10-08T12:36:29Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2175.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465571 wikitext text/x-wiki pkrqh228coxsr24ha4mqwtlq3kvwrkf 2465573 2465571 2026-10-08T12:39:44Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2465573 wikitext text/x-wiki rjnftoslxwb0doanss6zonbohho7jol 2465574 2465573 2026-10-08T12:43:30Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1067.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465574 wikitext text/x-wiki 34duwl1h7nzihnk68qrg4tpxpl75wyq 2465575 2465574 2026-10-08T12:43:51Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1067.eqiad.wmnet 2465575 wikitext text/x-wiki biwau1jvyqa5rpiogs9js46tkja2sv8 2465576 2465575 2026-10-08T12:43:52Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1067.eqiad.wmnet 2465576 wikitext text/x-wiki 6xawsmid5slmm300wiypyee8w3x00ur 2465577 2465576 2026-10-08T12:44:05Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1068.eqiad.wmnet 2465577 wikitext text/x-wiki bhyjim7n2c700yx8jzii7eyjkywsfm9 2465578 2465577 2026-10-08T12:44:37Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1068.eqiad.wmnet 2465578 wikitext text/x-wiki dyk5slvclfai5ikkgo19r8hrg3nk8xs 2465579 2465578 2026-10-08T12:44:57Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1068.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465579 wikitext text/x-wiki rsh0xrm8aapa4be5vsslnuteorebhxn 2465582 2465579 2026-10-08T12:47:49Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.mysql.pool pool db1901: test 2465582 wikitext text/x-wiki d0gsnax8rx85s861e0su2l1fj8509ph 2465583 2465582 2026-10-08T12:48:30Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2175.codfw.wmnet 2465583 wikitext text/x-wiki ry9jxpmsaa08w9r38yk2kk1l9zvao7p 2465584 2465583 2026-10-08T12:48:31Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2175.codfw.wmnet 2465584 wikitext text/x-wiki tl0626h81d15tw18dop58d4dzkysa64 2465585 2465584 2026-10-08T12:48:45Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2176.codfw.wmnet 2465585 wikitext text/x-wiki st0eb1mi0tx0znf9set3l4g4dt3m2er 2465586 2465585 2026-10-08T12:49:15Z Stashbot 7414 zabe: zabe@deploy1003:~$ mwscript recountCategories.php commonswiki --mode all # T440023 T439902 2465586 wikitext text/x-wiki 4etz7yshyx1h41srnvnvmh9sjq8jvgc 2465588 2465586 2026-10-08T12:49:57Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2176.codfw.wmnet 2465588 wikitext text/x-wiki jp8g2ygyq4ttm5sbqlugzgvg6ijkav8 2465589 2465588 2026-10-08T12:50:17Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2176.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465589 wikitext text/x-wiki c8t5mtf31vvobfkj0xevbhj6cj3k30i 2465590 2465589 2026-10-08T12:50:50Z Stashbot 7414 dbrant@deploy1003: helmfile [staging] START helmfile.d/services/mobileapps: apply 2465590 wikitext text/x-wiki 1apsm8qrsxyfzwr2lcel3demxm71leo 2465591 2465590 2026-10-08T12:51:10Z Stashbot 7414 dbrant@deploy1003: helmfile [staging] DONE helmfile.d/services/mobileapps: apply 2465591 wikitext text/x-wiki e1vc4e4qjdy5jr3quiib6di7i970nx9 2465592 2465591 2026-10-08T12:52:28Z Stashbot 7414 dbrant@deploy1003: helmfile [eqiad] START helmfile.d/services/mobileapps: apply 2465592 wikitext text/x-wiki mm8fuojjypibm57wwmo6ua88yj5gmjd 2465593 2465592 2026-10-08T12:52:46Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1068.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465593 wikitext text/x-wiki a896lfwz8tguvwqfow99vsic7319akx 2465594 2465593 2026-10-08T12:53:05Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1068.eqiad.wmnet 2465594 wikitext text/x-wiki 5w0m8681tbsodn72koza84irlmssyby 2465595 2465594 2026-10-08T12:53:06Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1068.eqiad.wmnet 2465595 wikitext text/x-wiki iteoxvvgg6pwfmxydcawb3yvcj9yorl 2465596 2465595 2026-10-08T12:53:13Z Stashbot 7414 dbrant@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply 2465596 wikitext text/x-wiki 8yo5yshf0ymiyo7qbsz4563rteob9fs 2465597 2465596 2026-10-08T12:53:19Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1069.eqiad.wmnet 2465597 wikitext text/x-wiki gl3b5qx0vovuo55yxj6az49punkmyb0 2465598 2465597 2026-10-08T12:53:24Z Stashbot 7414 dbrant@deploy1003: helmfile [codfw] START helmfile.d/services/mobileapps: apply 2465598 wikitext text/x-wiki mlxvy1n3lwitpflgzc79ujyoisasbub 2465599 2465598 2026-10-08T12:53:51Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1069.eqiad.wmnet 2465599 wikitext text/x-wiki 752n7taytf756gvbqg3rdpp7ti0oygj 2465600 2465599 2026-10-08T12:53:59Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1069.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465600 wikitext text/x-wiki b3q611utc1jldyenr8jqg1ef191rqho 2465601 2465600 2026-10-08T12:54:10Z Stashbot 7414 dbrant@deploy1003: helmfile [codfw] DONE helmfile.d/services/mobileapps: apply 2465601 wikitext text/x-wiki brjf3v3q9dijnfux8fddt0j3oof6ic4 2465602 2465601 2026-10-08T12:54:14Z Stashbot 7414 fceratto@cumin1004: END (ERROR) - Cookbook sre.mysql.pool (exit_code=97) pool db1901: test 2465602 wikitext text/x-wiki qduiq0q3i29565813sjtwq4tst05mi3 2465603 2465602 2026-10-08T12:54:22Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.mysql.depool depool db1901: test 2465603 wikitext text/x-wiki 4d5x9a0osjvbx3cewynv2jbgmor8qoe 2465604 2465603 2026-10-08T12:54:26Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1901: test 2465604 wikitext text/x-wiki ctc930e5qvp86s4r1qje3bmua0zatce 2465605 2465604 2026-10-08T12:54:31Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.mysql.pool pool db1901: test 2465605 wikitext text/x-wiki ok1qxoikaniicum0xaepd7wddele9o6 2465606 2465605 2026-10-08T12:54:40Z Stashbot 7414 fceratto@cumin1004: END (ERROR) - Cookbook sre.mysql.pool (exit_code=97) pool db1901: test 2465606 wikitext text/x-wiki ermk2mii5bilxt65ri51je011xiivwu 2465607 2465606 2026-10-08T12:54:51Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.mysql.pool pool db1901: test 2465607 wikitext text/x-wiki r27qqhqvz8z2grgf578a0d3adxx6vpp 2465608 2465607 2026-10-08T12:54:59Z Stashbot 7414 fceratto@cumin1004: END (ERROR) - Cookbook sre.mysql.pool (exit_code=97) pool db1901: test 2465608 wikitext text/x-wiki oy0b738xfk7kkr6nys7t88dcisr7b6t 2465609 2465608 2026-10-08T12:55:05Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.mysql.pool pool db1901: test 2465609 wikitext text/x-wiki a29cydhtzn72z84sgen0lrbc3y1wi02 2465610 2465609 2026-10-08T12:58:41Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2176.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465610 wikitext text/x-wiki qbk3xtcmcmpupqzacowo4zmctjy0nrq 2465611 2465610 2026-10-08T12:59:00Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2176.codfw.wmnet 2465611 wikitext text/x-wiki fwv29at1yghxnlr6sorgzimp2vmre4i 2465612 2465611 2026-10-08T12:59:01Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2176.codfw.wmnet 2465612 wikitext text/x-wiki 780j21lidwxc53l5oq5icpg3pc86fhe 2465613 2465612 2026-10-08T12:59:15Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2177.codfw.wmnet 2465613 wikitext text/x-wiki q7wr5r3jbqcl040ahm8r79rlket0u1c 2465614 2465613 2026-10-08T12:59:50Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2177.codfw.wmnet 2465614 wikitext text/x-wiki gxxyhxq6xwh8ir3z10d43366v0maupt 2465615 2465614 2026-10-08T13:00:09Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2177.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465615 wikitext text/x-wiki 4ul1jg60nvgtr3qfiiy3h4ps8ad01ul 2465616 2465615 2026-10-08T13:02:19Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1069.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465616 wikitext text/x-wiki bea9bxwamvp7478odw5pgia1o4uy6lt 2465618 2465616 2026-10-08T13:02:47Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1069.eqiad.wmnet 2465618 wikitext text/x-wiki rxehs0jsl7gb3e0mrfilc74qdeoua49 2465619 2465618 2026-10-08T13:02:49Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1069.eqiad.wmnet 2465619 wikitext text/x-wiki 4zkomoejnv25wydmsy2pgas3tnmugrd 2465620 2465619 2026-10-08T13:03:01Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1070.eqiad.wmnet 2465620 wikitext text/x-wiki ek2qno79kltz5t80lysbtectexgxflv 2465621 2465620 2026-10-08T13:03:34Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1070.eqiad.wmnet 2465621 wikitext text/x-wiki 4brrlkm8z7pewcmcbykyjfdvk2tgvin 2465622 2465621 2026-10-08T13:03:53Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1070.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465622 wikitext text/x-wiki qaeepupfyk613lh8o8d4y5kgp7c3vw5 2465623 2465622 2026-10-08T13:04:32Z Stashbot 7414 fceratto@cumin1004: END (ERROR) - Cookbook sre.mysql.pool (exit_code=97) pool db1901: test 2465623 wikitext text/x-wiki h0g990mtyzyjbld8qng3fhg9qauesfn 2465624 2465623 2026-10-08T13:04:36Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.mysql.pool pool db1901: test 2465624 wikitext text/x-wiki qcoys5ui12n8dl2e6ppfh7r5laibmyq 2465625 2465624 2026-10-08T13:04:40Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1901: test 2465625 wikitext text/x-wiki 2lrfdj0ekimcuwle7ck9r76ps47pq7v 2465626 2465625 2026-10-08T13:05:23Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2177.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465626 wikitext text/x-wiki pqkhu2op58rxlbe1omf3jvs9dnnczv8 2465627 2465626 2026-10-08T13:09:37Z Stashbot 7414 samtar@deploy1003: Started scap sync-world: Backport for [[gerrit:1352515|Home Experience: Feature flag to enable Home (T439738)]] 2465627 wikitext text/x-wiki 5b658xzfd0psytzzzplaee7yav1lulm 2465629 2465627 2026-10-08T13:11:44Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1070.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465629 wikitext text/x-wiki fjodry8abadckp3pbnn61ecybvoieae 2465630 2465629 2026-10-08T13:12:01Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1070.eqiad.wmnet 2465630 wikitext text/x-wiki f25dzg68uowq83flf1bgvqhgyevdlhy 2465631 2465630 2026-10-08T13:12:02Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1070.eqiad.wmnet 2465631 wikitext text/x-wiki t3l7v9gycqz7gcqcglr1sr8qzzpgbc5 2465632 2465631 2026-10-08T13:12:16Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1071.eqiad.wmnet 2465632 wikitext text/x-wiki dfcvwg5ewv25q5ujg2twevt83qietdp 2465633 2465632 2026-10-08T13:12:49Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1071.eqiad.wmnet 2465633 wikitext text/x-wiki g2g1bxon3ijuo4p0r388apyh33wj1k1 2465634 2465633 2026-10-08T13:13:08Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1071.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465634 wikitext text/x-wiki 8otluhztfpgz45vv3h75m57b76lwxkp 2465635 2465634 2026-10-08T13:13:45Z Stashbot 7414 samtar@deploy1003: emc-wmf, samtar: Backport for [[gerrit:1352515|Home Experience: Feature flag to enable Home (T439738)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2465635 wikitext text/x-wiki hu6utgs8c9c0d3zj2v13jxi2f0hl5ps 2465636 2465635 2026-10-08T13:20:58Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1071.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465636 wikitext text/x-wiki au5rta1jxtwaecycftywit28v5mnjn5 2465637 2465636 2026-10-08T13:21:26Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1071.eqiad.wmnet 2465637 wikitext text/x-wiki 68bqv9z3ats7pc3h0sgelx6yw6ll7uh 2465638 2465637 2026-10-08T13:21:27Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1071.eqiad.wmnet 2465638 wikitext text/x-wiki 148jmxh5ddbvh1ue7wyshau8l81rv9h 2465639 2465638 2026-10-08T13:21:40Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1072.eqiad.wmnet 2465639 wikitext text/x-wiki 8ycrrjkk8xk2xm7mv7ybg7tguuoa7f0 2465640 2465639 2026-10-08T13:22:12Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1072.eqiad.wmnet 2465640 wikitext text/x-wiki gbhsxy2vl4qp0ob7t5vqiwhkg7anzak 2465641 2465640 2026-10-08T13:22:33Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1072.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465641 wikitext text/x-wiki 63ji6a4zwu6yyau4ejwmca8y0gitw4i 2465642 2465641 2026-10-08T13:27:15Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest2001.codfw.wmnet (live debug) 2465642 wikitext text/x-wiki hgvh7og0tfblnaitz5wjkn4y699wt5m 2465643 2465642 2026-10-08T13:28:13Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest2001.codfw.wmnet (live debug) 2465643 wikitext text/x-wiki b0rcb19a9pq2a4q16xmumzksl1uunm1 2465644 2465643 2026-10-08T13:30:52Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1072.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465644 wikitext text/x-wiki 8un2kw9zaen5602r890yxl578bpyumg 2465645 2465644 2026-10-08T13:31:11Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1072.eqiad.wmnet 2465645 wikitext text/x-wiki 9z19pk4adz20ejlrfo24cbpkoiq7wdu 2465646 2465645 2026-10-08T13:31:12Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1072.eqiad.wmnet 2465646 wikitext text/x-wiki 20ebv2ps8dv5vculvyk9ee210ujpacd 2465647 2465646 2026-10-08T13:31:26Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1073.eqiad.wmnet 2465647 wikitext text/x-wiki 34qz324fkyjb8aflt88ax3sfzpln8uv 2465648 2465647 2026-10-08T13:31:59Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1073.eqiad.wmnet 2465648 wikitext text/x-wiki ozre7kw8g5ynk75hqbcg37awzzmxrxm 2465649 2465648 2026-10-08T13:32:19Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1073.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465649 wikitext text/x-wiki o1ln171daymouch73ei72lacnt3a1bd 2465651 2465649 2026-10-08T13:33:38Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.mysql.clone of db2901.codfw.wmnet onto db2902.codfw.wmnet 2465651 wikitext text/x-wiki t2jmemfc7ia29appx1l4efv5ka5ex6r 2465652 2465651 2026-10-08T13:33:39Z Stashbot 7414 fceratto@cumin1004: END (FAIL) - Cookbook sre.mysql.clone (exit_code=99) of db2901.codfw.wmnet onto db2902.codfw.wmnet 2465652 wikitext text/x-wiki eja9498gzjpbx9ghi1gqyco21hsof86 2465654 2465652 2026-10-08T13:38:19Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.mysql.clone of db2901.codfw.wmnet onto db2902.codfw.wmnet 2465654 wikitext text/x-wiki omxdbor093ozaxt2ypfmyx6mehe8sde 2465655 2465654 2026-10-08T13:38:20Z Stashbot 7414 fceratto@cumin1004: END (FAIL) - Cookbook sre.mysql.clone (exit_code=99) of db2901.codfw.wmnet onto db2902.codfw.wmnet 2465655 wikitext text/x-wiki qddcvy3ljhyt3397anhmilji5fbbq77 2465656 2465655 2026-10-08T13:41:09Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1073.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465656 wikitext text/x-wiki lvx1c21lsy4xqlj5tuer5qro2teghol 2465657 2465656 2026-10-08T13:41:37Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1073.eqiad.wmnet 2465657 wikitext text/x-wiki ql1xxxfwo0b87s0n6vnmqdqpwcm6sbv 2465658 2465657 2026-10-08T13:42:27Z Stashbot 7414 samtar@deploy1003: emc-wmf, samtar: Continuing with deployment 2465658 wikitext text/x-wiki kftzzis6fo3xh0qcwo5tf6xn8je51pm 2465660 2465658 2026-10-08T13:43:24Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1073.eqiad.wmnet 2465660 wikitext text/x-wiki gkhsb87rdli418xc9nrkiflzoogdvc8 2465661 2465660 2026-10-08T13:43:38Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1074.eqiad.wmnet 2465661 wikitext text/x-wiki cy24xy7s30w34ytckir1luuwp4echnq 2465662 2465661 2026-10-08T13:44:13Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1074.eqiad.wmnet 2465662 wikitext text/x-wiki g7wn3oiog2ds1sjzi9205id4dc2bn17 2465663 2465662 2026-10-08T13:44:33Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1074.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465663 wikitext text/x-wiki r75yao7q1q4zogk8w2g74iw0xq46kao 2465665 2465663 2026-10-08T13:47:17Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2465665 wikitext text/x-wiki gj970k2x2kxvegukihjy5lry44z4fxj 2465667 2465665 2026-10-08T13:47:51Z Stashbot 7414 samtar@deploy1003: Finished scap sync-world: Backport for [[gerrit:1352515|Home Experience: Feature flag to enable Home (T439738)]] (duration: 38m 16s) 2465667 wikitext text/x-wiki 8ftk7e3ijkh3swtjlz5f2rpwk29dteg 2465670 2465667 2026-10-08T13:53:23Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1074.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465670 wikitext text/x-wiki iiej1cs4u2jhv9a6l8qv0t690x1v9nx 2465671 2465670 2026-10-08T13:53:43Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1074.eqiad.wmnet 2465671 wikitext text/x-wiki 2v1i4vdtqmcpyabbxa6lsysm9z0ibha 2465672 2465671 2026-10-08T13:56:12Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1074.eqiad.wmnet 2465672 wikitext text/x-wiki pdo3muiey18ipto0hrzd0cvu6eazuvf 2465674 2465672 2026-10-08T13:56:26Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1075.eqiad.wmnet 2465674 wikitext text/x-wiki n8e1cu17wcyywxkftodcc6viudvgsz1 2465676 2465674 2026-10-08T13:56:58Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1075.eqiad.wmnet 2465676 wikitext text/x-wiki 51vgy409sd99mwj6lkn1nirequ80kd7 2465677 2465676 2026-10-08T13:57:17Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1075.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465677 wikitext text/x-wiki fkknsqxa6g5ed0hni2zm3iv8na13zdt 2465678 2465677 2026-10-08T13:58:53Z Stashbot 7414 jdrewniak@deploy1003: Started scap sync-world: Backport for [[gerrit:1353100|Bumping portals to master (T128546)]] 2465678 wikitext text/x-wiki 3ydui8c2v37a1q6g755qpsil0lyvza9 2465679 2465678 2026-10-08T14:03:04Z Stashbot 7414 jdrewniak@deploy1003: jdrewniak: Backport for [[gerrit:1353100|Bumping portals to master (T128546)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2465679 wikitext text/x-wiki pgbkisiiqjwtd2i9qx5hclpvxfp1o3r 2465680 2465679 2026-10-08T14:03:06Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.mysql.clone of db2901.codfw.wmnet onto db2902.codfw.wmnet 2465680 wikitext text/x-wiki 8nmc11itxrp4z06mdi4j962o1nzuwr9 2465681 2465680 2026-10-08T14:03:07Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.mysql.depool depool db2901: Depool db2901.codfw.wmnet to then clone it to db2902.codfw.wmnet - fceratto@cumin1004 2465681 wikitext text/x-wiki lxz6hr8dr3oz875xixbey61sglrlt8j 2465682 2465681 2026-10-08T14:03:10Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2901: Depool db2901.codfw.wmnet to then clone it to db2902.codfw.wmnet - fceratto@cumin1004 2465682 wikitext text/x-wiki 1jxcfoilpcxut37yprwv3kvghubgljw 2465683 2465682 2026-10-08T14:03:11Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.mysql.depool depool db2902: Depool db2902.codfw.wmnet - fceratto@cumin1004 2465683 wikitext text/x-wiki tjuqxz8u3m2be3zmqowh167z2wka2v8 2465684 2465683 2026-10-08T14:03:15Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2902: Depool db2902.codfw.wmnet - fceratto@cumin1004 2465684 wikitext text/x-wiki isw2cwpy2nxqektapslfjcvo9fph4ir 2465685 2465684 2026-10-08T14:06:07Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1075.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465685 wikitext text/x-wiki ljaamj0atn8ywi8ryhvfcc6dswgzaa8 2465686 2465685 2026-10-08T14:09:30Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.mysql.pool pool db2901: Pool db2901.codfw.wmnet in after cloning 2465686 wikitext text/x-wiki f2f7coeczcueurlpfivvlxlethtznvx 2465687 2465686 2026-10-08T14:17:05Z Stashbot 7414 fceratto@cumin1004: END (ERROR) - Cookbook sre.mysql.pool (exit_code=97) pool db2901: Pool db2901.codfw.wmnet in after cloning 2465687 wikitext text/x-wiki m870k0uxjne8ln3cmwjjyf1phwiceaw 2465688 2465687 2026-10-08T14:17:58Z Stashbot 7414 brouberol@deploy1003: helmfile [ml-serve-eqiad] START helmfile.d/admin 'apply'. 2465688 wikitext text/x-wiki iksjqwtkihpngwgnm5nrnq70ud1yf9w 2465689 2465688 2026-10-08T14:18:36Z Stashbot 7414 brouberol@deploy1003: helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'apply'. 2465689 wikitext text/x-wiki edtucx2mxr6gpd7oj8objxcw6yfkuw0 2465690 2465689 2026-10-08T14:19:14Z Stashbot 7414 brouberol@deploy1003: helmfile [ml-serve-codfw] START helmfile.d/admin 'apply'. 2465690 wikitext text/x-wiki nmvlrwbkjvn7zkzeb4qc78o7vjyjwtl 2465691 2465690 2026-10-08T14:20:13Z Stashbot 7414 brouberol@deploy1003: helmfile [ml-serve-codfw] DONE helmfile.d/admin 'apply'. 2465691 wikitext text/x-wiki klp72ij11ffwamoqx49gi9mi3v2n5yu 2465692 2465691 2026-10-08T14:21:37Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1075.eqiad.wmnet 2465692 wikitext text/x-wiki hl3ypbsv0ecao0f8cvjwbqrhsp0w5of 2465693 2465692 2026-10-08T14:21:38Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1075.eqiad.wmnet 2465693 wikitext text/x-wiki 8fewszp34jdjj0ahe90bszmgwp32284 2465694 2465693 2026-10-08T14:21:52Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1076.eqiad.wmnet 2465694 wikitext text/x-wiki enpwd2ov4o7zjkjjin9dj6hdlaxpvbq 2465695 2465694 2026-10-08T14:22:24Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1076.eqiad.wmnet 2465695 wikitext text/x-wiki 6wlo5u1smfnh5nbjkkob2mirhh3xh77 2465696 2465695 2026-10-08T14:22:44Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1076.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465696 wikitext text/x-wiki hi3aik6bgnoqvfy8owz3kde2nmo00as 2465697 2465696 2026-10-08T14:23:56Z Stashbot 7414 moritzm: installing perl security updates 2465697 wikitext text/x-wiki 0c58v274w88hv0uum7meazcqv325o2n 2465698 2465697 2026-10-08T14:29:10Z Stashbot 7414 jdrewniak@deploy1003: jdrewniak: Continuing with deployment 2465698 wikitext text/x-wiki pykivnvzmduwa9dicmve3kitpaoyuvt 2465699 2465698 2026-10-08T14:32:05Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1076.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465699 wikitext text/x-wiki bt0ntukge5dehpklordv0t0m6gl6z2d 2465700 2465699 2026-10-08T14:32:11Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1076.eqiad.wmnet 2465700 wikitext text/x-wiki d2hda117i1rl740ulmhgnu7mxhs1gj0 2465701 2465700 2026-10-08T14:32:16Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1076.eqiad.wmnet 2465701 wikitext text/x-wiki au4lu782a5dzbr7fba2q96tthqgvz38 2465702 2465701 2026-10-08T14:32:26Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1077.eqiad.wmnet 2465702 wikitext text/x-wiki becktj81al7o4htfsjoajx7tqso9uv3 2465703 2465702 2026-10-08T14:32:30Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.dns.netbox 2465703 wikitext text/x-wiki d87x1yyk09lmufpdakabez7s89bfu7o 2465704 2465703 2026-10-08T14:32:58Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1077.eqiad.wmnet 2465704 wikitext text/x-wiki smwwpgx2wo6i72haesey7m4ucgqvlkq 2465705 2465704 2026-10-08T14:33:18Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1077.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465705 wikitext text/x-wiki gewdijhnwcnnv6uivlkqhgo3cmiqx4u 2465706 2465705 2026-10-08T14:35:02Z Stashbot 7414 jdrewniak@deploy1003: Finished scap sync-world: Backport for [[gerrit:1353100|Bumping portals to master (T128546)]] (duration: 36m 09s) 2465706 wikitext text/x-wiki mrdqeknjecvdwzgj6zyjo1foyfs2de3 2465708 2465706 2026-10-08T14:35:20Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add new dns entries for IPs on lsw1-c1-eqiad - cmooney@cumin1004" 2465708 wikitext text/x-wiki ot3nzpzafyqdlrr7anljyy9bgyjxro0 2465712 2465708 2026-10-08T14:39:12Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add new dns entries for IPs on lsw1-c1-eqiad - cmooney@cumin1004" 2465712 wikitext text/x-wiki aaqwhk9b4knmpk7di1levxx55k06yta 2465713 2465712 2026-10-08T14:39:14Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2465713 wikitext text/x-wiki 7b1r6t1gkmo0jcwlrd21mipuq0wjd9w 2465714 2465713 2026-10-08T14:39:15Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.dns.netbox 2465714 wikitext text/x-wiki sllf6uqixb0dfo4uqrcd5jv5gq7qxpc 2465716 2465714 2026-10-08T14:42:10Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1077.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465716 wikitext text/x-wiki pprrkbk0psgyyk5zgpr2prs9htjrs67 2465718 2465716 2026-10-08T14:42:29Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1077.eqiad.wmnet 2465718 wikitext text/x-wiki ocv7mmhag0zulpcyy6iuy3x8tdnns5q 2465719 2465718 2026-10-08T14:43:08Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add new dns entries for IPs on lsw1-c1-eqiad - cmooney@cumin1004" 2465719 wikitext text/x-wiki 7pp8dz2ibdclzllg5apuwnnaq7arlwd 2465720 2465719 2026-10-08T14:43:26Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add new dns entries for IPs on lsw1-c1-eqiad - cmooney@cumin1004" 2465720 wikitext text/x-wiki 3guo8hgp3otfvav7lt991jofyuhkfvo 2465721 2465720 2026-10-08T14:43:27Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2465721 wikitext text/x-wiki qk71whthiozwxgazpk59lso1ei9zke0 2465722 2465721 2026-10-08T14:44:16Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1077.eqiad.wmnet 2465722 wikitext text/x-wiki r87pwbqhgaxicvl3oehy5wqay8i4y3e 2465723 2465722 2026-10-08T14:44:29Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1078.eqiad.wmnet 2465723 wikitext text/x-wiki s0ffk3k7aepsb9c26p866gjin1weo9b 2465724 2465723 2026-10-08T14:45:01Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1078.eqiad.wmnet 2465724 wikitext text/x-wiki ndsxasbel3hav63oyoa35guq4xi0ys7 2465725 2465724 2026-10-08T14:45:10Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1078.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465725 wikitext text/x-wiki mrtxjllioastxap9qe3h6x0dplrdyaz 2465732 2465725 2026-10-08T14:48:39Z Stashbot 7414 moritzm: installing pyasn1 security updates 2465732 wikitext text/x-wiki 7xmgrlv04pz2ud9oyu2n91g02r4ergj 2465733 2465732 2026-10-08T14:48:43Z Stashbot 7414 cgoubert@dns2004: START - running authdns-update 2465733 wikitext text/x-wiki dxf2qtgvl9rfs26w5qrqclfgbf7u78x 2465734 2465733 2026-10-08T14:50:58Z Stashbot 7414 cgoubert@dns2004: END - running authdns-update 2465734 wikitext text/x-wiki hohbcglm9bnyakc6o6cid9dsqeqqa2g 2465735 2465734 2026-10-08T14:51:06Z Stashbot 7414 cmooney@dns3003: START - running authdns-update 2465735 wikitext text/x-wiki 5wjdgh8dvi63txc06wro6zwnt6ijhqm 2465738 2465735 2026-10-08T14:54:10Z Stashbot 7414 cmooney@dns3003: END - running authdns-update 2465738 wikitext text/x-wiki c42ue8a8ehxpqtfksbsp84ozpfla3lq 2465739 2465738 2026-10-08T14:54:29Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1078.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465739 wikitext text/x-wiki 3bisc8yvf40n55lzpeilg30chsgyd2l 2465740 2465739 2026-10-08T14:54:57Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1078.eqiad.wmnet 2465740 wikitext text/x-wiki m5p4n7c02t78t8u9qg5ggpct740wuf5 2465741 2465740 2026-10-08T14:56:12Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1078.eqiad.wmnet 2465741 wikitext text/x-wiki f4q6sonveichlq6s82edq8liofg0uia 2465742 2465741 2026-10-08T14:56:26Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1079.eqiad.wmnet 2465742 wikitext text/x-wiki 6e3is3t59tzy4oqyh70wp9mfby648i5 2465743 2465742 2026-10-08T14:57:03Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1079.eqiad.wmnet 2465743 wikitext text/x-wiki 6btiuvnybubwgqpugk9xdq98sld0pto 2465744 2465743 2026-10-08T14:57:22Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1079.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465744 wikitext text/x-wiki t6f7qzvhd8o3bs1pw8yvco3kot0r3ct 2465745 2465744 2026-10-08T14:58:07Z Stashbot 7414 aikochou@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2465745 wikitext text/x-wiki 1t0n5geu98twyl37ud79knpuaga732l 2465747 2465745 2026-10-08T14:59:48Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.druid.reboot-workers for Druid public cluster: Reboot Druid nodes 2465747 wikitext text/x-wiki radwk1opu6e5zpbiw5qsip80v4h3t72 2465749 2465747 2026-10-08T15:06:13Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1079.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465749 wikitext text/x-wiki hz0de9nakw2tkynv2iiwhhqw90whznu 2465750 2465749 2026-10-08T15:06:32Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1079.eqiad.wmnet 2465750 wikitext text/x-wiki donnzj525o0bp9e020ya1kq1kjl29jl 2465751 2465750 2026-10-08T15:07:58Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1079.eqiad.wmnet 2465751 wikitext text/x-wiki mssz2ibgu4ho9tlhdh6by6cszx0as2h 2465752 2465751 2026-10-08T15:08:12Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1080.eqiad.wmnet 2465752 wikitext text/x-wiki ozi926b0bdavkety3x2lugwj9pwg8tb 2465753 2465752 2026-10-08T15:08:45Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1080.eqiad.wmnet 2465753 wikitext text/x-wiki 4f0o3tq578exit0m1b3300b2mlhk3bf 2465754 2465753 2026-10-08T15:09:04Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1080.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465754 wikitext text/x-wiki gf9z5m6x61ymilm485blzolmqhnu2jo 2465755 2465754 2026-10-08T15:17:35Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.mysql.pool pool db2902: Pool db2902.codfw.wmnet in after cloning 2465755 wikitext text/x-wiki csm04vwmi2sjenjzi9bvsygeyyhj1s8 2465756 2465755 2026-10-08T15:17:56Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1080.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465756 wikitext text/x-wiki 9gymsiktylxnmv6mmb7qmdiu8oq66ne 2465757 2465756 2026-10-08T15:18:14Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1080.eqiad.wmnet 2465757 wikitext text/x-wiki lidiid0ejzh2l6akjfq6ek4n6cmii0e 2465758 2465757 2026-10-08T15:20:54Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1080.eqiad.wmnet 2465758 wikitext text/x-wiki frqes1ic75m1mxyi7wn3qdcxqf860lx 2465759 2465758 2026-10-08T15:21:07Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1081.eqiad.wmnet 2465759 wikitext text/x-wiki 17usj73b0tlhyz19qjm08cyugfm7u7o 2465760 2465759 2026-10-08T15:21:42Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1081.eqiad.wmnet 2465760 wikitext text/x-wiki mm9xgumxxl3750f2o7wybluhwesjwdw 2465761 2465760 2026-10-08T15:22:01Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1081.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465761 wikitext text/x-wiki bqrrfs306edxifj9t5k8aor7ms7rhzi 2465762 2465761 2026-10-08T15:25:24Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.dns.netbox 2465762 wikitext text/x-wiki 6c82wvhhtzbl2lx8cmeq3nzhlq47mhg 2465765 2465762 2026-10-08T15:29:46Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add new dns entries for IPs on lsw1-c1-eqiad - cmooney@cumin1004" 2465765 wikitext text/x-wiki ehssx832s3wky7o44enczetvewoxkmz 2465767 2465765 2026-10-08T15:36:03Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.reimage for host sretest2009.codfw.wmnet with OS trixie 2465767 wikitext text/x-wiki fovdutydiypf5a71uvw0n899fakdb5a 2465768 2465767 2026-10-08T15:47:54Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on sretest2009.codfw.wmnet with reason: host reimage 2465768 wikitext text/x-wiki el1ey8d8j663muismh196mzisybefow 2465769 2465768 2026-10-08T15:52:22Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1081.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465769 wikitext text/x-wiki 2eov8idn7941vjy8hyhq74puaf4u1l4 2465770 2465769 2026-10-08T15:53:02Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sretest2009.codfw.wmnet with reason: host reimage 2465770 wikitext text/x-wiki 7o5ao84io15jza2nyz7dvawfz7nctx4 2465771 2465770 2026-10-08T15:55:51Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest2009.codfw.wmnet (live debug) 2465771 wikitext text/x-wiki g7fju6uhodvjsyvf68r1vxj5luxvodj 2465772 2465771 2026-10-08T15:56:46Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest2009.codfw.wmnet (live debug) 2465772 wikitext text/x-wiki 4tqyqhqse14yhrrnfe4poz8t97ns2e4 2465773 2465772 2026-10-08T16:04:59Z Stashbot 7414 swfrench@dns1004: START - running authdns-update 2465773 wikitext text/x-wiki cjcs6jtt58jtjmq82q6ah37alym5p4m 2465774 2465773 2026-10-08T16:07:36Z Stashbot 7414 swfrench@dns1004: END - running authdns-update 2465774 wikitext text/x-wiki 3defyd9go5nmwiid9a2dtobsldpxuxd 2465775 2465774 2026-10-08T16:10:41Z Stashbot 7414 elukey@cumin1004: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=1) for host sretest2009.codfw.wmnet with OS trixie 2465775 wikitext text/x-wiki 0iuh946bfu4r6qah20zglp9lzmfx934 2465776 2465775 2026-10-08T16:13:59Z Stashbot 7414 swfrench-wmf: begin rolling restarts of confd in ulsfo, eqsin, codfw to pick up etcd client SRV change 2465776 wikitext text/x-wiki 9zwgro4jtfzr11xt0v4kaz5wavvb0jm 2465777 2465776 2026-10-08T16:14:54Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add new dns entries for IPs on lsw1-c1-eqiad - cmooney@cumin1004" 2465777 wikitext text/x-wiki jywwawyxjlaj49r0l9nw24mcymxk09b 2465778 2465777 2026-10-08T16:14:55Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2465778 wikitext text/x-wiki h3khx5g87wnzx4juefrrjok342epcen 2465779 2465778 2026-10-08T16:15:10Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.network.tls for network device lsw1-c1-eqiad 2465779 wikitext text/x-wiki d0b06apcww1iv10z8u7wcbx56j9fg3q 2465780 2465779 2026-10-08T16:16:55Z Stashbot 7414 cmooney@cumin1004: END (FAIL) - Cookbook sre.network.tls (exit_code=99) for network device lsw1-c1-eqiad 2465780 wikitext text/x-wiki fks3d6wh2knj9wy9fvxfnpcsvv2vzep 2465781 2465780 2026-10-08T16:19:32Z Stashbot 7414 dancy@deploy1003: Installing scap version "4.296.0" for 3 host(s) 2465781 wikitext text/x-wiki s5luet6dc7n8ceocfynlu5kqi50533y 2465782 2465781 2026-10-08T16:21:25Z Stashbot 7414 dancy@deploy1003: Installation of scap version "4.296.0" completed for 3 hosts 2465782 wikitext text/x-wiki 0klgr2ix24hhtnwpskfnglem5pcqrzr 2465783 2465782 2026-10-08T16:25:13Z Stashbot 7414 ssastry@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2465783 wikitext text/x-wiki 3de8wfjy0uy83yqtwh2mriatl1em247 2465784 2465783 2026-10-08T16:25:40Z Stashbot 7414 ssastry@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2465784 wikitext text/x-wiki dpua6wny1mfv4yydoplozq26n5skk4l 2465785 2465784 2026-10-08T16:25:42Z Stashbot 7414 ssastry@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2465785 wikitext text/x-wiki 5biqhg7kwvxtal3vpq6oegfbiv3wbod 2465786 2465785 2026-10-08T16:26:13Z Stashbot 7414 ssastry@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2465786 wikitext text/x-wiki 2a3sgxkfpmzu6q69h4wuazvnvo4sqxv 2465787 2465786 2026-10-08T16:28:21Z Stashbot 7414 oblivian@cumin1004: END (FAIL) - Cookbook sre.k8s.enable_virtualization (exit_code=1) rolling provision on D{wikikube-worker[1064-1081,1084-1087,1093-1095].eqiad.wmnet} and (A:wikikube-master-eqiad or A:wikikube-worker-eqiad) 2465787 wikitext text/x-wiki qoan01w5up310wiopzhri5gfjyqdx3t 2465788 2465787 2026-10-08T16:33:51Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts wikikube-worker1081.eqiad.wmnet 2465788 wikitext text/x-wiki b5hwm6ebzbfesbet62w8219livsr7xp 2465789 2465788 2026-10-08T16:35:58Z Stashbot 7414 btullis@cumin1004: END (FAIL) - Cookbook sre.druid.reboot-workers (exit_code=99) for Druid public cluster: Reboot Druid nodes 2465789 wikitext text/x-wiki 07qne4zvmyv6l69d3ignl8ywdwz4u09 2465790 2465789 2026-10-08T16:37:52Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1057.eqiad.wmnet 2465790 wikitext text/x-wiki 1tbiliet5em9anchj8j0ud1g2qybdee 2465791 2465790 2026-10-08T16:38:42Z Stashbot 7414 oblivian@cumin1004: END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) pool for host wikikube-worker1057.eqiad.wmnet 2465791 wikitext text/x-wiki hmq34a2lz9cyg0gzm5y5ikc5ks2xm11 2465792 2465791 2026-10-08T16:43:28Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2177.codfw.wmnet 2465792 wikitext text/x-wiki r6xxkn8760hi1o9qdaud5vxn0ddeexy 2465793 2465792 2026-10-08T16:43:29Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2177.codfw.wmnet 2465793 wikitext text/x-wiki aaj9gov42q1pv12d6e6hjhmbdwqq8ws 2465794 2465793 2026-10-08T16:43:42Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2178.codfw.wmnet 2465794 wikitext text/x-wiki ckdaale32vsvoen2n87k7glr5mcxq6k 2465795 2465794 2026-10-08T16:44:15Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2178.codfw.wmnet 2465795 wikitext text/x-wiki 9onjcyndb5ep1c3zfz3ve05xe7ttdiu 2465796 2465795 2026-10-08T16:44:35Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2178.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465796 wikitext text/x-wiki f9sdbnzy1rrgre6je007rt6sn50qydp 2465797 2465796 2026-10-08T16:49:52Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2178.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465797 wikitext text/x-wiki 9ertgh12gm9e7g7wxnipjkicznw5q8a 2465803 2465797 2026-10-08T17:02:58Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2178.codfw.wmnet 2465803 wikitext text/x-wiki miofboqoavzwk6ty43yh588mc0jcs1c 2465804 2465803 2026-10-08T17:03:00Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2178.codfw.wmnet 2465804 wikitext text/x-wiki s213dxsi1iv49chdgje1a3703c53pev 2465805 2465804 2026-10-08T17:03:14Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2179.codfw.wmnet 2465805 wikitext text/x-wiki 3hbzp8ny1xxbn0yz9x43ttf0i6aydkv 2465806 2465805 2026-10-08T17:03:47Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2179.codfw.wmnet 2465806 wikitext text/x-wiki nbrroy8lqbx27g37qq4teqhm2lvehyq 2465807 2465806 2026-10-08T17:04:06Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2179.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465807 wikitext text/x-wiki c7ivdw3ddd03cxzektyfvahpitu8br8 2465808 2465807 2026-10-08T17:09:19Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2179.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465808 wikitext text/x-wiki o8q0davoztyju0nm5r3fiwgfcmd0jpl 2465809 2465808 2026-10-08T17:09:23Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] START helmfile.d/services/rest-gateway: apply 2465809 wikitext text/x-wiki 8uzo6n64oia3p1e6nenw4bwc9bny2v9 2465810 2465809 2026-10-08T17:10:25Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] DONE helmfile.d/services/rest-gateway: apply 2465810 wikitext text/x-wiki hb2oru33kyl24zliy5p3npkunzr9roz 2465811 2465810 2026-10-08T17:20:15Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2179.codfw.wmnet 2465811 wikitext text/x-wiki 93wofyp8x8k5r4uyq0r5p9y94o0szgg 2465812 2465811 2026-10-08T17:20:17Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2179.codfw.wmnet 2465812 wikitext text/x-wiki 5h3bnghi4t0o81lwyqnwem775ng39uc 2465813 2465812 2026-10-08T17:20:19Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.enable_virtualization (exit_code=0) rolling provision on D{wikikube-worker[2141-2179].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) 2465813 wikitext text/x-wiki oo39py07im6orrywmkjrupoapq50rdu 2465814 2465813 2026-10-08T17:31:38Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2465814 wikitext text/x-wiki 4ac6is609lzgh7csjq971poen9o8tim 2465815 2465814 2026-10-08T17:36:31Z Stashbot 7414 andrew@deploy1003: helmfile [staging] START helmfile.d/services/developer-portal: apply 2465815 wikitext text/x-wiki mq0ctdgkgdkqhqxq3b0khg4pesgekva 2465816 2465815 2026-10-08T17:36:47Z Stashbot 7414 andrew@deploy1003: helmfile [staging] DONE helmfile.d/services/developer-portal: apply 2465816 wikitext text/x-wiki 6b7pvdfqdc5iw45e813pkyuc2gu7nyo 2465818 2465816 2026-10-08T17:45:48Z Stashbot 7414 andrew@deploy1003: helmfile [codfw] START helmfile.d/services/developer-portal: apply 2465818 wikitext text/x-wiki b1m674lns654eradmk3fny2kfmayul8 2465819 2465818 2026-10-08T17:46:08Z Stashbot 7414 andrew@deploy1003: helmfile [codfw] DONE helmfile.d/services/developer-portal: apply 2465819 wikitext text/x-wiki 4s2zea0gljeq6l111th2hddv2vvu0lw 2465820 2465819 2026-10-08T17:46:56Z Stashbot 7414 andrew@deploy1003: helmfile [eqiad] START helmfile.d/services/developer-portal: apply 2465820 wikitext text/x-wiki s1tsv8b8vx3z8vkffn02596ypmolc3s 2465821 2465820 2026-10-08T17:47:11Z Stashbot 7414 andrew@deploy1003: helmfile [eqiad] DONE helmfile.d/services/developer-portal: apply 2465821 wikitext text/x-wiki 3l87yksh6gaqmd5j0pq73vlrp1jeios 2465828 2465821 2026-10-08T18:56:51Z Stashbot 7414 oblivian@cumin1004: END (ERROR) - Cookbook sre.hardware.upgrade-firmware (exit_code=97) upgrade firmware for hosts wikikube-worker1081.eqiad.wmnet 2465828 wikitext text/x-wiki 6up9sly3zft2cgj8wat3os71zlony8w 2465829 2465828 2026-10-08T19:00:49Z Stashbot 7414 andrew@deploy1003: helmfile [staging] START helmfile.d/services/developer-portal: apply 2465829 wikitext text/x-wiki e1uka37kuxn6woxfycdxpgvr4t5y95e 2465830 2465829 2026-10-08T19:01:00Z Stashbot 7414 andrew@deploy1003: helmfile [staging] DONE helmfile.d/services/developer-portal: apply 2465830 wikitext text/x-wiki qmbjgrivsuxior7tcaqkk7wucpgcrmm 2465831 2465830 2026-10-08T19:01:28Z Stashbot 7414 andrew@deploy1003: helmfile [codfw] START helmfile.d/services/developer-portal: apply 2465831 wikitext text/x-wiki 7e51sf9cgcj01m4ava7xkgqi6xn4fxn 2465832 2465831 2026-10-08T19:01:46Z Stashbot 7414 andrew@deploy1003: helmfile [codfw] DONE helmfile.d/services/developer-portal: apply 2465832 wikitext text/x-wiki 7a52zazqj3hk26mpgg01nwo5azliyw4 2465833 2465832 2026-10-08T19:02:03Z Stashbot 7414 andrew@deploy1003: helmfile [eqiad] START helmfile.d/services/developer-portal: apply 2465833 wikitext text/x-wiki nr92tzwisr752fyah4oskm5nlbuk0p7 2465834 2465833 2026-10-08T19:02:20Z Stashbot 7414 andrew@deploy1003: helmfile [eqiad] DONE helmfile.d/services/developer-portal: apply 2465834 wikitext text/x-wiki cy1t9h4viss6mmtqt9eo6wga24in9mg 2465835 2465834 2026-10-08T19:06:27Z Stashbot 7414 dzahn@deploy1003: helmfile [staging] START helmfile.d/services/miscweb: apply 2465835 wikitext text/x-wiki oa3sbz2ukj9sv2wxjb8g0pbi5c0pwtf 2465836 2465835 2026-10-08T19:06:47Z Stashbot 7414 dzahn@deploy1003: helmfile [staging] DONE helmfile.d/services/miscweb: apply 2465836 wikitext text/x-wiki mu7n0c1gaz991loe6lo55knqmgvioh1 2465837 2465836 2026-10-08T19:07:01Z Stashbot 7414 dzahn@deploy1003: helmfile [eqiad] START helmfile.d/services/miscweb: apply 2465837 wikitext text/x-wiki 1tqzbclszfode5wsf6pij7bjv7cy311 2465838 2465837 2026-10-08T19:07:17Z Stashbot 7414 dzahn@deploy1003: helmfile [eqiad] DONE helmfile.d/services/miscweb: apply 2465838 wikitext text/x-wiki 80bc1n07nj56aizb3tmna17wwo6wvfl 2465839 2465838 2026-10-08T19:07:29Z Stashbot 7414 dzahn@deploy1003: helmfile [codfw] START helmfile.d/services/miscweb: apply 2465839 wikitext text/x-wiki doybqi1gikbalr4w0kpwm7p2phabg7o 2465840 2465839 2026-10-08T19:07:50Z Stashbot 7414 dzahn@deploy1003: helmfile [codfw] DONE helmfile.d/services/miscweb: apply 2465840 wikitext text/x-wiki trwvzj5pxd4jijzgtx422xhtma7h5is 2465842 2465840 2026-10-08T19:22:40Z Stashbot 7414 kamila@deploy1003: Started scap deploy-service shellbox: PHP update 2465842 wikitext text/x-wiki 95ctoaynoomo5twoxoql71gg7nzhzql 2465843 2465842 2026-10-08T19:22:42Z Stashbot 7414 kamila@deploy1003: scap deploy-service shellbox: [STAGING/DEFAULT] staging-eqiad Deploying shellbox, shellbox-constraints, shellbox-media, shellbox-syntaxhighlight, shellbox-timeline, shellbox-video 2465843 wikitext text/x-wiki ixc3ph8a4ocnjeoijdxij8juw7ueguj 2465844 2465843 2026-10-08T19:26:11Z Stashbot 7414 kamila@deploy1003: scap deploy-service shellbox: [PRODUCTION/DEFAULT] codfw Deploying shellbox, shellbox-constraints, shellbox-media, shellbox-syntaxhighlight, shellbox-timeline, shellbox-video 2465844 wikitext text/x-wiki kbs2zz0op25wwcj1knzj30wx47cfsit 2465848 2465844 2026-10-08T19:57:20Z Stashbot 7414 kamila@deploy1003: scap deploy-service shellbox: [PRODUCTION/DEFAULT] eqiad Deploying shellbox, shellbox-constraints, shellbox-media, shellbox-syntaxhighlight, shellbox-timeline, shellbox-video 2465848 wikitext text/x-wiki 7z7s5mpbogdzliq7iky18droyg2xqe9 2465850 2465848 2026-10-08T19:58:45Z Stashbot 7414 kamila@deploy1003: Finished scap deploy-service shellbox: PHP update (duration: 36m 05s) 2465850 wikitext text/x-wiki 3xvi52e9dnfn3loiayuldfsr3reuczr 2465852 2465850 2026-10-08T20:06:44Z Stashbot 7414 cjming@deploy1003: Started scap sync-world: Backport for [[gerrit:1339561|Add URLs for MobileAppRedirect Special Page (T434930)]], [[gerrit:1352261|Update Test Kitchen instruments intake URL on beta cluster (T437720)]] 2465852 wikitext text/x-wiki 5myp5nuck4iw8ogd9pwv5t2ao2ho81e 2465853 2465852 2026-10-08T20:10:47Z Stashbot 7414 cjming@deploy1003: milazg, cjming: Backport for [[gerrit:1339561|Add URLs for MobileAppRedirect Special Page (T434930)]], [[gerrit:1352261|Update Test Kitchen instruments intake URL on beta cluster (T437720)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2465853 wikitext text/x-wiki 5ihpk8g9eez00vkodxi23fxrieya853 2465855 2465853 2026-10-08T20:14:04Z Stashbot 7414 cjming@deploy1003: milazg, cjming: Continuing with deployment 2465855 wikitext text/x-wiki mkavoth3r5t0yu6jyf62jcjghi9r061 2465857 2465855 2026-10-08T20:21:40Z Stashbot 7414 cjming@deploy1003: Finished scap sync-world: Backport for [[gerrit:1339561|Add URLs for MobileAppRedirect Special Page (T434930)]], [[gerrit:1352261|Update Test Kitchen instruments intake URL on beta cluster (T437720)]] (duration: 14m 56s) 2465857 wikitext text/x-wiki pfjehpzzhqe6hgstv1pzz5d79v48n2g 2465858 2465857 2026-10-08T20:23:27Z Stashbot 7414 mlitn@deploy1003: Started scap sync-world: Backport for [[gerrit:1353257|Temporary: don't catch exception]] 2465858 wikitext text/x-wiki fgkmwog265l5q6x1du6teke9124zhj6 2465859 2465858 2026-10-08T20:27:27Z Stashbot 7414 mlitn@deploy1003: mlitn: Backport for [[gerrit:1353257|Temporary: don't catch exception]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2465859 wikitext text/x-wiki s30exdq0gxyvq9eh0idg82xbi715cap 2465860 2465859 2026-10-08T20:27:54Z Stashbot 7414 mlitn@deploy1003: mlitn: Continuing with deployment 2465860 wikitext text/x-wiki 2uc1rm035s5lgd71a156hluy26k5s6l 2465861 2465860 2026-10-08T20:33:09Z Stashbot 7414 mlitn@deploy1003: Finished scap sync-world: Backport for [[gerrit:1353257|Temporary: don't catch exception]] (duration: 09m 41s) 2465861 wikitext text/x-wiki 7ezlw6kmy0kybqi3rg0dbgp51trlfqv 2465862 2465861 2026-10-08T20:38:44Z Stashbot 7414 cjming@deploy1003: Started scap sync-world: Backport for [[gerrit:1353392|Override experiment enrollments via X-Wikimedia-Debug header (T437240)]] 2465862 wikitext text/x-wiki soj9sb3obp551pifnmh3bzm1imvbfnv 2465863 2465862 2026-10-08T20:42:36Z Stashbot 7414 cjming@deploy1003: cjming: Backport for [[gerrit:1353392|Override experiment enrollments via X-Wikimedia-Debug header (T437240)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2465863 wikitext text/x-wiki nzg7t2l2jpjhljg26opm47kxf3h13m2 2465864 2465863 2026-10-08T20:43:07Z Stashbot 7414 cjming@deploy1003: cjming: Continuing with deployment 2465864 wikitext text/x-wiki jg74zvz4kcigkr5iys6rtsd3ogdyuex 2465865 2465864 2026-10-08T20:48:24Z Stashbot 7414 cjming@deploy1003: Finished scap sync-world: Backport for [[gerrit:1353392|Override experiment enrollments via X-Wikimedia-Debug header (T437240)]] (duration: 09m 40s) 2465865 wikitext text/x-wiki s29j2uepeetqy8o2udry6xedi4i9zu4 2465866 2465865 2026-10-08T21:07:10Z Stashbot 7414 ejegg@deploy1003: Started scap sync-world: Backport for [[gerrit:1353269|Update CentralNotice to 658422ff5fed886]] 2465866 wikitext text/x-wiki clya3nzzsiiqsxka06gz1a4j25yq547 2465867 2465866 2026-10-08T21:13:28Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/test-kitchen-next: apply 2465867 wikitext text/x-wiki ob9uygy8e7nfcsha9l2ve1gegqrlz8f 2465868 2465867 2026-10-08T21:14:07Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/test-kitchen-next: apply 2465868 wikitext text/x-wiki hcxeezub5qg2e5nbnbe0i4a2kcjnixt 2465869 2465868 2026-10-08T21:15:07Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.network.tls for network device lsw1-c1-eqiad 2465869 wikitext text/x-wiki rk7rp0qinahd4l9eoscav5sbpin9vji 2465870 2465869 2026-10-08T21:15:25Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-c1-eqiad 2465870 wikitext text/x-wiki rw5na17vzsdpduzrsbk816ot58yeivq 2465871 2465870 2026-10-08T21:27:08Z Stashbot 7414 ejegg@deploy1003: ejegg: Backport for [[gerrit:1353269|Update CentralNotice to 658422ff5fed886]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2465871 wikitext text/x-wiki t98nugp9vvtm4pwv7q466yxwv444ml1 2465872 2465871 2026-10-08T21:37:50Z Stashbot 7414 ejegg@deploy1003: ejegg: Rolling back deployment 2465872 wikitext text/x-wiki mk7gqc8533zsq451c56sgdp8h6wg7c9 2465873 2465872 2026-10-08T21:42:32Z Stashbot 7414 ejegg@deploy1003: Finished scap sync-world: Backport for [[gerrit:1353269|Update CentralNotice to 658422ff5fed886]] (duration: 35m 22s) 2465873 wikitext text/x-wiki 6f6767iglbpxbx7hr64vf5fjdfub6v6 2465874 2465873 2026-10-08T22:00:13Z Stashbot 7414 ladsgroup@deploy1003: helmfile [staging] START helmfile.d/services/thumbor: apply 2465874 wikitext text/x-wiki fnma2prsaxl9zeasops9ncy4qbvu30i 2465875 2465874 2026-10-08T22:00:21Z Stashbot 7414 kemayo@deploy1003: Started scap sync-world: Backport for [[gerrit:1351444|VisualEditor: Precompute edit suggestion counts on testwiki (T432733)]] 2465875 wikitext text/x-wiki kpql7gt36s0mkrd6y1tman7vythieqg 2465876 2465875 2026-10-08T22:00:23Z Stashbot 7414 ladsgroup@deploy1003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2465876 wikitext text/x-wiki 8mm9aii6i6slnpv3akkda2iret7b2e0 2465877 2465876 2026-10-08T22:02:32Z Stashbot 7414 herron@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-experimental: apply 2465877 wikitext text/x-wiki iot4ettjrodrjo8spp7bcz8en4kuq5z 2465878 2465877 2026-10-08T22:03:13Z Stashbot 7414 herron@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-experimental: apply 2465878 wikitext text/x-wiki 46clc2lk1eexji2eiltu8iy4wv5ls34 2465879 2465878 2026-10-08T22:03:34Z Stashbot 7414 herron@deploy1003: helmfile [codfw] START helmfile.d/services/mw-experimental: apply 2465879 wikitext text/x-wiki mm2d86507p9qd045rqqz345g4ae166a 2465880 2465879 2026-10-08T22:04:25Z Stashbot 7414 herron@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-experimental: apply 2465880 wikitext text/x-wiki lwovbqy7393an600bv01ubd19vowpuv 2465881 2465880 2026-10-08T22:11:24Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2465881 wikitext text/x-wiki 7gd4iogw285p01i4xyrl1dz7bv8nlji 2465882 2465881 2026-10-08T22:13:36Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2465882 wikitext text/x-wiki mw8fprx11yhy6i3toposeddo76wlei5 2465883 2465882 2026-10-08T22:20:24Z Stashbot 7414 ladsgroup@deploy1003: helmfile [eqiad] START helmfile.d/services/thumbor: apply 2465883 wikitext text/x-wiki b2570g5mafx0f2tys5h6dgt6x4h3ncl 2465884 2465883 2026-10-08T22:20:47Z Stashbot 7414 kemayo@deploy1003: kemayo: Backport for [[gerrit:1351444|VisualEditor: Precompute edit suggestion counts on testwiki (T432733)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2465884 wikitext text/x-wiki 348gruqfgx4i4wgn9hemrtk6n51mpwm 2465885 2465884 2026-10-08T22:22:36Z Stashbot 7414 ladsgroup@deploy1003: helmfile [eqiad] DONE helmfile.d/services/thumbor: apply 2465885 wikitext text/x-wiki 1pkr1oiyyjuj64kehtbiod9yr4w0jhh 2465886 2465885 2026-10-08T22:25:11Z Stashbot 7414 kemayo@deploy1003: kemayo: Continuing with deployment 2465886 wikitext text/x-wiki n9mq1chizqgfa9dazeev1lr2469kua2 2465887 2465886 2026-10-08T22:37:01Z Stashbot 7414 kemayo@deploy1003: Finished scap sync-world: Backport for [[gerrit:1351444|VisualEditor: Precompute edit suggestion counts on testwiki (T432733)]] (duration: 36m 40s) 2465887 wikitext text/x-wiki 4v0t5wxk28hiu56wststkzxax2zh77w 2465889 2465887 2026-10-08T22:51:20Z Stashbot 7414 ejegg@deploy1003: Started scap sync-world: Backport for [[gerrit:1353458|Update CentralNotice to cd3f46a4053cb74ff50b003e]] 2465889 wikitext text/x-wiki cz0fpw4ra42q6tjc3zb3akouc78klvq 2465890 2465889 2026-10-08T23:11:42Z Stashbot 7414 ejegg@deploy1003: ejegg: Backport for [[gerrit:1353458|Update CentralNotice to cd3f46a4053cb74ff50b003e]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2465890 wikitext text/x-wiki ef811josd8h3b5bs47w3o9sj4g8qzmu 2465892 2465890 2026-10-08T23:16:43Z Stashbot 7414 ejegg@deploy1003: ejegg: Continuing with deployment 2465892 wikitext text/x-wiki oko14bdyqcwbjpdwd5zrfwvt0z768ix 2465894 2465892 2026-10-08T23:28:46Z Stashbot 7414 ejegg@deploy1003: Finished scap sync-world: Backport for [[gerrit:1353458|Update CentralNotice to cd3f46a4053cb74ff50b003e]] (duration: 37m 26s) 2465894 wikitext text/x-wiki 4qrbc035556bredxq6ku4d401z5fpkr 2465895 2465894 2026-10-08T23:39:13Z Stashbot 7414 fceratto@cumin1004: END (FAIL) - Cookbook sre.mysql.pool (exit_code=99) pool db2902: Pool db2902.codfw.wmnet in after cloning 2465895 wikitext text/x-wiki f98cr9pyeznkvoztickdhpado1ggvlw 2465898 2465895 2026-10-09T01:14:36Z Stashbot 7414 mutante: releases1003 - /usr/sbin/sysctl -w net.ipv4.tcp_congestion_control=bbr T440068 - downloads 120x times faster 2465898 wikitext text/x-wiki fp32kb0ou00swq3rol3q0xbxr0h09dz 2465899 2465898 2026-10-09T01:20:17Z Stashbot 7414 kemayo@deploy1003: Started scap sync-world: Backport for [[gerrit:1353543|BaseEditCheck: don't use toDataElement when looking for categories (T440669)]] 2465899 wikitext text/x-wiki m6u2s4r1t0ac8lvszos9gewke2886nh 2465900 2465899 2026-10-09T01:24:16Z Stashbot 7414 kemayo@deploy1003: kemayo: Backport for [[gerrit:1353543|BaseEditCheck: don't use toDataElement when looking for categories (T440669)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2465900 wikitext text/x-wiki qf8g05vgq4yln0fzlr9enza74yo2nkd 2465901 2465900 2026-10-09T01:25:03Z Stashbot 7414 kemayo@deploy1003: kemayo: Continuing with deployment 2465901 wikitext text/x-wiki n9b0mv62mdgzfs5sf11h9n7yxwdb5t5 2465902 2465901 2026-10-09T01:30:23Z Stashbot 7414 kemayo@deploy1003: Finished scap sync-world: Backport for [[gerrit:1353543|BaseEditCheck: don't use toDataElement when looking for categories (T440669)]] (duration: 10m 10s) 2465902 wikitext text/x-wiki hg38gbdk2jkyrqgtogbl1oxnaw24kaw 2465903 2465902 2026-10-09T01:51:38Z Stashbot 7414 ssastry@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2465903 wikitext text/x-wiki 77vuu7stw2bds554nf5pptl6pfm5m70 2465904 2465903 2026-10-09T01:52:05Z Stashbot 7414 ssastry@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2465904 wikitext text/x-wiki q3l6xkx85tjllrz2ekqqvsq6y12yf8l 2465905 2465904 2026-10-09T01:52:07Z Stashbot 7414 ssastry@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2465905 wikitext text/x-wiki 4dipbnc5agyl9by4cptqr1aed84mpxs 2465906 2465905 2026-10-09T01:52:39Z Stashbot 7414 ssastry@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2465906 wikitext text/x-wiki pp8c0tkp6v8kl44p16u7nkx061h3e8u 2465907 2465906 2026-10-09T02:00:32Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2465907 wikitext text/x-wiki 20bn70jja8vyvzlxp63eogh9klyzgjm 2465908 2465907 2026-10-09T02:08:10Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 07m 37s) 2465908 wikitext text/x-wiki ar6bilvmn8554bltry2ernvleik69uq 2465911 2465908 2026-10-09T05:42:50Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts wikikube-worker1081.eqiad.wmnet 2465911 wikitext text/x-wiki 2cqd49r35mjb1bnjgp4yqhpqnq7jvk0 2465912 2465911 2026-10-09T05:42:58Z Stashbot 7414 oblivian@cumin1004: END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts wikikube-worker1081.eqiad.wmnet 2465912 wikitext text/x-wiki ex5z1jtmu8xgepw3t15xtnzson12757 2465913 2465912 2026-10-09T05:45:47Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1057.eqiad.wmnet 2465913 wikitext text/x-wiki 7ehprbi9eg2t81x2op54mz5in2sasma 2465914 2465913 2026-10-09T05:45:55Z Stashbot 7414 oblivian@cumin1004: END (ERROR) - Cookbook sre.k8s.pool-depool-node (exit_code=97) pool for host wikikube-worker1057.eqiad.wmnet 2465914 wikitext text/x-wiki lkmgf2ifjjnykay4su15e5luz7lpie7 2465915 2465914 2026-10-09T05:50:58Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1057.eqiad.wmnet 2465915 wikitext text/x-wiki jbrg10wtzdwbxmpxis9d60ud9nker38 2465916 2465915 2026-10-09T05:50:59Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1057.eqiad.wmnet 2465916 wikitext text/x-wiki fzwhsv1gkofg9abaue0d4psflyazri4 2465917 2465916 2026-10-09T05:51:40Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts wikikube-worker1081.eqiad.wmnet 2465917 wikitext text/x-wiki 0tiituv11p564ndt0694l7lw50eofgl 2465925 2465917 2026-10-09T06:24:40Z Stashbot 7414 oblivian@cumin1004: END (ERROR) - Cookbook sre.hardware.upgrade-firmware (exit_code=97) upgrade firmware for hosts wikikube-worker1081.eqiad.wmnet 2465925 wikitext text/x-wiki 8gydsi2midlqc6nq8baah33jg745z75 2465938 2465925 2026-10-09T07:24:54Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.enable_virtualization rolling provision on D{wikikube-worker[1084-1087,1093-1095].eqiad.wmnet} and (A:wikikube-master-eqiad or A:wikikube-worker-eqiad) 2465938 wikitext text/x-wiki m600ugkhnapijbhhmhg94m5f7hje7cq 2465939 2465938 2026-10-09T07:24:58Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1084.eqiad.wmnet 2465939 wikitext text/x-wiki 0ydlxkczlu5de51wdyo0p3wcv1hjti7 2465940 2465939 2026-10-09T07:25:31Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1084.eqiad.wmnet 2465940 wikitext text/x-wiki augxmrbg6awm48ihqaxuce5u30mzvaw 2465941 2465940 2026-10-09T07:25:51Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1084.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465941 wikitext text/x-wiki ahggojphndz2b09kyxvggw87nc3dc5g 2465943 2465941 2026-10-09T07:34:41Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1084.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465943 wikitext text/x-wiki hftadc1hsr02lvig5fu5b0xa8bz6h8a 2465944 2465943 2026-10-09T07:34:59Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1084.eqiad.wmnet 2465944 wikitext text/x-wiki jnyryl59mw39wroozjhdcev6p5s2vnw 2465947 2465944 2026-10-09T07:36:57Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1084.eqiad.wmnet 2465947 wikitext text/x-wiki 6wm0cafcx7062goyoietko0j6pyjje5 2465948 2465947 2026-10-09T07:37:10Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1085.eqiad.wmnet 2465948 wikitext text/x-wiki 397ule9i3hs0ydk5785utldv6fc09b0 2465950 2465948 2026-10-09T07:37:45Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1085.eqiad.wmnet 2465950 wikitext text/x-wiki 6i7vs0ldlfjjgm50wc1lqyoot9qn3jr 2465951 2465950 2026-10-09T07:38:04Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1085.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465951 wikitext text/x-wiki f07g0t1goyjnqnc4oyaapqi56346n0x 2465953 2465951 2026-10-09T07:46:55Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1085.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465953 wikitext text/x-wiki nremq95c39gdv1ca6g1bvkrnxnue55g 2465954 2465953 2026-10-09T07:47:06Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1085.eqiad.wmnet 2465954 wikitext text/x-wiki mvitdvpxupl180f47ijw3lnzv2vjrev 2465955 2465954 2026-10-09T07:47:07Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1085.eqiad.wmnet 2465955 wikitext text/x-wiki 9bzh5avaq9u34luts3x0skyiqx391an 2465956 2465955 2026-10-09T07:47:20Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1086.eqiad.wmnet 2465956 wikitext text/x-wiki n2kh2530aqzt781sxcvuwwji7k6rlbs 2465957 2465956 2026-10-09T07:47:53Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1086.eqiad.wmnet 2465957 wikitext text/x-wiki 26woz19g1o4cs6szh46bo2za2qonb0j 2465958 2465957 2026-10-09T07:48:13Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1086.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465958 wikitext text/x-wiki f4ety5cfsos3rcog2lsyvze20br5tsy 2465959 2465958 2026-10-09T07:57:34Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1086.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465959 wikitext text/x-wiki 5z2xqceegswgq5mp10xp6fp8al4scob 2465960 2465959 2026-10-09T07:57:46Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1086.eqiad.wmnet 2465960 wikitext text/x-wiki 61y4a1qnftss3yqnn6lbc3wudl29m1d 2465962 2465960 2026-10-09T07:59:02Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1086.eqiad.wmnet 2465962 wikitext text/x-wiki ejb487fmblwdj72bddu5lgkvgu4oohc 2465963 2465962 2026-10-09T07:59:15Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1087.eqiad.wmnet 2465963 wikitext text/x-wiki reesh171cwsnk1ghnadzdnsrqar76s7 2465964 2465963 2026-10-09T07:59:48Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1087.eqiad.wmnet 2465964 wikitext text/x-wiki mpv5m77rxv1jny2ug5vpzbpve6nobbo 2465965 2465964 2026-10-09T08:00:07Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1087.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465965 wikitext text/x-wiki b9qqtioyn3i4mf8qm645d52r7vgquyo 2465968 2465965 2026-10-09T08:08:57Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1087.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465968 wikitext text/x-wiki 5vx3hkb70kgzuloeu05t06w1cv1th97 2465969 2465968 2026-10-09T08:09:16Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1087.eqiad.wmnet 2465969 wikitext text/x-wiki sdwqgk9ulgzswetggn8c7qy9cddai6q 2465970 2465969 2026-10-09T08:09:38Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1087.eqiad.wmnet 2465970 wikitext text/x-wiki 3qf8egv5ami5j7aiikijc51gmhpks53 2465972 2465970 2026-10-09T08:09:51Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1093.eqiad.wmnet 2465972 wikitext text/x-wiki s55s76467gcy2g58yzolf5a08xs39ag 2465973 2465972 2026-10-09T08:10:24Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1093.eqiad.wmnet 2465973 wikitext text/x-wiki fflidoie4uba017tqewv00kgelqztcp 2465975 2465973 2026-10-09T08:10:44Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1093.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465975 wikitext text/x-wiki tlo38onszo25encd4ppm4a3g9of92qs 2465977 2465975 2026-10-09T08:18:34Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1093.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465977 wikitext text/x-wiki 47rc5o6sf8d69le93r89lznu062ijaw 2465978 2465977 2026-10-09T08:18:40Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1093.eqiad.wmnet 2465978 wikitext text/x-wiki dzta4tuqi92fhjhisb9zowpx2if6ek3 2465979 2465978 2026-10-09T08:21:10Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1093.eqiad.wmnet 2465979 wikitext text/x-wiki twd3ykrunbvdz2mc2ck2p2sa46iwwn3 2465980 2465979 2026-10-09T08:21:24Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1094.eqiad.wmnet 2465980 wikitext text/x-wiki 43kcq3n5n2vh4okv9ovxk1beagb15nz 2465981 2465980 2026-10-09T08:22:00Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1094.eqiad.wmnet 2465981 wikitext text/x-wiki 0mweqsd0bxi34dcffmpg80ev87qq5hj 2465982 2465981 2026-10-09T08:22:20Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1094.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465982 wikitext text/x-wiki lyic9un8z8v4mwro9tp0ha17pddabt6 2465984 2465982 2026-10-09T08:30:11Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1094.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465984 wikitext text/x-wiki 3bjnggvq2yumnyl7267rr07kn7wroqi 2465985 2465984 2026-10-09T08:30:17Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1094.eqiad.wmnet 2465985 wikitext text/x-wiki 26mw3a43vvadyrto71efsornjn3h7mh 2465986 2465985 2026-10-09T08:32:15Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1094.eqiad.wmnet 2465986 wikitext text/x-wiki hwjvzeur4qwc4ai0w4cypnselerurq9 2465987 2465986 2026-10-09T08:32:29Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1095.eqiad.wmnet 2465987 wikitext text/x-wiki ecmkvmincukgmbj6aliv85q121pir35 2465988 2465987 2026-10-09T08:33:04Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1095.eqiad.wmnet 2465988 wikitext text/x-wiki 9uc9rlz0x5gxn48762l7l49qoh0o37w 2465989 2465988 2026-10-09T08:33:24Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1095.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465989 wikitext text/x-wiki co75gv0heqm5qsrrp9sv0cvap6f6um7 2465990 2465989 2026-10-09T08:41:14Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1095.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2465990 wikitext text/x-wiki t2u65bbniu1u868bv5w4l7lys6fsaco 2465991 2465990 2026-10-09T08:41:25Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1095.eqiad.wmnet 2465991 wikitext text/x-wiki dl3crlecqh607716xdu4ike84mdw95u 2465992 2465991 2026-10-09T08:43:12Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1095.eqiad.wmnet 2465992 wikitext text/x-wiki 2veokhs18feolyukbixmv0gdh60837u 2465993 2465992 2026-10-09T08:43:15Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.enable_virtualization (exit_code=0) rolling provision on D{wikikube-worker[1084-1087,1093-1095].eqiad.wmnet} and (A:wikikube-master-eqiad or A:wikikube-worker-eqiad) 2465993 wikitext text/x-wiki 5l7d70yax72hlsjwtmnmmqwlrohsfu0 2465994 2465993 2026-10-09T08:45:06Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'llm' for release 'main' . 2465994 wikitext text/x-wiki fo3jvlmbgzgij8ji5ztkp33s6jq6m0l 2465996 2465994 2026-10-09T09:18:52Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.decommission for hosts cuminunpriv1001.eqiad.wmnet 2465996 wikitext text/x-wiki 195tgj719qhh0gnpw56n2s8eha3dpf8 2465997 2465996 2026-10-09T09:23:50Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.dns.netbox 2465997 wikitext text/x-wiki c96h1sujlj38zwauyiruihv2xmg4xi1 2465998 2465997 2026-10-09T09:37:14Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reimage for host druid1010.eqiad.wmnet with OS bookworm 2465998 wikitext text/x-wiki 1v0w1g39vzw78pjixt040l8qqch49qm 2465999 2465998 2026-10-09T09:40:47Z Stashbot 7414 codders: Updated the Wikidata property suggester with data from 20261005's JSON dump 2465999 wikitext text/x-wiki kkiaiqaels9zfcumrkmem9gq7ojmlbg 2466000 2465999 2026-10-09T09:51:20Z Stashbot 7414 ladsgroup@deploy1003: helmfile [staging] START helmfile.d/services/thumbor: apply 2466000 wikitext text/x-wiki 3qutvnskct97plk2bxrh6d8sd01mfai 2466001 2466000 2026-10-09T09:52:37Z Stashbot 7414 ladsgroup@deploy1003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2466001 wikitext text/x-wiki of67jq9kc2k2mj0lj16rj6xl34x5ffa 2466002 2466001 2026-10-09T09:53:39Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on druid1010.eqiad.wmnet with reason: host reimage 2466002 wikitext text/x-wiki 1o7mrlwzvqeuwala7u4qjtlt6goqzn9 2466003 2466002 2026-10-09T09:57:18Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2466003 wikitext text/x-wiki p3tfxx8x3cm43yh6yrxf6py2u1casy1 2466004 2466003 2026-10-09T09:58:57Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on druid1010.eqiad.wmnet with reason: host reimage 2466004 wikitext text/x-wiki mbzke8o47i4crhq7zc451d1raoi4lsf 2466005 2466004 2026-10-09T09:59:23Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2466005 wikitext text/x-wiki qff137ib4tvjxuk6jrc59u36g5ty3a5 2466006 2466005 2026-10-09T10:01:08Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cuminunpriv1001.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin2003" 2466006 wikitext text/x-wiki 76nqo428khuf4bzuyqpyqwbidgdeeur 2466007 2466006 2026-10-09T10:02:23Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: cuminunpriv1001.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - jmm@cumin2003" 2466007 wikitext text/x-wiki ql7zl2y5otfogj704lckus0s6p5yzpw 2466008 2466007 2026-10-09T10:02:25Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2466008 wikitext text/x-wiki 5ywafiuzxvviw1g8ruahtvn4otfgsmr 2466009 2466008 2026-10-09T10:02:26Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts cuminunpriv1001.eqiad.wmnet 2466009 wikitext text/x-wiki suxsbwbqkkyoalw9eupfblg059myjrk 2466010 2466009 2026-10-09T10:02:52Z Stashbot 7414 ladsgroup@deploy1003: helmfile [eqiad] START helmfile.d/services/thumbor: apply 2466010 wikitext text/x-wiki qixq8tedansmch16ep9b4ef0shv8zjx 2466011 2466010 2026-10-09T10:04:04Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2466011 wikitext text/x-wiki qtzrzistcxgbbt5mlkyb673g830ihzf 2466012 2466011 2026-10-09T10:04:16Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2466012 wikitext text/x-wiki b87htt2pqj9ubz12d1tvonqvpzooko0 2466013 2466012 2026-10-09T10:04:38Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2466013 wikitext text/x-wiki co2he97ubw79b37vv5yqsbv9ht7zb8a 2466014 2466013 2026-10-09T10:05:52Z Stashbot 7414 ladsgroup@deploy1003: helmfile [eqiad] DONE helmfile.d/services/thumbor: apply 2466014 wikitext text/x-wiki 6pnm2lgtfzftkkjmaf8ry7h7mz7hcxw 2466015 2466014 2026-10-09T10:16:40Z Stashbot 7414 cmooney@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on lswtest-d8-eqiad,lswtest-d8-eqiad IPv6,ssw1-d[1,8]-eqiad with reason: take rail kit from test switch 2466015 wikitext text/x-wiki gqdarce9itpr2bw13x0jijtl0j3sgrr 2466016 2466015 2026-10-09T10:17:10Z Stashbot 7414 cmooney@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on sretest1006.eqiad.wmnet with reason: move sretest1006 to row A 2466016 wikitext text/x-wiki 4ivydfepgaz5fhpicza8884bi02cqms 2466017 2466016 2026-10-09T10:20:21Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host druid1010.eqiad.wmnet with OS bookworm 2466017 wikitext text/x-wiki sun7bhdan38soqyhypdzfw2sdgnbcq5 2466018 2466017 2026-10-09T10:24:13Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . 2466018 wikitext text/x-wiki ram8bn0iqif6i202zkx4863sux1pv1u 2466019 2466018 2026-10-09T10:47:11Z Stashbot 7414 ozge@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'llm' for release 'main' . 2466019 wikitext text/x-wiki djorp04y1gw4qh0mof0egjopnmbemzt 2466020 2466019 2026-10-09T10:51:49Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2466020 wikitext text/x-wiki d28o261cu7z35lyiiatpufu3djwhlhb 2466021 2466020 2026-10-09T10:54:50Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2466021 wikitext text/x-wiki t2ebmzxmqd9gflxhpd88aiq1w78pv6p 2466022 2466021 2026-10-09T11:07:56Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'revertrisk' for release 'main' . 2466022 wikitext text/x-wiki jlen9lmaknw42zx1iucnpimbxtk6ilx 2466024 2466022 2026-10-09T11:33:30Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.mysql.clone (exit_code=0) of db2901.codfw.wmnet onto db2902.codfw.wmnet 2466024 wikitext text/x-wiki s3965nfrdpe11yruoc7x93jdvs2eu3a 2466025 2466024 2026-10-09T11:33:44Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.mysql.pool pool db1901: test 2466025 wikitext text/x-wiki pk4725oe7blcv170gjur5nsu6t7bre4 2466026 2466025 2026-10-09T11:33:47Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1901: test 2466026 wikitext text/x-wiki huv7cysirnn2lpqbtzc0bof85jbsy6d 2466027 2466026 2026-10-09T11:35:24Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.mysql.pool pool db1902: test 2466027 wikitext text/x-wiki clhvpgivvc12hvd5pnpn6jx8cxoel5g 2466028 2466027 2026-10-09T11:35:27Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1902: test 2466028 wikitext text/x-wiki 0nk8n9wdrfpdxxymv31ju68giop7r2n 2466029 2466028 2026-10-09T11:35:35Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.mysql.pool pool db1903: test 2466029 wikitext text/x-wiki 3hchcquuo4j3n6pa03qsf1ulilycr9m 2466030 2466029 2026-10-09T11:35:38Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1903: test 2466030 wikitext text/x-wiki nod7144r7a2g77xyispzr3hyyf5f30g 2466031 2466030 2026-10-09T11:37:22Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.mysql.pool pool db2901: test 2466031 wikitext text/x-wiki 0d2yafns1sdxvslipcmbrcydrl3mokx 2466032 2466031 2026-10-09T11:38:18Z Stashbot 7414 fceratto@cumin1004: START - Cookbook sre.mysql.pool pool db2902: test 2466032 wikitext text/x-wiki 9g3wj81h8b5oq2xlgt6co81q62xvm19 2466033 2466032 2026-10-09T11:42:25Z Stashbot 7414 ozge@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'llm' for release 'main' . 2466033 wikitext text/x-wiki ibflxngpx03fa10jm421oivf6bar4lg 2466034 2466033 2026-10-09T11:52:27Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2901: test 2466034 wikitext text/x-wiki q7vfkrxq530rruelgju74ds1kalf5tf 2466035 2466034 2026-10-09T11:53:23Z Stashbot 7414 fceratto@cumin1004: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2902: test 2466035 wikitext text/x-wiki f4vrgc9kba6hp1lmw9slmhnx6bsxjqg 2466037 2466035 2026-10-09T11:56:29Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2466037 wikitext text/x-wiki lkrhwrb3jjrj3a3tt2seci381y4h6k1 2466038 2466037 2026-10-09T11:58:54Z Stashbot 7414 aikochou@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2466038 wikitext text/x-wiki lvissk9lovj9vuk46jss78hzijnnjrg 0 9393 2465709 2465027 2026-10-08T14:36:09Z KHerron (WMF) 10463 /* Rebooting hosts */ 2465709 wikitext text/x-wiki 5prvsqp5ko0kfexxqtf0wrr3s0btpa9 0 17290 2465800 2465060 2026-10-08T16:57:51Z Stashbot 7414 dancy: Restarting buildkitd pods in gitlab-cloud-runners (prod) 2465800 wikitext text/x-wiki 37bxcjy90r5x8eqpeqnj0bm0bxpmygl 2465891 2465800 2026-10-08T23:14:19Z Stashbot 7414 dduvall: registering new trixie based integration-agent-docker-1095 agent with Jenkins 2465891 wikitext text/x-wiki 9ltvnbp1re781j20omz1vm1lbc1vrte 0 22503 2465707 2435205 2026-10-08T14:35:05Z LWatson-WMF 35880 /* Currently reserved values */ Add reserved value for semantic search reader web experiment 2465707 wikitext text/x-wiki gv05idhk3ottqpksdbftofd7z2ka06d 0 221439 2465825 2431254 2026-10-08T18:17:00Z ABaso (WMF) 1044 /* Administration */ temporary wmf_netflow replicaton workaround for space saving 2465825 wikitext text/x-wiki 4im64zajw59fpqynn5of3errcdwfemb 2465826 2465825 2026-10-08T18:38:10Z ABaso (WMF) 1044 /* Temporary reduction of replicants */ case 2465826 wikitext text/x-wiki ix7ofnhdx7jjzp6sta0a4v0zkoh390r 2465827 2465826 2026-10-08T18:40:44Z ABaso (WMF) 1044 /* Temporary reduction of replicants */ case, bolding, remove trailing drafted text 2465827 wikitext text/x-wiki qg70rbxxcemqsx1i6vk6gyzmbnviysb 2465846 2465827 2026-10-08T19:39:26Z ABaso (WMF) 1044 /* Temporary reduction of replicants */ retention time and other options 2465846 wikitext text/x-wiki cyt4v2mrt9qfpzbd3mwbj3yeetsi2sh 0 334461 2466023 2463683 2026-10-09T11:23:55Z MMuhlenhoff (WMF) 5268 /* Rootless production infrastructure */ Remove docs for rootless Cumin 2466023 wikitext text/x-wiki 5wdebv86uh2r7chch0ajzsqc4v148o8 0 443740 2465897 2401052 2026-10-09T00:51:29Z ArielGlenn 11 /* eventgate-main */ update link to config for changeprop -> eventgate 2465897 wikitext text/x-wiki 5i5lny5mbba5wpwtuyuzxnp8ovvzxjc 110 443895 2465727 2439278 2026-10-08T14:45:29Z XCollazo-WMF 31846 XCollazo-WMF moved page [[Mirrors]] to [[Obsolete:Mirrors]]: This service has long been decommissioned, thus having the page on Main namespace is confusing. 2439278 wikitext text/x-wiki f5gor4r9hi336w62fw8igt8m6znfx23 498 443946 2465847 2463807 2026-10-08T19:50:31Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: deployed 772ee56..51c233f: l10n updates (mag) 2465847 wikitext text/x-wiki 8f0d8had0vb9nljxghsjwb0jnrfzm68 498 443947 2465845 2459607 2026-10-08T19:38:26Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: deployed 2578960..9ac1608: l10n updates (mag) 2465845 wikitext text/x-wiki jwpmjam5vuxq8ghbeuyllmt5u6hoiez 498 443949 2465949 2464301 2026-10-09T07:37:27Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 24d9bdd (Update pywikibot from 11.7.0 to latest 11.8.0) 2465949 wikitext text/x-wiki q2wymrj0pylzlcijoqa52en2wzcnwst 2465952 2465949 2026-10-09T07:38:30Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Update pywikibot from 11.7.0 to 11.8.0 in Python 3.11 virtual environment using 'toolforge webservice python3.11 shell' / '/data/project/integraality/www/python/venv/bin/pip install -r /data/project/integraality/integraality/requirements.txt' 2465952 wikitext text/x-wiki rirwa81gpccr8ftdriwudllingyl64z 2465974 2465952 2026-10-09T08:10:34Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 0dd34a2 (Install Python dependencies via Toolforge job on deploy) 2465974 wikitext text/x-wiki bwexhagdmr5knzbvdjpr5mqgh5l5q1r 3 445116 2465918 2072435 2026-10-09T06:04:36Z SSapaty (WMF) 28955 2465918 wikitext text/x-wiki iqu2zdcae3esnoa1swqpb0u1kp0f7ct 0 445760 2465888 2457166 2026-10-08T22:46:09Z ArielGlenn 11 /* Generating the configuration */ fix a copy paste error 2465888 wikitext text/x-wiki kncl37lgfz0bep4uwzj8dzib8lr34yi 2465893 2465888 2026-10-08T23:23:38Z ArielGlenn 11 /* Deploying the configuration */ both volumes are on the changeprop instance, the jobqueue one is gone 2465893 wikitext text/x-wiki iws8f77qdfbylar4xebn8k2vf445lte 0 446944 2465653 2465149 2026-10-08T13:36:41Z Beedell.RokeJulianLockhart 26989 Undid revision [[Special:Diff/2465149|2465149]] by [[Special:Contributions/Floresfavi|Floresfavi]] ([[User talk:Floresfavi|talk]]) 2465653 wikitext text/x-wiki i4vwjbr1ss6302xzqevk6b0lzbfaf75 2465763 2465653 2026-10-08T15:27:28Z Veritas Sapientiae 35887 Reverted edit by [[Special:Contributions/Beedell.RokeJulianLockhart|Beedell.RokeJulianLockhart]] ([[User talk:Beedell.RokeJulianLockhart|talk]]) to last revision by [[User:Floresfavi|Floresfavi]] 2465149 wikitext text/x-wiki phoiac9h4m842xq45sp7s6u21eteeq1 2465764 2465763 2026-10-08T15:27:39Z Veritas Sapientiae 35887 sorry, it was a test 2465653 wikitext text/x-wiki i4vwjbr1ss6302xzqevk6b0lzbfaf75 0 447279 2465946 2202947 2026-10-09T07:35:50Z LToscano (WMF) 7191 /* Intermediate CA */ 2465946 wikitext text/x-wiki lu3kchcwneqq2g2eu87iowle05mmvj4 0 447280 2465942 2453292 2026-10-09T07:34:38Z LToscano (WMF) 7191 /* CLI Interactions */ 2465942 wikitext text/x-wiki i11kv5g7zumsckgdbpdr5t0e4ip22bd 0 447309 2465945 2380868 2026-10-09T07:35:16Z LToscano (WMF) 7191 /* Debugging */ 2465945 wikitext text/x-wiki hq08m1w8plyqlri2xzxupjo81p1r5af 3 447333 2465737 2465267 2026-10-08T14:52:34Z SSapaty (WMF) 28955 /* Toolforge Component Service */ Reply 2465737 wikitext text/x-wiki faj3n39ecvaqg4jvuup1dih539b8ea9 0 447389 2465966 1939199 2026-10-09T08:01:50Z LToscano (WMF) 7191 2465966 wikitext text/x-wiki 20l08r0d001uugshfvvhqz6c0u3qu1h 2465967 2465966 2026-10-09T08:05:16Z JMeybohm (WMF) 16709 2465967 wikitext text/x-wiki hb99tczh75o9pt56ah98fz5wi1n4lyo 0 449160 2465896 2465394 2026-10-09T00:00:34Z Dexbot 30554 Bot: Updating the report 2465896 wikitext text/x-wiki 8wns4uh4fgip2z74b69ggqc02not2ij 0 450684 2465731 2452021 2026-10-08T14:48:07Z Andrew McAllister (WMDE) 36224 Add information on sending emails from devenvs 2465731 wikitext text/x-wiki laj81khge0cpoc6a32k5vvtlrfs9hkd 3 451420 2465919 2269195 2026-10-09T06:10:56Z SSapaty (WMF) 28955 2465919 wikitext text/x-wiki n5s836mwrgrw695cyg0mjq9vktxpexm 0 455989 2465822 2463871 2026-10-08T17:47:37Z CMing (WMF) 23277 /* Launch */ 2465822 wikitext text/x-wiki gsoqmv2rcj103j9lxz2112yafd2r1ld 2465909 2465822 2026-10-09T02:51:19Z CMing (WMF) 23277 /* Enrollment override */ 2465909 wikitext text/x-wiki 6tsfxd65dk3eoy8vphftglzap0xcvez 0 456039 2465910 2452026 2026-10-09T03:07:22Z CMing (WMF) 23277 /* Test */ 2465910 wikitext text/x-wiki 07a7n4coyx3wk4xe5p7f4d0qlkz4ylv 0 456310 2465854 2424538 2026-10-08T20:13:19Z Krinkle 44 restructure information to be less confusing. Previously there were two bullet points. First, IDM unlinked and unbolded. Second, Phab linked and bolded, seemingly drawing attention despite not being the top item. Then followed a list of groups outside IDM heading, requiring a number of back and forths to comprehend the page. The heading also started at H3 instead of H2. 2465854 wikitext text/x-wiki gc07f099nffrh1rsvow8xu5ya29fbzg 2465856 2465854 2026-10-08T20:18:12Z Krinkle 44 /* Wikimedia Identity Management system */ Convert to number list to ease mental progress tracking. Remove redundant "Request new permissions" step since that's essentially the name of the page, there is nothing else there. Rephrase "After ... with Y" into a clear action item. Use bold for quoted headings/menus/buttons/labels to click or find. 2465856 wikitext text/x-wiki g7q4j8phodhugznrtbkwa6uqodfgfjb 0 459699 2465841 2465368 2026-10-08T19:14:13Z Stashbot 7414 damilare: SmashPig upgraded from 31c021ba to 7e3426cf 2465841 wikitext text/x-wiki l3qatvlh766qxqte2d8vd02c9s0zmq1 0 460194 2465976 2464579 2026-10-09T08:15:43Z MLechvien-WMF 49197 Project structure: Adding a note referencing the FAQ for better visibility 2465976 wikitext text/x-wiki 2ivf174kfvv8xakcrgay7l34tyxunc1 2465983 2465976 2026-10-09T08:23:10Z MLechvien-WMF 49197 Number of items: Adding a note referencing the FAQ for better visibility 2465983 wikitext text/x-wiki 812ts99m3e28qwqz7p83uvr3vyovl07 0 460234 2465817 2461452 2026-10-08T17:39:49Z CMing (WMF) 23277 /* How do I…? */ 2465817 wikitext text/x-wiki i2jkk75p1xjxzctjckafw5rn6b2dqiw 0 460344 2465961 2462971 2026-10-09T07:59:00Z MLechvien-WMF 49197 Clarified the answer on the checklist length based on team feedback 2465961 wikitext text/x-wiki hdknhlk5jkcusw9tulrrgeq3rnja9gy 2465971 2465961 2026-10-09T08:09:42Z MLechvien-WMF 49197 Adding one answer on project phases based on feedback 2465971 wikitext text/x-wiki bpwd0z8ba5s601zrsrhhh6ptsbh4gqm 12 460726 2465934 2465464 2026-10-09T06:48:10Z SSapaty (WMF) 28955 2465934 wikitext text/x-wiki haimm5g7iao5wh478dt95rglh1350xn 2465935 2465934 2026-10-09T06:49:56Z SSapaty (WMF) 28955 /* Check the generated configuration */ format terminal session 2465935 wikitext text/x-wiki jfxl6h1le3wfphnbtt7bb13yrd5catx 2465936 2465935 2026-10-09T06:50:16Z SSapaty (WMF) 28955 /* Check the Tool configuration */ format terminal session 2465936 wikitext text/x-wiki s1mubgptfm5novpmutczp28xhe7yubm 2465937 2465936 2026-10-09T06:50:45Z SSapaty (WMF) 28955 /* Check deployment history */ format terminal session 2465937 wikitext text/x-wiki 5ww3lxzg729k0xcs4optoxznf77zonp 2 460731 2465920 2461596 2026-10-09T06:18:43Z SSapaty (WMF) 28955 /* Create the complete tool configuration */ format terminal command 2465920 wikitext text/x-wiki etf4meyia2z1hpqhqwdignvm8zzflj2 2465921 2465920 2026-10-09T06:19:11Z SSapaty (WMF) 28955 /* Inspect the resulting jobs */ format terminal command 2465921 wikitext text/x-wiki 2xzck3llak57x84230mqxum3ntk5ren 2465922 2465921 2026-10-09T06:19:54Z SSapaty (WMF) 28955 /* Inspect the resulting jobs */ format terminal commands 2465922 wikitext text/x-wiki sa9te8flqscme2dsq3340oq5ah8gfeq 2465923 2465922 2026-10-09T06:20:10Z SSapaty (WMF) 28955 /* View the logs */ 2465923 wikitext text/x-wiki 98thhvv5ubwqptim9jraao7pmqm8d09 2465924 2465923 2026-10-09T06:20:36Z SSapaty (WMF) 28955 /* Experiment with the schedule */ 2465924 wikitext text/x-wiki c9llkrhbdzrsuenjyt9rwanuox41rj7 0 460748 2465673 2464757 2026-10-08T13:56:17Z DPogorzelski-WMF 48508 2465673 wikitext text/x-wiki rk1foi9u1cxmofds5lzbsk0vxkl4jk1 2465711 2465673 2026-10-08T14:38:23Z DPogorzelski-WMF 48508 2465711 wikitext text/x-wiki pptaxd16f3lzp3zwdl2dxngzyhvjd4z 0 460773 2465675 2464754 2026-10-08T13:56:44Z DPogorzelski-WMF 48508 2465675 wikitext text/x-wiki 6l3hp9t78l43jtzhod8lr1uy2oowpr0 2465710 2465675 2026-10-08T14:37:28Z DPogorzelski-WMF 48508 2465710 wikitext text/x-wiki ou97jpudga07tva6ahgs2gjips2f36i 2 460786 2465926 2464412 2026-10-09T06:31:26Z SSapaty (WMF) 28955 /* Create an experimental branch */ 2465926 wikitext text/x-wiki 7om8qotc8bpl9gwmmg9qg7f808prl60 2465927 2465926 2026-10-09T06:31:58Z SSapaty (WMF) 28955 /* Create an experimental branch */ 2465927 wikitext text/x-wiki f9fauap143032sfgk88cuwzrh834csj 2465928 2465927 2026-10-09T06:32:45Z SSapaty (WMF) 28955 /* Configure the experimental branch */ 2465928 wikitext text/x-wiki dkcl5yf37nl27sd4izsdvhnm9tqdnmw 2465929 2465928 2026-10-09T06:33:10Z SSapaty (WMF) 28955 /* Point the production configuration to the experimental branch */ 2465929 wikitext text/x-wiki fqumlt5dni4cjr0f2d1tyw47tndfly5 2465930 2465929 2026-10-09T06:33:46Z SSapaty (WMF) 28955 /* Load the experimental configuration */ 2465930 wikitext text/x-wiki 2029qvxd7qvy8lra6li73we24ah5qxf 2465931 2465930 2026-10-09T06:34:11Z SSapaty (WMF) 28955 /* Deploy the experimental branch */ 2465931 wikitext text/x-wiki 7bk5cp6l50lulz4hquowlxux6rtim3k 2465932 2465931 2026-10-09T06:34:52Z SSapaty (WMF) 28955 /* Continue experimenting */ 2465932 wikitext text/x-wiki eogirhbulaquea024e56jisdrxht2s5 2465933 2465932 2026-10-09T06:37:33Z SSapaty (WMF) 28955 /* Restore the default branch */ 2465933 wikitext text/x-wiki t6wbx9mbmlx0d61f9bdnh89ghgrdl7w 0 460791 2465995 2465465 2026-10-09T08:57:49Z GGoncalves-WMF 42848 Add Ben to the working group table. 2465995 wikitext text/x-wiki 0beehvqydvjakq9jaxyylnawoxgiy9x 3 460798 2465659 2026-10-08T13:43:08Z StrikerBot 8475 Welcome to Toolforge! 2465659 wikitext text/x-wiki 90cmm78t953272rmpz2ps4zxs9p6gj7 3 460799 2465664 2026-10-08T13:45:18Z StrikerBot 8475 Welcome to Toolforge! 2465664 wikitext text/x-wiki hr50v2rwf9vdviv1t6ulaaidqqtsvnt 3 460800 2465666 2026-10-08T13:47:38Z StrikerBot 8475 Welcome to Toolforge! 2465666 wikitext text/x-wiki ddxalg03j94z0abyp8rymb2nu9hw1zy 0 460801 2465728 2026-10-08T14:45:29Z XCollazo-WMF 31846 XCollazo-WMF moved page [[Mirrors]] to [[Obsolete:Mirrors]]: This service has long been decommissioned, thus having the page on Main namespace is confusing. 2465728 wikitext text/x-wiki 7mh6uxu1c4u7yk7o8ny8kpb5kel5uc5 3 460802 2466036 2026-10-09T11:54:12Z StrikerBot 8475 Welcome to Toolforge! 2466036 wikitext text/x-wiki 4tgcm11zj7b3qkdcinl7ab7h6ya613e