Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.24 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 3086 2468789 2466286 2026-10-15T12:21:38Z Stashbot 7414 dcaro: restart uwsgi-replica-cnf in tools-nfs-4 as the nginx socket was stall somehow 2468789 wikitext text/x-wiki ochblhwbvfmyoxgcp7t599jd32c0tox 2468840 2468789 2026-10-15T13:16:13Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component replica-cnf 2468840 wikitext text/x-wiki b0fdla4rvl2n51rl4cph0ha0cxfl2lz 2468841 2468840 2026-10-15T13:16:41Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component replica-cnf 2468841 wikitext text/x-wiki c2uw8mlbeqx9xx3cxfns6xy2vsnbsde 2468866 2468841 2026-10-15T13:31:20Z Stashbot 7414 dcaro: deployed the packaged version of replica-cnf 2468866 wikitext text/x-wiki ap90m2nwc39lq2ccgonriticac1kymi 0 4108 2468943 2468534 2026-10-15T14:44:47Z Ejegg 1736 2468943 wikitext text/x-wiki ayqtb6xvj6i9j7evbunmiaq8u78xa9l 2469268 2468943 2026-10-15T19:23:06Z ScheduleDeploymentBot 37566 Add [[gerrit:1355821]] to Thursday, October 15 UTC late backport window 2469268 wikitext text/x-wiki g2hblb58mfurvw7biysejpfc9llkjjx 2469271 2469268 2026-10-15T19:34:12Z ScheduleDeploymentBot 37566 Add [[gerrit:1355831]] to Thursday, October 15 UTC late backport window 2469271 wikitext text/x-wiki 5ikn68eitjwf3faj5airk6zetmuvuat 2469291 2469271 2026-10-15T19:51:51Z Ejegg 1736 Remove self from deploy list - sec team will handle it 2469291 wikitext text/x-wiki gkbpwgja6p60rwy33rfpd6ow4u7vrzi 2469328 2469291 2026-10-15T20:56:10Z ScheduleDeploymentBot 37566 Add [[gerrit:1355871]] to Thursday, October 15 UTC late backport window 2469328 wikitext text/x-wiki ceju3th35oljctmnr033vy78vfswlal 498 6726 2468849 2468732 2026-10-15T13:20:26Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component replica-cnf 2468849 wikitext text/x-wiki mbcpgoyrdih39xtmzh816jopqsxohiv 2468851 2468849 2026-10-15T13:20:48Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component replica-cnf 2468851 wikitext text/x-wiki 1vgjvdlfvcoel5i7ozgcjjoycqhrk2k 2468865 2468851 2026-10-15T13:31:16Z Stashbot 7414 dcaro: deployed the packaged version of replica-cnf 2468865 wikitext text/x-wiki 8zy4p0u3omfj0d1onhrgdgiexg4u3xg 0 7919 2468773 2468772 2026-10-15T12:00:46Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2193', diff saved to https://phabricator.wikimedia.org/P96696 and previous config saved to /var/cache/conftool/dbconfig/20261015-120044-marostegui.json 2468773 wikitext text/x-wiki 60r4zl3ei0imlvuq09actcdn35ngibt 2468774 2468773 2026-10-15T12:08:08Z Stashbot 7414 cmooney@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 19 hosts with reason: upgrade ssw1-d8-eqiad 2468774 wikitext text/x-wiki hwfsm3p5nq695huvln3q1jkjdojhwwf 2468775 2468774 2026-10-15T12:08:44Z Stashbot 7414 cmooney@cumin1004: DONE (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 1:00:00 on ssw1-c1-eqiad with reason: upgrade ssw1-d8-eqiad 2468775 wikitext text/x-wiki 6l70q3now87pkjr5s8y5dhgd3euh8e7 2468776 2468775 2026-10-15T12:09:53Z Stashbot 7414 cmooney@cumin1004: DONE (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 1:00:00 on lsw1-c1-eqiad with reason: upgrade ssw1-d8-eqiad 2468776 wikitext text/x-wiki ddy5pkb0kutfg509c124v1z7k3mgv6b 2468787 2468776 2026-10-15T12:15:48Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2193', diff saved to https://phabricator.wikimedia.org/P96697 and previous config saved to /var/cache/conftool/dbconfig/20261015-121546-marostegui.json 2468787 wikitext text/x-wiki 4woi3z1e4xzi1183mywhbsc9z4ej7ci 2468788 2468787 2026-10-15T12:18:49Z Stashbot 7414 topranks: reboot ssw1-d8-eqiad to upgrade SR-Linux on it T431745 2468788 wikitext text/x-wiki qwpvbtmiomwe092uqiysnl0r74zp15b 2468793 2468788 2026-10-15T12:30:51Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2193 (T441197)', diff saved to https://phabricator.wikimedia.org/P96698 and previous config saved to /var/cache/conftool/dbconfig/20261015-123048-marostegui.json 2468793 wikitext text/x-wiki hf7ikrgqpvaxh2uegrcqdywyaa9weaa 2468794 2468793 2026-10-15T12:31:06Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2197.codfw.wmnet with reason: Maintenance 2468794 wikitext text/x-wiki b3n9f86rn6etb6awoxolda96ndukmjf 2468795 2468794 2026-10-15T12:31:16Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2214.codfw.wmnet with reason: Maintenance 2468795 wikitext text/x-wiki 4d3avo2cw6id4bziy19uh84ra5qcnqa 2468796 2468795 2026-10-15T12:31:25Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Depooling db2214 (T441197)', diff saved to https://phabricator.wikimedia.org/P96699 and previous config saved to /var/cache/conftool/dbconfig/20261015-123116-marostegui.json 2468796 wikitext text/x-wiki 5dp2lnpalg71usbtq9t43xc9oxl56d8 2468797 2468796 2026-10-15T12:33:28Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2214 (T441197)', diff saved to https://phabricator.wikimedia.org/P96700 and previous config saved to /var/cache/conftool/dbconfig/20261015-123325-marostegui.json 2468797 wikitext text/x-wiki jat0h43kgtvt7sul5lscprf0z53eybw 2468798 2468797 2026-10-15T12:34:52Z Stashbot 7414 dpogorzelski@cumin1004: conftool action : set/pooled=false; selector: dnsdisc=inference,name=eqiad 2468798 wikitext text/x-wiki e9hz0i4yvs4tshvm9cbdj7bvy64ctal 2468799 2468798 2026-10-15T12:34:57Z Stashbot 7414 dpogorzelski@cumin1004: conftool action : set/pooled=false; selector: dnsdisc=k8s-ingress-ml-serve,name=eqiad 2468799 wikitext text/x-wiki bkwemckkhbd2pp23v0rrb9adxany5il 2468800 2468799 2026-10-15T12:35:02Z Stashbot 7414 dpogorzelski@cumin1004: conftool action : set/pooled=true; selector: dnsdisc=k8s-ingress-ml-serve,name=eqiad 2468800 wikitext text/x-wiki 01nbmcknj5q737pcd4tpxuuswwfe828 2468801 2468800 2026-10-15T12:35:09Z Stashbot 7414 dpogorzelski@cumin1004: conftool action : set/pooled=true; selector: dnsdisc=inference,name=eqiad 2468801 wikitext text/x-wiki 4a2zg01wlwfx826a40xk80kha8g6b3r 2468802 2468801 2026-10-15T12:35:16Z Stashbot 7414 dpogorzelski@cumin1004: conftool action : set/pooled=false; selector: dnsdisc=inference,name=codfw 2468802 wikitext text/x-wiki 36hhdnj9ljeck4y3bh03b7ee7jrjx24 2468803 2468802 2026-10-15T12:35:28Z Stashbot 7414 dpogorzelski@cumin1004: conftool action : set/pooled=false; selector: dnsdisc=k8s-ingress-ml-serve,name=codfw 2468803 wikitext text/x-wiki irt6ml1h33zpbfvcn2fn7fyb52mtmm5 2468804 2468803 2026-10-15T12:35:40Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-serve-codfw] START helmfile.d/admin 'sync'. 2468804 wikitext text/x-wiki 1lksud2f0077o9m3dmn0h7a4udjacqa 2468805 2468804 2026-10-15T12:38:23Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-serve-codfw] DONE helmfile.d/admin 'sync'. 2468805 wikitext text/x-wiki hkzzp5sgdxw98qdyozjuhzjjzym3fdh 2468806 2468805 2026-10-15T12:39:15Z Stashbot 7414 dpogorzelski@cumin1004: conftool action : set/pooled=true; selector: dnsdisc=k8s-ingress-ml-serve,name=codfw 2468806 wikitext text/x-wiki ktu9460r1o8vdpybfhvo6ef1mtea5aa 2468807 2468806 2026-10-15T12:39:20Z Stashbot 7414 dpogorzelski@cumin1004: conftool action : set/pooled=true; selector: dnsdisc=inference,name=codfw 2468807 wikitext text/x-wiki pjffeuddgoqeh1gcl3ifchglfwhnjkl 2468808 2468807 2026-10-15T12:40:21Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. 2468808 wikitext text/x-wiki jrh69klm16qii0oqfm8uxf35z6goqz9 2468809 2468808 2026-10-15T12:41:58Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. 2468809 wikitext text/x-wiki 5dvqgl6crvipedrpvqg01fr9rxkwbgu 2468810 2468809 2026-10-15T12:48:28Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2214', diff saved to https://phabricator.wikimedia.org/P96701 and previous config saved to /var/cache/conftool/dbconfig/20261015-124826-marostegui.json 2468810 wikitext text/x-wiki jzsfv2q5i58t5405wbqbxmre2o3qt59 2468811 2468810 2026-10-15T12:51:53Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1331.eqiad.wmnet 2468811 wikitext text/x-wiki orksoe9rnc0ta7nxhu02wufafk4lz0x 2468812 2468811 2026-10-15T12:51:58Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1331.eqiad.wmnet 2468812 wikitext text/x-wiki a63d6wfr8s1i46sjmm3c3zwrmwbhorj 2468813 2468812 2026-10-15T12:52:07Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1332.eqiad.wmnet 2468813 wikitext text/x-wiki exf8micx5dm376nlwg1l9xs85uyzz7k 2468814 2468813 2026-10-15T12:52:14Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1332.eqiad.wmnet 2468814 wikitext text/x-wiki 3wg3onwe6g18p8dys3943e620akdlw1 2468815 2468814 2026-10-15T12:52:42Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1333.eqiad.wmnet 2468815 wikitext text/x-wiki c7ogh9tcy6g7pl5c7b0xevo6kbrwzs0 2468816 2468815 2026-10-15T12:52:48Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1333.eqiad.wmnet 2468816 wikitext text/x-wiki 2qx1pd3djpxoa475izn6q69dwgl6j1h 2468817 2468816 2026-10-15T12:52:57Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1334.eqiad.wmnet 2468817 wikitext text/x-wiki gy33lue8zmqvqcnzxtir29vpqfg5492 2468818 2468817 2026-10-15T12:53:07Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1334.eqiad.wmnet 2468818 wikitext text/x-wiki keyt60pf3rczelwrbyl1h5m6n4zwvjw 2468819 2468818 2026-10-15T12:58:52Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2316.codfw.wmnet 2468819 wikitext text/x-wiki q6jcttcfggys94y4iohbi1hs3sdpwow 2468820 2468819 2026-10-15T12:58:57Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2316.codfw.wmnet 2468820 wikitext text/x-wiki 1368tvzgbpe2amyghaxuqfs6qry8m0s 2468821 2468820 2026-10-15T12:59:07Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2317.codfw.wmnet 2468821 wikitext text/x-wiki q6l1koapu6kpw72ab607hbcnlhy3xmf 2468822 2468821 2026-10-15T12:59:41Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2317.codfw.wmnet 2468822 wikitext text/x-wiki po6anzwto143c7ltt1vfse3vn1q66oj 2468823 2468822 2026-10-15T13:00:01Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2317.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2468823 wikitext text/x-wiki 7z11oaqoitxss3r8gs3h5f280vzfjtp 2468824 2468823 2026-10-15T13:00:44Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.hosts.reimage for host wikikube-worker1298.eqiad.wmnet with OS bookworm 2468824 wikitext text/x-wiki 9h2bkaneu5th0a9m1jhnjq1939lyr5n 2468827 2468824 2026-10-15T13:03:30Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2214', diff saved to https://phabricator.wikimedia.org/P96702 and previous config saved to /var/cache/conftool/dbconfig/20261015-130328-marostegui.json 2468827 wikitext text/x-wiki 2u4y6d8430vq30mxff5txw39ed1hrh7 2468828 2468827 2026-10-15T13:05:22Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2317.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2468828 wikitext text/x-wiki fs813z8zzv5tz3hy5t9ujj3luarvcaa 2468829 2468828 2026-10-15T13:05:49Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2317.codfw.wmnet 2468829 wikitext text/x-wiki f3ql21izfexyl6x6cu1n6w51r02ktas 2468830 2468829 2026-10-15T13:06:44Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2317.codfw.wmnet 2468830 wikitext text/x-wiki ez0c63mkzb7cmzorbbsix9r1nl8pq30 2468831 2468830 2026-10-15T13:06:58Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2318.codfw.wmnet 2468831 wikitext text/x-wiki iv89b9gcpsz61u16rxkm3805xklqkjo 2468832 2468831 2026-10-15T13:07:32Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2318.codfw.wmnet 2468832 wikitext text/x-wiki b7z72a0a65r44rb8sn5b5v5t1md1fc3 2468833 2468832 2026-10-15T13:07:53Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2318.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2468833 wikitext text/x-wiki hi4jiymf6dw71o0eqlupjaqny4zqeke 2468834 2468833 2026-10-15T13:13:12Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2318.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2468834 wikitext text/x-wiki fj8wy3xtt6bp32p9bykn5mt0pght1h1 2468835 2468834 2026-10-15T13:13:30Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2318.codfw.wmnet 2468835 wikitext text/x-wiki ejbvxtcl0c34c60ih4hgurhfn5c6bqo 2468836 2468835 2026-10-15T13:14:48Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2318.codfw.wmnet 2468836 wikitext text/x-wiki jy7pryyjang31bob2ktk63j3gpy4g6c 2468837 2468836 2026-10-15T13:15:01Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2319.codfw.wmnet 2468837 wikitext text/x-wiki nevy32699kxexdon0ckndldgqckzg6i 2468838 2468837 2026-10-15T13:15:35Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2319.codfw.wmnet 2468838 wikitext text/x-wiki q4rzjrfhb9p66ykfqtctrmmcml9bw9t 2468839 2468838 2026-10-15T13:15:54Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2319.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2468839 wikitext text/x-wiki dztimkf0242jjg746wj2w1khsogvfkd 2468842 2468839 2026-10-15T13:18:34Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2214 (T441197)', diff saved to https://phabricator.wikimedia.org/P96703 and previous config saved to /var/cache/conftool/dbconfig/20261015-131831-marostegui.json 2468842 wikitext text/x-wiki goph50mn8jxa867lrrxc1yzl1fbatgf 2468843 2468842 2026-10-15T13:18:48Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2217.codfw.wmnet with reason: Maintenance 2468843 wikitext text/x-wiki 6t3czty5qemgo2sc99tuhnsqbfreoxr 2468844 2468843 2026-10-15T13:18:59Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Depooling db2217 (T441197)', diff saved to https://phabricator.wikimedia.org/P96704 and previous config saved to /var/cache/conftool/dbconfig/20261015-131848-marostegui.json 2468844 wikitext text/x-wiki dxhfr5jni4g4ym5i3ge764efoqf7aml 2468845 2468844 2026-10-15T13:19:40Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.enable_virtualization rolling provision on D{wikikube-worker[1330-1349].eqiad.wmnet} and (A:wikikube-master-eqiad or A:wikikube-worker-eqiad) 2468845 wikitext text/x-wiki 2oqnijvahd6k3ydxogpffhnd8btece3 2468846 2468845 2026-10-15T13:19:47Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1335.eqiad.wmnet 2468846 wikitext text/x-wiki ku7b8a2p3v4qg1ub93a14phd58hvvbb 2468847 2468846 2026-10-15T13:19:59Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2217 (T441197)', diff saved to https://phabricator.wikimedia.org/P96705 and previous config saved to /var/cache/conftool/dbconfig/20261015-131956-marostegui.json 2468847 wikitext text/x-wiki mjcdv8ifoy2bo40ik13lts27z8d7kqz 2468848 2468847 2026-10-15T13:20:18Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1335.eqiad.wmnet 2468848 wikitext text/x-wiki miz531iyzfvh35d44rkhyvre0vnacjk 2468850 2468848 2026-10-15T13:20:38Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1335.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2468850 wikitext text/x-wiki 0b4kw93kep0vfk048v4817xke36nmod 2468852 2468850 2026-10-15T13:21:14Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2319.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2468852 wikitext text/x-wiki embjdtmgoqq7klbwyxtb6yw4bm7s70o 2468853 2468852 2026-10-15T13:21:20Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2319.codfw.wmnet 2468853 wikitext text/x-wiki f42knmahe6wd2gw2luexqepv12v5z3y 2468854 2468853 2026-10-15T13:22:32Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2319.codfw.wmnet 2468854 wikitext text/x-wiki s0ol9m9xjyktjrgkqsavwnakzv81kgp 2468855 2468854 2026-10-15T13:22:46Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2320.codfw.wmnet 2468855 wikitext text/x-wiki d1e8idtmqtnijzrw5d5nsj1bcdno6k1 2468856 2468855 2026-10-15T13:23:21Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2320.codfw.wmnet 2468856 wikitext text/x-wiki gppuivv3tb8wcuagaq8hwzdiszri5qn 2468857 2468856 2026-10-15T13:23:42Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2320.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2468857 wikitext text/x-wiki nkx8xh4etzh1ee8di6ntqa3zmzr4xbj 2468858 2468857 2026-10-15T13:26:39Z Stashbot 7414 isaranto@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2468858 wikitext text/x-wiki nofqw10wm2xf8b4u7jrb821wpx6o2q3 2468859 2468858 2026-10-15T13:27:15Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1335.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2468859 wikitext text/x-wiki iiadke2g728e3lqacbxqr3zzi1b30rt 2468860 2468859 2026-10-15T13:29:01Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2320.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2468860 wikitext text/x-wiki 5qjsh13bs2bq9e7y8g1t7jx6a6rspel 2468861 2468860 2026-10-15T13:29:30Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2320.codfw.wmnet 2468861 wikitext text/x-wiki 8egcwsw1hqkmm23tn22htg66cpsebd9 2468862 2468861 2026-10-15T13:29:43Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2320.codfw.wmnet 2468862 wikitext text/x-wiki qng8sncil81mvt0f687c39i5xn5hcam 2468863 2468862 2026-10-15T13:29:48Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.enable_virtualization (exit_code=0) rolling provision on D{wikikube-worker[2293-2320].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) 2468863 wikitext text/x-wiki oal0yts5ajebjf8cjp6wm71h1r309ud 2468867 2468863 2026-10-15T13:35:00Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2217', diff saved to https://phabricator.wikimedia.org/P96706 and previous config saved to /var/cache/conftool/dbconfig/20261015-133458-marostegui.json 2468867 wikitext text/x-wiki f4g9d5yjx8d7ulmhk6k5ym6j9vyaqk8 2468871 2468867 2026-10-15T13:38:12Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1335.eqiad.wmnet 2468871 wikitext text/x-wiki ffrmlu45812drw6l1tzpp4pqmxfjywv 2468872 2468871 2026-10-15T13:38:22Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1335.eqiad.wmnet 2468872 wikitext text/x-wiki 4iv9c5y780j6ep88vlkv5hean4nevbo 2468873 2468872 2026-10-15T13:38:28Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1336.eqiad.wmnet 2468873 wikitext text/x-wiki olu2tt5vbzfg4yc52trx7g34wam7ljg 2468874 2468873 2026-10-15T13:39:03Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1336.eqiad.wmnet 2468874 wikitext text/x-wiki o5iosm0l71u925oh8jpiempeemx775o 2468875 2468874 2026-10-15T13:39:22Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1336.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2468875 wikitext text/x-wiki 6pt82hjonlw7ony8tsorgdubm5l07c0 2468876 2468875 2026-10-15T13:41:23Z Stashbot 7414 moritzm: installing unbound security updates 2468876 wikitext text/x-wiki sy9eszlsus5ggyhwhoojskhot1f5b49 2468877 2468876 2026-10-15T13:45:58Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1336.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2468877 wikitext text/x-wiki 3mnm8wn0kilb03r4e2diefdro990k03 2468880 2468877 2026-10-15T13:48:51Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Started scap sync-world: Backport for [[gerrit:1355197|Remove eduction namespaces from Ukrainian Wikipedia (T441045)]], [[gerrit:1355198|Add rollbacker user group to krcwiki (T440898)]] 2468880 wikitext text/x-wiki s5fbga8i71bjabbmfkps8czu1961yp6 2468881 2468880 2026-10-15T13:50:02Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2217', diff saved to https://phabricator.wikimedia.org/P96707 and previous config saved to /var/cache/conftool/dbconfig/20261015-135000-marostegui.json 2468881 wikitext text/x-wiki iderdfwx1cak7q216auntnrpwom2p7i 2468882 2468881 2026-10-15T13:52:59Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: codenamenoreste, lucaswerkmeister-wmde: Backport for [[gerrit:1355197|Remove eduction namespaces from Ukrainian Wikipedia (T441045)]], [[gerrit:1355198|Add rollbacker user group to krcwiki (T440898)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2468882 wikitext text/x-wiki dm3xpvjp8b4olruk6ckroapnxpv4kg0 2468883 2468882 2026-10-15T13:56:57Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: codenamenoreste, lucaswerkmeister-wmde: Continuing with deployment 2468883 wikitext text/x-wiki 0tgtujlrl7qiwxyzgg213myby0mdwaq 2468884 2468883 2026-10-15T13:58:29Z Stashbot 7414 ebernhardson@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-semantic-search-ssd: apply 2468884 wikitext text/x-wiki 15jvmnf7j2dm3139ofrfxuxwliynu9t 2468885 2468884 2026-10-15T13:58:36Z Stashbot 7414 ebernhardson@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search-ssd: apply 2468885 wikitext text/x-wiki euhjtlf7c4u7nmfomus83051c1o8eow 2468886 2468885 2026-10-15T14:01:29Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1336.eqiad.wmnet 2468886 wikitext text/x-wiki ex83lz71337wfcr033opi7c039u2xd1 2468887 2468886 2026-10-15T14:01:39Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1336.eqiad.wmnet 2468887 wikitext text/x-wiki bi04h7tr7hz0cowolpx9idbqs0dw2lp 2468888 2468887 2026-10-15T14:01:46Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1337.eqiad.wmnet 2468888 wikitext text/x-wiki i0h61l06ubabzys8vfko0tufult7tby 2468889 2468888 2026-10-15T14:02:26Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Finished scap sync-world: Backport for [[gerrit:1355197|Remove eduction namespaces from Ukrainian Wikipedia (T441045)]], [[gerrit:1355198|Add rollbacker user group to krcwiki (T440898)]] (duration: 13m 35s) 2468889 wikitext text/x-wiki kp3dy5acnswshzdmzexp78hzlwdc0x3 2468890 2468889 2026-10-15T14:02:37Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: mwscript-k8s job started: cleanupTitles ukwiki # T441045 (expecting no results but running just in case) 2468890 wikitext text/x-wiki 4sa8wn33atpsluejps4vypfnobjql3g 2468891 2468890 2026-10-15T14:02:51Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1337.eqiad.wmnet 2468891 wikitext text/x-wiki bu1uloktrbcmtbs7x2vz39i04fmwyrd 2468892 2468891 2026-10-15T14:03:14Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1337.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2468892 wikitext text/x-wiki 0rtvxqa71lmaelfevbnknl757fj4nmt 2468893 2468892 2026-10-15T14:04:36Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-sre: apply 2468893 wikitext text/x-wiki 8z00c6lap5y2xwozokxu4owtaxiqstb 2468894 2468893 2026-10-15T14:04:49Z Stashbot 7414 marostegui: Drop ce_worklist_articles from wikisharede testwiki test2wiki officewiki T441263 2468894 wikitext text/x-wiki r01myu0c9kpvl3pi23tk6csumjojzlg 2468895 2468894 2026-10-15T14:05:05Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2217 (T441197)', diff saved to https://phabricator.wikimedia.org/P96708 and previous config saved to /var/cache/conftool/dbconfig/20261015-140502-marostegui.json 2468895 wikitext text/x-wiki 9xj0p5twoobsphryvnid46j3gbbs4m3 2468896 2468895 2026-10-15T14:05:19Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2224.codfw.wmnet with reason: Maintenance 2468896 wikitext text/x-wiki 0g2sgcpdabi8tjw3imy9exmivq5yskp 2468897 2468896 2026-10-15T14:05:26Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Depooling db2224 (T441197)', diff saved to https://phabricator.wikimedia.org/P96709 and previous config saved to /var/cache/conftool/dbconfig/20261015-140520-marostegui.json 2468897 wikitext text/x-wiki 0b8l6sjtgvsf0n83d0b5i4e2alm9kvb 2468898 2468897 2026-10-15T14:05:34Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-sre: apply 2468898 wikitext text/x-wiki r9yowthxncwaj5k9sno7vqv1h3pq80v 2468899 2468898 2026-10-15T14:06:31Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2224 (T441197)', diff saved to https://phabricator.wikimedia.org/P96710 and previous config saved to /var/cache/conftool/dbconfig/20261015-140628-marostegui.json 2468899 wikitext text/x-wiki dlv1davrgi41ofvftrcj5mrikyyiy15 2468900 2468899 2026-10-15T14:09:50Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1337.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2468900 wikitext text/x-wiki 3cqefyxy8m1nvvwmanvduqjzb7s14rt 2468901 2468900 2026-10-15T14:10:00Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-sre: apply 2468901 wikitext text/x-wiki meqfpkyy034b3pjqs0l2iozih3oqub8 2468902 2468901 2026-10-15T14:10:29Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-sre: apply 2468902 wikitext text/x-wiki 3ihife3vzw71y13yz1acq248cw00aly 2468903 2468902 2026-10-15T14:11:08Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1337.eqiad.wmnet 2468903 wikitext text/x-wiki hmz04v1xh27vvkqtt9tf8gy480rdldq 2468904 2468903 2026-10-15T14:11:17Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1337.eqiad.wmnet 2468904 wikitext text/x-wiki 5wmhmpmxxlxv3cmyvx4soowdn302wls 2468905 2468904 2026-10-15T14:11:27Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1338.eqiad.wmnet 2468905 wikitext text/x-wiki gytafn5wh40wff4t54qx862atxxp2sf 2468906 2468905 2026-10-15T14:11:56Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1338.eqiad.wmnet 2468906 wikitext text/x-wiki d10hnxx7fq3o6coz8c2dyn3xo7t1mlx 2468907 2468906 2026-10-15T14:12:15Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1338.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2468907 wikitext text/x-wiki l07qvvcy3rqmbtmrlr9e62b1gfx047a 2468908 2468907 2026-10-15T14:18:01Z Stashbot 7414 ladsgroup@deploy1003: Started scap sync-world: Backport for [[gerrit:1355665|Undeploy FR from enwikibooks (T440519)]] 2468908 wikitext text/x-wiki 72u1r15th0fgu2hybc1ccb587osel93 2468909 2468908 2026-10-15T14:18:51Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1338.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2468909 wikitext text/x-wiki 7s13pu6zb6olssman5vuy0tqvbcpq19 2468910 2468909 2026-10-15T14:21:31Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2224', diff saved to https://phabricator.wikimedia.org/P96711 and previous config saved to /var/cache/conftool/dbconfig/20261015-142130-marostegui.json 2468910 wikitext text/x-wiki muf5xj3mu2gut6wdarzhgmh92nf73di 2468911 2468910 2026-10-15T14:22:04Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup: Backport for [[gerrit:1355665|Undeploy FR from enwikibooks (T440519)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2468911 wikitext text/x-wiki oak9hdd5ftrq263zy1amehifwdigeuk 2468912 2468911 2026-10-15T14:24:09Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup: Continuing with deployment 2468912 wikitext text/x-wiki 228lcg21zyoo3ulnv06g7n80xfeh70d 2468913 2468912 2026-10-15T14:29:33Z Stashbot 7414 ladsgroup@deploy1003: Finished scap sync-world: Backport for [[gerrit:1355665|Undeploy FR from enwikibooks (T440519)]] (duration: 11m 32s) 2468913 wikitext text/x-wiki 07qqmatiqzp6y60kh48t433tuo5kf5z 2468914 2468913 2026-10-15T14:29:49Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1338.eqiad.wmnet 2468914 wikitext text/x-wiki 93jhtopc2vkd321cso6ndjqw5vn96k4 2468915 2468914 2026-10-15T14:29:55Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1338.eqiad.wmnet 2468915 wikitext text/x-wiki f065gl24yjzkr6ac1pn1dclttr4qiq8 2468916 2468915 2026-10-15T14:30:01Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.enable_virtualization rolling provision on D{wikikube-worker[2321-2340].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) 2468916 wikitext text/x-wiki qd1dbaksfcs2qn2zyj2e2nwq1rf8791 2468917 2468916 2026-10-15T14:30:13Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1339.eqiad.wmnet 2468917 wikitext text/x-wiki 6ms5byhzd9fp3c7ofkis31j3px8bkqw 2468918 2468917 2026-10-15T14:30:20Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2321.codfw.wmnet 2468918 wikitext text/x-wiki fkshkom12uxymr1u3cwtal6qs8f67ty 2468919 2468918 2026-10-15T14:30:38Z Stashbot 7414 ladsgroup@deploy1003: Started scap sync-world: Backport for [[gerrit:1355120|Bump APCu expiry from 10s to 60s (T440885)]] (1.47.0-wmf.24) 2468919 wikitext text/x-wiki 8ahoi2dysllruv08s2popp8eeb0i9lz 2468920 2468919 2026-10-15T14:30:45Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1339.eqiad.wmnet 2468920 wikitext text/x-wiki ncrfrfaq44c0ydtyarpjy1n47411qvc 2468921 2468920 2026-10-15T14:30:51Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2321.codfw.wmnet 2468921 wikitext text/x-wiki hj7rybg3yfyolf8n07g8jr9o1l7q2f9 2468922 2468921 2026-10-15T14:30:57Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1339.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2468922 wikitext text/x-wiki oo9c1a8t2fmcbfo0xy1ub6e2yzz13yu 2468923 2468922 2026-10-15T14:31:02Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2321.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2468923 wikitext text/x-wiki 9s8wew62hkgyg0sy4mlze7tctm1ayid 2468924 2468923 2026-10-15T14:34:44Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup, krinkle: Backport for [[gerrit:1355120|Bump APCu expiry from 10s to 60s (T440885)]] (1.47.0-wmf.24) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2468924 wikitext text/x-wiki e99a2adsz8uedauidwnkc99w7msl763 2468925 2468924 2026-10-15T14:35:15Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup, krinkle: Continuing with deployment 2468925 wikitext text/x-wiki r06znnaul8a0z6pbi91fyqmiycibk3n 2468926 2468925 2026-10-15T14:36:20Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2321.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2468926 wikitext text/x-wiki thdrzuyjvsnywydcviypj9qndgm7eem 2468927 2468926 2026-10-15T14:36:32Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2321.codfw.wmnet 2468927 wikitext text/x-wiki 9wvcguyghoc1ixwqul5h0xjxen2xh97 2468928 2468927 2026-10-15T14:36:40Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2224', diff saved to https://phabricator.wikimedia.org/P96712 and previous config saved to /var/cache/conftool/dbconfig/20261015-143632-marostegui.json 2468928 wikitext text/x-wiki n6nofuvkte93fbex4olvft9bpmcjba9 2468929 2468928 2026-10-15T14:37:33Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1339.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2468929 wikitext text/x-wiki s6xdgz6yrqmj5kns50b435xfivfswj3 2468930 2468929 2026-10-15T14:37:56Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2321.codfw.wmnet 2468930 wikitext text/x-wiki km3yvfrv32z0h7m6ao4pfzxc75kp4rk 2468931 2468930 2026-10-15T14:38:09Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2322.codfw.wmnet 2468931 wikitext text/x-wiki 7az4s9tqk5zdjra2idqciubs9k1p8k8 2468932 2468931 2026-10-15T14:38:43Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2322.codfw.wmnet 2468932 wikitext text/x-wiki pp1jdzso6g0zkpz38ic8gv10cbvt70d 2468933 2468932 2026-10-15T14:39:04Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2322.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2468933 wikitext text/x-wiki 5km0ag4qt84c22faiq8rsgzdgkh70t1 2468934 2468933 2026-10-15T14:39:11Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1339.eqiad.wmnet 2468934 wikitext text/x-wiki as56s2nbrsi7sv6y4sa8qxcidlssogk 2468935 2468934 2026-10-15T14:39:19Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1339.eqiad.wmnet 2468935 wikitext text/x-wiki syeio992rmvz6t64rjcojh3jgpq9bhd 2468936 2468935 2026-10-15T14:39:26Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1340.eqiad.wmnet 2468936 wikitext text/x-wiki 9bo3i9nplqd3z24616nrd3fhjnc5fgm 2468937 2468936 2026-10-15T14:39:59Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1340.eqiad.wmnet 2468937 wikitext text/x-wiki qp3xd5ri42ove3n9cqoszx6s397a064 2468938 2468937 2026-10-15T14:40:18Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1340.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2468938 wikitext text/x-wiki 4tbwliarhx8mwq2m3b6d7b3cxosn13y 2468939 2468938 2026-10-15T14:40:34Z Stashbot 7414 ladsgroup@deploy1003: Finished scap sync-world: Backport for [[gerrit:1355120|Bump APCu expiry from 10s to 60s (T440885)]] (1.47.0-wmf.24) (duration: 09m 57s) 2468939 wikitext text/x-wiki 25mdh4h531v95b3xbouxso94i2eslyf 2468940 2468939 2026-10-15T14:43:33Z Stashbot 7414 XioNoX: uploaded spicerack_14.0.0 to apt.wikimedia.org bookworm-wikimedia,trixie-wikimedia 2468940 wikitext text/x-wiki 8b7osugwgphzfztbxbomdlcoiq3ozi3 2468941 2468940 2026-10-15T14:44:22Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2322.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2468941 wikitext text/x-wiki h2q25wesvg2a6p6rj28zgcvmeevggj4 2468942 2468941 2026-10-15T14:44:29Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2322.codfw.wmnet 2468942 wikitext text/x-wiki ku90z7h65z63l6qjoxpanw5ywjalroq 2468944 2468942 2026-10-15T14:45:22Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2322.codfw.wmnet 2468944 wikitext text/x-wiki svxjktu62k6uavp9bko4hdkydq1tcpd 2468945 2468944 2026-10-15T14:45:36Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2323.codfw.wmnet 2468945 wikitext text/x-wiki g6g1djl2c736pp9swyo2ohl9l2rdjzj 2468946 2468945 2026-10-15T14:46:13Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2323.codfw.wmnet 2468946 wikitext text/x-wiki dkgjb0yfmop6bucfsy0qm3h0d3q853f 2468947 2468946 2026-10-15T14:46:24Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2323.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2468947 wikitext text/x-wiki cvrj0pm1lylctqgzrcimwy0b0hgrd74 2468948 2468947 2026-10-15T14:46:55Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1340.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2468948 wikitext text/x-wiki tsh2ilu9d0brujzj02o1hpsuuq4z32v 2468949 2468948 2026-10-15T14:48:13Z Stashbot 7414 topranks: enable BGP peerings to new spine switches eqiad rows A/B 2468949 wikitext text/x-wiki 5ixjzd9385n3vthop04tmo73y0t7tvo 2468950 2468949 2026-10-15T14:50:30Z Stashbot 7414 papaul: start maintenance on mr1-codfw 2468950 wikitext text/x-wiki d3rh1dx2yww9hkqqzc33q6rb884vhvq 2468951 2468950 2026-10-15T14:51:37Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2224 (T441197)', diff saved to https://phabricator.wikimedia.org/P96713 and previous config saved to /var/cache/conftool/dbconfig/20261015-145134-marostegui.json 2468951 wikitext text/x-wiki o0xkxcj7erotgswfmq2qgomwxbmanph 2468952 2468951 2026-10-15T14:51:42Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2323.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2468952 wikitext text/x-wiki egspa7lrdlzp904ge387x6vqwlzko0d 2468953 2468952 2026-10-15T14:51:51Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2323.codfw.wmnet 2468953 wikitext text/x-wiki rf49k4d7n8ncuewhxc1713lake0f9yq 2468954 2468953 2026-10-15T14:51:59Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2229.codfw.wmnet with reason: Maintenance 2468954 wikitext text/x-wiki 3tz3mnm7hypr7rs94fd8a2m0p9o148v 2468955 2468954 2026-10-15T14:52:28Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2323.codfw.wmnet 2468955 wikitext text/x-wiki ojl5m1axs7wncdm7kxxt92r74med91c 2468956 2468955 2026-10-15T14:52:42Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2324.codfw.wmnet 2468956 wikitext text/x-wiki ismaf1eeug4hfc4u5urqczh5mellou0 2468957 2468956 2026-10-15T14:53:16Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2324.codfw.wmnet 2468957 wikitext text/x-wiki 1f6klndpu5g9mye2p1vkjkufvhra6hn 2468958 2468957 2026-10-15T14:53:37Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2324.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2468958 wikitext text/x-wiki mert8347i0p1blfvv12ncrqzicwayog 2468959 2468958 2026-10-15T14:54:20Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1165.eqiad.wmnet with reason: Maintenance 2468959 wikitext text/x-wiki glpn7mkbxrpk7i383yxj31qpucdldij 2468960 2468959 2026-10-15T14:54:38Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1168.eqiad.wmnet with reason: Maintenance 2468960 wikitext text/x-wiki npqkvz9bffofme6xw2qxp7uuyxbbdgj 2468961 2468960 2026-10-15T14:54:56Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1187.eqiad.wmnet with reason: Maintenance 2468961 wikitext text/x-wiki nxjghjb7bi5aspsq52rbcnl0o57hs8s 2468962 2468961 2026-10-15T14:55:19Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1201.eqiad.wmnet with reason: Maintenance 2468962 wikitext text/x-wiki hizz6otod3qu0eugpvwfwdoaahw13ft 2468963 2468962 2026-10-15T14:55:39Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1225.eqiad.wmnet with reason: Maintenance 2468963 wikitext text/x-wiki ipfswue889jwd385wq0izqa1nahcn4u 2468964 2468963 2026-10-15T14:55:47Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1241.eqiad.wmnet with reason: Maintenance 2468964 wikitext text/x-wiki 49i7bwwkwntj9ugc69ji7mktljo0lcs 2468965 2468964 2026-10-15T14:55:57Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1279.eqiad.wmnet with reason: Maintenance 2468965 wikitext text/x-wiki b425f8drluhrsssigrpil7c94aqfxk8 2468966 2468965 2026-10-15T14:56:07Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on 6 hosts with reason: Maintenance 2468966 wikitext text/x-wiki bviraufbxnsi72nbod2mdeje6ujs0vv 2468967 2468966 2026-10-15T14:56:25Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1282.eqiad.wmnet with reason: Maintenance 2468967 wikitext text/x-wiki l22bzl0wivoeawmnnom0wvstou1c1cr 2468968 2468967 2026-10-15T14:56:46Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1287.eqiad.wmnet with reason: Maintenance 2468968 wikitext text/x-wiki gyb7rg0b2q1o6qb0bzvkftxp7w3zmla 2468970 2468968 2026-10-15T14:57:03Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on dbstore1009.eqiad.wmnet with reason: Maintenance 2468970 wikitext text/x-wiki l8h070m8r92iatho6tierkpz2kvnjt2 2468971 2468970 2026-10-15T14:58:55Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2324.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2468971 wikitext text/x-wiki sprcauhps2zktvocqao9mughsde6fzy 2468972 2468971 2026-10-15T14:59:01Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2324.codfw.wmnet 2468972 wikitext text/x-wiki pkbug2oo73j3fwifufdh8spk7uaow9t 2468973 2468972 2026-10-15T14:59:50Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2324.codfw.wmnet 2468973 wikitext text/x-wiki cfot0tln9ngamdimimtzebsylym79is 2468974 2468973 2026-10-15T15:00:04Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2325.codfw.wmnet 2468974 wikitext text/x-wiki obgzb28jizsw9rg9fsfigq57rp0v69j 2468975 2468974 2026-10-15T15:00:38Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2325.codfw.wmnet 2468975 wikitext text/x-wiki snm67cfqtde6fesob9e3ctq0q4v03ql 2468976 2468975 2026-10-15T15:00:57Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2325.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2468976 wikitext text/x-wiki 63gyezh8kkpmdsyeauahbzchkdkptwf 2468977 2468976 2026-10-15T15:01:44Z Stashbot 7414 moritzm: installing unbound security updates 2468977 wikitext text/x-wiki c6axkypl4cu3pwmpz0miqsp1zbpx77z 2468978 2468977 2026-10-15T15:02:14Z Stashbot 7414 pt1979@cumin1004: DONE (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on 33 hosts with reason: Junos upgrade 2468978 wikitext text/x-wiki t8mmjpvnjbf2sovlwqx17jwu2y48k7t 2468979 2468978 2026-10-15T15:02:25Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1340.eqiad.wmnet 2468979 wikitext text/x-wiki pjaevfskk3zun6gb1crl6diebww3bqw 2468980 2468979 2026-10-15T15:02:30Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1340.eqiad.wmnet 2468980 wikitext text/x-wiki 9zkynbvmlc2cop51tamf7xfea4zypw6 2468981 2468980 2026-10-15T15:02:40Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1341.eqiad.wmnet 2468981 wikitext text/x-wiki nxi8sluypbl8iqvkhjcqn3v4ozwixu5 2468982 2468981 2026-10-15T15:03:13Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1341.eqiad.wmnet 2468982 wikitext text/x-wiki sj9r69y3ob3qs91906gwozcob360078 2468983 2468982 2026-10-15T15:03:34Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1341.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2468983 wikitext text/x-wiki anzqoiyy0ow04s47bl0e8zyw4f5iveh 2468984 2468983 2026-10-15T15:06:18Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2325.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2468984 wikitext text/x-wiki khrxpsg886zwk07f4bko562v87d3r9k 2468985 2468984 2026-10-15T15:06:35Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2325.codfw.wmnet 2468985 wikitext text/x-wiki nk3p2ih02a27hjngg5hqotehncwdcla 2468986 2468985 2026-10-15T15:06:52Z Stashbot 7414 pt1979@cumin1004: DONE (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on 15 hosts with reason: Junos upgrade 2468986 wikitext text/x-wiki 1svbkerhzb18a2eedwydgl3wwubtn92 2468987 2468986 2026-10-15T15:07:44Z Stashbot 7414 pt1979@cumin1004: DONE (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on 15 hosts with reason: Junos upgrade 2468987 wikitext text/x-wiki 2qrte3w0mwm8mfxs2u7hrrp2nyi9y31 2468988 2468987 2026-10-15T15:07:53Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2325.codfw.wmnet 2468988 wikitext text/x-wiki 4bbrk5fuu089t3dilxc9ys6l59pkwz4 2468989 2468988 2026-10-15T15:08:07Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2326.codfw.wmnet 2468989 wikitext text/x-wiki a1pvzqv8z0qjs9vnvw8bo2p939aaxzp 2468990 2468989 2026-10-15T15:08:40Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2326.codfw.wmnet 2468990 wikitext text/x-wiki bt9y2gf1ejna7k1ti36thpg0lvihb6w 2468991 2468990 2026-10-15T15:09:01Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2326.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2468991 wikitext text/x-wiki 0otxty070o35bl63p5i6eehiw3e6jq8 2468992 2468991 2026-10-15T15:09:23Z Stashbot 7414 cdobbins@cumin1004: conftool action : set/pooled=no; selector: name=cp2047.* 2468992 wikitext text/x-wiki 3e1gt984ydfqf49b81p36s8sv42lf78 2468993 2468992 2026-10-15T15:09:54Z Stashbot 7414 pt1979@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 14 hosts with reason: Junos upgrade 2468993 wikitext text/x-wiki j0vba9z61rjbjlws8v1ye6actxpfch8 2468994 2468993 2026-10-15T15:09:59Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cp2047.codfw.wmnet 2468994 wikitext text/x-wiki hr0lydfhsu3qzo7ghm7kxr8xhn8r6l6 2468995 2468994 2026-10-15T15:10:10Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1341.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2468995 wikitext text/x-wiki hshh72yb2wrz3pi1lsg488qo43frmfx 2468996 2468995 2026-10-15T15:11:03Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hosts.reboot-single for host cp2047.codfw.wmnet 2468996 wikitext text/x-wiki cq2mt0zgqey10c65676dlvmavk50oj0 2468997 2468996 2026-10-15T15:11:48Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1341.eqiad.wmnet 2468997 wikitext text/x-wiki g7gkghgx85tmbb6aixfuyet4jlkk6jt 2468998 2468997 2026-10-15T15:11:53Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1341.eqiad.wmnet 2468998 wikitext text/x-wiki g2l8so6z3nauuoax5ecpl3nfpoktlqb 2468999 2468998 2026-10-15T15:12:03Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1342.eqiad.wmnet 2468999 wikitext text/x-wiki 3b1psxdduptjao7rozzg9ogcsazkhfx 2469000 2468999 2026-10-15T15:12:38Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1342.eqiad.wmnet 2469000 wikitext text/x-wiki 1tvb6ybgikqcaczk9crz7ihn1l9rm86 2469001 2469000 2026-10-15T15:12:58Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1342.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469001 wikitext text/x-wiki sikz94o7hmfthrw4hpr6qmbn55gtwnj 2469002 2469001 2026-10-15T15:14:20Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2326.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469002 wikitext text/x-wiki iiahhqs8utyid0wg2bjcog2eiqwekfi 2469003 2469002 2026-10-15T15:14:29Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2326.codfw.wmnet 2469003 wikitext text/x-wiki towvns0vvui9xzux6fhqgkv5vhgskpi 2469004 2469003 2026-10-15T15:14:57Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2326.codfw.wmnet 2469004 wikitext text/x-wiki 85u5qyb7jlm0la4hxz1b81930y1hdfu 2469005 2469004 2026-10-15T15:15:11Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2327.codfw.wmnet 2469005 wikitext text/x-wiki 95yrwvdgjlukndo9z7pefkj7895zczk 2469006 2469005 2026-10-15T15:15:45Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2327.codfw.wmnet 2469006 wikitext text/x-wiki p7w0dq3r3owrttwm079d4f9zmx5lkb8 2469007 2469006 2026-10-15T15:19:01Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/analytics-test: apply 2469007 wikitext text/x-wiki 85uqu6bk3nbi682jbrli5adfr09d8nd 2469008 2469007 2026-10-15T15:19:06Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/analytics-test: apply 2469008 wikitext text/x-wiki 335pbikpaxc5ci7e596a9k82bs0rhct 2469009 2469008 2026-10-15T15:19:35Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1342.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469009 wikitext text/x-wiki i7oqvsvp8ya226law01kahcdaloydp5 2469010 2469009 2026-10-15T15:20:51Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1342.eqiad.wmnet 2469010 wikitext text/x-wiki j90r0nfzsnrgbzvpgygdyebwfhqaej6 2469011 2469010 2026-10-15T15:21:02Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1342.eqiad.wmnet 2469011 wikitext text/x-wiki ooudt0c6cgw8de8kkfxdn0w6ibizdpe 2469012 2469011 2026-10-15T15:21:12Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1343.eqiad.wmnet 2469012 wikitext text/x-wiki qxlpygaaeewprnxvlcag0myla46rygv 2469013 2469012 2026-10-15T15:21:39Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1343.eqiad.wmnet 2469013 wikitext text/x-wiki 5c57fapb4ofu9z318yn6l1mdyanwhns 2469014 2469013 2026-10-15T15:28:13Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "sync switches in eqiad a and b changed to state active in netbox - cmooney@cumin1004" 2469014 wikitext text/x-wiki qlbmrrocfkmmxkmleyridlwwtidnt3z 2469015 2469014 2026-10-15T15:28:41Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "sync switches in eqiad a and b changed to state active in netbox - cmooney@cumin1004" 2469015 wikitext text/x-wiki rks0b0qn8onahsj080ksxx790pqeeea 2469017 2469015 2026-10-15T15:33:13Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp2047.codfw.wmnet 2469017 wikitext text/x-wiki l88721yqhp6rn32w6vr4ngkkxmfg3bo 2469018 2469017 2026-10-15T15:40:03Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.hosts.reimage for host sretest1006.eqiad.wmnet with OS trixie 2469018 wikitext text/x-wiki 06x7vwrbywncv7zci2qoy2stdegoh3b 2469021 2469018 2026-10-15T15:49:17Z Stashbot 7414 ebernhardson@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-semantic-search: apply 2469021 wikitext text/x-wiki 9v5ygpto761f4irbte30fmc2xj2eagy 2469022 2469021 2026-10-15T15:49:27Z Stashbot 7414 ebernhardson@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search: apply 2469022 wikitext text/x-wiki ldtglrgcjj062ane1wh5q12ekzf0gd0 2469023 2469022 2026-10-15T15:52:33Z Stashbot 7414 ebernhardson@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/dse-k8s-services/opensearch-semantic-search: apply 2469023 wikitext text/x-wiki 7uepn0vu1y5532m4n686mdp8783zrzs 2469024 2469023 2026-10-15T15:52:41Z Stashbot 7414 ebernhardson@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search: apply 2469024 wikitext text/x-wiki 6yq0d5q4z1z4ywjwmwf84x1q6w9kjmk 2469025 2469024 2026-10-15T15:52:56Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1173.eqiad.wmnet with reason: Maintenance 2469025 wikitext text/x-wiki fg7a76yzr7ccjmrpp18g5dre5tcrgkm 2469026 2469025 2026-10-15T15:54:01Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2175.codfw.wmnet with reason: Maintenance 2469026 wikitext text/x-wiki rqk7iw9boclex8884xpmvwwpyh1f7q3 2469027 2469026 2026-10-15T15:54:32Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2189.codfw.wmnet with reason: Maintenance 2469027 wikitext text/x-wiki ellpl29suqja521p4qufrkgynfkoydn 2469029 2469027 2026-10-15T15:55:04Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2197.codfw.wmnet with reason: Maintenance 2469029 wikitext text/x-wiki cc21l2fn354b8ls8ss956zkpnyt8ywr 2469030 2469029 2026-10-15T15:55:36Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2207.codfw.wmnet with reason: Maintenance 2469030 wikitext text/x-wiki ql59evwyiwzq2xl108slftzo2n5q3qw 2469031 2469030 2026-10-15T15:56:18Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2225.codfw.wmnet with reason: Maintenance 2469031 wikitext text/x-wiki po3dhzzcch9kghnd8s4nrxz0b1zqx0c 2469032 2469031 2026-10-15T15:56:49Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2226.codfw.wmnet with reason: Maintenance 2469032 wikitext text/x-wiki gjc07xkd9vrpfkal6hehmvxvmo0gzej 2469034 2469032 2026-10-15T15:57:22Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2238.codfw.wmnet with reason: Maintenance 2469034 wikitext text/x-wiki dbf94k1rr8bhbsmdzqbe0ka9bxecxgk 2469036 2469034 2026-10-15T15:58:25Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1343.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469036 wikitext text/x-wiki 3kmkyyb59vb24qn48sgdvxw7vffkwze 2469037 2469036 2026-10-15T15:58:34Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2327.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469037 wikitext text/x-wiki d2blw2vw5cpmeg6hwcfv2jacnteeurg 2469040 2469037 2026-10-15T16:03:49Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2327.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469040 wikitext text/x-wiki lo2iqg7lz64v872w1n9lkcg7fbxwoei 2469041 2469040 2026-10-15T16:04:07Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2327.codfw.wmnet 2469041 wikitext text/x-wiki 1sd2p0xenjhw9cn37uog0zkg8rhysev 2469042 2469041 2026-10-15T16:05:01Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1343.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469042 wikitext text/x-wiki fl3jtej9oixkedqyxhejro7w516bbkm 2469043 2469042 2026-10-15T16:05:07Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2327.codfw.wmnet 2469043 wikitext text/x-wiki gt2ker287x8pdhmqmhocs9dnfcdizx9 2469044 2469043 2026-10-15T16:05:15Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2328.codfw.wmnet 2469044 wikitext text/x-wiki ghjx8uyvmmbarucx2743rd9xq77xld1 2469045 2469044 2026-10-15T16:05:54Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2328.codfw.wmnet 2469045 wikitext text/x-wiki plqszswdl32ha74iss4k6snfir69i65 2469046 2469045 2026-10-15T16:06:03Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2328.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469046 wikitext text/x-wiki f1sv6c0dz6li5z6pvbhx7owbu4007v7 2469047 2469046 2026-10-15T16:10:01Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2204.codfw.wmnet with reason: Maintenance 2469047 wikitext text/x-wiki m9a1crribwjfxpfw5e1hhebl70rrwdr 2469048 2469047 2026-10-15T16:10:48Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1156.eqiad.wmnet with reason: Maintenance 2469048 wikitext text/x-wiki l6chg4gq5jirx0b7r8aox23vh86frvd 2469049 2469048 2026-10-15T16:11:11Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1188.eqiad.wmnet with reason: Maintenance 2469049 wikitext text/x-wiki te6lf4nta8989j9gya1r19r5khlwr21 2469050 2469049 2026-10-15T16:11:22Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2328.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469050 wikitext text/x-wiki qqqludpgivrnv1j69e5abqn237ej3jk 2469051 2469050 2026-10-15T16:11:30Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1197.eqiad.wmnet with reason: Maintenance 2469051 wikitext text/x-wiki fn9s0xh0nm0gytyyb14580b74kb6gne 2469052 2469051 2026-10-15T16:11:47Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1222.eqiad.wmnet with reason: Maintenance 2469052 wikitext text/x-wiki kixvgr433xwor6wge6yu84sjo3wx01n 2469054 2469052 2026-10-15T16:11:59Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2328.codfw.wmnet 2469054 wikitext text/x-wiki rh94iekw87e1inbzion8oszq08vn5sh 2469055 2469054 2026-10-15T16:12:14Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2328.codfw.wmnet 2469055 wikitext text/x-wiki g3or2oh22r5v2x0wp2fm72v7al3hqe8 2469056 2469055 2026-10-15T16:12:22Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1225.eqiad.wmnet with reason: Maintenance 2469056 wikitext text/x-wiki d9jp10ky4le7bm26scf7bx7f7agwyog 2469057 2469056 2026-10-15T16:12:31Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2329.codfw.wmnet 2469057 wikitext text/x-wiki bjn47xvamg38b4a5mc22oy7lwutbhn5 2469058 2469057 2026-10-15T16:12:45Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1229.eqiad.wmnet with reason: Maintenance 2469058 wikitext text/x-wiki s091frm6r9hhudwaojhoveyd8c3wd1x 2469059 2469058 2026-10-15T16:13:02Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2329.codfw.wmnet 2469059 wikitext text/x-wiki s3zkwqd71g6c48o4rt2aukflk44x8v0 2469060 2469059 2026-10-15T16:13:08Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1233.eqiad.wmnet with reason: Maintenance 2469060 wikitext text/x-wiki 4btnji2g695sn0qx9pw6dqrjgx102sa 2469061 2469060 2026-10-15T16:13:16Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1239.eqiad.wmnet with reason: Maintenance 2469061 wikitext text/x-wiki 70hevg9me81au1fmcvieqqpyxs96xie 2469062 2469061 2026-10-15T16:13:26Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2329.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469062 wikitext text/x-wiki k2r8fc8u03do1tdl55sfhjkrlfip6e6 2469064 2469062 2026-10-15T16:13:42Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1254.eqiad.wmnet with reason: Maintenance 2469064 wikitext text/x-wiki 1xh6o33ee9z5rykpfpum5elh0mdn51e 2469065 2469064 2026-10-15T16:13:49Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1259.eqiad.wmnet with reason: Maintenance 2469065 wikitext text/x-wiki 9oeklwcbi465vy5hsxgz9j9je0kcch4 2469066 2469065 2026-10-15T16:14:09Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1271.eqiad.wmnet with reason: Maintenance 2469066 wikitext text/x-wiki mffw5qe76hjb2g777x19xiqum8yc852 2469067 2469066 2026-10-15T16:14:21Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on 7 hosts with reason: Maintenance 2469067 wikitext text/x-wiki dpu0vz3errhg67uay7sa69qhix5o78d 2469068 2469067 2026-10-15T16:14:43Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1276.eqiad.wmnet with reason: Maintenance 2469068 wikitext text/x-wiki 8jgoxh192ml6nysli8keh820s50xzwv 2469069 2469068 2026-10-15T16:15:11Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance 2469069 wikitext text/x-wiki 4mzysso37btzrwv6d6rknxly4lnwzzb 2469070 2469069 2026-10-15T16:15:57Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1343.eqiad.wmnet 2469070 wikitext text/x-wiki 4d765p3l6wx5cpi0kdzwci3zsco7rvs 2469071 2469070 2026-10-15T16:16:06Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1343.eqiad.wmnet 2469071 wikitext text/x-wiki bzf8t3phxorvx0hsmkjfy4wcwg298ox 2469072 2469071 2026-10-15T16:16:15Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1344.eqiad.wmnet 2469072 wikitext text/x-wiki thy5vtht8d1ej0mvda5krwiu9nv5omw 2469073 2469072 2026-10-15T16:16:45Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1344.eqiad.wmnet 2469073 wikitext text/x-wiki bh2c2ctmizdskufr86g5fulnqkfkmfm 2469074 2469073 2026-10-15T16:17:04Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1344.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469074 wikitext text/x-wiki r925ga4b1ozum61gip6sujvbq558gwg 2469075 2469074 2026-10-15T16:17:42Z Stashbot 7414 mutante: contint1002/contint2002 - restart docker to apply a nofile ulimit for containers from gerrit:1355127 T440670 2469075 wikitext text/x-wiki 1hj9b1xlwot7mwb4fje8lm5grvgto32 2469076 2469075 2026-10-15T16:18:40Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2329.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469076 wikitext text/x-wiki srdkvkedrh3ipcuago25jcihxv8t4c0 2469077 2469076 2026-10-15T16:18:46Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2329.codfw.wmnet 2469077 wikitext text/x-wiki 5zuev5swtkigqzyykclgfr0cwmtf7jw 2469078 2469077 2026-10-15T16:19:05Z Stashbot 7414 pt1979@cumin2003: DONE (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 0:05:00 on 42 hosts with reason: Testing PDU downtime 2469078 wikitext text/x-wiki k8wiu0aehsxsp7ztm9vwyndqep22w51 2469079 2469078 2026-10-15T16:20:04Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2329.codfw.wmnet 2469079 wikitext text/x-wiki m17y707jassz0sxb0h3d4r2hfh0pds9 2469080 2469079 2026-10-15T16:20:17Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2330.codfw.wmnet 2469080 wikitext text/x-wiki 2wkx4sm39scexr5pzjnl72y5805samp 2469081 2469080 2026-10-15T16:20:52Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2330.codfw.wmnet 2469081 wikitext text/x-wiki hne3w0n6er4qtn4c0trfciiowxfu50h 2469082 2469081 2026-10-15T16:21:12Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2330.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469082 wikitext text/x-wiki 6b8v9vg57ppjo4vokzyfp8ppzba28qz 2469083 2469082 2026-10-15T16:21:20Z Stashbot 7414 pt1979@cumin2003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:05:00 on 8 hosts with reason: Testing PDU downtime 2469083 wikitext text/x-wiki 2lb0c5pr0jwshvjd4sbfmcc9d0afnl8 2469085 2469083 2026-10-15T16:23:40Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1344.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469085 wikitext text/x-wiki 1cu4y2rgzgez7d9ss5i7345341t5b85 2469086 2469085 2026-10-15T16:24:33Z Stashbot 7414 mutante: contint1003/contint2003 - restart docker to apply a nofile ulimit for containers from gerrit:1355127 T440670 2469086 wikitext text/x-wiki 3hxdwhho58rwljb7dx09jzkpsq7dskp 2469089 2469086 2026-10-15T16:26:38Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2330.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469089 wikitext text/x-wiki 8utuk1izsnx0wnlkoxbdqerph54ytrq 2469090 2469089 2026-10-15T16:26:47Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2330.codfw.wmnet 2469090 wikitext text/x-wiki 1t2ier20z340ggj18gvqikhemy1bxvb 2469091 2469090 2026-10-15T16:28:01Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2330.codfw.wmnet 2469091 wikitext text/x-wiki grs93ldjjrxbcsqvuifxufs48ctxc87 2469092 2469091 2026-10-15T16:28:14Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2331.codfw.wmnet 2469092 wikitext text/x-wiki 9ww9po19b74ibcxnngh8jbpcpe9rzyc 2469093 2469092 2026-10-15T16:28:40Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on sretest1006.eqiad.wmnet with reason: host reimage 2469093 wikitext text/x-wiki etjxpp6vm4dojolauu6mtqrpltkw0ko 2469094 2469093 2026-10-15T16:28:48Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2331.codfw.wmnet 2469094 wikitext text/x-wiki djndckdygdzmhr9qw5ylvzi1v09gbx4 2469095 2469094 2026-10-15T16:29:07Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2331.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469095 wikitext text/x-wiki 00zcbnxlofoi7dx5z3abpm6vkqcsj9y 2469096 2469095 2026-10-15T16:29:21Z Stashbot 7414 cmooney@cumin1004: END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on sretest1006.eqiad.wmnet with reason: host reimage 2469096 wikitext text/x-wiki jpf7o69d3labcbcih54liqyrejbv4lx 2469097 2469096 2026-10-15T16:34:26Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2331.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469097 wikitext text/x-wiki nzl4oj3ymc8631me2cu1i9wi4ar7di3 2469098 2469097 2026-10-15T16:34:37Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1344.eqiad.wmnet 2469098 wikitext text/x-wiki eqd0krsj1dwxv949ton6o314bx4qxdj 2469099 2469098 2026-10-15T16:34:45Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1344.eqiad.wmnet 2469099 wikitext text/x-wiki jh7boaxt75f4maxbrpfwrlcs0ta20h0 2469101 2469099 2026-10-15T16:34:50Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2331.codfw.wmnet 2469101 wikitext text/x-wiki 3yssqtliihc8vgfx1sqwqv5yqauha3v 2469102 2469101 2026-10-15T16:34:55Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1345.eqiad.wmnet 2469102 wikitext text/x-wiki 2vyxf3avb9y5900882qgyariaiitw4f 2469103 2469102 2026-10-15T16:35:27Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2331.codfw.wmnet 2469103 wikitext text/x-wiki l0yutp52suwzexg38w5vedtix9eqsa0 2469104 2469103 2026-10-15T16:35:40Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2332.codfw.wmnet 2469104 wikitext text/x-wiki jpfflmi5t2x8jiu1jcpug4tkdxzqcld 2469105 2469104 2026-10-15T16:36:17Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2332.codfw.wmnet 2469105 wikitext text/x-wiki fuvaznao5a8vxynrpp4ru1rb24mlx62 2469106 2469105 2026-10-15T16:36:36Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2332.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469106 wikitext text/x-wiki gkvdvul8a991w2zjw4bhwbxzf7dmpk4 2469107 2469106 2026-10-15T16:39:54Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1345.eqiad.wmnet 2469107 wikitext text/x-wiki sgqay8l6cdrw1r1u8ulgz9dvc3zeb9n 2469108 2469107 2026-10-15T16:40:15Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1345.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469108 wikitext text/x-wiki pc48bnyieytedfaei1bf3qw5rfmd9tg 2469112 2469108 2026-10-15T16:43:13Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2332.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469112 wikitext text/x-wiki oryzgqijuj3m387acskfhkq0vj2ct8n 2469113 2469112 2026-10-15T16:43:30Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2332.codfw.wmnet 2469113 wikitext text/x-wiki iii54bb92055vxkzxe0pmtscrft2rs8 2469115 2469113 2026-10-15T16:44:07Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2332.codfw.wmnet 2469115 wikitext text/x-wiki d3brvbrhrxv3xd5ffnls1140tatsmn8 2469116 2469115 2026-10-15T16:44:20Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2333.codfw.wmnet 2469116 wikitext text/x-wiki p447mzxh6f45zydz7tnmnee62u488ce 2469117 2469116 2026-10-15T16:44:56Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2333.codfw.wmnet 2469117 wikitext text/x-wiki eqak3japqsfzvshy302s3g13944atp7 2469118 2469117 2026-10-15T16:45:17Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2333.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469118 wikitext text/x-wiki nwkehglphz3uvzkc53j0hcc4r3j5x1t 2469120 2469118 2026-10-15T16:46:52Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1345.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469120 wikitext text/x-wiki nnmsoact6xilcm4hl8ami87f8sve2qh 2469122 2469120 2026-10-15T16:48:29Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1345.eqiad.wmnet 2469122 wikitext text/x-wiki h1vi1iu1et9aaujkh6b9yuxteqji1rt 2469123 2469122 2026-10-15T16:48:34Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1345.eqiad.wmnet 2469123 wikitext text/x-wiki tgnox25klc61ufjdluix3nuuvqsitqe 2469124 2469123 2026-10-15T16:48:43Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1346.eqiad.wmnet 2469124 wikitext text/x-wiki bf1gzb804gle0ygsjsbudxlkjab7l53 2469125 2469124 2026-10-15T16:49:17Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1346.eqiad.wmnet 2469125 wikitext text/x-wiki hs0dxdk3qyhfs3tb5jf31bepacsf6k4 2469126 2469125 2026-10-15T16:49:37Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1346.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469126 wikitext text/x-wiki 5c4ccmp0au6jqs5wo4rnly6j6ccj234 2469127 2469126 2026-10-15T16:51:55Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2333.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469127 wikitext text/x-wiki 288zhb7im5r68vt1cqur76t884gssn2 2469129 2469127 2026-10-15T16:52:23Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2333.codfw.wmnet 2469129 wikitext text/x-wiki i2ir9o1pexdxwixwqg6y75eiwsovy6b 2469130 2469129 2026-10-15T16:52:49Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2333.codfw.wmnet 2469130 wikitext text/x-wiki 063ouag9f4sq7zauwkvdgqexo6mixj2 2469131 2469130 2026-10-15T16:53:02Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2334.codfw.wmnet 2469131 wikitext text/x-wiki be6r5qu5rekolxkz1vskkffd86sl6pp 2469133 2469131 2026-10-15T16:53:38Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2334.codfw.wmnet 2469133 wikitext text/x-wiki lscb8y1n1cb7fwoh7i03d5ony2531zh 2469134 2469133 2026-10-15T16:53:58Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2334.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469134 wikitext text/x-wiki j3jn1h4u94emo4e7syq0zwhczx3ey9v 2469135 2469134 2026-10-15T16:54:21Z Stashbot 7414 arlolra@deploy1003: Started scap sync-world: Backport for [[gerrit:1355741|Set wgUseParsoidParser to false in prod (T441345 T432760)]] 2469135 wikitext text/x-wiki 2xxgy3sdy3kwek6uxqqzag2x0ccvobj 2469136 2469135 2026-10-15T16:56:13Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1346.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469136 wikitext text/x-wiki 3wu6dcj9o9sd2r26iv8f7f8iccakjep 2469137 2469136 2026-10-15T16:56:32Z Stashbot 7414 arlolra@deploy1003: arlolra: Backport for [[gerrit:1355741|Set wgUseParsoidParser to false in prod (T441345 T432760)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2469137 wikitext text/x-wiki bd3vg2e9rj2nc4lax8lgyidpwv6ifci 2469138 2469137 2026-10-15T16:56:57Z Stashbot 7414 arlolra@deploy1003: arlolra: Continuing with deployment 2469138 wikitext text/x-wiki 05uxlvbedhwhgoez4zv3vb9cl7mwtw1 2469139 2469138 2026-10-15T16:57:52Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1346.eqiad.wmnet 2469139 wikitext text/x-wiki decpbq4eykhw7upqloidfj1majnj1ja 2469140 2469139 2026-10-15T16:57:53Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1346.eqiad.wmnet 2469140 wikitext text/x-wiki dmm39jilax60dgk89gxc0v2toxwkgl7 2469141 2469140 2026-10-15T16:58:06Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1347.eqiad.wmnet 2469141 wikitext text/x-wiki aj19suqdfiklfseysw1jgyb8ab34xh6 2469142 2469141 2026-10-15T16:58:43Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1347.eqiad.wmnet 2469142 wikitext text/x-wiki sfrtia839uudbnllwet0dwhuo0rlobm 2469143 2469142 2026-10-15T16:58:52Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1347.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469143 wikitext text/x-wiki emr6g4gfuoua3voxoamc1cmb6s7wrf0 2469144 2469143 2026-10-15T17:00:35Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2334.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469144 wikitext text/x-wiki b26vsea1fhuneu624z6lg9nxhnt2il1 2469145 2469144 2026-10-15T17:02:22Z Stashbot 7414 arlolra@deploy1003: Finished scap sync-world: Backport for [[gerrit:1355741|Set wgUseParsoidParser to false in prod (T441345 T432760)]] (duration: 08m 01s) 2469145 wikitext text/x-wiki kqjb3fg8r2yvmrqtbmg4ph3rehlvynr 2469146 2469145 2026-10-15T17:05:34Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1347.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469146 wikitext text/x-wiki stls8y71yzpchwyd1cn34hpawlvnx9i 2469149 2469146 2026-10-15T17:10:55Z Stashbot 7414 cdobbins@cumin1004: END (ERROR) - Cookbook sre.hardware.upgrade-firmware (exit_code=97) upgrade firmware for hosts cp2047.codfw.wmnet 2469149 wikitext text/x-wiki l82zx8xwnvaa3k9fkjqmw3l7p2cz1ty 2469150 2469149 2026-10-15T17:11:02Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cp2047.codfw.wmnet 2469150 wikitext text/x-wiki d1exnz7xm4zrvklfazdkpwtb8pyj9r5 2469152 2469150 2026-10-15T17:11:22Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts cp2047.codfw.wmnet 2469152 wikitext text/x-wiki ionzm6tygw2d8a6sgu1iliwfyz8g63n 2469153 2469152 2026-10-15T17:11:31Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2334.codfw.wmnet 2469153 wikitext text/x-wiki 17oomicydm3gf23neyni8k3outl2512 2469154 2469153 2026-10-15T17:11:32Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2334.codfw.wmnet 2469154 wikitext text/x-wiki 4xr9qzbqkwcyyfixgsygjwas1m5t115 2469155 2469154 2026-10-15T17:11:46Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2335.codfw.wmnet 2469155 wikitext text/x-wiki snljg2wk1b1lwn8jx5clygdlxudgngv 2469156 2469155 2026-10-15T17:12:21Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2335.codfw.wmnet 2469156 wikitext text/x-wiki r6yjefs0zsfv1szn7uhwi9fll138gwt 2469157 2469156 2026-10-15T17:12:41Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2335.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469157 wikitext text/x-wiki 5xnb9dp5o67lhhg0s2xa6ihgkh6q88s 2469158 2469157 2026-10-15T17:12:45Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1347.eqiad.wmnet 2469158 wikitext text/x-wiki p89naknwzsmbsvb121y5fnvi8rbor7v 2469159 2469158 2026-10-15T17:12:47Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1347.eqiad.wmnet 2469159 wikitext text/x-wiki hqdvatwsben9b3lz4grzbxsv0c9t368 2469160 2469159 2026-10-15T17:13:00Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1348.eqiad.wmnet 2469160 wikitext text/x-wiki ojg2xxuyvrl55ufpmj67xmpwq7uxk85 2469161 2469160 2026-10-15T17:13:32Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1348.eqiad.wmnet 2469161 wikitext text/x-wiki 75ew94nqo23ta8twt89vahwlqamtmnf 2469162 2469161 2026-10-15T17:13:52Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1348.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469162 wikitext text/x-wiki fgqjkk93jy9bph6zo8m7l5pifaxqqpu 2469163 2469162 2026-10-15T17:19:25Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2335.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469163 wikitext text/x-wiki 095e6avwp3h3l1hl0opxbeetqol6lh5 2469164 2469163 2026-10-15T17:20:28Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1348.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469164 wikitext text/x-wiki elmccneujqd4gb0ezzknvv8gkj7bgsv 2469166 2469164 2026-10-15T17:23:47Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hosts.provision for host cp2047.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2469166 wikitext text/x-wiki 787im63siwln6kc62pp8rnakfe1fx9w 2469168 2469166 2026-10-15T17:27:05Z Stashbot 7414 tsev@deploy1003: helmfile [staging] START helmfile.d/services/wikifeeds: apply 2469168 wikitext text/x-wiki 8sdr0ii38ugbell0mdnmovvpj8wtju3 2469169 2469168 2026-10-15T17:27:32Z Stashbot 7414 tsev@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifeeds: apply 2469169 wikitext text/x-wiki 4jfoowhun5b2fdsolqv8767noym0bfa 2469170 2469169 2026-10-15T17:30:21Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2335.codfw.wmnet 2469170 wikitext text/x-wiki oa5vfxmr94estfa2tzkhkqurqw3r5cs 2469171 2469170 2026-10-15T17:30:23Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2335.codfw.wmnet 2469171 wikitext text/x-wiki 1sm3fqz67aoz6nh5y40vw1vozu52x67 2469172 2469171 2026-10-15T17:30:36Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2336.codfw.wmnet 2469172 wikitext text/x-wiki 0e5bjp1h3iznw98dndb2nuuw5jxlr78 2469173 2469172 2026-10-15T17:31:05Z Stashbot 7414 tsev@deploy1003: helmfile [eqiad] START helmfile.d/services/wikifeeds: apply 2469173 wikitext text/x-wiki j421cl5nvitbc3ysw0r5ruk2mb0oicn 2469174 2469173 2026-10-15T17:31:13Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2336.codfw.wmnet 2469174 wikitext text/x-wiki 5yaehn1bkuwdn3k6du7fgw9n5gqetyx 2469175 2469174 2026-10-15T17:31:32Z Stashbot 7414 tsev@deploy1003: helmfile [eqiad] DONE helmfile.d/services/wikifeeds: apply 2469175 wikitext text/x-wiki o5r6fdlziojuvdj6w4feh84pc2j8i9j 2469176 2469175 2026-10-15T17:31:33Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2336.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469176 wikitext text/x-wiki cmbukp9vwmdx4siww55818jfpydr5z7 2469177 2469176 2026-10-15T17:32:52Z Stashbot 7414 tsev@deploy1003: helmfile [codfw] START helmfile.d/services/wikifeeds: apply 2469177 wikitext text/x-wiki 2eqxuagoalgzs7cxxjf6u0nvcmqvvdx 2469178 2469177 2026-10-15T17:33:23Z Stashbot 7414 tsev@deploy1003: helmfile [codfw] DONE helmfile.d/services/wikifeeds: apply 2469178 wikitext text/x-wiki i0vt79ivwni1qq0qe286nqfdrdc7w5n 2469179 2469178 2026-10-15T17:35:59Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1348.eqiad.wmnet 2469179 wikitext text/x-wiki g16ox8qz10m5bfwzrwb47hbc7qto8xa 2469180 2469179 2026-10-15T17:36:01Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1348.eqiad.wmnet 2469180 wikitext text/x-wiki jpa5z3snsy4evnq7zqwpbyyduof1gzs 2469181 2469180 2026-10-15T17:36:14Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1349.eqiad.wmnet 2469181 wikitext text/x-wiki s7236ua85nq1uu49dhwovnhogi7asn1 2469182 2469181 2026-10-15T17:36:50Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1349.eqiad.wmnet 2469182 wikitext text/x-wiki rnjxfob4vv7rm8qbin0xds3nwvdvyn5 2469183 2469182 2026-10-15T17:37:10Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1349.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469183 wikitext text/x-wiki degtto2pzjmbqdzj7figbn7jkj2782e 2469184 2469183 2026-10-15T17:38:17Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2336.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469184 wikitext text/x-wiki 3ps1kvrx0rw966shx3mi2vyl6r9mxmy 2469185 2469184 2026-10-15T17:39:01Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cp2047.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2469185 wikitext text/x-wiki 8p0quk82eybm0soa3730avgi03tzd1q 2469186 2469185 2026-10-15T17:39:39Z Stashbot 7414 dancy@deploy1003: Installing scap version "4.299.0" for 3 host(s) 2469186 wikitext text/x-wiki rz4umxrwgagryvoof56yome7ldhwd9q 2469187 2469186 2026-10-15T17:41:33Z Stashbot 7414 dancy@deploy1003: Installation of scap version "4.299.0" completed for 3 hosts 2469187 wikitext text/x-wiki 6r70c0we2r6o4pzr6f8u2bb4turpfja 2469188 2469187 2026-10-15T17:42:54Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hosts.remove-downtime for cp2047.codfw.wmnet 2469188 wikitext text/x-wiki l9qglm5a9y9zn16pjcgny1p2a545t8s 2469189 2469188 2026-10-15T17:42:57Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp2047.codfw.wmnet 2469189 wikitext text/x-wiki 5dys64045fx3l0o2gbvke17bkjq1u7s 2469190 2469189 2026-10-15T17:43:03Z Stashbot 7414 cdobbins@cumin1004: conftool action : set/pooled=yes; selector: name=cp2047.* 2469190 wikitext text/x-wiki om15ddokjkvt3qatnuc5ulai0dxevvr 2469191 2469190 2026-10-15T17:43:46Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1349.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469191 wikitext text/x-wiki p1hzdf3dgjlo9hvkoow5yo98m83u96q 2469192 2469191 2026-10-15T17:53:46Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2336.codfw.wmnet 2469192 wikitext text/x-wiki 04941lltsj4ieqgaki1a9hrkwmvkitj 2469193 2469192 2026-10-15T17:53:48Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2336.codfw.wmnet 2469193 wikitext text/x-wiki jg3gmp43pt1bde2sy1kn9mtogbom62m 2469194 2469193 2026-10-15T17:54:01Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2337.codfw.wmnet 2469194 wikitext text/x-wiki c8f6vpog0ghx7tboemdicsyoqr2yd1w 2469195 2469194 2026-10-15T17:54:37Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2337.codfw.wmnet 2469195 wikitext text/x-wiki h9nkdpi41ua4vuchuemtmcn1tuxuzfh 2469196 2469195 2026-10-15T17:54:57Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2337.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469196 wikitext text/x-wiki kszrg4z0zm9dw6pouvpfbxmwdt8lx66 2469197 2469196 2026-10-15T18:01:30Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2337.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469197 wikitext text/x-wiki cyslv9i82ddhad2bqpxky8y4e3lrjib 2469198 2469197 2026-10-15T18:01:58Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2337.codfw.wmnet 2469198 wikitext text/x-wiki 76vp1v7087mjb916tf12pn9doyxi6yg 2469199 2469198 2026-10-15T18:02:00Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2337.codfw.wmnet 2469199 wikitext text/x-wiki keuys87vienvd2s14wggb0zrlqcuj3x 2469200 2469199 2026-10-15T18:02:14Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2338.codfw.wmnet 2469200 wikitext text/x-wiki fqkhhp64u8ottn986m1eph8pjgap0cn 2469201 2469200 2026-10-15T18:02:46Z Stashbot 7414 cmooney@cumin1004: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest1006.eqiad.wmnet with OS trixie 2469201 wikitext text/x-wiki 07jjfroia93f1zrnndwqh8e1k9eoszz 2469202 2469201 2026-10-15T18:02:49Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2338.codfw.wmnet 2469202 wikitext text/x-wiki h1t1ob13mqnbxkyvvmy3shu5acve6dq 2469203 2469202 2026-10-15T18:03:09Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2338.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469203 wikitext text/x-wiki 98gbzhg3y9xpnbgrk8han8n3ww0tulx 2469204 2469203 2026-10-15T18:04:16Z Stashbot 7414 cdobbins@cumin1004: conftool action : set/pooled=no; selector: name=cp2048.* 2469204 wikitext text/x-wiki lfklyjqmnbhr3c6bw0op534xu4rqng5 2469205 2469204 2026-10-15T18:04:29Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cp2048.codfw.wmnet 2469205 wikitext text/x-wiki b7jlw1ymgafc4dcyc5bsut7qnoi2g14 2469206 2469205 2026-10-15T18:05:43Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hosts.reboot-single for host cp2048.codfw.wmnet 2469206 wikitext text/x-wiki ae2zjarczwrp8std9nezqigxzzx8982 2469207 2469206 2026-10-15T18:09:44Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2338.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469207 wikitext text/x-wiki dftmf1knrtt85uvnm9yw53f71h0axjk 2469208 2469207 2026-10-15T18:10:12Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2338.codfw.wmnet 2469208 wikitext text/x-wiki 6ldblg4unbqs2ra7v1yeabsb86b5shn 2469209 2469208 2026-10-15T18:10:38Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2338.codfw.wmnet 2469209 wikitext text/x-wiki 6cday3z1ujtkzyeo4eafxxt7wrzncbe 2469210 2469209 2026-10-15T18:10:51Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2339.codfw.wmnet 2469210 wikitext text/x-wiki 4db0fmss62f0vo28w47f9p18hmqcg0j 2469211 2469210 2026-10-15T18:11:26Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2339.codfw.wmnet 2469211 wikitext text/x-wiki d10qen5r4lzftibk7stpeqxb1yxbrew 2469212 2469211 2026-10-15T18:11:45Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2339.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469212 wikitext text/x-wiki jelnq58bkqm2z2go18dff11hmfar8mv 2469213 2469212 2026-10-15T18:18:24Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2339.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469213 wikitext text/x-wiki 4pk674grjget848p3ixrtkpq4737i8c 2469214 2469213 2026-10-15T18:20:00Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2469214 wikitext text/x-wiki h2r9pfokjit9h20rxvn5b8sj6x6smz4 2469215 2469214 2026-10-15T18:22:43Z Stashbot 7414 pt1979@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp2047'] 2469215 wikitext text/x-wiki geiiz7m2qpsteddbvr52i49df8t195k 2469216 2469215 2026-10-15T18:23:51Z Stashbot 7414 pt1979@cumin1004: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cp2047'] 2469216 wikitext text/x-wiki 2m2wo1tnhe3qzqmoo6ruyukri2vrmfe 2469217 2469216 2026-10-15T18:25:54Z Stashbot 7414 pt1979@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp2047'] 2469217 wikitext text/x-wiki rjtei20a6jgl8hjskh3ze8low31qzng 2469218 2469217 2026-10-15T18:27:42Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp2048.codfw.wmnet 2469218 wikitext text/x-wiki npj20be91agtx47c4afm1veck9dwywh 2469219 2469218 2026-10-15T18:27:44Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts cp2048.codfw.wmnet 2469219 wikitext text/x-wiki hs95j9vh4oqitx1dprahjy7yqqgww7a 2469220 2469219 2026-10-15T18:29:05Z Stashbot 7414 musikanimal@deploy1003: Started scap sync-world: Backport for [[gerrit:1355783|CommonSettings: keep CodeMirror off on enwiki for older accounts (T441308)]] 2469220 wikitext text/x-wiki 12oqjsg0rz52pcg9qmlmnsbox5eyvbk 2469221 2469220 2026-10-15T18:29:20Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2339.codfw.wmnet 2469221 wikitext text/x-wiki 7o9dqijeucit74hgumt9x6fa4u71ov5 2469222 2469221 2026-10-15T18:29:22Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2339.codfw.wmnet 2469222 wikitext text/x-wiki 77u09u76xz2j7itolwmuta9d816cy2w 2469223 2469222 2026-10-15T18:29:36Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2340.codfw.wmnet 2469223 wikitext text/x-wiki 5sjvxwf56spgo0htqo79j5zi2ntqg8m 2469224 2469223 2026-10-15T18:30:12Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2340.codfw.wmnet 2469224 wikitext text/x-wiki n8lezyn194ztcpffkqjr8xh7b4k8ise 2469225 2469224 2026-10-15T18:30:32Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2340.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469225 wikitext text/x-wiki n2f8f3y8r9rldtcapfsgzu0fi3m1ood 2469226 2469225 2026-10-15T18:31:24Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hosts.provision for host cp2048.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2469226 wikitext text/x-wiki dv5mldyslr1kszbec5ya0glunble527 2469227 2469226 2026-10-15T18:32:55Z Stashbot 7414 musikanimal@deploy1003: musikanimal: Backport for [[gerrit:1355783|CommonSettings: keep CodeMirror off on enwiki for older accounts (T441308)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2469227 wikitext text/x-wiki oha75g6pqsgklcvx0bytmzfig2mdoky 2469228 2469227 2026-10-15T18:33:54Z Stashbot 7414 musikanimal@deploy1003: musikanimal: Continuing with deployment 2469228 wikitext text/x-wiki 2xgeojmmzkxxw5ay1jwfrgg22dwonz2 2469229 2469228 2026-10-15T18:33:56Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.dns.netbox 2469229 wikitext text/x-wiki ankc3frxi5on7rqc4ct9twzkqog3x4d 2469230 2469229 2026-10-15T18:37:07Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2340.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469230 wikitext text/x-wiki m1tdnz92l4c2id5c50b876nq4ceys9d 2469231 2469230 2026-10-15T18:37:35Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2340.codfw.wmnet 2469231 wikitext text/x-wiki b3jpkwdtvc6gyl73r7ghfwvm0ti6euo 2469232 2469231 2026-10-15T18:37:37Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2340.codfw.wmnet 2469232 wikitext text/x-wiki osvfx1bvznd6f4ut1ybhn5kas0przwr 2469233 2469232 2026-10-15T18:37:39Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.enable_virtualization (exit_code=0) rolling provision on D{wikikube-worker[2321-2340].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) 2469233 wikitext text/x-wiki m5iqennxt795zu77048k0caa7tphk4m 2469234 2469233 2026-10-15T18:37:55Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update entry for sretest1006 - cmooney@cumin1004" 2469234 wikitext text/x-wiki 76kx6x7zi5yzvi7qpm0nyl7z254usql 2469235 2469234 2026-10-15T18:38:46Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update entry for sretest1006 - cmooney@cumin1004" 2469235 wikitext text/x-wiki 3lkjkkumbif3wn1ntytc3r644h6pk20 2469236 2469235 2026-10-15T18:38:48Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2469236 wikitext text/x-wiki f30el56qei228s9y04dk24unrs85h9i 2469237 2469236 2026-10-15T18:39:19Z Stashbot 7414 musikanimal@deploy1003: Finished scap sync-world: Backport for [[gerrit:1355783|CommonSettings: keep CodeMirror off on enwiki for older accounts (T441308)]] (duration: 10m 14s) 2469237 wikitext text/x-wiki liidcwhij04pwlb6gl3v0c77onbjddv 2469238 2469237 2026-10-15T18:39:50Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.dns.wipe-cache sretest1006.eqiad.wmnet on all recursors 2469238 wikitext text/x-wiki ke2imiecl0dujs3sh33ynqwu6lbglrr 2469239 2469238 2026-10-15T18:39:53Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) sretest1006.eqiad.wmnet on all recursors 2469239 wikitext text/x-wiki l8ojodrgxg0b9uw2npwu8gg92anzrzx 2469240 2469239 2026-10-15T18:40:52Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp2047'] 2469240 wikitext text/x-wiki 2f8pu5lf4hrbszm59e0w63s0cwc5818 2469241 2469240 2026-10-15T18:41:20Z Stashbot 7414 cdobbins@cumin1004: END (ERROR) - Cookbook sre.hardware.upgrade-firmware (exit_code=97) upgrade firmware for hosts ['cp2047'] 2469241 wikitext text/x-wiki opkkk3bj8mplrs5swvr93vmpj0a6q4t 2469242 2469241 2026-10-15T18:41:47Z Stashbot 7414 cdobbins@cumin1004: conftool action : set/pooled=no; selector: name=cp2047.* 2469242 wikitext text/x-wiki snb3lcrhe0wp1ufaxl6d19jbgzl0xfe 2469243 2469242 2026-10-15T18:41:51Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp2047'] 2469243 wikitext text/x-wiki cl67dhw43yauq47unjpd29fer3yo6v9 2469244 2469243 2026-10-15T18:42:24Z Stashbot 7414 cdobbins@cumin1004: END (ERROR) - Cookbook sre.hardware.upgrade-firmware (exit_code=97) upgrade firmware for hosts ['cp2047'] 2469244 wikitext text/x-wiki lazpup4xyydp6p7sbzen4b89n1lzluo 2469245 2469244 2026-10-15T18:42:27Z Stashbot 7414 cdobbins@cumin1004: conftool action : set/pooled=yes; selector: name=cp2047.* 2469245 wikitext text/x-wiki qshc85xuh17iepsk2nk5ry114giogcb 2469246 2469245 2026-10-15T18:42:53Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.hosts.reimage for host sretest1006.eqiad.wmnet with OS trixie 2469246 wikitext text/x-wiki qxs4oevc8jvmdlqd3fdm28tkfjveisw 2469247 2469246 2026-10-15T18:43:55Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cp2048.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2469247 wikitext text/x-wiki e9fu320jwggk9b1inhngpn2jr3ruzqq 2469248 2469247 2026-10-15T18:46:42Z Stashbot 7414 cdobbins@cumin1004: conftool action : set/pooled=no; selector: name=cp2047.* 2469248 wikitext text/x-wiki cusd0icfianlpwgia1n8jh4b7z2vdts 2469249 2469248 2026-10-15T18:46:46Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp2047'] 2469249 wikitext text/x-wiki o2vyna0s3cd6p3c5dljr3y4dukp06mu 2469250 2469249 2026-10-15T18:47:22Z Stashbot 7414 cdobbins@cumin1004: END (ERROR) - Cookbook sre.hardware.upgrade-firmware (exit_code=97) upgrade firmware for hosts ['cp2047'] 2469250 wikitext text/x-wiki tfz607m8a79ks0tmwhhebsuj8uqvdkr 2469251 2469250 2026-10-15T18:47:26Z Stashbot 7414 cdobbins@cumin1004: conftool action : set/pooled=yes; selector: name=cp2047.* 2469251 wikitext text/x-wiki 6c8fenibd0ga18q287ma258dxf0p4t8 2469252 2469251 2026-10-15T18:52:28Z Stashbot 7414 ladsgroup@deploy1003: Started scap sync-world: Backport for [[gerrit:1355713|Continuation of changes after the undeployment of FR on enwikibooks (T440519)]] 2469252 wikitext text/x-wiki go2xc4115njhtg7nys90o3bs8i4akmr 2469253 2469252 2026-10-15T18:54:11Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hosts.remove-downtime for cp2048.codfw.wmnet 2469253 wikitext text/x-wiki esigxo36w97rwyig3g4gazrrklf86xn 2469254 2469253 2026-10-15T18:54:13Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp2048.codfw.wmnet 2469254 wikitext text/x-wiki t08grgt8fh5atfpgnods3kra9spm9gc 2469255 2469254 2026-10-15T18:54:26Z Stashbot 7414 cdobbins@cumin1004: conftool action : set/pooled=yes; selector: name=cp2048.* 2469255 wikitext text/x-wiki 73wj00r52eir97of2gf6lnv68k4r3ww 2469256 2469255 2026-10-15T18:55:36Z Stashbot 7414 cdobbins@cumin1004: conftool action : set/pooled=no; selector: name=cp2049.* 2469256 wikitext text/x-wiki fw5x2xrul2ulbl6z2oswt3saamc65f8 2469257 2469256 2026-10-15T18:56:09Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cp2049.codfw.wmnet 2469257 wikitext text/x-wiki pai11rldtkgrdsd6dq8yiesjwewsnas 2469258 2469257 2026-10-15T18:56:35Z Stashbot 7414 ladsgroup@deploy1003: codenamenoreste, ladsgroup: Backport for [[gerrit:1355713|Continuation of changes after the undeployment of FR on enwikibooks (T440519)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2469258 wikitext text/x-wiki ra3qo41zuqtr8qgj9vuvrm8kbugqeh6 2469259 2469258 2026-10-15T18:58:08Z Stashbot 7414 ssastry@deploy1003: mwscript-k8s job started: initImageData.php --later-than=20261015081300 --earlier-than=20261015144032 --wiki=frwiki # T441345: run initImageData for pages edited after .24 deploy and before fix 2469259 wikitext text/x-wiki 0n5ld4ko7tgeswnsuezlgvutfuqwxcs 2469260 2469259 2026-10-15T18:58:38Z Stashbot 7414 ssastry@deploy1003: mwscript-k8s job started: initImageData.php --wiki=frwiki --later-than=20261015081300 --earlier-than=20261015144032 # T441345: run initImageData for pages edited after .24 deploy and before fix 2469260 wikitext text/x-wiki 9uft5a3aowb4o9b7734zprg48gozl33 2469261 2469260 2026-10-15T19:00:03Z Stashbot 7414 ladsgroup@deploy1003: codenamenoreste, ladsgroup: Continuing with deployment 2469261 wikitext text/x-wiki h19w4zyju0tfty4vy2li54reoofy4wt 2469262 2469261 2026-10-15T19:00:29Z Stashbot 7414 ssastry@deploy1003: mwscript-k8s job started: ./extensions/PageImages/maintenance/initImageData.php --wiki=frwiki --later-than=20261015081300 --earlier-than=20261015144032 # T441345: run initImageData for pages edited after .24 deploy and before fix 2469262 wikitext text/x-wiki 87d0jpn80065cwmo09zgcx0tmgss5mj 2469263 2469262 2026-10-15T19:00:57Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on sretest1006.eqiad.wmnet with reason: host reimage 2469263 wikitext text/x-wiki ak7bf9weyb1wrqboojfkmm3yqicvvcu 2469264 2469263 2026-10-15T19:01:49Z Stashbot 7414 cmooney@cumin1004: END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on sretest1006.eqiad.wmnet with reason: host reimage 2469264 wikitext text/x-wiki nlf5ixjy6sop5gduaba92r53k8fdg2f 2469265 2469264 2026-10-15T19:05:39Z Stashbot 7414 ladsgroup@deploy1003: Finished scap sync-world: Backport for [[gerrit:1355713|Continuation of changes after the undeployment of FR on enwikibooks (T440519)]] (duration: 13m 12s) 2469265 wikitext text/x-wiki taaywlohnjxa1vd6tansvccktz39jpk 2469266 2469265 2026-10-15T19:16:31Z Stashbot 7414 cdobbins@cumin1004: END (ERROR) - Cookbook sre.hardware.upgrade-firmware (exit_code=97) upgrade firmware for hosts cp2049.codfw.wmnet 2469266 wikitext text/x-wiki kauu0gb2od3v1vh173bsnt58my1ai2c 2469267 2469266 2026-10-15T19:16:41Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cp2049.codfw.wmnet 2469267 wikitext text/x-wiki ojar0rupwsc8jsgava5w9foghn9jo94 2469269 2469267 2026-10-15T19:23:58Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2469269 wikitext text/x-wiki 498hyqnjge7f7z7lxx7hwvpz18rseb3 2469270 2469269 2026-10-15T19:24:11Z Stashbot 7414 ssastry@deploy1003: mwscript-k8s job started: ./extensions/PageImages/maintenance/initImageData.php --wiki=frwiki --start=36374 --queue-pressure=20 --later-than=20261015081300 --earlier-than=20261015144032 # T441345: run initImageData for pages edited after .24 deploy and before fix 2469270 wikitext text/x-wiki hg70c06qk1257ylgfihjyr3xiyeur0n 2469272 2469270 2026-10-15T19:37:03Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sretest1006.eqiad.wmnet with OS trixie 2469272 wikitext text/x-wiki 8nw0bdhe4zfg1xt3lcq05vmgf9odoh3 2469273 2469272 2026-10-15T19:39:00Z Stashbot 7414 kemayo@deploy1003: helmfile [codfw] START helmfile.d/services/editcheck-headless: apply 2469273 wikitext text/x-wiki jc07hyi1urgwdptdfx22gzufdjyiwga 2469274 2469273 2026-10-15T19:39:35Z Stashbot 7414 kemayo@deploy1003: helmfile [codfw] DONE helmfile.d/services/editcheck-headless: apply 2469274 wikitext text/x-wiki hxm31ny0vn041k62uw3jng0aezsxvue 2469275 2469274 2026-10-15T19:40:13Z Stashbot 7414 kemayo@deploy1003: helmfile [eqiad] START helmfile.d/services/editcheck-headless: apply 2469275 wikitext text/x-wiki 5msxnmd9k20wxwtvyrnhudk6bbc8ahp 2469276 2469275 2026-10-15T19:40:48Z Stashbot 7414 kemayo@deploy1003: helmfile [eqiad] DONE helmfile.d/services/editcheck-headless: apply 2469276 wikitext text/x-wiki 6l4pufm0nqwbas92k1gqivj1fhk1u3n 2469277 2469276 2026-10-15T19:41:31Z Stashbot 7414 kemayo@deploy1003: helmfile [staging] START helmfile.d/services/changeprop-jobqueue: apply 2469277 wikitext text/x-wiki qjxox8ggtzlsv2gf5iq3m4qh0bbcs77 2469278 2469277 2026-10-15T19:41:40Z Stashbot 7414 kemayo@deploy1003: helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: apply 2469278 wikitext text/x-wiki c7ra8k1tihce8twx5tt72oqoxw4zurw 2469279 2469278 2026-10-15T19:42:09Z Stashbot 7414 kemayo@deploy1003: helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply 2469279 wikitext text/x-wiki dh75gvmznr24yaf3610jq689gtvhv4h 2469280 2469279 2026-10-15T19:42:56Z Stashbot 7414 kemayo@deploy1003: helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply 2469280 wikitext text/x-wiki jn9nqy1jqw18bimweqvmpfhwlc0blob 2469281 2469280 2026-10-15T19:43:32Z Stashbot 7414 kemayo@deploy1003: helmfile [eqiad] START helmfile.d/services/changeprop-jobqueue: apply 2469281 wikitext text/x-wiki 3knlo9euyln1xaay1tjv8z0x410z5si 2469282 2469281 2026-10-15T19:44:14Z Stashbot 7414 kemayo@deploy1003: helmfile [eqiad] DONE helmfile.d/services/changeprop-jobqueue: apply 2469282 wikitext text/x-wiki f9tk0rkocmmg50t0113wn047js2xj3a 2469283 2469282 2026-10-15T19:46:03Z Stashbot 7414 cdobbins@cumin1004: END (ERROR) - Cookbook sre.hardware.upgrade-firmware (exit_code=97) upgrade firmware for hosts cp2049.codfw.wmnet 2469283 wikitext text/x-wiki gms4saheiasfw1ckr89y5c7f3r9t6ap 2469284 2469283 2026-10-15T19:46:56Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2469284 wikitext text/x-wiki jjhiszlhcosaoywfp0uwuinvz2r9j9h 2469285 2469284 2026-10-15T19:46:58Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cp2049.codfw.wmnet 2469285 wikitext text/x-wiki iclb4u6dmjgrdc51d5aq6okcqtoq4xg 2469288 2469285 2026-10-15T19:48:37Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hosts.reboot-single for host cp2049.codfw.wmnet 2469288 wikitext text/x-wiki at8r9ys1855wu48k9zkdx25pwg970na 2469292 2469288 2026-10-15T20:02:50Z Stashbot 7414 kemayo@deploy1003: Started scap sync-world: Backport for [[gerrit:1355831|VisualEditor: Precompute edit suggestion counts on 50% of enwiki (T433024)]], [[gerrit:1355188|InitialiseSettings: enable return-to-app banner on all wikis (T439746)]] 2469292 wikitext text/x-wiki jozy59i6ev8heiazxakweom5axb6irh 2469293 2469292 2026-10-15T20:06:57Z Stashbot 7414 kemayo@deploy1003: kemayo, cklimas: Backport for [[gerrit:1355831|VisualEditor: Precompute edit suggestion counts on 50% of enwiki (T433024)]], [[gerrit:1355188|InitialiseSettings: enable return-to-app banner on all wikis (T439746)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2469293 wikitext text/x-wiki rtyaw5d73o1eng25kkf94s1yj9cqcrv 2469295 2469293 2026-10-15T20:11:01Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp2049.codfw.wmnet 2469295 wikitext text/x-wiki couq2ktxf1rwiyrpkgz2z84bw1i0lod 2469296 2469295 2026-10-15T20:11:03Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts cp2049.codfw.wmnet 2469296 wikitext text/x-wiki q9a1xlwrokyn7ncsab7dbainf0v6q3j 2469297 2469296 2026-10-15T20:12:06Z Stashbot 7414 kemayo@deploy1003: kemayo, cklimas: Continuing with deployment 2469297 wikitext text/x-wiki jwscq194wcx3pa5sfd9nlb5w2fq3fg7 2469298 2469297 2026-10-15T20:16:48Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs: apply 2469298 wikitext text/x-wiki 6w4bvn1nj20e4f1xxr3izscbzxqxrns 2469299 2469298 2026-10-15T20:17:33Z Stashbot 7414 kemayo@deploy1003: Finished scap sync-world: Backport for [[gerrit:1355831|VisualEditor: Precompute edit suggestion counts on 50% of enwiki (T433024)]], [[gerrit:1355188|InitialiseSettings: enable return-to-app banner on all wikis (T439746)]] (duration: 14m 43s) 2469299 wikitext text/x-wiki 7ffyx5jl5h4ra0z123f92f80w7ptrjy 2469300 2469299 2026-10-15T20:19:06Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hosts.provision for host cp2049.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2469300 wikitext text/x-wiki 6wd7brumvuy8o2mygnmh0px74q6e0bz 2469301 2469300 2026-10-15T20:32:15Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cp2049.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2469301 wikitext text/x-wiki jb7b7m44xin1up9dwsswwd7j2txr6m3 2469302 2469301 2026-10-15T20:34:07Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hosts.remove-downtime for cp2049.codfw.wmnet 2469302 wikitext text/x-wiki psnxof31didmtod43n1wg8s6p9s45kt 2469303 2469302 2026-10-15T20:34:09Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp2049.codfw.wmnet 2469303 wikitext text/x-wiki tcnc7y7m9ngx8vwsqde7lq2jn0j4mtp 2469304 2469303 2026-10-15T20:34:14Z Stashbot 7414 cdobbins@cumin1004: conftool action : set/pooled=yes; selector: name=cp2049.* 2469304 wikitext text/x-wiki m37ogelb8ik7ghrqto598m4abvjq9oa 2469305 2469304 2026-10-15T20:35:01Z Stashbot 7414 cdobbins@cumin1004: conftool action : set/pooled=no; selector: name=cp2047.* 2469305 wikitext text/x-wiki t41283guddk38w81o2ummdylmx4mld2 2469306 2469305 2026-10-15T20:35:11Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp2047'] 2469306 wikitext text/x-wiki 1t8dlasr61dg94k3oqmny4nwukb9wep 2469307 2469306 2026-10-15T20:35:42Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1349.eqiad.wmnet 2469307 wikitext text/x-wiki df8heu6i1p40e1lxdrnyjlpsn2n36nc 2469308 2469307 2026-10-15T20:35:43Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1349.eqiad.wmnet 2469308 wikitext text/x-wiki 44i9uj5wslmmppq3wdgqymfh6x6fzes 2469309 2469308 2026-10-15T20:35:45Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.enable_virtualization (exit_code=0) rolling provision on D{wikikube-worker[1330-1349].eqiad.wmnet} and (A:wikikube-master-eqiad or A:wikikube-worker-eqiad) 2469309 wikitext text/x-wiki 4ebbbgs0p4pgyqb6qw7u334rv1k1bsh 2469310 2469309 2026-10-15T20:43:31Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.enable_virtualization rolling provision on D{wikikube-worker[2341-2364].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) 2469310 wikitext text/x-wiki 68w1wpyrkwvmzdtyouvpjmt53f38ums 2469311 2469310 2026-10-15T20:43:34Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2341.codfw.wmnet 2469311 wikitext text/x-wiki 44f4e5pzpbsrcixje9sua0d6i1mzm3r 2469312 2469311 2026-10-15T20:43:42Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.enable_virtualization rolling provision on D{wikikube-worker[1350-1379].eqiad.wmnet} and (A:wikikube-master-eqiad or A:wikikube-worker-eqiad) 2469312 wikitext text/x-wiki g0f6y3n5qzhyd7q87fpkkc39zt0ray8 2469313 2469312 2026-10-15T20:43:46Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1350.eqiad.wmnet 2469313 wikitext text/x-wiki hihauw8pm6a2n5phvkgtqhxvrymdrp8 2469314 2469313 2026-10-15T20:44:10Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2341.codfw.wmnet 2469314 wikitext text/x-wiki ijz2it8x2r71fh1sqnvan4wvdpoo8q3 2469315 2469314 2026-10-15T20:44:22Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1350.eqiad.wmnet 2469315 wikitext text/x-wiki fiythjn27gtkfua65ayqasg1rxywj4d 2469316 2469315 2026-10-15T20:44:30Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2341.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469316 wikitext text/x-wiki bdl0d7av5tf9vq91cjh0qq7s7hga5aa 2469317 2469316 2026-10-15T20:44:43Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1350.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469317 wikitext text/x-wiki pcnczqa2v4z5z5jcgdx30wfrejkm98a 2469318 2469317 2026-10-15T20:48:30Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply 2469318 wikitext text/x-wiki 5d1siy1vmsmdbganplgl3o1jeiisdae 2469319 2469318 2026-10-15T20:51:08Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2341.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469319 wikitext text/x-wiki d8xn4538zloh1dckwvv0y93p9593fqy 2469320 2469319 2026-10-15T20:51:19Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1350.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469320 wikitext text/x-wiki 5vrfp0olazy45g4orn88ewwxfuu76d7 2469321 2469320 2026-10-15T20:51:47Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1350.eqiad.wmnet 2469321 wikitext text/x-wiki 6zhec3sij2epqvj7118ryjhzgs28fyu 2469322 2469321 2026-10-15T20:51:49Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1350.eqiad.wmnet 2469322 wikitext text/x-wiki 8xvg5iknngcl7dl6wdalk6e890ej5qa 2469323 2469322 2026-10-15T20:52:03Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1351.eqiad.wmnet 2469323 wikitext text/x-wiki 5gzr4ybm8q3psnedxv8dv5aujxg6rkk 2469324 2469323 2026-10-15T20:52:35Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1351.eqiad.wmnet 2469324 wikitext text/x-wiki 7tci85rgbwnrjhex1gqjs70a23qa2i4 2469325 2469324 2026-10-15T20:52:55Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1351.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469325 wikitext text/x-wiki p8zmq7kpa9799xgyycuvo9m8p0dnpqg 2469326 2469325 2026-10-15T20:54:06Z Stashbot 7414 cscott@deploy1003: Started scap sync-world: Backport for [[gerrit:1355821|Hand-patch forward-compatibility with Parsoid's new page bundle format (T441221)]] (1.47.0-wmf.23) 2469326 wikitext text/x-wiki cq07pupyafs6berh0ho9mq9qwb8hfey 2469327 2469326 2026-10-15T20:55:09Z Stashbot 7414 cscott@deploy1003: cscott: Backport for [[gerrit:1355821|Hand-patch forward-compatibility with Parsoid's new page bundle format (T441221)]] (1.47.0-wmf.23) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2469327 wikitext text/x-wiki 031hj8eszefl1j990bzz9600xirbvfi 2469329 2469327 2026-10-15T20:59:03Z Stashbot 7414 cscott@deploy1003: cscott: Continuing with deployment 2469329 wikitext text/x-wiki 4zrc9wwco5zhsiych3loeuvmdl0cpie 2469330 2469329 2026-10-15T20:59:31Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1351.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469330 wikitext text/x-wiki fgnre1kf9jr2lhmw5cici694zd51czs 2469331 2469330 2026-10-15T20:59:59Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1351.eqiad.wmnet 2469331 wikitext text/x-wiki lz5rcizrl82kq4m56rc1caywckxuk0y 2469332 2469331 2026-10-15T21:00:23Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1351.eqiad.wmnet 2469332 wikitext text/x-wiki qznk6pr5v68ojj19qqfd0bf0rfvi2bm 2469333 2469332 2026-10-15T21:00:36Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1352.eqiad.wmnet 2469333 wikitext text/x-wiki 5xea2y85yl4smav1m8xsztipfwwqz6p 2469334 2469333 2026-10-15T21:00:59Z Stashbot 7414 cscott@deploy1003: Finished scap sync-world: Backport for [[gerrit:1355821|Hand-patch forward-compatibility with Parsoid's new page bundle format (T441221)]] (1.47.0-wmf.23) (duration: 06m 53s) 2469334 wikitext text/x-wiki 3it4tyktc9ygirux41opj0qmr1ke6j4 2469335 2469334 2026-10-15T21:01:04Z Stashbot 7414 cdobbins@cumin1004: END (ERROR) - Cookbook sre.hardware.upgrade-firmware (exit_code=97) upgrade firmware for hosts ['cp2047'] 2469335 wikitext text/x-wiki j9zzr0ptvl781trursoy2ucn17m1anz 2469336 2469335 2026-10-15T21:01:09Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1352.eqiad.wmnet 2469336 wikitext text/x-wiki fpkom0pu29orwfxfm4l3rchvg3wz935 2469337 2469336 2026-10-15T21:01:11Z Stashbot 7414 cdobbins@cumin1004: conftool action : set/pooled=yes; selector: name=cp2047.* 2469337 wikitext text/x-wiki hauv1rzdq7pdih05gh3g4qy6g8krkfs 2469338 2469337 2026-10-15T21:01:26Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hosts.remove-downtime for cp2047.codfw.wmnet 2469338 wikitext text/x-wiki mrhogv2nt3eeejjzzrnh8ja3ssvseuc 2469339 2469338 2026-10-15T21:01:27Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp2047.codfw.wmnet 2469339 wikitext text/x-wiki 3cs2do57a7fowbjiwk8f8oatmvcu8ck 2469340 2469339 2026-10-15T21:01:29Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1352.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469340 wikitext text/x-wiki 1vsuful7cbhm58dlzxbl3m6kom20gok 2469341 2469340 2026-10-15T21:06:26Z Stashbot 7414 kemayo@deploy1003: Started scap sync-world: Backport for [[gerrit:1355871|Suggestion mode: tighten behavior of 'view more' button in publish card (T432622)]] (1.47.0-wmf.24) 2469341 wikitext text/x-wiki 964uyozenw3ijtezlk8wnkkn2zwkv2t 2469342 2469341 2026-10-15T21:08:06Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1352.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469342 wikitext text/x-wiki 2omyw38gmv6gq5wsmahosl6hq2m5c77 2469343 2469342 2026-10-15T21:08:39Z Stashbot 7414 kemayo@deploy1003: kemayo: Backport for [[gerrit:1355871|Suggestion mode: tighten behavior of 'view more' button in publish card (T432622)]] (1.47.0-wmf.24) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2469343 wikitext text/x-wiki 8lxkhkbyd2vg5ug2btqt31209n6nl5q 2469344 2469343 2026-10-15T21:10:23Z Stashbot 7414 kemayo@deploy1003: kemayo: Continuing with deployment 2469344 wikitext text/x-wiki 6dkaix940sh1wzmox3ihyno3051yvrk 2469346 2469344 2026-10-15T21:15:47Z Stashbot 7414 kemayo@deploy1003: Finished scap sync-world: Backport for [[gerrit:1355871|Suggestion mode: tighten behavior of 'view more' button in publish card (T432622)]] (1.47.0-wmf.24) (duration: 09m 20s) 2469346 wikitext text/x-wiki dz7d4se1szv9u07uawafy1yx74hbtx2 2469347 2469346 2026-10-15T21:22:53Z Stashbot 7414 cscott@deploy1003: Started scap sync-world: Backport for [[gerrit:1355877|Ensure that RefreshLinks::fixLinksFromArticle() runs secondary data updates (T441345)]] (1.47.0-wmf.24) 2469347 wikitext text/x-wiki 5mua1mplk402z3e4e6o1ef2g63iakhk 2469348 2469347 2026-10-15T21:23:36Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1352.eqiad.wmnet 2469348 wikitext text/x-wiki j1h379h6t5v6totrfxl5ojhb6ix01r1 2469349 2469348 2026-10-15T21:23:38Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1352.eqiad.wmnet 2469349 wikitext text/x-wiki rrsfchkcrhtrwlph3140bfgv2dtdhhj 2469350 2469349 2026-10-15T21:23:51Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1353.eqiad.wmnet 2469350 wikitext text/x-wiki 77hm777eddg3qlhdf8hdoqryv5siby5 2469351 2469350 2026-10-15T21:24:24Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1353.eqiad.wmnet 2469351 wikitext text/x-wiki jazii6byfya9y757ba9w6c61yi4em8k 2469352 2469351 2026-10-15T21:24:44Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1353.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469352 wikitext text/x-wiki pkp4empodinirh79sff1ioox9alpy6n 2469353 2469352 2026-10-15T21:25:02Z Stashbot 7414 cscott@deploy1003: cscott: Backport for [[gerrit:1355877|Ensure that RefreshLinks::fixLinksFromArticle() runs secondary data updates (T441345)]] (1.47.0-wmf.24) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2469353 wikitext text/x-wiki 3a48rb6whx3d29q68mzvh8kr2g3800w 2469354 2469353 2026-10-15T21:25:39Z Stashbot 7414 cscott@deploy1003: cscott: Continuing with deployment 2469354 wikitext text/x-wiki 3mlhnfdenqfsiz61o3jm3pc6c0yg7ol 2469355 2469354 2026-10-15T21:31:04Z Stashbot 7414 cscott@deploy1003: Finished scap sync-world: Backport for [[gerrit:1355877|Ensure that RefreshLinks::fixLinksFromArticle() runs secondary data updates (T441345)]] (1.47.0-wmf.24) (duration: 08m 11s) 2469355 wikitext text/x-wiki qkmyckbjs41niqqn1vs2u3qp82qiagt 2469356 2469355 2026-10-15T21:31:20Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1353.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469356 wikitext text/x-wiki dspnjvgaei3slw3tsjn9y4dj5t2yoib 2469357 2469356 2026-10-15T21:33:11Z Stashbot 7414 ssastry@deploy1003: mwscript-k8s job started: ./extensions/PageImages/maintenance/initImageData.php --wiki=frwiki --start=36374 --queue-pressure=20 --later-than=20261015081300 --earlier-than=20261015144032 # T441345: TAKE 2: frwiki: run initImageData for pages edited after .24 deploy and before fix 2469357 wikitext text/x-wiki szeda8zku1ypuwwoyr46fw2w2ztc8jf 2469358 2469357 2026-10-15T21:34:39Z Stashbot 7414 ssastry@deploy1003: mwscript-k8s job started: ./extensions/PageImages/maintenance/initImageData.php --wiki=frwiki --queue-pressure=20 --later-than=20261015081300 --earlier-than=20261015144032 # T441345: TAKE 2: frwiki: run initImageData for pages edited after .24 deploy and before fix 2469358 wikitext text/x-wiki jixnmgu45jvr2cfihaiefptsy80wl4u 2469359 2469358 2026-10-15T21:44:34Z Stashbot 7414 maryum: Deployed security fix for T439722, T440123, and T440119 2469359 wikitext text/x-wiki da8c8mtbhf4glno22c18pxmwhon7i8b 2469360 2469359 2026-10-15T21:58:06Z Stashbot 7414 ssastry@deploy1003: mwscript-k8s job started: ./extensions/PageImages/maintenance/initImageData.php --wiki=frwiki --queue-pressure=20 --later-than=20261015081300 # T441345: TAKE 3: frwiki: run initImageData for pages edited after .24 deploy and before fix 2469360 wikitext text/x-wiki mdmgdgkyoz68s3o2zxlam52s6bbh7hr 2469361 2469360 2026-10-15T22:08:03Z Stashbot 7414 sbassett: Deployed security patch for T437944 2469361 wikitext text/x-wiki bfqzbu9ecgsnjlh9dmroz4trl6ewma1 2469362 2469361 2026-10-15T22:24:19Z Stashbot 7414 sbassett: Deployed security fix for T439935 2469362 wikitext text/x-wiki 4aeog3qazid67gux8fky67dw7v1ufhk 2469363 2469362 2026-10-15T22:37:13Z Stashbot 7414 sbassett: Deployed security fix for T439859 2469363 wikitext text/x-wiki h2ynma8ycta575yxtpz4fshdosnqqdk 2469364 2469363 2026-10-15T22:51:56Z Stashbot 7414 sbassett: Deployed security fix for T440713 2469364 wikitext text/x-wiki oh3vzu4zlcdhlq9hwgapjxpf7fqxh6w 2469365 2469364 2026-10-15T23:03:03Z Stashbot 7414 pt1979@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['cp2047'] 2469365 wikitext text/x-wiki tbe1ci7c5zxsu6t7dgjzsq6s2299rnx 2469366 2469365 2026-10-15T23:08:10Z Stashbot 7414 sbassett: Deployed security fix for T441037 2469366 wikitext text/x-wiki 4ivxlldti94c1kaye7dr5sfyqbcvqh5 2469367 2469366 2026-10-15T23:11:58Z Stashbot 7414 zabe@deploy1003: Started scap sync-world: Backport for [[gerrit:1355930|Update interwiki cache (T441169)]] 2469367 wikitext text/x-wiki niyqfyaeig47rs7vr1tbfloo5xp0wxl 2469368 2469367 2026-10-15T23:15:59Z Stashbot 7414 zabe@deploy1003: zabe: Backport for [[gerrit:1355930|Update interwiki cache (T441169)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2469368 wikitext text/x-wiki ee7nfvfnfxvj0ccy8lh4e4s39bx0ijf 2469369 2469368 2026-10-15T23:19:35Z Stashbot 7414 zabe@deploy1003: zabe: Continuing with deployment 2469369 wikitext text/x-wiki qxri44nhfpcaqu7d7cjubc2gvzigkvv 2469370 2469369 2026-10-15T23:20:52Z Stashbot 7414 pt1979@cumin1004: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['cp2047'] 2469370 wikitext text/x-wiki ls8103njw3cxn18fz2kdpe4ytt9d50w 2469371 2469370 2026-10-15T23:25:00Z Stashbot 7414 zabe@deploy1003: Finished scap sync-world: Backport for [[gerrit:1355930|Update interwiki cache (T441169)]] (duration: 13m 02s) 2469371 wikitext text/x-wiki 7glvbbt8uauabxml1k7w5pj71ktdhjz 2469373 2469371 2026-10-15T23:32:04Z Stashbot 7414 kemayo@deploy1003: Started scap sync-world: Backport for [[gerrit:1355883|EditCheck: Use binary search to match annotations to modified ranges]] (1.47.0-wmf.24) 2469373 wikitext text/x-wiki e3kd11dmw5y7fh59xldv6f56z39essn 2469374 2469373 2026-10-15T23:36:06Z Stashbot 7414 kemayo@deploy1003: kemayo: Backport for [[gerrit:1355883|EditCheck: Use binary search to match annotations to modified ranges]] (1.47.0-wmf.24) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2469374 wikitext text/x-wiki epzrpkonaeqybxbk8g04au9sdwtqxjz 2469375 2469374 2026-10-15T23:37:10Z Stashbot 7414 kemayo@deploy1003: kemayo: Continuing with deployment 2469375 wikitext text/x-wiki s5djk3r7ilkv6ufwe18alr6bijt3wpa 2469376 2469375 2026-10-15T23:42:34Z Stashbot 7414 kemayo@deploy1003: Finished scap sync-world: Backport for [[gerrit:1355883|EditCheck: Use binary search to match annotations to modified ranges]] (1.47.0-wmf.24) (duration: 10m 29s) 2469376 wikitext text/x-wiki ktskskh4aw5n8klpc1x1kf4y71bh1vq 2469379 2469376 2026-10-16T00:00:07Z Stashbot 7414 root@deploy1003: helmfile [staging] START helmfile.d/services/shellbox: sync 2469379 wikitext text/x-wiki tjlnc7imgazajy3dl2oovnfiy8f4qa7 2469380 2469379 2026-10-16T00:00:15Z Stashbot 7414 root@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox: sync 2469380 wikitext text/x-wiki l00gy7owikp5i5ddvj9dji1s3cinv8l 2469381 2469380 2026-10-16T00:00:18Z Stashbot 7414 root@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-timeline: sync 2469381 wikitext text/x-wiki jgsee1o03seg6kq90cglv79ck4lp5hj 2469382 2469381 2026-10-16T00:00:26Z Stashbot 7414 root@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-timeline: sync 2469382 wikitext text/x-wiki 4lfmjum514ss743635kbf2l64h8wvo8 2469384 2469382 2026-10-16T02:00:32Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2469384 wikitext text/x-wiki 6w06t2v81ivh44ri4sxj0qg2b9jrbmr 2469385 2469384 2026-10-16T02:08:10Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 07m 38s) 2469385 wikitext text/x-wiki fz31ryr82maw2r10508gznkvy52snr8 2469386 2469385 2026-10-16T04:02:34Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1353.eqiad.wmnet 2469386 wikitext text/x-wiki kevr75774hagxy2vjidipky7vl1mqaj 2469387 2469386 2026-10-16T04:02:37Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1353.eqiad.wmnet 2469387 wikitext text/x-wiki ti3d88lw5iofel69yv6mmgvmiivoxw5 2469388 2469387 2026-10-16T04:02:42Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2341.codfw.wmnet 2469388 wikitext text/x-wiki kn4onrr6j9yaffmlr6gc55f0wewdf9z 2469389 2469388 2026-10-16T04:02:45Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2341.codfw.wmnet 2469389 wikitext text/x-wiki b4aowbod4skpprakzcshqyq10pluoak 2469390 2469389 2026-10-16T04:02:49Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1354.eqiad.wmnet 2469390 wikitext text/x-wiki izdy20rk34hxem6q8tyz33tyibedg95 2469391 2469390 2026-10-16T04:02:58Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2342.codfw.wmnet 2469391 wikitext text/x-wiki ndj47u1y3odwcyajcmnouu3dtjdg7sx 2469392 2469391 2026-10-16T04:03:24Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1354.eqiad.wmnet 2469392 wikitext text/x-wiki 5hqhm064na1a1xw7mp37m91hfxj1pup 2469393 2469392 2026-10-16T04:03:33Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2342.codfw.wmnet 2469393 wikitext text/x-wiki 2mp42b6sk77okjfcde7oegaxuf397o7 2469394 2469393 2026-10-16T04:03:44Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1354.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469394 wikitext text/x-wiki 6wcb20rulkluk875kx5l8tipbi785kn 2469395 2469394 2026-10-16T04:03:52Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2342.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469395 wikitext text/x-wiki f4934po8dxcdc7t4ggfs4zlormjzazy 2469396 2469395 2026-10-16T04:10:20Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1354.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469396 wikitext text/x-wiki 0ffbnu19t4091uy1s3rgg6p2tl92ptk 2469397 2469396 2026-10-16T04:10:31Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2342.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469397 wikitext text/x-wiki ilitolqftcg074jjjm6j3i7grtksgig 2469398 2469397 2026-10-16T04:25:50Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1354.eqiad.wmnet 2469398 wikitext text/x-wiki p56zhdmozqucfhg7zcmiezk0von07ea 2469399 2469398 2026-10-16T04:25:52Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1354.eqiad.wmnet 2469399 wikitext text/x-wiki r2dsbkdmgerzem9ntqyjz0vkkkuxu1y 2469400 2469399 2026-10-16T04:26:05Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1355.eqiad.wmnet 2469400 wikitext text/x-wiki f6hoz0d1vyezb4w6rb62jmup2x0893t 2469401 2469400 2026-10-16T04:26:39Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1355.eqiad.wmnet 2469401 wikitext text/x-wiki s8wagncucmzxciffo3exlw8z8k1gool 2469402 2469401 2026-10-16T04:26:58Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1355.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469402 wikitext text/x-wiki lcq43k6nfgtwx17o2wof5z5249zgqnb 2469403 2469402 2026-10-16T04:33:35Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1355.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469403 wikitext text/x-wiki dr3kbddigv9xalq4w3jruijcopb4h6e 2469404 2469403 2026-10-16T04:34:03Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1355.eqiad.wmnet 2469404 wikitext text/x-wiki 92oxa6u9o5khhhaoyv8x7p4zpye8gwq 2469405 2469404 2026-10-16T04:34:05Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1355.eqiad.wmnet 2469405 wikitext text/x-wiki m68qg28n18mdvtmgco85xgk9ol8p3t8 2469406 2469405 2026-10-16T04:34:19Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1356.eqiad.wmnet 2469406 wikitext text/x-wiki 0ze7jjht2eos0r577g8lt2ru1seccx5 2469407 2469406 2026-10-16T04:34:52Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1356.eqiad.wmnet 2469407 wikitext text/x-wiki fyd9uva8v3s6vo3y8j1c4i2i57prj7f 2469408 2469407 2026-10-16T04:35:12Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1356.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469408 wikitext text/x-wiki 8d7s8r01ln9sq8yiob1yt1tpxvo4lvh 2469409 2469408 2026-10-16T04:41:48Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1356.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469409 wikitext text/x-wiki sqlkakk9a1rz33jy0zk9pfrly6ehk3u 2469410 2469409 2026-10-16T04:55:49Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2342.codfw.wmnet 2469410 wikitext text/x-wiki 6odaz1o0cq3s1dre1b26o4kiaunezrq 2469411 2469410 2026-10-16T04:55:51Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2342.codfw.wmnet 2469411 wikitext text/x-wiki 0xe56wiigt1srim5dr44p6ps1l36ouw 2469412 2469411 2026-10-16T04:56:04Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2343.codfw.wmnet 2469412 wikitext text/x-wiki k34oc5inn87luvc62l5qv3hkde3cygm 2469413 2469412 2026-10-16T04:56:38Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2343.codfw.wmnet 2469413 wikitext text/x-wiki fkc4lkgqmql521lcv33geclymhf7a5o 2469414 2469413 2026-10-16T04:56:59Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2343.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469414 wikitext text/x-wiki lxflb2if0d38eafvatx8lgofq8ycy7f 2469415 2469414 2026-10-16T05:03:39Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2343.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469415 wikitext text/x-wiki bvqc37aqegqvl2fqbz0orihjanjo0u3 2469416 2469415 2026-10-16T05:04:07Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2343.codfw.wmnet 2469416 wikitext text/x-wiki t4l07kr2bd4358uawkj2tlkh5gx9yil 2469417 2469416 2026-10-16T05:04:09Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2343.codfw.wmnet 2469417 wikitext text/x-wiki pvkj3byn82qeuk4l3osiiybv33wqk0b 2469418 2469417 2026-10-16T05:04:23Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2344.codfw.wmnet 2469418 wikitext text/x-wiki 2d653i2vefkz2j7hvk1pa3i6tss69v3 2469419 2469418 2026-10-16T05:04:58Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2344.codfw.wmnet 2469419 wikitext text/x-wiki 83p9kzd84wplv6e7zjikjboqyelolmo 2469420 2469419 2026-10-16T05:05:19Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2344.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469420 wikitext text/x-wiki stdvi79gxqufk4s0y85citul9jceyvz 2469421 2469420 2026-10-16T05:11:56Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2344.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469421 wikitext text/x-wiki o7oeerhour65v3wy8t8y80ob0ymefkn 2469422 2469421 2026-10-16T05:21:39Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1356.eqiad.wmnet 2469422 wikitext text/x-wiki nko9ytx3f96qulw03gl68i224wf9cx9 2469423 2469422 2026-10-16T05:21:41Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1356.eqiad.wmnet 2469423 wikitext text/x-wiki i15qssaqa72cgdye70sh69h77acqlq3 2469424 2469423 2026-10-16T05:21:54Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1357.eqiad.wmnet 2469424 wikitext text/x-wiki exvtdycy34vww6ujmyq8lb6xg0v2n2k 2469425 2469424 2026-10-16T05:22:27Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1357.eqiad.wmnet 2469425 wikitext text/x-wiki azrfiv8jw845iuocho70v3ckenaseh2 2469426 2469425 2026-10-16T05:22:47Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1357.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469426 wikitext text/x-wiki oprgo18li7m2uy69qexo4llj439pwsh 2469427 2469426 2026-10-16T05:22:54Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2344.codfw.wmnet 2469427 wikitext text/x-wiki 4yyo945ttmh7i4cytz56ym07sxp2wu9 2469428 2469427 2026-10-16T05:22:56Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2344.codfw.wmnet 2469428 wikitext text/x-wiki 21xdh4clboo2v4numtsv57nv6xumpaw 2469429 2469428 2026-10-16T05:23:10Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2345.codfw.wmnet 2469429 wikitext text/x-wiki 81uk8e5o4opvakf42648i6dc1xi8fkw 2469430 2469429 2026-10-16T05:23:45Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2345.codfw.wmnet 2469430 wikitext text/x-wiki oibieagvwhmpvjygwzq8c2lb2l1dufb 2469431 2469430 2026-10-16T05:24:05Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2345.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469431 wikitext text/x-wiki 5hcy0o2pz6ncq2wp8kfugr9ylvn1ni4 2469432 2469431 2026-10-16T05:29:23Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1357.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469432 wikitext text/x-wiki gazkba9v51jgaafq4dlrttw3b4ygfnj 2469433 2469432 2026-10-16T05:30:42Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2345.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469433 wikitext text/x-wiki dx1r7dg9udttwdjoqxb5zu4zpeftbaj 2469434 2469433 2026-10-16T05:31:09Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2345.codfw.wmnet 2469434 wikitext text/x-wiki d7l1y2cnr51afgspb3wjom0hk8p7txd 2469435 2469434 2026-10-16T05:31:11Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2345.codfw.wmnet 2469435 wikitext text/x-wiki sipkj2h7vw0br3f97grhcap9v742ebm 2469436 2469435 2026-10-16T05:31:25Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2346.codfw.wmnet 2469436 wikitext text/x-wiki 3rnuvo2yverp2zwblgathf7dlp1kelp 2469437 2469436 2026-10-16T05:32:00Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2346.codfw.wmnet 2469437 wikitext text/x-wiki kby1ne9rnjuny9cvp25fcapq6sra8ia 2469438 2469437 2026-10-16T05:32:20Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2346.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469438 wikitext text/x-wiki hl7hbldm05ouj33p0de8h496n106owl 2469439 2469438 2026-10-16T05:36:39Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1162.eqiad.wmnet with reason: Maintenance 2469439 wikitext text/x-wiki t116vmq2rnbmxyyongkbw3v2czbndk0 2469440 2469439 2026-10-16T05:38:34Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2168.codfw.wmnet with reason: Maintenance 2469440 wikitext text/x-wiki 76fb3pug4kviigstqpwg8lllymel36v 2469441 2469440 2026-10-16T05:39:00Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2346.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469441 wikitext text/x-wiki dhhaoqjfz3v09gnbv1d2j8rsf6v8ziu 2469442 2469441 2026-10-16T05:39:01Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2169.codfw.wmnet with reason: Maintenance 2469442 wikitext text/x-wiki e8ujkv3ptdr4egbk7pn9ji953tn9nxp 2469443 2469442 2026-10-16T05:39:27Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2182.codfw.wmnet with reason: Maintenance 2469443 wikitext text/x-wiki 6qd331ct1vpmpoqu05z9wnwixfjycj6 2469444 2469443 2026-10-16T05:39:54Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2198.codfw.wmnet with reason: Maintenance 2469444 wikitext text/x-wiki qsge8oewduzdtzniz23p2itdrnnia0w 2469445 2469444 2026-10-16T05:40:19Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1357.eqiad.wmnet 2469445 wikitext text/x-wiki pjosx0vh9mekcrfu8zcx0yj52iu9bon 2469446 2469445 2026-10-16T05:40:21Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1357.eqiad.wmnet 2469446 wikitext text/x-wiki 62344bcz2xwwbv5lhnppnwp1ijadnia 2469447 2469446 2026-10-16T05:40:23Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2200.codfw.wmnet with reason: Maintenance 2469447 wikitext text/x-wiki d1exindxwgtn1l9qpm6fm9h09fnjr49 2469448 2469447 2026-10-16T05:40:34Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1358.eqiad.wmnet 2469448 wikitext text/x-wiki iah1y4cq7nxzclrj6kfuw6mke3jfmxa 2469449 2469448 2026-10-16T05:40:49Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2208.codfw.wmnet with reason: Maintenance 2469449 wikitext text/x-wiki 6r4v663f1icd7pm97yre3qilt4fdliv 2469450 2469449 2026-10-16T05:41:01Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2346.codfw.wmnet 2469450 wikitext text/x-wiki ksu1cq5a7z1dawfb8fyfdjrn811ucgp 2469451 2469450 2026-10-16T05:41:03Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2346.codfw.wmnet 2469451 wikitext text/x-wiki m673zx0zhs3w9yo9z2338x6ioicqpne 2469452 2469451 2026-10-16T05:41:06Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2218.codfw.wmnet with reason: Maintenance 2469452 wikitext text/x-wiki pg63llkgqq7qmxwgmo29h2ldhmtvd1d 2469453 2469452 2026-10-16T05:41:08Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1358.eqiad.wmnet 2469453 wikitext text/x-wiki kxlm4twj4vmax3jaqembdg6xzrb7ox7 2469454 2469453 2026-10-16T05:41:16Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2347.codfw.wmnet 2469454 wikitext text/x-wiki lmymniiymuy0i1ad1z5s33pjn418iq7 2469455 2469454 2026-10-16T05:41:26Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1358.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469455 wikitext text/x-wiki 80rofysqjrwcpxeobf3bkkws7jpo8ez 2469456 2469455 2026-10-16T05:41:33Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2220.codfw.wmnet with reason: Maintenance 2469456 wikitext text/x-wiki c0hp8hsfxfeb5b9ccebm9s6g0u98y31 2469457 2469456 2026-10-16T05:41:50Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2347.codfw.wmnet 2469457 wikitext text/x-wiki omin8vmw8x1haom4692p0n6yd2bh264 2469458 2469457 2026-10-16T05:42:00Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2221.codfw.wmnet with reason: Maintenance 2469458 wikitext text/x-wiki 4sd9ggiwjj71yvssnrly27yjuv9uqk1 2469459 2469458 2026-10-16T05:42:10Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2347.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469459 wikitext text/x-wiki rgsy2dasof1c61sdwepsv0n7gtgdqsb 2469460 2469459 2026-10-16T05:42:16Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2222.codfw.wmnet with reason: Maintenance 2469460 wikitext text/x-wiki 2fy7em65japhssybg7g1it702p4bych 2469461 2469460 2026-10-16T05:42:44Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2228.codfw.wmnet with reason: Maintenance 2469461 wikitext text/x-wiki ovs6i5neodapsrxqsmq4jt6e9hgtwlv 2469462 2469461 2026-10-16T05:44:31Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2159.codfw.wmnet with reason: Maintenance 2469462 wikitext text/x-wiki prkxvzq8ymu8leqivujng725eci2mv2 2469463 2469462 2026-10-16T05:44:56Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1158.eqiad.wmnet with reason: Maintenance 2469463 wikitext text/x-wiki b5o6qw9u090uoyv4zgx5trzwwom4j6p 2469464 2469463 2026-10-16T05:45:15Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1170.eqiad.wmnet with reason: Maintenance 2469464 wikitext text/x-wiki j15u6usrodlphuaf9p54ks2n1mtw1nv 2469465 2469464 2026-10-16T05:45:49Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1174.eqiad.wmnet with reason: Maintenance 2469465 wikitext text/x-wiki 4ti58iuvaw45jbgx14nksnmhgjz64yr 2469466 2469465 2026-10-16T05:45:56Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1181.eqiad.wmnet with reason: Maintenance 2469466 wikitext text/x-wiki l05098egsmjx7cyxnjo2541ustiirv8 2469467 2469466 2026-10-16T05:46:16Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1190.eqiad.wmnet with reason: Maintenance 2469467 wikitext text/x-wiki r0hndnyfwxhkqklurdtfbis5yhv7l3u 2469468 2469467 2026-10-16T05:46:35Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1191.eqiad.wmnet with reason: Maintenance 2469468 wikitext text/x-wiki 5df78jm1n8l9k4n170t9hwdzwzk64z5 2469469 2469468 2026-10-16T05:46:54Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1194.eqiad.wmnet with reason: Maintenance 2469469 wikitext text/x-wiki e1hi46jmctap344mv6o3q02yvgrg0b1 2469470 2469469 2026-10-16T05:47:13Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1202.eqiad.wmnet with reason: Maintenance 2469470 wikitext text/x-wiki hasdbssq2mmynbgolhyflotetf54l9g 2469471 2469470 2026-10-16T05:47:32Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1227.eqiad.wmnet with reason: Maintenance 2469471 wikitext text/x-wiki g0xk5l9aijkn6qgrxps16dsgeydq7ns 2469472 2469471 2026-10-16T05:47:54Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1231.eqiad.wmnet with reason: Maintenance 2469472 wikitext text/x-wiki 5kqjchb0rmfk93d98juz6xb1c0i6taf 2469473 2469472 2026-10-16T05:48:02Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1358.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469473 wikitext text/x-wiki 2a50h3k6aohjcmuwmuf1l2vdmq1bwed 2469474 2469473 2026-10-16T05:48:12Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1253.eqiad.wmnet with reason: Maintenance 2469474 wikitext text/x-wiki qxqdoacgz6mo6unkyzifg04ffmmzd0q 2469475 2469474 2026-10-16T05:48:32Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1273.eqiad.wmnet with reason: Maintenance 2469475 wikitext text/x-wiki 34kj7k3h05e8b7lkkg0a0x6ketuo82g 2469476 2469475 2026-10-16T05:48:44Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2347.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469476 wikitext text/x-wiki 70jnslho4fph44iwu6eblh8ruhjrosg 2469477 2469476 2026-10-16T05:48:54Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 7 hosts with reason: Maintenance 2469477 wikitext text/x-wiki 3knf35hiw5x1sjx3nwwkk3wsir1kegf 2469478 2469477 2026-10-16T05:49:11Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2347.codfw.wmnet 2469478 wikitext text/x-wiki czclwd242l0u8li845unu8o0gyhf9t7 2469479 2469478 2026-10-16T05:49:13Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1284.eqiad.wmnet with reason: Maintenance 2469479 wikitext text/x-wiki 3o92jr0vxjl0m0nlqfmxf2t6r31aqi2 2469480 2469479 2026-10-16T05:49:30Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1285.eqiad.wmnet with reason: Maintenance 2469480 wikitext text/x-wiki 4442odw2w3ojg3g250xvc5c8qvqpqhv 2469481 2469480 2026-10-16T05:49:37Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2347.codfw.wmnet 2469481 wikitext text/x-wiki bf4xpvllagbd8p7y7nkiv673walqbc1 2469482 2469481 2026-10-16T05:49:39Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1358.eqiad.wmnet 2469482 wikitext text/x-wiki a0l5otjfbw7i47b27ftpi5oy76wx4kk 2469483 2469482 2026-10-16T05:49:41Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1358.eqiad.wmnet 2469483 wikitext text/x-wiki qnxb2opqczqhweolnbif80s3q50zqj5 2469484 2469483 2026-10-16T05:49:49Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1288.eqiad.wmnet with reason: Maintenance 2469484 wikitext text/x-wiki dc9ak0msw01g8of38w8j0vz7mrhcrpc 2469485 2469484 2026-10-16T05:49:50Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2348.codfw.wmnet 2469485 wikitext text/x-wiki 2x381fnlmumol6rk19dcdp856qwsfq2 2469486 2469485 2026-10-16T05:49:55Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1359.eqiad.wmnet 2469486 wikitext text/x-wiki ttjmd0r3x9u7x3gwr2lmlyi72r2kmvk 2469487 2469486 2026-10-16T05:50:11Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on dbstore1008.eqiad.wmnet with reason: Maintenance 2469487 wikitext text/x-wiki khwikza1n3xft4296zjpxmo7kxmfqvo 2469488 2469487 2026-10-16T05:50:26Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2348.codfw.wmnet 2469488 wikitext text/x-wiki ecxjxn94h04yhzc7depcgphppnvltwm 2469489 2469488 2026-10-16T05:50:30Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1359.eqiad.wmnet 2469489 wikitext text/x-wiki 6zyy0lzdxr5fl4vxwikn0wptd8t1o5r 2469490 2469489 2026-10-16T05:50:45Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2348.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469490 wikitext text/x-wiki 0iqy3xsbs68knr9oh2i6ua63029v8zd 2469491 2469490 2026-10-16T05:50:49Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1359.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469491 wikitext text/x-wiki 0dwb5hho3q6giqdtusfmqvewsb3ltv9 2469492 2469491 2026-10-16T05:52:54Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1236.eqiad.wmnet with reason: Maintenance 2469492 wikitext text/x-wiki im2m89q16wikck07l8p5h9c0ulbcxyw 2469493 2469492 2026-10-16T05:53:24Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2168.codfw.wmnet with reason: Maintenance 2469493 wikitext text/x-wiki dijfe3pppe56k6aqljj5d6hr0kflo25 2469494 2469493 2026-10-16T05:53:31Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2169.codfw.wmnet with reason: Maintenance 2469494 wikitext text/x-wiki rbowgj6xf8lweltojxnadpg6tei3mhp 2469495 2469494 2026-10-16T05:53:38Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2182.codfw.wmnet with reason: Maintenance 2469495 wikitext text/x-wiki avqaoad9khbb7tov2ud5wvehyamzav5 2469496 2469495 2026-10-16T05:53:46Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2198.codfw.wmnet with reason: Maintenance 2469496 wikitext text/x-wiki essas7h7r63jd16uinoyeyo3m1hi12j 2469497 2469496 2026-10-16T05:53:53Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2200.codfw.wmnet with reason: Maintenance 2469497 wikitext text/x-wiki nl2zckhjh8xcqxc5ir7wfck2a0083er 2469498 2469497 2026-10-16T05:54:28Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2156.codfw.wmnet with reason: Maintenance 2469498 wikitext text/x-wiki fqbswm4v8dfgj0nz70rf48pge1ehhrp 2469499 2469498 2026-10-16T05:57:23Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2348.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469499 wikitext text/x-wiki t07t74dh5t7a7qj79yxnrgp0yjdt4rj 2469500 2469499 2026-10-16T05:57:26Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1359.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469500 wikitext text/x-wiki 65wukadxj9szy195p2juvwox8p0ezem 2469501 2469500 2026-10-16T05:59:01Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2348.codfw.wmnet 2469501 wikitext text/x-wiki k6prztlb8sdqgkm0sdwc1zvrzjoi53k 2469502 2469501 2026-10-16T05:59:04Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2348.codfw.wmnet 2469502 wikitext text/x-wiki h258frjk801kzfl1c3jmoz1ctnn7elk 2469503 2469502 2026-10-16T05:59:17Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2349.codfw.wmnet 2469503 wikitext text/x-wiki as38xohqj46lhphf9u16dih12is8mpi 2469504 2469503 2026-10-16T05:59:52Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2349.codfw.wmnet 2469504 wikitext text/x-wiki kgsued9muyyzzke7of99xxcib4sjw20 2469505 2469504 2026-10-16T05:59:56Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1359.eqiad.wmnet 2469505 wikitext text/x-wiki g6grmapumc8m7h8ha6evlsgrl21nr84 2469506 2469505 2026-10-16T05:59:57Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1359.eqiad.wmnet 2469506 wikitext text/x-wiki ints3mj0yxjnybtw3hee420t74kur11 2469507 2469506 2026-10-16T06:00:11Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1360.eqiad.wmnet 2469507 wikitext text/x-wiki 8c4z5a5qb2n0qlstkpp69giwzf6z8in 2469508 2469507 2026-10-16T06:00:12Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2349.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469508 wikitext text/x-wiki czbpt4xzluojkj5vbvakt4x9vhpepvr 2469509 2469508 2026-10-16T06:00:46Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1360.eqiad.wmnet 2469509 wikitext text/x-wiki db5std6vobqnh0ritttyio1ukjwh37x 2469510 2469509 2026-10-16T06:01:05Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1360.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469510 wikitext text/x-wiki ldmal25zisejokccjg25lb6c3o0sw8f 2469511 2469510 2026-10-16T06:06:52Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2349.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469511 wikitext text/x-wiki g6nvsfoiiy5znqnbhavijfhou6108ws 2469512 2469511 2026-10-16T06:07:11Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2349.codfw.wmnet 2469512 wikitext text/x-wiki bwcay6gf5megpsx8faipz4tqnn0wzfs 2469513 2469512 2026-10-16T06:07:13Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2349.codfw.wmnet 2469513 wikitext text/x-wiki qn1q6hild3y9ywnupxux1v6pz3sfrop 2469514 2469513 2026-10-16T06:07:27Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2350.codfw.wmnet 2469514 wikitext text/x-wiki t3gtcn5bdcjnl792hxhb7wu8rc0hqcl 2469515 2469514 2026-10-16T06:07:31Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2177.codfw.wmnet with reason: Maintenance 2469515 wikitext text/x-wiki kpl6mw7mmqb753ci9yg5patvg5fa1hi 2469516 2469515 2026-10-16T06:07:39Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1360.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469516 wikitext text/x-wiki i3anf2xtsh1cig01822cj9ye6ncbqyf 2469517 2469516 2026-10-16T06:08:06Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2350.codfw.wmnet 2469517 wikitext text/x-wiki bv79fg77prypsbmuiplsa6muxlip19q 2469518 2469517 2026-10-16T06:08:25Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2350.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469518 wikitext text/x-wiki lwlnrei0le6t036ifeu68xvyk39z5q9 2469519 2469518 2026-10-16T06:14:59Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2350.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469519 wikitext text/x-wiki qiduxmdzdgvn9cm8rbdmz844kpxoi2q 2469520 2469519 2026-10-16T06:15:27Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2350.codfw.wmnet 2469520 wikitext text/x-wiki 8mtxy4dljkjsig2kezfy7je0plrejko 2469521 2469520 2026-10-16T06:15:29Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2350.codfw.wmnet 2469521 wikitext text/x-wiki pvi7vo656dyp3dl4qqqzgxtqwf64zt1 2469522 2469521 2026-10-16T06:15:43Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1360.eqiad.wmnet 2469522 wikitext text/x-wiki hu7w1rgylefl74wz92g3lzqbtj4kaxd 2469523 2469522 2026-10-16T06:15:45Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2351.codfw.wmnet 2469523 wikitext text/x-wiki 839o1g517d2ddlglmhpigiusb2zg726 2469524 2469523 2026-10-16T06:15:47Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1360.eqiad.wmnet 2469524 wikitext text/x-wiki 6hxcq6176k59gcbua5wi38c7tc0phsm 2469525 2469524 2026-10-16T06:15:58Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1361.eqiad.wmnet 2469525 wikitext text/x-wiki 3se63kdrg9fzox0uwg6ulzi023h5oaw 2469526 2469525 2026-10-16T06:16:34Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1361.eqiad.wmnet 2469526 wikitext text/x-wiki qupblwp37sxopnq6miv5ssknos0h6yf 2469527 2469526 2026-10-16T06:16:54Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1361.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469527 wikitext text/x-wiki ok4b9mxldz5ohvnumvgxbd56ry8gjhq 2469528 2469527 2026-10-16T06:16:56Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2351.codfw.wmnet 2469528 wikitext text/x-wiki 5ph5thcch91iatiqkximwwsb1rij5bp 2469529 2469528 2026-10-16T06:17:15Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2351.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469529 wikitext text/x-wiki 8tjt0s1xhgia5wlnori6z89vswm9ri8 2469530 2469529 2026-10-16T06:20:30Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2190.codfw.wmnet with reason: Maintenance 2469530 wikitext text/x-wiki mfzlc8tqjgjyggmy7gvtd9cnpm99h5o 2469531 2469530 2026-10-16T06:23:28Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1361.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469531 wikitext text/x-wiki gfcfu4vxmvmutq0x2dzw1tl3mrw3rs7 2469532 2469531 2026-10-16T06:23:49Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2351.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469532 wikitext text/x-wiki e246m1iyvzdxw53b288g5am3tgbo1h7 2469533 2469532 2026-10-16T06:23:56Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1361.eqiad.wmnet 2469533 wikitext text/x-wiki ninorheszen4nnroh63g1rwsuclsip4 2469534 2469533 2026-10-16T06:23:57Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1361.eqiad.wmnet 2469534 wikitext text/x-wiki 113bn7x0etqu855im01wy3j56a0cmej 2469535 2469534 2026-10-16T06:24:11Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1362.eqiad.wmnet 2469535 wikitext text/x-wiki n2jb178gmxslz0o76g39y7kapts7utj 2469536 2469535 2026-10-16T06:24:17Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2351.codfw.wmnet 2469536 wikitext text/x-wiki 022rbaf1kk718viyt319aacmobvihs5 2469537 2469536 2026-10-16T06:24:19Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2351.codfw.wmnet 2469537 wikitext text/x-wiki 8mgv3p88iusp6fs25tho9cwt9acj54t 2469538 2469537 2026-10-16T06:24:33Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2352.codfw.wmnet 2469538 wikitext text/x-wiki trvcqdtmqw0g3o0s25bdp2117f43cjg 2469539 2469538 2026-10-16T06:24:44Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1362.eqiad.wmnet 2469539 wikitext text/x-wiki 0tolbhnfxxjbiilqp6g6jao7f7lcbra 2469540 2469539 2026-10-16T06:25:04Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1362.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469540 wikitext text/x-wiki 4nb8zylrha433qmoaefr2jbyfwvtgww 2469541 2469540 2026-10-16T06:25:09Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2352.codfw.wmnet 2469541 wikitext text/x-wiki hjf6l7hv8ows5wjqdhou6mm65zqu5bq 2469542 2469541 2026-10-16T06:25:29Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2352.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469542 wikitext text/x-wiki og3ely4lo7vco47ezsmd0smibiihpz3 2469543 2469542 2026-10-16T06:31:39Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1362.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469543 wikitext text/x-wiki ewp3yx5qwcy6uaxm2hama69baj8fxig 2469544 2469543 2026-10-16T06:32:03Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2352.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469544 wikitext text/x-wiki 9jzgiepynghbjjt33gkldd2021kzc7h 2469545 2469544 2026-10-16T06:32:21Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2352.codfw.wmnet 2469545 wikitext text/x-wiki g7ki36a1w405v4tzozqsg563bedcuky 2469546 2469545 2026-10-16T06:32:55Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1362.eqiad.wmnet 2469546 wikitext text/x-wiki ousajwi4iwqxskno3e7ecolsdoetqdq 2469547 2469546 2026-10-16T06:32:56Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1362.eqiad.wmnet 2469547 wikitext text/x-wiki f57gxmu42uybntyus4gkidqxhzrf0w4 2469548 2469547 2026-10-16T06:32:58Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2352.codfw.wmnet 2469548 wikitext text/x-wiki l8c3knfgwn6pb9zqxu06eq8yanvgqeu 2469549 2469548 2026-10-16T06:33:09Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1363.eqiad.wmnet 2469549 wikitext text/x-wiki 23lec7jv9z0xb227xor3yb10so5689r 2469550 2469549 2026-10-16T06:33:12Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2353.codfw.wmnet 2469550 wikitext text/x-wiki 8jcuqfl81y4ediarwlj1bkkids5zbmz 2469551 2469550 2026-10-16T06:33:29Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2194.codfw.wmnet with reason: Maintenance 2469551 wikitext text/x-wiki 8m67i88nmlt9hpez8zpddrikqptypx4 2469552 2469551 2026-10-16T06:33:46Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1363.eqiad.wmnet 2469552 wikitext text/x-wiki q542v61qu9cll6s5f0gxwbaz3972o2n 2469553 2469552 2026-10-16T06:33:48Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2353.codfw.wmnet 2469553 wikitext text/x-wiki 3ltk2y01i5aiw9w3dofvcdu6cqjhy1h 2469554 2469553 2026-10-16T06:34:05Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1363.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469554 wikitext text/x-wiki lqthm1s96iy3r6vo922029hgy6wc9zg 2469555 2469554 2026-10-16T06:34:09Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2353.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469555 wikitext text/x-wiki ja7mr7kiq3rvvelxhlrw5sinqsol5s6 2469556 2469555 2026-10-16T06:40:43Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2353.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469556 wikitext text/x-wiki ft1zg13d3tiz42b1evabact6y8wylje 2469557 2469556 2026-10-16T06:40:45Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1363.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469557 wikitext text/x-wiki d06apcysmdnneph6dsw4a0lfzy2xkme 2469558 2469557 2026-10-16T06:41:59Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2353.codfw.wmnet 2469558 wikitext text/x-wiki rorewve8fquu4veksxvima7vbk1kelj 2469559 2469558 2026-10-16T06:42:01Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2353.codfw.wmnet 2469559 wikitext text/x-wiki 0buugmlid8bgof5ewbex2le7vp7j55e 2469560 2469559 2026-10-16T06:42:14Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2354.codfw.wmnet 2469560 wikitext text/x-wiki rth1bxjtpz76w29v2p8tm2jemp6f9gn 2469561 2469560 2026-10-16T06:42:48Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2354.codfw.wmnet 2469561 wikitext text/x-wiki 5qkhm9g3a0vlr6cz1hh9651ybg9a9lb 2469562 2469561 2026-10-16T06:43:09Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2354.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469562 wikitext text/x-wiki sgchczsvmh6rg1zr0728tachqw3ns2o 2469563 2469562 2026-10-16T06:46:28Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2209.codfw.wmnet with reason: Maintenance 2469563 wikitext text/x-wiki fuv7v2gqpfdeznxy9zp3wfa5gor48qc 2469564 2469563 2026-10-16T06:49:43Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2354.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469564 wikitext text/x-wiki ncyo1jh0xtgv938w1yrbi26llp1txys 2469565 2469564 2026-10-16T06:50:00Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2354.codfw.wmnet 2469565 wikitext text/x-wiki aj286cgk2yszxcf3v5yhg5acfmuqbpv 2469566 2469565 2026-10-16T06:50:09Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2354.codfw.wmnet 2469566 wikitext text/x-wiki ru4ti3d1kyjpq4aqrb0we6ycfun686a 2469567 2469566 2026-10-16T06:50:22Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2355.codfw.wmnet 2469567 wikitext text/x-wiki 27qreyvr6xbkdhy2l0m0rsadvp011mt 2469568 2469567 2026-10-16T06:50:58Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2355.codfw.wmnet 2469568 wikitext text/x-wiki 2i4nv0fss87roete13j6vjciw48ws6b 2469569 2469568 2026-10-16T06:51:18Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2355.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469569 wikitext text/x-wiki gic6ystbhn0brna38y7a7hol34i5nse 2469570 2469569 2026-10-16T06:56:14Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1363.eqiad.wmnet 2469570 wikitext text/x-wiki 7mkgnlgauuymi87b4um4lcnx5o3h6nx 2469571 2469570 2026-10-16T06:56:16Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1363.eqiad.wmnet 2469571 wikitext text/x-wiki 058jhqz0jh3ci99cidf6ndldq8wnhql 2469572 2469571 2026-10-16T06:56:29Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1364.eqiad.wmnet 2469572 wikitext text/x-wiki 9rjh06s8kq93p3sfviwirl9zh5zt7u1 2469573 2469572 2026-10-16T06:57:02Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1364.eqiad.wmnet 2469573 wikitext text/x-wiki kr7udunk4iessw2l79z5nyhekojrr3s 2469574 2469573 2026-10-16T06:57:22Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1364.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469574 wikitext text/x-wiki igerg6apyyeo44qqaaslrqw7x7jmo4v 2469575 2469574 2026-10-16T06:57:53Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2355.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469575 wikitext text/x-wiki 8fjsjh8q7eg6m5fvtgcnr96pwco1va2 2469576 2469575 2026-10-16T06:58:22Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2355.codfw.wmnet 2469576 wikitext text/x-wiki qrrg3hih8f0awms35egtilugock7lq9 2469577 2469576 2026-10-16T06:58:47Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2355.codfw.wmnet 2469577 wikitext text/x-wiki g825xwkldlwma0b3xmbcg0lw6ds38n1 2469578 2469577 2026-10-16T06:59:01Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2356.codfw.wmnet 2469578 wikitext text/x-wiki 090vax4rodap96anmcu08v2s35vvs03 2469579 2469578 2026-10-16T06:59:26Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2227.codfw.wmnet with reason: Maintenance 2469579 wikitext text/x-wiki kwcer3qn6xducxl1ubj0jxe7jh3eoh6 2469580 2469579 2026-10-16T07:00:11Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2356.codfw.wmnet 2469580 wikitext text/x-wiki 9psshs7mmvj9iz70aursticgdcx0e7i 2469581 2469580 2026-10-16T07:00:32Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2356.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469581 wikitext text/x-wiki cqvc5gvdt3k4a7p8pxhvyl8ci8d63lj 2469582 2469581 2026-10-16T07:03:57Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1364.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469582 wikitext text/x-wiki 36vjbrs6qfy4bgrfydprpcmp3rshxtn 2469583 2469582 2026-10-16T07:05:12Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1364.eqiad.wmnet 2469583 wikitext text/x-wiki t845yiol3qbqkodkjp5eohitdjn131j 2469584 2469583 2026-10-16T07:05:14Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1364.eqiad.wmnet 2469584 wikitext text/x-wiki 1p7zvugixlo5u88c0cq50q0k3qaq0v7 2469585 2469584 2026-10-16T07:05:27Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1365.eqiad.wmnet 2469585 wikitext text/x-wiki fdugmr1ll4mf0f9wrndp0zg4016l0b3 2469586 2469585 2026-10-16T07:05:59Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1365.eqiad.wmnet 2469586 wikitext text/x-wiki 05p60pbs4awryuparcx02p0nkdawco3 2469587 2469586 2026-10-16T07:06:19Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1365.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469587 wikitext text/x-wiki r03pfwbi3qfm9j71zhismtv5daa7u16 2469588 2469587 2026-10-16T07:07:12Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2356.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469588 wikitext text/x-wiki canguu3ws5zz4kltcuq5xj2h2dgu7y5 2469589 2469588 2026-10-16T07:07:30Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2356.codfw.wmnet 2469589 wikitext text/x-wiki j3xsw1uy8zl7chbmly1tpo20spzxyjx 2469590 2469589 2026-10-16T07:08:07Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2356.codfw.wmnet 2469590 wikitext text/x-wiki jz0joq4oxi4rabmu74hx0l714kiigx2 2469591 2469590 2026-10-16T07:08:21Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2357.codfw.wmnet 2469591 wikitext text/x-wiki 62nwfdewvxpt1yiio7mgh4vv9kzvpr2 2469592 2469591 2026-10-16T07:08:55Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2357.codfw.wmnet 2469592 wikitext text/x-wiki jbk0ivivvybxtpixq2npjamwbdlm8bf 2469593 2469592 2026-10-16T07:09:15Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2357.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469593 wikitext text/x-wiki 4f7cxvxwdf8kzxd6jzratfc8kjxmd7q 2469594 2469593 2026-10-16T07:12:54Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1365.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469594 wikitext text/x-wiki mwt8tjw6lt321bo9x0sj1mttynitskb 2469595 2469594 2026-10-16T07:13:00Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2239.codfw.wmnet with reason: Maintenance 2469595 wikitext text/x-wiki b5id0h2uj93tav5pibadd20kikqfglc 2469596 2469595 2026-10-16T07:14:31Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1365.eqiad.wmnet 2469596 wikitext text/x-wiki cmsbq7oegdd7ig1f4zt3x375c4nmc5c 2469597 2469596 2026-10-16T07:14:33Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1365.eqiad.wmnet 2469597 wikitext text/x-wiki mallanst8468nsgyremkakehzjjhjpq 2469598 2469597 2026-10-16T07:14:46Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1366.eqiad.wmnet 2469598 wikitext text/x-wiki mfo9spf0wbn7r67ot8dnxo8eimtq3jf 2469599 2469598 2026-10-16T07:15:21Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1366.eqiad.wmnet 2469599 wikitext text/x-wiki d0qphpztxvbodwnsyb8g6ewplgid4ie 2469600 2469599 2026-10-16T07:15:42Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1366.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469600 wikitext text/x-wiki kj7vrh9h8lolqvpasi66r71n1hfbv4p 2469601 2469600 2026-10-16T07:15:56Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2357.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469601 wikitext text/x-wiki 8ezaj4ogpkem6acnt3ujui61xg3gmr2 2469602 2469601 2026-10-16T07:16:23Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2357.codfw.wmnet 2469602 wikitext text/x-wiki a9vxbfwfcf53ce3tnj8z0esnyb0royh 2469603 2469602 2026-10-16T07:16:26Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2357.codfw.wmnet 2469603 wikitext text/x-wiki t6xsp665u30u742vyaakgfqpiaim0d7 2469604 2469603 2026-10-16T07:16:40Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2358.codfw.wmnet 2469604 wikitext text/x-wiki 4o90ulga9x6fl4kciibhmggyl2rons0 2469605 2469604 2026-10-16T07:17:15Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2358.codfw.wmnet 2469605 wikitext text/x-wiki imxa0azy96h49tse7l3rylz8x6zcwl4 2469606 2469605 2026-10-16T07:17:36Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2358.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469606 wikitext text/x-wiki 1t5ugzxe78dywo9n2uk93h23c81kmvl 2469607 2469606 2026-10-16T07:22:21Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1366.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469607 wikitext text/x-wiki j4n0gf9f8bgdi3u6y24siy4rgrvursg 2469608 2469607 2026-10-16T07:24:16Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2358.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469608 wikitext text/x-wiki o1nrx5d0rdtiuolr4m8jo4btsfbs3fo 2469609 2469608 2026-10-16T07:24:44Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2358.codfw.wmnet 2469609 wikitext text/x-wiki 5fsc55m973x5zehkdkf71mggwor7w37 2469610 2469609 2026-10-16T07:24:46Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2358.codfw.wmnet 2469610 wikitext text/x-wiki d1f7fts0qlgdtz1lmrvic8s5ur0mam9 2469611 2469610 2026-10-16T07:24:59Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2359.codfw.wmnet 2469611 wikitext text/x-wiki e3msxm8ymz1y9gt2sb6doavfvmifgdi 2469612 2469611 2026-10-16T07:25:35Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2359.codfw.wmnet 2469612 wikitext text/x-wiki t2dl1ht53j5iiyxxi1haess73l3zt1o 2469613 2469612 2026-10-16T07:25:54Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2359.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469613 wikitext text/x-wiki 441mq2fp6em6h3fyudsc044rzuiw3f4 2469614 2469613 2026-10-16T07:32:40Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2359.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469614 wikitext text/x-wiki h59rbks7ivvx0j3yo5puih733sb177h 2469615 2469614 2026-10-16T07:33:17Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1366.eqiad.wmnet 2469615 wikitext text/x-wiki c3j5exc0n59deipvq3ukfmhv2etb1hj 2469616 2469615 2026-10-16T07:33:19Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1366.eqiad.wmnet 2469616 wikitext text/x-wiki mxgzxptr3g21rmp8c3cxxb3yw5w3o83 2469617 2469616 2026-10-16T07:33:33Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1367.eqiad.wmnet 2469617 wikitext text/x-wiki 40hamllew7iqnb6lqiwqz00puhujmdk 2469618 2469617 2026-10-16T07:34:09Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1367.eqiad.wmnet 2469618 wikitext text/x-wiki rhoqmvp0rymu84tde8mf7aaw21an20r 2469619 2469618 2026-10-16T07:34:29Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1367.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469619 wikitext text/x-wiki 7ufwft7n3rfm48perh8xws2oe5usqt0 2469620 2469619 2026-10-16T07:36:00Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db2205.codfw.wmnet with reason: Maintenance 2469620 wikitext text/x-wiki 6vl2abjhjyvuw38b9d27bwz44wbrija 2469621 2469620 2026-10-16T07:41:04Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1367.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469621 wikitext text/x-wiki ix3cptgsvuoza7olfbpnxdzzz2mivad 2469622 2469621 2026-10-16T07:53:04Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1157.eqiad.wmnet with reason: Maintenance 2469622 wikitext text/x-wiki jsqn4ikole42dvrrw5q3l9xbbm76rak 2469623 2469622 2026-10-16T07:55:55Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1166.eqiad.wmnet with reason: Maintenance 2469623 wikitext text/x-wiki oyulax88jv8vtpqofgk5dkhrtp6w287 2469624 2469623 2026-10-16T07:56:34Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1367.eqiad.wmnet 2469624 wikitext text/x-wiki bszmls2lv8wm4y6g3k550v1dn8nufn6 2469625 2469624 2026-10-16T07:56:36Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1367.eqiad.wmnet 2469625 wikitext text/x-wiki mdy019tb02a5rav4d7ll02k4hqj6efv 2469626 2469625 2026-10-16T07:56:49Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1368.eqiad.wmnet 2469626 wikitext text/x-wiki 2go8ho36tfn642q455aclhk2ml0y3jr 2469627 2469626 2026-10-16T07:57:24Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1368.eqiad.wmnet 2469627 wikitext text/x-wiki gvbyyo1fz4gwb3ezg6g45m9rnvd061n 2469628 2469627 2026-10-16T07:57:44Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1368.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469628 wikitext text/x-wiki be1dwwoxr5aw59hx821xurp88j6olkw 2469629 2469628 2026-10-16T07:58:35Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1175.eqiad.wmnet with reason: Maintenance 2469629 wikitext text/x-wiki qobezlxrf44c7pdzyljq8cxncghoi5m 2469631 2469629 2026-10-16T08:01:16Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1198.eqiad.wmnet with reason: Maintenance 2469631 wikitext text/x-wiki bye3v2sn1qqygow85x1wpmpt73ru2oi 2469632 2469631 2026-10-16T08:04:02Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1212.eqiad.wmnet with reason: Maintenance 2469632 wikitext text/x-wiki 1n9r8k0yrjsrdd9n4tlg9w7u9gp5kh6 2469633 2469632 2026-10-16T08:04:18Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1368.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469633 wikitext text/x-wiki 1pwxu1v24qxx7qbewsoosd9ptuk27r1 2469634 2469633 2026-10-16T08:04:23Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on 7 hosts with reason: Maintenance 2469634 wikitext text/x-wiki 2jhwes8k5dddzserzraru3afqtkdv5q 2469635 2469634 2026-10-16T08:05:33Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1368.eqiad.wmnet 2469635 wikitext text/x-wiki brslb7egi8p9qr0bj7fen895r6tic1e 2469636 2469635 2026-10-16T08:05:35Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1368.eqiad.wmnet 2469636 wikitext text/x-wiki nx1apf85maph2us5raw44gps64e1w1y 2469637 2469636 2026-10-16T08:05:46Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2359.codfw.wmnet 2469637 wikitext text/x-wiki ekjteos7z43pxxqx1kw7m9y94ktatib 2469638 2469637 2026-10-16T08:05:48Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2359.codfw.wmnet 2469638 wikitext text/x-wiki 07391dpxy1slfganlsxyfann2zzbapw 2469639 2469638 2026-10-16T08:05:50Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1369.eqiad.wmnet 2469639 wikitext text/x-wiki nz55wea94wdcxsghdfg5er1may4gu47 2469640 2469639 2026-10-16T08:06:01Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2360.codfw.wmnet 2469640 wikitext text/x-wiki 267ulcvh35a4fp2lhungy30e7tp45ct 2469641 2469640 2026-10-16T08:06:21Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1369.eqiad.wmnet 2469641 wikitext text/x-wiki 97pwjrsowggoofqnxehpkw5cz4qjckx 2469642 2469641 2026-10-16T08:06:35Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2360.codfw.wmnet 2469642 wikitext text/x-wiki qqah0w8ffz14sd04dg2w5hawbwl6qyy 2469643 2469642 2026-10-16T08:06:40Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1369.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469643 wikitext text/x-wiki rgpwyd87iizuzpbibunerh63cfiz7v5 2469644 2469643 2026-10-16T08:06:54Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2360.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469644 wikitext text/x-wiki sx6hq1luh9h0ad6o9mkfvf9a891qrbn 2469645 2469644 2026-10-16T08:07:01Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1223.eqiad.wmnet with reason: Maintenance 2469645 wikitext text/x-wiki ekhqogvxsnpob0v3ok8nk05kz4uaah4 2469646 2469645 2026-10-16T08:09:47Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1240.eqiad.wmnet with reason: Maintenance 2469646 wikitext text/x-wiki 1b3us5rek5h4jlmmm5njzvqh17c7k0f 2469647 2469646 2026-10-16T08:12:37Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1265.eqiad.wmnet with reason: Maintenance 2469647 wikitext text/x-wiki atrdzn5akb2ynglinft8rk0ccr59noe 2469648 2469647 2026-10-16T08:13:14Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1369.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469648 wikitext text/x-wiki erer2amioz8u3rasvhr9qhjxbspnqqn 2469649 2469648 2026-10-16T08:13:36Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2360.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469649 wikitext text/x-wiki owx7ngwztl1s0l0aiqu0gh8pm6famjt 2469650 2469649 2026-10-16T08:14:51Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1369.eqiad.wmnet 2469650 wikitext text/x-wiki dv3bzgdfpj156hn5kaahxptxsnox71h 2469651 2469650 2026-10-16T08:14:53Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1369.eqiad.wmnet 2469651 wikitext text/x-wiki cvzvmv4nlbawi4wc1hcylqutrp7zbxu 2469652 2469651 2026-10-16T08:15:06Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1370.eqiad.wmnet 2469652 wikitext text/x-wiki kp9qd9n989dqvgspj1cmi6dau8qfzvk 2469653 2469652 2026-10-16T08:15:11Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1272.eqiad.wmnet with reason: Maintenance 2469653 wikitext text/x-wiki mxygungm82cmmsg49e2dk83mezeww1d 2469654 2469653 2026-10-16T08:15:39Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1370.eqiad.wmnet 2469654 wikitext text/x-wiki 1ix0ox1icysdusbtvkoy0vysz5hzfm8 2469655 2469654 2026-10-16T08:15:58Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1370.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469655 wikitext text/x-wiki 7uukq4b5vc3jre86e8ozj9djifdzwap 2469656 2469655 2026-10-16T08:16:25Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.mysql.decommission 2469656 wikitext text/x-wiki rcat2ayfariv26zrk0c5rpywl8gaz1v 2469657 2469656 2026-10-16T08:16:36Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.hosts.decommission for hosts clouddb1013.eqiad.wmnet 2469657 wikitext text/x-wiki e1ixxckneeedlvxj5yzqpi6xboi809h 2469658 2469657 2026-10-16T08:17:35Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1280.eqiad.wmnet with reason: Maintenance 2469658 wikitext text/x-wiki pgyab2wlwu42ml8x6zmqwosw0p90dn8 2469659 2469658 2026-10-16T08:19:49Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1289.eqiad.wmnet with reason: Maintenance 2469659 wikitext text/x-wiki lb95q9vsqcrnapr64gpewwftbv68t4b 2469660 2469659 2026-10-16T08:22:16Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance 2469660 wikitext text/x-wiki 02cu0txa1snalyvglx86cpqyvkkdscn 2469661 2469660 2026-10-16T08:22:18Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.dns.netbox 2469661 wikitext text/x-wiki 6u13yjyy4qklm2faztkmkwhn7bxj7xp 2469662 2469661 2026-10-16T08:22:32Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1370.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469662 wikitext text/x-wiki n1g9kisln7mehcoimcqykz7z6i3tv9q 2469663 2469662 2026-10-16T08:24:30Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2360.codfw.wmnet 2469663 wikitext text/x-wiki 50yiocx4yqttr653558yos1bte1k9ow 2469664 2469663 2026-10-16T08:24:32Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2360.codfw.wmnet 2469664 wikitext text/x-wiki dnsua5e7s5dxrasvnmjbb7ek6blubdt 2469665 2469664 2026-10-16T08:24:46Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2361.codfw.wmnet 2469665 wikitext text/x-wiki pevo5m1a2mlvq9olvhfnkw9y6j7of3i 2469666 2469665 2026-10-16T08:25:19Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2361.codfw.wmnet 2469666 wikitext text/x-wiki 79bmtetfvb40c2frbz8nvjrnq6qdewo 2469667 2469666 2026-10-16T08:25:39Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2361.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469667 wikitext text/x-wiki 0ab9nglrpows7g2c0lwtjiqpavk0iue 2469668 2469667 2026-10-16T08:26:01Z Stashbot 7414 marostegui@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: clouddb1013.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - marostegui@cumin1004" 2469668 wikitext text/x-wiki 1fpeek73ao6rhuh5chs9nct7eh85f2q 2469669 2469668 2026-10-16T08:26:16Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: clouddb1013.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - marostegui@cumin1004" 2469669 wikitext text/x-wiki r6sgeredrsznwxnjey440ib66ldlyrc 2469670 2469669 2026-10-16T08:26:18Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2469670 wikitext text/x-wiki aheud21akejvkqj5bkf78yzni3zzbvw 2469671 2469670 2026-10-16T08:26:20Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts clouddb1013.eqiad.wmnet 2469671 wikitext text/x-wiki hbnveie2tmya5ak21yppg0e3kvhgnkd 2469672 2469671 2026-10-16T08:27:19Z Stashbot 7414 marostegui@cumin1004: Removing clouddb1013 from zarcillo T441300 2469672 wikitext text/x-wiki 2wczpmkevwxte0lcy8oixd8vrctswx3 2469673 2469672 2026-10-16T08:27:23Z Stashbot 7414 marostegui@cumin1004: END (PASS) - Cookbook sre.mysql.decommission (exit_code=0) 2469673 wikitext text/x-wiki 2dtjb7pqomigam46htnyqa3sw2od5fj 2469674 2469673 2026-10-16T08:28:45Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on db1189.eqiad.wmnet with reason: Maintenance 2469674 wikitext text/x-wiki c5yyuqo1r8ohmg6difxpdppi62b5dr3 2469675 2469674 2026-10-16T08:32:25Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2361.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469675 wikitext text/x-wiki po84dnp8ix4gdjxxa0z1cprleehr8vk 2469676 2469675 2026-10-16T08:32:43Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2361.codfw.wmnet 2469676 wikitext text/x-wiki hake0sdq4cefjrabohz5jkn31yvsevv 2469677 2469676 2026-10-16T08:32:45Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2361.codfw.wmnet 2469677 wikitext text/x-wiki 1q8lwh9s08gnxoj7650wfm5c6lc3plx 2469678 2469677 2026-10-16T08:32:59Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2362.codfw.wmnet 2469678 wikitext text/x-wiki snf4y7thxzg4kxhpt4johir3hiocowz 2469679 2469678 2026-10-16T08:33:29Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1370.eqiad.wmnet 2469679 wikitext text/x-wiki snq5wsd4yip3jfagigtenjeks856y31 2469680 2469679 2026-10-16T08:33:30Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1370.eqiad.wmnet 2469680 wikitext text/x-wiki 609g5albut2unfylsv4g91f45tk520i 2469681 2469680 2026-10-16T08:33:35Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2362.codfw.wmnet 2469681 wikitext text/x-wiki 77drbrhxr6nmeb44f16lw8945fy33fl 2469682 2469681 2026-10-16T08:33:43Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1371.eqiad.wmnet 2469682 wikitext text/x-wiki jejcccfv391linpw4cmnt5fa3wkyr3n 2469683 2469682 2026-10-16T08:33:54Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2362.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469683 wikitext text/x-wiki i0avleyltvjkxe158cbrt6h7otk2fov 2469684 2469683 2026-10-16T08:34:19Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1371.eqiad.wmnet 2469684 wikitext text/x-wiki l0uq883tre83wx6bos9vhkstw3zngah 2469685 2469684 2026-10-16T08:34:39Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1371.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469685 wikitext text/x-wiki n6bvilnh4janb44dmwfsj3cr3av0yjb 2469686 2469685 2026-10-16T08:35:55Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2171.codfw.wmnet with reason: Maintenance 2469686 wikitext text/x-wiki 7qa1xmelbc4s2uk9jnbltne83o5apsd 2469687 2469686 2026-10-16T08:37:18Z Stashbot 7414 oblivian@cumin1004: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker2362.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469687 wikitext text/x-wiki 7gg0o4fsc4w59t97q14kij0obaf9tky 2469688 2469687 2026-10-16T08:38:05Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2178.codfw.wmnet with reason: Maintenance 2469688 wikitext text/x-wiki 19fl1y7cqv2w9ii2ojrwkfpizyyexx9 2469689 2469688 2026-10-16T08:40:12Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2192.codfw.wmnet with reason: Maintenance 2469689 wikitext text/x-wiki 0kwq10ieqqb7goqwta0fbj7j4eovw51 2469690 2469689 2026-10-16T08:41:19Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1371.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469690 wikitext text/x-wiki 4og7hp05jzmv8uvbxlc9q87duknjuoo 2469691 2469690 2026-10-16T08:42:20Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2201.codfw.wmnet with reason: Maintenance 2469691 wikitext text/x-wiki j26jkcfly4dfvktegz28f14tuml6msa 2469692 2469691 2026-10-16T08:44:33Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2211.codfw.wmnet with reason: Maintenance 2469692 wikitext text/x-wiki j3j5apyu1wz2zs7b1s4ljmarr2tbtsi 2469693 2469692 2026-10-16T08:46:46Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2213.codfw.wmnet with reason: Maintenance 2469693 wikitext text/x-wiki s2vm2hfk56cs2rx5q3aenmxf8zk4am7 2469694 2469693 2026-10-16T08:48:54Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2223.codfw.wmnet with reason: Maintenance 2469694 wikitext text/x-wiki 8d8vz9p8gjgbif1l1bt1l2sjyaiucms 2469695 2469694 2026-10-16T08:52:14Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1371.eqiad.wmnet 2469695 wikitext text/x-wiki sfhc3zayj3snv8f02p40l4lws6fqd6x 2469696 2469695 2026-10-16T08:52:17Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1371.eqiad.wmnet 2469696 wikitext text/x-wiki qysc0h0nrv74pbi1gs1v5ly4wplqj5f 2469697 2469696 2026-10-16T08:52:24Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2157.codfw.wmnet with reason: Maintenance 2469697 wikitext text/x-wiki ssubv00sjirggvfus5cfvi7a7m3t655 2469698 2469697 2026-10-16T08:52:29Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1372.eqiad.wmnet 2469698 wikitext text/x-wiki oukfwkg7hjoz1chertshvece2gvxqoo 2469699 2469698 2026-10-16T08:53:02Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1372.eqiad.wmnet 2469699 wikitext text/x-wiki 3rdsdcraltv982li9djirmuf4n0elln 2469700 2469699 2026-10-16T08:53:22Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1372.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469700 wikitext text/x-wiki c2ar5vei9iua7to2y3seuxvla50bfp8 2469702 2469700 2026-10-16T08:55:22Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1159.eqiad.wmnet with reason: Maintenance 2469702 wikitext text/x-wiki 5wp2kk9iav7x55niukp8j2u2v56ww83 2469703 2469702 2026-10-16T08:55:55Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1161.eqiad.wmnet with reason: Maintenance 2469703 wikitext text/x-wiki 5lmrblg46jz9lbgrllfqoqa9q9juyvc 2469704 2469703 2026-10-16T08:56:32Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1185.eqiad.wmnet with reason: Maintenance 2469704 wikitext text/x-wiki piz83vjxux1e1902vlf9xxd0ol1g64m 2469705 2469704 2026-10-16T08:57:08Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1200.eqiad.wmnet with reason: Maintenance 2469705 wikitext text/x-wiki j6pgyqvjt718y8w0h6tf4e4prb98v5z 2469706 2469705 2026-10-16T08:57:47Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1207.eqiad.wmnet with reason: Maintenance 2469706 wikitext text/x-wiki m2qyfunxye392jnmz5zipwvsz48ayz7 2469707 2469706 2026-10-16T08:58:26Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1216.eqiad.wmnet with reason: Maintenance 2469707 wikitext text/x-wiki mn2kmnd9gyb7vvhekke4pnphp5j30rp 2469708 2469707 2026-10-16T08:59:05Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1230.eqiad.wmnet with reason: Maintenance 2469708 wikitext text/x-wiki gmjd1h6bmanj5ecdb9s007bwqk0u93g 2469710 2469708 2026-10-16T08:59:38Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1274.eqiad.wmnet with reason: Maintenance 2469710 wikitext text/x-wiki 9j3evfvl6f93pvbo5qechc45eglqnyg 2469711 2469710 2026-10-16T08:59:57Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1372.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469711 wikitext text/x-wiki 6bnqlt3un5qgv09ls6i1ss9ws4oj3b2 2469712 2469711 2026-10-16T09:00:13Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1275.eqiad.wmnet with reason: Maintenance 2469712 wikitext text/x-wiki czg5qjwd5p7bcrvdae1vcfchujq7ns3 2469713 2469712 2026-10-16T09:00:26Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1372.eqiad.wmnet 2469713 wikitext text/x-wiki q2ayy4rsez4bcpghvaz64pnwkp3tho2 2469714 2469713 2026-10-16T09:00:28Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1372.eqiad.wmnet 2469714 wikitext text/x-wiki fxxmsdbk00t0esp26ms0grpl5zsu6aq 2469715 2469714 2026-10-16T09:00:35Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 7 hosts with reason: Maintenance 2469715 wikitext text/x-wiki jyiu4lbhbhflbcc12j9i3u8evw5rxo5 2469716 2469715 2026-10-16T09:00:41Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1373.eqiad.wmnet 2469716 wikitext text/x-wiki 1laj7sc6th8qiadu47qvjzmvap8hpu8 2469717 2469716 2026-10-16T09:01:11Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on dbstore1008.eqiad.wmnet with reason: Maintenance 2469717 wikitext text/x-wiki 7hr8zclgk3qpsfamgdhjgf1ei3k9wi2 2469718 2469717 2026-10-16T09:01:17Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1373.eqiad.wmnet 2469718 wikitext text/x-wiki fcy6fnnte91fuyu72duxm964hz4khmo 2469719 2469718 2026-10-16T09:01:37Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1373.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469719 wikitext text/x-wiki j0rpirlpox2zmiqtuooi2vph6umkpyj 2469720 2469719 2026-10-16T09:01:56Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1210.eqiad.wmnet with reason: Maintenance 2469720 wikitext text/x-wiki 1ppscpa8zuz1dmqpbfhj8qn7cxumlpp 2469721 2469720 2026-10-16T09:03:02Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2153.codfw.wmnet with reason: Maintenance 2469721 wikitext text/x-wiki 0qe1r42bcmlg41d1ov0zoydcfhc0yjd 2469722 2469721 2026-10-16T09:03:22Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2170.codfw.wmnet with reason: Maintenance 2469722 wikitext text/x-wiki ksgznhndmcsz9whfxqezvwb0bcvwjwi 2469723 2469722 2026-10-16T09:03:40Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2173.codfw.wmnet with reason: Maintenance 2469723 wikitext text/x-wiki oat89ygtjs62wfuv05z4zbl50be5ycl 2469724 2469723 2026-10-16T09:03:59Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2174.codfw.wmnet with reason: Maintenance 2469724 wikitext text/x-wiki cr06fhl1zcu1wq0b15kz99gjod8yf5n 2469725 2469724 2026-10-16T09:04:18Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2176.codfw.wmnet with reason: Maintenance 2469725 wikitext text/x-wiki 94pnczg72sos81b30ygaq7g4i96zmen 2469726 2469725 2026-10-16T09:04:38Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2188.codfw.wmnet with reason: Maintenance 2469726 wikitext text/x-wiki 7l43o4yi3uycrg0jy3xznwhvboiffb4 2469727 2469726 2026-10-16T09:04:58Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2202.codfw.wmnet with reason: Maintenance 2469727 wikitext text/x-wiki 8rwt8v6d1q0xm90un41hk0grnefd0ke 2469728 2469727 2026-10-16T09:05:06Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2212.codfw.wmnet with reason: Maintenance 2469728 wikitext text/x-wiki nmjdmjyzaotirurej6ajxfhg7l7lnbg 2469729 2469728 2026-10-16T09:05:26Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2216.codfw.wmnet with reason: Maintenance 2469729 wikitext text/x-wiki 42grmjt5g79d4oxme83fm4rod21n09h 2469730 2469729 2026-10-16T09:05:45Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2250.codfw.wmnet with reason: Maintenance 2469730 wikitext text/x-wiki 37d2qccd3b2vik56rwhc47seevc63lt 2469731 2469730 2026-10-16T09:06:33Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2203.codfw.wmnet with reason: Maintenance 2469731 wikitext text/x-wiki 8nvzjumovvinjjfs37gth68yhxnfl5s 2469732 2469731 2026-10-16T09:07:16Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1163.eqiad.wmnet with reason: Maintenance 2469732 wikitext text/x-wiki qrqtf25ueyoei86rv14e36fw7imtw2h 2469733 2469732 2026-10-16T09:07:35Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1169.eqiad.wmnet with reason: Maintenance 2469733 wikitext text/x-wiki m8nv47ra69wi8fs5gdb51sox9znt084 2469734 2469733 2026-10-16T09:07:47Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1186.eqiad.wmnet with reason: Maintenance 2469734 wikitext text/x-wiki 3dzl6vwxbccejo9s6x9wzuxuk363jja 2469735 2469734 2026-10-16T09:08:05Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1195.eqiad.wmnet with reason: Maintenance 2469735 wikitext text/x-wiki tos3x1l9qtsvcbvkbh47vf2y1a7maqw 2469736 2469735 2026-10-16T09:08:23Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1373.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469736 wikitext text/x-wiki 7ol6d3i1swvmi6jo7gqtdylvfrmds00 2469737 2469736 2026-10-16T09:08:25Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1196.eqiad.wmnet with reason: Maintenance 2469737 wikitext text/x-wiki sgwwg846w1l1zsfdzu4svtathkd8fkv 2469738 2469737 2026-10-16T09:08:44Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 6 hosts with reason: Maintenance 2469738 wikitext text/x-wiki axwikg9621fnpz7pvpk18ajqy0rdcoc 2469739 2469738 2026-10-16T09:09:03Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1206.eqiad.wmnet with reason: Maintenance 2469739 wikitext text/x-wiki obnz3d09hswp2l6v5rmgx59tfgde6ih 2469740 2469739 2026-10-16T09:09:13Z Stashbot 7414 XioNoX: test setting 192.168.0.0/24 IP on mr1-eqiad:irb.900 2469740 wikitext text/x-wiki 4eltrelpsf0pm4mu0ih5pudr1ggd9i9 2469741 2469740 2026-10-16T09:09:20Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1218.eqiad.wmnet with reason: Maintenance 2469741 wikitext text/x-wiki f33fsl8w6xwhfpjtztsl3d0ku736a7p 2469742 2469741 2026-10-16T09:09:38Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1219.eqiad.wmnet with reason: Maintenance 2469742 wikitext text/x-wiki 8xa6q33mutoxw765x4womvcl1ux1qi1 2469743 2469742 2026-10-16T09:10:00Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1232.eqiad.wmnet with reason: Maintenance 2469743 wikitext text/x-wiki 33eemfytuqkf4jx58urliedsy6p56lc 2469744 2469743 2026-10-16T09:10:20Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1234.eqiad.wmnet with reason: Maintenance 2469744 wikitext text/x-wiki 5j4mzqxb0p2ddtbarlrc1uoly8i7wdw 2469745 2469744 2026-10-16T09:10:39Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1235.eqiad.wmnet with reason: Maintenance 2469745 wikitext text/x-wiki aen3qdzn6fby41p998akuwljsxmiul2 2469746 2469745 2026-10-16T09:10:57Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1239.eqiad.wmnet with reason: Maintenance 2469746 wikitext text/x-wiki 3kuacutz1t8xqj5tiu28ysdai4qatmo 2469747 2469746 2026-10-16T09:11:04Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1240.eqiad.wmnet with reason: Maintenance 2469747 wikitext text/x-wiki jbg54fk0lxx7xxwu3l33jkszk11foey 2469748 2469747 2026-10-16T09:11:21Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1251.eqiad.wmnet with reason: Maintenance 2469748 wikitext text/x-wiki 93e4pajlp5vbqyjm0lzm1cvxrx4rfbr 2469749 2469748 2026-10-16T09:11:45Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1277.eqiad.wmnet with reason: Maintenance 2469749 wikitext text/x-wiki p7p92xyth8ydc9ags51gajkogi6w90v 2469750 2469749 2026-10-16T09:12:01Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1283.eqiad.wmnet with reason: Maintenance 2469750 wikitext text/x-wiki ipgfh29ehbe28bsidor8e0gtt10049b 2469751 2469750 2026-10-16T09:12:09Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on dbstore1008.eqiad.wmnet with reason: Maintenance 2469751 wikitext text/x-wiki gxqob3qfv0soyr772bclfza1lr4gp70 2469752 2469751 2026-10-16T09:13:06Z Stashbot 7414 jayme@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on kafka-main1009.eqiad.wmnet with reason: firmware upgrade 2469752 wikitext text/x-wiki 7rswsv8qc2239wu6artxfqg8mi5vuwt 2469753 2469752 2026-10-16T09:17:44Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1184.eqiad.wmnet with reason: Maintenance 2469753 wikitext text/x-wiki qa5h5qf5um7lpg5wpkueyt2loprzzwt 2469754 2469753 2026-10-16T09:18:30Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2155.codfw.wmnet with reason: Maintenance 2469754 wikitext text/x-wiki c2ypdu8tvi3p38k3tku1mwx3i6hxn1h 2469755 2469754 2026-10-16T09:18:33Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Depooling db2155 (T441197)', diff saved to https://phabricator.wikimedia.org/P96717 and previous config saved to /var/cache/conftool/dbconfig/20261016-091831-marostegui.json 2469755 wikitext text/x-wiki pt33sc8mjy1ovsh19o7oyvu1d17c3h7 2469756 2469755 2026-10-16T09:19:18Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1373.eqiad.wmnet 2469756 wikitext text/x-wiki a5pbyk3cmuvb2damhgsfplgqrk2li96 2469757 2469756 2026-10-16T09:19:20Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1373.eqiad.wmnet 2469757 wikitext text/x-wiki hifodyb4410ttdir56m8bqb83l1xcta 2469758 2469757 2026-10-16T09:19:33Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1374.eqiad.wmnet 2469758 wikitext text/x-wiki 4oqdt9ls3e9lwoodrqk6mt1v4ot4j3u 2469759 2469758 2026-10-16T09:20:09Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1374.eqiad.wmnet 2469759 wikitext text/x-wiki 0di4uw1i8nnv7c3p7juqnu5dtaequi5 2469760 2469759 2026-10-16T09:20:28Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1374.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469760 wikitext text/x-wiki cfqfezrs6yg28q1xjlxo22hurvug2q3 2469762 2469760 2026-10-16T09:26:48Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2155 (T441197)', diff saved to https://phabricator.wikimedia.org/P96718 and previous config saved to /var/cache/conftool/dbconfig/20261016-092645-marostegui.json 2469762 wikitext text/x-wiki d5wwhuuosqhmz3kjp7y5zep0zcdzeza 2469763 2469762 2026-10-16T09:27:13Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1374.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469763 wikitext text/x-wiki idxmtwvojbhhsfagxznbybhslycb0z5 2469764 2469763 2026-10-16T09:27:31Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1374.eqiad.wmnet 2469764 wikitext text/x-wiki jdtsh3rcgwbgzb09eyz7kozihelgc32 2469765 2469764 2026-10-16T09:28:01Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1374.eqiad.wmnet 2469765 wikitext text/x-wiki lhvz041umo11594aul8jq35qq6bcq40 2469766 2469765 2026-10-16T09:28:14Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1375.eqiad.wmnet 2469766 wikitext text/x-wiki 7ibixrlvhj1wkuyg8heo3e449qm0ijx 2469767 2469766 2026-10-16T09:28:47Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1375.eqiad.wmnet 2469767 wikitext text/x-wiki hw86dzxfh6yl0bf6aav4nn6oepmdlcy 2469768 2469767 2026-10-16T09:29:07Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1375.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469768 wikitext text/x-wiki t9y1qm1ru3zb9ws5wh3gzj43pti2ysy 2469769 2469768 2026-10-16T09:35:51Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1375.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469769 wikitext text/x-wiki bt7j3pts7s0cgykmh5r8ieaq7qwdjzk 2469770 2469769 2026-10-16T09:37:02Z Stashbot 7414 jayme@cumin1004: START - Cookbook sre.hosts.remove-downtime for kafka-main1009.eqiad.wmnet 2469770 wikitext text/x-wiki 6nk1md7el8kxq4qakpepf3mw97jhpa2 2469771 2469770 2026-10-16T09:37:04Z Stashbot 7414 jayme@cumin1004: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for kafka-main1009.eqiad.wmnet 2469771 wikitext text/x-wiki iha1pd7tv3lybyqvpjo4h2cbj6ci7oj 2469772 2469771 2026-10-16T09:38:29Z Stashbot 7414 jayme@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on kafka-main2008.codfw.wmnet with reason: firmware upgrade 2469772 wikitext text/x-wiki jte1y1cpye6xh2ofi8wpv0vh2t93xod 2469773 2469772 2026-10-16T09:41:49Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2155', diff saved to https://phabricator.wikimedia.org/P96719 and previous config saved to /var/cache/conftool/dbconfig/20261016-094147-marostegui.json 2469773 wikitext text/x-wiki 2tsqeg48nkobglu317c0nyvp11xopur 2469774 2469773 2026-10-16T09:46:48Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1375.eqiad.wmnet 2469774 wikitext text/x-wiki nmi4jy5uluz8opsc0ix33rvbgijw5us 2469775 2469774 2026-10-16T09:46:50Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1375.eqiad.wmnet 2469775 wikitext text/x-wiki hs34kgc56xfbf8qkjo7kyyuykcci0sf 2469776 2469775 2026-10-16T09:47:03Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1376.eqiad.wmnet 2469776 wikitext text/x-wiki 5cq9482wm7vzaxpgumy2u6v4sgy0aiu 2469777 2469776 2026-10-16T09:47:39Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1376.eqiad.wmnet 2469777 wikitext text/x-wiki b9e6vb3r0dxi35ba2ddzhfjco575na6 2469778 2469777 2026-10-16T09:47:58Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1376.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469778 wikitext text/x-wiki cezfb8uzdoopztrowx9t6qjs5wslm9w 2469779 2469778 2026-10-16T09:52:50Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2469779 wikitext text/x-wiki h2y82id6eaz3o558pf9gt1b76cajjmu 2469780 2469779 2026-10-16T09:53:29Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2469780 wikitext text/x-wiki jr3q8qhmbktynlsktmh7rfjds7ivenw 2469781 2469780 2026-10-16T09:54:34Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1376.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469781 wikitext text/x-wiki a7n80pj8hq9dfyqb9e1t22a82sylogo 2469782 2469781 2026-10-16T09:56:12Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1376.eqiad.wmnet 2469782 wikitext text/x-wiki p2k3slg88wep2wu2stg3kdxeqnvkwp3 2469783 2469782 2026-10-16T09:56:14Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1376.eqiad.wmnet 2469783 wikitext text/x-wiki a1q5fqwvxwwvdskjakz87okisyt8yip 2469784 2469783 2026-10-16T09:56:26Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1377.eqiad.wmnet 2469784 wikitext text/x-wiki bp5e7wq9bm2jzh58ozr9o4ficlhtrm4 2469785 2469784 2026-10-16T09:56:51Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2155', diff saved to https://phabricator.wikimedia.org/P96720 and previous config saved to /var/cache/conftool/dbconfig/20261016-095650-marostegui.json 2469785 wikitext text/x-wiki tf9pp2d3pw2zv99d7majlb571nwcnss 2469786 2469785 2026-10-16T09:56:59Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1377.eqiad.wmnet 2469786 wikitext text/x-wiki 4hbuya9tj3cn4vz1w92qux15y8ulet1 2469787 2469786 2026-10-16T09:57:18Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1377.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469787 wikitext text/x-wiki jmjrn1oaciuu90qxehl59lonorx5t2n 2469788 2469787 2026-10-16T10:00:46Z Stashbot 7414 oblivian@cumin1004: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1377.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469788 wikitext text/x-wiki k9oe84txz7ukahydkf619zdeb9wdek1 2469789 2469788 2026-10-16T10:01:03Z Stashbot 7414 jayme@cumin1004: START - Cookbook sre.hosts.remove-downtime for kafka-main2008.codfw.wmnet 2469789 wikitext text/x-wiki dde0fz61vwob9d8f70xinn0zp8fx74d 2469790 2469789 2026-10-16T10:01:05Z Stashbot 7414 jayme@cumin1004: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for kafka-main2008.codfw.wmnet 2469790 wikitext text/x-wiki isheh09ii5r7pia1vg3i8kj77munv20 2469791 2469790 2026-10-16T10:01:27Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2362.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469791 wikitext text/x-wiki jua3gx8dvlmnopkpeokyklpvrnmi01y 2469792 2469791 2026-10-16T10:01:42Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1377.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469792 wikitext text/x-wiki pgao0a0cbw5zmir1qr50if672ku0ews 2469793 2469792 2026-10-16T10:04:40Z Stashbot 7414 oblivian@cumin1004: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker2362.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469793 wikitext text/x-wiki 2dn0d2w7b0h7upae3hcyfkp0y3ve7fv 2469794 2469793 2026-10-16T10:05:01Z Stashbot 7414 oblivian@cumin1004: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host wikikube-worker1377.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469794 wikitext text/x-wiki rtn0l1pwjrxlu5e49nfqw8br2kzd2iq 2469795 2469794 2026-10-16T10:10:48Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2362.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469795 wikitext text/x-wiki ff465jz5r2hdm4s8usrk9jb7wihap6k 2469796 2469795 2026-10-16T10:11:01Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1377.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469796 wikitext text/x-wiki 35a7crywqdgwx390zgvuvlf8vk6rvt4 2469797 2469796 2026-10-16T10:11:55Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2155 (T441197)', diff saved to https://phabricator.wikimedia.org/P96721 and previous config saved to /var/cache/conftool/dbconfig/20261016-101151-marostegui.json 2469797 wikitext text/x-wiki h0ihmrp9jbw2oybg3m37b2apydjul74 2469798 2469797 2026-10-16T10:12:09Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2172.codfw.wmnet with reason: Maintenance 2469798 wikitext text/x-wiki 8j368a8ui9usmpm58yrefrpfgveda1t 2469799 2469798 2026-10-16T10:12:12Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Depooling db2172 (T441197)', diff saved to https://phabricator.wikimedia.org/P96722 and previous config saved to /var/cache/conftool/dbconfig/20261016-101209-marostegui.json 2469799 wikitext text/x-wiki tt71nydb7f2skehnglv6w9r7y2tmzr0 2469800 2469799 2026-10-16T10:17:28Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2362.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469800 wikitext text/x-wiki ekjvggtwziaq3vwrmbjo6upbev4prdj 2469801 2469800 2026-10-16T10:17:41Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2362.codfw.wmnet 2469801 wikitext text/x-wiki r94pcbxv3102rky6n39ot6mcxnfhsy6 2469802 2469801 2026-10-16T10:17:46Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1377.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469802 wikitext text/x-wiki 6w2d4rmrf4xioychudk44jol1gnvh4e 2469803 2469802 2026-10-16T10:18:17Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2362.codfw.wmnet 2469803 wikitext text/x-wiki gere1u9r6setfe65vankqq068tbak2r 2469804 2469803 2026-10-16T10:18:30Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2363.codfw.wmnet 2469804 wikitext text/x-wiki 0cnbyxjfzrwmql3x1shryo44h18dpsu 2469805 2469804 2026-10-16T10:19:05Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2363.codfw.wmnet 2469805 wikitext text/x-wiki rkeifrjg5hsj4tifrnwdf7poadjtw7q 2469806 2469805 2026-10-16T10:19:25Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2363.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469806 wikitext text/x-wiki ovdc8io5sdqt3ir9npruo0qinsk5lyq 2469807 2469806 2026-10-16T10:20:52Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2172 (T441197)', diff saved to https://phabricator.wikimedia.org/P96723 and previous config saved to /var/cache/conftool/dbconfig/20261016-102049-marostegui.json 2469807 wikitext text/x-wiki fwvcct6pcrg8sbsh3kqie3fmp1p9nkt 2469808 2469807 2026-10-16T10:26:05Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2363.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469808 wikitext text/x-wiki ocskkxuov3b95kxqo4zqk7xiq7l386r 2469809 2469808 2026-10-16T10:26:32Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2363.codfw.wmnet 2469809 wikitext text/x-wiki 6l87mfz3m9w9mnfakkhlc86qhyqvygs 2469810 2469809 2026-10-16T10:26:58Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2363.codfw.wmnet 2469810 wikitext text/x-wiki h3kyee87jnobq72gbxvsb9co81pscrk 2469811 2469810 2026-10-16T10:27:11Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2364.codfw.wmnet 2469811 wikitext text/x-wiki d5rgbcchlgo2d9gliqdoj6rifluacal 2469812 2469811 2026-10-16T10:27:47Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2364.codfw.wmnet 2469812 wikitext text/x-wiki 1qadnkjcm5kiwol3ajgfllyq0d70a6e 2469813 2469812 2026-10-16T10:28:08Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2364.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469813 wikitext text/x-wiki g0c3b5suj54bcf8p0f7wgkqqqawrwtk 2469814 2469813 2026-10-16T10:28:42Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1377.eqiad.wmnet 2469814 wikitext text/x-wiki r6jnjfe72m2x3p4kaxp9jzcmcij3gjt 2469815 2469814 2026-10-16T10:28:44Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1377.eqiad.wmnet 2469815 wikitext text/x-wiki f37q32x1i3v2fb2c5ph923pw5kxf5le 2469816 2469815 2026-10-16T10:28:56Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1378.eqiad.wmnet 2469816 wikitext text/x-wiki m2kqxf8e01p6q6zqqnaevf1adgozmm2 2469817 2469816 2026-10-16T10:29:28Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1378.eqiad.wmnet 2469817 wikitext text/x-wiki i3p95rx266b0ob2lbulosm4slim961g 2469818 2469817 2026-10-16T10:29:48Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1378.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469818 wikitext text/x-wiki 56gltchzde0v6h80n2oio6ywduptluy 2469819 2469818 2026-10-16T10:34:42Z Stashbot 7414 ozge@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2469819 wikitext text/x-wiki n5f7q9hkntqmquyhhg1cj6nf2bycg5w 2469820 2469819 2026-10-16T10:34:53Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2364.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2469820 wikitext text/x-wiki 6kuznoio261hos5o5td6cq86fjzmsau 2469821 2469820 2026-10-16T10:35:53Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2172', diff saved to https://phabricator.wikimedia.org/P96724 and previous config saved to /var/cache/conftool/dbconfig/20261016-103551-marostegui.json 2469821 wikitext text/x-wiki qopmlpq05s8dcnl7ng5gh6fpyobimti 2469822 2469821 2026-10-16T10:36:29Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1378.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469822 wikitext text/x-wiki t1mm80zmkpkgtxp9zaiyuc7z9pgks25 2469823 2469822 2026-10-16T10:36:31Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2364.codfw.wmnet 2469823 wikitext text/x-wiki kjzrm4txsj76p427o8833jifc7pyfzu 2469824 2469823 2026-10-16T10:36:33Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2364.codfw.wmnet 2469824 wikitext text/x-wiki ril2vda16y5c96cnpiobmmudcs8blan 2469825 2469824 2026-10-16T10:36:34Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.enable_virtualization (exit_code=0) rolling provision on D{wikikube-worker[2341-2364].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) 2469825 wikitext text/x-wiki nz5k48h1e7p1oqw1er6rgx9biuuqhiu 2469828 2469825 2026-10-16T10:50:56Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2172', diff saved to https://phabricator.wikimedia.org/P96725 and previous config saved to /var/cache/conftool/dbconfig/20261016-105054-marostegui.json 2469828 wikitext text/x-wiki 1pu51ier8srkzry28t2a4or05qif2in 2469829 2469828 2026-10-16T11:02:55Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1378.eqiad.wmnet 2469829 wikitext text/x-wiki 1mj9ptunf68sisokd22n9qxngsyklfo 2469830 2469829 2026-10-16T11:02:57Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1378.eqiad.wmnet 2469830 wikitext text/x-wiki 6n0pfzwg8wy47xhne3p3oyyfpzea9vl 2469831 2469830 2026-10-16T11:03:10Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1379.eqiad.wmnet 2469831 wikitext text/x-wiki ftcr1q7msg84cu5zj5a0xodpsne9qmn 2469832 2469831 2026-10-16T11:03:42Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1379.eqiad.wmnet 2469832 wikitext text/x-wiki aakw2x0ngahltruqrv3zu82rdynzj0t 2469833 2469832 2026-10-16T11:04:02Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1379.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469833 wikitext text/x-wiki s03d2kuii84fd05uq7c1wezv8e5yw4x 2469834 2469833 2026-10-16T11:05:59Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2172 (T441197)', diff saved to https://phabricator.wikimedia.org/P96726 and previous config saved to /var/cache/conftool/dbconfig/20261016-110555-marostegui.json 2469834 wikitext text/x-wiki 3xqknmcf28rxxvpfkazi19061ofztp2 2469835 2469834 2026-10-16T11:06:13Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2199.codfw.wmnet with reason: Maintenance 2469835 wikitext text/x-wiki cw4e5imzj2da1usb5r78v9fdw1ubf6l 2469836 2469835 2026-10-16T11:10:46Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1379.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART 2469836 wikitext text/x-wiki 27m7bzgin39thvmb25n2iz00dbzboau 2469837 2469836 2026-10-16T11:11:13Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1379.eqiad.wmnet 2469837 wikitext text/x-wiki 2zy5grmynq0sp9ncvqns08f4jemwilr 2469838 2469837 2026-10-16T11:11:15Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1379.eqiad.wmnet 2469838 wikitext text/x-wiki o4zqbq3p4jmt3kpqtdjf7os7sg81so0 2469839 2469838 2026-10-16T11:11:17Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.enable_virtualization (exit_code=0) rolling provision on D{wikikube-worker[1350-1379].eqiad.wmnet} and (A:wikikube-master-eqiad or A:wikikube-worker-eqiad) 2469839 wikitext text/x-wiki om06gzqdkiy6wv82zz5mi7vvbaq8jkl 2469840 2469839 2026-10-16T11:14:55Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2206.codfw.wmnet with reason: Maintenance 2469840 wikitext text/x-wiki 5zk0148v7mig0hlv7ifmt7te3q39rhy 2469841 2469840 2026-10-16T11:14:59Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Depooling db2206 (T441197)', diff saved to https://phabricator.wikimedia.org/P96727 and previous config saved to /var/cache/conftool/dbconfig/20261016-111455-marostegui.json 2469841 wikitext text/x-wiki p8apyyngbr6o41io2qbyk6vm98ckmf4 2469842 2469841 2026-10-16T11:23:18Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2206 (T441197)', diff saved to https://phabricator.wikimedia.org/P96728 and previous config saved to /var/cache/conftool/dbconfig/20261016-112315-marostegui.json 2469842 wikitext text/x-wiki 92b1d55p7gko48pngxhxfrs6ux03d5v 2469845 2469842 2026-10-16T11:24:52Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2469845 wikitext text/x-wiki j94i5g71xf1nqk5k0sbtd6kon2s1qfz 2469846 2469845 2026-10-16T11:38:18Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2206', diff saved to https://phabricator.wikimedia.org/P96729 and previous config saved to /var/cache/conftool/dbconfig/20261016-113817-marostegui.json 2469846 wikitext text/x-wiki 5q8t39ez7x77rde1eiju6e2s6uoojh1 2469847 2469846 2026-10-16T11:53:21Z Stashbot 7414 marostegui@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db2206', diff saved to https://phabricator.wikimedia.org/P96730 and previous config saved to /var/cache/conftool/dbconfig/20261016-115319-marostegui.json 2469847 wikitext text/x-wiki 4n1bdonqwrhuzu45umc3h1j7fd4691r 0 17290 2469294 2468359 2026-10-15T20:10:23Z Stashbot 7414 dduvall: performing rolling restart of docker on integration-agent-docker instances to deploy https://gerrit.wikimedia.org/r/c/operations/puppet/+/1355127 (T440670) 2469294 wikitext text/x-wiki t6srhb9u2t1ka0rnj8u59aul73vnoho 498 30942 2468777 2467584 2026-10-15T12:10:38Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/365 2468777 wikitext text/x-wiki 5rqs82bf0zk3izdcw0armbh4riio185 2468778 2468777 2026-10-15T12:10:50Z Stashbot 7414 taavi@cloudcumin1001: END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/365 2468778 wikitext text/x-wiki aukopvic7ez4nlc5bgl25tpz0myqg1b 2468779 2468778 2026-10-15T12:11:33Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/365 2468779 wikitext text/x-wiki ni1n1eesco8zi8vuafsmeyteh2ol9q3 2468780 2468779 2026-10-15T12:11:48Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/365 2468780 wikitext text/x-wiki 0xuvz9k58ix5o0lu642dpcsaoj7t6uo 2468781 2468780 2026-10-15T12:12:45Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch 2468781 wikitext text/x-wiki mej5s42mgzycletbi8rjqnsbkm1ofi7 2468782 2468781 2026-10-15T12:13:26Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch 2468782 wikitext text/x-wiki sdvatmcxuawnhu70bvvis8e9xjx9l8y 2468869 2468782 2026-10-15T13:36:55Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.restart_openstack on deployment eqiad1 for service: project,heat 2468869 wikitext text/x-wiki 5lc8m8l0pjif2bc9vtylx5d39g54lpi 2468870 2468869 2026-10-15T13:37:43Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) on deployment eqiad1 for service: project,heat 2468870 wikitext text/x-wiki ddvag4wronl5mke024mu8c5n6o1gnu0 2469019 2468870 2026-10-15T15:45:22Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol2010-dev.codfw.wmnet' 2469019 wikitext text/x-wiki 1al2zpdpp6lvmguivmxznh9ilz8vnjc 2469033 2469019 2026-10-15T15:57:08Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudcontrol2010-dev.codfw.wmnet' 2469033 wikitext text/x-wiki 6y1rnycnezplzzkd3r4h4j0gnstrq6k 2469038 2469033 2026-10-15T15:58:55Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol2005-dev.codfw.wmnet' 2469038 wikitext text/x-wiki optwthvqdjt12tdjes8yrnco5u3wc7x 2469053 2469038 2026-10-15T16:11:53Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudcontrol2005-dev.codfw.wmnet' 2469053 wikitext text/x-wiki prso28ov6kyheclw26sklc96z6anu33 2469063 2469053 2026-10-15T16:13:35Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol2006-dev.codfw.wmnet' 2469063 wikitext text/x-wiki 7lc0mpuaffvwfttjtrjf9zgh6y7yy0d 2469088 2469063 2026-10-15T16:26:24Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudcontrol2006-dev.codfw.wmnet' 2469088 wikitext text/x-wiki k60jpydnnr4o8t66ygd6kdzrh2ek8yn 2469110 2469088 2026-10-15T16:40:34Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol1011.eqiad.wmnet' (T441318) 2469110 wikitext text/x-wiki b2s6eqfftq4uh28h95g4ggk5nw4a0hl 2469128 2469110 2026-10-15T16:52:08Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudcontrol1011.eqiad.wmnet' (T441318) 2469128 wikitext text/x-wiki h2wi9lcbgykbwnhe9x32z052xqn9wqp 2469132 2469128 2026-10-15T16:53:11Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol1007.eqiad.wmnet' (T441318) 2469132 wikitext text/x-wiki g1yq4p6wttmvagfd6limanj5b8b1j2w 2469147 2469132 2026-10-15T17:09:09Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudcontrol1007.eqiad.wmnet' (T441318) 2469147 wikitext text/x-wiki hu3yfqt2fousaxih6tgb32enxlbho6g 2469148 2469147 2026-10-15T17:09:33Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node on host 'cloudcontrol1006.eqiad.wmnet' (T441318) 2469148 wikitext text/x-wiki 3iju7c5684drhzxvnos3ypwczn8m5fq 2469165 2469148 2026-10-15T17:23:38Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudcontrol.upgrade_openstack_node (exit_code=0) on host 'cloudcontrol1006.eqiad.wmnet' (T441318) 2469165 wikitext text/x-wiki t9zrn34yhjul2oq83p5ifrzw9nzfuru 0 33280 2469109 2461913 2026-10-15T16:40:30Z Krinkle 44 /* nda group */ 2469109 wikitext text/x-wiki fvnpagclbvy78uscu3bcras2npronps 498 55577 2468864 2468752 2026-10-15T13:31:07Z Stashbot 7414 dcaro: deployed the packaged version of replica-cnf 2468864 wikitext text/x-wiki 9s1muwzl9ushq3u05fycvlu8qy8ml6i 0 56257 2469826 2456074 2026-10-16T10:40:27Z Widespread backlash 60658 Changing date and time 2469826 wikitext text/x-wiki b0iv6lbrlltmxz084yxut3soka7mr3i 2469827 2469826 2026-10-16T10:46:53Z JavaHurricane 38118 Reverted edit by [[Special:Contributions/Widespread backlash|Widespread backlash]] ([[User talk:Widespread backlash|talk]]) to last revision by [[User:Lucas Werkmeister (WMDE)|Lucas Werkmeister (WMDE)]] 2456074 wikitext text/x-wiki jgk8kdnkjehnbqzsixdarzp9st3vv94 116 441857 2468878 1777867 2026-10-15T13:46:40Z Siebrand 65 updates 2468878 wikitext text/x-wiki 8nuavh4afpg76i7q1uw4fkl5d9srq7n 0 443215 2469372 2361394 2026-10-15T23:30:44Z Krinkle 44 Add mw.loader.store.oldestItem() 2469372 wikitext text/x-wiki 8m6wqtcvwu0ksjn5cusb8f7ef8wrqwe 2469377 2469372 2026-10-15T23:46:58Z Krinkle 44 mw.loader.store.oldestItem > mw.loader.store.debug 2469377 wikitext text/x-wiki 8mtsevc2jf3j8fbks52skidhda5mlex 2469378 2469377 2026-10-15T23:50:28Z Krinkle 44 /* Store debug */ rename section 2469378 wikitext text/x-wiki ir7duytz5ivvpsfjnt4luns3hwj17sc 498 443261 2468783 2467979 2026-10-15T12:13:48Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.create_instance_with_prefix with prefix 'waf' 2468783 wikitext text/x-wiki az9ri8dapmfiy538x4r955u3ayntd5s 2468784 2468783 2026-10-15T12:13:51Z Stashbot 7414 taavi@cloudcumin1001: END (FAIL) - Cookbook wmcs.vps.create_instance_with_prefix (exit_code=99) with prefix 'waf' 2468784 wikitext text/x-wiki 8e7uieeyzrwld75ou2dpu0679aqujp0 2468785 2468784 2026-10-15T12:14:33Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.create_instance_with_prefix with prefix 'waf' 2468785 wikitext text/x-wiki 5wg18h47cx76cfzy3itlqa2yiisct62 2468790 2468785 2026-10-15T12:22:34Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.create_instance_with_prefix (exit_code=0) with prefix 'waf' 2468790 wikitext text/x-wiki j4awn8c1z0vljpsdnfy3i269jid49s1 2468791 2468790 2026-10-15T12:23:49Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.refresh_puppet_certs on waf-1.cloudinfra.eqiad1.wikimedia.cloud 2468791 wikitext text/x-wiki j3387dqk602kwnkf61lst6mjdv72jw8 2468792 2468791 2026-10-15T12:26:51Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=0) on waf-1.cloudinfra.eqiad1.wikimedia.cloud 2468792 wikitext text/x-wiki ozrj8e2a8tdr2ljstcih14ex8mcx5w2 0 443371 2469151 2350140 2026-10-15T17:11:20Z Krinkle 44 /* MediaWiki deployments */ 2469151 wikitext text/x-wiki 7nl60mf8beewwt5a24b5w47dc4qj0ks 0 443471 2469028 1845528 2026-10-15T15:55:02Z AndrewBogott (WMF) 51047 /* importing packages into our reprepro */ 2469028 wikitext text/x-wiki lzqvq0awwmtcmv1spgk7hcehazafoc5 0 444830 2468969 1850892 2026-10-15T14:57:03Z AQuhen (WMF) 29318 2468969 wikitext text/x-wiki b7xeht8eukazytd1rjjrf22ugpo0ebw 2469016 2468969 2026-10-15T15:33:20Z AKlapper (WMF) 421 /* Bots maintained by Data-Engineering */ 2469016 wikitext text/x-wiki cn0d52cev35zq9fjoilvp0ywswiupdj 0 445088 2469121 2315010 2026-10-15T16:47:29Z Krinkle 44 /* Logstash/Kibana */ change SlowQuery link from outdated permalink of a specific version to a regular dashboard link, always showing latest changes and improvements. The link was broken because it still queried "channel:DBPermance" instead of "channel:rdbms", despite the dashboard having been fixed some time ago already 2469121 wikitext text/x-wiki tweetdum1q8pksld6rx9zcp0pjzrgu4 0 445864 2468879 2449005 2026-10-15T13:47:49Z DCaro (WMF) 18271 /* Deploy the package */ added replica-cnf 2468879 wikitext text/x-wiki dv2y7s7gma465oen4ns0kyp3vc27iv8 0 446759 2469111 2418965 2026-10-15T16:41:06Z Krinkle 44 /* External link */ fix copy-pasta link that was pointing to unrelated wikimediastatus.net 2469111 wikitext text/x-wiki k4glp0hsx6afv1g3mayh5dpj515e2ip 2469119 2469111 2026-10-15T16:45:37Z Krinkle 44 2469119 wikitext text/x-wiki fpytvw4qrahwzfxs70dy7bw2lhw1z59 0 447017 2468826 2463839 2026-10-15T13:03:30Z JGiannelos (WMF) 17083 /* Published SLOs */ 2468826 wikitext text/x-wiki jpkkqfq24v0jtdapse3a41yl3zutj8h 0 447760 2468786 2460326 2026-10-15T12:14:54Z TCipriani (WMF) 4895 /* Forcing Replication re-runs */ 2468786 wikitext text/x-wiki rl9xfmxu3korzo5iomj5o0394tdxbux 0 449160 2469383 2468747 2026-10-16T00:02:21Z Dexbot 30554 Bot: Updating the report 2469383 wikitext text/x-wiki lxa12q717bnf8zm42cpm5o01e6gdqxb 2469761 2469383 2026-10-16T09:21:29Z Dexbot 30554 Bot: Updating the report 2469761 wikitext text/x-wiki tmj5cocw9bqbe3m1m3zjpo8nqigvzbl 0 450684 2469035 2465731 2026-10-15T15:57:44Z AMastilovic-WMF 40067 /* Schedule interval */ Add paragraph about changing the schedule of an existing DAG 2469035 wikitext text/x-wiki j0nrylcqbcs50n2ccuwic3m82zydvla 2469114 2469035 2026-10-15T16:43:55Z AMastilovic-WMF 40067 /* Which properties should be overridable? */ Remove the comment about backfilling by altering the DAG start date in properties 2469114 wikitext text/x-wiki lfwywza7mpidfrh53qozkt59zu9nnst 0 453836 2469020 2431154 2026-10-15T15:48:35Z TBurmeister (WMF) 27417 Add important missing link for admin docs landing page 2469020 wikitext text/x-wiki oyq1a86ablrx86zwvggyf84lw9822ob 116 453906 2469287 2468215 2026-10-15T19:48:20Z Gitlabaccountapprovalbot 37332 jackblanket847 was rejected. 2469287 wikitext text/x-wiki gobey9nk42mgsuhgwd8boh1optv15m1 2469345 2469287 2026-10-15T21:15:27Z Gitlabaccountapprovalbot 37332 qhairy was rejected. 2469345 wikitext text/x-wiki j9jgtnp8zscmdxr9onyuunl2sof40pp 0 456082 2469039 2422818 2026-10-15T16:02:46Z ABaso (WMF) 1044 /* Jupyter */ To make scanning of imports of this page not flag, putting placeholder for token 2469039 wikitext text/x-wiki ql7i7m2j45st1q9c0xkycjl2js179p1 0 459156 2468868 2468252 2026-10-15T13:36:14Z Filippo Giunchedi 2939 Expand on debugging and error/incident 2468868 wikitext text/x-wiki bnm1or4xr40wrwcp5ioit9iojdjawky 0 459290 2469630 2468666 2026-10-16T07:59:19Z JAllemandou (WMF) 37709 Add new code to dpeloy 2469630 wikitext text/x-wiki jyzuu0lkh34ns4yhnvdwweeaso6n92e 2469701 2469630 2026-10-16T08:54:45Z JAllemandou (WMF) 37709 Add new patch to deploy 2469701 wikitext text/x-wiki glnaqqf795z1pzeinbjwan4y2b5b6rl 2469709 2469701 2026-10-16T08:59:07Z JAllemandou (WMF) 37709 Add another patch to next deploy 2469709 wikitext text/x-wiki fwj8cuu04gn3lumjvvqogp77q9yfdfu 0 459699 2469084 2468313 2026-10-15T16:22:47Z Stashbot 7414 ejegg: donorwiki upgraded from 9e8d0c0b to 06bf0472 2469084 wikitext text/x-wiki t20h2lpjy65iu2xu7q8e3y1ge0atbjp 2469087 2469084 2026-10-15T16:25:31Z Stashbot 7414 ejegg: payments-wiki upgraded from 9e8d0c0b to 06bf0472 2469087 wikitext text/x-wiki ap15yq0mqcg4b4613781ltrsmo1hje1 0 460621 2468825 2464937 2026-10-15T13:02:54Z JGiannelos (WMF) 17083 2468825 wikitext text/x-wiki f1k68ln7dezfnrv7unm0o5zb7yro0ul 2 460671 2469167 2459040 2026-10-15T17:24:50Z CKlimas-WMF 59190 2469167 wikitext text/x-wiki kxmxqdytfdp4825zan4rlgy2rchxpcz 12 460735 2469100 2464327 2026-10-15T16:34:53Z FNegri-WMF 32595 Move beta notice to the top, remove limitation for tools not using toolforge config 2469100 wikitext text/x-wiki 760eihiain03d7n48799o2pnellclou 0 460803 2469286 2468282 2026-10-15T19:48:17Z DLynch (WMF) 6438 2469286 wikitext text/x-wiki qa5ebdbb4v58ofd1ocip122si0lb2up 2469289 2469286 2026-10-15T19:49:05Z DLynch (WMF) 6438 /* Slow checks */ 2469289 wikitext text/x-wiki 6rhb6fk46g4h33kn7y7v8v62eihqgdu 2469290 2469289 2026-10-15T19:49:35Z DLynch (WMF) 6438 2469290 wikitext text/x-wiki skpq7ki37kou0q9y2npd511ehmha4s4 116 460821 2469843 2026-10-16T11:24:03Z Dev Jadiya 43758 Create initial documentation for clip2commons, including architecture diagrams, usage instructions, technical details, and development history. 2469843 wikitext text/x-wiki m5b0ou9i3odm9ncbd0tqbux7kso4wv3 2469844 2469843 2026-10-16T11:24:46Z Dev Jadiya 43758 Removed non-existed category 2469844 wikitext text/x-wiki loyyhtm4k9mg3e48kcphpoza0y3unbr 2 460822 2469848 2026-10-16T11:53:27Z GModena (WMF) 20194 Created page with "{{Note|Report for [[phab:T437892|T437892]]. ''Load test WDQS v2 with rewritten queries''.}} == Problem space == Before opening the WDQS v2 to all users we need answers to three questions that previous synthetic benchmarks could not give us: * '''Capacity:''' what request rate can the v2 fleet actually sustain on ''real'' Wikidata query traffic, and where does it fall over? * '''Rate limiting:''' what upper/lower bounds should drive the rate-limit configuration so the s..." 2469848 wikitext text/x-wiki 5thuujcqer0uwnazvjnv1la3ujgij5h