Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.22 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 420 2463190 2453576 2026-10-02T21:46:37Z Krinkle 44 improve lede and summarise how it works, add main web link (there wasn't a link to beta.wmcloud.org anywhere!), and add section for shell access 2463190 wikitext text/x-wiki 2nc57i5esbwznu65lre6xgsq2wi3acb 498 845 2463185 2461956 2026-10-02T21:03:28Z Krinkle 44 deployment-cache => deployment-cp 2463185 wikitext text/x-wiki b2b9kne9utpnjm8uoql3ockf193akmg 2463186 2463185 2026-10-02T21:07:30Z Krinkle 44 2463186 wikitext text/x-wiki 79g80ct1xtj39r1up9y6fh0g9zz1uja 2463187 2463186 2026-10-02T21:07:49Z Krinkle 44 rm irc.beta per [[phab:T396088]] 2463187 wikitext text/x-wiki i302kzy19gfacv6p5inklvgbzv8gfx1 498 3086 2463038 2462773 2026-10-02T13:45:42Z Stashbot 7414 fnegri@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component alerts-api (T432865) 2463038 wikitext text/x-wiki 4uqgffh5vev77ipva5rr4aworgmi1qj 2463039 2463038 2026-10-02T13:46:49Z Stashbot 7414 fnegri@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component alerts-api (T432865) 2463039 wikitext text/x-wiki b1cjgm91br76f3r31babwe24ypvns4h 0 3788 2463145 2442792 2026-10-02T18:29:04Z Meno25 1446 update redirected link 2463145 wikitext text/x-wiki c6xoydsbpntv4hguyppr9g5zxvep99d 2463146 2463145 2026-10-02T18:29:42Z Meno25 1446 update redirected link 2463146 wikitext text/x-wiki 10ngio6dgaale8154qnoyj8ln7nbv85 2463147 2463146 2026-10-02T18:31:05Z Meno25 1446 update redirected link 2463147 wikitext text/x-wiki hnjnwtci89e9r26v3lu3zbypkn5ppfb 0 4108 2463200 2462879 2026-10-03T02:00:49Z DeploymentCalendarTool 20896 Remove Week of September 28 2463200 wikitext text/x-wiki sibeex9q50djctgzdji5oklwokvhwry 0 7919 2463008 2463007 2026-10-02T12:00:36Z Stashbot 7414 btullis@cumin1004: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ml-cache2002.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2463008 wikitext text/x-wiki gaciq5452boldvb5t3v67h0avzw7vjh 2463009 2463008 2026-10-02T12:00:49Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reimage for host ml-cache2002.codfw.wmnet with OS bookworm 2463009 wikitext text/x-wiki lamud8bcxedpozmj8swo0q5ewu0fjy9 2463010 2463009 2026-10-02T12:01:08Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.dns.netbox 2463010 wikitext text/x-wiki nfg6ypemsc4v8rgzd8b4hj052aio7vc 2463011 2463010 2026-10-02T12:11:39Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART 2463011 wikitext text/x-wiki eukukvvo82qk1d957gsn73v3r6smz3u 2463012 2463011 2026-10-02T12:11:44Z Stashbot 7414 elukey@cumin1004: END (ERROR) - Cookbook sre.hosts.provision (exit_code=97) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART 2463012 wikitext text/x-wiki iz08g36x8rf0cy23gi2yis6t12ora0h 2463014 2463012 2026-10-02T12:14:35Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.provision for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART 2463014 wikitext text/x-wiki 3xbvxwj8b4zack5ih3r1syab7eo7bne 2463015 2463014 2026-10-02T12:14:38Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest2001.codfw.wmnet (push config only) 2463015 wikitext text/x-wiki ld9kz8mqnyxxgiwmobj36v4lwkgfr70 2463016 2463015 2026-10-02T12:14:42Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest2001.codfw.wmnet (push config only) 2463016 wikitext text/x-wiki g5sapa7u6d6yobruy4jihydjiym881s 2463017 2463016 2026-10-02T12:15:50Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Re-adding ml-cache2002 - btullis@cumin1004" 2463017 wikitext text/x-wiki 0slglj9md4qgq0qmuth99u1p8m5lluf 2463018 2463017 2026-10-02T12:15:53Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Re-adding ml-cache2002 - btullis@cumin1004" 2463018 wikitext text/x-wiki 6k2jf3d3u5iscbk7c7se44fm0n7jdjv 2463019 2463018 2026-10-02T12:15:54Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2463019 wikitext text/x-wiki nfy2ydlgewzvrf2tc8yp7dtjxtmrrr5 2463020 2463019 2026-10-02T12:16:56Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on ml-cache2002.codfw.wmnet with reason: host reimage 2463020 wikitext text/x-wiki 96csnzq4hk7w2pa31nbe1y8nu4r3cm6 2463021 2463020 2026-10-02T12:19:49Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest2001.codfw.wmnet (remove config only) 2463021 wikitext text/x-wiki r73sxe6nqhxp6s21rq5v1jgka93bauy 2463022 2463021 2026-10-02T12:19:53Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest2001.codfw.wmnet (remove config only) 2463022 wikitext text/x-wiki esipc7tlbv71vqe5heyt8oc7vuf67sl 2463023 2463022 2026-10-02T12:20:04Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2001.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART 2463023 wikitext text/x-wiki e7ntwdyaa84utpzio9h809vnyk1hwl3 2463024 2463023 2026-10-02T12:20:27Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-cache2002.codfw.wmnet with reason: host reimage 2463024 wikitext text/x-wiki 32001zlal2b4kq58fk5thatuu1niz9s 2463026 2463024 2026-10-02T12:27:17Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.provision for host ml-cache2003.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2463026 wikitext text/x-wiki ed7iabac88q2xq2624f8dd0x59mdfir 2463028 2463026 2026-10-02T12:36:37Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1004" 2463028 wikitext text/x-wiki 38ghj4juxp9hao66llvbgdna5did6oc 2463030 2463028 2026-10-02T12:49:56Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ml-cache2003.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2463030 wikitext text/x-wiki avss94jo0pip1rnj4y40b2na6t67lm1 2463037 2463030 2026-10-02T13:36:54Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.wdqs.reboot 2463037 wikitext text/x-wiki glf0yzqr3nfxwy9m36trxv6048y4p42 2463040 2463037 2026-10-02T13:49:52Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1004" 2463040 wikitext text/x-wiki gxqxa06j0rw7pxwfeb6qt4brebqxxqq 2463041 2463040 2026-10-02T13:49:54Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ml-cache2002.codfw.wmnet with OS bookworm 2463041 wikitext text/x-wiki 7kqa8bk3dtnsh4ii82927i3q5niri2t 2463042 2463041 2026-10-02T13:58:42Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) 2463042 wikitext text/x-wiki jr2o7prms89sh9aaccge44wndbn9v1a 2463043 2463042 2026-10-02T14:03:11Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.wdqs.reboot 2463043 wikitext text/x-wiki 5j5ydlkvjm2mj13lz76f2t3saot1o7y 2463044 2463043 2026-10-02T14:10:43Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.zookeeper.roll-restart-zookeeper for Zookeeper A:zookeeper-analytics cluster: Roll restart of jvm daemons. 2463044 wikitext text/x-wiki ql7etk5q9tevyskfe72rmq9c4nf7ssg 2463045 2463044 2026-10-02T14:17:05Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.zookeeper.roll-restart-zookeeper (exit_code=0) for Zookeeper A:zookeeper-analytics cluster: Roll restart of jvm daemons. 2463045 wikitext text/x-wiki 21yaypg8so5be8mhk1l79ojjlx0qoyo 2463046 2463045 2026-10-02T14:23:10Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) 2463046 wikitext text/x-wiki g8yaybsqrn9uo2xk8yxetsd0aw8aght 2463047 2463046 2026-10-02T14:23:27Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.provision for host ml-cache2003.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2463047 wikitext text/x-wiki 581bybsmlr8zlqxx1ox7hfqmkzhn8c9 2463048 2463047 2026-10-02T14:25:10Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reboot-single for host an-conf1004.eqiad.wmnet 2463048 wikitext text/x-wiki qf9coob3m1ugyam2uimhxsa1m5g6okk 2463049 2463048 2026-10-02T14:25:50Z Stashbot 7414 btullis@cumin1004: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host ml-cache2003.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2463049 wikitext text/x-wiki phctc5hfjr27xn35idurzmyvwci982d 2463050 2463049 2026-10-02T14:30:26Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-conf1004.eqiad.wmnet 2463050 wikitext text/x-wiki e5tiudzv9fzpvegpb1y01gg27ju9nn3 2463051 2463050 2026-10-02T14:31:47Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reimage for host ml-cache2003.codfw.wmnet with OS bookworm 2463051 wikitext text/x-wiki 9toryh3uz79wxddgsr46qco7yga6chz 2463052 2463051 2026-10-02T14:32:07Z Stashbot 7414 btullis@cumin1004: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ml-cache2003.codfw.wmnet with OS bookworm 2463052 wikitext text/x-wiki dqfyjjpkicfa2x70hfkxl2og8b8exfk 2463053 2463052 2026-10-02T14:32:08Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reboot-single for host an-conf1005.eqiad.wmnet 2463053 wikitext text/x-wiki 4uro5xrlkvikwbzcn957cz4eookq1md 2463054 2463053 2026-10-02T14:37:26Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-conf1005.eqiad.wmnet 2463054 wikitext text/x-wiki bkok66odpyuflmrurl1y8pdukb8qreg 2463055 2463054 2026-10-02T14:39:35Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reboot-single for host an-conf1006.eqiad.wmnet 2463055 wikitext text/x-wiki nl7m8s8uqijiwwqoapbuw23ls9vh9vz 2463056 2463055 2026-10-02T14:44:19Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reimage for host ml-cache2003.codfw.wmnet with OS bookworm 2463056 wikitext text/x-wiki gw5lolzd2e4dh8ehikx4rbc5ghiolgd 2463057 2463056 2026-10-02T14:45:05Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-conf1006.eqiad.wmnet 2463057 wikitext text/x-wiki 4jwcb680n0eyt1f5d58klvlx4bzs6lw 2463058 2463057 2026-10-02T14:47:15Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.druid.reboot-workers for Druid analytics cluster: Reboot Druid nodes 2463058 wikitext text/x-wiki mj9xrzazb5y0ufh22prpsd3plo31rj0 2463060 2463058 2026-10-02T14:56:51Z Stashbot 7414 ebernhardson@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-semantic-search-ssd: apply 2463060 wikitext text/x-wiki itbfmoajon92h9zrnj39ambwvxvy2tj 2463061 2463060 2026-10-02T14:56:55Z Stashbot 7414 ebernhardson@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search-ssd: apply 2463061 wikitext text/x-wiki mwdobze6qhg3g7tzjilhy0cqn8rbxek 2463062 2463061 2026-10-02T15:00:45Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on ml-cache2003.codfw.wmnet with reason: host reimage 2463062 wikitext text/x-wiki 7uxg2gp7uknzwbv5z8b2064tepkd638 2463063 2463062 2026-10-02T15:03:31Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ml-cache2003.codfw.wmnet with reason: host reimage 2463063 wikitext text/x-wiki e3lnx238fxhih4k1a5damjx1i29df93 2463064 2463063 2026-10-02T15:04:46Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.wdqs.reboot 2463064 wikitext text/x-wiki puv46uq3u3rbpgnqf5wmz0zh7ytuqc7 2463065 2463064 2026-10-02T15:20:04Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1004" 2463065 wikitext text/x-wiki 42vv0r2e66pxkn8snifs88k0u3x8rar 2463066 2463065 2026-10-02T15:21:47Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - btullis@cumin1004" 2463066 wikitext text/x-wiki 91gn4dlo06sgflzp7skl3qgonpqimu2 2463067 2463066 2026-10-02T15:21:52Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ml-cache2003.codfw.wmnet with OS bookworm 2463067 wikitext text/x-wiki 27h3lnx48i8hxvcnepa513jn36391tc 2463068 2463067 2026-10-02T15:44:41Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reimage for host an-druid1003.eqiad.wmnet with OS bookworm 2463068 wikitext text/x-wiki hwnj8i17eobfghnsrk8se0rabe4l464 2463069 2463068 2026-10-02T15:45:45Z Stashbot 7414 bking@cumin2003: END (FAIL) - Cookbook sre.wdqs.reboot (exit_code=99) 2463069 wikitext text/x-wiki qjqqfsr32ccrcmz3vubkv49cvudihfu 2463070 2463069 2026-10-02T15:47:35Z Stashbot 7414 btullis@cumin1004: END (ERROR) - Cookbook sre.druid.reboot-workers (exit_code=97) for Druid analytics cluster: Reboot Druid nodes 2463070 wikitext text/x-wiki o7quno4tlgnmkkad0arvp2ds9shla85 2463071 2463070 2026-10-02T15:48:06Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reboot-single for host an-test-client1002.eqiad.wmnet 2463071 wikitext text/x-wiki 1pzhv3tjhfb4t72jbjmv5itl5d3z0ok 2463072 2463071 2026-10-02T15:51:27Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.wdqs.reboot 2463072 wikitext text/x-wiki q7y5s1ekzqd72l5tr1nqfxyajssceft 2463073 2463072 2026-10-02T15:52:16Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-test-client1002.eqiad.wmnet 2463073 wikitext text/x-wiki r5ujt2mnr31o5ldl3aav66abp0xqdvh 2463074 2463073 2026-10-02T15:56:59Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.rename from ml-cache2001 to dse-k8s-worker2009 2463074 wikitext text/x-wiki ixzakyw8r8slp81ob93krc0wzhbfd35 2463075 2463074 2026-10-02T15:57:23Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.dns.netbox 2463075 wikitext text/x-wiki j9b6ex1kis5srdq513apddqvia8fnn1 2463078 2463075 2026-10-02T16:01:12Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming ml-cache2001 to dse-k8s-worker2009 - btullis@cumin1004" 2463078 wikitext text/x-wiki bn3jal7lf3495nxik4kqwerqech0tip 2463079 2463078 2026-10-02T16:02:43Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.rename from ml-cache2002 to dse-k8s-worker2010 2463079 wikitext text/x-wiki 7kwfja5mqr2h4g2kaxo952uvjr3id9c 2463080 2463079 2026-10-02T16:02:51Z Stashbot 7414 ebernhardson@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-semantic-search-ssd: apply 2463080 wikitext text/x-wiki t2xdvv852r97so9tck4absgw2y1xg0e 2463081 2463080 2026-10-02T16:02:55Z Stashbot 7414 ebernhardson@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search-ssd: apply 2463081 wikitext text/x-wiki cvkl8qd59y5v1oudvfm7kea63g6eyer 2463082 2463081 2026-10-02T16:02:56Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming ml-cache2001 to dse-k8s-worker2009 - btullis@cumin1004" 2463082 wikitext text/x-wiki 4r0raoxuo1jqtmkk5sfi80c6sxyg5xv 2463083 2463082 2026-10-02T16:02:58Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2463083 wikitext text/x-wiki tgv2r5hhbrdjuw4wmrriidy2t7j7yuk 2463084 2463083 2026-10-02T16:02:59Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.dns.wipe-cache dse-k8s-worker2009 on all recursors 2463084 wikitext text/x-wiki rkhzmq5rs2hgta7yr5ehqw47ratw62e 2463086 2463084 2026-10-02T16:03:03Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) dse-k8s-worker2009 on all recursors 2463086 wikitext text/x-wiki q05ehy4mxkv8ayca4ggzfir6kf62dop 2463087 2463086 2026-10-02T16:03:05Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.network.configure-switch-interfaces for host dse-k8s-worker2009 2463087 wikitext text/x-wiki j701jz7t3bmk8xv5or4l4epvw5tmltj 2463088 2463087 2026-10-02T16:03:08Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.dns.netbox 2463088 wikitext text/x-wiki 18dxtq916fxvtukj5wvvbll9vw9mtcd 2463089 2463088 2026-10-02T16:03:13Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dse-k8s-worker2009 2463089 wikitext text/x-wiki gten0ihuvyvdcb7kispvwpu7kx26e66 2463090 2463089 2026-10-02T16:03:47Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from ml-cache2001 to dse-k8s-worker2009 2463090 wikitext text/x-wiki 0sa49i76k5unt85ydvrtl8k4bop2alt 2463091 2463090 2026-10-02T16:04:03Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.rename from ml-cache2003 to dse-k8s-worker2011 2463091 wikitext text/x-wiki hi6fbzrw5q9tlfzeumtdue6keh9m7ca 2463092 2463091 2026-10-02T16:05:15Z Stashbot 7414 btullis@cumin1004: END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) 2463092 wikitext text/x-wiki 673vwt3nng8ke1h95wk4jyhf7hvez20 2463093 2463092 2026-10-02T16:05:16Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.dns.netbox 2463093 wikitext text/x-wiki 0j3y9ups6d3cwqduldi4tnb5k5jo13n 2463094 2463093 2026-10-02T16:07:30Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reimage for host dse-k8s-worker2009.codfw.wmnet with OS bookworm 2463094 wikitext text/x-wiki jajnxfsern5wfx5kmwahq9y0qgtsvrj 2463095 2463094 2026-10-02T16:09:02Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming ml-cache2003 to dse-k8s-worker2011 - btullis@cumin1004" 2463095 wikitext text/x-wiki qrb78s3luiefbbdmirqxuooov5noc4q 2463096 2463095 2026-10-02T16:10:40Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.dns.netbox 2463096 wikitext text/x-wiki 5jd2tdob9l7ht0qk96tiqv6q1hiok1y 2463097 2463096 2026-10-02T16:13:05Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2463097 wikitext text/x-wiki s63yqzglo0s5bk9gq3skr6p4b3yds93 2463098 2463097 2026-10-02T16:13:07Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.dns.wipe-cache dse-k8s-worker2010 on all recursors 2463098 wikitext text/x-wiki 7t3pl4xztrnugj4c52xhrifj4gd8bie 2463099 2463098 2026-10-02T16:13:09Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) dse-k8s-worker2010 on all recursors 2463099 wikitext text/x-wiki ej46idn96msryn2llrkan8lk7jd0zqq 2463100 2463099 2026-10-02T16:13:10Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.network.configure-switch-interfaces for host dse-k8s-worker2010 2463100 wikitext text/x-wiki n03ozi6dlff0oca95tkbf6qy8r2kjv6 2463103 2463100 2026-10-02T16:21:39Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming ml-cache2003 to dse-k8s-worker2011 - btullis@cumin1004" 2463103 wikitext text/x-wiki dh9rpiz3b5d1p33q5xpsi21ic4kv9r5 2463104 2463103 2026-10-02T16:21:40Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2463104 wikitext text/x-wiki a0ds6ee9glg539b80h36ge2y78845lz 2463105 2463104 2026-10-02T16:21:42Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.dns.wipe-cache dse-k8s-worker2011 on all recursors 2463105 wikitext text/x-wiki 5scy41xss6gnwdsxcxs5j6rd7srv1oe 2463106 2463105 2026-10-02T16:21:43Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dse-k8s-worker2010 2463106 wikitext text/x-wiki 3y2kt0tub580sar5z8vdsa5anwtwu73 2463107 2463106 2026-10-02T16:21:44Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) dse-k8s-worker2011 on all recursors 2463107 wikitext text/x-wiki 03lm4ptvvov722jh1bblxghed6gexx7 2463108 2463107 2026-10-02T16:21:45Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.network.configure-switch-interfaces for host dse-k8s-worker2011 2463108 wikitext text/x-wiki 3kky73oxg8sgz5sc7lnmhilmoqdlmsi 2463109 2463108 2026-10-02T16:21:59Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dse-k8s-worker2011 2463109 wikitext text/x-wiki 1s2td4pfwnorcffeimu6k4cuosj3aec 2463110 2463109 2026-10-02T16:22:15Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from ml-cache2002 to dse-k8s-worker2010 2463110 wikitext text/x-wiki 9jbobunwfb1m2wnws9ogplb69ebwivr 2463111 2463110 2026-10-02T16:22:34Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from ml-cache2003 to dse-k8s-worker2011 2463111 wikitext text/x-wiki loxmvr6aeu83nizq91s1fg4zxhsu4w6 2463112 2463111 2026-10-02T16:24:20Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on dse-k8s-worker2009.codfw.wmnet with reason: host reimage 2463112 wikitext text/x-wiki ds29lp2lme3h7m1fu2umyt0ptzehe5z 2463114 2463112 2026-10-02T16:28:05Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dse-k8s-worker2009.codfw.wmnet with reason: host reimage 2463114 wikitext text/x-wiki a3jst5209b57kxputw74yx1ugizs3nq 2463115 2463114 2026-10-02T16:28:43Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-staging-codfw] 'sync' command on namespace 'tts-section-generator' for release 'main' . 2463115 wikitext text/x-wiki 2wlhgsyc7ciagy2s3uki178qb39es7y 2463116 2463115 2026-10-02T16:31:28Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-serve-eqiad] 'sync' command on namespace 'tts-section-generator' for release 'main' . 2463116 wikitext text/x-wiki dr7b3o8nj8h981xemylwnjuktjj0zzu 2463117 2463116 2026-10-02T16:33:10Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-serve-codfw] 'sync' command on namespace 'tts-section-generator' for release 'main' . 2463117 wikitext text/x-wiki 7tix9azechv7fdkbd15hr9oymiv48bj 2463118 2463117 2026-10-02T16:44:18Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dse-k8s-worker2009.codfw.wmnet with OS bookworm 2463118 wikitext text/x-wiki a9eau3hunzdyv6ol10mug7kk1k164zd 2463121 2463118 2026-10-02T17:23:36Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) 2463121 wikitext text/x-wiki o6ary242xcn9r1luslqidxsdbwk569r 2463122 2463121 2026-10-02T17:25:13Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.wdqs.reboot 2463122 wikitext text/x-wiki rcy1epmnz4ytnhhw3ectprssq6c03d9 2463123 2463122 2026-10-02T17:35:01Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.reboot-single for host flink-zk1001.eqiad.wmnet 2463123 wikitext text/x-wiki 8u0rxbcvamion52s3oh7to2cdw11g3p 2463124 2463123 2026-10-02T17:39:07Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host flink-zk1001.eqiad.wmnet 2463124 wikitext text/x-wiki djahvlba2xfvdhh8y8q1avua0q8qagh 2463125 2463124 2026-10-02T17:39:18Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.wdqs.reboot (exit_code=0) 2463125 wikitext text/x-wiki gfvnofexjp0085roo9ou9sotvfrbkhy 2463127 2463125 2026-10-02T17:41:46Z Stashbot 7414 dzahn@dns1004: START - running authdns-update 2463127 wikitext text/x-wiki 23b8h6dfo57ux67hruijw01crxxm9lz 2463128 2463127 2026-10-02T17:42:24Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.reboot-single for host flink-zk1002.eqiad.wmnet 2463128 wikitext text/x-wiki 1hh3lf5sntkfsceh7ljb2tsypbx09ma 2463129 2463128 2026-10-02T17:44:22Z Stashbot 7414 dzahn@dns1004: END - running authdns-update 2463129 wikitext text/x-wiki r3ggr7hlkth3jk13dt57qx03rt7im6w 2463130 2463129 2026-10-02T17:45:30Z Stashbot 7414 dzahn@cumin1004: START - Cookbook sre.hosts.decommission for hosts zuul1001.eqiad.wmnet 2463130 wikitext text/x-wiki k2l80j65mjhwv2tbxa7ea01gaxfsrf5 2463131 2463130 2026-10-02T17:46:18Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host flink-zk1002.eqiad.wmnet 2463131 wikitext text/x-wiki a21yxsqutsut6ipxgl656a0balai91m 2463132 2463131 2026-10-02T17:47:01Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.reboot-single for host flink-zk2001.codfw.wmnet 2463132 wikitext text/x-wiki i7eiblr5rdinr6qa2ris3llx512wusd 2463134 2463132 2026-10-02T17:50:22Z Stashbot 7414 dzahn@cumin1004: START - Cookbook sre.dns.netbox 2463134 wikitext text/x-wiki 62ovxe9ed4ctt6xgjvnh00xsql740lh 2463135 2463134 2026-10-02T17:51:03Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host flink-zk2001.codfw.wmnet 2463135 wikitext text/x-wiki oxpyv3k3w5nsqpp6z6pch858pvfrp6z 2463136 2463135 2026-10-02T17:56:43Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.reboot-single for host flink-zk1003.eqiad.wmnet 2463136 wikitext text/x-wiki dxkvehrvqxn54snesyyafx8qyftqtlg 2463137 2463136 2026-10-02T17:56:53Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.reboot-single for host flink-zk2002.codfw.wmnet 2463137 wikitext text/x-wiki djf30y5txdol1wvc3nb9fagyowdkn7c 2463138 2463137 2026-10-02T18:00:42Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host flink-zk1003.eqiad.wmnet 2463138 wikitext text/x-wiki 8tackhl9mob3opbqkwf4gjk3vnqt1km 2463139 2463138 2026-10-02T18:00:54Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host flink-zk2002.codfw.wmnet 2463139 wikitext text/x-wiki 4vteh9ofyr48gsla95g1t41ttxzj4nd 2463140 2463139 2026-10-02T18:01:13Z Stashbot 7414 dzahn@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: zuul1001.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - dzahn@cumin1004" 2463140 wikitext text/x-wiki epqabrh3wrvz5jd2y4xrjnqaale0ddo 2463141 2463140 2026-10-02T18:01:38Z Stashbot 7414 dzahn@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: zuul1001.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - dzahn@cumin1004" 2463141 wikitext text/x-wiki iig0ybikf524ckjft45lfbamy0whu10 2463142 2463141 2026-10-02T18:01:39Z Stashbot 7414 dzahn@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2463142 wikitext text/x-wiki 633gnwm61ikqtuugysjpx8xt6fku0s7 2463143 2463142 2026-10-02T18:01:40Z Stashbot 7414 dzahn@cumin1004: END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts zuul1001.eqiad.wmnet 2463143 wikitext text/x-wiki 394l8ri1y4uqliyc7ch4c7shjidlwvb 2463144 2463143 2026-10-02T18:03:17Z Stashbot 7414 dzahn@cumin1004: START - Cookbook sre.hosts.reimage for host zuul1004.eqiad.wmnet with OS trixie 2463144 wikitext text/x-wiki rk5jo3ydj4thmvfs1nakmkzso6ssmo6 2463148 2463144 2026-10-02T18:36:19Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.reboot-single for host flink-zk2003.codfw.wmnet 2463148 wikitext text/x-wiki 2yal0hb6rgvjla99o2eiresh4uwzf6d 2463149 2463148 2026-10-02T18:40:10Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host flink-zk2003.codfw.wmnet 2463149 wikitext text/x-wiki amh213xiblw711won48rn9dmsfaxiwq 2463150 2463149 2026-10-02T19:08:13Z Stashbot 7414 dzahn@cumin1004: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host zuul1004.eqiad.wmnet with OS trixie 2463150 wikitext text/x-wiki o8i3acyzz20fflz7kfsj6pju57wi7rl 2463151 2463150 2026-10-02T19:33:38Z Stashbot 7414 mutante: zuul1004 - reimage stuck in d-i on leftover software RAID/LVM from its previous life as a ganeti host; wiping old md/LVM metadata and partition tables from the installer shell same fix as on zuul1005 (as also mentioned by Valerie/dcops) - T427353 2463151 wikitext text/x-wiki 1d7ravljz024yolm5uqnmq6uswl84xs 2463153 2463151 2026-10-02T19:37:24Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-druid1003'] 2463153 wikitext text/x-wiki 4mur9ql6sov5ljm3e7o7l5ipz2khpjm 2463154 2463153 2026-10-02T19:37:50Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-druid1003'] 2463154 wikitext text/x-wiki kieahgingy9nsbssxifhpsz6jmngc92 2463155 2463154 2026-10-02T19:37:57Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-druid1003'] 2463155 wikitext text/x-wiki 3p2l48man6obq6ehtlk5anoymr7aq7v 2463156 2463155 2026-10-02T19:39:05Z Stashbot 7414 dzahn@cumin1004: START - Cookbook sre.hosts.reimage for host zuul1004.eqiad.wmnet with OS trixie 2463156 wikitext text/x-wiki 5eg8k6kixuj2gs0wqd0gyllwkmdf9ko 2463159 2463156 2026-10-02T19:46:11Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['an-druid1003'] 2463159 wikitext text/x-wiki 4q4wufqvkf77a675nt87pnxcqqgi57f 2463160 2463159 2026-10-02T19:47:58Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['an-druid1003'] 2463160 wikitext text/x-wiki 6vhwhw50ftk637eb1kvmyhxmrfb2qkj 2463161 2463160 2026-10-02T19:54:07Z Stashbot 7414 dzahn@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on zuul1004.eqiad.wmnet with reason: host reimage 2463161 wikitext text/x-wiki mpf7mg46xrddk9klge9y3kpkthpyin8 2463162 2463161 2026-10-02T19:58:39Z Stashbot 7414 dzahn@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on zuul1004.eqiad.wmnet with reason: host reimage 2463162 wikitext text/x-wiki ru9e1jsq04wwe6c50n7f60qpi8xsljs 2463163 2463162 2026-10-02T20:10:09Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reimage for host dse-k8s-worker2011.codfw.wmnet with OS bookworm 2463163 wikitext text/x-wiki 4dl376pbnrs44ygt6k6yej91hnp9tq1 2463164 2463163 2026-10-02T20:10:34Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reimage for host dse-k8s-worker2010.codfw.wmnet with OS bookworm 2463164 wikitext text/x-wiki mha3f4x2fgy01s0ttyky6djokyg65ny 2463165 2463164 2026-10-02T20:17:25Z Stashbot 7414 dzahn@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host zuul1004.eqiad.wmnet with OS trixie 2463165 wikitext text/x-wiki qqqq65y23ype0jm2n55vhx046vcr7b4 2463166 2463165 2026-10-02T20:20:56Z Stashbot 7414 osleger@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2463166 wikitext text/x-wiki 5behv5sjne4ign8kmsg98tzqrbjrrg1 2463167 2463166 2026-10-02T20:21:27Z Stashbot 7414 osleger@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2463167 wikitext text/x-wiki 7yjq2ecmdvub81g6ecjucespcjcan1t 2463168 2463167 2026-10-02T20:21:28Z Stashbot 7414 osleger@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2463168 wikitext text/x-wiki sd51zlr8uk9y6x5xshwperfylxqy8tv 2463169 2463168 2026-10-02T20:22:05Z Stashbot 7414 osleger@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2463169 wikitext text/x-wiki n4dlbzlczxhisg3mylbp0tbd7697mar 2463170 2463169 2026-10-02T20:23:29Z Stashbot 7414 osleger@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2463170 wikitext text/x-wiki 92hwz2lhqdakf3g757wd6k47odfq7b4 2463171 2463170 2026-10-02T20:23:31Z Stashbot 7414 osleger@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2463171 wikitext text/x-wiki jf23gx9blijaz4huteqr8h4t6n8tqci 2463172 2463171 2026-10-02T20:23:32Z Stashbot 7414 osleger@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2463172 wikitext text/x-wiki 1tdr7p5s8f3x5e07ep0n9pcdgqdakdg 2463173 2463172 2026-10-02T20:23:35Z Stashbot 7414 osleger@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2463173 wikitext text/x-wiki gocec1rr6sipqdfoz7ngt3cx71lqnl0 2463174 2463173 2026-10-02T20:26:37Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on dse-k8s-worker2011.codfw.wmnet with reason: host reimage 2463174 wikitext text/x-wiki rw5iscabfddtonwz6ph49p30cxu57nj 2463175 2463174 2026-10-02T20:26:58Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on dse-k8s-worker2010.codfw.wmnet with reason: host reimage 2463175 wikitext text/x-wiki pfkqnogag0bguufb8uicqg4x5pto81d 2463178 2463175 2026-10-02T20:31:57Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dse-k8s-worker2011.codfw.wmnet with reason: host reimage 2463178 wikitext text/x-wiki a7tzgk7n6jilxtpa8mddt56zzkj7nqp 2463179 2463178 2026-10-02T20:37:47Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dse-k8s-worker2010.codfw.wmnet with reason: host reimage 2463179 wikitext text/x-wiki ozofzzcu7rbfdurgbzqhbclddppxddq 2463180 2463179 2026-10-02T20:40:54Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.hosts.reimage for host an-druid1003.eqiad.wmnet with OS bookworm 2463180 wikitext text/x-wiki 09pqd0plxr9s5swd8cvtprcg2wcd9dh 2463181 2463180 2026-10-02T20:49:03Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dse-k8s-worker2011.codfw.wmnet with OS bookworm 2463181 wikitext text/x-wiki osrqr0bpk4h10a7xfb1a7lnu9kj537d 2463182 2463181 2026-10-02T20:53:49Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dse-k8s-worker2010.codfw.wmnet with OS bookworm 2463182 wikitext text/x-wiki 143a7zhwhoyr088qg1yg1m1nw35fhwx 2463183 2463182 2026-10-02T20:54:36Z Stashbot 7414 inflatador: bking@an-druid100[4-7] `tune2fs -m0 /dev/mapper/vg0-srv` T440033 2463183 wikitext text/x-wiki sy5muw68lp70lzmtkv7b74fmf2r58rf 2463184 2463183 2026-10-02T21:01:38Z Stashbot 7414 jclark@cumin1004: START - Cookbook sre.hosts.provision for host an-druid1003.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2463184 wikitext text/x-wiki 7a5djjtvodrozkq47pklfoe95etga8s 2463188 2463184 2026-10-02T21:10:21Z Stashbot 7414 jclark@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host an-druid1003.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2463188 wikitext text/x-wiki rl3zq8722443rnxj2kxaq5cw0mk6znw 2463201 2463188 2026-10-03T02:00:54Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2463201 wikitext text/x-wiki ff0in3su4x0p65p5vt4dkk3eal4j7a4 2463203 2463201 2026-10-03T02:08:23Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 07m 28s) 2463203 wikitext text/x-wiki se6nvkomabo2bfusjn6bmay6s9a1bqh 498 16138 2463189 147740 2026-10-02T21:44:06Z Krinkle 44 2463189 wikitext text/x-wiki f82er2q020xyufrhluj2znmzior79ih 0 17290 2463085 2462714 2026-10-02T16:03:02Z Stashbot 7414 Krinkle: krinkle@doc2003:/srv/doc/cover$ sudo -u doc-uploader rm -rf mediawiki-libs-node-cssjanus/; krinkle@doc1004:/srv/doc/cover$ sudo -u doc-uploader rm -rf mediawiki-libs-node-cssjanus/; ref T424419 2463085 wikitext text/x-wiki rmriw7mazidy26yxgx0q2gu6xsov5hx 1 19371 2463176 1755279 2026-10-02T20:28:08Z Allisoncarrielee 60176 /* Database */ new section 2463176 wikitext text/x-wiki 85k2exoqr756n53rkd5uyav7569mcec 2463177 2463176 2026-10-02T20:29:50Z Allisoncarrielee 60176 /* Database */ 2463177 wikitext text/x-wiki lniih7544ttvb6z87l7mmi2ujkb7gwl 2463193 2463177 2026-10-03T00:03:47Z JJMC89 7474 Reverted edits by [[Special:Contributions/Allisoncarrielee|Allisoncarrielee]] ([[User talk:Allisoncarrielee|talk]]) to last revision by [[User:Joal~labswiki|Joal~labswiki]] 1755279 wikitext text/x-wiki 0hmq3fcts41rc1ce06kru6po4v9e272 0 20832 2463205 2462787 2026-10-03T10:40:02Z Meno25 1446 update redirected links 2463205 wikitext text/x-wiki 2f7ewpb1e6y3mu1k9bv4xmyjl9gfera 498 30942 2463029 2462970 2026-10-02T12:37:32Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.depool_and_destroy (T429387) 2463029 wikitext text/x-wiki mnbiiod1m01km5yn136aoaznulrprid 2463032 2463029 2026-10-02T12:59:13Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.bootstrap_and_add 2463032 wikitext text/x-wiki fc8ho3zoj2mnqvvn8eb9rdmmrol6evf 2463035 2463032 2026-10-02T13:06:48Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=0) 2463035 wikitext text/x-wiki 381vcivk3l860aqq8bcwueu1o20amxv 2463101 2463035 2026-10-02T16:15:20Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.restart_openstack on deployment codfw1dev for service: project,trove 2463101 wikitext text/x-wiki l2v8lhrtpnfw768y5xd5q5onf4ft3wr 2463102 2463101 2026-10-02T16:15:32Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.restart_openstack (exit_code=0) on deployment codfw1dev for service: project,trove 2463102 wikitext text/x-wiki do9124rd241bhrh9iwsdwg39h0k4ms2 2463119 2463102 2026-10-02T17:18:09Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=99) (T429387) 2463119 wikitext text/x-wiki 431n0id1sbeen0vxissmmxwj9bldpuc 2463120 2463119 2026-10-02T17:21:04Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.depool_and_destroy (T429387) 2463120 wikitext text/x-wiki h93lupkk3xwvjg35uhmol33fwc817qk 2463126 2463120 2026-10-02T17:40:09Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.bootstrap_and_add 2463126 wikitext text/x-wiki iwwazwu7v6w7pqcitayj8t33owckh4h 2463133 2463126 2026-10-02T17:47:41Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=0) 2463133 wikitext text/x-wiki adzgc1oveysqd84zemx6b21qg6ctkjt 2463191 2463133 2026-10-02T23:45:19Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.depool_and_destroy (T429387) 2463191 wikitext text/x-wiki qyylixgv32kbnhwaaoxm4ukf8gsqddk 2463194 2463191 2026-10-03T00:27:39Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=99) (T429387) 2463194 wikitext text/x-wiki o1qa7onw7zcn9z5w2kxltlx4nm0fy03 2463195 2463194 2026-10-03T00:27:49Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.depool_and_destroy (T429387) 2463195 wikitext text/x-wiki 9rwhlyszvblr5pbfsqhjp8ywy3nteq0 2463196 2463195 2026-10-03T00:28:07Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=99) (T429387) 2463196 wikitext text/x-wiki ggxyd5fbrpl6vd0almk3ajjoz5lmm0l 2463197 2463196 2026-10-03T00:28:16Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.depool_and_destroy (T429387) 2463197 wikitext text/x-wiki go6k5hyk199ayfdx953lv7gx8putovf 2463198 2463197 2026-10-03T01:05:28Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.bootstrap_and_add 2463198 wikitext text/x-wiki mt9p6edh89mi3nfid18qbjv0oqsqq6s 2463199 2463198 2026-10-03T01:12:40Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=0) 2463199 wikitext text/x-wiki s65xxjxeqm9bbchf98mpmi6psoc8ogh 2463204 2463199 2026-10-03T05:06:07Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=99) (T429387) 2463204 wikitext text/x-wiki g3m9fg51e7625egzoflrtwfpt6w2pby 498 443946 2463206 2460741 2026-10-03T10:59:16Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: deployed 1312363: Migrate to Toolforge Components API with push-to-deploy [also undeployed T431146 debug logging, no longer needed] 2463206 wikitext text/x-wiki o73kly3epmb1df81mmbtds3jpccuysr 2463207 2463206 2026-10-03T11:05:40Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: deployed 1312363..9a129cb: l10n updates (ne) 2463207 wikitext text/x-wiki r745l08t4ngcy8tvqhcqxpu3nskdv7o 498 443949 2463157 2462641 2026-10-02T19:40:53Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 167fb9c (Support sourcing dashboard columns from a property's values on an item) for T429918 2463157 wikitext text/x-wiki i6odq72hezl5g0dnk3bxzt64n0h5ax1 2463158 2463157 2026-10-02T19:46:09Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 94d37aa (Log grouping-type detection to the update stream) 2463158 wikitext text/x-wiki mtlpb5bx0pk2iwznmcxlvclgknvzzqr 0 449160 2463192 2462938 2026-10-03T00:01:22Z Dexbot 30554 Bot: Updating the report 2463192 wikitext text/x-wiki le6vo8igyeqm9sbtjw95lgn1lq0z82w 0 451533 2463034 2452190 2026-10-02T13:00:42Z APuthin-WMF 52425 Updating next agenda & date 2463034 wikitext text/x-wiki 0rbdlmhozmkx5chobmmtxerv82v16dn 116 453906 2463013 2461709 2026-10-02T12:12:18Z Gitlabaccountapprovalbot 37332 mgagat was rejected. 2463013 wikitext text/x-wiki e1hx2ou8ukxn7plbqgae86goobhec6s 2463031 2463013 2026-10-02T12:57:26Z Gitlabaccountapprovalbot 37332 @harii was approved. 2463031 wikitext text/x-wiki cvxdlzk9rq1kat7aa0ok05pkcnu0rmy 2463059 2463031 2026-10-02T14:51:34Z Gitlabaccountapprovalbot 37332 @nichesports was approved. 2463059 wikitext text/x-wiki iio1d1sqnxxrxb90u65d7kv3xhwfnds 498 458783 2463076 2460199 2026-10-02T15:57:57Z Krinkle 44 /* Unblocking an IP or network */ 2463076 wikitext text/x-wiki gy8fu6pt03sp5wkd2fxk83qjm4dfrpb 2463077 2463076 2026-10-02T15:58:15Z Krinkle 44 /* Blocking an IP or network */ cache-text => cp-text 2463077 wikitext text/x-wiki k83gjpcmp9ww6em2ivfyaplfeoykpko 0 459699 2463025 2462950 2026-10-02T12:20:37Z Stashbot 7414 jgleeson: payments-wiki upgraded from dae59de9 to dac9a1b9 2463025 wikitext text/x-wiki 7dkgn84d6faohgvsrw0efgem65ozcdn 0 460652 2463202 2461098 2026-10-03T02:00:59Z DeploymentCalendarTool 20896 Add last week 2463202 wikitext text/x-wiki 2w3295o2s9yemnfcv2mxex2k8zk4zp6 0 460760 2463033 2026-10-02T13:00:12Z APuthin-WMF 52425 Adding 2026-09-29 meeting notes 2463033 wikitext text/x-wiki o3823l1zmt9f23ljrrmw3fok313u4r7 0 460763 2463152 2026-10-02T19:33:53Z PFischer-WMF 38527 Created page with "= Highlights = * [https://phabricator.wikimedia.org/T204089 T204089] A Community Wishlist request from September 2018 is out with 1.47.0-wmf.21: searches can now exclude redirects or match only them. The original use case was Commons maintenance — a typo fix in a file title leaves a redirect under the old name, so searching for that misspelling keeps returning files already corrected. A [https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(technical)#Curating_redirec..." 2463152 wikitext text/x-wiki h8yqc7adwpq35474ml7pvf8dteebfsk