Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.48.0-wmf.1 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 1 2515 2476589 2454936 2026-11-03T03:30:18Z Atotxa 62253 /* In my very first time… */ new section 2476589 wikitext text/x-wiki affaatalenc6iz55qsh5liiuxbosj3t 2476590 2476589 2026-11-03T03:39:49Z JJMC89 7474 Reverted 1 edit by [[Special:Contributions/Atotxa|Atotxa]] ([[User talk:Atotxa|talk]]) to last revision by Enbi 2476590 wikitext text/x-wiki siv1uf1xtkisdnkqlv766k79ajz1z2r 0 3225 2476463 2367187 2026-11-02T20:13:38Z Quiddity 1884 fix [[w:WP:LISTGAP]] issues 2476463 wikitext text/x-wiki boimbvog1v8p99adb5xpextvasy6h3d 0 4044 2476487 2369454 2026-11-02T22:56:57Z LFrost-WMF 59983 /* HOWTO */ SAL link 2476487 wikitext text/x-wiki eks4pj3yy33wc9un1lbz0j04h3hr1th 2476488 2476487 2026-11-02T23:24:18Z LFrost-WMF 59983 /* HOWTO */ better SAL link 2476488 wikitext text/x-wiki 3pqu82jxbxfz857rla6wwaqwwb9yuep 0 4108 2476114 2476074 2026-11-02T12:05:37Z ScheduleDeploymentBot 37566 Add [[gerrit:1361372]] to Monday, November 02 UTC afternoon backport window 2476114 wikitext text/x-wiki ephbz286si2xa6ullir306z4cq0up6e 2476120 2476114 2026-11-02T12:06:34Z ScheduleDeploymentBot 37566 Add [[gerrit:1361373]] to Monday, November 02 UTC afternoon backport window 2476120 wikitext text/x-wiki 2tabxnnwp4kqu7y9h548vs9bi5776b5 2476121 2476120 2026-11-02T12:07:12Z ScheduleDeploymentBot 37566 Add [[gerrit:1361379]] to Monday, November 02 UTC afternoon backport window 2476121 wikitext text/x-wiki ispcvqncwkruysztn6v96830wffho44 2476122 2476121 2026-11-02T12:07:29Z ScheduleDeploymentBot 37566 Add [[gerrit:1361378]] to Monday, November 02 UTC afternoon backport window 2476122 wikitext text/x-wiki 3q21f19kcvd7ixvhtmpj6wubfz3ekn2 2476123 2476122 2026-11-02T12:07:57Z ScheduleDeploymentBot 37566 Add [[gerrit:1361369]] to Monday, November 02 UTC afternoon backport window 2476123 wikitext text/x-wiki eqij0jsglsmsl2lkwiwbil6ex0qygzd 2476208 2476123 2026-11-02T13:40:48Z Audrey Penven (WMDE) 37575 moving the copyright notice changes up because they are high priority 2476208 wikitext text/x-wiki t2ez8czmii9i9gqk220bjc4wy52ri92 2476372 2476208 2026-11-02T19:10:53Z ScheduleDeploymentBot 37566 Add [[gerrit:1311061]] to Monday, November 02 UTC late backport window 2476372 wikitext text/x-wiki jdy1yx7e0bsu0bi0sxc5b2lemkmsj62 2476373 2476372 2026-11-02T19:20:48Z ScheduleDeploymentBot 37566 Add [[gerrit:1360551]] to Monday, November 02 UTC late backport window 2476373 wikitext text/x-wiki 6gbdivjhkmot4oi7yb6iotquo4cfb3u 2476374 2476373 2026-11-02T19:21:05Z ScheduleDeploymentBot 37566 Add [[gerrit:1359878]] to Monday, November 02 UTC late backport window 2476374 wikitext text/x-wiki 3y9z15r8f7n4rqlgohqkacbyq5tvk4p 2476484 2476374 2026-11-02T22:27:04Z Krinkle 44 /* {{Deployment_day|date=2026-11-02}} */ 2476484 wikitext text/x-wiki oml9lguwpg8wmydp12jo8heerzrpt4a 2476597 2476484 2026-11-03T05:00:34Z ScheduleDeploymentBot 37566 Add [[gerrit:1359140]] to Tuesday, November 03 UTC afternoon backport window 2476597 wikitext text/x-wiki r0xam688pgwvgnx2j72h2ueotigf3wn 2476603 2476597 2026-11-03T05:20:32Z ScheduleDeploymentBot 37566 Add [[gerrit:1361187]] to Tuesday, November 03 UTC morning backport window 2476603 wikitext text/x-wiki 4bv6dgln7ojop9fakm4kgfrvt5stcmv 2476604 2476603 2026-11-03T05:20:56Z ScheduleDeploymentBot 37566 Add [[gerrit:1360437]] to Tuesday, November 03 UTC morning backport window 2476604 wikitext text/x-wiki hjreqbfipzxni7x32ww30g6o7rg2hnl 2476631 2476604 2026-11-03T09:04:11Z JNuche (WMF) 30132 Add missing UTC train window 2476631 wikitext text/x-wiki 2zohfrxdbsyo5adjcgf9ht4ccdslqiv 2476633 2476631 2026-11-03T09:10:04Z JNuche (WMF) 30132 Add missing UTC train window - Wed 2476633 wikitext text/x-wiki bq46mb386tf2sj7pmzsroquh4ej57zt 2476634 2476633 2026-11-03T09:11:26Z JNuche (WMF) 30132 Add missing UTC train window - Thurs 2476634 wikitext text/x-wiki 1aynkky5i7w8a59elsdocpoibictqa6 2476682 2476634 2026-11-03T10:42:50Z ScheduleDeploymentBot 37566 Add [[gerrit:1361187]] to Tuesday, November 03 UTC afternoon backport window 2476682 wikitext text/x-wiki 2fl3v4u03of7t5d17g9bbw3lzw527sb 2476684 2476682 2026-11-03T10:43:14Z ScheduleDeploymentBot 37566 Add [[gerrit:1355072]] to Tuesday, November 03 UTC afternoon backport window 2476684 wikitext text/x-wiki by06746eiwe1jwl0676ion2u3lpoztn 2476694 2476684 2026-11-03T11:03:57Z ScheduleDeploymentBot 37566 Add [[gerrit:1361447]] to Tuesday, November 03 UTC afternoon backport window 2476694 wikitext text/x-wiki 8e5mfekotgq2mi174l88u36zpe92zu0 2476703 2476694 2026-11-03T11:27:12Z ScheduleDeploymentBot 37566 Add [[gerrit:1361843]] to Tuesday, November 03 UTC late backport window 2476703 wikitext text/x-wiki 2q8pxmd70saypchhdensjmbpwe1415p 2476704 2476703 2026-11-03T11:27:34Z ScheduleDeploymentBot 37566 Add [[gerrit:1361837]] to Tuesday, November 03 UTC late backport window 2476704 wikitext text/x-wiki 59yuhxt2674t4rr6yr0vyhgr0jj0rwl 0 7919 2476098 2476097 2026-11-02T11:59:43Z Stashbot 7414 blake@deploy2003: Finished scap sync-world: Non-build deploy to bump chart version (T434925) (duration: 07m 48s) 2476098 wikitext text/x-wiki mti6jp1ly61tjg7c3ge8roj06pftjbp 2476099 2476098 2026-11-02T12:00:06Z Stashbot 7414 root@deploy2003: helmfile [staging] START helmfile.d/services/shellbox: sync 2476099 wikitext text/x-wiki p7ucme3qpuevn21ubrmrdhwbdt4tnfx 2476100 2476099 2026-11-02T12:00:16Z Stashbot 7414 root@deploy2003: helmfile [staging] DONE helmfile.d/services/shellbox: sync 2476100 wikitext text/x-wiki pvzgld6ji4xptq7naqvlxe7clnm180y 2476101 2476100 2026-11-02T12:00:20Z Stashbot 7414 root@deploy2003: helmfile [staging] START helmfile.d/services/shellbox-timeline: sync 2476101 wikitext text/x-wiki ewh1kjs3gv8o2p0mrelvu6496ylmc78 2476102 2476101 2026-11-02T12:00:30Z Stashbot 7414 root@deploy2003: helmfile [staging] DONE helmfile.d/services/shellbox-timeline: sync 2476102 wikitext text/x-wiki l6rbh9zd30o9ojn90aj8hezs17xf179 2476103 2476102 2026-11-02T12:00:34Z Stashbot 7414 root@deploy2003: helmfile [codfw] START helmfile.d/services/shellbox-timeline: sync 2476103 wikitext text/x-wiki cgor15j06l7kgcbbdophpdprqwrg647 2476104 2476103 2026-11-02T12:00:42Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.k8s.reboot-nodes rolling reboot on A:wikikube-master-eqiad 2476104 wikitext text/x-wiki 301t0f24pef2aer0b2d1u7o6qo10gnu 2476105 2476104 2026-11-02T12:00:45Z Stashbot 7414 root@deploy2003: helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: sync 2476105 wikitext text/x-wiki 5xw64ezxq8gyen15bfqsodcgf2u4cuf 2476106 2476105 2026-11-02T12:00:48Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-ctrl1002.eqiad.wmnet 2476106 wikitext text/x-wiki c31wx7til5hp54a81u9y1f29d4s7bmu 2476107 2476106 2026-11-02T12:00:51Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-ctrl1002.eqiad.wmnet 2476107 wikitext text/x-wiki 6b4enit81k532k5ajpym0lwhtpjhr1e 2476108 2476107 2026-11-02T12:02:59Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on rpki1001.eqiad.wmnet with reason: host reimage 2476108 wikitext text/x-wiki en8om3ua9jrzpzh1untcnsb13vxcbqq 2476109 2476108 2026-11-02T12:03:24Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox-canary 2476109 wikitext text/x-wiki 1j4qhkroszzx3ijw8j1r7qs83d365rp 2476110 2476109 2026-11-02T12:04:26Z Stashbot 7414 jiji@cumin1004: START - Cookbook sre.hosts.reboot-single for host mc-misc1001.eqiad.wmnet 2476110 wikitext text/x-wiki bqlrriuyznxtk8ekihv2po6h8b92196 2476111 2476110 2026-11-02T12:04:51Z Stashbot 7414 jiji@cumin1004: START - Cookbook sre.hosts.reboot-single for host mc-wf1001.eqiad.wmnet 2476111 wikitext text/x-wiki 7vhtxq9astnuw70dov1mnegq5lvs4jy 2476112 2476111 2026-11-02T12:04:58Z Stashbot 7414 jayme@cumin1004: START - Cookbook sre.kafka.roll-restart-reboot-brokers rolling reboot on A:kafka-main-eqiad 2476112 wikitext text/x-wiki 01matoi9foqt3gmd5xc39p7to288wku 2476113 2476112 2026-11-02T12:05:36Z Stashbot 7414 blake@deploy2003: helmfile [staging] START helmfile.d/services/changeprop: apply 2476113 wikitext text/x-wiki ev87e2v3cb2vu4dfdo291p991uo3afb 2476115 2476113 2026-11-02T12:05:52Z Stashbot 7414 blake@deploy2003: helmfile [staging] DONE helmfile.d/services/changeprop: apply 2476115 wikitext text/x-wiki gkp8kcqkp8pcqnmpvazvzeuu074ksks 2476116 2476115 2026-11-02T12:06:06Z Stashbot 7414 blake@deploy2003: helmfile [codfw] START helmfile.d/services/changeprop: apply 2476116 wikitext text/x-wiki 8bx66za9sogbs3y31qi780i8q71mjfu 2476117 2476116 2026-11-02T12:06:12Z Stashbot 7414 blake@deploy2003: helmfile [codfw] DONE helmfile.d/services/changeprop: apply 2476117 wikitext text/x-wiki klukfcfqoyjowxh6894f02vsdk5mw7y 2476118 2476117 2026-11-02T12:06:18Z Stashbot 7414 blake@deploy2003: helmfile [eqiad] START helmfile.d/services/changeprop: apply 2476118 wikitext text/x-wiki kp33wli2od4bg8twsxk3l2q5uxj8ulf 2476119 2476118 2026-11-02T12:06:24Z Stashbot 7414 blake@deploy2003: helmfile [eqiad] DONE helmfile.d/services/changeprop: apply 2476119 wikitext text/x-wiki iitlg804ytsdxqrrwwfwncnyypox5bg 2476124 2476119 2026-11-02T12:08:06Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-ctrl1002.eqiad.wmnet 2476124 wikitext text/x-wiki 258dp81pozmc0eaneypuwcj76qkmdsm 2476125 2476124 2026-11-02T12:08:09Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-ctrl1002.eqiad.wmnet 2476125 wikitext text/x-wiki 83gwsjhyaxopyn0yib8esgf87lz73lh 2476126 2476125 2026-11-02T12:08:15Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-ctrl1003.eqiad.wmnet 2476126 wikitext text/x-wiki lmkgtzdrf3z6e3tbh950lf5k1jp4gxr 2476127 2476126 2026-11-02T12:08:18Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-ctrl1003.eqiad.wmnet 2476127 wikitext text/x-wiki jvvfzt3puqyen9pa69hvaa6t7y84fio 2476128 2476127 2026-11-02T12:09:42Z Stashbot 7414 jiji@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-misc1001.eqiad.wmnet 2476128 wikitext text/x-wiki tg1u3ggt1xdm844n09l8ai0enk38owi 2476129 2476128 2026-11-02T12:09:45Z Stashbot 7414 jiji@cumin1004: START - Cookbook sre.hosts.reboot-single for host mc-misc1002.eqiad.wmnet 2476129 wikitext text/x-wiki m3trger6krazj8rd59fw108k3e1pona 2476130 2476129 2026-11-02T12:12:25Z Stashbot 7414 jiji@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-wf1001.eqiad.wmnet 2476130 wikitext text/x-wiki szceunb2wmcvueys3cicj2ql2p88832 2476131 2476130 2026-11-02T12:12:29Z Stashbot 7414 jiji@cumin1004: START - Cookbook sre.hosts.reboot-single for host mc-wf1002.eqiad.wmnet 2476131 wikitext text/x-wiki 4rntw32r5uaj2jdukdm5x6h6l4fxu6v 2476132 2476131 2026-11-02T12:14:56Z Stashbot 7414 jayme@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1250.eqiad.wmnet 2476132 wikitext text/x-wiki 48eboq6le370sl29ini7o6gu05igls0 2476133 2476132 2026-11-02T12:14:59Z Stashbot 7414 jayme@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1250.eqiad.wmnet 2476133 wikitext text/x-wiki brhxmqvglu2w1k0prr2e7j0fri34umx 2476134 2476133 2026-11-02T12:15:02Z Stashbot 7414 jiji@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-misc1002.eqiad.wmnet 2476134 wikitext text/x-wiki p01ogcye7oqpz5w5rh6psriyr3lsmbw 2476135 2476134 2026-11-02T12:15:35Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-ctrl1003.eqiad.wmnet 2476135 wikitext text/x-wiki 9q6kpwh54tnxljmnnx2tmvr6uqkard3 2476136 2476135 2026-11-02T12:15:38Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-ctrl1003.eqiad.wmnet 2476136 wikitext text/x-wiki 7na58kaq3bu0g9wvh4km8mjup1cp59j 2476137 2476136 2026-11-02T12:15:43Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-ctrl1004.eqiad.wmnet 2476137 wikitext text/x-wiki i6jdik9d3jbenlu6f3ud425jks9qu28 2476138 2476137 2026-11-02T12:15:46Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-ctrl1004.eqiad.wmnet 2476138 wikitext text/x-wiki s0ief9hfw8ggq8nszb90bnr1ztdnmld 2476139 2476138 2026-11-02T12:17:15Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host rpki1001.eqiad.wmnet with OS trixie 2476139 wikitext text/x-wiki bibtc3011o1sqkx7y041xeh3avjy4gx 2476140 2476139 2026-11-02T12:18:17Z Stashbot 7414 blake@deploy2003: helmfile [staging] START helmfile.d/services/changeprop: apply 2476140 wikitext text/x-wiki fir3tl97mhzjesq2irest325j6vmcte 2476141 2476140 2026-11-02T12:18:48Z Stashbot 7414 blake@deploy2003: helmfile [staging] DONE helmfile.d/services/changeprop: apply 2476141 wikitext text/x-wiki 9pmbdidqfpyutnhmpsghhj21zil9hu1 2476142 2476141 2026-11-02T12:18:54Z Stashbot 7414 blake@deploy2003: helmfile [codfw] START helmfile.d/services/changeprop: apply 2476142 wikitext text/x-wiki tljsk9o2k5cpnvl4x8se26q9bjxh3bu 2476143 2476142 2026-11-02T12:19:12Z Stashbot 7414 cgoubert@cumin2003: conftool action : set/pooled=false; selector: dnsdisc=helm-charts.*,name=codfw 2476143 wikitext text/x-wiki 5msqnrkfalyjhdfdvf1ika5rjrjnebf 2476144 2476143 2026-11-02T12:19:31Z Stashbot 7414 blake@deploy2003: helmfile [codfw] DONE helmfile.d/services/changeprop: apply 2476144 wikitext text/x-wiki e55r7t9gmag06f2m4egdaazbrspe0t3 2476145 2476144 2026-11-02T12:19:34Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host chartmuseum2001.codfw.wmnet 2476145 wikitext text/x-wiki 0w6smya0q2bhk6ealudxnuvdp0ylqr0 2476146 2476145 2026-11-02T12:19:37Z Stashbot 7414 blake@deploy2003: helmfile [eqiad] START helmfile.d/services/changeprop: apply 2476146 wikitext text/x-wiki 84rsyrtcf2h7e4sejjcqah7gteyneoj 2476147 2476146 2026-11-02T12:19:56Z Stashbot 7414 jiji@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-wf1002.eqiad.wmnet 2476147 wikitext text/x-wiki jc1d0a63e0tf72sg83rodc8sz3pojut 2476148 2476147 2026-11-02T12:20:09Z Stashbot 7414 blake@deploy2003: helmfile [eqiad] DONE helmfile.d/services/changeprop: apply 2476148 wikitext text/x-wiki aadl2ckf4zbo53huz0afdfdnm4y3dlr 2476150 2476148 2026-11-02T12:23:22Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-ctrl1004.eqiad.wmnet 2476150 wikitext text/x-wiki fkjxb68agkixxyxat9ohjw5qdr4unkj 2476151 2476150 2026-11-02T12:23:26Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-ctrl1004.eqiad.wmnet 2476151 wikitext text/x-wiki tivlaieka4nabv714a3ohszojrdycwa 2476152 2476151 2026-11-02T12:23:31Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-ctrl1005.eqiad.wmnet 2476152 wikitext text/x-wiki 54dpnicmvoa0fb0pspp114kbtqzbm3o 2476153 2476152 2026-11-02T12:23:34Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-ctrl1005.eqiad.wmnet 2476153 wikitext text/x-wiki 8ear79hfm1srkhtgyod5gggnv3qlf0l 2476154 2476153 2026-11-02T12:23:38Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host chartmuseum2001.codfw.wmnet 2476154 wikitext text/x-wiki tjddxhcc2zlp6ktsfq9n5mzq9cpsqwc 2476155 2476154 2026-11-02T12:23:42Z Stashbot 7414 cgoubert@cumin2003: conftool action : set/pooled=true; selector: dnsdisc=helm-charts.*,name=codfw 2476155 wikitext text/x-wiki 16ucb0fyqam4336s0hymx5vn19q7cje 2476156 2476155 2026-11-02T12:23:57Z Stashbot 7414 cgoubert@cumin2003: conftool action : set/pooled=false; selector: dnsdisc=helm-charts.*,name=eqiad 2476156 wikitext text/x-wiki lrqpm9niodphq1djcbuogsaggwmeyvt 2476157 2476156 2026-11-02T12:24:19Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host chartmuseum1001.eqiad.wmnet 2476157 wikitext text/x-wiki sfrm8olw3ry9yaa6e2u5eabwnpf32ew 2476158 2476157 2026-11-02T12:27:25Z Stashbot 7414 jiji@cumin1004: START - Cookbook sre.hosts.reboot-single for host mc-wf2001.codfw.wmnet 2476158 wikitext text/x-wiki erv8pwcr7cakc20j70k3hfd2x7bvlsk 2476159 2476158 2026-11-02T12:28:21Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host chartmuseum1001.eqiad.wmnet 2476159 wikitext text/x-wiki 72x6la461qqvoz2nrroulbf537o28s2 2476160 2476159 2026-11-02T12:29:25Z Stashbot 7414 cgoubert@cumin2003: conftool action : set/pooled=true; selector: dnsdisc=helm-charts.*,name=eqiad 2476160 wikitext text/x-wiki 0357zphk5rn25lbz2s1hxm1cmv1llur 2476161 2476160 2026-11-02T12:29:58Z Stashbot 7414 blake@deploy2003: helmfile [staging] START helmfile.d/services/changeprop: apply 2476161 wikitext text/x-wiki ksso5olh6lhzcxaswu6q0x0vqt8igwg 2476162 2476161 2026-11-02T12:30:10Z Stashbot 7414 blake@deploy2003: helmfile [staging] DONE helmfile.d/services/changeprop: apply 2476162 wikitext text/x-wiki afipgac1s4x79ayfxwbb6isb9x3yrho 2476163 2476162 2026-11-02T12:30:17Z Stashbot 7414 blake@deploy2003: helmfile [eqiad] START helmfile.d/services/changeprop: apply 2476163 wikitext text/x-wiki ntltj6xptq5ixi9t8fiokvihc9791kq 2476164 2476163 2026-11-02T12:30:26Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-ctrl1005.eqiad.wmnet 2476164 wikitext text/x-wiki a227kpn8b7x6utbretc4r7p564i6fzg 2476165 2476164 2026-11-02T12:30:29Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-ctrl1005.eqiad.wmnet 2476165 wikitext text/x-wiki eg6x8dfw8uon9c1x21nvilaz0m0teaw 2476166 2476165 2026-11-02T12:30:32Z Stashbot 7414 blake@deploy2003: helmfile [eqiad] DONE helmfile.d/services/changeprop: apply 2476166 wikitext text/x-wiki eof5plqtvmi2a02rhthwpzt8ha32rlm 2476167 2476166 2026-11-02T12:30:35Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-ctrl1006.eqiad.wmnet 2476167 wikitext text/x-wiki 3h7ntkcmuowcdxuaxf1wdk0o032u221 2476168 2476167 2026-11-02T12:30:38Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-ctrl1006.eqiad.wmnet 2476168 wikitext text/x-wiki 90c5z6theiapnpg5wluptwy29p8ft9k 2476169 2476168 2026-11-02T12:30:41Z Stashbot 7414 blake@deploy2003: helmfile [codfw] START helmfile.d/services/changeprop: apply 2476169 wikitext text/x-wiki 5hlnlpa3n1adghcwb13d6za5jl4do5s 2476170 2476169 2026-11-02T12:31:02Z Stashbot 7414 blake@deploy2003: helmfile [codfw] DONE helmfile.d/services/changeprop: apply 2476170 wikitext text/x-wiki ib207ivgpvkemtt5sk9g2ct86jcn3vk 2476171 2476170 2026-11-02T12:31:05Z Stashbot 7414 cmooney@cumin1004: END (FAIL) - Cookbook sre.netbox.update-extras (exit_code=1) rolling restart_daemons on A:netbox-canary 2476171 wikitext text/x-wiki 6n7y8n3iacqs87f6aqad6ge2s0sem8f 2476172 2476171 2026-11-02T12:33:58Z Stashbot 7414 cgoubert@deploy2003: Locking from deployment [ALL REPOSITORIES]: Dragonfly supernodes reboot 2476172 wikitext text/x-wiki 5oadqzk0cnetuxd3mgcu06vxlp8fmhk 2476173 2476172 2026-11-02T12:34:04Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1157.eqiad.wmnet with reason: Maintenance 2476173 wikitext text/x-wiki tahuxt492ch6i0m1uoercgmncioxhyc 2476174 2476173 2026-11-02T12:34:07Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db1157 (T441633)', diff saved to https://phabricator.wikimedia.org/P97046 and previous config saved to /var/cache/conftool/dbconfig/20261102-123404-ladsgroup.json 2476174 wikitext text/x-wiki lv8tgqooziivqv4kokdmgs9sujtt6wc 2476175 2476174 2026-11-02T12:34:18Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host dragonfly-supernode1001.eqiad.wmnet 2476175 wikitext text/x-wiki 31fj220tjm85a7h62k3iqmpv1ve6nxj 2476177 2476175 2026-11-02T12:34:47Z Stashbot 7414 jiji@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-wf2001.codfw.wmnet 2476177 wikitext text/x-wiki sk61pzi8eh6oqnylo4omqqwjvj3jeg4 2476178 2476177 2026-11-02T12:34:51Z Stashbot 7414 jiji@cumin1004: START - Cookbook sre.hosts.reboot-single for host mc-wf2002.codfw.wmnet 2476178 wikitext text/x-wiki 4oean07bhw9cgi2zgx68at01x8qtxkb 2476179 2476178 2026-11-02T12:37:23Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-ctrl1006.eqiad.wmnet 2476179 wikitext text/x-wiki n9zg46vd25snvb0y23fdnpfyszt359g 2476180 2476179 2026-11-02T12:37:27Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-ctrl1006.eqiad.wmnet 2476180 wikitext text/x-wiki qgt7bgd6vn100pm4iwswn01rxun585q 2476181 2476180 2026-11-02T12:37:30Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on A:wikikube-master-eqiad 2476181 wikitext text/x-wiki i60yyaprv78lnwaepm6152f96fs6j8d 2476182 2476181 2026-11-02T12:37:36Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox 2476182 wikitext text/x-wiki h1ihw0cva6pdrc9j17wsfp4l8530296 2476183 2476182 2026-11-02T12:38:06Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox 2476183 wikitext text/x-wiki rt31mam8thubx5zk0wb9n0hhqogjr3b 2476184 2476183 2026-11-02T12:38:09Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dragonfly-supernode1001.eqiad.wmnet 2476184 wikitext text/x-wiki 4mw5997ft027c5jvcak0y5gru4d9hla 2476185 2476184 2026-11-02T12:40:59Z Stashbot 7414 jiji@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host mc-wf2002.codfw.wmnet 2476185 wikitext text/x-wiki f5d1hsvjr63gijyogb7h7lfhmz2e1bo 2476186 2476185 2026-11-02T12:41:52Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1157 (T441633)', diff saved to https://phabricator.wikimedia.org/P97048 and previous config saved to /var/cache/conftool/dbconfig/20261102-124149-ladsgroup.json 2476186 wikitext text/x-wiki ea1yf52bgasett7cfvf37k7wh9ub5r4 2476187 2476186 2026-11-02T12:43:18Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.hosts.reboot-single for host dragonfly-supernode2001.codfw.wmnet 2476187 wikitext text/x-wiki 35jtujpdu4hpsk9f56f2hnrp21i4m7j 2476188 2476187 2026-11-02T12:46:10Z Stashbot 7414 jayme@cumin1004: END (PASS) - Cookbook sre.kafka.roll-restart-reboot-brokers (exit_code=0) rolling reboot on A:kafka-main-eqiad 2476188 wikitext text/x-wiki 2an3piu068rn5wcrizrmhj9fes7cecr 2476189 2476188 2026-11-02T12:47:18Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dragonfly-supernode2001.codfw.wmnet 2476189 wikitext text/x-wiki 8qih49b0b0qcy48du7qe5hno55gfuls 2476190 2476189 2026-11-02T12:47:47Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host netmon2002.wikimedia.org 2476190 wikitext text/x-wiki ojsdqs08ywyaop0cfsgbbwc5vht6jig 2476191 2476190 2026-11-02T12:48:19Z Stashbot 7414 cgoubert@deploy2003: Unlocked for deployment [ALL REPOSITORIES]: Dragonfly supernodes reboot (duration: 14m 21s) 2476191 wikitext text/x-wiki fc4sy5sjn9q702zs7qofl3wtoavjfx5 2476192 2476191 2026-11-02T12:51:53Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1157', diff saved to https://phabricator.wikimedia.org/P97049 and previous config saved to /var/cache/conftool/dbconfig/20261102-125151-ladsgroup.json 2476192 wikitext text/x-wiki ca053r2vcp6e4xqh0ct48g0omeura7q 2476193 2476192 2026-11-02T12:53:28Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netmon2002.wikimedia.org 2476193 wikitext text/x-wiki rzz04s5qd8dfev5nf4vskfykif8rk0v 2476194 2476193 2026-11-02T12:56:18Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host netmon1003.wikimedia.org 2476194 wikitext text/x-wiki kccg1dytvqi49mjxccfs05s70c390l6 2476195 2476194 2026-11-02T13:01:56Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1157', diff saved to https://phabricator.wikimedia.org/P97050 and previous config saved to /var/cache/conftool/dbconfig/20261102-130153-ladsgroup.json 2476195 wikitext text/x-wiki amddnt668w1vb11mghsm4xqdor30wo3 2476196 2476195 2026-11-02T13:02:08Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netmon1003.wikimedia.org 2476196 wikitext text/x-wiki mi7yulie4ja8tvngk7vbq8do0du3e0f 2476197 2476196 2026-11-02T13:02:54Z Stashbot 7414 jayme@cumin1004: START - Cookbook sre.kafka.roll-restart-reboot-brokers rolling reboot on A:kafka-main-codfw 2476197 wikitext text/x-wiki ev3r31ozrkt3kz4qucm8bt9f2fdumzr 2476198 2476197 2026-11-02T13:05:10Z Stashbot 7414 cwilliams@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1217.eqiad.wmnet with reason: Maintenance 2476198 wikitext text/x-wiki 5ns5affdy3l50m8olgg7dp7ztmx36hc 2476199 2476198 2026-11-02T13:07:49Z Stashbot 7414 ozge@deploy2003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'llm' for release 'main' . 2476199 wikitext text/x-wiki 03u4xmia0ufox9aeiowrnsoc7pv7d0v 2476200 2476199 2026-11-02T13:07:54Z Stashbot 7414 ozge@deploy2003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'llm' for release 'llmisvc' . 2476200 wikitext text/x-wiki apjb0ny8eskm0qsifvr4s43t9jysdq7 2476201 2476200 2026-11-02T13:11:58Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1157 (T441633)', diff saved to https://phabricator.wikimedia.org/P97051 and previous config saved to /var/cache/conftool/dbconfig/20261102-131155-ladsgroup.json 2476201 wikitext text/x-wiki 9nwzjyyctymr9gn0f4xaokw00t6rsb9 2476202 2476201 2026-11-02T13:12:05Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1166.eqiad.wmnet with reason: Maintenance 2476202 wikitext text/x-wiki 4hw5nuusjb7pyasg5ajxl52tp6yx9zu 2476203 2476202 2026-11-02T13:12:08Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db1166 (T441633)', diff saved to https://phabricator.wikimedia.org/P97052 and previous config saved to /var/cache/conftool/dbconfig/20261102-131205-ladsgroup.json 2476203 wikitext text/x-wiki ser52ccyv6uu99qzam54jhufi7vyjea 2476204 2476203 2026-11-02T13:21:41Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1166 (T441633)', diff saved to https://phabricator.wikimedia.org/P97054 and previous config saved to /var/cache/conftool/dbconfig/20261102-132138-ladsgroup.json 2476204 wikitext text/x-wiki 3ssf9rvudwo54jbtpliwcr67shgdu5q 2476205 2476204 2026-11-02T13:22:25Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host netboxdb1003.eqiad.wmnet 2476205 wikitext text/x-wiki 4nm58j9o4u1n3ruklhrcypqbeerh8hf 2476206 2476205 2026-11-02T13:26:15Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netboxdb1003.eqiad.wmnet 2476206 wikitext text/x-wiki jche20048nqzmj1s7mwzhvem905fauz 2476207 2476206 2026-11-02T13:31:43Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P97055 and previous config saved to /var/cache/conftool/dbconfig/20261102-133140-ladsgroup.json 2476207 wikitext text/x-wiki 69afvtdshxdme267n29wge360xy8t77 2476209 2476207 2026-11-02T13:41:45Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1166', diff saved to https://phabricator.wikimedia.org/P97056 and previous config saved to /var/cache/conftool/dbconfig/20261102-134143-ladsgroup.json 2476209 wikitext text/x-wiki prktb09gune5w2gn26z1t4opxa5wiy2 2476210 2476209 2026-11-02T13:44:53Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1251.eqiad.wmnet 2476210 wikitext text/x-wiki 0wkwodthf8y42ifs6cw2rb1dkm0k11d 2476211 2476210 2026-11-02T13:45:45Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1251.eqiad.wmnet 2476211 wikitext text/x-wiki gjkg9ybe6je8to0jjma1s7fux6g4b44 2476212 2476211 2026-11-02T13:49:47Z Stashbot 7414 aqu@deploy2003: Started deploy [analytics/refinery@2226a9f] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@2226a9fe] 2476212 wikitext text/x-wiki 9zkitkt3tvr78fcgnrayyhbcadwc4g7 2476213 2476212 2026-11-02T13:50:34Z Stashbot 7414 aqu@deploy2003: Finished deploy [analytics/refinery@2226a9f] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@2226a9fe] (duration: 00m 47s) 2476213 wikitext text/x-wiki k6m9qhnfhdcdonh0ngqkrjvrakka9t6 2476214 2476213 2026-11-02T13:50:38Z Stashbot 7414 aqu@deploy2003: Started deploy [analytics/refinery@2226a9f]: Regular analytics weekly train [analytics/refinery@2226a9fe] 2476214 wikitext text/x-wiki joozrr28gu2zhn9rgngf3gn9dzy1fhz 2476215 2476214 2026-11-02T13:51:47Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1166 (T441633)', diff saved to https://phabricator.wikimedia.org/P97057 and previous config saved to /var/cache/conftool/dbconfig/20261102-135145-ladsgroup.json 2476215 wikitext text/x-wiki n4j9o245mv6m5jc4npxn1t9syrskmbx 2476216 2476215 2026-11-02T13:52:05Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1175.eqiad.wmnet with reason: Maintenance 2476216 wikitext text/x-wiki 3bykuj68c2w2g63zwa857n9uo134j4d 2476217 2476216 2026-11-02T13:55:25Z Stashbot 7414 aqu@deploy2003: Finished deploy [analytics/refinery@2226a9f]: Regular analytics weekly train [analytics/refinery@2226a9fe] (duration: 04m 46s) 2476217 wikitext text/x-wiki aen9xgqf38waw7oukd24ilbrn6kwwig 2476219 2476217 2026-11-02T13:57:44Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1198.eqiad.wmnet with reason: Maintenance 2476219 wikitext text/x-wiki bei4ribaveftrdjsodljnan4bnoe6e9 2476220 2476219 2026-11-02T13:57:47Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db1198 (T441633)', diff saved to https://phabricator.wikimedia.org/P97059 and previous config saved to /var/cache/conftool/dbconfig/20261102-135744-ladsgroup.json 2476220 wikitext text/x-wiki qpj8o27yrplxvj3jwa20kevf62rlbjl 2476221 2476220 2026-11-02T13:59:05Z Stashbot 7414 jayme@cumin1004: END (PASS) - Cookbook sre.kafka.roll-restart-reboot-brokers (exit_code=0) rolling reboot on A:kafka-main-codfw 2476221 wikitext text/x-wiki l3zi7ua3eyj5wqmc9vg7b004y2o8aqu 2476222 2476221 2026-11-02T14:02:39Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1251.eqiad.wmnet 2476222 wikitext text/x-wiki ontb8wxcq2jweuwzpdrqd0ga5hzbrn2 2476223 2476222 2026-11-02T14:02:43Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1251.eqiad.wmnet 2476223 wikitext text/x-wiki 7icqjagt6p0pge19qcwxkjuu79sx6rf 2476224 2476223 2026-11-02T14:04:09Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1198 (T441633)', diff saved to https://phabricator.wikimedia.org/P97060 and previous config saved to /var/cache/conftool/dbconfig/20261102-140406-ladsgroup.json 2476224 wikitext text/x-wiki agftz9opoveozy7hx42teomxjw9awof 2476225 2476224 2026-11-02T14:06:02Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1252.eqiad.wmnet 2476225 wikitext text/x-wiki mxy963e43ds5ygm252nkxt60v3mc5cd 2476226 2476225 2026-11-02T14:06:13Z Stashbot 7414 sukhe@puppetserver1001: conftool action : set/pooled=no; selector: name=dns7001.* [reason: testing pdns-rec 5.4.9] 2476226 wikitext text/x-wiki eg4wdohf7azxdm6wtbf4yzh4q2hf47m 2476228 2476226 2026-11-02T14:07:26Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1252.eqiad.wmnet 2476228 wikitext text/x-wiki pqf1a1cz26zm1447kloxaarnogp4i35 2476229 2476228 2026-11-02T14:10:08Z Stashbot 7414 lucaswerkmeister-wmde@deploy2003: Started scap sync-world: Backport for [[gerrit:1361372|Set license acknowledgement cookie for MEX cypress tests (T441916)]] (1.48.0-wmf.1), [[gerrit:1361373|Fix incomplete settings in NewEntitySchemaTest (T441916)]] (1.48.0-wmf.1), [[gerrit:1361379|Set license acknowledgement cookie for MEX cypress tests (T441916)]] (1.48.0-wmf.1), [[gerrit:1361378|Set license acknowledgement cookie f 2476229 wikitext text/x-wiki m4g5w25nc88mru87kt4auww2g5ey256 2476230 2476229 2026-11-02T14:11:07Z Stashbot 7414 sukhe@puppetserver1001: conftool action : set/pooled=yes; selector: name=dns7001.* [reason: [end] testing pdns-rec 5.4.9] 2476230 wikitext text/x-wiki 6vgb2p06dl72u01md8hjcih20fk9msl 2476231 2476230 2026-11-02T14:14:11Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1198', diff saved to https://phabricator.wikimedia.org/P97061 and previous config saved to /var/cache/conftool/dbconfig/20261102-141408-ladsgroup.json 2476231 wikitext text/x-wiki nj3as6u4q5hcvnhno29p2jzf42t7ueo 2476239 2476231 2026-11-02T14:24:13Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1198', diff saved to https://phabricator.wikimedia.org/P97062 and previous config saved to /var/cache/conftool/dbconfig/20261102-142411-ladsgroup.json 2476239 wikitext text/x-wiki jphgq10mzhku9h9vwjmlqmrht8c05ha 2476241 2476239 2026-11-02T14:29:41Z Stashbot 7414 lucaswerkmeister-wmde@deploy2003: mlitn, audreypenven, lucaswerkmeister-wmde: Backport for [[gerrit:1361372|Set license acknowledgement cookie for MEX cypress tests (T441916)]] (1.48.0-wmf.1), [[gerrit:1361373|Fix incomplete settings in NewEntitySchemaTest (T441916)]] (1.48.0-wmf.1), [[gerrit:1361379|Set license acknowledgement cookie for MEX cypress tests (T441916)]] (1.48.0-wmf.1), [[gerrit:1361378|Set license ackno 2476241 wikitext text/x-wiki qr62cvanc3r0l8pax134o5bdipvq8q7 2476242 2476241 2026-11-02T14:34:16Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1198 (T441633)', diff saved to https://phabricator.wikimedia.org/P97063 and previous config saved to /var/cache/conftool/dbconfig/20261102-143413-ladsgroup.json 2476242 wikitext text/x-wiki aoicv4u5j8p5qu7m0iy06dqbij8dp41 2476243 2476242 2026-11-02T14:34:20Z Stashbot 7414 lucaswerkmeister-wmde@deploy2003: mlitn, audreypenven, lucaswerkmeister-wmde: Continuing with deployment 2476243 wikitext text/x-wiki 28sj590rldm4ltf2cps3lbc2h6zty18 2476244 2476243 2026-11-02T14:34:34Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1212.eqiad.wmnet with reason: Maintenance 2476244 wikitext text/x-wiki 7v0aluntcjvs2r5gdmpvld3ydkotfbc 2476245 2476244 2026-11-02T14:34:55Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on 6 hosts with reason: Maintenance 2476245 wikitext text/x-wiki isj2aco6milhqz6h6ol0wo884rxzk35 2476246 2476245 2026-11-02T14:34:59Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db1212 (T441633)', diff saved to https://phabricator.wikimedia.org/P97064 and previous config saved to /var/cache/conftool/dbconfig/20261102-143454-ladsgroup.json 2476246 wikitext text/x-wiki o8fvo6ktn685b1ytz1jbxlmezcx8fnk 2476247 2476246 2026-11-02T14:36:02Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1252.eqiad.wmnet 2476247 wikitext text/x-wiki j16cg61vh4n6idijkuzbof89hrt2p4l 2476248 2476247 2026-11-02T14:36:05Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1252.eqiad.wmnet 2476248 wikitext text/x-wiki 7phwpqt5phvwzixs484vr0l775utyd9 2476251 2476248 2026-11-02T14:40:55Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1212 (T441633)', diff saved to https://phabricator.wikimedia.org/P97065 and previous config saved to /var/cache/conftool/dbconfig/20261102-144052-ladsgroup.json 2476251 wikitext text/x-wiki jbnkxv5sluor01e964rjmc5e9vudvqs 2476252 2476251 2026-11-02T14:47:07Z Stashbot 7414 lucaswerkmeister-wmde@deploy2003: Finished scap sync-world: Backport for [[gerrit:1361372|Set license acknowledgement cookie for MEX cypress tests (T441916)]] (1.48.0-wmf.1), [[gerrit:1361373|Fix incomplete settings in NewEntitySchemaTest (T441916)]] (1.48.0-wmf.1), [[gerrit:1361379|Set license acknowledgement cookie for MEX cypress tests (T441916)]] (1.48.0-wmf.1), [[gerrit:1361378|Set license acknowledgement cookie 2476252 wikitext text/x-wiki at61e1tsw636v7reyml5s5p3zwjcgg7 2476253 2476252 2026-11-02T14:50:57Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1212', diff saved to https://phabricator.wikimedia.org/P97066 and previous config saved to /var/cache/conftool/dbconfig/20261102-145054-ladsgroup.json 2476253 wikitext text/x-wiki 0iuzbmwzbz9zxa5b6sxifx2hxr3e7lp 2476254 2476253 2026-11-02T14:59:01Z Stashbot 7414 lucaswerkmeister-wmde@deploy2003: Started scap sync-world: Backport for [[gerrit:1361148|eswiki: Add protect user right to botadmin group (T443124)]], [[gerrit:1360406|GrowthExperiments: enable SpecialHome on testwiki (T442733)]] 2476254 wikitext text/x-wiki r1ers7ksooed822e5uwwfeh0pj0ebk6 2476255 2476254 2026-11-02T15:00:59Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1212', diff saved to https://phabricator.wikimedia.org/P97067 and previous config saved to /var/cache/conftool/dbconfig/20261102-150057-ladsgroup.json 2476255 wikitext text/x-wiki qhrx7nqqgjj7esncytv9e1cj8mtx9lq 2476257 2476255 2026-11-02T15:03:26Z Stashbot 7414 lucaswerkmeister-wmde@deploy2003: sgimeno, lucaswerkmeister-wmde, tryvix1509: Backport for [[gerrit:1361148|eswiki: Add protect user right to botadmin group (T443124)]], [[gerrit:1360406|GrowthExperiments: enable SpecialHome on testwiki (T442733)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2476257 wikitext text/x-wiki 0pj8m0roeimr4wqs54skjzwmyclfw5s 2476258 2476257 2026-11-02T15:05:35Z Stashbot 7414 lucaswerkmeister-wmde@deploy2003: sgimeno, lucaswerkmeister-wmde, tryvix1509: Continuing with deployment 2476258 wikitext text/x-wiki 1dn9thavgk335sdo2i2pgwawnaapc3d 2476259 2476258 2026-11-02T15:11:02Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1212 (T441633)', diff saved to https://phabricator.wikimedia.org/P97068 and previous config saved to /var/cache/conftool/dbconfig/20261102-151059-ladsgroup.json 2476259 wikitext text/x-wiki ecpy8rzszdqgpt3dxsxd0g37h6eeq9j 2476260 2476259 2026-11-02T15:11:19Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1223.eqiad.wmnet with reason: Maintenance 2476260 wikitext text/x-wiki m78xit190egexeex5i7srtxc8b611wm 2476261 2476260 2026-11-02T15:11:23Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db1223 (T441633)', diff saved to https://phabricator.wikimedia.org/P97069 and previous config saved to /var/cache/conftool/dbconfig/20261102-151119-ladsgroup.json 2476261 wikitext text/x-wiki husvy0i3393dj13shjsx154pi0f52un 2476262 2476261 2026-11-02T15:13:36Z Stashbot 7414 lucaswerkmeister-wmde@deploy2003: Finished scap sync-world: Backport for [[gerrit:1361148|eswiki: Add protect user right to botadmin group (T443124)]], [[gerrit:1360406|GrowthExperiments: enable SpecialHome on testwiki (T442733)]] (duration: 14m 35s) 2476262 wikitext text/x-wiki akkdnit88hc6ymgy1alxr0b8vg8arav 2476263 2476262 2026-11-02T15:13:51Z Stashbot 7414 Lucas_WMDE: UTC afternoon backport+config window done 2476263 wikitext text/x-wiki fvyr1ovx3nktentx5bfvcyuoym5j6j7 2476264 2476263 2026-11-02T15:17:29Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1223 (T441633)', diff saved to https://phabricator.wikimedia.org/P97070 and previous config saved to /var/cache/conftool/dbconfig/20261102-151726-ladsgroup.json 2476264 wikitext text/x-wiki 6shnbkampv2ruf0vg7e7mwmyzan0h5u 2476265 2476264 2026-11-02T15:17:34Z Stashbot 7414 aqu@deploy2003: Started deploy [analytics/refinery@bbf3d3a] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@bbf3d3a6] 2476265 wikitext text/x-wiki 24n39bb2v66qdlhsr3z8w4a6yx1ccu3 2476266 2476265 2026-11-02T15:18:18Z Stashbot 7414 aqu@deploy2003: Finished deploy [analytics/refinery@bbf3d3a] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@bbf3d3a6] (duration: 00m 44s) 2476266 wikitext text/x-wiki r8m1zd9h0uwcwuho4ur0f579j2r8cus 2476267 2476266 2026-11-02T15:24:42Z Stashbot 7414 aqu@deploy2003: Started deploy [analytics/refinery@bbf3d3a]: Regular analytics weekly train [analytics/refinery@bbf3d3a6] 2476267 wikitext text/x-wiki b2nsqz4wm0p3t89fmx46rije9smm847 2476268 2476267 2026-11-02T15:27:31Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1223', diff saved to https://phabricator.wikimedia.org/P97072 and previous config saved to /var/cache/conftool/dbconfig/20261102-152728-ladsgroup.json 2476268 wikitext text/x-wiki 5c47utrkq2oa56fy420kzk8axhsq180 2476269 2476268 2026-11-02T15:31:11Z Stashbot 7414 aqu@deploy2003: Finished deploy [analytics/refinery@bbf3d3a]: Regular analytics weekly train [analytics/refinery@bbf3d3a6] (duration: 06m 29s) 2476269 wikitext text/x-wiki nhlfsqaxn3s2r4uibgp290e6crn275d 2476270 2476269 2026-11-02T15:37:34Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1223', diff saved to https://phabricator.wikimedia.org/P97073 and previous config saved to /var/cache/conftool/dbconfig/20261102-153731-ladsgroup.json 2476270 wikitext text/x-wiki dzhbnhppjshkao2ao3bqr6bz4mmlznl 2476271 2476270 2026-11-02T15:47:36Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1223 (T441633)', diff saved to https://phabricator.wikimedia.org/P97074 and previous config saved to /var/cache/conftool/dbconfig/20261102-154733-ladsgroup.json 2476271 wikitext text/x-wiki hpie7ovnwn2845gxz4bcycerpcacazo 2476272 2476271 2026-11-02T15:47:55Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1240.eqiad.wmnet with reason: Maintenance 2476272 wikitext text/x-wiki rz3y2qbg2kwy4h36byf9n991yp8fsp1 2476273 2476272 2026-11-02T15:50:08Z Stashbot 7414 volans@cumin1004: START - Cookbook sre.mysql.depool depool es2036: Host crashed 2476273 wikitext text/x-wiki 44ea7on05qx1yilmf8u0fjiqoi0oban 2476274 2476273 2026-11-02T15:50:19Z Stashbot 7414 volans@cumin1004: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es2036: Host crashed 2476274 wikitext text/x-wiki 01get2my551dq31a9n1nv8lfv7ampva 2476275 2476274 2026-11-02T15:51:19Z Stashbot 7414 tchin@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/eventstreams-internal: apply 2476275 wikitext text/x-wiki 1xey2m3adbfcgdk5euac02351ypurr3 2476276 2476275 2026-11-02T15:51:50Z Stashbot 7414 tchin@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/eventstreams-internal: apply 2476276 wikitext text/x-wiki 4zgmffhjfzlhlcyznnihpxuqh20ruod 2476277 2476276 2026-11-02T15:53:36Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1265.eqiad.wmnet with reason: Maintenance 2476277 wikitext text/x-wiki kub2ljs0bpkj9dokig1bfzf4vm66d89 2476278 2476277 2026-11-02T15:54:21Z Stashbot 7414 tchin@deploy2003: helmfile [staging] START helmfile.d/services/eventstreams: apply 2476278 wikitext text/x-wiki dwfw49dpjkscb68r012wpjl9aw7xcpj 2476279 2476278 2026-11-02T15:54:47Z Stashbot 7414 tchin@deploy2003: helmfile [staging] DONE helmfile.d/services/eventstreams: apply 2476279 wikitext text/x-wiki fvmh14lzjwyk1jcukilyyerd9wis5x7 2476280 2476279 2026-11-02T15:56:06Z Stashbot 7414 tchin@deploy2003: helmfile [eqiad] START helmfile.d/services/eventstreams: apply 2476280 wikitext text/x-wiki 9g9pdogf94d6aowmdv3m50tqxn8ezjl 2476281 2476280 2026-11-02T15:56:40Z Stashbot 7414 tchin@deploy2003: helmfile [eqiad] DONE helmfile.d/services/eventstreams: apply 2476281 wikitext text/x-wiki ihtj9zwopqad8ew3cvnbar82myfad8o 2476282 2476281 2026-11-02T15:57:13Z Stashbot 7414 tchin@deploy2003: helmfile [codfw] START helmfile.d/services/eventstreams: apply 2476282 wikitext text/x-wiki kiomm0b2z0079890da6j04wms5s07aj 2476283 2476282 2026-11-02T15:57:19Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1272.eqiad.wmnet with reason: Maintenance 2476283 wikitext text/x-wiki r46xa0m5de83uhs9cwx6iqzrcedke73 2476284 2476283 2026-11-02T15:57:23Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db1272 (T441633)', diff saved to https://phabricator.wikimedia.org/P97076 and previous config saved to /var/cache/conftool/dbconfig/20261102-155719-ladsgroup.json 2476284 wikitext text/x-wiki p4c0tjrkp0uu4jg1jc4p21wqxusec1d 2476285 2476284 2026-11-02T15:57:42Z Stashbot 7414 tchin@deploy2003: helmfile [codfw] DONE helmfile.d/services/eventstreams: apply 2476285 wikitext text/x-wiki q7xa96n833nkm800xe2cp72jix8zaxo 2476286 2476285 2026-11-02T16:01:30Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1272 (T441633)', diff saved to https://phabricator.wikimedia.org/P97077 and previous config saved to /var/cache/conftool/dbconfig/20261102-160127-ladsgroup.json 2476286 wikitext text/x-wiki qbzwodk35xy5z61eodz6xzz9y5yao1h 2476287 2476286 2026-11-02T16:04:57Z Stashbot 7414 volans@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es2036.codfw.wmnet with reason: host crashed 2476287 wikitext text/x-wiki mnb7scrk1ok816fav3utpomilwtqsgf 2476290 2476287 2026-11-02T16:11:32Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1272', diff saved to https://phabricator.wikimedia.org/P97078 and previous config saved to /var/cache/conftool/dbconfig/20261102-161129-ladsgroup.json 2476290 wikitext text/x-wiki jfpujh9ivsuwjaxnqjrkwa9fal47nt4 2476293 2476290 2026-11-02T16:18:24Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1253.eqiad.wmnet 2476293 wikitext text/x-wiki 06ygcezyxlmsjgamrvnunr7bs3m5k92 2476294 2476293 2026-11-02T16:19:12Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1253.eqiad.wmnet 2476294 wikitext text/x-wiki e7exhnafm0uqwh1dz4593by01kvb4y0 2476295 2476294 2026-11-02T16:21:34Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1272', diff saved to https://phabricator.wikimedia.org/P97079 and previous config saved to /var/cache/conftool/dbconfig/20261102-162132-ladsgroup.json 2476295 wikitext text/x-wiki lo9fjlnhx3uw1pit6azamwi7iham4e6 2476297 2476295 2026-11-02T16:31:37Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1272 (T441633)', diff saved to https://phabricator.wikimedia.org/P97080 and previous config saved to /var/cache/conftool/dbconfig/20261102-163134-ladsgroup.json 2476297 wikitext text/x-wiki dyl8niyfqznja9saq59va7onr1nwewe 2476298 2476297 2026-11-02T16:31:54Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1280.eqiad.wmnet with reason: Maintenance 2476298 wikitext text/x-wiki o2pt8wryymabu4qa6sptzlqi79rfhf6 2476299 2476298 2026-11-02T16:31:58Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db1280 (T441633)', diff saved to https://phabricator.wikimedia.org/P97081 and previous config saved to /var/cache/conftool/dbconfig/20261102-163154-ladsgroup.json 2476299 wikitext text/x-wiki hkp14ili37js3gdolayau7g86z7w762 2476300 2476299 2026-11-02T16:32:44Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1253.eqiad.wmnet 2476300 wikitext text/x-wiki gdsl7ydz024vnc4k7woc3k6ftgc6jfv 2476301 2476300 2026-11-02T16:32:47Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1253.eqiad.wmnet 2476301 wikitext text/x-wiki mwgcahl7dxsa09tiu3dxq3n6ujeh3xd 2476303 2476301 2026-11-02T16:36:05Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1280 (T441633)', diff saved to https://phabricator.wikimedia.org/P97082 and previous config saved to /var/cache/conftool/dbconfig/20261102-163602-ladsgroup.json 2476303 wikitext text/x-wiki o9123yct2gxgn6ghcw0c4n0kwoyi9og 2476304 2476303 2026-11-02T16:46:07Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1280', diff saved to https://phabricator.wikimedia.org/P97083 and previous config saved to /var/cache/conftool/dbconfig/20261102-164605-ladsgroup.json 2476304 wikitext text/x-wiki ltxzrfgudtyr0dpoo7qoiuoodab6l9w 2476308 2476304 2026-11-02T16:56:09Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1280', diff saved to https://phabricator.wikimedia.org/P97084 and previous config saved to /var/cache/conftool/dbconfig/20261102-165607-ladsgroup.json 2476308 wikitext text/x-wiki t121kcwt26m4443tz6kvmuc8v5stg6p 2476309 2476308 2026-11-02T16:59:17Z Stashbot 7414 ladsgroup@deploy2003: Started scap sync-world: Backport for [[gerrit:1361508|Temporarily increase circuit breaking (T443274)]] 2476309 wikitext text/x-wiki ll2lz9mnhiixkujdajo28yi8qshmd69 2476310 2476309 2026-11-02T17:03:32Z Stashbot 7414 ladsgroup@deploy2003: ladsgroup: Backport for [[gerrit:1361508|Temporarily increase circuit breaking (T443274)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2476310 wikitext text/x-wiki r8uhop92mayzxj757djju6kctsy0g31 2476311 2476310 2026-11-02T17:06:08Z Stashbot 7414 ladsgroup@deploy2003: ladsgroup: Continuing with deployment 2476311 wikitext text/x-wiki pvosc3sfjdabmkmwsjz10xxss8xvjqd 2476312 2476311 2026-11-02T17:06:12Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1280 (T441633)', diff saved to https://phabricator.wikimedia.org/P97085 and previous config saved to /var/cache/conftool/dbconfig/20261102-170609-ladsgroup.json 2476312 wikitext text/x-wiki 0r74ktbgbx3hc7fdbqkqnfnd8yhz9t4 2476313 2476312 2026-11-02T17:06:29Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1289.eqiad.wmnet with reason: Maintenance 2476313 wikitext text/x-wiki atu93to6fq6xi26xbed1o9fj5kout8m 2476314 2476313 2026-11-02T17:06:33Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db1289 (T441633)', diff saved to https://phabricator.wikimedia.org/P97086 and previous config saved to /var/cache/conftool/dbconfig/20261102-170629-ladsgroup.json 2476314 wikitext text/x-wiki nz7fgdan9pgg2u9q9mhm4uguhxwqias 2476315 2476314 2026-11-02T17:07:28Z Stashbot 7414 cwilliams@cumin1004: START - Cookbook sre.mysql.pool pool db1228: Maintenance 2476315 wikitext text/x-wiki ml6933hqpic51030itdpbia3zqdpvke 2476316 2476315 2026-11-02T17:07:41Z Stashbot 7414 cwilliams@cumin1004: END (ERROR) - Cookbook sre.mysql.pool (exit_code=97) pool db1228: Maintenance 2476316 wikitext text/x-wiki ptu4ap3s4zvlywylqfnzy8wqiyubm3s 2476317 2476316 2026-11-02T17:10:40Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1289 (T441633)', diff saved to https://phabricator.wikimedia.org/P97087 and previous config saved to /var/cache/conftool/dbconfig/20261102-171037-ladsgroup.json 2476317 wikitext text/x-wiki epa9fzfq8nj2bkjmojqhrmx1f8bmj0o 2476318 2476317 2026-11-02T17:12:57Z Stashbot 7414 ladsgroup@deploy2003: Finished scap sync-world: Backport for [[gerrit:1361508|Temporarily increase circuit breaking (T443274)]] (duration: 13m 39s) 2476318 wikitext text/x-wiki rz53ji8k389qa8s7wir0oopjnlwck50 2476319 2476318 2026-11-02T17:20:42Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1289', diff saved to https://phabricator.wikimedia.org/P97088 and previous config saved to /var/cache/conftool/dbconfig/20261102-172039-ladsgroup.json 2476319 wikitext text/x-wiki mu545d8qtzmyauisln6tbotz0p2rlus 2476320 2476319 2026-11-02T17:30:44Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1289', diff saved to https://phabricator.wikimedia.org/P97089 and previous config saved to /var/cache/conftool/dbconfig/20261102-173041-ladsgroup.json 2476320 wikitext text/x-wiki ln2fp9yndok6anoj8qi8mqaq56le3in 2476321 2476320 2026-11-02T17:32:41Z Stashbot 7414 otto@deploy2003: Started scap deploy-service eventgate-analytics: Time to persist metric - T440968 2476321 wikitext text/x-wiki htk0w7ngm2knzvu64eow2o7ncf0t708 2476322 2476321 2026-11-02T17:32:46Z Stashbot 7414 otto@deploy2003: scap deploy-service eventgate-analytics: [STAGING/DEFAULT] staging-eqiad Deploying eventgate-analytics 2476322 wikitext text/x-wiki 19nmjxdbk0rfeakyo5o4fnm0dvaenfv 2476323 2476322 2026-11-02T17:40:46Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1289 (T441633)', diff saved to https://phabricator.wikimedia.org/P97090 and previous config saved to /var/cache/conftool/dbconfig/20261102-174043-ladsgroup.json 2476323 wikitext text/x-wiki npq9ntx6yo0n7tht1xnbhftapq76py1 2476324 2476323 2026-11-02T17:41:04Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on dbstore1007.eqiad.wmnet with reason: Maintenance 2476324 wikitext text/x-wiki 93dhvtpri6hn6dw4g29qrqygjpi7wpr 2476325 2476324 2026-11-02T17:45:28Z Stashbot 7414 dancy: Investigating spiderpig 2476325 wikitext text/x-wiki 4vu0dryzs1worf3kqjqfv9xhj58v3hd 2476326 2476325 2026-11-02T17:46:21Z Stashbot 7414 jgiannelos@deploy1003: helmfile [staging] START helmfile.d/services/tegola-vector-tiles: apply 2476326 wikitext text/x-wiki 85j88urlqfl8gxfd4ik0vhrd3bp40my 2476327 2476326 2026-11-02T17:46:43Z Stashbot 7414 jgiannelos@deploy1003: helmfile [staging] DONE helmfile.d/services/tegola-vector-tiles: apply 2476327 wikitext text/x-wiki tvr84ou1w1m4hhnmjyuvqn0y78n96pn 2476328 2476327 2026-11-02T17:47:45Z Stashbot 7414 ladsgroup@deploy2003: Started scap sync-world: Backport for [[gerrit:1361521|Adjust circuit breaking thresholds (T443274)]], [[gerrit:1361519|rdbms: Allow overriding of load monitor per lb cluster (T443274)]] (1.48.0-wmf.1) 2476328 wikitext text/x-wiki jnwdq4t1z2n8slftxh7o84ptlfrsf28 2476329 2476328 2026-11-02T17:48:15Z Stashbot 7414 otto@deploy2003: helmfile [eqiad] START helmfile.d/services/eventgate-analytics: apply 2476329 wikitext text/x-wiki njici66b6v302ts6lxe06lbcys9cqph 2476330 2476329 2026-11-02T17:49:04Z Stashbot 7414 otto@deploy2003: helmfile [eqiad] DONE helmfile.d/services/eventgate-analytics: apply 2476330 wikitext text/x-wiki kdc1u4e6vrb8i3xldn9ej76a785i1hx 2476331 2476330 2026-11-02T17:49:22Z Stashbot 7414 otto@deploy2003: helmfile [codfw] START helmfile.d/services/eventgate-analytics: apply 2476331 wikitext text/x-wiki b27ktlodoko7x5ex0ws3rpl8n94y7d1 2476333 2476331 2026-11-02T17:50:09Z Stashbot 7414 otto@deploy2003: helmfile [codfw] DONE helmfile.d/services/eventgate-analytics: apply 2476333 wikitext text/x-wiki 3vkyju9sliba8rwb80kuirjfzov9cd6 2476334 2476333 2026-11-02T17:51:50Z Stashbot 7414 ladsgroup@deploy2003: ladsgroup: Backport for [[gerrit:1361521|Adjust circuit breaking thresholds (T443274)]], [[gerrit:1361519|rdbms: Allow overriding of load monitor per lb cluster (T443274)]] (1.48.0-wmf.1) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2476334 wikitext text/x-wiki n0wroqel7qd80m3oyurumfx7fxugvbi 2476335 2476334 2026-11-02T17:52:40Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] START helmfile.d/services/tegola-vector-tiles: apply 2476335 wikitext text/x-wiki pdgba4hpc67jbxj13nqgvjzlktje98m 2476336 2476335 2026-11-02T17:53:19Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] DONE helmfile.d/services/tegola-vector-tiles: apply 2476336 wikitext text/x-wiki 0o308fk71e34qu004t7i20tijrmdgj1 2476337 2476336 2026-11-02T17:53:33Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] START helmfile.d/services/tegola-vector-tiles: apply 2476337 wikitext text/x-wiki gjddnm2omop63dtif55u6bb923fqcep 2476338 2476337 2026-11-02T17:53:41Z Stashbot 7414 ladsgroup@deploy2003: ladsgroup: Continuing with deployment 2476338 wikitext text/x-wiki atr4hnfnntr33c3tq9ye9clzli6u8j0 2476340 2476338 2026-11-02T17:54:09Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] DONE helmfile.d/services/tegola-vector-tiles: apply 2476340 wikitext text/x-wiki th65ol6e48v9t0y6gszsgzbid7wvvj1 2476341 2476340 2026-11-02T17:59:36Z Stashbot 7414 ladsgroup@deploy2003: Finished scap sync-world: Backport for [[gerrit:1361521|Adjust circuit breaking thresholds (T443274)]], [[gerrit:1361519|rdbms: Allow overriding of load monitor per lb cluster (T443274)]] (1.48.0-wmf.1) (duration: 11m 51s) 2476341 wikitext text/x-wiki dsgzxpkzrg1kjtjuyr9vanqd0d2qoe3 2476343 2476341 2026-11-02T18:02:52Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] START helmfile.d/services/tegola-vector-tiles: apply 2476343 wikitext text/x-wiki iuq6kannt0lsmfoqijxho5ls3ai4vld 2476344 2476343 2026-11-02T18:02:56Z Stashbot 7414 jgiannelos@deploy1003: helmfile [codfw] DONE helmfile.d/services/tegola-vector-tiles: apply 2476344 wikitext text/x-wiki ijdadfsssdvxn3ivj98d16qreto43c3 2476345 2476344 2026-11-02T18:03:01Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] START helmfile.d/services/tegola-vector-tiles: apply 2476345 wikitext text/x-wiki 8l1of9ruaww4z135zeyl893w518el2c 2476346 2476345 2026-11-02T18:03:04Z Stashbot 7414 jgiannelos@deploy1003: helmfile [eqiad] DONE helmfile.d/services/tegola-vector-tiles: apply 2476346 wikitext text/x-wiki bsbne0pyoa3l40vxs6dzqj4479em08n 2476347 2476346 2026-11-02T18:03:10Z Stashbot 7414 jgiannelos@deploy1003: helmfile [staging] START helmfile.d/services/tegola-vector-tiles: apply 2476347 wikitext text/x-wiki r26pq7sb215aioru47540gnpufb2ega 2476348 2476347 2026-11-02T18:03:13Z Stashbot 7414 jgiannelos@deploy1003: helmfile [staging] DONE helmfile.d/services/tegola-vector-tiles: apply 2476348 wikitext text/x-wiki rn7mq6tenrv4x5ehwgcqwh78kce2hrl 2476349 2476348 2026-11-02T18:11:52Z Stashbot 7414 rzl@deploy2003: Started scap sync-world: https://gerrit.wikimedia.org/r/1360005 T436338 2476349 wikitext text/x-wiki 0f0gmndwh8ke5nhi2iaj5o9or85deqa 2476350 2476349 2026-11-02T18:18:45Z Stashbot 7414 rzl@deploy2003: Finished scap sync-world: https://gerrit.wikimedia.org/r/1360005 T436338 (duration: 07m 48s) 2476350 wikitext text/x-wiki 1go8cx7tr9a104ikz8ytrxaski53pf3 2476351 2476350 2026-11-02T18:23:42Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/rest-gateway: apply 2476351 wikitext text/x-wiki dziwyrjgixdsaen4u0cf8ypndqo8gcw 2476352 2476351 2026-11-02T18:24:01Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply 2476352 wikitext text/x-wiki jz1jhb1li65ivg6yuhvxc920np63ssy 2476353 2476352 2026-11-02T18:24:56Z Stashbot 7414 rzl@deploy2003: helmfile [codfw] START helmfile.d/services/rest-gateway: apply 2476353 wikitext text/x-wiki 6mmyruqrot68ldq9gn7yp3qs7f9nr99 2476354 2476353 2026-11-02T18:25:13Z Stashbot 7414 rzl@deploy2003: helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply 2476354 wikitext text/x-wiki t3mhbs37uyf1fkl19vxzcwbcb0usll6 2476355 2476354 2026-11-02T18:29:15Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/mw-videoscaler: apply 2476355 wikitext text/x-wiki t2e0huus3c65txte5jyykgbzqy8qsmv 2476356 2476355 2026-11-02T18:29:35Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/mw-videoscaler: apply 2476356 wikitext text/x-wiki 0lj73lvct2tii8mu7xubn08jyev4p9v 2476357 2476356 2026-11-02T18:30:16Z Stashbot 7414 btullis@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on an-presto1015.eqiad.wmnet with reason: Recreate data RAID without failed disk 2476357 wikitext text/x-wiki icvdcfczfdvob2fi606crmynv2rt0nz 2476358 2476357 2026-11-02T18:31:31Z Stashbot 7414 rzl@deploy2003: helmfile [codfw] START helmfile.d/services/mw-videoscaler: apply 2476358 wikitext text/x-wiki kjlj6s3ij8fh61r3525kbah2twik6dt 2476359 2476358 2026-11-02T18:31:44Z Stashbot 7414 rzl@deploy2003: helmfile [codfw] DONE helmfile.d/services/mw-videoscaler: apply 2476359 wikitext text/x-wiki 78gjrp1f67yrk13h06hnl3bbqajqauu 2476360 2476359 2026-11-02T18:36:13Z Stashbot 7414 rsilvola@deploy2003: helmfile [codfw] START helmfile.d/services/miscweb: apply 2476360 wikitext text/x-wiki q9bj3r6u1ttppgeifepsrghxloysqc9 2476361 2476360 2026-11-02T18:36:36Z Stashbot 7414 rsilvola@deploy2003: helmfile [codfw] DONE helmfile.d/services/miscweb: apply 2476361 wikitext text/x-wiki bdhsha2svtae7ydklb0ubmxrvmfshiq 2476362 2476361 2026-11-02T18:36:43Z Stashbot 7414 rsilvola@deploy2003: helmfile [eqiad] START helmfile.d/services/miscweb: apply 2476362 wikitext text/x-wiki 4xabvjd7bd0q8c2ipq8mhvp8ladrmhc 2476363 2476362 2026-11-02T18:37:08Z Stashbot 7414 rsilvola@deploy2003: helmfile [eqiad] DONE helmfile.d/services/miscweb: apply 2476363 wikitext text/x-wiki 74mwge5b7y1ebun8wxbq2lhaak8xflv 2476364 2476363 2026-11-02T18:43:51Z Stashbot 7414 akhatun@deploy2003: Started scap sync-world: Backport for [[gerrit:1361525|Prefetch the LAC revision_feature_counts artifact on all wikipedias]] 2476364 wikitext text/x-wiki ig6jrh631rhbgkjr5h2k55r9971hxma 2476367 2476364 2026-11-02T18:47:59Z Stashbot 7414 akhatun@deploy2003: akhatun: Backport for [[gerrit:1361525|Prefetch the LAC revision_feature_counts artifact on all wikipedias]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2476367 wikitext text/x-wiki 9wddfn1eqm0w50ilrt9q7pc5ul2ytan 2476368 2476367 2026-11-02T18:48:42Z Stashbot 7414 akhatun@deploy2003: akhatun: Continuing with deployment 2476368 wikitext text/x-wiki eaqlauc5xf66i7rujaxyxml6nof30ds 2476369 2476368 2026-11-02T18:54:34Z Stashbot 7414 akhatun@deploy2003: Finished scap sync-world: Backport for [[gerrit:1361525|Prefetch the LAC revision_feature_counts artifact on all wikipedias]] (duration: 10m 43s) 2476369 wikitext text/x-wiki qvlp2ire63hz2c5lmd31lanktfbvn6g 2476370 2476369 2026-11-02T18:55:08Z Stashbot 7414 dancy@deploy2003: Installing scap version "4.310.0" for 2 host(s) 2476370 wikitext text/x-wiki bytbqc0v97twjhcn6qx7vriwbk8jz0x 2476371 2476370 2026-11-02T18:57:01Z Stashbot 7414 dancy@deploy2003: Installation of scap version "4.310.0" completed for 2 hosts 2476371 wikitext text/x-wiki mkmapvxlgrmn3wagenhoj6x8kp9jjb1 2476375 2476371 2026-11-02T19:29:55Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/apertium: apply 2476375 wikitext text/x-wiki kho6bl62gxixfv5a0qts3ugm9ds5f7q 2476376 2476375 2026-11-02T19:30:23Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/apertium: apply 2476376 wikitext text/x-wiki gq22lu3fn84yyirnkvci5zvebnn19eo 2476377 2476376 2026-11-02T19:33:20Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/chart-renderer: apply 2476377 wikitext text/x-wiki kmvauiygevk9m7zftd9s1cclpv2le12 2476378 2476377 2026-11-02T19:33:36Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/chart-renderer: apply 2476378 wikitext text/x-wiki o5w45rq91vppo0qqgbfui3bqkwcqvlx 2476379 2476378 2026-11-02T19:34:16Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply 2476379 wikitext text/x-wiki rync3ofww3wsh5ai7ekk1iyslgzqp3c 2476380 2476379 2026-11-02T19:34:24Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply 2476380 wikitext text/x-wiki 35b7bfss7wzpvcwhddulsrrhhzzdwrz 2476381 2476380 2026-11-02T19:34:30Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/citoid: apply 2476381 wikitext text/x-wiki tti79p3537zbaukti0vc84ftkumdn5k 2476382 2476381 2026-11-02T19:34:44Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/citoid: apply 2476382 wikitext text/x-wiki 4jl3an8ovhfsrs9ymyaqxawka99gm1h 2476383 2476382 2026-11-02T19:34:50Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/commons-impact-analytics: apply 2476383 wikitext text/x-wiki mjovyoh6613rg8tbn6o8h8xlkxym93x 2476384 2476383 2026-11-02T19:35:01Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/commons-impact-analytics: apply 2476384 wikitext text/x-wiki n6wazp7cmrvgbidikt40t6x582b51wt 2476385 2476384 2026-11-02T19:35:09Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/cxserver: apply 2476385 wikitext text/x-wiki c2bxdzxr6luzjeb8ow2mqvbmfk4x5fo 2476386 2476385 2026-11-02T19:35:26Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/cxserver: apply 2476386 wikitext text/x-wiki nsnsoz2bodyif374y72fji9xkgekunq 2476387 2476386 2026-11-02T19:35:34Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/data-gateway: apply 2476387 wikitext text/x-wiki 72gvb5ostz10v145qdq1rwgvwwx8rh9 2476388 2476387 2026-11-02T19:35:45Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/data-gateway: apply 2476388 wikitext text/x-wiki tjto0fhsi4gcp2meu2cylu7o5iizeii 2476389 2476388 2026-11-02T19:35:51Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/developer-portal: apply 2476389 wikitext text/x-wiki 2kut7asvkpici180g31x6uuo4ol3yry 2476390 2476389 2026-11-02T19:36:00Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/developer-portal: apply 2476390 wikitext text/x-wiki dozje28brqwb2b8yk91valvup45u6ol 2476391 2476390 2026-11-02T19:36:05Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/device-analytics: apply 2476391 wikitext text/x-wiki 2j0bbs39abs3j1in84fphdpgtt86ows 2476392 2476391 2026-11-02T19:36:18Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/device-analytics: apply 2476392 wikitext text/x-wiki hjjbye3gfd7c01zsrzdgkiurnex0z5b 2476393 2476392 2026-11-02T19:36:24Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/echostore: apply 2476393 wikitext text/x-wiki rbrxmw0ox3omslb62r8urhwou8136l5 2476394 2476393 2026-11-02T19:36:35Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/echostore: apply 2476394 wikitext text/x-wiki 9bpwy9s6y5q3d1zxqny2xl1z68snbbj 2476395 2476394 2026-11-02T19:36:41Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/edit-analytics: apply 2476395 wikitext text/x-wiki tsdzic76tb9kbj5ttmuv3q4n5leq2t1 2476396 2476395 2026-11-02T19:36:54Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/edit-analytics: apply 2476396 wikitext text/x-wiki 7k29pg0lh9go78ta4hmku9ti94ippcv 2476397 2476396 2026-11-02T19:36:59Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/editcheck-headless: apply 2476397 wikitext text/x-wiki 9ndgdvh3caenwgn09vywi98cpealmx2 2476398 2476397 2026-11-02T19:37:15Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/editcheck-headless: apply 2476398 wikitext text/x-wiki 5pjlfsyc87tgi6dj7kj95175qa5twa9 2476399 2476398 2026-11-02T19:37:32Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/editor-analytics: apply 2476399 wikitext text/x-wiki opvjz9sjyvn7udyzsjmdky63ktqvegx 2476400 2476399 2026-11-02T19:37:45Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/editor-analytics: apply 2476400 wikitext text/x-wiki 5egul8hlwm0houanm4ieu2hwu1lw711 2476401 2476400 2026-11-02T19:37:50Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/eventgate-analytics: apply 2476401 wikitext text/x-wiki 400avbwdu7qs29ugkl41tg0s98zajwj 2476402 2476401 2026-11-02T19:38:17Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/eventgate-analytics: apply 2476402 wikitext text/x-wiki ti7ylnl4th1dsrwt7q6hvfc3160qini 2476403 2476402 2026-11-02T19:39:02Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/eventstreams: apply 2476403 wikitext text/x-wiki 4jjh0jcksgdn65tnmh3688yit68citb 2476404 2476403 2026-11-02T19:39:24Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/eventstreams: apply 2476404 wikitext text/x-wiki 4f9m3h4pfkd4suhws6ejvj2u4bzivzu 2476405 2476404 2026-11-02T19:39:41Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/geo-analytics: apply 2476405 wikitext text/x-wiki 9dy3ukjup259um6nq8xnl6ho6lpoewm 2476406 2476405 2026-11-02T19:39:50Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/geo-analytics: apply 2476406 wikitext text/x-wiki hbkrcu6ayizlehb6jicpxvvta8lq5dj 2476407 2476406 2026-11-02T19:39:56Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/kartotherian: apply 2476407 wikitext text/x-wiki 4zibs4ujjtqcp57y6u5n8df59ytuoaa 2476408 2476407 2026-11-02T19:40:08Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/kartotherian: apply 2476408 wikitext text/x-wiki 6a6jemm952lzct61w4gfaj002p6pai5 2476409 2476408 2026-11-02T19:40:22Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/lac-lambdas: apply 2476409 wikitext text/x-wiki 6b2nmzo1nr40fdo68dqi6lhgkwx8sg9 2476410 2476409 2026-11-02T19:40:37Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/lac-lambdas: apply 2476410 wikitext text/x-wiki qkwlq4441u38mw9os3q82zg7lndsh9e 2476411 2476410 2026-11-02T19:40:57Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/linked-artifacts: apply 2476411 wikitext text/x-wiki 2fmgbc6jx02v72kyaa56tsp6gt78j7o 2476412 2476411 2026-11-02T19:41:07Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/linked-artifacts: apply 2476412 wikitext text/x-wiki 5t1yl3wgr5u18vkm3t3q83vrt6vdfob 2476413 2476412 2026-11-02T19:41:33Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/linkrecommendation: apply 2476413 wikitext text/x-wiki 8n3syw79qzjnj4rzfyzs4pkwhvr49p8 2476414 2476413 2026-11-02T19:41:44Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/linkrecommendation: apply 2476414 wikitext text/x-wiki 67jgd7oeucga74mu9uj41knqxth2mmd 2476415 2476414 2026-11-02T19:41:52Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/machinetranslation: apply 2476415 wikitext text/x-wiki rymq4cpo340ahqkmfr1noy0w3akyqvn 2476416 2476415 2026-11-02T19:45:32Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/machinetranslation: apply 2476416 wikitext text/x-wiki mac59foutowgehv6yux8odiy7h4w4jk 2476417 2476416 2026-11-02T19:45:43Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/media-analytics: apply 2476417 wikitext text/x-wiki kts4keahw67ibhr6ctpqb2ald8qm4do 2476418 2476417 2026-11-02T19:45:52Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/media-analytics: apply 2476418 wikitext text/x-wiki jrqxr9mjq5xlywr6g016lig8hv9exl2 2476420 2476418 2026-11-02T19:50:48Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/mobileapps: apply 2476420 wikitext text/x-wiki 0ai3bdm89jggl64bqsmmnx0ubrciql1 2476421 2476420 2026-11-02T19:51:07Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/mobileapps: apply 2476421 wikitext text/x-wiki 8awvikpkbvw738tbew56tkvnsl3cpsa 2476422 2476421 2026-11-02T19:51:50Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/page-analytics: apply 2476422 wikitext text/x-wiki 43k2lj3owfxs56glc6bamcgdadbcvx9 2476424 2476422 2026-11-02T19:52:01Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/page-analytics: apply 2476424 wikitext text/x-wiki kmrbg8x487cgrd51mjyxxfyxbvvsxjv 2476425 2476424 2026-11-02T19:52:06Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/proton: apply 2476425 wikitext text/x-wiki 5ffyll1cezsd8mhtvge4w9c9a5c5zor 2476426 2476425 2026-11-02T19:52:16Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/proton: apply 2476426 wikitext text/x-wiki 922zqecbdxh5kdsnefowcm0oubnlbvd 2476427 2476426 2026-11-02T19:52:36Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/push-notifications: apply 2476427 wikitext text/x-wiki md6fb9ee8jb3gynveovvmq6zn69mp8x 2476428 2476427 2026-11-02T19:52:47Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/push-notifications: apply 2476428 wikitext text/x-wiki mmrnum62qba2d53n7iilij32cc9q8lq 2476430 2476428 2026-11-02T19:53:17Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/recommendation-api: apply 2476430 wikitext text/x-wiki 5tvfvz6aogvjjf91x9zu6ek4pmwajcb 2476431 2476430 2026-11-02T19:53:27Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/recommendation-api: apply 2476431 wikitext text/x-wiki 52qbkkqrbrehua97eao7se1r0kjnx27 2476432 2476431 2026-11-02T19:53:34Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/rest-gateway: apply 2476432 wikitext text/x-wiki qcbr8ylafge78o1uxc7t0mls2b2kp6p 2476433 2476432 2026-11-02T19:53:45Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/rest-gateway: apply 2476433 wikitext text/x-wiki 4o9ot0dymjf9of0fxnv8v8xeizgawix 2476434 2476433 2026-11-02T19:54:00Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/sessionstore: apply 2476434 wikitext text/x-wiki nqnhl6vg98gjmz9lbu56fkytt2drs4w 2476435 2476434 2026-11-02T19:54:10Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/sessionstore: apply 2476435 wikitext text/x-wiki 1bcwnpesk0yygtsoiyby23ltglqg7q3 2476436 2476435 2026-11-02T19:54:17Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/shellbox: apply 2476436 wikitext text/x-wiki k6kjzen4i415r0osn06286ncwpg04ai 2476437 2476436 2026-11-02T19:54:28Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/shellbox: apply 2476437 wikitext text/x-wiki tixshnyetyr6hb8czjkf8nexgq4ry8u 2476438 2476437 2026-11-02T19:54:35Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/shellbox-constraints: apply 2476438 wikitext text/x-wiki jd6nxuw58lfuossrkfa7fxiey5mpag3 2476439 2476438 2026-11-02T19:54:48Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/shellbox-constraints: apply 2476439 wikitext text/x-wiki 2lp2upopgaqqqxcs3jc4r3pcuk4xswk 2476440 2476439 2026-11-02T19:54:56Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/shellbox-media: apply 2476440 wikitext text/x-wiki 49th1rl5vgiuil0deatsi38uf520k6v 2476441 2476440 2026-11-02T19:55:11Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/shellbox-media: apply 2476441 wikitext text/x-wiki 0phxtmzjkwtrpbuwrybe269z15czllw 2476442 2476441 2026-11-02T19:56:15Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/shellbox-timeline: apply 2476442 wikitext text/x-wiki swm6bz4k274jo0n4pc55m78xrz3okkt 2476444 2476442 2026-11-02T19:56:27Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/shellbox-timeline: apply 2476444 wikitext text/x-wiki 0n6p6vhdavake34rc2h9kubbpniz28g 2476445 2476444 2026-11-02T19:57:03Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/shellbox-video: apply 2476445 wikitext text/x-wiki 0oteoof3v67ono1jutsfihgwfzwal43 2476446 2476445 2026-11-02T19:57:28Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/shellbox-video: apply 2476446 wikitext text/x-wiki 1wfgguad2sw3axtjtxgfpp813f4sehd 2476447 2476446 2026-11-02T19:57:34Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/tegola-vector-tiles: apply 2476447 wikitext text/x-wiki p5go93yq3ju979sxyy5cw11f7rafjda 2476448 2476447 2026-11-02T19:57:59Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/tegola-vector-tiles: apply 2476448 wikitext text/x-wiki noke8emb5c5kwe6zf16d2riam17bey2 2476449 2476448 2026-11-02T19:58:07Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/termbox: apply 2476449 wikitext text/x-wiki 2n0au69u44twxcz4p1exzgkut64d8jn 2476450 2476449 2026-11-02T19:58:34Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/termbox: apply 2476450 wikitext text/x-wiki 6dmg1qbr9fdsdm6o6ddh3c4z6j5l57q 2476451 2476450 2026-11-02T19:58:39Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/thumbor: apply 2476451 wikitext text/x-wiki hdwsk106hqomjad1tmxvojr91ro7mwh 2476452 2476451 2026-11-02T19:58:49Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2476452 wikitext text/x-wiki owwgr5m7fskhi38jk5ypvry85fzn7dt 2476453 2476452 2026-11-02T19:58:55Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/toolhub: apply 2476453 wikitext text/x-wiki ad5b6cp5ekzejykwty5k1om1czmhmyf 2476454 2476453 2026-11-02T19:59:20Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/toolhub: apply 2476454 wikitext text/x-wiki 59kb7ufgfdmxhe488uu9bn39f146unv 2476455 2476454 2026-11-02T19:59:52Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/wikidata-query-gui: apply 2476455 wikitext text/x-wiki a99v2tc8neb7qhvghxixr3523z7onzb 2476456 2476455 2026-11-02T20:00:09Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/wikidata-query-gui: apply 2476456 wikitext text/x-wiki gy0qy5m3tgnejvxceerm0rllyytgqs7 2476457 2476456 2026-11-02T20:00:35Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/wikifeeds: apply 2476457 wikitext text/x-wiki 8lgdcl6b6xlun9b8t50xrfyc057z098 2476458 2476457 2026-11-02T20:00:52Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/wikifeeds: apply 2476458 wikitext text/x-wiki 4a32m7933ouvh86wvcepsmmpmc7ty9l 2476459 2476458 2026-11-02T20:00:59Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/wikifunctions: apply 2476459 wikitext text/x-wiki b8zdf3is937axdnb3oob8m44tcwajjr 2476460 2476459 2026-11-02T20:01:47Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/wikifunctions: apply 2476460 wikitext text/x-wiki hopfs7b4mioywzm5lnpdqc4e49xiw8l 2476461 2476460 2026-11-02T20:01:58Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/zotero: apply 2476461 wikitext text/x-wiki t8ixvi8y383i1a4frrqx2uwl1twt0rg 2476462 2476461 2026-11-02T20:02:14Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/zotero: apply 2476462 wikitext text/x-wiki bt2xunxexb8laag3eql6540dr9okqk0 2476464 2476462 2026-11-02T20:33:55Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/miscweb: apply 2476464 wikitext text/x-wiki 2xmny78l7hs1d4425546fizy6epl571 2476465 2476464 2026-11-02T20:34:58Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/miscweb: apply 2476465 wikitext text/x-wiki d9lpxv1q18yvxx4uywnfs98wa2tsv6b 2476466 2476465 2026-11-02T20:43:04Z Stashbot 7414 cscott@deploy2003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2476466 wikitext text/x-wiki d28yovhvix960yugwbksxbmd7zbg7q6 2476467 2476466 2026-11-02T20:43:57Z Stashbot 7414 cscott@deploy2003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2476467 wikitext text/x-wiki f3tt7g7akycpwxxyyg3yomi4ckyuma5 2476469 2476467 2026-11-02T21:15:28Z Stashbot 7414 jdlrobson@deploy2003: Started scap sync-world: Backport for [[gerrit:1360497|Skin: Update skin-responsive logic (T439273)]] (1.48.0-wmf.1), [[gerrit:1360498|Skin: skin--responsive class no longer varies on user (T439273)]] (1.48.0-wmf.1), [[gerrit:1360551|Fast forward wmf.1 branch to 0626e6 (T440916 T441259 T441260 T441477 T442906)]] (1.48.0-wmf.1) 2476469 wikitext text/x-wiki fqmc4uvu3bld1px67udfkg9rtu4liq9 2476470 2476469 2026-11-02T21:36:50Z Stashbot 7414 jdlrobson@deploy2003: jdlrobson: Backport for [[gerrit:1360497|Skin: Update skin-responsive logic (T439273)]] (1.48.0-wmf.1), [[gerrit:1360498|Skin: skin--responsive class no longer varies on user (T439273)]] (1.48.0-wmf.1), [[gerrit:1360551|Fast forward wmf.1 branch to 0626e6 (T440916 T441259 T441260 T441477 T442906)]] (1.48.0-wmf.1) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes 2476470 wikitext text/x-wiki l1o5uaexgp9plmunmbijhw54jry33xg 2476471 2476470 2026-11-02T21:38:08Z Stashbot 7414 jdlrobson@deploy2003: jdlrobson: Continuing with deployment 2476471 wikitext text/x-wiki aykhhkijmrcg5e0y0bjpu7n3axeclwx 2476472 2476471 2026-11-02T21:50:36Z Stashbot 7414 jdlrobson@deploy2003: Finished scap sync-world: Backport for [[gerrit:1360497|Skin: Update skin-responsive logic (T439273)]] (1.48.0-wmf.1), [[gerrit:1360498|Skin: skin--responsive class no longer varies on user (T439273)]] (1.48.0-wmf.1), [[gerrit:1360551|Fast forward wmf.1 branch to 0626e6 (T440916 T441259 T441260 T441477 T442906)]] (1.48.0-wmf.1) (duration: 35m 12s) 2476472 wikitext text/x-wiki hcedh9mmuy10yv8rf3eugfsva8iogwt 2476473 2476472 2026-11-02T21:52:41Z Stashbot 7414 jdlrobson@deploy2003: Started scap sync-world: Backport for [[gerrit:1359878|Enable Vector CTA on all wikipedias (T441705)]] 2476473 wikitext text/x-wiki j08i89eg3p4jpyzeu0po4hznfoaklhi 2476474 2476473 2026-11-02T21:56:57Z Stashbot 7414 jdlrobson@deploy2003: jdlrobson: Backport for [[gerrit:1359878|Enable Vector CTA on all wikipedias (T441705)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2476474 wikitext text/x-wiki qsih6p0av0n25jpes1c7chwbh7ctkj5 2476475 2476474 2026-11-02T21:57:46Z Stashbot 7414 jdlrobson@deploy2003: jdlrobson: Continuing with deployment 2476475 wikitext text/x-wiki mmkw6otm4y8exka3ut8tewrxcokmhdc 2476477 2476475 2026-11-02T22:05:46Z Stashbot 7414 jdlrobson@deploy2003: Finished scap sync-world: Backport for [[gerrit:1359878|Enable Vector CTA on all wikipedias (T441705)]] (duration: 13m 05s) 2476477 wikitext text/x-wiki ehw8zdwsg6zb2edze0aau4rsd8zxuxs 2476478 2476477 2026-11-02T22:11:14Z Stashbot 7414 krinkle@deploy2003: Started scap sync-world: Backport for [[gerrit:1361554|Handle \mathcal in mmlFilter instead of the font]] (1.48.0-wmf.1), [[gerrit:1361555|Keep \mathrm upright inside \mathbf (T442312)]] (1.48.0-wmf.1), [[gerrit:1361556|Draw no outer line for a nested \hline]] (1.48.0-wmf.1) 2476478 wikitext text/x-wiki fxqbloophkkmywbvr4nvzrohmr9j4sz 2476481 2476478 2026-11-02T22:15:20Z Stashbot 7414 krinkle@deploy2003: krinkle: Backport for [[gerrit:1361554|Handle \mathcal in mmlFilter instead of the font]] (1.48.0-wmf.1), [[gerrit:1361555|Keep \mathrm upright inside \mathbf (T442312)]] (1.48.0-wmf.1), [[gerrit:1361556|Draw no outer line for a nested \hline]] (1.48.0-wmf.1) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2476481 wikitext text/x-wiki 2yp28bkhppoz1aas0pygmilyih89rbh 2476482 2476481 2026-11-02T22:19:14Z Stashbot 7414 krinkle@deploy2003: krinkle: Continuing with deployment 2476482 wikitext text/x-wiki 3biu2a3mmtu5wabln8jptk60hdx758a 2476483 2476482 2026-11-02T22:25:05Z Stashbot 7414 krinkle@deploy2003: Finished scap sync-world: Backport for [[gerrit:1361554|Handle \mathcal in mmlFilter instead of the font]] (1.48.0-wmf.1), [[gerrit:1361555|Keep \mathrm upright inside \mathbf (T442312)]] (1.48.0-wmf.1), [[gerrit:1361556|Draw no outer line for a nested \hline]] (1.48.0-wmf.1) (duration: 13m 50s) 2476483 wikitext text/x-wiki bun849zdr7k4rmcem6vzzzx20x6kl3l 2476485 2476483 2026-11-02T22:35:03Z Stashbot 7414 cscott@deploy2003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2476485 wikitext text/x-wiki ctfnif83y4hh9fucq26elt183v4z1q5 2476486 2476485 2026-11-02T22:35:50Z Stashbot 7414 cscott@deploy2003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2476486 wikitext text/x-wiki 99c0l7epmsyv8dfoxmp2ivtms8s24e5 2476489 2476486 2026-11-02T23:24:42Z Stashbot 7414 maryum: Deployed security fix for T440502, T440330, T442830, T442861 2476489 wikitext text/x-wiki do3h54u4o1zitfsktjhpdrnlb6h211j 2476492 2476489 2026-11-03T00:10:51Z Stashbot 7414 maryum: Deployed security fix for T440469, T441384, T440735, T440501, T439716 2476492 wikitext text/x-wiki tnk9jhoq2gs2ky53thqrvgtycroi53b 2476493 2476492 2026-11-03T00:41:24Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/apertium: apply 2476493 wikitext text/x-wiki q0uy4asikc4tdzs6hy7ybqg9q12ilow 2476494 2476493 2026-11-03T00:41:57Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/apertium: apply 2476494 wikitext text/x-wiki 5mvg6j6seti4z6rowhrdqewka2kj7dz 2476495 2476494 2026-11-03T00:46:03Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/chart-renderer: apply 2476495 wikitext text/x-wiki 53c88430lpd16g74ia6owooaf1uy8z4 2476496 2476495 2026-11-03T00:46:28Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/chart-renderer: apply 2476496 wikitext text/x-wiki fec7v9as238rbm2oeyf4894j5t999rj 2476497 2476496 2026-11-03T00:46:38Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply 2476497 wikitext text/x-wiki nfa7vwuz5pf5d8fd6baf95gt9q3bh8u 2476498 2476497 2026-11-03T00:46:45Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply 2476498 wikitext text/x-wiki t6zro4p9ctdm96o7qkdv8zr5ng5cid5 2476499 2476498 2026-11-03T00:46:53Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/citoid: apply 2476499 wikitext text/x-wiki 5hyod5eoda2yqwd9s560t2fsd55kbjn 2476500 2476499 2026-11-03T00:47:14Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/citoid: apply 2476500 wikitext text/x-wiki 4egyk54mpfkeplqyu6rilpd6y0tohub 2476501 2476500 2026-11-03T00:47:39Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/commons-impact-analytics: apply 2476501 wikitext text/x-wiki s0d04n8n1f22linp0rst8keacacpwqn 2476502 2476501 2026-11-03T00:47:57Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/commons-impact-analytics: apply 2476502 wikitext text/x-wiki p39a59fldpcedr0l122tva83kproeej 2476503 2476502 2026-11-03T00:48:39Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/cxserver: apply 2476503 wikitext text/x-wiki cbhmvuyx7akq801h6fswhg1eb5grcp1 2476504 2476503 2026-11-03T00:49:01Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/cxserver: apply 2476504 wikitext text/x-wiki 4u9ozd73hgtsekybnqw57u9tb19qaqv 2476505 2476504 2026-11-03T00:49:07Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/data-gateway: apply 2476505 wikitext text/x-wiki 1zh97l6ezz3xa08n86chq512vpzgmkh 2476506 2476505 2026-11-03T00:49:26Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/data-gateway: apply 2476506 wikitext text/x-wiki ouq8du2nz70400batm8hpz5fmvxvrok 2476507 2476506 2026-11-03T00:50:10Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/developer-portal: apply 2476507 wikitext text/x-wiki e1s3gvml9esxh5eq6racwf5ymq7sdan 2476508 2476507 2026-11-03T00:50:26Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/developer-portal: apply 2476508 wikitext text/x-wiki qb0d9bibgrzdo79b17irj3pfbaqe1yo 2476509 2476508 2026-11-03T00:51:12Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/device-analytics: apply 2476509 wikitext text/x-wiki 06qh0fd45zidqh8glt5yjq0sg9rflhp 2476510 2476509 2026-11-03T00:51:28Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/device-analytics: apply 2476510 wikitext text/x-wiki keqfgjlc3rnbug8ot1x6awfet70dim5 2476511 2476510 2026-11-03T00:53:35Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/echostore: apply 2476511 wikitext text/x-wiki pkpmdr2x6aa0dblngigzxan154yhbi1 2476512 2476511 2026-11-03T00:53:51Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/echostore: apply 2476512 wikitext text/x-wiki 3fz3xqhsiealh2cufnqfuf9wbjccz4p 2476513 2476512 2026-11-03T00:53:57Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/edit-analytics: apply 2476513 wikitext text/x-wiki lnveu0zcdf1wsu7sl3ucylrwuimwa2h 2476514 2476513 2026-11-03T00:54:14Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/edit-analytics: apply 2476514 wikitext text/x-wiki rze4cx60or39ee6ht66oyqg92w6xu20 2476515 2476514 2026-11-03T00:54:20Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/editcheck-headless: apply 2476515 wikitext text/x-wiki p08cq9lqnf9dr2ans4titpxfsh6takw 2476516 2476515 2026-11-03T00:55:27Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/editcheck-headless: apply 2476516 wikitext text/x-wiki 626aqu0t81rkvjzu5og0ohcut67caq1 2476517 2476516 2026-11-03T00:55:33Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/editor-analytics: apply 2476517 wikitext text/x-wiki k4heybskfjk3ynvnty8qqzu72r5ypmu 2476518 2476517 2026-11-03T00:55:48Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/editor-analytics: apply 2476518 wikitext text/x-wiki pv0kon6c2y5tyykl66p5ccq47oi50px 2476519 2476518 2026-11-03T00:56:33Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/eventgate-analytics: apply 2476519 wikitext text/x-wiki fdg49mq5m2ayxu0qngp9zbsgk9opq9f 2476520 2476519 2026-11-03T00:57:13Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/eventgate-analytics: apply 2476520 wikitext text/x-wiki buu36uf4uj1j73nx8k5n3bgbk57zs1v 2476521 2476520 2026-11-03T01:00:25Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/eventstreams: apply 2476521 wikitext text/x-wiki lzfx269k2dtkqb0qusd68yuybnrz8xr 2476522 2476521 2026-11-03T01:00:59Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/eventstreams: apply 2476522 wikitext text/x-wiki qhvlnjl7q1v56tz23zyi4i47uiac1uu 2476523 2476522 2026-11-03T01:01:06Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/geo-analytics: apply 2476523 wikitext text/x-wiki oyxvygv198m4yq4rumpzklhmsxp1q3v 2476524 2476523 2026-11-03T01:01:25Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/geo-analytics: apply 2476524 wikitext text/x-wiki b2kbkwvocx3d0uk32topqjdab93y4wt 2476525 2476524 2026-11-03T01:01:59Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/kartotherian: apply 2476525 wikitext text/x-wiki t8zbslws8ix94an1q5ie747j3yd7g8y 2476526 2476525 2026-11-03T01:03:02Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/kartotherian: apply 2476526 wikitext text/x-wiki f91pvf55swj9u5g5jkp5iztn1svmrum 2476527 2476526 2026-11-03T01:03:09Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/lac-lambdas: apply 2476527 wikitext text/x-wiki kl6qn6jxfpl40ajghotkzv0reydc246 2476528 2476527 2026-11-03T01:03:29Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/lac-lambdas: apply 2476528 wikitext text/x-wiki rs18bg4ayu7ixkbo8ynob58qlgzchae 2476529 2476528 2026-11-03T01:03:33Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/linked-artifacts: apply 2476529 wikitext text/x-wiki 6br8djvv05lvmccfrzl57kl2u9tqqtz 2476530 2476529 2026-11-03T01:03:57Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/linked-artifacts: apply 2476530 wikitext text/x-wiki 0yr42jyy571usirah1336l7j1le0idf 2476531 2476530 2026-11-03T01:04:06Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/linkrecommendation: apply 2476531 wikitext text/x-wiki pcxcxi02dq33x8r1td3f83l0v64s2am 2476532 2476531 2026-11-03T01:05:39Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/linkrecommendation: apply 2476532 wikitext text/x-wiki sqxrmvl8lkl09hdpk8y4kvwb9le2871 2476533 2476532 2026-11-03T01:05:45Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/machinetranslation: apply 2476533 wikitext text/x-wiki q0xo3aovurjjdzpdvgr1g68eroddh3a 2476534 2476533 2026-11-03T01:13:05Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/machinetranslation: apply 2476534 wikitext text/x-wiki icau7rtprq0v9o7c5ac91c58qpzqkdv 2476535 2476534 2026-11-03T01:13:15Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/media-analytics: apply 2476535 wikitext text/x-wiki firx9usuryqpr3eyl3yno1resg6jmth 2476536 2476535 2026-11-03T01:13:34Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/media-analytics: apply 2476536 wikitext text/x-wiki s8s9or7kul3egcwbe1595poa48lqhlv 2476537 2476536 2026-11-03T01:13:56Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/miscweb: apply 2476537 wikitext text/x-wiki il66f4auh8ol64fgufgid8kmfnio0bg 2476538 2476537 2026-11-03T01:16:07Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/miscweb: apply 2476538 wikitext text/x-wiki slonaz9ww3oku77zl3c839h4aw804qx 2476539 2476538 2026-11-03T01:16:20Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/mobileapps: apply 2476539 wikitext text/x-wiki ts79ldusikjdkjkr0ae4ib961xkdbe5 2476540 2476539 2026-11-03T01:17:01Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply 2476540 wikitext text/x-wiki sovqn394dws5nbhb4v45qri8i7xyk1q 2476541 2476540 2026-11-03T01:18:23Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/page-analytics: apply 2476541 wikitext text/x-wiki 69me2j3pm3i3ez1ka4bwes34585jtfd 2476542 2476541 2026-11-03T01:18:42Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/page-analytics: apply 2476542 wikitext text/x-wiki ljef8nh9o6i51ydxn0i5p33gjhs7me8 2476543 2476542 2026-11-03T01:18:51Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/proton: apply 2476543 wikitext text/x-wiki lwcobfqtyipr1pkvj2drat8wlrr8d1q 2476544 2476543 2026-11-03T01:20:03Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/proton: apply 2476544 wikitext text/x-wiki 9hleqitwolke3zypc4dxy8tctlbdxyt 2476545 2476544 2026-11-03T01:20:17Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/push-notifications: apply 2476545 wikitext text/x-wiki oetuussmgoqjp0zgbszvyefu81a5chv 2476546 2476545 2026-11-03T01:20:47Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/push-notifications: apply 2476546 wikitext text/x-wiki 0z9uvu939iuj5yl85bah0mrakmna6xm 2476547 2476546 2026-11-03T01:21:31Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/recommendation-api: apply 2476547 wikitext text/x-wiki 4fpogeikaei4y53lx06o9b7dkwkspfb 2476548 2476547 2026-11-03T01:21:56Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/recommendation-api: apply 2476548 wikitext text/x-wiki 09bqj4pscl1l6i98qoshj208khws7rn 2476549 2476548 2026-11-03T01:22:03Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/sessionstore: apply 2476549 wikitext text/x-wiki d2h3ielf5qea28e8uxtkpp6buxv1tb5 2476550 2476549 2026-11-03T01:22:19Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/sessionstore: apply 2476550 wikitext text/x-wiki q7bm62v2fg41gej7f8v5fbduz7qzkx5 2476551 2476550 2026-11-03T01:22:50Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/shellbox: apply 2476551 wikitext text/x-wiki j3inqybbf0cjqy9q46acugtyru4vqks 2476552 2476551 2026-11-03T01:23:18Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/shellbox: apply 2476552 wikitext text/x-wiki pjr25c3h6j09814r543da6p30gxy4ec 2476553 2476552 2026-11-03T01:23:26Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/shellbox-constraints: apply 2476553 wikitext text/x-wiki 00rlaa5mu48p32bgvfcal10ps09trwl 2476554 2476553 2026-11-03T01:24:00Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/shellbox-constraints: apply 2476554 wikitext text/x-wiki 6sy185ukeunuds4f8v7kxl8cst61vl1 2476555 2476554 2026-11-03T01:24:11Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/shellbox-media: apply 2476555 wikitext text/x-wiki tgs4jgbx32mubxfrue518gveq82i96c 2476556 2476555 2026-11-03T01:24:28Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/shellbox-media: apply 2476556 wikitext text/x-wiki rle1o5zdis9zuluzqihyg0gst3nf25i 2476557 2476556 2026-11-03T01:24:45Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/shellbox-timeline: apply 2476557 wikitext text/x-wiki mth6ofnrcrmz70mr7nthlzngrikk1e6 2476558 2476557 2026-11-03T01:25:06Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/shellbox-timeline: apply 2476558 wikitext text/x-wiki 15mym6bvpd2zil3cvxutedbpi7pq3q7 2476559 2476558 2026-11-03T01:25:13Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/shellbox-video: apply 2476559 wikitext text/x-wiki t3iawvl9s23agyyoh3jrwiitb2t2ifo 2476560 2476559 2026-11-03T01:25:44Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/shellbox-video: apply 2476560 wikitext text/x-wiki 499ppiptxu9z9qpqkcgjpdh4j8fw6zg 2476561 2476560 2026-11-03T01:25:49Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/tegola-vector-tiles: apply 2476561 wikitext text/x-wiki 8jisy26xgutooo5llmyjdlcuicedfr4 2476562 2476561 2026-11-03T01:26:25Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/tegola-vector-tiles: apply 2476562 wikitext text/x-wiki 0qbyoa9iu362we69c31ay96k9w2njdb 2476563 2476562 2026-11-03T01:26:32Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/termbox: apply 2476563 wikitext text/x-wiki l3sz9qel5fn388rv0i8mk4zlxvui3cc 2476564 2476563 2026-11-03T01:27:11Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/termbox: apply 2476564 wikitext text/x-wiki 7ni4in4ds52tdzstu37hkc56q763nro 2476565 2476564 2026-11-03T01:27:26Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/toolhub: apply 2476565 wikitext text/x-wiki i2okxtgff08hb9ujg1louoepqhs320g 2476566 2476565 2026-11-03T01:28:00Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/toolhub: apply 2476566 wikitext text/x-wiki 33htg7k2jmh9q08ghw84l9c8hzwczdr 2476567 2476566 2026-11-03T01:28:25Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/wikidata-query-gui: apply 2476567 wikitext text/x-wiki 92ixkl260owhxfe261dk2nof3c9gr9a 2476568 2476567 2026-11-03T01:28:48Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/wikidata-query-gui: apply 2476568 wikitext text/x-wiki 6dqer1muri2vhh8cttcpbsc0xmmdvtx 2476569 2476568 2026-11-03T01:28:53Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/wikifeeds: apply 2476569 wikitext text/x-wiki f2irmibsdv180lrar10qmwmcw4b54a9 2476570 2476569 2026-11-03T01:29:12Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/wikifeeds: apply 2476570 wikitext text/x-wiki hnnpaqm2wexi3yeutfqmpqbozmx3yx2 2476571 2476570 2026-11-03T01:29:35Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/wikifunctions: apply 2476571 wikitext text/x-wiki coax85jajyfjg3zo2r0nwh7ornbp33d 2476572 2476571 2026-11-03T01:30:13Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply 2476572 wikitext text/x-wiki fowzf0v67u08aq82e2eiz22a0rqm6ce 2476573 2476572 2026-11-03T01:30:21Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/zotero: apply 2476573 wikitext text/x-wiki 39j6zr8sdpmgf6xl4n423vo8exmf4oo 2476574 2476573 2026-11-03T01:30:45Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/zotero: apply 2476574 wikitext text/x-wiki o89qv0e7gcx32dxywhm6g3yw7iwa8d9 2476593 2476574 2026-11-03T04:16:18Z Stashbot 7414 krinkle@deploy2003: Started scap sync-world: Backport for [[gerrit:1311061|MathML+MathJax rollout to phase 6 (remaining large Wikipedias) (T271001)]] 2476593 wikitext text/x-wiki qkzlao2zylovtm8fslvk4am7pz23mpw 2476594 2476593 2026-11-03T04:24:25Z Stashbot 7414 krinkle@deploy2003: krinkle: Backport for [[gerrit:1311061|MathML+MathJax rollout to phase 6 (remaining large Wikipedias) (T271001)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2476594 wikitext text/x-wiki cm4s8i2xbbs3q9m4q906g6ijw4l3hz2 2476595 2476594 2026-11-03T04:33:05Z Stashbot 7414 krinkle@deploy2003: krinkle: Continuing with deployment 2476595 wikitext text/x-wiki hiwxwf87jtdpbvbr6k4pezj34waq3ng 2476596 2476595 2026-11-03T04:40:52Z Stashbot 7414 krinkle@deploy2003: Finished scap sync-world: Backport for [[gerrit:1311061|MathML+MathJax rollout to phase 6 (remaining large Wikipedias) (T271001)]] (duration: 24m 34s) 2476596 wikitext text/x-wiki 29m44ha0q3q096f7wgr5vvjciiali08 2476598 2476596 2026-11-03T05:02:29Z Stashbot 7414 mwpresync@deploy2003: Pruned MediaWiki: 1.47.0-wmf.23 (duration: 02m 26s) 2476598 wikitext text/x-wiki luk6mhgqszx5mwbk56az6a2ve6gyh6q 2476619 2476598 2026-11-03T08:13:33Z Stashbot 7414 denisse: incresing disk in arclamp2001 2476619 wikitext text/x-wiki kni8psrz3pvmcnvqoca36uvvuh7dgv3 2476620 2476619 2026-11-03T08:14:28Z Stashbot 7414 denisse: deleting stale .tmp logs from 2025 in arclamp2001 2476620 wikitext text/x-wiki rscrbhfqvor1sb586n36z9tg31dz90e 2476621 2476620 2026-11-03T08:24:30Z Stashbot 7414 denisse: increasing disk size in arclamp1001 2476621 wikitext text/x-wiki qvpqtm5plw5fs15f26w9s7kcec88ugx 2476626 2476621 2026-11-03T08:50:40Z Stashbot 7414 dpogorzelski@deploy2003: helmfile [ml-staging-codfw] START helmfile.d/admin 'apply'. 2476626 wikitext text/x-wiki it3uyqdo9mcefwoczuom8b6mrtyyefn 2476627 2476626 2026-11-03T08:50:45Z Stashbot 7414 dpogorzelski@deploy2003: helmfile [ml-staging-codfw] DONE helmfile.d/admin 'apply'. 2476627 wikitext text/x-wiki sitq29zvxumuww5zcmq89nl7dyxujmq 2476628 2476627 2026-11-03T08:58:59Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host urldownloader2004.wikimedia.org 2476628 wikitext text/x-wiki 59l4iu4adzkan5729fhtqf77dawo9w8 2476629 2476628 2026-11-03T09:02:35Z Stashbot 7414 Tran: Deployed patch for T441675 2476629 wikitext text/x-wiki s66z75m37v0r20ftznq7g9lv12jyang 2476630 2476629 2026-11-03T09:03:29Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host urldownloader2004.wikimedia.org 2476630 wikitext text/x-wiki hw627oawg19r0pjnmh9m1fujjv1cgws 2476632 2476630 2026-11-03T09:08:04Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host urldownloader2003.wikimedia.org 2476632 wikitext text/x-wiki cg5t347u1m284ijyarv5g9q3mfsvoiz 2476635 2476632 2026-11-03T09:12:03Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1188.eqiad.wmnet with reason: Maintenance 2476635 wikitext text/x-wiki qu4scjpabss3r85y3v07sy5bqohsbqr 2476636 2476635 2026-11-03T09:12:07Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db1188 (T441633)', diff saved to https://phabricator.wikimedia.org/P97093 and previous config saved to /var/cache/conftool/dbconfig/20261103-091203-ladsgroup.json 2476636 wikitext text/x-wiki 6shan2so0xrdff3ddectn0g8j5qqdk4 2476638 2476636 2026-11-03T09:12:35Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host urldownloader2003.wikimedia.org 2476638 wikitext text/x-wiki 8ziar5ljs2u5f4ilt1nw7fuyekerk8p 2476639 2476638 2026-11-03T09:18:19Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1188 (T441633)', diff saved to https://phabricator.wikimedia.org/P97094 and previous config saved to /var/cache/conftool/dbconfig/20261103-091816-ladsgroup.json 2476639 wikitext text/x-wiki besjaojuv1xal2v2y6j2hlnxi0f93uk 2476640 2476639 2026-11-03T09:21:18Z Stashbot 7414 dpogorzelski@deploy2003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'llm' . 2476640 wikitext text/x-wiki gv3gzlr2i5o56maj4li0dxhn67xuf3y 2476641 2476640 2026-11-03T09:28:21Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1188', diff saved to https://phabricator.wikimedia.org/P97095 and previous config saved to /var/cache/conftool/dbconfig/20261103-092818-ladsgroup.json 2476641 wikitext text/x-wiki iusz8wqn7wx084gu2gee47wm7vpawhm 2476642 2476641 2026-11-03T09:38:23Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1188', diff saved to https://phabricator.wikimedia.org/P97096 and previous config saved to /var/cache/conftool/dbconfig/20261103-093820-ladsgroup.json 2476642 wikitext text/x-wiki 25szb6fzgis0pih7dgqfe2ecjvcnred 2476643 2476642 2026-11-03T09:48:26Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1188 (T441633)', diff saved to https://phabricator.wikimedia.org/P97097 and previous config saved to /var/cache/conftool/dbconfig/20261103-094823-ladsgroup.json 2476643 wikitext text/x-wiki 8rvazl5syy8yttd7ybbxpr64qayic1r 2476644 2476643 2026-11-03T09:48:43Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1197.eqiad.wmnet with reason: Maintenance 2476644 wikitext text/x-wiki 6iw5vgbycybqw5fjc4yhhnaaohwin4g 2476645 2476644 2026-11-03T09:48:46Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db1197 (T441633)', diff saved to https://phabricator.wikimedia.org/P97098 and previous config saved to /var/cache/conftool/dbconfig/20261103-094843-ladsgroup.json 2476645 wikitext text/x-wiki sn2mslf9n98iypl49htiegtfqm99dyo 2476646 2476645 2026-11-03T09:57:18Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1197 (T441633)', diff saved to https://phabricator.wikimedia.org/P97099 and previous config saved to /var/cache/conftool/dbconfig/20261103-095715-ladsgroup.json 2476646 wikitext text/x-wiki 8zw3vh41vydnfzgfrrws64kd39e8rzq 2476648 2476646 2026-11-03T10:00:24Z Stashbot 7414 dpogorzelski@deploy2003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'llm' . 2476648 wikitext text/x-wiki sb8pwtjib873t7ffo7ytimx99pmseis 2476649 2476648 2026-11-03T10:04:35Z Stashbot 7414 dpogorzelski@deploy2003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'llm' . 2476649 wikitext text/x-wiki te7updfevbjy9rckgmcyq7f5b8rn2ee 2476650 2476649 2026-11-03T10:07:19Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1197', diff saved to https://phabricator.wikimedia.org/P97101 and previous config saved to /var/cache/conftool/dbconfig/20261103-100717-ladsgroup.json 2476650 wikitext text/x-wiki tki1th2s3m8rbedzzc7sccoqnkkm8lm 2476651 2476650 2026-11-03T10:15:51Z Stashbot 7414 moritzm: installing imagemagick security updates 2476651 wikitext text/x-wiki epl4n27g47ukn3jahzdwyuc6oeja2hi 2476652 2476651 2026-11-03T10:17:22Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1197', diff saved to https://phabricator.wikimedia.org/P97102 and previous config saved to /var/cache/conftool/dbconfig/20261103-101719-ladsgroup.json 2476652 wikitext text/x-wiki k1ynh8i0wiv7i3cfuszu9ydasai0wgm 2476653 2476652 2026-11-03T10:22:12Z Stashbot 7414 blake@deploy2003: helmfile [staging] START helmfile.d/services/changeprop: apply 2476653 wikitext text/x-wiki lz0ypvhzkvnzp5wmiguo3xjtbuuvmfy 2476654 2476653 2026-11-03T10:22:37Z Stashbot 7414 blake@deploy2003: helmfile [staging] DONE helmfile.d/services/changeprop: apply 2476654 wikitext text/x-wiki 1gaea6vs5l97atjalv2fms73ehcjcy2 2476655 2476654 2026-11-03T10:22:46Z Stashbot 7414 blake@deploy2003: helmfile [eqiad] START helmfile.d/services/changeprop: apply 2476655 wikitext text/x-wiki 1zkvygs9w68ovyx58uzsypt6f2dqis5 2476656 2476655 2026-11-03T10:22:52Z Stashbot 7414 urbanecm@deploy2003: mwscript-k8s job started: foreachwikiindblist mwscript.dblist GrowthExperiments:revalidateLinkRecommendations.php --olderThan=1790175600 --verbose # T438366 (dblist: https://phabricator.wikimedia.org/P97103) 2476656 wikitext text/x-wiki 0upbvxb09ex3yl7pjqrjfkw16msdwnb 2476657 2476656 2026-11-03T10:22:55Z Stashbot 7414 moritzm: installing git-lfs security updates 2476657 wikitext text/x-wiki tm5sy3whskd11lrn1q740869esio5m4 2476658 2476657 2026-11-03T10:23:06Z Stashbot 7414 urbanecm@deploy2003: mwscript-k8s job started: GrowthExperiments:revalidateLinkRecommendations.php --wiki=enwiki --olderThan=1790175600 --verbose # T438366 2476658 wikitext text/x-wiki pqayrcdzkqrwogr521s0fx79w1368yy 2476659 2476658 2026-11-03T10:23:20Z Stashbot 7414 blake@deploy2003: helmfile [eqiad] DONE helmfile.d/services/changeprop: apply 2476659 wikitext text/x-wiki dmr26wny8qz7zjji2jah3xs8ic6vhlm 2476660 2476659 2026-11-03T10:23:25Z Stashbot 7414 urbanecm@deploy2003: mwscript-k8s job started: GrowthExperiments:revalidateLinkRecommendations.php --wiki=frwiki --olderThan=1790175600 --verbose # T438366 2476660 wikitext text/x-wiki ppf6ije5w66750jkcp9divcgo4tzqli 2476661 2476660 2026-11-03T10:23:29Z Stashbot 7414 blake@deploy2003: helmfile [codfw] START helmfile.d/services/changeprop: apply 2476661 wikitext text/x-wiki ifqdj0jbdp7y525id48p4bj3e9une9t 2476662 2476661 2026-11-03T10:23:53Z Stashbot 7414 urbanecm@deploy2003: mwscript-k8s job started: GrowthExperiments:revalidateLinkRecommendations.php --wiki=itwiki --olderThan=1790175600 --verbose # T438366 2476662 wikitext text/x-wiki 1vy1xhlviwvk3hnc1j4okjx29suxpi9 2476663 2476662 2026-11-03T10:23:59Z Stashbot 7414 blake@deploy2003: helmfile [codfw] DONE helmfile.d/services/changeprop: apply 2476663 wikitext text/x-wiki 6keyfddze0ub8vxy76dq7hu7pl8ufx0 2476664 2476663 2026-11-03T10:27:24Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1197 (T441633)', diff saved to https://phabricator.wikimedia.org/P97104 and previous config saved to /var/cache/conftool/dbconfig/20261103-102721-ladsgroup.json 2476664 wikitext text/x-wiki 0zwwl38lp1w4cmvvsyubp2292a6f9l7 2476665 2476664 2026-11-03T10:27:42Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1222.eqiad.wmnet with reason: Maintenance 2476665 wikitext text/x-wiki 47qra2tow5vix1vmnaavidourphd6eh 2476666 2476665 2026-11-03T10:27:45Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db1222 (T441633)', diff saved to https://phabricator.wikimedia.org/P97105 and previous config saved to /var/cache/conftool/dbconfig/20261103-102742-ladsgroup.json 2476666 wikitext text/x-wiki dbl477tkzp3jo4ierocn4pko3ab9y0o 2476667 2476666 2026-11-03T10:27:50Z Stashbot 7414 dpogorzelski@deploy2003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'llm' . 2476667 wikitext text/x-wiki 96lx6g2q8o2c6j6z5jfeukqn2842hja 2476668 2476667 2026-11-03T10:29:23Z Stashbot 7414 dpogorzelski@deploy2003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'llm' . 2476668 wikitext text/x-wiki qv78bixtgnwstxaucxxpzu38f0xas6u 2476669 2476668 2026-11-03T10:29:50Z Stashbot 7414 dpogorzelski@deploy2003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'llm' . 2476669 wikitext text/x-wiki iy0222aybovx7bn50guxwof8il1xrox 2476670 2476669 2026-11-03T10:30:31Z Stashbot 7414 blake@deploy2003: helmfile [staging] START helmfile.d/services/changeprop-jobqueue: apply 2476670 wikitext text/x-wiki c5ozrzv6oc201v81e1i5n808v8y4t3d 2476671 2476670 2026-11-03T10:30:48Z Stashbot 7414 blake@deploy2003: helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: apply 2476671 wikitext text/x-wiki s3ytd189ybed50obkrsw8xz551ojvre 2476672 2476671 2026-11-03T10:31:00Z Stashbot 7414 urbanecm@deploy2003: mwscript-k8s job started: foreachwikiindblist mwscript.dblist GrowthExperiments:revalidateLinkRecommendations.php --olderThan=1790175600 --verbose # T438366 (dblist: https://phabricator.wikimedia.org/P97106) 2476672 wikitext text/x-wiki op7n97nn68ok5xg56u7mr6dbh58akk5 2476673 2476672 2026-11-03T10:31:10Z Stashbot 7414 blake@deploy2003: helmfile [eqiad] START helmfile.d/services/changeprop-jobqueue: apply 2476673 wikitext text/x-wiki c7grb23wco5ee0cedbqntquer63gzoz 2476674 2476673 2026-11-03T10:31:20Z Stashbot 7414 urbanecm@deploy2003: mwscript-k8s job started: GrowthExperiments:revalidateLinkRecommendations.php --wiki=eswiki --olderThan=1790175600 --verbose # T438366 2476674 wikitext text/x-wiki 74azqby84hj5qzr3ykiw3dp50tutgwd 2476675 2476674 2026-11-03T10:31:49Z Stashbot 7414 blake@deploy2003: helmfile [eqiad] DONE helmfile.d/services/changeprop-jobqueue: apply 2476675 wikitext text/x-wiki 5i249j2m4dazw2hb1lf8jzya21rnlph 2476676 2476675 2026-11-03T10:33:03Z Stashbot 7414 blake@deploy2003: helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply 2476676 wikitext text/x-wiki qlyp4yvct3wopkaiao0la7yhrjm3s6l 2476677 2476676 2026-11-03T10:33:50Z Stashbot 7414 blake@deploy2003: helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply 2476677 wikitext text/x-wiki rojhjibny5igaitl2t9bfdwybmuv0bb 2476678 2476677 2026-11-03T10:34:06Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1222 (T441633)', diff saved to https://phabricator.wikimedia.org/P97107 and previous config saved to /var/cache/conftool/dbconfig/20261103-103404-ladsgroup.json 2476678 wikitext text/x-wiki 0cpghoe4r6iiq9is7qr3sl057jtjs9v 2476679 2476678 2026-11-03T10:36:40Z Stashbot 7414 cwilliams@cumin1004: START - Cookbook sre.mysql.pool pool db1228: Repooling 2476679 wikitext text/x-wiki 0xh99i8b6a5fa5826applqpbtqavo1f 2476680 2476679 2026-11-03T10:42:30Z Stashbot 7414 ladsgroup@deploy2003: helmfile [staging] START helmfile.d/services/thumbor: apply 2476680 wikitext text/x-wiki 867wqdh5xocgjbtdt1us5wym21rn85q 2476681 2476680 2026-11-03T10:42:44Z Stashbot 7414 ladsgroup@deploy2003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2476681 wikitext text/x-wiki oke6nqd6ys307ogsbo7w24hd3wmggsw 2476683 2476681 2026-11-03T10:43:13Z Stashbot 7414 ladsgroup@deploy2003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2476683 wikitext text/x-wiki joxu2jzn1s557zitzvomgp83j7155x5 2476685 2476683 2026-11-03T10:44:08Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1222', diff saved to https://phabricator.wikimedia.org/P97109 and previous config saved to /var/cache/conftool/dbconfig/20261103-104406-ladsgroup.json 2476685 wikitext text/x-wiki exvihmdf5abk2gmr45k0d02ny6dfjrb 2476686 2476685 2026-11-03T10:46:55Z Stashbot 7414 ladsgroup@deploy2003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2476686 wikitext text/x-wiki rql0g082usn6crdfcc8wuwopn1hjwuy 2476688 2476686 2026-11-03T10:51:30Z Stashbot 7414 jmm@dns1004: START - running authdns-update 2476688 wikitext text/x-wiki bmucet8hd27w44pnpzvpj9ts74y9rno 2476689 2476688 2026-11-03T10:53:33Z Stashbot 7414 ladsgroup@deploy2003: helmfile [eqiad] START helmfile.d/services/thumbor: apply 2476689 wikitext text/x-wiki ohuefis3k730ziw0hxkhdexoisg0gr4 2476690 2476689 2026-11-03T10:53:44Z Stashbot 7414 jmm@dns1004: END - running authdns-update 2476690 wikitext text/x-wiki 8gcp5sojscax3va9lnpys09hoknbh34 2476691 2476690 2026-11-03T10:54:10Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1222', diff saved to https://phabricator.wikimedia.org/P97111 and previous config saved to /var/cache/conftool/dbconfig/20261103-105408-ladsgroup.json 2476691 wikitext text/x-wiki 4b4ux6r17ybwb5aq4tojo7bmj7ixh6s 2476692 2476691 2026-11-03T10:54:51Z Stashbot 7414 ladsgroup@deploy2003: helmfile [eqiad] DONE helmfile.d/services/thumbor: apply 2476692 wikitext text/x-wiki hvpb8xc5k2abaniuqx44f2lhg7lvoha 2476695 2476692 2026-11-03T11:04:13Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1222 (T441633)', diff saved to https://phabricator.wikimedia.org/P97112 and previous config saved to /var/cache/conftool/dbconfig/20261103-110410-ladsgroup.json 2476695 wikitext text/x-wiki 8phegy8i504wqqz7f7vrl3eqd5w996q 2476696 2476695 2026-11-03T11:04:31Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1225.eqiad.wmnet with reason: Maintenance 2476696 wikitext text/x-wiki edeb4wlrdww8m0ov6qsacmyzhvl7d1q 2476697 2476696 2026-11-03T11:09:45Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1229.eqiad.wmnet with reason: Maintenance 2476697 wikitext text/x-wiki hqialgkrxwqs7oth21uort1d1j35nfo 2476698 2476697 2026-11-03T11:09:49Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db1229 (T441633)', diff saved to https://phabricator.wikimedia.org/P97114 and previous config saved to /var/cache/conftool/dbconfig/20261103-110944-ladsgroup.json 2476698 wikitext text/x-wiki nvm9l0aqgimzdovnqrtx79ma9leksds 2476699 2476698 2026-11-03T11:12:39Z Stashbot 7414 moritzm: installing chromium security updates 2476699 wikitext text/x-wiki o6wpssms62ken18pkp05jah2ie6r84b 2476700 2476699 2026-11-03T11:15:45Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1229 (T441633)', diff saved to https://phabricator.wikimedia.org/P97115 and previous config saved to /var/cache/conftool/dbconfig/20261103-111542-ladsgroup.json 2476700 wikitext text/x-wiki 8l0glekixgzyb0dwnq5ute3y38d2uad 2476701 2476700 2026-11-03T11:21:52Z Stashbot 7414 cwilliams@cumin1004: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1228: Repooling 2476701 wikitext text/x-wiki 2mpct4xthlugsuk2z67j2ujzd1f0pbu 2476702 2476701 2026-11-03T11:25:47Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1229', diff saved to https://phabricator.wikimedia.org/P97117 and previous config saved to /var/cache/conftool/dbconfig/20261103-112544-ladsgroup.json 2476702 wikitext text/x-wiki 97yqasma3xaqeheqxgcpl39tyips4rg 2476705 2476702 2026-11-03T11:29:38Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.network.tls for network device lsw1-d6-eqiad 2476705 wikitext text/x-wiki nca7uici4c1gt1e13vn9ddajuistnfz 2476706 2476705 2026-11-03T11:30:34Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-d6-eqiad 2476706 wikitext text/x-wiki mir3z6ee3g1jz36mgxzbzphuixasabq 2476708 2476706 2026-11-03T11:35:49Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1229', diff saved to https://phabricator.wikimedia.org/P97118 and previous config saved to /var/cache/conftool/dbconfig/20261103-113546-ladsgroup.json 2476708 wikitext text/x-wiki py42zm9c94eldf0lersspp5kcabuczv 2476711 2476708 2026-11-03T11:45:51Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1229 (T441633)', diff saved to https://phabricator.wikimedia.org/P97119 and previous config saved to /var/cache/conftool/dbconfig/20261103-114548-ladsgroup.json 2476711 wikitext text/x-wiki 8wiykvxi4gq5ow8erat0rlbhmusys6f 2476712 2476711 2026-11-03T11:46:09Z Stashbot 7414 ladsgroup@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1233.eqiad.wmnet with reason: Maintenance 2476712 wikitext text/x-wiki bfrl175o4bdqamfar3eyhvdthoow8vl 2476713 2476712 2026-11-03T11:46:13Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Depooling db1233 (T441633)', diff saved to https://phabricator.wikimedia.org/P97120 and previous config saved to /var/cache/conftool/dbconfig/20261103-114609-ladsgroup.json 2476713 wikitext text/x-wiki 3tyovn9b9gwkk7wiajesey4jn6e15uv 2476714 2476713 2026-11-03T11:46:32Z Stashbot 7414 ladsgroup@deploy2003: Started scap sync-world: Backport for [[gerrit:1361850|Add --listfile to transcode maint scripts (T435744 T373546)]] (1.48.0-wmf.1) 2476714 wikitext text/x-wiki d580cuo73irlc1lunqqfk297yeyc9qf 2476715 2476714 2026-11-03T11:49:31Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.hosts.reimage for host sretest1006.eqiad.wmnet with OS trixie 2476715 wikitext text/x-wiki ly9rymvk4utmv26tjx43d41eg39pw2w 2476716 2476715 2026-11-03T11:50:25Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.hosts.dhcp for host sretest1006.eqiad.wmnet (push config only) 2476716 wikitext text/x-wiki 6789zocflsttz6oglkiyiheew0n1qpx 2476717 2476716 2026-11-03T11:50:29Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host sretest1006.eqiad.wmnet (push config only) 2476717 wikitext text/x-wiki 5knpib8pbyovbkcap5ma9eimddg28lu 2476718 2476717 2026-11-03T11:50:54Z Stashbot 7414 ladsgroup@deploy2003: ladsgroup: Backport for [[gerrit:1361850|Add --listfile to transcode maint scripts (T435744 T373546)]] (1.48.0-wmf.1) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2476718 wikitext text/x-wiki lo1fjfx2cmg6i0azvjwp2kr3nootw9l 2476719 2476718 2026-11-03T11:51:30Z Stashbot 7414 ladsgroup@deploy2003: ladsgroup: Continuing with deployment 2476719 wikitext text/x-wiki ia5u24p5ws0bhifeyydtwj8b5169oiz 2476720 2476719 2026-11-03T11:51:38Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.dns.netbox 2476720 wikitext text/x-wiki 6t31an96y236gl90ztmh7oiexyb8up0 2476721 2476720 2026-11-03T11:52:20Z Stashbot 7414 ladsgroup@cumin1004: dbctl commit (dc=all): 'Repooling after maintenance db1233 (T441633)', diff saved to https://phabricator.wikimedia.org/P97121 and previous config saved to /var/cache/conftool/dbconfig/20261103-115217-ladsgroup.json 2476721 wikitext text/x-wiki r6t9wjgik7ytocfkwe9du51ifxerigf 2476722 2476721 2026-11-03T11:56:18Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update entry for sretest1006 - cmooney@cumin1004" 2476722 wikitext text/x-wiki i6uao3z4utg2rpsfm9snnlfutdkzipr 2476723 2476722 2026-11-03T11:56:21Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update entry for sretest1006 - cmooney@cumin1004" 2476723 wikitext text/x-wiki o59rtig3vdzba6njj698c8azgzmzhz0 2476724 2476723 2026-11-03T11:56:24Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2476724 wikitext text/x-wiki 7ez0zgz5fbliwh0sialn2os0v82154f 2476725 2476724 2026-11-03T11:56:32Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.dns.wipe-cache sretest1006.eqiad.wmnet on all recursors 2476725 wikitext text/x-wiki 6kcx8kkcud0yjdsl5diz42bz828wrz5 2476726 2476725 2026-11-03T11:56:35Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) sretest1006.eqiad.wmnet on all recursors 2476726 wikitext text/x-wiki 0skq5e47vc1q878dgwkmsex5q1y1zzv 2476727 2476726 2026-11-03T11:57:30Z Stashbot 7414 ladsgroup@deploy2003: Finished scap sync-world: Backport for [[gerrit:1361850|Add --listfile to transcode maint scripts (T435744 T373546)]] (1.48.0-wmf.1) (duration: 10m 58s) 2476727 wikitext text/x-wiki ckck20lcbzfrfxwnya1vyec2mti1ooa 498 16087 2476291 2474354 2026-11-02T16:14:00Z Stashbot 7414 andrewbogott: temporarily switching proxy to bypass octavia load-balancer to see if that improves performance 2476291 wikitext text/x-wiki axesp2zxweyq6lxq7391zz73xfvpvus 2476296 2476291 2026-11-02T16:21:54Z Stashbot 7414 andrewbogott: reverting and switching proxy back to load-balancer 2476296 wikitext text/x-wiki onpbz5aqfu4v8bf3j5r2nwz7rz43kj1 2476305 2476296 2026-11-02T16:49:23Z Stashbot 7414 andrewbogott: increased worker count to 5 nodes 2476305 wikitext text/x-wiki 5md5rlx99zj0ln91lmpgaal27r37ilr 0 17290 2476365 2476013 2026-11-02T18:45:30Z Stashbot 7414 Southparkfan: Set set_min_part_hours to 6 for all Swift rings - T436476 2476365 wikitext text/x-wiki m8fvhr2omhfki28y4tyo39c0milixql 2476366 2476365 2026-11-02T18:45:54Z Stashbot 7414 Southparkfan: Remove deployment-ms-be07 and deployment-ms-be08 from all Swift rings - T436476 2476366 wikitext text/x-wiki dg0feakq0lk7kgq2rperid2hmyg11hy 2476468 2476366 2026-11-02T20:53:39Z Stashbot 7414 Southparkfan: Delete deployment-ms-be07 and deployment-ms-be08 - T436476 2476468 wikitext text/x-wiki r5rlw2hbv6owd3wn89czeqx71kbjdpt 498 79869 2476232 2272017 2026-11-02T14:21:16Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.delete_project for project petscan in eqiad1 (T443245) 2476232 wikitext text/x-wiki lvd8xpcmtw0r1oq8ahoo5cmaau8qutr 2476233 2476232 2026-11-02T14:21:20Z Stashbot 7414 taavi@cloudcumin1001: END (FAIL) - Cookbook wmcs.vps.delete_project (exit_code=99) for project petscan in eqiad1 (T443245) 2476233 wikitext text/x-wiki ov0si3atylena3leoanr7ov9vdsszyy 2476234 2476233 2026-11-02T14:22:01Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.remove_instance for instance petscan5 2476234 wikitext text/x-wiki dn36ih2bicppyhjp6lr9qw0k04cj33f 2476235 2476234 2026-11-02T14:22:13Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance petscan5 2476235 wikitext text/x-wiki mkenliskamxq4bi48gspmblmv8celqd 2476236 2476235 2026-11-02T14:22:20Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.delete_project for project petscan in eqiad1 (T443245) 2476236 wikitext text/x-wiki trg7rw9qpqjzwu24khg5yaa5rv23bax 2476237 2476236 2026-11-02T14:22:23Z Stashbot 7414 taavi@cloudcumin1001: END (FAIL) - Cookbook wmcs.vps.delete_project (exit_code=99) for project petscan in eqiad1 (T443245) 2476237 wikitext text/x-wiki ailv00ve23tdopm58uybpccrjcl379z 2476238 2476237 2026-11-02T14:23:26Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.delete_project for project petscan in eqiad1 (T443245) 2476238 wikitext text/x-wiki 64tevdewv4ugg5o1tkgdsq5z6y8hhmz 2476240 2476238 2026-11-02T14:24:58Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.delete_project (exit_code=0) for project petscan in eqiad1 (T443245) 2476240 wikitext text/x-wiki 6eg015sfdvbdayt4wcnqggnw57tsi78 8 144571 2476687 2471809 2026-11-03T10:47:58Z Taavi-WMF 41365 blank 2476687 wikitext text/x-wiki 6za6z27cqk2qatlebqsiz85czbjf3rd 498 443628 2476579 2475999 2026-11-03T01:46:50Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41561434850 (https://github.com/cluebotng/component-configs/commits/a1b96298b6a3498e8bb51b228a348b2fbd4eed06) 2476579 wikitext text/x-wiki j3qyi98mfyqkuy05l1o9xtz4teag3xc 2476584 2476579 2026-11-03T02:41:38Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41567216287 (https://github.com/cluebotng/component-configs/commits/baa95cf1e3a0b0c85cd8ee23d102608549c93e6d) 2476584 wikitext text/x-wiki l90yho816vfj6q7fca56aqw4obx0we3 2476602 2476584 2026-11-03T05:18:41Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41582696228 (https://github.com/cluebotng/component-configs/commits/085afd71093b712517702f3975ce1a3bea759e1e) 2476602 wikitext text/x-wiki cogzboxqgfi7a1u5xa9529byafh4sx0 2476613 2476602 2026-11-03T05:55:13Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41586147096 (https://github.com/cluebotng/component-configs/commits/6295be2043be15b64a1f5a2667c2f9f11b4194b5) 2476613 wikitext text/x-wiki cxyd8nwc3qd0uycs5lsgpm413xuimfo 2476615 2476613 2026-11-03T05:59:48Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41586264002 (https://github.com/cluebotng/component-configs/commits/95f7813d0a27c8f38f34ba200f066a34a2a41e0a) 2476615 wikitext text/x-wiki t49zbqnqjch7qfrkxahy1jz7g2x1cj9 2476625 2476615 2026-11-03T08:47:07Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41605215687 (https://github.com/cluebotng/component-configs/commits/874f44a0ab1b450c296132a9246bea96e0b7d25b) 2476625 wikitext text/x-wiki jj92okgjec3v1t6kdian4bvh2lxcj92 498 446211 2476609 2475904 2026-11-03T05:54:05Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41586264139 (https://github.com/cluebotng/component-configs/commits/95f7813d0a27c8f38f34ba200f066a34a2a41e0a) 2476609 wikitext text/x-wiki 87qdmmnt75rq6xvziblteopqxkz4vrq 0 448996 2476578 2435483 2026-11-03T01:46:48Z WFan (WMF) 38087 2476578 wikitext text/x-wiki g29aa5m4l2yau1ydgvnu3bwkqarczwm 0 449160 2476176 2476005 2026-11-02T12:34:30Z Dexbot 30554 Bot: Updating the report 2476176 wikitext text/x-wiki pu53lp0zyn3icrv7f4s77khstnvrtvk 2476490 2476176 2026-11-03T00:01:27Z Dexbot 30554 Bot: Updating the report 2476490 wikitext text/x-wiki 2dh4a3h6q2dwruw0k3pegjus7p06d2n 2476637 2476490 2026-11-03T09:12:32Z Dexbot 30554 Bot: Updating the report 2476637 wikitext text/x-wiki srlpq7mjw10xi5cyy0kjt4y54ahukfg 498 451228 2476306 2196530 2026-11-02T16:52:35Z Stashbot 7414 andrewbogott: shutting down VMs due to lack of admin response T435785 2476306 wikitext text/x-wiki 29fqtz2nqlag7cymu4525mbpdorac8x 498 452890 2476580 2475947 2026-11-03T01:47:21Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41561434964 (https://github.com/cluebotng/component-configs/commits/a1b96298b6a3498e8bb51b228a348b2fbd4eed06) 2476580 wikitext text/x-wiki lbtrohk3g5o0lvw8am8xf4sqdhr4qxu 2476585 2476580 2026-11-03T02:41:48Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41567216266 (https://github.com/cluebotng/component-configs/commits/baa95cf1e3a0b0c85cd8ee23d102608549c93e6d) 2476585 wikitext text/x-wiki 50xldsgg36okxox40g08ide2fuyer8y 2476605 2476585 2026-11-03T05:27:53Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41583533049 (https://github.com/cluebotng/component-configs/commits/417cde41c250a5f0b6f21e72ce00a343ad270295) 2476605 wikitext text/x-wiki oc0wnnr9ndp995yx4q71lsagshu36t3 2476614 2476605 2026-11-03T05:55:27Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41586147205 (https://github.com/cluebotng/component-configs/commits/6295be2043be15b64a1f5a2667c2f9f11b4194b5) 2476614 wikitext text/x-wiki ttttrfkep8c7scbyev3b0np4rkpegft 2476616 2476614 2026-11-03T06:00:54Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41586264177 (https://github.com/cluebotng/component-configs/commits/95f7813d0a27c8f38f34ba200f066a34a2a41e0a) 2476616 wikitext text/x-wiki a7f5c7ims42jtns5jiix3a30x1wmlzo 0 453468 2476256 2447988 2026-11-02T15:03:00Z ArielGlenn 11 /* API Platform Team */ add link to the page on mw.o for chore duty which is now under our team page there 2476256 wikitext text/x-wiki pabxdl5fxdneibte35zl89wezl9damf 498 454772 2476307 2196888 2026-11-02T16:54:03Z Stashbot 7414 andrewbogott: shutting down VMs due to lack of admin response T435759 2476307 wikitext text/x-wiki dc1xojkr0wy9rkzqk07n1rr0m7z71ls 0 457955 2476218 2475936 2026-11-02T13:55:39Z LSobanski (WMF) 18783 /* Prerequisites */ Removed Yubikey 4 as it doesn't support ed25519-sk 2476218 wikitext text/x-wiki 3qpmyc7x3dsl6kiyjogx6h77oe4qil7 2476302 2476218 2026-11-02T16:34:37Z MPopov (WMF) 5891 /* Additional instructions for macOS */ Homebrew PATH fix 2476302 wikitext text/x-wiki 9aqzohhu10l7ayeoekcv2339gnj9agc 0 457961 2476707 2475511 2026-11-03T11:32:42Z HNowlan (WMF) 15760 /* Service management */ 2476707 wikitext text/x-wiki sudzqskc3lweod9g86eilnkhkokf15x 2476709 2476707 2026-11-03T11:36:36Z HNowlan (WMF) 15760 /* Deployment */ contradiction in terms 2476709 wikitext text/x-wiki l2k16narv27b1mb1a87xf1fy5iakiph 498 458783 2476476 2464156 2026-11-02T22:01:24Z BryanDavis 1604 /* Varnish rule unblock */ unmarkdownify 2476476 wikitext text/x-wiki nuc5n7llnoiv6vfyoksc44xyz5vwbo7 498 458787 2476583 2475998 2026-11-03T02:40:51Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41567216275 (https://github.com/cluebotng/component-configs/commits/baa95cf1e3a0b0c85cd8ee23d102608549c93e6d) 2476583 wikitext text/x-wiki pasqfmz02lufzdc2qmpsvex1q4qx2vv 2476601 2476583 2026-11-03T05:18:14Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41582696321 (https://github.com/cluebotng/component-configs/commits/085afd71093b712517702f3975ce1a3bea759e1e) 2476601 wikitext text/x-wiki knrcx8ycs1ntyb3gbztkjwwd2edthco 2476611 2476601 2026-11-03T05:54:16Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41586264114 (https://github.com/cluebotng/component-configs/commits/95f7813d0a27c8f38f34ba200f066a34a2a41e0a) 2476611 wikitext text/x-wiki 25191d4hnhmuoogq0j3hfl76nz12kz4 2476624 2476611 2026-11-03T08:45:40Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41605215680 (https://github.com/cluebotng/component-configs/commits/874f44a0ab1b450c296132a9246bea96e0b7d25b) 2476624 wikitext text/x-wiki 3xlotrrr1jnh9yzzp1alezc7y66cnj7 498 459243 2476586 2475952 2026-11-03T03:13:23Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41570372141 (https://github.com/cluebotng/component-configs/commits/9e06eef94c362f2813b0a34a82356b7d503c3f4f) 2476586 wikitext text/x-wiki 4c8npdhjtz64whcts739s1x8t1woqyj 2476599 2476586 2026-11-03T05:09:23Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41581755584 (https://github.com/cluebotng/component-configs/commits/ad0a4ebfac738d2c3b772e79b296d5c00c79c38e) 2476599 wikitext text/x-wiki 0461tz2a0sjqpfqpmdx67fgznaxykh0 2476600 2476599 2026-11-03T05:13:22Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41582112461 (https://github.com/cluebotng/component-configs/commits/753eb7b9e738029a5443693413aff58e1d3fa349) 2476600 wikitext text/x-wiki 8njbj9pg8og46ftxuhpbykxmb51r15r 2476612 2476600 2026-11-03T05:54:56Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41586264099 (https://github.com/cluebotng/component-configs/commits/95f7813d0a27c8f38f34ba200f066a34a2a41e0a) 2476612 wikitext text/x-wiki i9f0kao2nkubrc82r0wc2gb9dto8yyk 2476617 2476612 2026-11-03T06:31:41Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41590047860 (https://github.com/cluebotng/component-configs/commits/b727998497e3e9aad0bbeead0c3ab4000f61584c) 2476617 wikitext text/x-wiki 57hfb70djqjdpb4m07a24asiex0u1uq 2476618 2476617 2026-11-03T06:35:54Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41590277348 (https://github.com/cluebotng/component-configs/commits/be302650e64737354887b8a0d3765c836f16937f) 2476618 wikitext text/x-wiki t6l30tloz0fxcojjznoigta1dt5paqz 2476693 2476618 2026-11-03T10:55:00Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41622611776 (https://github.com/cluebotng/component-configs/commits/5393f63d09ee5ee78540551dbd2532edbb754bdd) 2476693 wikitext text/x-wiki l6nl5eco7xlk5pbjrnagxuvcpjkeobg 498 459244 2476577 2475907 2026-11-03T01:46:23Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41561434982 (https://github.com/cluebotng/component-configs/commits/a1b96298b6a3498e8bb51b228a348b2fbd4eed06) 2476577 wikitext text/x-wiki g5nx95zjjk6dmpcn1d78t66deoz19rr 2476582 2476577 2026-11-03T02:40:30Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41567113718 (https://github.com/cluebotng/component-configs/commits/10880256092163e5d6d4d97b1d2a0453e51c1f2c) 2476582 wikitext text/x-wiki qxkryi4l01awh8y76qinfr08vhunmu0 2476607 2476582 2026-11-03T05:51:42Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/41586263970 (https://github.com/cluebotng/component-configs/commits/95f7813d0a27c8f38f34ba200f066a34a2a41e0a) 2476607 wikitext text/x-wiki gff4l1av0bqajumawfja9u1f29yef8d 498 459255 2476610 2475905 2026-11-03T05:54:14Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41586264050 (https://github.com/cluebotng/component-configs/commits/95f7813d0a27c8f38f34ba200f066a34a2a41e0a) 2476610 wikitext text/x-wiki 1frhd061szsx72hdt91q0uu3kndphmv 498 459263 2476606 2475951 2026-11-03T05:51:41Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/41586264061 (https://github.com/cluebotng/component-configs/commits/95f7813d0a27c8f38f34ba200f066a34a2a41e0a) 2476606 wikitext text/x-wiki leg83pei26h86cl6pb4i1f6efphe29f 498 459362 2476608 2475906 2026-11-03T05:54:01Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/41586264019 (https://github.com/cluebotng/component-configs/commits/95f7813d0a27c8f38f34ba200f066a34a2a41e0a) 2476608 wikitext text/x-wiki 8scr835hz05mt6x1ngj09exs0cjtctr 0 459699 2476292 2475599 2026-11-02T16:15:08Z Stashbot 7414 larssandergreen: civicrm upgraded from 5d2a3573 to 4c384232 2476292 wikitext text/x-wiki 39gorni4h1dotizkm787cerd24ptk7b 2476480 2476292 2026-11-02T22:14:30Z Stashbot 7414 eileen: civicrm upgraded from 4c384232 to a65615a7 2476480 wikitext text/x-wiki br01ip4te81174n9kiiil2gre5445xf 2476587 2476480 2026-11-03T03:26:52Z Stashbot 7414 eileen: config revision changed from 8c06da7a to 8c3f56d7 2476587 wikitext text/x-wiki 6ffyojscvyu64yybvnddfqbjxg3vphn 2476588 2476587 2026-11-03T03:27:31Z Stashbot 7414 eileen: * civicrm upgraded from a65615a7 to 6212f766 2476588 wikitext text/x-wiki n0wzu6y9japrrh1az498yegj3xdpv1b 2476591 2476588 2026-11-03T03:44:40Z Stashbot 7414 eileen: config revision changed from 8c3f56d7 to 82cd7215 2476591 wikitext text/x-wiki k7woxebgt2bfu0twkrt63iwhmc4qmg2 0 459901 2476250 2449682 2026-11-02T14:38:32Z JMeybohm (WMF) 16709 2476250 wikitext text/x-wiki 7ly6jg1ss558i6evc3vt4xb67ift1c7 2 460230 2476623 2458923 2026-11-03T08:39:01Z SLyngshede-WMF 31501 /* Checking node health and status */ Fix upload test 2476623 wikitext text/x-wiki pwtj2owdwcqzcxfs3pb7p1n5ojot7l6 0 460417 2476647 2474087 2026-11-03T10:00:14Z OKarakaya-WMF 40765 adding llm-batch. 2476647 wikitext text/x-wiki 7wy9eab8ytw1g56sqayql2lufd8aidt 2 460427 2476249 2462805 2026-11-02T14:37:42Z ArielGlenn 11 /* Grafana */ add changeprop dashboard to the mix 2476249 wikitext text/x-wiki 40yx0ootwu5xrel229fkove2drd5fae 0 460559 2476332 2449811 2026-11-02T17:49:55Z AStein-WMF 39485 2476332 wikitext text/x-wiki fhxvzs0ya26tzppll0d53mvp106mlxj 2476339 2476332 2026-11-02T17:54:01Z AStein-WMF 39485 2476339 wikitext text/x-wiki 0jhlxpcr8bko937i2qmd9utn6z9y6kn 2476342 2476339 2026-11-02T18:00:19Z AStein-WMF 39485 2476342 wikitext text/x-wiki sf29sx9b4rsnn70zd0p0t8bzo3nndbr 0 460627 2476288 2475940 2026-11-02T16:09:11Z AKhatun (WMF) 50461 /* Schema */ Add all featuers in schema for clarity 2476288 wikitext text/x-wiki gw5u6vhbpsg6ks61kn9v90g2hj0myud 2476289 2476288 2026-11-02T16:09:59Z AKhatun (WMF) 50461 /* Schema */ 2476289 wikitext text/x-wiki ch0mxp0hxdajkxkvi3stwjoybfkc9ig 2476491 2476289 2026-11-03T00:03:36Z AKhatun (WMF) 50461 /* Roll Out */ 2476491 wikitext text/x-wiki 8exzk7td476o0l2s0pdif07m9heqezo 0 460791 2476622 2474384 2026-11-03T08:29:45Z Nemo bis 139 /* Summary */ clarify 2476622 wikitext text/x-wiki p3lzd16kqww0g73ednty5fck9y3wiau 0 460907 2476479 2475376 2026-11-02T22:13:13Z Wargo 15859 /* Notes */ correct link 2476479 wikitext text/x-wiki 9d4ffmsmxkfk3x5soj8yugkw6zxamiu 0 460914 2476227 2475787 2026-11-02T14:07:05Z GModena (WMF) 20194 2476227 wikitext text/x-wiki 4dhxco48byztudkhkejp3kyrjgpxw0s 0 460923 2476149 2026-11-02T12:22:16Z Seddon (WMF) 39161 Created page with "{{SCROLL/Tools/Banner|requested}} <templatestyles src="User:Effie_Mouzeli_(WMF)/SCROLL/styles.css" /> ''Service Checklist for Readiness, Operations, Launch and Lifecycle'' {{Draft}} __TOC__ {| style="width: 100%; border: none; background: transparent;" | style="vertical-align: top; width: 38%; padding-right: 2%;" | {| class="wikitable" style="font-size: 90%; width: 100%; border: 1px solid #a2a9b1;" |- ! colspan="2" class="scroll-card-header" | 📜 Service/Component..." 2476149 wikitext text/x-wiki o6jqumjqfgiaeapcar2p2qaisyc7fao 3 460924 2476419 2026-11-02T19:49:12Z StrikerBot 8475 Welcome to Toolforge! 2476419 wikitext text/x-wiki 8t1j28vjp0p2lcxy2apdtq8n5iqh5ow 3 460925 2476423 2026-11-02T19:51:56Z StrikerBot 8475 Welcome to Toolforge! 2476423 wikitext text/x-wiki 7mdujjkim5f3nhk43ls6v995svb65wb 3 460926 2476429 2026-11-02T19:52:51Z StrikerBot 8475 Welcome to Toolforge! 2476429 wikitext text/x-wiki cnfdlj2e3vc69azb20gmb8sdhn8ld0z 3 460927 2476443 2026-11-02T19:56:22Z StrikerBot 8475 Welcome to Toolforge! 2476443 wikitext text/x-wiki 289ut55lr3v185o8cswr1ldb8hgzwvg 2 460928 2476575 2026-11-03T01:43:27Z BCornwall-WMF 31521 Created page with "This proposal is for automatic execution of cookbooks for upgrading/rebooting systems. As an example, the following would be run at the schedules listed below on cp nodes (text and upload in parallel): <pre> # cookbook sre.cdn.roll-reboot --alias cp-<site>_text -b 1 --grace-sleep 3600 -p 100 # cookbook sre.cdn.roll-reboot --alias cp-<site>_upload -b 1 --grace-sleep 3600 -p 100 </pre> This scheduling would be created via a new profile: <code>profile::cookbooks::schedule..." 2476575 wikitext text/x-wiki drvgs4s0kq42o21sswlb6dp62uc7ey3 2476576 2476575 2026-11-03T01:44:55Z BCornwall-WMF 31521 /* Automated reboots */ 2476576 wikitext text/x-wiki femvzat2u3x6o02tdenittbspmbnilp 2476581 2476576 2026-11-03T01:53:28Z BCornwall-WMF 31521 /* Automated reboots */ 2476581 wikitext text/x-wiki l64z7fp695plgzbmaj0tco2x6kd5rqz 3 460929 2476592 2026-11-03T03:51:10Z Koavf 1382 /* Welcome */ new section 2476592 wikitext text/x-wiki luzylcd919pygn8yj5rc9hdfkcp3qv8 3 460930 2476710 2026-11-03T11:39:21Z StrikerBot 8475 Welcome to Toolforge! 2476710 wikitext text/x-wiki thbo9pj0o8cea3q4zuzhmhysi12atfa