Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.10 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 1516 2435202 2426889 2026-07-09T23:25:50Z Stashbot 7414 AntiComposite: restart all CVNBots 2435202 wikitext text/x-wiki hlo2s3h8b78novmjpvrt511q3hbxueo 498 3086 2434935 2434916 2026-07-09T12:14:27Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component jobs-api 2434935 wikitext text/x-wiki 6018op4epaoxdjsk9vpilsdo98l5rxy 2434946 2434935 2026-07-09T12:31:17Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api 2434946 wikitext text/x-wiki 8q1kwv9b5iwl0hg7c663jk3gqvaz8g5 2434958 2434946 2026-07-09T12:53:42Z Stashbot 7414 taavi@cloudcumin1001: END (ERROR) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=97) for all nodes 2434958 wikitext text/x-wiki 3x3k7eujnlwkixlxb6pb91uyh9ixku1 2434959 2434958 2026-07-09T12:53:46Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.reboot for all nodes 2434959 wikitext text/x-wiki jliby9lq2vkm9ik68hx4mwvup55ga9i 2435094 2434959 2026-07-09T17:59:30Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for all nodes 2435094 wikitext text/x-wiki 56vpemnxyfm5xa1t6qnxbkqkqioxio5 0 4108 2434970 2434875 2026-07-09T13:18:22Z Jdforrester (WMF) 468 /* {{Deployment_day|date=2026-07-09}} */ One done. 2434970 wikitext text/x-wiki j28hs70pyi2kjxga8oefq22ni51y651 2435188 2434970 2026-07-09T22:16:58Z ScheduleDeploymentBot 37566 Add [[gerrit:1309302]] to Monday, July 13 UTC afternoon backport window 2435188 wikitext text/x-wiki 4st87txc46jhvth9ktefam1r4k9d1a0 2435242 2435188 2026-07-10T07:23:36Z ScheduleDeploymentBot 37566 Add [[gerrit:1309552]] to Monday, July 13 UTC morning backport window 2435242 wikitext text/x-wiki kj2hl7ycul9a08403rozcxwwsb8e8c2 2435250 2435242 2026-07-10T07:54:23Z Msz2001 16141 /* {{Deployment_day|date=2026-07-13}} */ 2435250 wikitext text/x-wiki bnmyche8ehochmbhn1q4vv9ewx885xm 498 6726 2434925 2434919 2026-07-09T11:59:21Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component jobs-api 2434925 wikitext text/x-wiki 2yyipo3etzrzip7139b4qprkye409gj 2434934 2434925 2026-07-09T12:11:13Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api 2434934 wikitext text/x-wiki czkqldtwwhid7rpr5snt4o6hqzokhvz 0 7518 2435157 1919934 2026-07-09T21:32:57Z BryanDavis 1604 /* Maintainer */ interwiki to phab 2435157 wikitext text/x-wiki k1i95jelh2gfjbmr4ycrgg8xc4hl2jf 2435158 2435157 2026-07-09T21:34:45Z BryanDavis 1604 override ptag inherited from nav template 2435158 wikitext text/x-wiki sg4rp2cecxpv2aoq8353eygkfjmlrbw 0 7919 2434926 2434924 2026-07-09T12:02:13Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host irc1003.wikimedia.org 2434926 wikitext text/x-wiki fb5cw2c0oyt2fcmg4tgejste37134wx 2434927 2434926 2026-07-09T12:02:36Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host failoid2003.codfw.wmnet 2434927 wikitext text/x-wiki no007qysqspd3qhr0hyf5i8kflo9wxo 2434928 2434927 2026-07-09T12:03:40Z Stashbot 7414 jynus@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on backup[1003,1014].eqiad.wmnet with reason: reboot & upgrade 2434928 wikitext text/x-wiki tsbijurfrl3f3dvusqij93vih5whssr 2434929 2434928 2026-07-09T12:05:50Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host failoid1003.eqiad.wmnet 2434929 wikitext text/x-wiki 2ilrwzbdmpoo1vx0ciru2tl3ambeegc 2434930 2434929 2026-07-09T12:06:09Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host apt-staging2001.codfw.wmnet 2434930 wikitext text/x-wiki 37fqezd0snev1ptw0x2qivy2jq2tffx 2434931 2434930 2026-07-09T12:09:41Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host failoid1003.eqiad.wmnet 2434931 wikitext text/x-wiki soypd4anvjjvgt155aoq47rq838h1v9 2434932 2434931 2026-07-09T12:10:11Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host apt-staging2001.codfw.wmnet 2434932 wikitext text/x-wiki 1znqh74074nq1o64cwuhbokeco47n03 2434933 2434932 2026-07-09T12:10:49Z Stashbot 7414 jynus@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on backup[2003,2014].codfw.wmnet with reason: reboot & upgrade 2434933 wikitext text/x-wiki k2u1as76c562c1qe9c32w1swfdym3cl 2434936 2434933 2026-07-09T12:14:36Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host bast7002.wikimedia.org 2434936 wikitext text/x-wiki ljdewmb99sseaz76fj4gc6g1ykglsla 2434937 2434936 2026-07-09T12:14:59Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host apt2002.wikimedia.org 2434937 wikitext text/x-wiki pv2zumys70lhc2o0cdjjl5pxikhb6sk 2434938 2434937 2026-07-09T12:18:17Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.network.host-bgp for host ml-serve1004 2434938 wikitext text/x-wiki 878p7241f2p87p61d758wt4zpatw9cv 2434939 2434938 2026-07-09T12:18:26Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.network.host-bgp (exit_code=0) for host ml-serve1004 2434939 wikitext text/x-wiki fsnbgk0j7yydgslnazeo118csyc18xu 2434940 2434939 2026-07-09T12:18:34Z Stashbot 7414 bwojtowicz@deploy2003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2434940 wikitext text/x-wiki jpw8igxmzr0gdvhzmwmv4xvq2bpa8a8 2434941 2434940 2026-07-09T12:18:37Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host bast4006.wikimedia.org 2434941 wikitext text/x-wiki nyjdfg7x3utlb2o5ajwivb6cuu8piqu 2434942 2434941 2026-07-09T12:20:22Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host bast7002.wikimedia.org 2434942 wikitext text/x-wiki k4pgjm6av32kdkg24pb4aacgqy9pnxs 2434943 2434942 2026-07-09T12:20:50Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host apt2002.wikimedia.org 2434943 wikitext text/x-wiki 2vncd8kopck948z8k1h5h7064b7k284 2434944 2434943 2026-07-09T12:24:19Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host bast4006.wikimedia.org 2434944 wikitext text/x-wiki 0zwa3h3kybo685klyonnp8qgr3mboc7 2434951 2434944 2026-07-09T12:42:42Z Stashbot 7414 kevinbazira@deploy2003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . 2434951 wikitext text/x-wiki 3t2d3daet8vyzwlznm4y0plbu844g1q 2434952 2434951 2026-07-09T12:43:44Z Stashbot 7414 cgoubert@deploy2003: helmfile [staging] START helmfile.d/services/mobileapps: apply 2434952 wikitext text/x-wiki 0ed8o3juevramlrgh8eiy8h61xidlnm 2434953 2434952 2026-07-09T12:43:59Z Stashbot 7414 cgoubert@deploy2003: helmfile [staging] DONE helmfile.d/services/mobileapps: apply 2434953 wikitext text/x-wiki m1nckj5zz4v8m3rxgjierh8p6snivkw 2434954 2434953 2026-07-09T12:44:31Z Stashbot 7414 cgoubert@deploy2003: helmfile [codfw] START helmfile.d/services/mobileapps: apply 2434954 wikitext text/x-wiki 8ew9qmk8m75rmgm38la50au0m1c1eek 2434955 2434954 2026-07-09T12:44:40Z Stashbot 7414 bwojtowicz@deploy2003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'llm' for release 'main' . 2434955 wikitext text/x-wiki 6tkmb4wdx9blukg7xmldgukxp7i6exq 2434956 2434955 2026-07-09T12:45:42Z Stashbot 7414 cgoubert@deploy2003: helmfile [codfw] DONE helmfile.d/services/mobileapps: apply 2434956 wikitext text/x-wiki j50qoo9p75g2t4japdwkgd85zduwuug 2434957 2434956 2026-07-09T12:52:39Z Stashbot 7414 cgoubert@deploy2003: helmfile [eqiad] START helmfile.d/services/mobileapps: apply 2434957 wikitext text/x-wiki 6ujh0uko0y1z8lvn6ch56egh8xnq9a3 2434961 2434957 2026-07-09T12:54:12Z Stashbot 7414 bwojtowicz@deploy2003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2434961 wikitext text/x-wiki nyc5c4gr7ko3zsfuo6pkzzbop5khmj3 2434963 2434961 2026-07-09T12:54:21Z Stashbot 7414 cgoubert@deploy2003: helmfile [eqiad] DONE helmfile.d/services/mobileapps: apply 2434963 wikitext text/x-wiki 7wkgh2cb3626x8cams32ie9yg3q7xek 2434965 2434963 2026-07-09T13:06:21Z Stashbot 7414 jforrester@deploy2003: Started scap sync-world: Backport for [[gerrit:1309112|abstractwiki: Don't run our jobs too quickly, they'll collide and error (T430898)]] 2434965 wikitext text/x-wiki fd8ui81j1ziy30blvnl3p29y46zjut8 2434967 2434965 2026-07-09T13:08:04Z Stashbot 7414 jforrester@deploy2003: jforrester: Backport for [[gerrit:1309112|abstractwiki: Don't run our jobs too quickly, they'll collide and error (T430898)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2434967 wikitext text/x-wiki tmmj705kchceg3grup3bcdfp48hu1zs 2434968 2434967 2026-07-09T13:13:26Z Stashbot 7414 jforrester@deploy2003: jforrester: Continuing with deployment 2434968 wikitext text/x-wiki 8kyfxws1d7ep03cpwrukr7nwtbs13hq 2434969 2434968 2026-07-09T13:17:47Z Stashbot 7414 jforrester@deploy2003: Finished scap sync-world: Backport for [[gerrit:1309112|abstractwiki: Don't run our jobs too quickly, they'll collide and error (T430898)]] (duration: 11m 26s) 2434969 wikitext text/x-wiki h3df20q79udibrhldsv4e56ilbx5l16 2434971 2434969 2026-07-09T13:29:44Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker1052.eqiad.wmnet 2434971 wikitext text/x-wiki 84rmfp7px5uro71o1vef92b0ywg0ru9 2434972 2434971 2026-07-09T13:29:48Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1052.eqiad.wmnet 2434972 wikitext text/x-wiki 4z817krpoqy58lshnk21djqp2s5eokd 2434975 2434972 2026-07-09T13:30:23Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1052.eqiad.wmnet 2434975 wikitext text/x-wiki pfmxdhfvp71ycf70n44jii4k0pgvtp1 2434976 2434975 2026-07-09T13:30:47Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.hosts.reimage for host wikikube-worker1052.eqiad.wmnet with OS trixie 2434976 wikitext text/x-wiki kpt4th9rn0rufb9hi1wqyxmurgh3nup 2434977 2434976 2026-07-09T13:31:03Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.hosts.move-vlan for host wikikube-worker1052 2434977 wikitext text/x-wiki 5rcvu4xdx2oufru9r8uwp155o61b0ck 2434978 2434977 2026-07-09T13:31:15Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.dns.netbox 2434978 wikitext text/x-wiki gkkmhqa67b17m63vxkajw2dc0wmpe6n 2434979 2434978 2026-07-09T13:34:01Z Stashbot 7414 mszwarc@deploy2003: Started scap sync-world: Backport for [[gerrit:1309101|Fix UserEditTracker spoiling ActorStore cache for cross-wiki lookups (T431176)]], [[gerrit:1309122|SuggestedInvestigations: Instrument link clicks in the cases table (T429320)]] 2434979 wikitext text/x-wiki mv2dan1y2bwrrbw4ndozkqfds008lk1 2434981 2434979 2026-07-09T13:35:26Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1052 - blake@cumin1003" 2434981 wikitext text/x-wiki bbcyumjhmhwflzeol8ia1z0ad7x1j7c 2434982 2434981 2026-07-09T13:35:31Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1052 - blake@cumin1003" 2434982 wikitext text/x-wiki 7te6fvihkbufv43s2z7s7ss0amhcvt3 2434983 2434982 2026-07-09T13:35:32Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2434983 wikitext text/x-wiki 4fh4t4m7xcldysadbexv8iyxhdr8y22 2434984 2434983 2026-07-09T13:35:33Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.dns.wipe-cache wikikube-worker1052.eqiad.wmnet 47.32.64.10.in-addr.arpa 7.4.0.0.2.3.0.0.4.6.0.0.0.1.0.0.3.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2434984 wikitext text/x-wiki qp16zq2fdcdeivg6rnk34n36jw2fwbs 2434985 2434984 2026-07-09T13:35:35Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker1052.eqiad.wmnet 47.32.64.10.in-addr.arpa 7.4.0.0.2.3.0.0.4.6.0.0.0.1.0.0.3.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2434985 wikitext text/x-wiki 5isxnnbwdxcl4i73ljcuwxgs0y76lzg 2434986 2434985 2026-07-09T13:35:36Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1052 2434986 wikitext text/x-wiki t6z6c3sbacalulyvgpgygnvv17jc85h 2434987 2434986 2026-07-09T13:35:44Z Stashbot 7414 mszwarc@deploy2003: mszwarc: Backport for [[gerrit:1309101|Fix UserEditTracker spoiling ActorStore cache for cross-wiki lookups (T431176)]], [[gerrit:1309122|SuggestedInvestigations: Instrument link clicks in the cases table (T429320)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2434987 wikitext text/x-wiki b545lnh2ugvzb78vd8odq1idponimle 2434988 2434987 2026-07-09T13:36:10Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1052 2434988 wikitext text/x-wiki fstwka2xhd08zugftghwe6lpxpnfdv7 2434989 2434988 2026-07-09T13:36:11Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1052 2434989 wikitext text/x-wiki botfougst3sohm34dynwrvaz7mtwq1e 2434990 2434989 2026-07-09T13:37:12Z Stashbot 7414 mszwarc@deploy2003: mszwarc: Continuing with deployment 2434990 wikitext text/x-wiki 9xxo4ejjjqsub27m8g4u8olzfqnibhe 2434992 2434990 2026-07-09T13:41:11Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host apt1002.wikimedia.org 2434992 wikitext text/x-wiki cd24qmkwmhs2gr6bn0szrecssnnwi88 2434993 2434992 2026-07-09T13:41:31Z Stashbot 7414 mszwarc@deploy2003: Finished scap sync-world: Backport for [[gerrit:1309101|Fix UserEditTracker spoiling ActorStore cache for cross-wiki lookups (T431176)]], [[gerrit:1309122|SuggestedInvestigations: Instrument link clicks in the cases table (T429320)]] (duration: 07m 30s) 2434993 wikitext text/x-wiki g9xti9xgpb1vxwhv9uqot9gokz3c99m 2434994 2434993 2026-07-09T13:41:55Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host apt1002.wikimedia.org 2434994 wikitext text/x-wiki dks11eikipiw7zylfuvtz0oorliggi8 2434996 2434994 2026-07-09T13:43:30Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/pageview-trending-relative-next: apply 2434996 wikitext text/x-wiki 2stsm39q0a2lpqt7y38x0o6e1d9gl21 2434997 2434996 2026-07-09T13:43:41Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/pageview-trending-relative-next: apply 2434997 wikitext text/x-wiki sgf82lrxwmdcr8679h5pws8tcpna2kf 2434998 2434997 2026-07-09T13:43:52Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host netboxdb2003.codfw.wmnet 2434998 wikitext text/x-wiki 0516wnaxyh4sgmse6mxxatmh2pqwt45 2434999 2434998 2026-07-09T13:44:03Z Stashbot 7414 Msz2001: Updated `logging` on `metawiki` to fix log performers, T431176#12105297 2434999 wikitext text/x-wiki 8zszmcibrm9m4zwsob7u7q5z0aqqipc 2435000 2434999 2026-07-09T13:44:22Z Stashbot 7414 Msz2001: UTC afternoon config+backport window is done 2435000 wikitext text/x-wiki q6yh3u07ljd85cyhtv0oz83miu1z06n 2435001 2435000 2026-07-09T13:47:52Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netboxdb2003.codfw.wmnet 2435001 wikitext text/x-wiki s3hk3hyb4j1tqv7yuszt2xto4yj8sbo 2435002 2435001 2026-07-09T13:50:19Z Stashbot 7414 moritzm: installing python-cryptography security updates 2435002 wikitext text/x-wiki b7cwdytmb1ls4c017bhwolmwd03ikxw 2435003 2435002 2026-07-09T13:53:03Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1052.eqiad.wmnet with reason: host reimage 2435003 wikitext text/x-wiki cc7ltvqr91d2yc6jpsn4ho6vbkn8sgm 2435005 2435003 2026-07-09T13:55:38Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host netboxdb1003.eqiad.wmnet 2435005 wikitext text/x-wiki 0o4mbfo0gqv5ir30mamjj7586oladq7 2435006 2435005 2026-07-09T13:56:26Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host cuminunpriv1001.eqiad.wmnet 2435006 wikitext text/x-wiki 89ftcbe8pkvgzzugdicthymf27i6o21 2435007 2435006 2026-07-09T13:57:19Z Stashbot 7414 moritzm: installing requests security updates 2435007 wikitext text/x-wiki mu4cmqurv4bc5qoflbsdw1ez5lsfzso 2435008 2435007 2026-07-09T13:59:25Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1052.eqiad.wmnet with reason: host reimage 2435008 wikitext text/x-wiki 8b2828xwg6b5hy47v4y5lsvx8kc7wp9 2435009 2435008 2026-07-09T13:59:28Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host netboxdb1003.eqiad.wmnet 2435009 wikitext text/x-wiki tqwy99ns77dgktx5qx62mks9l2a9yrp 2435010 2435009 2026-07-09T14:00:15Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cuminunpriv1001.eqiad.wmnet 2435010 wikitext text/x-wiki p61smjusuy89kue0bosdqh4cacgwtpd 2435013 2435010 2026-07-09T14:04:39Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.dns.netbox 2435013 wikitext text/x-wiki j8oi1gp1ecm8eq3fu1spshlk9te5pi4 2435014 2435013 2026-07-09T14:07:31Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/webrequest-page-view-next: apply 2435014 wikitext text/x-wiki 38e2c9maqvkdnk5cbkdh5jqct7slkvh 2435015 2435014 2026-07-09T14:07:49Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/webrequest-page-view-next: apply 2435015 wikitext text/x-wiki mbyrhekozm2t1qlygqu3mh8e1mofiq1 2435016 2435015 2026-07-09T14:09:16Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: updating for papaul - jhancock@cumin2002" 2435016 wikitext text/x-wiki 5y0t0vtx1zosn1w0hnceapq120benvd 2435017 2435016 2026-07-09T14:09:21Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: updating for papaul - jhancock@cumin2002" 2435017 wikitext text/x-wiki taz7kbs5syqjqulh3eirn7sf9o2krdo 2435018 2435017 2026-07-09T14:09:23Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2435018 wikitext text/x-wiki 14mn3nfmszlin6zxp2dh41b6f45gfhx 2435019 2435018 2026-07-09T14:11:29Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/webrequest-page-view-next: apply 2435019 wikitext text/x-wiki 7mtwsd2o1dzryuqgmxoh01ajfmhq4xj 2435020 2435019 2026-07-09T14:11:36Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/webrequest-page-view-next: apply 2435020 wikitext text/x-wiki rgbkftq3s2v93vxqmnyqokorlsohncd 2435021 2435020 2026-07-09T14:13:43Z Stashbot 7414 elukey: update druid indexation job for webrequest_sampled_live - T427068 2435021 wikitext text/x-wiki qj5mj0d05yf81vvjg6ybn64z8ssvxb9 2435022 2435021 2026-07-09T14:14:48Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/webrequest-page-view-next: apply 2435022 wikitext text/x-wiki cmm0b7vkii5x5w8xfpuuthlpktczhmt 2435023 2435022 2026-07-09T14:14:53Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/webrequest-page-view-next: apply 2435023 wikitext text/x-wiki ciz1eo98noguf5z5rym2za3u74jcc16 2435024 2435023 2026-07-09T14:15:37Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/pageview-trending-relative-next: apply 2435024 wikitext text/x-wiki ktijxz0vvoxiav6p7p5g7d0vk06d717 2435025 2435024 2026-07-09T14:15:44Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/pageview-trending-relative-next: apply 2435025 wikitext text/x-wiki 6w1g6zq7iupb5axs15h4nm7onry3yob 2435026 2435025 2026-07-09T14:17:52Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/pageview-trending-relative-next: apply 2435026 wikitext text/x-wiki 7shfypgvtwg24c9y8cte5projg341db 2435027 2435026 2026-07-09T14:18:03Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/pageview-trending-relative-next: apply 2435027 wikitext text/x-wiki 4lv8v3kq9cfnz092i1wufmp441vt55r 2435028 2435027 2026-07-09T14:19:54Z Stashbot 7414 jynus@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on 6 hosts with reason: reboot & upgrade 2435028 wikitext text/x-wiki in5rsfjjsjxapivsk6u99ftmbrksa74 2435029 2435028 2026-07-09T14:20:19Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1052.eqiad.wmnet with OS trixie 2435029 wikitext text/x-wiki qg61dvypehgjruzwqws66bzcb05si5w 2435030 2435029 2026-07-09T14:23:03Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/pageview-trending-relative-next: apply 2435030 wikitext text/x-wiki f7ag5gjk4jo40mgsgz6lr3o9gvduxwa 2435031 2435030 2026-07-09T14:23:15Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/pageview-trending-relative-next: apply 2435031 wikitext text/x-wiki mhsjx9bnbxuqtwmoou5njq6sn7ay9o5 2435032 2435031 2026-07-09T14:26:58Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/pageview-trending-relative-next: apply 2435032 wikitext text/x-wiki h0sciu8p7azgx00bzma0sedv86une3t 2435033 2435032 2026-07-09T14:28:14Z Stashbot 7414 elukey@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: sync 2435033 wikitext text/x-wiki nyeb6g6y805z6vjntumxn21ghtt4vyo 2435034 2435033 2026-07-09T14:28:36Z Stashbot 7414 elukey@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: sync 2435034 wikitext text/x-wiki fa62gr3dkk078qfktv63oflw9qnklkb 2435035 2435034 2026-07-09T14:30:06Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/pageview-trending-relative-next: apply 2435035 wikitext text/x-wiki owb1bzyxw1fokjxcxwpcoh05pt7ahb3 2435036 2435035 2026-07-09T14:30:32Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/webrequest-page-view-next: apply 2435036 wikitext text/x-wiki mpwzuuikqh8ft8qf51u6scuszcl5n1p 2435037 2435036 2026-07-09T14:30:37Z Stashbot 7414 elukey@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: sync 2435037 wikitext text/x-wiki ilxj3rvrljsstbf7cuzo5h6z6ahsnbi 2435038 2435037 2026-07-09T14:30:45Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/webrequest-page-view-next: apply 2435038 wikitext text/x-wiki jbdz9tj61v6uwrrsumdavhlvec905zm 2435039 2435038 2026-07-09T14:30:53Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/webrequest-page-view-next: apply 2435039 wikitext text/x-wiki c6po424y18k06xzxfwxtm9f9jiam1fw 2435040 2435039 2026-07-09T14:31:01Z Stashbot 7414 elukey@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: sync 2435040 wikitext text/x-wiki rhhyoh4u2l1h0arusj7s8fnazj0k18y 2435041 2435040 2026-07-09T14:31:50Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/webrequest-page-view-next: apply 2435041 wikitext text/x-wiki 8jgjkj7s91sntqoswsz5yuoewt5ftjb 2435042 2435041 2026-07-09T14:32:14Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/webrequest-page-view-next: apply 2435042 wikitext text/x-wiki q3rctx7w7aybuahhhvf3ikznirpij5t 2435043 2435042 2026-07-09T14:32:31Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/webrequest-page-view-next: apply 2435043 wikitext text/x-wiki 0bz72g3ntvnyqj01egnigmmaacyt0gs 2435044 2435043 2026-07-09T14:42:20Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1052.eqiad.wmnet 2435044 wikitext text/x-wiki 03bj6rvre4vbhpeepbbsl11ai6vosd6 2435045 2435044 2026-07-09T14:42:21Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1052.eqiad.wmnet 2435045 wikitext text/x-wiki n2w6dmjg4cdsaq3xh3iaytgqoff6jkl 2435046 2435045 2026-07-09T14:42:23Z Stashbot 7414 blake@cumin1003: END (FAIL) - Cookbook sre.k8s.renumber-node (exit_code=1) Renumbering for host wikikube-worker1052.eqiad.wmnet 2435046 wikitext text/x-wiki m6i2haq3bwzz090w8qlqagljk4njsc5 2435047 2435046 2026-07-09T14:45:39Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.bmc-user-mgmt for host an-test-client1002.eqiad.wmnet,an-test-coord[1001-1002].eqiad.wmnet,an-test-druid1001.eqiad.wmnet,an-test-master[1001-1004].eqiad.wmnet,an-test-presto1001.eqiad.wmnet,an-test-ui1001.eqiad.wmnet,an-test-worker[1001-1003].eqiad.wmnet 2435047 wikitext text/x-wiki 47ljjs4p4hwnp6mh10ybcf2e47zatfx 2435048 2435047 2026-07-09T14:47:40Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.bmc-user-mgmt (exit_code=0) for host an-test-client1002.eqiad.wmnet,an-test-coord[1001-1002].eqiad.wmnet,an-test-druid1001.eqiad.wmnet,an-test-master[1001-1004].eqiad.wmnet,an-test-presto1001.eqiad.wmnet,an-test-ui1001.eqiad.wmnet,an-test-worker[1001-1003].eqiad.wmnet 2435048 wikitext text/x-wiki ab6xtproptci82vauoy6vlz52nljz7u 2435049 2435048 2026-07-09T14:48:30Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.bmc-user-mgmt for host an-test-coord1002.eqiad.wmnet 2435049 wikitext text/x-wiki ov0530ydebrwvawpnbcnxyoa9a843to 2435050 2435049 2026-07-09T14:48:38Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.bmc-user-mgmt (exit_code=0) for host an-test-coord1002.eqiad.wmnet 2435050 wikitext text/x-wiki 15poo3xjew4i4x0a5131aw8eu884hos 2435051 2435050 2026-07-09T14:49:11Z Stashbot 7414 jynus@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on 6 hosts with reason: reboot & upgrade 2435051 wikitext text/x-wiki 2d5en9n3ki2tf8reiig0t9rjnao5srk 2435052 2435051 2026-07-09T14:51:43Z Stashbot 7414 jynus@cumin1003: START - Cookbook sre.hosts.remove-downtime for 14 hosts 2435052 wikitext text/x-wiki 246s5zz584a5uyyc5oitmkn3u7506f3 2435053 2435052 2026-07-09T14:51:51Z Stashbot 7414 jynus@cumin1003: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for 14 hosts 2435053 wikitext text/x-wiki qpluop2muzoa9omyg7lyd7w5742c0ei 2435055 2435053 2026-07-09T14:58:37Z Stashbot 7414 cjming@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/test-kitchen: apply 2435055 wikitext text/x-wiki mt054ttbmtwanig3xt6cp15jngzrb6e 2435056 2435055 2026-07-09T14:59:15Z Stashbot 7414 cjming@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/test-kitchen: apply 2435056 wikitext text/x-wiki pgu1lph7kig5c3jimtc6b1gt2t1a08b 2435057 2435056 2026-07-09T15:06:20Z Stashbot 7414 cjming@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/test-kitchen-next: apply 2435057 wikitext text/x-wiki 55wqd80p4g6pidx2ue0ke2781vqhrzs 2435058 2435057 2026-07-09T15:06:48Z Stashbot 7414 cjming@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/test-kitchen-next: apply 2435058 wikitext text/x-wiki 757sq5fc00wln73yl1flodjffghu2mu 2435060 2435058 2026-07-09T15:13:29Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/pageview-trending-relative-next: apply 2435060 wikitext text/x-wiki m2ff4z08vctjml9jebq2cdujfyaxhz6 2435061 2435060 2026-07-09T15:13:40Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/pageview-trending-relative-next: apply 2435061 wikitext text/x-wiki kl7h529e3mjrf0y87kyk2x4v9a0vnyf 2435062 2435061 2026-07-09T15:14:07Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/pageview-trending-relative-next: apply 2435062 wikitext text/x-wiki qqkmwq63wx50gp9xsr2nvvaomkim15t 2435063 2435062 2026-07-09T15:14:17Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/pageview-trending-relative-next: apply 2435063 wikitext text/x-wiki jk5jn6pnpsmpqyhqk6qcr4ak6ubrz5y 2435065 2435063 2026-07-09T15:14:38Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/pageview-trending-relative-next: apply 2435065 wikitext text/x-wiki bslql0lz4gmpsbel2b92hy81gkpt2ca 2435066 2435065 2026-07-09T15:14:46Z Stashbot 7414 javiermonton@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/pageview-trending-relative-next: apply 2435066 wikitext text/x-wiki 0s8sa2z2nz9vkpbfbuxoez5meim39ud 2435068 2435066 2026-07-09T15:47:47Z Stashbot 7414 jynus@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on backupmon1001.eqiad.wmnet with reason: restart 2435068 wikitext text/x-wiki 8dtjfux20evjfraayc9jdx27y88u28v 2435069 2435068 2026-07-09T15:49:14Z Stashbot 7414 jynus@cumin1003: START - Cookbook sre.hosts.remove-downtime for 14 hosts 2435069 wikitext text/x-wiki krwvzoseqlcylgi2owelvxktbspgp6j 2435070 2435069 2026-07-09T15:49:24Z Stashbot 7414 jynus@cumin1003: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for 14 hosts 2435070 wikitext text/x-wiki 7xaztn8ymgoftspgq5bkrizghhlu2p2 2435071 2435070 2026-07-09T15:51:27Z Stashbot 7414 jynus: restarting backupmon1001 2435071 wikitext text/x-wiki srp43hm4s181zp9hmuf1c2amvrnycbi 2435072 2435071 2026-07-09T15:54:30Z Stashbot 7414 cjming@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/test-kitchen-next: apply 2435072 wikitext text/x-wiki qwazg2sa5u0rfqw8vcqnexlfer38jc8 2435073 2435072 2026-07-09T15:55:01Z Stashbot 7414 cjming@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/test-kitchen-next: apply 2435073 wikitext text/x-wiki 0rqt53aopeeovx94kcc8o37rg1884js 2435075 2435073 2026-07-09T16:47:56Z Stashbot 7414 brett@cumin2002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on doh5004.wikimedia.org with reason: random high load, investigating 2435075 wikitext text/x-wiki flob5lbgx74orufl7f0w2amivete6ev 2435076 2435075 2026-07-09T16:49:40Z Stashbot 7414 mutante: planet1003/planet2003 - rebooting 2435076 wikitext text/x-wiki 5vp8662vnd9jch936karh41dtta8582 2435077 2435076 2026-07-09T16:52:56Z Stashbot 7414 ladsgroup@deploy2003: helmfile [staging] START helmfile.d/services/thumbor: apply 2435077 wikitext text/x-wiki 2zwhs0bobh23j34p3xvxlw4mnov2xtn 2435078 2435077 2026-07-09T16:53:24Z Stashbot 7414 ladsgroup@deploy2003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2435078 wikitext text/x-wiki 12mlh6e152fmp4popmyo1tr2mxxa5qp 2435079 2435078 2026-07-09T16:54:25Z Stashbot 7414 ebernhardson: start full in-place reindex of cloudelastic cluster 2435079 wikitext text/x-wiki fpl6hah8erjs9082s5p7dqo31gh2f7t 2435081 2435079 2026-07-09T16:59:16Z Stashbot 7414 mutante: stewards1001/stewards2001 - reboot for maintenance 2435081 wikitext text/x-wiki 4k1yg6qc21we5esfbg0u6q8kcrzptr1 2435082 2435081 2026-07-09T17:03:11Z Stashbot 7414 ebernhardson: start full in-place reindex of codfw cirrussearch cluster 2435082 wikitext text/x-wiki afh28ky7wltp7hrqh42pfw7w17g8q57 2435083 2435082 2026-07-09T17:08:29Z Stashbot 7414 dzahn@cumin2002: START - Cookbook sre.hosts.reboot-cluster 2435083 wikitext text/x-wiki evmuqpbhqf539f3qcbo4drzl59hhz0c 2435084 2435083 2026-07-09T17:08:30Z Stashbot 7414 dzahn@cumin2002: END (FAIL) - Cookbook sre.hosts.reboot-cluster (exit_code=99) 2435084 wikitext text/x-wiki 3w6cywehmuvvy1myqndqmljo12zb3b3 2435085 2435084 2026-07-09T17:09:30Z Stashbot 7414 ebernhardson: start full in-place reindex of eqiad cirrussearch cluster 2435085 wikitext text/x-wiki ach78kkll343poymmh9cmxu7t3okrbb 2435086 2435085 2026-07-09T17:09:52Z Stashbot 7414 mutante: zuul[12]00[123] - rebooting for maintenance 2435086 wikitext text/x-wiki ghwmhhuhc0qnmjn757kilysdkmmnrb9 2435087 2435086 2026-07-09T17:26:58Z Stashbot 7414 ladsgroup@deploy2003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2435087 wikitext text/x-wiki 6cdacy2iqnri7foa8mxvzkviwo9rvov 2435088 2435087 2026-07-09T17:29:15Z Stashbot 7414 ladsgroup@deploy2003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2435088 wikitext text/x-wiki g94rb9olaa542p0ql2py7nnn881y2uw 2435089 2435088 2026-07-09T17:35:59Z Stashbot 7414 ladsgroup@deploy2003: helmfile [eqiad] START helmfile.d/services/thumbor: apply 2435089 wikitext text/x-wiki o1uzijri47vevpbhmffshn8w91by6gu 2435091 2435089 2026-07-09T17:38:38Z Stashbot 7414 ladsgroup@deploy2003: helmfile [eqiad] DONE helmfile.d/services/thumbor: apply 2435091 wikitext text/x-wiki 9lmrpe6bzywlti5t9kxamasi5c8gzfu 2435092 2435091 2026-07-09T17:45:53Z Stashbot 7414 brett@cumin2002: START - Cookbook sre.hosts.remove-downtime for doh5004.wikimedia.org 2435092 wikitext text/x-wiki hofpbbbr3u2b5l2lg0nzrk7nbgchcsr 2435093 2435092 2026-07-09T17:45:55Z Stashbot 7414 brett@cumin2002: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for doh5004.wikimedia.org 2435093 wikitext text/x-wiki 0lixdtfnsc1sd9oubt0lo61vr2mj42w 2435095 2435093 2026-07-09T18:15:12Z Stashbot 7414 rzl@deploy2003: helmfile [staging-codfw] START helmfile.d/admin 'apply'. 2435095 wikitext text/x-wiki anmomorhtvpkl9jc8n8eognfp6vyhte 2435096 2435095 2026-07-09T18:16:55Z Stashbot 7414 rzl@deploy2003: helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. 2435096 wikitext text/x-wiki 6kffs02te0o6s7s7iclaya2cqxk6txp 2435097 2435096 2026-07-09T18:41:43Z Stashbot 7414 rzl@deploy2003: helmfile [staging-eqiad] START helmfile.d/admin 'apply'. 2435097 wikitext text/x-wiki fwzf6dv42rwpic0h2dh5ef2e90txhlq 2435098 2435097 2026-07-09T18:42:57Z Stashbot 7414 rzl@deploy2003: helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. 2435098 wikitext text/x-wiki qr50vjkak9bcrmzmvrd4ppvrv8bbs07 2435100 2435098 2026-07-09T19:25:45Z Stashbot 7414 rzl@deploy2003: helmfile [codfw] START helmfile.d/admin 'apply'. 2435100 wikitext text/x-wiki 1s2t281sl2k2t6zbnoygykbmcydcce7 2435101 2435100 2026-07-09T19:27:09Z Stashbot 7414 rzl@deploy2003: helmfile [codfw] DONE helmfile.d/admin 'apply'. 2435101 wikitext text/x-wiki g44o87ojlzotvblvnd97vkd73pivg0j 2435102 2435101 2026-07-09T19:28:52Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/admin 'apply'. 2435102 wikitext text/x-wiki cpny0csq5dry703zk6iu62o4w828imk 2435103 2435102 2026-07-09T19:30:04Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/admin 'apply'. 2435103 wikitext text/x-wiki h42y9limquaghkiz4hp8w8lpiiljyw0 2435104 2435103 2026-07-09T19:43:29Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.provision for host thanos-be1009.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2435104 wikitext text/x-wiki tdkrfcixxd46jtk7cvvmeyxzwg51r9b 2435107 2435104 2026-07-09T19:54:14Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host thanos-be1009.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2435107 wikitext text/x-wiki mwb1dye3zvpel654g6r9y4yendvi6mr 2435108 2435107 2026-07-09T19:55:19Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.reimage for host thanos-be1009.eqiad.wmnet with OS trixie 2435108 wikitext text/x-wiki s3gdmxjgqq0lodomyd43pgr86lp19dd 2435109 2435108 2026-07-09T20:02:47Z Stashbot 7414 ladsgroup@cumin1003: START - Cookbook sre.wikireplicas.update-views 2435109 wikitext text/x-wiki tihls8084sdpdf2a4fgk18u5akxws6m 2435111 2435109 2026-07-09T20:12:46Z Stashbot 7414 ladsgroup@cumin1003: END (FAIL) - Cookbook sre.wikireplicas.update-views (exit_code=99) 2435111 wikitext text/x-wiki cy4h3ct484tox5vsmxjrmhe46vjk1r7 2435112 2435111 2026-07-09T20:15:43Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on thanos-be1009.eqiad.wmnet with reason: host reimage 2435112 wikitext text/x-wiki l17qm6ymkagen3cxw87f4lowjd4x8oe 2435113 2435112 2026-07-09T20:16:20Z Stashbot 7414 ladsgroup@cumin1003: START - Cookbook sre.wikireplicas.update-views 2435113 wikitext text/x-wiki 6vdbess8peuoadi5wpja0prauf5ohdp 2435114 2435113 2026-07-09T20:20:06Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on thanos-be1009.eqiad.wmnet with reason: host reimage 2435114 wikitext text/x-wiki mf9mpehcvkhx22zkslfhc9jbpxna8bk 2435115 2435114 2026-07-09T20:21:42Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.elasticsearch.rolling-operation Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster relforge: Lifecycle work - bking@cumin2003 - T431658 2435115 wikitext text/x-wiki 9z8gca16k7817a8ubipu1l9y6q5kfvc 2435116 2435115 2026-07-09T20:21:50Z Stashbot 7414 bking@cumin2003: END (ERROR) - Cookbook sre.elasticsearch.rolling-operation (exit_code=97) Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster relforge: Lifecycle work - bking@cumin2003 - T431658 2435116 wikitext text/x-wiki mv4h8vvuodrrj8j420y1swayzg8we2a 2435117 2435116 2026-07-09T20:22:02Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.elasticsearch.rolling-operation Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster relforge: Lifecycle work - bking@cumin2003 - T431658 2435117 wikitext text/x-wiki 8drszvxjkw83mjcu0gd6m0woduskw5u 2435118 2435117 2026-07-09T20:22:04Z Stashbot 7414 bking@cumin2003: END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster relforge: Lifecycle work - bking@cumin2003 - T431658 2435118 wikitext text/x-wiki r18zdq57om5szev81sv63p8rktmfcy0 2435119 2435118 2026-07-09T20:23:09Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.reboot-single for host relforge1008.eqiad.wmnet 2435119 wikitext text/x-wiki 62z4bcbx7ro7i9uvtcidi5vkteqe0cl 2435120 2435119 2026-07-09T20:23:10Z Stashbot 7414 rzl@deploy2003: helmfile [staging] START helmfile.d/services/wikifunctions: apply 2435120 wikitext text/x-wiki olkb75n2hm2ypkooq2i6k2h4lk7z6yr 2435121 2435120 2026-07-09T20:23:26Z Stashbot 7414 bking@cumin2003: END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) for host relforge1008.eqiad.wmnet 2435121 wikitext text/x-wiki 3criq0qio1gg6shxdyr3giw3t2d0484 2435122 2435121 2026-07-09T20:23:50Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.reimage for host wcqs2002.codfw.wmnet with OS bookworm 2435122 wikitext text/x-wiki jiracgw4affl2hxu4frggh9ysgftjc8 2435123 2435122 2026-07-09T20:24:43Z Stashbot 7414 rzl@deploy2003: helmfile [staging] DONE helmfile.d/services/wikifunctions: apply 2435123 wikitext text/x-wiki qdn9a064dndnj3yq6za95wqz3mkmnss 2435124 2435123 2026-07-09T20:29:40Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.reboot-single for host relforge1008.eqiad.wmnet 2435124 wikitext text/x-wiki 6y3huxnb59ypiubw5jc5qb8r75waihz 2435125 2435124 2026-07-09T20:31:39Z Stashbot 7414 ladsgroup@cumin1003: END (PASS) - Cookbook sre.wikireplicas.update-views (exit_code=0) 2435125 wikitext text/x-wiki ft374zr1ipryzd8her2gkjq2spj8756 2435126 2435125 2026-07-09T20:31:56Z Stashbot 7414 ladsgroup@cumin1003: START - Cookbook sre.wikireplicas.update-views 2435126 wikitext text/x-wiki ov10woy4mzhv2hbleht5f5psn0lt1s2 2435127 2435126 2026-07-09T20:32:43Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.elasticsearch.rolling-operation Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster cloudelastic: lifecyle work - bking@cumin2003 - T431658 2435127 wikitext text/x-wiki kj2p2dmdunbzmw3d24xkt6hdfnww8k8 2435128 2435127 2026-07-09T20:32:45Z Stashbot 7414 bking@cumin2003: END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster cloudelastic: lifecyle work - bking@cumin2003 - T431658 2435128 wikitext text/x-wiki fext9hwwwvhmzziqtlbmuqjypbvps81 2435129 2435128 2026-07-09T20:33:43Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.elasticsearch.rolling-operation Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster cloudelastic: lifecyle work - bking@cumin2003 - T431658 2435129 wikitext text/x-wiki oyltrghpd2nzl7799tngmyq34ux56h6 2435130 2435129 2026-07-09T20:37:51Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host thanos-be1009.eqiad.wmnet with OS trixie 2435130 wikitext text/x-wiki khwfs0nrvqmgdom7qh3gk5mz0i0c8hz 2435131 2435130 2026-07-09T20:40:10Z Stashbot 7414 bking@cumin2003: END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster cloudelastic: lifecyle work - bking@cumin2003 - T431658 2435131 wikitext text/x-wiki skxw7i11gvwbxupy9v2o12zvbgfmuu4 2435132 2435131 2026-07-09T20:40:18Z Stashbot 7414 bking@cumin2003: END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) for host relforge1008.eqiad.wmnet 2435132 wikitext text/x-wiki 2rckr0xwnn0r3de2pouzhdlpy38v4zc 2435133 2435132 2026-07-09T20:41:28Z Stashbot 7414 ladsgroup@cumin1003: END (FAIL) - Cookbook sre.wikireplicas.update-views (exit_code=99) 2435133 wikitext text/x-wiki jnd32z422jllc4g2jxin4y131k7team 2435134 2435133 2026-07-09T20:41:36Z Stashbot 7414 ladsgroup@cumin1003: START - Cookbook sre.wikireplicas.update-views 2435134 wikitext text/x-wiki 0fpacbo9b6aidwfsuqks3mowxdeb8mm 2435135 2435134 2026-07-09T20:42:56Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on wcqs2002.codfw.wmnet with reason: host reimage 2435135 wikitext text/x-wiki d4ebgtiduxkypy8lvmvhhvz49geg3cg 2435136 2435135 2026-07-09T20:47:35Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.elasticsearch.rolling-operation Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster cloudelastic: lifecycle work - bking@cumin2003 2435136 wikitext text/x-wiki 6hlt7pjpv2kw8mfj7ia8c2v5w7gu2ys 2435137 2435136 2026-07-09T20:50:02Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wcqs2002.codfw.wmnet with reason: host reimage 2435137 wikitext text/x-wiki h64mmhd041knla3kbk3dm1sg2sdyb5j 2435138 2435137 2026-07-09T20:51:06Z Stashbot 7414 ladsgroup@cumin1003: END (FAIL) - Cookbook sre.wikireplicas.update-views (exit_code=99) 2435138 wikitext text/x-wiki sk9o7xvclfpnewsjmkoipjw3gi52yfm 2435139 2435138 2026-07-09T20:53:16Z Stashbot 7414 ladsgroup@deploy2003: Started scap sync-world: Backport for [[gerrit:1309290|Introduce sharing of section function (T18691)]], [[gerrit:1309291|Drop the share icon from the mobile site (T18691)]] 2435139 wikitext text/x-wiki ckksqyrklup0qib8w88ch7min9ft3sr 2435140 2435139 2026-07-09T20:53:18Z Stashbot 7414 ladsgroup@cumin1003: START - Cookbook sre.wikireplicas.update-views 2435140 wikitext text/x-wiki hy3qc9ty24wsphj2xh7y7y1rbkg1qjd 2435141 2435140 2026-07-09T20:54:43Z Stashbot 7414 bking@cumin2003: END (FAIL) - Cookbook sre.elasticsearch.rolling-operation (exit_code=99) Operation.REBOOT (1 nodes at a time) for ElasticSearch cluster cloudelastic: lifecycle work - bking@cumin2003 2435141 wikitext text/x-wiki 4ge202xycycf0p5o9scnf9vb8x3rr7v 2435142 2435141 2026-07-09T21:07:28Z Stashbot 7414 bking@cumin2003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on 6 hosts with reason: reboots 2435142 wikitext text/x-wiki iny8is1zl2futxak0lw8hxmj2ficu78 2435143 2435142 2026-07-09T21:08:05Z Stashbot 7414 ladsgroup@cumin1003: END (PASS) - Cookbook sre.wikireplicas.update-views (exit_code=0) 2435143 wikitext text/x-wiki pfxi9upholz7su238k6gvxr2gi0nep1 2435144 2435143 2026-07-09T21:11:05Z Stashbot 7414 ladsgroup@deploy2003: ladsgroup: Backport for [[gerrit:1309290|Introduce sharing of section function (T18691)]], [[gerrit:1309291|Drop the share icon from the mobile site (T18691)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2435144 wikitext text/x-wiki 9c17gsb4d5gr802lur6u5q2nhsrpajl 2435145 2435144 2026-07-09T21:13:56Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wcqs2002.codfw.wmnet with OS bookworm 2435145 wikitext text/x-wiki 07n8n47orjwvlg3oapod63percpmbp1 2435146 2435145 2026-07-09T21:15:10Z Stashbot 7414 ladsgroup@deploy2003: ladsgroup: Continuing with deployment 2435146 wikitext text/x-wiki rk3bssg9w595tnhwy1eattcldwnw30d 2435147 2435146 2026-07-09T21:16:21Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.wdqs.data-transfer (T430879, restore data on newly-reimaged host) xfer commons from wcqs2001.codfw.wmnet -> wcqs2002.codfw.wmnet, repooling source-only afterwards 2435147 wikitext text/x-wiki pajj7kgin5mfrmwca05cscdtmdtb5nr 2435148 2435147 2026-07-09T21:16:30Z Stashbot 7414 bking@cumin2003: END (ERROR) - Cookbook sre.wdqs.data-transfer (exit_code=97) (T430879, restore data on newly-reimaged host) xfer commons from wcqs2001.codfw.wmnet -> wcqs2002.codfw.wmnet, repooling source-only afterwards 2435148 wikitext text/x-wiki mio2eeyh56vpo9fu6h10cuvauzq4yw5 2435149 2435148 2026-07-09T21:20:19Z Stashbot 7414 bking@deploy2003: Started deploy [wdqs/wdqs@e8fb00c] (wcqs): T430879 2435149 wikitext text/x-wiki ck0wuk0x0bouubn8tiwic89nffv2ncw 2435150 2435149 2026-07-09T21:20:25Z Stashbot 7414 bking@deploy2003: Finished deploy [wdqs/wdqs@e8fb00c] (wcqs): T430879 (duration: 00m 22s) 2435150 wikitext text/x-wiki 9r3k3h44gpbu2ze8m6t65s1r9pfde5s 2435152 2435150 2026-07-09T21:22:02Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.wdqs.data-transfer (T430879, restore data on newly-reimaged host) xfer commons from wcqs2001.codfw.wmnet -> wcqs2002.codfw.wmnet, repooling source-only afterwards 2435152 wikitext text/x-wiki qld0yjjlmv052p6pjkyawmput13sozj 2435153 2435152 2026-07-09T21:23:21Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.reimage for host wcqs1002.eqiad.wmnet with OS trixie 2435153 wikitext text/x-wiki q3s90wwyrt5w18p8t1rtbca6gpq18e3 2435154 2435153 2026-07-09T21:23:43Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.move-vlan for host wcqs1002 2435154 wikitext text/x-wiki 97fbeka8sx8n7vitsca8f7rls3mo1cl 2435155 2435154 2026-07-09T21:23:45Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wcqs1002 2435155 wikitext text/x-wiki 0gnpz3z10r1beo90d6g1c30an1fk49o 2435156 2435155 2026-07-09T21:27:31Z Stashbot 7414 ladsgroup@deploy2003: Finished scap sync-world: Backport for [[gerrit:1309290|Introduce sharing of section function (T18691)]], [[gerrit:1309291|Drop the share icon from the mobile site (T18691)]] (duration: 34m 14s) 2435156 wikitext text/x-wiki kvpktuzta0u4cv9gq8x2dykxc35ypu8 2435159 2435156 2026-07-09T21:38:12Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on wcqs1002.eqiad.wmnet with reason: host reimage 2435159 wikitext text/x-wiki pywpwv1iq6c1mpyw6b1p10bipwtbpk1 2435160 2435159 2026-07-09T21:42:07Z Stashbot 7414 maryum: Deploy fix for T431684 2435160 wikitext text/x-wiki 9eqda8uiqprmjc43uh32x0oq0xkhg82 2435161 2435160 2026-07-09T21:43:05Z Stashbot 7414 rzl@deploy2003: helmfile [staging-codfw] START helmfile.d/admin 'apply'. 2435161 wikitext text/x-wiki p52h3imcu5h1qxnrkno21oia6e2xbkj 2435162 2435161 2026-07-09T21:43:47Z Stashbot 7414 rzl@deploy2003: helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. 2435162 wikitext text/x-wiki pviu1ynoh0g2ebyy1fa2bzofk9pxy4x 2435163 2435162 2026-07-09T21:44:22Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wcqs1002.eqiad.wmnet with reason: host reimage 2435163 wikitext text/x-wiki 9drool7k751mokuv21ctcxct4q9yt7q 2435164 2435163 2026-07-09T21:45:47Z Stashbot 7414 rzl@deploy2003: helmfile [staging-eqiad] START helmfile.d/admin 'apply'. 2435164 wikitext text/x-wiki mac4i8yap9swhjbfpxwn7pljdbswq7k 2435165 2435164 2026-07-09T21:47:00Z Stashbot 7414 rzl@deploy2003: helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. 2435165 wikitext text/x-wiki h6hz1zc6t45ten1tdurq0fsf1jm6lp1 2435166 2435165 2026-07-09T21:53:07Z Stashbot 7414 rzl@deploy2003: helmfile [codfw] START helmfile.d/admin 'apply'. 2435166 wikitext text/x-wiki lnuzxd4k8u562k6gfd2auf3g3yavnhk 2435167 2435166 2026-07-09T21:53:10Z Stashbot 7414 jasmine@cumin2002: START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker1165.eqiad.wmnet 2435167 wikitext text/x-wiki n5oh0ku8rdrdgugc6jv0a46smttfcgd 2435168 2435167 2026-07-09T21:53:15Z Stashbot 7414 jasmine@cumin2002: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1165.eqiad.wmnet 2435168 wikitext text/x-wiki n1g9hmumkhy1wbfrc8brb1djowmtun0 2435169 2435168 2026-07-09T21:53:39Z Stashbot 7414 rzl@deploy2003: helmfile [codfw] DONE helmfile.d/admin 'apply'. 2435169 wikitext text/x-wiki preeh1s64d4axhzy2vs8lgmjp1k1qp3 2435170 2435169 2026-07-09T21:54:24Z Stashbot 7414 jasmine@cumin2002: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1165.eqiad.wmnet 2435170 wikitext text/x-wiki 85q6ylaw2r0xd2fljj0byfus1xeisyv 2435171 2435170 2026-07-09T21:54:46Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/admin 'apply'. 2435171 wikitext text/x-wiki k9nsegmgjn6p5y96q9fburd2uhlq12k 2435172 2435171 2026-07-09T21:54:48Z Stashbot 7414 jasmine@cumin2002: START - Cookbook sre.hosts.reimage for host wikikube-worker1165.eqiad.wmnet with OS trixie 2435172 wikitext text/x-wiki 1m8lh8zkkbto2tzjzyd3q2gjjqvum97 2435173 2435172 2026-07-09T21:55:10Z Stashbot 7414 jasmine@cumin2002: START - Cookbook sre.hosts.move-vlan for host wikikube-worker1165 2435173 wikitext text/x-wiki fh2vrnrvr4migm674yj41l40vdabn17 2435174 2435173 2026-07-09T21:57:34Z Stashbot 7414 jasmine@cumin2002: START - Cookbook sre.dns.netbox 2435174 wikitext text/x-wiki 2fgqc6eb4ybfj24z0pucp10qe1jit00 2435175 2435174 2026-07-09T22:02:02Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/admin 'apply'. 2435175 wikitext text/x-wiki ooxaql70ihx0bss7pi1kr6joqn5c9ei 2435176 2435175 2026-07-09T22:02:13Z Stashbot 7414 jasmine@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1165 - jasmine@cumin2002" 2435176 wikitext text/x-wiki chg2n4phh7h43ep2ekivr2j6namghfg 2435177 2435176 2026-07-09T22:02:19Z Stashbot 7414 jasmine@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1165 - jasmine@cumin2002" 2435177 wikitext text/x-wiki 8d7aexs7n6hgv93wrtpt03bfo4uipka 2435178 2435177 2026-07-09T22:02:20Z Stashbot 7414 jasmine@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2435178 wikitext text/x-wiki bymngvhvensn56qz842rxidjqz3m2po 2435179 2435178 2026-07-09T22:02:21Z Stashbot 7414 jasmine@cumin2002: START - Cookbook sre.dns.wipe-cache wikikube-worker1165.eqiad.wmnet 115.48.64.10.in-addr.arpa 5.1.1.0.8.4.0.0.4.6.0.0.0.1.0.0.7.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2435179 wikitext text/x-wiki deurbi6a1tcuxr87fnrkiptt1i7yg80 2435180 2435179 2026-07-09T22:02:23Z Stashbot 7414 jasmine@cumin2002: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker1165.eqiad.wmnet 115.48.64.10.in-addr.arpa 5.1.1.0.8.4.0.0.4.6.0.0.0.1.0.0.7.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2435180 wikitext text/x-wiki 5bl7n49z7rxueh5ibkxdez6m1bhhi87 2435181 2435180 2026-07-09T22:02:25Z Stashbot 7414 jasmine@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1165 2435181 wikitext text/x-wiki 5x9y5bcddz2opdkr49l459gmp1wzqsw 2435182 2435181 2026-07-09T22:02:48Z Stashbot 7414 jasmine@cumin2002: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1165 2435182 wikitext text/x-wiki mxrlhiyuyvyyk5rmay641z06dhmo2qs 2435183 2435182 2026-07-09T22:02:49Z Stashbot 7414 jasmine@cumin2002: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1165 2435183 wikitext text/x-wiki 0bjdhgjn306xuusxz2e0g4lmzej8xrq 2435184 2435183 2026-07-09T22:04:18Z Stashbot 7414 rzl@deploy2003: helmfile [codfw] START helmfile.d/services/wikifunctions: apply 2435184 wikitext text/x-wiki ezfnq73njxe6jy9d0spvmphcs34afuo 2435185 2435184 2026-07-09T22:04:54Z Stashbot 7414 rzl@deploy2003: helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply 2435185 wikitext text/x-wiki 988t03djcz7anfl02bo45t9h4nplw5s 2435186 2435185 2026-07-09T22:12:17Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] START helmfile.d/services/wikifunctions: apply 2435186 wikitext text/x-wiki 4fyvv69tswnfwmnwbgd68qp7orf00cr 2435187 2435186 2026-07-09T22:13:02Z Stashbot 7414 rzl@deploy2003: helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply 2435187 wikitext text/x-wiki hixru3btwycpmjjyexqf815glfsmvic 2435189 2435187 2026-07-09T22:17:18Z Stashbot 7414 jasmine@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1165.eqiad.wmnet with reason: host reimage 2435189 wikitext text/x-wiki kjygbzq4t8e1rdfxi9y6hd770i4cpn5 2435190 2435189 2026-07-09T22:25:07Z Stashbot 7414 jasmine@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1165.eqiad.wmnet with reason: host reimage 2435190 wikitext text/x-wiki 0yf4zqbxfg6jh2msfjp2fdvcsgscrhn 2435191 2435190 2026-07-09T22:37:00Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T430879, restore data on newly-reimaged host) xfer commons from wcqs2001.codfw.wmnet -> wcqs2002.codfw.wmnet, repooling source-only afterwards 2435191 wikitext text/x-wiki sm1q15rueuqbtdv77qckxm6xwtdzdka 2435192 2435191 2026-07-09T22:37:24Z Stashbot 7414 arlolra@deploy2003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2435192 wikitext text/x-wiki 6rp0mxrdyq86ku2wgbx3s98cjht0d3e 2435193 2435192 2026-07-09T22:37:55Z Stashbot 7414 arlolra@deploy2003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2435193 wikitext text/x-wiki 0qwy6l061dhp073oy2bi726jmg7rrpg 2435194 2435193 2026-07-09T22:37:56Z Stashbot 7414 arlolra@deploy2003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2435194 wikitext text/x-wiki ejmzmac37cakzfp6edvm38gj2uoblde 2435195 2435194 2026-07-09T22:38:29Z Stashbot 7414 arlolra@deploy2003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2435195 wikitext text/x-wiki gx1wtniigmaiwnik0gktc1no479z5vt 2435196 2435195 2026-07-09T22:45:13Z Stashbot 7414 jasmine@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1165.eqiad.wmnet with OS trixie 2435196 wikitext text/x-wiki 23inrt2w3qkzcahl00nqjg1zd84blww 2435197 2435196 2026-07-09T22:56:56Z Stashbot 7414 jasmine@cumin2002: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1165.eqiad.wmnet 2435197 wikitext text/x-wiki j6k8yntxfnfsx8hdi378bqjm7buwacz 2435198 2435197 2026-07-09T22:56:59Z Stashbot 7414 jasmine@cumin2002: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1165.eqiad.wmnet 2435198 wikitext text/x-wiki 587zmmew9t7j3wt9v2eom0qtemol8y7 2435199 2435198 2026-07-09T22:57:00Z Stashbot 7414 jasmine@cumin2002: END (PASS) - Cookbook sre.k8s.renumber-node (exit_code=0) Renumbering for host wikikube-worker1165.eqiad.wmnet 2435199 wikitext text/x-wiki tv4zbxz4xbblru1h0eor0hmmtfky6y5 2435200 2435199 2026-07-09T23:20:30Z Stashbot 7414 ladsgroup@deploy2003: Started scap sync-world: Backport for [[gerrit:1308671|Enable section share on Persian Wikipedia (T431514)]] 2435200 wikitext text/x-wiki eewswitbk5s51admi5k1e3oldbfpz5x 2435201 2435200 2026-07-09T23:22:21Z Stashbot 7414 ladsgroup@deploy2003: ladsgroup, jdlrobson: Backport for [[gerrit:1308671|Enable section share on Persian Wikipedia (T431514)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2435201 wikitext text/x-wiki ase890qtg037g6q0z8ul89rjt88db52 2435203 2435201 2026-07-09T23:29:36Z Stashbot 7414 ladsgroup@deploy2003: ladsgroup, jdlrobson: Continuing with deployment 2435203 wikitext text/x-wiki 3j3o1u3xiygq8ow1upgbmundwvpvq2p 2435204 2435203 2026-07-09T23:33:56Z Stashbot 7414 ladsgroup@deploy2003: Finished scap sync-world: Backport for [[gerrit:1308671|Enable section share on Persian Wikipedia (T431514)]] (duration: 13m 26s) 2435204 wikitext text/x-wiki i180uxgeprb9m01e214v6eclyiz1srp 2435210 2435204 2026-07-10T02:00:27Z Stashbot 7414 mwpresync@deploy2003: Started scap build-images: Publishing wmf/next image 2435210 wikitext text/x-wiki tuareamef0u121m3yuu4cv6f4uk3czq 2435211 2435210 2026-07-10T02:07:08Z Stashbot 7414 mwpresync@deploy2003: Finished scap build-images: Publishing wmf/next image (duration: 06m 41s) 2435211 wikitext text/x-wiki nu849jiemukawnz8lzgvlvdlmcweenx 2435232 2435211 2026-07-10T06:45:11Z Stashbot 7414 jynus@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on 10 hosts with reason: reboot & upgrade 2435232 wikitext text/x-wiki 1q0m4whf3vpe9braueo18ed49diymtg 2435240 2435232 2026-07-10T07:23:03Z Stashbot 7414 jynus@cumin1003: START - Cookbook sre.hosts.remove-downtime for 10 hosts 2435240 wikitext text/x-wiki jn1ao45f0c8sm36lne3ytxid0wq65lg 2435241 2435240 2026-07-10T07:23:09Z Stashbot 7414 jynus@cumin1003: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for 10 hosts 2435241 wikitext text/x-wiki 04ugrjlg5nzym37v43ua2unqe722766 2435243 2435241 2026-07-10T07:44:06Z Stashbot 7414 dcausse@deploy2003: helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply 2435243 wikitext text/x-wiki ox94cv0nrs0lu5yn4tf0z8jyo9ipy4c 2435244 2435243 2026-07-10T07:44:17Z Stashbot 7414 dcausse@deploy2003: helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply 2435244 wikitext text/x-wiki hw3po22q55swv1tektcmlluia4x17cm 2435245 2435244 2026-07-10T07:47:16Z Stashbot 7414 dcausse@deploy2003: helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply 2435245 wikitext text/x-wiki 6ea4y642q49ex6kp7e6b33ttk2pd3o1 2435246 2435245 2026-07-10T07:47:26Z Stashbot 7414 dcausse@deploy2003: helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply 2435246 wikitext text/x-wiki j6bd3qthv7erg4rgsa6b1jtfnenuffh 2435247 2435246 2026-07-10T07:49:25Z Stashbot 7414 jynus@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on 11 hosts with reason: reboot & upgrade 2435247 wikitext text/x-wiki cnqknnblsmbwmypz1lqefy7rs9dppa7 2435248 2435247 2026-07-10T07:52:12Z Stashbot 7414 dcausse@deploy2003: helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply 2435248 wikitext text/x-wiki b86qaadr9egb5rhtj6wdk5rmoe2h89f 2435249 2435248 2026-07-10T07:52:28Z Stashbot 7414 dcausse@deploy2003: helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply 2435249 wikitext text/x-wiki nfnjk7sfdka0bz3bzcj7fcp3m3jihxe 2435251 2435249 2026-07-10T08:00:30Z Stashbot 7414 jynus@cumin1003: START - Cookbook sre.hosts.remove-downtime for db[2183-2184].codfw.wmnet 2435251 wikitext text/x-wiki 6yg9hscuyw1mg8otb9pd11virr62nyv 2435252 2435251 2026-07-10T08:00:31Z Stashbot 7414 jynus@cumin1003: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for db[2183-2184].codfw.wmnet 2435252 wikitext text/x-wiki 7mq64fj9vdst01b9uhaq7z7f7liqf0l 2435253 2435252 2026-07-10T08:18:11Z Stashbot 7414 dcausse@deploy2003: helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply 2435253 wikitext text/x-wiki 9rxrqh46e2hvg70fggfs76mnle9g1nw 2435254 2435253 2026-07-10T08:18:15Z Stashbot 7414 dcausse@deploy2003: helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply 2435254 wikitext text/x-wiki 75tmr4dxd3nlueaxw3olg9gv1ehz166 2435256 2435254 2026-07-10T08:24:02Z Stashbot 7414 dcausse@deploy2003: helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply 2435256 wikitext text/x-wiki tgma0lf7kzjwqnrbg6kt8wstap98bco 2435257 2435256 2026-07-10T08:24:04Z Stashbot 7414 dcausse@deploy2003: helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply 2435257 wikitext text/x-wiki 7ba1143nns573b4fjyhkmdavqjpi5ui 2435259 2435257 2026-07-10T08:29:13Z Stashbot 7414 dcausse@deploy2003: helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply 2435259 wikitext text/x-wiki juqyivougsftaoa0252bz0nn0566mii 2435260 2435259 2026-07-10T08:29:15Z Stashbot 7414 dcausse@deploy2003: helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply 2435260 wikitext text/x-wiki 5zx07l27mdpvbe4qqvh73hon213ycse 2435261 2435260 2026-07-10T08:30:21Z Stashbot 7414 JavierMonton: Deploying Refinery at 1abf22ea for changes 1308121/T427068 1306491/T430020 and 1308190 2435261 wikitext text/x-wiki k6dntmrm1h5tkmdfsnejiowlcvzedb5 2435262 2435261 2026-07-10T08:30:55Z Stashbot 7414 javiermonton@deploy2003: Started deploy [analytics/refinery@1abf22e] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@1abf22ea] 2435262 wikitext text/x-wiki mdkwd19w7ikq194pxz6fmxguo5q1ar3 2435264 2435262 2026-07-10T08:32:59Z Stashbot 7414 javiermonton@deploy2003: Finished deploy [analytics/refinery@1abf22e] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@1abf22ea] (duration: 02m 03s) 2435264 wikitext text/x-wiki fdbx9c8ihm8aqyyafeu4kdyexul6kkz 2435265 2435264 2026-07-10T08:33:19Z Stashbot 7414 javiermonton@deploy2003: Started deploy [analytics/refinery@1abf22e]: Regular analytics weekly train [analytics/refinery@1abf22ea] 2435265 wikitext text/x-wiki kguzfbpoimjbnm1tn4drzv7fselvl7z 2435267 2435265 2026-07-10T08:34:36Z Stashbot 7414 bwojtowicz@deploy2003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'llm' for release 'main' . 2435267 wikitext text/x-wiki rooikvgq5trld9vs9w6thq5svbx014f 2435268 2435267 2026-07-10T08:38:20Z Stashbot 7414 bwojtowicz@deploy2003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2435268 wikitext text/x-wiki kzhu2zvcf64weg5jdrzew4i0irwpql1 2435269 2435268 2026-07-10T08:38:37Z Stashbot 7414 javiermonton@deploy2003: Finished deploy [analytics/refinery@1abf22e]: Regular analytics weekly train [analytics/refinery@1abf22ea] (duration: 05m 17s) 2435269 wikitext text/x-wiki gxu2pixcb45znlkqt6jpdj4uzc17hjy 2435270 2435269 2026-07-10T08:38:49Z Stashbot 7414 javiermonton@deploy2003: Started deploy [analytics/refinery@1abf22e] (thin): Regular analytics weekly train THIN [analytics/refinery@1abf22ea] 2435270 wikitext text/x-wiki h3luf1pti846qehdolzci9sw3cw9me4 2435271 2435270 2026-07-10T08:41:01Z Stashbot 7414 javiermonton@deploy2003: Finished deploy [analytics/refinery@1abf22e] (thin): Regular analytics weekly train THIN [analytics/refinery@1abf22ea] (duration: 02m 11s) 2435271 wikitext text/x-wiki gdn4b7qflzzxy3z8khj94n0g6av7dsy 2435273 2435271 2026-07-10T09:03:07Z Stashbot 7414 brouberol@dns1004: START - running authdns-update 2435273 wikitext text/x-wiki lijbf6k2gyw1jw5hbckkg3tufiibflq 2435274 2435273 2026-07-10T09:04:55Z Stashbot 7414 brouberol@dns1004: END - running authdns-update 2435274 wikitext text/x-wiki aqvho0lgrfl03e96a8y8pj2gnqdqk6k 2435276 2435274 2026-07-10T09:06:01Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker1053.eqiad.wmnet 2435276 wikitext text/x-wiki iettplwozoexh2hl2ocysxn1vbv14ek 2435277 2435276 2026-07-10T09:06:05Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1053.eqiad.wmnet 2435277 wikitext text/x-wiki qe7hg4rvk3a71ahdmx27uam6w35g1cl 2435278 2435277 2026-07-10T09:06:40Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1053.eqiad.wmnet 2435278 wikitext text/x-wiki 6kmbiqq6jv8kdwt1f9bpeio2lkxey19 2435279 2435278 2026-07-10T09:06:54Z Stashbot 7414 blake@cumin1003: END (FAIL) - Cookbook sre.k8s.renumber-node (exit_code=99) Renumbering for host wikikube-worker1053.eqiad.wmnet 2435279 wikitext text/x-wiki pzt43fc12zz828bh11dne3gxxsp41b9 2435280 2435279 2026-07-10T09:08:08Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker1053.eqiad.wmnet 2435280 wikitext text/x-wiki te0fe70aioc6gz2nsyb43avxi1bkvhg 2435281 2435280 2026-07-10T09:08:13Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1053.eqiad.wmnet 2435281 wikitext text/x-wiki iqveg4iec9slr8ae8e1z2bln9uq59z0 2435282 2435281 2026-07-10T09:08:14Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1053.eqiad.wmnet 2435282 wikitext text/x-wiki rks1uni7bdm3j1n57brupuouxdaw9fs 2435283 2435282 2026-07-10T09:08:24Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.hosts.reimage for host wikikube-worker1053.eqiad.wmnet with OS trixie 2435283 wikitext text/x-wiki kpjuo2lanq6d364lnoqg2ulz3s7ilif 2435284 2435283 2026-07-10T09:11:03Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.hosts.move-vlan for host wikikube-worker1053 2435284 wikitext text/x-wiki ji21wykru7ohzhr6lywtdk7h6cz10h6 2435285 2435284 2026-07-10T09:11:13Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.dns.netbox 2435285 wikitext text/x-wiki q9xcbq0ckzmtpciw94sdhe28bfurv1n 2435286 2435285 2026-07-10T09:15:28Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1053 - blake@cumin1003" 2435286 wikitext text/x-wiki pcfa6ivibfn8iau8k5hd7s7znjf5r18 2435287 2435286 2026-07-10T09:15:33Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1053 - blake@cumin1003" 2435287 wikitext text/x-wiki 5dx6dowc0h5af93f2r37utlrnuipqeg 2435288 2435287 2026-07-10T09:15:34Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2435288 wikitext text/x-wiki b6mdvuqzh54jpq4uknjhoev18p454ky 2435289 2435288 2026-07-10T09:15:35Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.dns.wipe-cache wikikube-worker1053.eqiad.wmnet 48.32.64.10.in-addr.arpa 8.4.0.0.2.3.0.0.4.6.0.0.0.1.0.0.3.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2435289 wikitext text/x-wiki b6o4kc78zwkk3b4o56538nkx4c7xia6 2435290 2435289 2026-07-10T09:15:37Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker1053.eqiad.wmnet 48.32.64.10.in-addr.arpa 8.4.0.0.2.3.0.0.4.6.0.0.0.1.0.0.3.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2435290 wikitext text/x-wiki gegwk88hvfbs2j0mhm6d9g5bv2tmknw 2435291 2435290 2026-07-10T09:15:38Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1053 2435291 wikitext text/x-wiki 4go6svfd2pbsx0ruhsrjfpehnp2p2ja 2435292 2435291 2026-07-10T09:16:06Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1053 2435292 wikitext text/x-wiki 3kjyd978izb73n8xnamombvnnf4eg99 2435293 2435292 2026-07-10T09:16:07Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1053 2435293 wikitext text/x-wiki dhmwka6wa8d1lsls9dfdksufe4ruxku 2435295 2435293 2026-07-10T09:36:27Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1053.eqiad.wmnet with reason: host reimage 2435295 wikitext text/x-wiki acif4x06r014chioluf6vglec7j8ej4 2435296 2435295 2026-07-10T09:36:35Z Stashbot 7414 kevinbazira@deploy2003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . 2435296 wikitext text/x-wiki jhsz9ckoyppaziscfmg30heix3fimqn 2435297 2435296 2026-07-10T09:37:05Z Stashbot 7414 topranks: apply new IBGP outbound policy on lsw1-e2-codfw T423430 2435297 wikitext text/x-wiki roybis6p83zz0xd7yx5cahf38eogs4a 2435298 2435297 2026-07-10T09:41:52Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1053.eqiad.wmnet with reason: host reimage 2435298 wikitext text/x-wiki ku5u3m2zl07iaed0dhy3hmtaaq1wkos 2435299 2435298 2026-07-10T09:51:50Z Stashbot 7414 cgoubert@cumin1003: START - Cookbook sre.k8s.roll-reimage-nodes rolling reimage on A:wikikube-worker-codfw 2435299 wikitext text/x-wiki bmlgbcg8hxbn36n2ll4u8b6186fqwo5 2435300 2435299 2026-07-10T09:52:01Z Stashbot 7414 cgoubert@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2001-2002,2005-2006,2011-2012].codfw.wmnet 2435300 wikitext text/x-wiki dgqxdicp20m2ymho76v4um0jaw6uve5 2435301 2435300 2026-07-10T09:55:18Z Stashbot 7414 gmodena@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2435301 wikitext text/x-wiki h159uhn1nty4078yvjju71lmam7ziih 2435302 2435301 2026-07-10T09:55:22Z Stashbot 7414 cgoubert@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2001-2002,2005-2006,2011-2012].codfw.wmnet 2435302 wikitext text/x-wiki 1ow5bnufhr92p9pec5sd90xzukuhws3 2435303 2435302 2026-07-10T09:55:52Z Stashbot 7414 cgoubert@cumin1003: START - Cookbook sre.hosts.reimage for host wikikube-worker2001.codfw.wmnet with OS bookworm 2435303 wikitext text/x-wiki sayac826q4rljb6zw8f2skmtvlsqqlx 2435304 2435303 2026-07-10T10:00:34Z Stashbot 7414 gmodena@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2435304 wikitext text/x-wiki 6lm6bc6pjx7ornvmclyirr2q0ni67y8 2435305 2435304 2026-07-10T10:06:55Z Stashbot 7414 brouberol@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2435305 wikitext text/x-wiki mx33x25bdsl6e18ej7xuwe7nh2qte9c 2435306 2435305 2026-07-10T10:07:51Z Stashbot 7414 brouberol@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2435306 wikitext text/x-wiki mjk8d3c6k44wj9q4vyzypgoqjopx4vw 2435307 2435306 2026-07-10T10:08:22Z Stashbot 7414 gmodena@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2435307 wikitext text/x-wiki p6cnc2hvm4r9qjyvcv1m1mhoioau0oc 2435308 2435307 2026-07-10T10:09:00Z Stashbot 7414 gmodena@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2435308 wikitext text/x-wiki opcuwj9pqq7dz36ab0ly1106ci6wj1b 2435309 2435308 2026-07-10T10:11:14Z Stashbot 7414 brouberol@deploy2003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. 2435309 wikitext text/x-wiki tdprrrl9q2cfrq6bq230973vigmx91o 2435310 2435309 2026-07-10T10:11:48Z Stashbot 7414 brouberol@deploy2003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. 2435310 wikitext text/x-wiki mwntsyaqkslo57ivtxv1vyx9z5beu4g 2435311 2435310 2026-07-10T10:15:09Z Stashbot 7414 cgoubert@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2001.codfw.wmnet with reason: host reimage 2435311 wikitext text/x-wiki sdz3oxcg7tumaq7g16dt6nf3oug3qw4 2435312 2435311 2026-07-10T10:24:04Z Stashbot 7414 gmodena@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2435312 wikitext text/x-wiki 7u4a9dhrv41wzrag49h20su86kvssm3 2435313 2435312 2026-07-10T10:24:08Z Stashbot 7414 gmodena@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2435313 wikitext text/x-wiki qvo4tvdh0tniwb6v7uj9rxtbwujhr5x 2435314 2435313 2026-07-10T10:25:10Z Stashbot 7414 cgoubert@cumin1003: END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on wikikube-worker2001.codfw.wmnet with reason: host reimage 2435314 wikitext text/x-wiki epwy05hmu3uw9k7fj9uiniw7o7mobrv 2435315 2435314 2026-07-10T10:27:15Z Stashbot 7414 cgoubert@cumin1003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker2001.codfw.wmnet with OS bookworm 2435315 wikitext text/x-wiki rqazrmmfsqx80rxuyb3w60324nwgkmd 2435316 2435315 2026-07-10T10:27:28Z Stashbot 7414 cgoubert@cumin1003: END (FAIL) - Cookbook sre.k8s.roll-reimage-nodes (exit_code=1) rolling reimage on A:wikikube-worker-codfw 2435316 wikitext text/x-wiki 2bjg1k4kycak5s41vsza24c43z8f3ym 2435317 2435316 2026-07-10T10:30:12Z Stashbot 7414 aokoth@cumin1003: START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1004.wikimedia.org with reason: Security Release - T431656 2435317 wikitext text/x-wiki m32vrvymn8ou2zx4xcpom4412i2q3g1 2435318 2435317 2026-07-10T10:30:21Z Stashbot 7414 cgoubert@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2002,2005-2006,2011-2012].codfw.wmnet 2435318 wikitext text/x-wiki bysenieaixbbrzdkyyrm5w5rvao32b7 2435319 2435318 2026-07-10T10:30:24Z Stashbot 7414 cgoubert@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2002,2005-2006,2011-2012].codfw.wmnet 2435319 wikitext text/x-wiki swfhiam8xqr5gv98x6vhtizkx7if5cp 2435320 2435319 2026-07-10T10:30:44Z Stashbot 7414 cgoubert@cumin1003: START - Cookbook sre.hosts.remove-downtime for wikikube-worker[2002,2005-2006,2011-2012].codfw.wmnet 2435320 wikitext text/x-wiki exz9i32qok08g2o0x7luzgdsjl32q0w 2435321 2435320 2026-07-10T10:30:46Z Stashbot 7414 cgoubert@cumin1003: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for wikikube-worker[2002,2005-2006,2011-2012].codfw.wmnet 2435321 wikitext text/x-wiki s39t5jhb06loow4r1uj7xew53h3gdf1 2435322 2435321 2026-07-10T10:35:46Z Stashbot 7414 topranks: adjust IBGP outbound policy on lsw1-e2-codfw T423430 towards ssw1-e1-codfw 2435322 wikitext text/x-wiki 20u4fqg2sepeddv9tc4xtm4xk78pfkt 2435323 2435322 2026-07-10T10:38:17Z Stashbot 7414 cgoubert@cumin1003: START - Cookbook sre.k8s.roll-reimage-nodes rolling reimage on P{wikikube-worker2001*} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) 2435323 wikitext text/x-wiki 0cdn4it3zrjvf1w1jgmdrpsn52l0tgk 2435324 2435323 2026-07-10T10:38:21Z Stashbot 7414 cgoubert@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2001.codfw.wmnet 2435324 wikitext text/x-wiki 1gsm331amfku4o16gv79dghu4ivoret 2435325 2435324 2026-07-10T10:38:22Z Stashbot 7414 cgoubert@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2001.codfw.wmnet 2435325 wikitext text/x-wiki fjk9dyc0olwf0xyk8ycjgehjzr3ldex 2435326 2435325 2026-07-10T10:38:38Z Stashbot 7414 cgoubert@cumin1003: START - Cookbook sre.hosts.reimage for host wikikube-worker2001.codfw.wmnet with OS trixie 2435326 wikitext text/x-wiki 82vfx0ozgkz5yc9lrk6u8dvnti4gbzr 2435327 2435326 2026-07-10T10:57:15Z Stashbot 7414 aokoth@cumin1003: END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1004.wikimedia.org with reason: Security Release - T431656 2435327 wikitext text/x-wiki 82iebcatybdkdr2q38jlaalsq5qj0hr 2435329 2435327 2026-07-10T10:58:50Z Stashbot 7414 cgoubert@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2001.codfw.wmnet with reason: host reimage 2435329 wikitext text/x-wiki 10nx68qttpiksezpjqqz09z6pr6hp5t 2435330 2435329 2026-07-10T11:01:55Z Stashbot 7414 gmodena@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2435330 wikitext text/x-wiki 2xfoewdt1sanfb3ncfzt3ougnwba1hz 2435331 2435330 2026-07-10T11:02:27Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1053.eqiad.wmnet with OS trixie 2435331 wikitext text/x-wiki 166de5naihkuq1pxlg92f737cjrkptm 2435333 2435331 2026-07-10T11:08:50Z Stashbot 7414 cgoubert@cumin1003: END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on wikikube-worker2001.codfw.wmnet with reason: host reimage 2435333 wikitext text/x-wiki 916z79m5t72vrw8fqsoly3py5ucyuq8 2435334 2435333 2026-07-10T11:13:58Z Stashbot 7414 gmodena@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2435334 wikitext text/x-wiki f8nvz26ilk4bnofeopspqj4vk45yhl4 2435335 2435334 2026-07-10T11:14:39Z Stashbot 7414 jynus@cumin1003: START - Cookbook sre.hosts.remove-downtime for 11 hosts 2435335 wikitext text/x-wiki 3lhod6fb7i5s45t3iler9btv22pyq3m 2435336 2435335 2026-07-10T11:14:46Z Stashbot 7414 jynus@cumin1003: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for 11 hosts 2435336 wikitext text/x-wiki 91nuoalvghpbojxuu7auqpuk051sz14 2435337 2435336 2026-07-10T11:14:54Z Stashbot 7414 gmodena@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2435337 wikitext text/x-wiki aihu5l5cff923awzl5zp8nmo7fk1533 2435338 2435337 2026-07-10T11:15:14Z Stashbot 7414 gmodena@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2435338 wikitext text/x-wiki 02a3l86f6nejgmu45q32dg2pg1n7679 2435339 2435338 2026-07-10T11:16:12Z Stashbot 7414 gmodena@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2435339 wikitext text/x-wiki mncsfe9n1yfmh9r2ml88qatu7tl93ms 2435340 2435339 2026-07-10T11:20:03Z Stashbot 7414 cgoubert@cumin1003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host wikikube-worker2001.codfw.wmnet with OS trixie 2435340 wikitext text/x-wiki oroshg4150h2o6ug3rgsoy4wsv6es50 2435341 2435340 2026-07-10T11:21:32Z Stashbot 7414 jynus@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 6:00:00 on 18 hosts with reason: reboot & upgrade 2435341 wikitext text/x-wiki c7wie4zsku7y8g8me59k0vynab59krc 2435342 2435341 2026-07-10T11:30:07Z Stashbot 7414 gmodena@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2435342 wikitext text/x-wiki cagjdjkrc807c8gvite0x86z25r4ycn 2435343 2435342 2026-07-10T11:30:13Z Stashbot 7414 gmodena@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2435343 wikitext text/x-wiki 960pmwddrurt9hgxuzhhtncthp0dcky 2435344 2435343 2026-07-10T11:31:04Z Stashbot 7414 cgoubert@cumin1003: END (FAIL) - Cookbook sre.k8s.roll-reimage-nodes (exit_code=1) rolling reimage on P{wikikube-worker2001*} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) 2435344 wikitext text/x-wiki 010wl2lx5bmisqdcpkm1mrzss72s66r 2435345 2435344 2026-07-10T11:31:26Z Stashbot 7414 cgoubert@cumin1003: START - Cookbook sre.hosts.remove-downtime for wikikube-worker2001.codfw.wmnet 2435345 wikitext text/x-wiki g8dxmomwld6qc3pl99cpkx1owzvxx7p 2435346 2435345 2026-07-10T11:31:27Z Stashbot 7414 cgoubert@cumin1003: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for wikikube-worker2001.codfw.wmnet 2435346 wikitext text/x-wiki 5m83et1axfbs35otfcmtvg33819fk0y 2435347 2435346 2026-07-10T11:32:23Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1053.eqiad.wmnet 2435347 wikitext text/x-wiki jfxr6by4l86a6xxhnbdyhrmpx5k41bo 2435348 2435347 2026-07-10T11:32:24Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1053.eqiad.wmnet 2435348 wikitext text/x-wiki dadz4jnzvsp1jtz8sp004mhhy5l3ho6 2435349 2435348 2026-07-10T11:32:25Z Stashbot 7414 cgoubert@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2001.codfw.wmnet 2435349 wikitext text/x-wiki daabgdmwjbzzr9ltc2qyfbygxa6qy9t 2435350 2435349 2026-07-10T11:32:26Z Stashbot 7414 blake@cumin1003: END (FAIL) - Cookbook sre.k8s.renumber-node (exit_code=1) Renumbering for host wikikube-worker1053.eqiad.wmnet 2435350 wikitext text/x-wiki 4muspwj7lb9o63k0bz2lry2mi5pnwfh 2435351 2435350 2026-07-10T11:32:27Z Stashbot 7414 cgoubert@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2001.codfw.wmnet 2435351 wikitext text/x-wiki kzxfyoxo4uuggfz3rkb7itigd0j48nm 2435352 2435351 2026-07-10T11:44:05Z Stashbot 7414 gmodena@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2435352 wikitext text/x-wiki ix24gjwc40wsuy2sk9yez34syyde3kl 2435354 2435352 2026-07-10T11:47:37Z Stashbot 7414 gmodena@deploy2003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2435354 wikitext text/x-wiki pxufi4297klwqvk0y8bdgl1tvki0xd4 2435355 2435354 2026-07-10T11:48:21Z Stashbot 7414 gmodena@deploy2003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2435355 wikitext text/x-wiki 8av9vbzsndtr878abp7w36lzduh1vc8 2435356 2435355 2026-07-10T11:49:09Z Stashbot 7414 gmodena@deploy2003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs: apply 2435356 wikitext text/x-wiki j94eeloda8myv8g8y75oqheyg2yoh7u 2435357 2435356 2026-07-10T11:51:17Z Stashbot 7414 gmodena@deploy2003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs: apply 2435357 wikitext text/x-wiki fj4ph8rotjq14xzvrkv2s5cj6hun716 498 14256 2435110 2414311 2026-07-09T20:07:56Z Stashbot 7414 wmbot~bd808@tools-bastion-14: restarted irc bot because of bouncer restart (T431756, T410540) 2435110 wikitext text/x-wiki niltifb7y85hi6hmrbyxfmi5l4iukfd 0 17290 2435294 2434921 2026-07-10T09:16:18Z Stashbot 7414 James_F: Docker: [commit-message-validator] Update to 2.3.0 2435294 wikitext text/x-wiki 7w12a9pq9ex8052ui33wu7o16h5rinv 2435358 2435294 2026-07-10T11:56:10Z Stashbot 7414 James_F: Zuul: Disable all browser tests on release branches except Wikibase's, for T430415 2435358 wikitext text/x-wiki 0gplb5yvsu2rqbof64al09o7swfcpxv 0 22503 2435205 2434007 2026-07-09T23:43:53Z Ladsgroup 1264 /* Currently reserved values */ 2435205 wikitext text/x-wiki 9mqozcf0h6y9aiy9tk1tye4em9baueg 498 30942 2434945 2434850 2026-07-09T12:29:47Z Stashbot 7414 godog: wmcs-openstack aggregate delete maintenance 2434945 wikitext text/x-wiki dvnpeg5p2zr6a735bprbzf0q917keb4 2434960 2434945 2026-07-09T12:53:54Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/332 2434960 wikitext text/x-wiki q7sefypt3x4lhnl22dndk1q8z6q4wpn 2434962 2434960 2026-07-09T12:54:19Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/332 2434962 wikitext text/x-wiki cqziugtuac44l3fy4laa2qazklxupc6 0 440900 2435255 2432751 2026-07-10T08:22:50Z Filippo Giunchedi 2939 /* cloudrabbitXXXX */ 2435255 wikitext text/x-wiki 5uh8opqkf4pw2qybymp1syqmwicnjj0 2435266 2435255 2026-07-10T08:34:11Z Filippo Giunchedi 2939 /* cloudvirtXXXX */ 2435266 wikitext text/x-wiki fbkd0sino9omuu7930ae149jdbur1og 0 441820 2435151 2433003 2026-07-09T21:20:43Z BKing (WMF) 29017 2435151 wikitext text/x-wiki e7zz4p8bwfak0x7b1swz6wa8pxzt8sf 0 441958 2435258 2331365 2026-07-10T08:26:12Z Filippo Giunchedi 2939 2435258 wikitext text/x-wiki mf5c0tols971402jkqf8i42c83flmiq 0 443904 2434948 2396291 2026-07-09T12:37:04Z KSoučková-WMF 35993 update active deployment server to deploy2003 2434948 wikitext text/x-wiki ga9cstbl8hjdpioa6fni3kx7g6me6ax 0 445509 2434947 2178226 2026-07-09T12:31:23Z Filippo Giunchedi 2939 /* Properties */ Remove mentions of maintenance aggregate 2434947 wikitext text/x-wiki k8nuv7xraybjoo4vwn22ybgep9t6n5i 0 445989 2435074 2372286 2026-07-09T16:28:08Z BCornwall-WMF 31521 /* Technical notes */ Remove wikidough prefix 2435074 wikitext text/x-wiki 99k6uvjyhfjptbdflkhl347q3va2vqo 498 446686 2434973 2422243 2026-07-09T13:29:59Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.refresh_puppet_certs on metricsinfra-controller-3.metricsinfra.eqiad1.wikimedia.cloud 2434973 wikitext text/x-wiki oudvgqlohe0m5p6m9s3na50ma2k3ymz 2434974 2434973 2026-07-09T13:30:08Z Stashbot 7414 taavi@cloudcumin1001: END (FAIL) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=99) on metricsinfra-controller-3.metricsinfra.eqiad1.wikimedia.cloud 2434974 wikitext text/x-wiki cy5flcm2sd9lo3fqxguarfd6q76sw2y 2434991 2434974 2026-07-09T13:40:27Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.refresh_puppet_certs on metricsinfra-controller-3.metricsinfra.eqiad1.wikimedia.cloud 2434991 wikitext text/x-wiki q3bw1yfpu5s5nhrxnc376xghokyge7x 2434995 2434991 2026-07-09T13:42:05Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.refresh_puppet_certs (exit_code=0) on metricsinfra-controller-3.metricsinfra.eqiad1.wikimedia.cloud 2434995 wikitext text/x-wiki mvz997c084spdsir8tn9f8z2vieufjk 0 447310 2435105 2434677 2026-07-09T19:52:19Z MPopov (WMF) 5891 /* Experimentation templates */ Switch template links to the new phab forms 2435105 wikitext text/x-wiki 9g4bfk3bukl6bkbxtkoxmd3xizxv6y6 2435106 2435105 2026-07-09T19:52:43Z MPopov (WMF) 5891 /* Experimentation templates */ 2435106 wikitext text/x-wiki 2354j1b4x5yacsmlx3ht0ylt4h03smw 0 449160 2435206 2434686 2026-07-10T00:02:11Z Dexbot 30554 Bot: Updating the report 2435206 wikitext text/x-wiki 9p00ouu38pagrv6qcurbqc4qywgijgz 0 450818 2435011 2433456 2026-07-09T14:00:21Z BKing (WMF) 29017 BKing (WMF) moved page [[Search/S3 Plugin Enable]] to [[Search/Backup and Recovery]]: Clarity on what the page is actually about 2433456 wikitext text/x-wiki fdd3c45qi3v34seonht3tlkx92s0oeq 2435054 2435011 2026-07-09T14:55:36Z BKing (WMF) 29017 2435054 wikitext text/x-wiki 01pm9iiquiufzgsar63uro8yeih3wuj 0 451256 2435208 2062712 2026-07-10T00:51:54Z WFan (WMF) 38087 2435208 wikitext text/x-wiki 2m8cab20bjx87xaku8zr4zb6h2pqp4x 2435209 2435208 2026-07-10T01:09:31Z WFan (WMF) 38087 2435209 wikitext text/x-wiki et4j1aa7preuh13vvqq0kjbr86f2v1a 0 452153 2434964 2430736 2026-07-09T12:59:59Z Taavi-WMF 41365 boldly add some clear owners 2434964 wikitext text/x-wiki bocyo5emd6mntlko53b5h4tiemnzv3i 0 459044 2435099 2428280 2026-07-09T19:10:26Z BKing (WMF) 29017 /* Operations */ 2435099 wikitext text/x-wiki fbhb1azqxfgr40tchiqxfjyx3r3o1gs 0 459290 2434980 2434876 2026-07-09T13:34:23Z APizzata-WMF 47941 2434980 wikitext text/x-wiki g75hhwjdy1eprcd6b9fekpnjek9pked 2435059 2434980 2026-07-09T15:08:01Z JMonton-WMF 47887 add pending deployment 2435059 wikitext text/x-wiki f5x2zqtswfn5nl4xxx14zn42vtl21pe 2435263 2435059 2026-07-10T08:32:49Z JMonton-WMF 47887 Deploy refinery 2435263 wikitext text/x-wiki fo8gnal4j4344zqy90t4o68ix3uvfhr 2435332 2435263 2026-07-10T11:07:54Z APizzata-WMF 47941 /* YYYY-MM-DD NEXT TUESDAY TRAIN (REPLACE THIS AFTER DEPLOY) */ 2435332 wikitext text/x-wiki savz5j7or42zb945kgdvb96auy4nodp 2435353 2435332 2026-07-10T11:46:38Z APizzata-WMF 47941 /* YYYY-MM-DD NEXT TUESDAY TRAIN (REPLACE THIS AFTER DEPLOY) */ 2435353 wikitext text/x-wiki c98olf5qi59z8fngru0q3tih5mfgpw5 0 459920 2435090 2424934 2026-07-09T17:36:13Z RLazarus (WMF) 15215 /* How services are defined */ 2435090 wikitext text/x-wiki m6ismitjouyhw8r1us4fqh82t257744 0 460089 2434966 2415834 2026-07-09T13:06:52Z CGoubert-WMF 32775 /* Service endpoints */ Add service mesh listener endpoint 2434966 wikitext text/x-wiki 9y3ankio6lepmq5jcxt7uwa0z9zhmgy 0 460231 2435064 2433330 2026-07-09T15:14:29Z BKing (WMF) 29017 2435064 wikitext text/x-wiki 9e8fiawrxy5uax090z1nnq1avr4o2ou 2435067 2435064 2026-07-09T15:17:25Z BKing (WMF) 29017 /* Dealing with an under-replicated cluster */ 2435067 wikitext text/x-wiki ef10ugj28ut7zy8nh4l30ba9saln5s5 116 460408 2435214 2433026 2026-07-10T05:16:59Z Ancient9983 52221 Fill out project license section 2435214 wikitext text/x-wiki j2kiu27dp2ynr4f8nwvkk3pen65mcuj 2435215 2435214 2026-07-10T05:18:08Z Ancient9983 52221 /* Credits */ Add contributor info 2435215 wikitext text/x-wiki 5x31efeuxvqv3x57jt64spkucoj5q4x 2435216 2435215 2026-07-10T05:31:52Z Ancient9983 52221 Remove code structure section for now. 2435216 wikitext text/x-wiki 8zqictce8w9pm99yyp5ez982zr5lf00 2435217 2435216 2026-07-10T05:34:16Z Ancient9983 52221 /* Technical implementation */ 2435217 wikitext text/x-wiki ltpzn9z2jmvfqbtfce7awbeojpy4mf6 2435218 2435217 2026-07-10T05:37:12Z Ancient9983 52221 /* Libraries used */ 2435218 wikitext text/x-wiki bx98tj4qkx7efiw26ihograym9qelij 2435219 2435218 2026-07-10T05:41:45Z Ancient9983 52221 /* Technical implementation */ Flesh out details of tools/libraries used in the project. 2435219 wikitext text/x-wiki eaoynmb8vlcwftchnxeo6gavm3onhle 2435220 2435219 2026-07-10T05:45:14Z Ancient9983 52221 /* Set up */ Fill out dev setup section. 2435220 wikitext text/x-wiki n2925bul1z1zykpa2lkub4veie2k3id 2435221 2435220 2026-07-10T05:46:11Z Ancient9983 52221 /* Set up */ 2435221 wikitext text/x-wiki 0kbzuwe92l3qsu1uygkt7hx7rdfdlhh 2435222 2435221 2026-07-10T05:46:25Z Ancient9983 52221 /* Configure */ 2435222 wikitext text/x-wiki 2kqm4kcf3hauvqfe6rnof08qbhztn5t 2435223 2435222 2026-07-10T05:46:48Z Ancient9983 52221 /* Local development */ Remove unneeded installation step. 2435223 wikitext text/x-wiki qjaxsf8r4wqh720l0wecnfeq9v3drqt 2435224 2435223 2026-07-10T05:49:36Z Ancient9983 52221 /* Build and test */ Fill out build/test section. 2435224 wikitext text/x-wiki 3bsq7yhhhbwf76w71rrj4gsci4ybg3f 2435225 2435224 2026-07-10T05:50:10Z Ancient9983 52221 /* Local development */ Remove debugging section for now. 2435225 wikitext text/x-wiki 24lrq9btimbc9u4iwyycmgds3caza8d 2435226 2435225 2026-07-10T06:00:49Z Ancient9983 52221 /* WikiData Authority Control Tool */ Fill out initial intro section 2435226 wikitext text/x-wiki l91qyrvnpb0u04vy78mvr5cvgzt7uwb 2435227 2435226 2026-07-10T06:17:43Z Ancient9983 52221 /* Basic functionality */ Fill out basic functionality section 2435227 wikitext text/x-wiki 8ldgnjhadakew6dpscj7vbz536jegdo 2435228 2435227 2026-07-10T06:18:44Z Ancient9983 52221 /* Basic functionality */ Clarify wording 2435228 wikitext text/x-wiki 060bf4cd7c33g8q0azk3pgx31n2ldlh 2435229 2435228 2026-07-10T06:27:19Z Ancient9983 52221 /* How to use WikiData Authority Control Tool */ Fill out how to use section 2435229 wikitext text/x-wiki 3f2if9ouo2ze3k0ckw50dghwm9tg2aj 2435230 2435229 2026-07-10T06:29:03Z Ancient9983 52221 Clearly separate out user documentation from developer documentation 2435230 wikitext text/x-wiki apyvln302k4fayrelx1bezv43z8xbjb 2435231 2435230 2026-07-10T06:29:40Z Ancient9983 52221 2435231 wikitext text/x-wiki es3d3luu65neaz9sg5v0jjrmecceph9 2435233 2435231 2026-07-10T06:56:22Z Ancient9983 52221 /* User documentation */ Remove placeholder Troubleshooting section for now. 2435233 wikitext text/x-wiki m81tvb571roivdxlm9ce5ttffuq5sni 2435234 2435233 2026-07-10T07:01:18Z Ancient9983 52221 /* How to contribute */ Fill out basic contribution process details 2435234 wikitext text/x-wiki 28goxda9eyf2w5pau6m86uhlaf9g2p6 2435235 2435234 2026-07-10T07:06:03Z Ancient9983 52221 /* WikiData Authority Control Tool */ 2435235 wikitext text/x-wiki f738zuk0v2qiwqptsx533c0iammklzw 2435236 2435235 2026-07-10T07:07:43Z Ancient9983 52221 /* WikiData Authority Control Tool */ Remove TODO which is done. 2435236 wikitext text/x-wiki qh5o796zyw3rwc88ig4h1myk63yf726 2435237 2435236 2026-07-10T07:12:53Z Ancient9983 52221 Add project image 2435237 wikitext text/x-wiki 7qajligpfob2rywwbyyov2z2bbzr05t 2435238 2435237 2026-07-10T07:13:21Z Ancient9983 52221 2435238 wikitext text/x-wiki bd9ehjwaaihwnnhq3phrxhl1nqx8gn0 2435239 2435238 2026-07-10T07:15:20Z Ancient9983 52221 Fix up image sizing 2435239 wikitext text/x-wiki qkps2h2uhz14qxpo7ey6c7s24vnh6gk 1 460416 2435207 2433218 2026-07-10T00:15:44Z Jheald 3726 /* federated MWAPI server ? */ new section 2435207 wikitext text/x-wiki p0hkyup1uzo2hqodeexuuk3t9f96nh0 0 460417 2435004 2433286 2026-07-09T13:55:18Z ISarantopoulos-WMF 34784 2435004 wikitext text/x-wiki 54z8j3g0hc7c5l3xb4x7mqldvk9ep1x 12 460432 2434949 2026-07-09T12:39:50Z KSoučková-WMF 35993 add deploy2003 fingerprints 2434949 wikitext text/x-wiki 91ug033w5zjpsdardchgrv6vew2e7ya 2434950 2434949 2026-07-09T12:40:51Z KSoučková-WMF 35993 Protected "[[Help:SSH Fingerprints/deploy2003.codfw.wmnet]]": prevent tampering with published fingerprint ([Edit=Allow only administrators] (indefinite) [Move=Allow only administrators] (indefinite)) 2434949 wikitext text/x-wiki 91ug033w5zjpsdardchgrv6vew2e7ya 0 460433 2435012 2026-07-09T14:00:21Z BKing (WMF) 29017 BKing (WMF) moved page [[Search/S3 Plugin Enable]] to [[Search/Backup and Recovery]]: Clarity on what the page is actually about 2435012 wikitext text/x-wiki k4mv1vay6vdy2hkn85e3fytrrsul5om 0 460434 2435080 2026-07-09T16:58:22Z CStone (WMF) 38439 Created page with "add things" 2435080 wikitext text/x-wiki 0s38hisu0rp18iap0ujfqnzscbo6vwa 3 460435 2435212 2026-07-10T05:04:53Z StrikerBot 8475 Welcome to Toolforge! 2435212 wikitext text/x-wiki 3ud64yk8blcizfamv32uhezc0q942eb 3 460436 2435213 2026-07-10T05:14:49Z StrikerBot 8475 Welcome to Toolforge! 2435213 wikitext text/x-wiki et1v6emabswoipr9ca77q3hun2h0995 3 460437 2435272 2026-07-10T09:02:56Z StrikerBot 8475 Welcome to Toolforge! 2435272 wikitext text/x-wiki b95y1mlebnha9ejk4dklkvuzfwota4t 3 460438 2435275 2026-07-10T09:05:01Z StrikerBot 8475 Welcome to Toolforge! 2435275 wikitext text/x-wiki 4ke8itso0b2983f487vdkc4zbytyq50 3 460439 2435328 2026-07-10T10:57:20Z Dmdjdu 54679 /* */ 2435328 wikitext text/x-wiki endv4j48moso296t78o7z41nxdktyly