Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.17 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 3086 2452778 2452286 2026-08-30T20:51:25Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2452778 wikitext text/x-wiki qm9zcsr5lnx5bff01z9uyoiq6do3j29 2452779 2452778 2026-08-30T20:56:38Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api 2452779 wikitext text/x-wiki 1icubxlgq2y2sf6lprfzf2vm7tkabzv 0 4108 2452793 2452774 2026-08-31T07:11:37Z KartikMistry 1115 Removed AG patch. 2452793 wikitext text/x-wiki jaxyf27z2f1oaa6c4uxk70zk04c2fo6 498 6726 2452776 2452282 2026-08-30T20:12:34Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2452776 wikitext text/x-wiki 3aqybm5zxqd70kc8yaax3g6qqz4nhsh 2452777 2452776 2026-08-30T20:17:15Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api 2452777 wikitext text/x-wiki 6nc681aoki1riwfzz98dmka0gzw4fu1 0 7919 2452782 2452771 2026-08-31T02:00:25Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2452782 wikitext text/x-wiki 7vovtpkyfziqrrps6z172f8y8seal91 2452783 2452782 2026-08-31T02:08:41Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 08m 15s) 2452783 wikitext text/x-wiki 87kqb4xqnlif9w2q2r3xher6g7p7msd 2452784 2452783 2026-08-31T03:11:06Z Stashbot 7414 tstarling@deploy1003: Started scap sync-world: Backport for [[gerrit:1332525|Produnto: use wgCopyUploadProxy to contact GitLab (T421436)]] 2452784 wikitext text/x-wiki bobroermp5t7uw7guwf71lsrm8pan6v 2452786 2452784 2026-08-31T03:29:28Z Stashbot 7414 tstarling@deploy1003: tstarling: Backport for [[gerrit:1332525|Produnto: use wgCopyUploadProxy to contact GitLab (T421436)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2452786 wikitext text/x-wiki sh3blgwxqfbgljbrrt1kezdq6zq4prz 2452788 2452786 2026-08-31T03:31:11Z Stashbot 7414 tstarling@deploy1003: tstarling: Continuing with deployment 2452788 wikitext text/x-wiki 15albuis6nbx8rnupr2h4hfpzddjz8v 2452789 2452788 2026-08-31T03:44:26Z Stashbot 7414 tstarling@deploy1003: Finished scap sync-world: Backport for [[gerrit:1332525|Produnto: use wgCopyUploadProxy to contact GitLab (T421436)]] (duration: 33m 20s) 2452789 wikitext text/x-wiki 7n579fbj15fy3m6s57hhay1rfwpyvla 2452791 2452789 2026-08-31T07:04:12Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. 2452791 wikitext text/x-wiki 2pqzusrzm1szonul2w41fb46y3ipbea 2452792 2452791 2026-08-31T07:05:06Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. 2452792 wikitext text/x-wiki bx97fm6rf0ep8w8czohobz1mhjq7jvn 2452794 2452792 2026-08-31T07:15:14Z Stashbot 7414 kartik@deploy1003: Started scap sync-world: Backport for [[gerrit:1332474|kowiki: convert extendedconfirmed calculation to begin from first edit (T436449)]] 2452794 wikitext text/x-wiki sr88n5i9t2lbv0vgt042giupqe10wmv 2452795 2452794 2026-08-31T07:19:45Z Stashbot 7414 kartik@deploy1003: kartik, revi: Backport for [[gerrit:1332474|kowiki: convert extendedconfirmed calculation to begin from first edit (T436449)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2452795 wikitext text/x-wiki t8xe4c8kl6kqvken1gzsmiwvooqh8ph 2452796 2452795 2026-08-31T07:20:37Z Stashbot 7414 jelto@deploy1003: helmfile [staging] START helmfile.d/services/miscweb: apply 2452796 wikitext text/x-wiki b0ccsczjlwhx2b15r819psai6386i5j 2452797 2452796 2026-08-31T07:21:38Z Stashbot 7414 jelto@deploy1003: helmfile [staging] DONE helmfile.d/services/miscweb: apply 2452797 wikitext text/x-wiki d30x3kbt71lkuzxpci13e9a2lsjy9vs 2452798 2452797 2026-08-31T07:22:27Z Stashbot 7414 kartik@deploy1003: kartik, revi: Continuing with deployment 2452798 wikitext text/x-wiki amhps14up4bkotvpw12077xeno6hacj 2452799 2452798 2026-08-31T07:30:15Z Stashbot 7414 kartik@deploy1003: Finished scap sync-world: Backport for [[gerrit:1332474|kowiki: convert extendedconfirmed calculation to begin from first edit (T436449)]] (duration: 15m 00s) 2452799 wikitext text/x-wiki 2wq244exl698djwu3sgdi4pukr57wle 2452800 2452799 2026-08-31T07:31:44Z Stashbot 7414 moritzm: installing openssl security updates 2452800 wikitext text/x-wiki gjpvcb2a4455rdtjungw934gttfr32e 2452801 2452800 2026-08-31T07:33:27Z Stashbot 7414 kartik@deploy1003: Started scap sync-world: Backport for [[gerrit:1332181|thwikibooks: update wordmark and tagline (T436426)]] 2452801 wikitext text/x-wiki kz9339xysx3vi0jcgylcz2z8gfgikti 2452802 2452801 2026-08-31T07:37:22Z Stashbot 7414 kartik@deploy1003: hamishz, kartik: Backport for [[gerrit:1332181|thwikibooks: update wordmark and tagline (T436426)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2452802 wikitext text/x-wiki a4o0yv4ozuoxmbenikqbqzpj9vi4t95 2452803 2452802 2026-08-31T07:38:31Z Stashbot 7414 kartik@deploy1003: hamishz, kartik: Rolling back deployment 2452803 wikitext text/x-wiki 4pzucq0ve2mmex6j5kw8yuexxszeeju 2452804 2452803 2026-08-31T07:41:08Z Stashbot 7414 kartik@deploy1003: Finished scap sync-world: Backport for [[gerrit:1332181|thwikibooks: update wordmark and tagline (T436426)]] (duration: 07m 41s) 2452804 wikitext text/x-wiki 47s9pyi60tmymbjkfkkq9pd2mnvr8gc 2452805 2452804 2026-08-31T08:01:56Z Stashbot 7414 moritzm: installing Linux 6.12.107 on Trixie hosts 2452805 wikitext text/x-wiki ai5qejv6x5y2z01faq30c2s7z3i1wwt 2452806 2452805 2026-08-31T08:39:32Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies rolling restart_daemons on A:swift-fe 2452806 wikitext text/x-wiki t2qlalgvq8ihheln1erdnm1ka69ppb6 2452807 2452806 2026-08-31T08:39:55Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.swift.roll-restart-reboot-swift-thanos-proxies rolling restart_daemons on A:thanos-fe 2452807 wikitext text/x-wiki 9hayf62ek0l1caoge9gk9e6vccclbjk 2452809 2452807 2026-08-31T08:42:49Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts pki1002.eqiad.wmnet 2452809 wikitext text/x-wiki gz25ozxpuqn04h6cpe2pui964os95m6 2452810 2452809 2026-08-31T08:43:54Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-thanos-proxies (exit_code=0) rolling restart_daemons on A:thanos-fe 2452810 wikitext text/x-wiki os8um55i2c71ptygcouimnyd2bcf0dn 2452811 2452810 2026-08-31T08:49:33Z Stashbot 7414 moritzm: installing emacs security updates 2452811 wikitext text/x-wiki ocm4e6degbehgha1pqce1p73l469e7t 2452812 2452811 2026-08-31T08:56:37Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies (exit_code=0) rolling restart_daemons on A:swift-fe 2452812 wikitext text/x-wiki kbfdihrpuammdms03g5hv3yvnp25ebq 2452813 2452812 2026-08-31T08:57:07Z Stashbot 7414 hashar: Upgrading CI Jenkins 2.555.3 to 2.568.2 2452813 wikitext text/x-wiki in3g20ty3ph5zzuw4pqz2iw0xu1mqz9 2452814 2452813 2026-08-31T08:58:17Z Stashbot 7414 marostegui: Stop mariadb on sanitarium s2,s4,s6,s7 there will be lag on wikireplicas for those sections T407942 2452814 wikitext text/x-wiki gvlq8ag2p7ccnnu1g9f2mrc567utpws 2452815 2452814 2026-08-31T08:58:19Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on 22 hosts with reason: Cloning 2452815 wikitext text/x-wiki 2abrcb9k2dc4fq4w8tgy35d6dqaeg5h 2452816 2452815 2026-08-31T09:06:35Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.reboot-single for host pki1002.eqiad.wmnet 2452816 wikitext text/x-wiki ogz6214tr2hh0d5d3ri07nsk4m8i6af 2452818 2452816 2026-08-31T09:16:41Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host pki1002.eqiad.wmnet 2452818 wikitext text/x-wiki e09i97mxr5c7yi3xbnf86wn5gfqzff6 2452819 2452818 2026-08-31T09:16:43Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts pki1002.eqiad.wmnet 2452819 wikitext text/x-wiki knmhkagdijibn1t130e2ual993w28df 2452820 2452819 2026-08-31T09:21:21Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.provision for host pki1002.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2452820 wikitext text/x-wiki 3iszskg44gbwnl65pgctvcedwm9czwv 2452821 2452820 2026-08-31T09:24:05Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.reboot-nodes rolling reboot on A:aux-master-eqiad 2452821 wikitext text/x-wiki b7wnog6qwulr64dq9r7uoe49rkiv4bl 2452822 2452821 2026-08-31T09:24:09Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-ctrl1002.eqiad.wmnet 2452822 wikitext text/x-wiki 91camrib7wvsosgwpkl5o8vdc59rg30 2452823 2452822 2026-08-31T09:24:09Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-ctrl1002.eqiad.wmnet 2452823 wikitext text/x-wiki gii59x3r5et2ttzhoqnd1bvfocxi575 2452824 2452823 2026-08-31T09:29:11Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host pki1002.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2452824 wikitext text/x-wiki aqjli52d4dub965og9g28jl1blxaww6 2452825 2452824 2026-08-31T09:29:12Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-ctrl1002.eqiad.wmnet 2452825 wikitext text/x-wiki sg5x7586rlbtvpdz0ik9hu47urshnzb 2452826 2452825 2026-08-31T09:29:13Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-ctrl1002.eqiad.wmnet 2452826 wikitext text/x-wiki a0lfothxwblgs9nhsa11rndktlnfkzt 2452827 2452826 2026-08-31T09:29:18Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-ctrl1003.eqiad.wmnet 2452827 wikitext text/x-wiki 5b8fkp19112b5za82t8apx8x4mcebz0 2452828 2452827 2026-08-31T09:29:18Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-ctrl1003.eqiad.wmnet 2452828 wikitext text/x-wiki bt6nz33mi6io7n7okgchfazeqdx68xx 2452829 2452828 2026-08-31T09:30:15Z Stashbot 7414 elukey@puppetserver1001: conftool action : set/pooled=true; selector: dnsdisc=pki,name=eqiad 2452829 wikitext text/x-wiki jjhka47y8sixpi4s9gplqile5lq4c8j 2452830 2452829 2026-08-31T09:34:13Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-ctrl1003.eqiad.wmnet 2452830 wikitext text/x-wiki 5yxul1x168vjgz4op2tl9mjcjm3h1y4 2452831 2452830 2026-08-31T09:34:14Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-ctrl1003.eqiad.wmnet 2452831 wikitext text/x-wiki s7hmtrpl14mn0lrcz7drz2f08jdtpwv 2452832 2452831 2026-08-31T09:34:14Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on A:aux-master-eqiad 2452832 wikitext text/x-wiki dbehwiuf797vi6mvfchm0za39bji4h0 2452833 2452832 2026-08-31T09:37:11Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.reboot-nodes rolling reboot on A:aux-master-codfw 2452833 wikitext text/x-wiki p6s54di00acm9yxkf79l2ltnqtw95fr 2452834 2452833 2026-08-31T09:37:15Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-ctrl2002.codfw.wmnet 2452834 wikitext text/x-wiki tr4rca8rtdg39tvoqfcv30g82cq5wui 2452835 2452834 2026-08-31T09:37:16Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-ctrl2002.codfw.wmnet 2452835 wikitext text/x-wiki rgdkj5uj56ntgb2f9h3vubol0u3tm9k 2452836 2452835 2026-08-31T09:42:03Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-ctrl2002.codfw.wmnet 2452836 wikitext text/x-wiki ie84deono6dv6hgd22pn1idkdstp62g 2452837 2452836 2026-08-31T09:42:05Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-ctrl2002.codfw.wmnet 2452837 wikitext text/x-wiki qh9tbxyrpsemix90vxhwncucp0upz9x 2452838 2452837 2026-08-31T09:42:11Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-ctrl2003.codfw.wmnet 2452838 wikitext text/x-wiki s6acrfumjojvy12an2k3b36pf4l7yzt 2452839 2452838 2026-08-31T09:42:12Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-ctrl2003.codfw.wmnet 2452839 wikitext text/x-wiki dbwhkhps1cq82uxv5x671w0t6xukgwu 2452840 2452839 2026-08-31T09:47:20Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-ctrl2003.codfw.wmnet 2452840 wikitext text/x-wiki 8fxu4opuh3fodlqlpe2eqxs2qvjncpc 2452841 2452840 2026-08-31T09:47:21Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-ctrl2003.codfw.wmnet 2452841 wikitext text/x-wiki 54k6ix8t5wr94xvmhgkput9tpmos4so 2452842 2452841 2026-08-31T09:47:22Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on A:aux-master-codfw 2452842 wikitext text/x-wiki 9gbwuuz1d9qx62sf1sk1bkvwepdn5ue 2452843 2452842 2026-08-31T09:59:40Z Stashbot 7414 fabfur: disabled puppet on A:cp to gradually apply https://gerrit.wikimedia.org/r/c/operations/puppet/+/1330314, starting from cp6016 2452843 wikitext text/x-wiki s2fhcmr0a5xe8dvjnq1x0hhw7761htn 2452844 2452843 2026-08-31T10:01:02Z Stashbot 7414 ozge@deploy1003: helmfile [staging] START helmfile.d/services/linkrecommendation: apply 2452844 wikitext text/x-wiki 2tw1r7d2odrsgrm9nwse830dijxpc38 2452845 2452844 2026-08-31T10:02:09Z Stashbot 7414 ozge@deploy1003: helmfile [staging] DONE helmfile.d/services/linkrecommendation: apply 2452845 wikitext text/x-wiki 8iq4tssp94koxxehpswdj5q22sk4vcn 2452846 2452845 2026-08-31T10:07:03Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.reboot-nodes rolling reboot on P{aux-k8s-worker[1006-1009].eqiad.wmnet} and (A:aux-master-eqiad or A:aux-worker-eqiad) 2452846 wikitext text/x-wiki 96qi5io4dbd0rf6on2hctax0n7akxl1 2452847 2452846 2026-08-31T10:07:07Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker1006.eqiad.wmnet 2452847 wikitext text/x-wiki 27vn4vkerw5y7c7fzmy2dl4w4pumh80 2452848 2452847 2026-08-31T10:07:29Z Stashbot 7414 fabfur: enable puppet on A:cp to apply https://gerrit.wikimedia.org/r/c/operations/puppet/+/1330314 (T434766) 2452848 wikitext text/x-wiki q6psgrrmzxaxnspbamlag4fsoyli07q 2452849 2452848 2026-08-31T10:07:43Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker1006.eqiad.wmnet 2452849 wikitext text/x-wiki kzttic6fmzbh2gfor235c5que6y24cx 2452850 2452849 2026-08-31T10:10:16Z Stashbot 7414 ozge@deploy1003: helmfile [eqiad] START helmfile.d/services/linkrecommendation: apply 2452850 wikitext text/x-wiki gmm08fv70ayzsu8ijsov3d7ltpimsq5 2452851 2452850 2026-08-31T10:12:24Z Stashbot 7414 ozge@deploy1003: helmfile [eqiad] DONE helmfile.d/services/linkrecommendation: apply 2452851 wikitext text/x-wiki t1w6z8h0v7xto98zjdc6dg904zctvfq 2452852 2452851 2026-08-31T10:12:51Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker1006.eqiad.wmnet 2452852 wikitext text/x-wiki h6ifh58qby32cmu7cnrk127itgki73l 2452853 2452852 2026-08-31T10:12:51Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker1006.eqiad.wmnet 2452853 wikitext text/x-wiki efowge16fzu92d1bwq3my91ix2jccfl 2452854 2452853 2026-08-31T10:12:58Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker1007.eqiad.wmnet 2452854 wikitext text/x-wiki 315s42yh05wnzzuuvt7dphvcbv5lqnb 2452855 2452854 2026-08-31T10:13:33Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker1007.eqiad.wmnet 2452855 wikitext text/x-wiki n9fi3d480xysmcfl0mkggs4xcxcrs4u 2452856 2452855 2026-08-31T10:14:07Z Stashbot 7414 ozge@deploy1003: helmfile [codfw] START helmfile.d/services/linkrecommendation: apply 2452856 wikitext text/x-wiki ehju7njbuz9wvstmjmw7b0h8gazgwur 2452857 2452856 2026-08-31T10:15:53Z Stashbot 7414 ozge@deploy1003: helmfile [codfw] DONE helmfile.d/services/linkrecommendation: apply 2452857 wikitext text/x-wiki cnzksaridf0t2tylm5q8wrsbxrgwxv3 2452859 2452857 2026-08-31T10:18:42Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker1007.eqiad.wmnet 2452859 wikitext text/x-wiki 80xv6o009ggv5ehmot37ikl8bmrlki6 2452860 2452859 2026-08-31T10:18:43Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker1007.eqiad.wmnet 2452860 wikitext text/x-wiki n6ju5l9415zv21vb49zfscd9101tc4t 2452861 2452860 2026-08-31T10:18:48Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker1008.eqiad.wmnet 2452861 wikitext text/x-wiki ji9z4ojhgbi42n424z99ijpn58l91ax 2452862 2452861 2026-08-31T10:19:24Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker1008.eqiad.wmnet 2452862 wikitext text/x-wiki lkjtwdcdis9dzq8b5ih6zzz8aele3ed 2452863 2452862 2026-08-31T10:24:41Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker1008.eqiad.wmnet 2452863 wikitext text/x-wiki rcq6ar0rvt7jxgoq7znczmrg8jtk4ec 2452864 2452863 2026-08-31T10:24:41Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker1008.eqiad.wmnet 2452864 wikitext text/x-wiki lcmngqe2x2ssnuxj1f7kspcmkhbql8b 2452865 2452864 2026-08-31T10:24:47Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host aux-k8s-worker1009.eqiad.wmnet 2452865 wikitext text/x-wiki bv74e8s7bitnie4su60eqkgc13akbnz 2452867 2452865 2026-08-31T10:25:22Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host aux-k8s-worker1009.eqiad.wmnet 2452867 wikitext text/x-wiki 7v1mm1w38xq6gmw9lnztxyvdw8xpl1k 2452868 2452867 2026-08-31T10:30:34Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host aux-k8s-worker1009.eqiad.wmnet 2452868 wikitext text/x-wiki 17sut4nyp0f7sinhclt0g4m4m3q2ej5 2452869 2452868 2026-08-31T10:30:35Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host aux-k8s-worker1009.eqiad.wmnet 2452869 wikitext text/x-wiki 41zrl20xt2natj6fifi48j1odvd5xl2 2452870 2452869 2026-08-31T10:30:36Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on P{aux-k8s-worker[1006-1009].eqiad.wmnet} and (A:aux-master-eqiad or A:aux-worker-eqiad) 2452870 wikitext text/x-wiki r0n84cb57aoamrsai0fgl0zqndm41z6 2452873 2452870 2026-08-31T10:54:06Z Stashbot 7414 kamila@deploy1003: Started scap sync-world: rebuild for T436488 2452873 wikitext text/x-wiki cu6qgdde8ds7v2ox4xn76472hi9z28z 2452874 2452873 2026-08-31T11:11:56Z Stashbot 7414 moritzm: powercycle netmon2002, unresponsive 2452874 wikitext text/x-wiki 9ibg0g738kz74lp9uq5jir95usk3cal 2452875 2452874 2026-08-31T11:20:52Z Stashbot 7414 ozge@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2452875 wikitext text/x-wiki 22bpkn9fxwp2n4xbgxomye4n7fk8mdq 2452876 2452875 2026-08-31T11:21:09Z Stashbot 7414 ozge@deploy1003: helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . 2452876 wikitext text/x-wiki q8cjd72fx6ryomx5oh04ugtnyxhde72 2452877 2452876 2026-08-31T11:28:58Z Stashbot 7414 kamila@deploy1003: Finished scap sync-world: rebuild for T436488 (duration: 34m 43s) 2452877 wikitext text/x-wiki lw4h53md0xyksovf2504rw4w37nwmso 0 17290 2452790 2452211 2026-08-31T04:18:07Z Stashbot 7414 Krinkle: Reloading Zuul to deploy https://gerrit.wikimedia.org/r/1332530 2452790 wikitext text/x-wiki frpllpj5q49tblwazn2i4lexvbgakc5 2452817 2452790 2026-08-31T09:16:34Z Stashbot 7414 elukey: move cx-server and citoid-beta endpoints in deployment-prep to two new Trixie VMs, update their configs and Docker images and delete the old images. 2452817 wikitext text/x-wiki m699lzwnfr87q5cr89pb0zxsts09dq4 0 91251 2452858 2430539 2026-08-31T10:17:02Z MMuhlenhoff (WMF) 5268 /* Service */ Document the new LVS setup 2452858 wikitext text/x-wiki dbkfsb64xkr2e5i9etr5ifm6y7zf7lm 2452866 2452858 2026-08-31T10:24:53Z MMuhlenhoff (WMF) 5268 Add a brief troubleshooting section with the basics 2452866 wikitext text/x-wiki g42khu70h8ejl3hbpggfs4i8dtwsx16 0 442914 2452780 2440755 2026-08-30T22:00:59Z Akd.2303 58755 /* sincronizar */ 2452780 wikitext text/x-wiki 05cxp45b5en1yxcv1reolomg0w6i2rq 0 449160 2452781 2452769 2026-08-31T00:02:17Z Dexbot 30554 Bot: Updating the report 2452781 wikitext text/x-wiki 7o7kukeiy6tfjptzy93iv1sv0e7j9pg 0 453463 2452871 2415324 2026-08-31T10:33:37Z CGoubert-WMF 32775 /* Datastores */ Add redis-lock 2452871 wikitext text/x-wiki 1c1lma0v7o21tmjiebnp8jiwmziete1 116 453906 2452872 2452080 2026-08-31T10:51:28Z Gitlabaccountapprovalbot 37332 @hgzh3 was approved. 2452872 wikitext text/x-wiki 9advnqwrlr5ebpy3vqoofgm174u59vr 0 455357 2452808 2447752 2026-08-31T08:42:20Z BJensen-WMF 48942 /* Troubleshooting */ Add manual certificate renewal instructions. 2452808 wikitext text/x-wiki 3oz6xi4c6d8gadorihj2nl0bgp13a8i 0 455928 2452785 2452747 2026-08-31T03:28:06Z CMing (WMF) 23277 /* Testing */ 2452785 wikitext text/x-wiki px3qk0dx3h8kr3kicm4rzhedhmy9jsr 2452787 2452785 2026-08-31T03:30:58Z CMing (WMF) 23277 /* Testing */ 2452787 wikitext text/x-wiki n7vszw9p383pli81gighy5wbjd64ycq 0 456526 2452878 2449640 2026-08-31T11:43:25Z CGoubert-WMF 32775 /* How do I restart all of my team's failed jobs? */ 2452878 wikitext text/x-wiki ivxed7gwi4p8hgkzuksotny0jumavr1 116 460070 2452775 2436836 2026-08-30T14:38:50Z EtherpadBackupBot 54504 EYG02 archived by Ericliu1912 2452775 wikitext text/x-wiki a0buxq57bhccmyvbik79r8uti0t72vc