Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.12 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk Talk:Main Page 1 2515 2440899 2440892 2026-07-26T17:45:10Z 2600 etc 38727 /* Wikitech logo - number of petals */ 2440899 wikitext text/x-wiki hewmai4x79oac5qnzso0gde8ht6jscr Nova Resource:Tools/SAL 498 3086 2440941 2440485 2026-07-27T08:11:30Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.vm_console (exit_code=0) 2440941 wikitext text/x-wiki tdnba9gk72xo4js5bgz5u9vt9bukuca 2441048 2440941 2026-07-27T11:37:04Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component volume-admission (T432325) 2441048 wikitext text/x-wiki 6i692qirf3514fvmx3ud20h7rvf2aye 2441051 2441048 2026-07-27T11:40:00Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component volume-admission (T432325) 2441051 wikitext text/x-wiki fh6klbtrqauje6mmhj0icnh38ywfh87 Deployments 0 4108 2440909 2440816 2026-07-27T05:15:27Z ScheduleDeploymentBot 37566 Add [[gerrit:1317814]] to Monday, July 27 UTC morning backport window 2440909 wikitext text/x-wiki pppo99dkzxw6rh39mv9hfpjan6chfib 2440910 2440909 2026-07-27T05:15:49Z ScheduleDeploymentBot 37566 Add [[gerrit:1313923]] to Monday, July 27 UTC morning backport window 2440910 wikitext text/x-wiki 2l5xgx6sip847lzqcc6moyhi58i9zly 2440938 2440910 2026-07-27T07:31:48Z Phuedx (WMF) 47850 Unscheduled https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/1313923 2440938 wikitext text/x-wiki pppo99dkzxw6rh39mv9hfpjan6chfib Nova Resource:Toolsbeta/SAL 498 6726 2440968 2440298 2026-07-27T09:29:39Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component volume-admission (T432325) 2440968 wikitext text/x-wiki s85ujjimxln14q67xz3u8ejvcqt9zl0 2440970 2440968 2026-07-27T09:32:32Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component volume-admission (T432325) 2440970 wikitext text/x-wiki 01w73c5d39wpkbn47c2s4s94sgdgwi9 2440979 2440970 2026-07-27T10:10:28Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.reboot for all NFS workers (T432325) 2440979 wikitext text/x-wiki qbay0n0162ef9z249hx5uquh8n2lw6n 2440988 2440979 2026-07-27T10:30:23Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for all NFS workers (T432325) 2440988 wikitext text/x-wiki c7fv1pz932xkiwfsma0vq0uvw6h2p6m 2441024 2440988 2026-07-27T11:14:47Z Stashbot 7414 godog: set 'dumps_use_nfs_lb: true' for prefix-puppet toolsbeta-test-k8s-worker-nfs - T432325 2441024 wikitext text/x-wiki r653722kahmyl8pfk70ntxz8evmum6g Server Admin Log 0 7919 2440893 2440888 2026-07-26T14:59:31Z Stashbot 7414 ssastry@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2440893 wikitext text/x-wiki iggde3fzbycc8402jwinfb1izzsfq3a 2440894 2440893 2026-07-26T14:59:33Z Stashbot 7414 ssastry@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2440894 wikitext text/x-wiki 4309kfb2y6l5quqky4org7yvp428lrn 2440895 2440894 2026-07-26T14:59:35Z Stashbot 7414 ssastry@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2440895 wikitext text/x-wiki afy847r3v71am3a04145iow2cv32g28 2440896 2440895 2026-07-26T14:59:38Z Stashbot 7414 ssastry@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2440896 wikitext text/x-wiki esakk09klpld515zxgla91mbn48fv94 2440901 2440896 2026-07-27T02:00:54Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2440901 wikitext text/x-wiki majg4coqchml4v6q3auhwz7fxp7octv 2440902 2440901 2026-07-27T02:07:30Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 06m 36s) 2440902 wikitext text/x-wiki 0n4u42l59p05nyagplyt6e22trsh8hk 2440903 2440902 2026-07-27T04:48:14Z Stashbot 7414 ryankemper@deploy1003: Started deploy [wdqs/wdqs@e8fb00c]: T430880 deploy to fresh wdqs host 2440903 wikitext text/x-wiki dir0kv2okemrvzyk11kdpu39sj0pf64 2440904 2440903 2026-07-27T04:48:19Z Stashbot 7414 ryankemper@deploy1003: Finished deploy [wdqs/wdqs@e8fb00c]: T430880 deploy to fresh wdqs host (duration: 00m 05s) 2440904 wikitext text/x-wiki i9gjjwxsfldv87efji2aw8ocgnfn1d6 2440905 2440904 2026-07-27T04:48:23Z Stashbot 7414 ryankemper@deploy1003: Started deploy [wdqs/wdqs@e8fb00c]: T430880 deploy to fresh wdqs host 2440905 wikitext text/x-wiki 5094pdd5p0jbnky02w655o1pz5yzqu8 2440906 2440905 2026-07-27T04:48:29Z Stashbot 7414 ryankemper@deploy1003: Finished deploy [wdqs/wdqs@e8fb00c]: T430880 deploy to fresh wdqs host (duration: 00m 05s) 2440906 wikitext text/x-wiki 65zr3ylsvhpr8ru199czlruc6z32sis 2440907 2440906 2026-07-27T04:51:44Z Stashbot 7414 ryankemper@cumin2003: START - Cookbook sre.wdqs.data-transfer (T430880, restore data on newly-reimaged host) xfer wdqs-all from wdqs2007.codfw.wmnet -> wdqs1018.eqiad.wmnet, repooling source-only afterwards 2440907 wikitext text/x-wiki b4plmsucqvmaa9yfyukw4567atdomhs 2440908 2440907 2026-07-27T04:51:54Z Stashbot 7414 ryankemper@cumin2003: START - Cookbook sre.wdqs.data-transfer (T430880, restore data on newly-reimaged host) xfer wdqs-all from wdqs2008.codfw.wmnet -> wdqs1019.eqiad.wmnet, repooling source-only afterwards 2440908 wikitext text/x-wiki 7onzqvhfynxfky5xn47kqoafoaoosmr 2440911 2440908 2026-07-27T06:00:33Z Stashbot 7414 ryankemper@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T430880, restore data on newly-reimaged host) xfer wdqs-all from wdqs2007.codfw.wmnet -> wdqs1018.eqiad.wmnet, repooling source-only afterwards 2440911 wikitext text/x-wiki lvdbwd8tq2m7ureshby5oo00ef4jlid 2440912 2440911 2026-07-27T06:00:36Z Stashbot 7414 ryankemper@cumin2003: END (PASS) - Cookbook sre.wdqs.data-transfer (exit_code=0) (T430880, restore data on newly-reimaged host) xfer wdqs-all from wdqs2008.codfw.wmnet -> wdqs1019.eqiad.wmnet, repooling source-only afterwards 2440912 wikitext text/x-wiki a8p2u7tbgn2lloy2w65vde0v2nu0euc 2440914 2440912 2026-07-27T06:25:21Z Stashbot 7414 marostegui@cumin1003: conftool action : set/weight=100; selector: name=clouddb1032.eqiad.wmnet,service=s4 2440914 wikitext text/x-wiki 14wetutelc3jsawbpoccw5z3a47v0n3 2440915 2440914 2026-07-27T06:25:25Z Stashbot 7414 marostegui@cumin1003: conftool action : set/weight=100; selector: name=clouddb1032.eqiad.wmnet,service=s6 2440915 wikitext text/x-wiki 2gxomfog3h2dfqw0s9n9p73f7e4gdh9 2440916 2440915 2026-07-27T06:25:35Z Stashbot 7414 marostegui@cumin1003: conftool action : set/pooled=no; selector: name=clouddb1032.eqiad.wmnet,service=s4 2440916 wikitext text/x-wiki jyewiakaixpkbxxbc422jrnk1zlzx8x 2440917 2440916 2026-07-27T06:25:39Z Stashbot 7414 marostegui@cumin1003: conftool action : set/pooled=no; selector: name=clouddb1032.eqiad.wmnet,service=s6 2440917 wikitext text/x-wiki 5tykeyvoa2g4bce8steob8993apblim 2440918 2440917 2026-07-27T06:25:47Z Stashbot 7414 marostegui@cumin1003: conftool action : set/weight=50; selector: name=clouddb1032.eqiad.wmnet,service=s6 2440918 wikitext text/x-wiki 24xplhvvz3a8ut01qw70yqqnrwx7zci 2440919 2440918 2026-07-27T06:25:50Z Stashbot 7414 marostegui@cumin1003: conftool action : set/weight=50; selector: name=clouddb1032.eqiad.wmnet,service=s4 2440919 wikitext text/x-wiki necjq46xilzsbja1n6zjximluity9yn 2440920 2440919 2026-07-27T06:25:54Z Stashbot 7414 marostegui@cumin1003: conftool action : set/pooled=yes; selector: name=clouddb1032.eqiad.wmnet,service=s6 2440920 wikitext text/x-wiki phqpgkflii9tg9xh8vldnccbfwzjxt6 2440921 2440920 2026-07-27T06:25:56Z Stashbot 7414 marostegui@cumin1003: conftool action : set/pooled=yes; selector: name=clouddb1032.eqiad.wmnet,service=s4 2440921 wikitext text/x-wiki aeoqjkh8p7krnezn7y7tztz13o7ear9 2440922 2440921 2026-07-27T06:29:16Z Stashbot 7414 marostegui@cumin1003: conftool action : set/weight=100; selector: name=clouddb1032.eqiad.wmnet,service=s6 2440922 wikitext text/x-wiki l0dyqziajccmxxbp73qz850c7agahts 2440923 2440922 2026-07-27T06:29:18Z Stashbot 7414 marostegui@cumin1003: conftool action : set/weight=100; selector: name=clouddb1032.eqiad.wmnet,service=s4 2440923 wikitext text/x-wiki g7ibkebufv8b80f6ou6k8yawq9emady 2440924 2440923 2026-07-27T06:35:30Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1228.eqiad.wmnet with reason: Rebooting 2440924 wikitext text/x-wiki 2krhxbzsr98gckeibvogsw6ptph7hek 2440925 2440924 2026-07-27T06:40:30Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on clouddb1020.eqiad.wmnet with reason: Cloning 2440925 wikitext text/x-wiki sja84raj8jvosc7glcbvp5r17f62d7o 2440926 2440925 2026-07-27T06:56:46Z Stashbot 7414 ryankemper@cumin2003: conftool action : set/pooled=yes; selector: name=wdqs1018.eqiad.wmnet 2440926 wikitext text/x-wiki evckdufd5862jq595e5d5s4nkxsmyth 2440927 2440926 2026-07-27T06:57:37Z Stashbot 7414 ryankemper@cumin2003: conftool action : set/pooled=yes; selector: name=wdqs1019.eqiad.wmnet 2440927 wikitext text/x-wiki 4v9h6cwz8gzr92zn12fulzljznwb3y8 2440928 2440927 2026-07-27T07:04:45Z Stashbot 7414 phuedx@deploy1003: Started scap sync-world: Backport for [[gerrit:1317814|sessionTick: Use Test Kitchen to send action=feature_not_available events (T413296)]] 2440928 wikitext text/x-wiki 2b5q8ncyh25pb3n1fmuddoi043ud0ge 2440929 2440928 2026-07-27T07:16:49Z Stashbot 7414 ryankemper: T430880 [WDQS] Reimaged `wdqs1018` and `wdqs1019` to Bookworm, restored data using test-cookbook change 1317128, and repooled both; 25/36 hosts complete 2440929 wikitext text/x-wiki s440wcx0x7xl1962themjlolc94c0qx 2440930 2440929 2026-07-27T07:20:44Z Stashbot 7414 phuedx@deploy1003: phuedx: Backport for [[gerrit:1317814|sessionTick: Use Test Kitchen to send action=feature_not_available events (T413296)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2440930 wikitext text/x-wiki 3i04r360w4764wzmx9yf42kjvjvj357 2440931 2440930 2026-07-27T07:22:28Z Stashbot 7414 cwilliams@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1179.eqiad.wmnet with reason: Maintenance 2440931 wikitext text/x-wiki fii18m890vpe1cqgesa7v7cvlowfsi1 2440932 2440931 2026-07-27T07:22:36Z Stashbot 7414 cwilliams@cumin1003: dbctl commit (dc=all): 'Depooling db1179 (T431660)', diff saved to https://phabricator.wikimedia.org/P95149 and previous config saved to /var/cache/conftool/dbconfig/20260727-072234-cwilliams.json 2440932 wikitext text/x-wiki kccxd2qafmkq7jr52ig7zsnainxs9o6 2440933 2440932 2026-07-27T07:22:48Z Stashbot 7414 marostegui: Drop tables in akwiki nawiki pihwiki - growthexperiments_* T428885 2440933 wikitext text/x-wiki f31ylyxbvo0nexqv0m72np8ze1yf03q 2440934 2440933 2026-07-27T07:25:01Z Stashbot 7414 phuedx@deploy1003: phuedx: Continuing with deployment 2440934 wikitext text/x-wiki q0yxumwy43ch3dnnuxefsjsxl1jv3kx 2440936 2440934 2026-07-27T07:27:00Z Stashbot 7414 marostegui: Rename tables on s3 T426341 2440936 wikitext text/x-wiki cbqi86hneiqowhyfvpzd9qme4ezrgw3 2440937 2440936 2026-07-27T07:28:33Z Stashbot 7414 root@cumin1003: START - Cookbook sre.mysql.pool pool db1179: Maintenance 2440937 wikitext text/x-wiki 2kmk8k1eq48jqpwpaarqjxgsd0y86ir 2440939 2440937 2026-07-27T07:37:18Z Stashbot 7414 phuedx@deploy1003: Finished scap sync-world: Backport for [[gerrit:1317814|sessionTick: Use Test Kitchen to send action=feature_not_available events (T413296)]] (duration: 32m 33s) 2440939 wikitext text/x-wiki autqikmwq774li807w0j1d0tqorplb2 2440940 2440939 2026-07-27T07:44:22Z Stashbot 7414 phuedx: UTC morning backport window done 2440940 wikitext text/x-wiki pd2v2y8668yea8bw6lh1izlc7p17mxa 2440943 2440940 2026-07-27T08:16:02Z Stashbot 7414 root@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1179: Maintenance 2440943 wikitext text/x-wiki m6ubyd8dcnfq31f7vzapagkzdvp67av 2440944 2440943 2026-07-27T08:36:57Z Stashbot 7414 cwilliams@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1203.eqiad.wmnet with reason: Maintenance 2440944 wikitext text/x-wiki jqqlfunmqb5i4wvf72d8um5amseglrq 2440945 2440944 2026-07-27T08:37:05Z Stashbot 7414 cwilliams@cumin1003: dbctl commit (dc=all): 'Depooling db1203 (T431660)', diff saved to https://phabricator.wikimedia.org/P95154 and previous config saved to /var/cache/conftool/dbconfig/20260727-083703-cwilliams.json 2440945 wikitext text/x-wiki 949dwwtd7a45f25bywnfkpt8lcoc2df 2440946 2440945 2026-07-27T08:43:02Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker1136.eqiad.wmnet 2440946 wikitext text/x-wiki goe513rsnede6tztus9lirudu1cw5cy 2440947 2440946 2026-07-27T08:43:05Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1136.eqiad.wmnet 2440947 wikitext text/x-wiki cv7taxw5yrx1ftmbo4zwsad1wddm1i1 2440948 2440947 2026-07-27T08:43:08Z Stashbot 7414 root@cumin1003: START - Cookbook sre.mysql.pool pool db1203: Maintenance 2440948 wikitext text/x-wiki 48sb7otmywqxnjh0eka00znob3avv2d 2440949 2440948 2026-07-27T08:43:41Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1136.eqiad.wmnet 2440949 wikitext text/x-wiki kb37ho7jdx77yprmn6qgkk8ygt8mghr 2440950 2440949 2026-07-27T08:44:53Z Stashbot 7414 marostegui: Rename tables on s3 T425066 2440950 wikitext text/x-wiki 1n7kx0izuepwi3bbl7c1k4yyubcpt0b 2440951 2440950 2026-07-27T08:46:56Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.reimage for host wikikube-worker1136.eqiad.wmnet with OS trixie 2440951 wikitext text/x-wiki evkaat5o80hvib0nqx5ef07vzncfd3t 2440952 2440951 2026-07-27T08:47:24Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.move-vlan for host wikikube-worker1136 2440952 wikitext text/x-wiki bb55jgujn3n5u8jb37u3d2vjv59cxth 2440953 2440952 2026-07-27T08:50:46Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.dns.netbox 2440953 wikitext text/x-wiki ldhsnqiwbs95oqggnciu1uvf4bhej6i 2440954 2440953 2026-07-27T08:51:56Z Stashbot 7414 jiji@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-mcrouter: apply 2440954 wikitext text/x-wiki s0azcltewz2em9funwr64xd4qk5ztk6 2440955 2440954 2026-07-27T08:52:01Z Stashbot 7414 jiji@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-mcrouter: apply 2440955 wikitext text/x-wiki kdnb2y9zk61ropuimt2dvyzxmlxorl7 2440956 2440955 2026-07-27T08:52:09Z Stashbot 7414 jiji@deploy1003: helmfile [codfw] START helmfile.d/services/mw-mcrouter: apply 2440956 wikitext text/x-wiki d71pctgothmd3gdvmq7anrq4u1bhwpc 2440957 2440956 2026-07-27T08:52:21Z Stashbot 7414 jiji@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-mcrouter: apply 2440957 wikitext text/x-wiki 3tpmbewda661opzkdlumcc2i0309ilk 2440958 2440957 2026-07-27T09:04:08Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1136 - jiji@cumin1003" 2440958 wikitext text/x-wiki lxkkl2lzjvxs2daf04ju6bf2vzo4dnt 2440959 2440958 2026-07-27T09:04:12Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1136 - jiji@cumin1003" 2440959 wikitext text/x-wiki 3v3rtsk1bnhomf4fg4ie5nugs5uwpmr 2440960 2440959 2026-07-27T09:04:14Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2440960 wikitext text/x-wiki 8mvm1ny0bgxjtgpilok7tuimem4vnnj 2440961 2440960 2026-07-27T09:04:15Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.dns.wipe-cache wikikube-worker1136.eqiad.wmnet 191.32.64.10.in-addr.arpa 1.9.1.0.2.3.0.0.4.6.0.0.0.1.0.0.3.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2440961 wikitext text/x-wiki b8ern9atqpybicp1tpduc6asirt52fr 2440962 2440961 2026-07-27T09:04:17Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker1136.eqiad.wmnet 191.32.64.10.in-addr.arpa 1.9.1.0.2.3.0.0.4.6.0.0.0.1.0.0.3.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2440962 wikitext text/x-wiki c4w9s5vs3e6sz5peip71d7cdzwaq3qi 2440963 2440962 2026-07-27T09:04:18Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1136 2440963 wikitext text/x-wiki 4x79nbctpl0ie943d3kvjn0pllav2g8 2440965 2440963 2026-07-27T09:17:33Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1136 2440965 wikitext text/x-wiki g3xoqsiv9u1cxvkwd2wxpixovwx86yd 2440966 2440965 2026-07-27T09:17:35Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1136 2440966 wikitext text/x-wiki fgffvjimsumx2z5ogqtuu5vgd08ptmx 2440969 2440966 2026-07-27T09:30:13Z Stashbot 7414 root@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1203: Maintenance 2440969 wikitext text/x-wiki qqtlqxdn2can35tfliv6lfukv9v62nk 2440971 2440969 2026-07-27T09:32:47Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1136.eqiad.wmnet with reason: host reimage 2440971 wikitext text/x-wiki ab1x713y17li1wveh8sidf6442b3fzx 2440972 2440971 2026-07-27T09:33:22Z Stashbot 7414 cwilliams@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1237.eqiad.wmnet with reason: Maintenance 2440972 wikitext text/x-wiki 7ch9p1x89j2q5qf4x18jcmlggs4tzwq 2440973 2440972 2026-07-27T09:33:31Z Stashbot 7414 cwilliams@cumin1003: dbctl commit (dc=all): 'Depooling db1237 (T431660)', diff saved to https://phabricator.wikimedia.org/P95159 and previous config saved to /var/cache/conftool/dbconfig/20260727-093328-cwilliams.json 2440973 wikitext text/x-wiki ivebubi63b7lzfejrpha04h1po5crdj 2440974 2440973 2026-07-27T09:38:07Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1136.eqiad.wmnet with reason: host reimage 2440974 wikitext text/x-wiki l41fs7x3chdixc2bvdmoh67gl5cz0hq 2440975 2440974 2026-07-27T09:39:05Z Stashbot 7414 root@cumin1003: START - Cookbook sre.mysql.pool pool db1237: Maintenance 2440975 wikitext text/x-wiki 4r7obj23oww9du37w7vw0st0628brtc 2440976 2440975 2026-07-27T09:39:25Z Stashbot 7414 elukey: restart burrow-main-eqiad.service on kafkamon1003 to see if a recurrent kafka error on kafka-main1008 goes away 2440976 wikitext text/x-wiki l96i0kwkshutzbfh3mseewrtujly733 2440977 2440976 2026-07-27T09:58:26Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1136.eqiad.wmnet with OS trixie 2440977 wikitext text/x-wiki 63oh7cx4e4w2wl23ow21tw4k8j7p04j 2440978 2440977 2026-07-27T10:04:57Z Stashbot 7414 elukey: restart burrow main-eqiad on kafkamon2003 to clear some errors on kafka-main1008 2440978 wikitext text/x-wiki tjupyh3xq16bd88oaovhqxftfs1pw16 2440981 2440978 2026-07-27T10:24:48Z Stashbot 7414 root@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1237: Maintenance 2440981 wikitext text/x-wiki pik77bzzqm5m0iksd1ffrfthhekkj45 2440982 2440981 2026-07-27T10:27:08Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2440982 wikitext text/x-wiki 0e55cuucnp8i8gnmnhoev4l7qv3mduv 2440983 2440982 2026-07-27T10:27:39Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2440983 wikitext text/x-wiki 8bek9sxcxdzompra6dwvh1ekq7l2r4a 2440984 2440983 2026-07-27T10:28:50Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-product: apply 2440984 wikitext text/x-wiki rwy9fna54rhkp8cg1hhmi610tn67zsb 2440985 2440984 2026-07-27T10:29:24Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-product: apply 2440985 wikitext text/x-wiki m0a9b2fq335ynphggk5qjdoaz8lsc3d 2440986 2440985 2026-07-27T10:29:41Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2440986 wikitext text/x-wiki 9dy5v7zmepq20l962namjcarw3hvi2y 2440987 2440986 2026-07-27T10:30:18Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2440987 wikitext text/x-wiki hzbv95bha60jm1mxenl3tpejdxjazvr 2440989 2440987 2026-07-27T10:31:42Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-dumps: apply 2440989 wikitext text/x-wiki 0h8y046q3r385f7p86pzesbft7xtbpe 2440990 2440989 2026-07-27T10:31:57Z Stashbot 7414 cwilliams@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1264.eqiad.wmnet with reason: Maintenance 2440990 wikitext text/x-wiki lwij9tx6xug7m0pfjj0iglxn8c33q9c 2440991 2440990 2026-07-27T10:32:05Z Stashbot 7414 cwilliams@cumin1003: dbctl commit (dc=all): 'Depooling db1264 (T431660)', diff saved to https://phabricator.wikimedia.org/P95164 and previous config saved to /var/cache/conftool/dbconfig/20260727-103204-cwilliams.json 2440991 wikitext text/x-wiki icelztpjts7akrbnrx12ut6o0bbfi5r 2440992 2440991 2026-07-27T10:32:16Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-dumps: apply 2440992 wikitext text/x-wiki j2w4v887l9bdzevc5cf0h9oold95t3b 2440993 2440992 2026-07-27T10:32:24Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-fr-tech: apply 2440993 wikitext text/x-wiki 2kirm5awuj2an2kis30m395ywxfnzjf 2440994 2440993 2026-07-27T10:32:57Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-fr-tech: apply 2440994 wikitext text/x-wiki b6bfydy9him9kbe24mhaqiyecbx9hxm 2440995 2440994 2026-07-27T10:34:08Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-main: apply 2440995 wikitext text/x-wiki nvehm5w6y59b3al7beidgqaq2rsamzr 2440996 2440995 2026-07-27T10:34:39Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-main: apply 2440996 wikitext text/x-wiki qqtof88xm7tpb700fjnymejj28zmiyt 2440997 2440996 2026-07-27T10:34:47Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-ml: apply 2440997 wikitext text/x-wiki sxdvrjgb78i04h6ymnu5ybjoqjyi8a4 2440998 2440997 2026-07-27T10:35:17Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-ml: apply 2440998 wikitext text/x-wiki c9h5ftw4t86x8z8ue40j031protulz7 2440999 2440998 2026-07-27T10:35:24Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-platform-eng: apply 2440999 wikitext text/x-wiki bkhftwtf6o92o2pg9mwwnij4f57hbb2 2441000 2440999 2026-07-27T10:36:04Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-platform-eng: apply 2441000 wikitext text/x-wiki 1slx87pey00832qrogb6kth8gdqvwlq 2441001 2441000 2026-07-27T10:36:12Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-research: apply 2441001 wikitext text/x-wiki 1tbvbv58qbd9k302nd68pda2s5t4cz8 2441002 2441001 2026-07-27T10:36:43Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-research: apply 2441002 wikitext text/x-wiki 7s7ssvouxt8mgliec4ztxnfw28mcfdj 2441003 2441002 2026-07-27T10:36:54Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-search: apply 2441003 wikitext text/x-wiki q1j8hkkz7cz4o43vq1ip2cgmxq8mb5i 2441004 2441003 2026-07-27T10:37:32Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-search: apply 2441004 wikitext text/x-wiki hxa0w8swnms3i1wprfs0j4ptwl7l9hc 2441005 2441004 2026-07-27T10:37:39Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-sre: apply 2441005 wikitext text/x-wiki skxsnj0hcoi8kv8mqym0hmemx62jbx4 2441007 2441005 2026-07-27T10:38:14Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-sre: apply 2441007 wikitext text/x-wiki a22zpueep9zuf4mz8v5p9gw0wer9p06 2441008 2441007 2026-07-27T10:38:22Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-wikidata: apply 2441008 wikitext text/x-wiki qvqiboflr3fdsuak35912iarsiq4g36 2441009 2441008 2026-07-27T10:38:53Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-wikidata: apply 2441009 wikitext text/x-wiki mo5z50uaal78dm3dynomt1qu5u8scjg 2441010 2441009 2026-07-27T10:39:00Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-wmde: apply 2441010 wikitext text/x-wiki 6b7k2tlqgx005nkz5zfck5oq5gzudfe 2441011 2441010 2026-07-27T10:39:08Z Stashbot 7414 root@cumin1003: START - Cookbook sre.mysql.pool pool db1264: Maintenance 2441011 wikitext text/x-wiki cs7gr40sgplavo9a1a6v64i7175cbb0 2441012 2441011 2026-07-27T10:39:31Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-wmde: apply 2441012 wikitext text/x-wiki j6o2wb8aka5qvog8z1y6qf6obz1igi3 2441013 2441012 2026-07-27T10:43:13Z Stashbot 7414 ozge@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2441013 wikitext text/x-wiki h3bozei4lksvymvb818zrjt8srbko41 2441014 2441013 2026-07-27T10:50:28Z Stashbot 7414 arthurtaylor@deploy1003: helmfile [staging] START helmfile.d/services/wikidata-query-gui: apply 2441014 wikitext text/x-wiki lp73kmq8l0t3uh5fyfsjbbrv5v676l6 2441015 2441014 2026-07-27T11:03:00Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2441015 wikitext text/x-wiki g42xa1v92fmrifqe0x5wc8jic9eu6iq 2441016 2441015 2026-07-27T11:03:15Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2441016 wikitext text/x-wiki 8k93vm5gfvn5qxet3odvtp48hovkcsy 2441017 2441016 2026-07-27T11:05:25Z Stashbot 7414 blake@deploy1003: helmfile [staging-codfw] START helmfile.d/admin 'apply'. 2441017 wikitext text/x-wiki qovwmzw0c00nvmb24adr18krrt5126m 2441018 2441017 2026-07-27T11:08:36Z Stashbot 7414 blake@deploy1003: helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. 2441018 wikitext text/x-wiki 5xqje5qnv9nis5poicbpfr3wvd1xxkv 2441019 2441018 2026-07-27T11:09:29Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. 2441019 wikitext text/x-wiki kr68a6fkuq403goen8qxpcuu15080gz 2441020 2441019 2026-07-27T11:09:44Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. 2441020 wikitext text/x-wiki o4asfo4vgvbii4yeh8qtrc3jhirr2ok 2441021 2441020 2026-07-27T11:09:59Z Stashbot 7414 blake@deploy1003: helmfile [staging-eqiad] START helmfile.d/admin 'apply'. 2441021 wikitext text/x-wiki ttcdc2ja0ayvv4jln86nnj25tjxcmdx 2441022 2441021 2026-07-27T11:11:36Z Stashbot 7414 blake@deploy1003: helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. 2441022 wikitext text/x-wiki 4c67x9iaxajidcnxfizjraa3u5qrqcb 2441023 2441022 2026-07-27T11:12:30Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/admin 'apply'. 2441023 wikitext text/x-wiki 5mgxw0kf67x8mqn47yvtoa35wheyrrk 2441025 2441023 2026-07-27T11:18:19Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/admin 'apply'. 2441025 wikitext text/x-wiki 3ofow3dkn4e7h7fqpvjxw2mh79hyi4j 2441026 2441025 2026-07-27T11:18:51Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/admin 'apply'. 2441026 wikitext text/x-wiki 49fwryg0hshciu4j30e90xwpgr2uk03 2441027 2441026 2026-07-27T11:20:29Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/admin 'apply'. 2441027 wikitext text/x-wiki 14q56aqjl1crmuldig8krujaak5us51 2441028 2441027 2026-07-27T11:22:10Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool es1050: testing 2441028 wikitext text/x-wiki 9wujj8zo8tcbuocp3zi4xfpjpmqd1a1 2441029 2441028 2026-07-27T11:22:19Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1050: testing 2441029 wikitext text/x-wiki 0uc7ojkbgfnzkslkxjsdx36x2fe2ob6 2441030 2441029 2026-07-27T11:23:04Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Repool es1050', diff saved to https://phabricator.wikimedia.org/P95169 and previous config saved to /var/cache/conftool/dbconfig/20260727-112302-marostegui.json 2441030 wikitext text/x-wiki le0d46tb7cqnmiyvtkyy4urit0gloik 2441031 2441030 2026-07-27T11:23:28Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Repool es1050 as master', diff saved to https://phabricator.wikimedia.org/P95170 and previous config saved to /var/cache/conftool/dbconfig/20260727-112326-marostegui.json 2441031 wikitext text/x-wiki 24cj1kxo0ca8uxbc9ljlprw050788j4 2441032 2441031 2026-07-27T11:24:02Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool es1038: testing 2441032 wikitext text/x-wiki izf8lwiv183nuvzsqr8ke53dv8ob4aj 2441033 2441032 2026-07-27T11:24:46Z Stashbot 7414 root@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1264: Maintenance 2441033 wikitext text/x-wiki h7bn7117xgrjwmyqt8p0o9ysdnjln2o 2441034 2441033 2026-07-27T11:26:02Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1038: testing 2441034 wikitext text/x-wiki 1ntmdor7b9h99u9u2dz2phwfk1t6o92 2441035 2441034 2026-07-27T11:26:42Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.dns.admin DNS admin: depool ulsfo [reason: router upgrade, T431752] 2441035 wikitext text/x-wiki s1q1cjw9knlhx5icpshyucnw8ad29ne 2441036 2441035 2026-07-27T11:26:55Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool es1038: es1038 repool 2441036 wikitext text/x-wiki 6ag2fu7ljtenxxcltqv3dh60ff3tcak 2441037 2441036 2026-07-27T11:27:00Z Stashbot 7414 ayounsi@cumin1003: END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: depool ulsfo [reason: router upgrade, T431752] 2441037 wikitext text/x-wiki 6uccqn0ka57chjlvpbkshd3i9mkzc2q 2441038 2441037 2026-07-27T11:27:17Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool es1035: testing 2441038 wikitext text/x-wiki kcwplabb9gxv0x4vbs0l0yktt3w1va2 2441039 2441038 2026-07-27T11:27:26Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1035: testing 2441039 wikitext text/x-wiki ezq3nb4o68a3q6kbcsgz4uuee7ukufg 2441040 2441039 2026-07-27T11:28:07Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool es1035: testing 2441040 wikitext text/x-wiki 36f6o4ak6b32k5su5v4zyu83hsi6hax 2441041 2441040 2026-07-27T11:28:22Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool es1035: testing 2441041 wikitext text/x-wiki kt0gj5yd0dbx6hfkddrbcm9nwfb2r1l 2441042 2441041 2026-07-27T11:29:17Z Stashbot 7414 arthurtaylor@deploy1003: helmfile [staging] START helmfile.d/services/wikidata-query-gui: apply 2441042 wikitext text/x-wiki a7nrc9k984wp92eincr73ofipibasly 2441043 2441042 2026-07-27T11:29:43Z Stashbot 7414 arthurtaylor@deploy1003: helmfile [staging] DONE helmfile.d/services/wikidata-query-gui: apply 2441043 wikitext text/x-wiki eba23pk3j54gtc3yg8na1zlj5l74gz3 2441044 2441043 2026-07-27T11:29:52Z Stashbot 7414 XioNoX: start draining cr4-ulsfo - T431752 2441044 wikitext text/x-wiki lp7rdsxboc81wryhdefi06wkf1zszg6 2441045 2441044 2026-07-27T11:35:41Z Stashbot 7414 arthurtaylor@deploy1003: helmfile [codfw] START helmfile.d/services/wikidata-query-gui: apply 2441045 wikitext text/x-wiki fucwyfu6dok4w2t6sl71wja2qmkmowt 2441046 2441045 2026-07-27T11:36:36Z Stashbot 7414 arthurtaylor@deploy1003: helmfile [codfw] DONE helmfile.d/services/wikidata-query-gui: apply 2441046 wikitext text/x-wiki 0xhbms2zkvkckheitp9vi9ckgb0x2vn 2441047 2441046 2026-07-27T11:36:44Z Stashbot 7414 arthurtaylor@deploy1003: helmfile [eqiad] START helmfile.d/services/wikidata-query-gui: apply 2441047 wikitext text/x-wiki s5v51hobxnfqv3zjnpk0x13lvl7k5ta 2441049 2441047 2026-07-27T11:37:13Z Stashbot 7414 arthurtaylor@deploy1003: helmfile [eqiad] DONE helmfile.d/services/wikidata-query-gui: apply 2441049 wikitext text/x-wiki k39vewbue8dk9l8agnu8q7dusxxdzh5 2441050 2441049 2026-07-27T11:39:04Z Stashbot 7414 urbanecm@deploy1003: Started scap sync-world: Backport for [[gerrit:1311832|[Growth] Deploy automated mentor list cleaner to all wikis (T431804)]] 2441050 wikitext text/x-wiki p6coznto09ihorh4dypie9uoh4g4btt 2441052 2441050 2026-07-27T11:42:48Z Stashbot 7414 urbanecm@deploy1003: urbanecm: Backport for [[gerrit:1311832|[Growth] Deploy automated mentor list cleaner to all wikis (T431804)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2441052 wikitext text/x-wiki npi0t01rtg7km2mx9uj3ccw44c0z7j8 2441053 2441052 2026-07-27T11:43:32Z Stashbot 7414 urbanecm@deploy1003: urbanecm: Continuing with deployment 2441053 wikitext text/x-wiki pa1fn1gzg60wyxygkj249zfg3vrv61t 2441055 2441053 2026-07-27T11:48:38Z Stashbot 7414 cwilliams@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1187.eqiad.wmnet with reason: Maintenance 2441055 wikitext text/x-wiki 1ng2sr2hd2ye0fwxijvkycuywiwkuyt 2441056 2441055 2026-07-27T11:48:46Z Stashbot 7414 cwilliams@cumin1003: dbctl commit (dc=all): 'Depooling db1187 (T431660)', diff saved to https://phabricator.wikimedia.org/P95178 and previous config saved to /var/cache/conftool/dbconfig/20260727-114844-cwilliams.json 2441056 wikitext text/x-wiki fg2l8psmv4e10ohfsutznbdtxhc8z7g 2441058 2441056 2026-07-27T11:50:12Z Stashbot 7414 urbanecm@deploy1003: Finished scap sync-world: Backport for [[gerrit:1311832|[Growth] Deploy automated mentor list cleaner to all wikis (T431804)]] (duration: 11m 07s) 2441058 wikitext text/x-wiki gapk0gm9w6vxf590zh43ladhqagbjz5 2441059 2441058 2026-07-27T11:50:40Z Stashbot 7414 ayounsi@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cr4-ulsfo,cr4-ulsfo IPv6,cr4-ulsfo.mgmt with reason: router upgrade 2441059 wikitext text/x-wiki 1j9r6m2d9ldcxsf2zacqa7ostaq1bl2 2441061 2441059 2026-07-27T11:53:35Z Stashbot 7414 urbanecm@deploy1003: mwscript-k8s job started: foreachwikiindblist growthexperiments GrowthExperiments:cleanMentorList # T431804 2441061 wikitext text/x-wiki 9bzhize2bsrv9vtsz8b65t5ivw3jfqe 2441062 2441061 2026-07-27T11:55:40Z Stashbot 7414 root@cumin1003: START - Cookbook sre.mysql.pool pool db1187: Maintenance 2441062 wikitext text/x-wiki ilgb03k29c3a2dcz5ep46nsupsf5yt4 CDN/Headers 0 8495 2441060 2428573 2026-07-27T11:52:03Z CParle (WMF) 11007 /* Keys */ 2441060 wikitext text/x-wiki m46091saldoaneq5qpxuosu6co12usg Portal:Toolforge/Admin 0 21478 2440913 2428514 2026-07-27T06:15:12Z SSapaty (WMF) 28955 /* Project membership request approval */ add clarifying notes for reviewers on code repo and licence 2440913 wikitext text/x-wiki t7ay8tnx7px0aq025z96m9ud2r5doqs User:Tommy Kronkvist 2 441756 2440898 2425511 2026-07-26T17:16:56Z Tommy Kronkvist 11506 User statistics. 2440898 wikitext text/x-wiki d3u9h4xyxck47tg7qea1qy5ldll6cnl Spicerack/Cookbooks 0 442875 2440980 2382319 2026-07-27T10:22:28Z LToscano (WMF) 7191 Add spicerack PYTHONPATH tricks 2440980 wikitext text/x-wiki dkew1tcclt6cdoye6824s1uqqx6649y Map of database maintenance 0 449160 2440900 2440866 2026-07-27T00:00:11Z Dexbot 30554 Bot: Updating the report 2440900 wikitext text/x-wiki ezrssbkbl8u4y3h3s7wre3l38px6ako 2440935 2440900 2026-07-27T07:25:06Z Dexbot 30554 Bot: Updating the report 2440935 wikitext text/x-wiki heep65x4ph8qwt6e1fj3o1z652po3et 2441057 2440935 2026-07-27T11:49:41Z Dexbot 30554 Bot: Updating the report 2441057 wikitext text/x-wiki 2odkmx1hhwgk1atladfa8w8v9kcruyc Kubernetes/Remove a service 0 451481 2441006 2440660 2026-07-27T10:38:06Z BJensen-WMF 48942 /* Puppet: remove kubeconfig files */ typo 2441006 wikitext text/x-wiki 5ltjxwg8rx0f3om9dh2ewncl9reqdkx Tool:Gitlab-account-approval/Log 116 453906 2440897 2440656 2026-07-26T15:39:15Z Gitlabaccountapprovalbot 37332 demansanaagmailcom was rejected. 2440897 wikitext text/x-wiki lgos97x6l5yd2x4cg0c1cz8e55sxekg 2440942 2440897 2026-07-27T08:12:26Z Gitlabaccountapprovalbot 37332 @cambob was approved. 2440942 wikitext text/x-wiki qhy3z5nwpi9f623rq95vxq41akfmyvp Nova Resource:Tools.wikimonitor-beta/SAL 498 460131 2441063 2438699 2026-07-27T11:57:05Z Stashbot 7414 wmbot~gergesshamon@tools-bastion-15: [DEPLOY] Starting deployment | ref=feature/prometheus-metrics-wikistream 2441063 wikitext text/x-wiki guleqpblaci3ymws0bovuez33l17dv5 2441064 2441063 2026-07-27T11:58:40Z Stashbot 7414 wmbot~gergesshamon@tools-bastion-15: [DEPLOY] Build triggered successfully | ref=feature/prometheus-metrics-wikistream 2441064 wikitext text/x-wiki qjpqyz03gqn1yc2iitqj5ehazy7mo2a 2441065 2441064 2026-07-27T11:58:42Z Stashbot 7414 wmbot~gergesshamon@tools-bastion-15: [DEPLOY] Restarting buildservice | ref=feature/prometheus-metrics-wikistream 2441065 wikitext text/x-wiki oda4mkdjo9ywnglmfj0n94b1tgxzcsc 2441066 2441065 2026-07-27T11:58:53Z Stashbot 7414 wmbot~gergesshamon@tools-bastion-15: [DEPLOY] Deployment completed successfully | ref=feature/prometheus-metrics-wikistream 2441066 wikitext text/x-wiki 7u5xqoz68zc1jqv9ly9gdrln8ebh9zu User talk:Basedgirl 3 460488 2440964 2026-07-27T09:16:33Z StrikerBot 8475 Welcome to Toolforge! 2440964 wikitext text/x-wiki qyunzrtf3f9lpglmrqu92pc02m4nxz4 User talk:Luca.favorido 3 460489 2440967 2026-07-27T09:17:39Z StrikerBot 8475 Welcome to Toolforge! 2440967 wikitext text/x-wiki 6ha3d0wvfbm09k6u9p9ey68lv08p0d1 Nova Resource:Omd 498 460490 2441054 2026-07-27T11:47:46Z Labslogbot 55 Auto update of instance info. 2441054 wikitext text/x-wiki 7r0sarwa3lgj7d8yi9ifaf4rndyox5r