Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.1 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk Nova Resource:Tools/SAL 498 3086 2412222 2411755 2026-05-11T00:34:01Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component image-config 2412222 wikitext text/x-wiki kizli4exzwdr9hbuf2t7935jdzrrz3u 2412223 2412222 2026-05-11T00:39:11Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component image-config 2412223 wikitext text/x-wiki 6gjvozp9njlaliryts81k8m0fczwy4s 2412224 2412223 2026-05-11T00:40:11Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component image-config 2412224 wikitext text/x-wiki nufl3do7y8gfkfcve6lnkn4max50w44 2412225 2412224 2026-05-11T00:45:18Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component image-config 2412225 wikitext text/x-wiki trknmdvrgd9ucldu11femqjhubmfeqw Deployments 0 4108 2412239 2412179 2026-05-11T02:51:05Z ScheduleDeploymentBot 37566 Add [[gerrit:1283048]] to Monday, May 11 UTC morning backport window 2412239 wikitext text/x-wiki m6ehu8vik025o69y573uofj2vc39l4i 2412270 2412239 2026-05-11T08:15:19Z ScheduleDeploymentBot 37566 Add [[gerrit:1278704]] to Monday, May 11 UTC afternoon backport window 2412270 wikitext text/x-wiki pqnnj3sghxb4mr27hy1ocycrcuy71t1 2412271 2412270 2026-05-11T08:15:46Z ScheduleDeploymentBot 37566 Add [[gerrit:1285352]] to Monday, May 11 UTC afternoon backport window 2412271 wikitext text/x-wiki kpkcdo3fk9octul2q9wrvj126gp8ex6 2412272 2412271 2026-05-11T08:15:56Z ScheduleDeploymentBot 37566 Add [[gerrit:1285406]] to Monday, May 11 UTC afternoon backport window 2412272 wikitext text/x-wiki ew6pbpssekpfz5z5drc41o9prm2ikpi 2412324 2412272 2026-05-11T10:04:17Z ScheduleDeploymentBot 37566 Add [[gerrit:1285743]] to Monday, May 11 UTC late backport window 2412324 wikitext text/x-wiki 86a7hkbhwie4vmcv3c0msdfg3bpd1ct 2412357 2412324 2026-05-11T11:52:36Z ScheduleDeploymentBot 37566 Add [[gerrit:1285761]] to Monday, May 11 UTC afternoon backport window 2412357 wikitext text/x-wiki gjj7edlwdvsn520yzddh20k329nm589 Nova Resource:Toolsbeta/SAL 498 6726 2412220 2410949 2026-05-11T00:22:57Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component image-config 2412220 wikitext text/x-wiki q7j5g1yeli7alnl7syk9euqj67pdc1a 2412221 2412220 2026-05-11T00:30:48Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component image-config 2412221 wikitext text/x-wiki 8ohtyr2gq3r6tv10bfvqwa8jbf9vley 2412342 2412221 2026-05-11T10:31:17Z Stashbot 7414 fnegri@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component builds-api (T423417) 2412342 wikitext text/x-wiki 2xipbqmmgthu6ewi80qnzkfbkhf6obq 2412343 2412342 2026-05-11T10:35:56Z Stashbot 7414 fnegri@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component builds-api (T423417) 2412343 wikitext text/x-wiki op0f4in7d4fiax48ll7xjdggkfgot9m SRE/Infrastructure naming conventions 0 7195 2412355 2407045 2026-05-11T11:43:04Z BTullis (WMF) 25295 Added dse-k8s-wdqs hostname prefixes 2412355 wikitext text/x-wiki j0016pi99ikm1vv1l76uolqoy25erzi Server Admin Log 0 7919 2412210 2412194 2026-05-10T18:09:00Z Stashbot 7414 urbanecm@deploy1003: mwscript-k8s job started: extensions/Translate/scripts/moveTranslatableBundle.php --wiki=metawiki '--reason=per [[:phab:T425503]]' ESEAP_Preparatory_Council/Proposed_theory_of_change 'ESEAP Hub/Governance/ESEAP Preparatory Council/Proposed theory of change' 'Martin Urbanec' # T425503 2412210 wikitext text/x-wiki h8gzifd6dqd6sqscqvnt9ql5t7ulk6l 2412212 2412210 2026-05-10T18:11:23Z Stashbot 7414 urbanecm@deploy1003: mwscript-k8s job started: extensions/Translate/scripts/moveTranslatableBundle.php --wiki=metawiki '--reason=per [[:phab:T425504]]' ESEAP_Hub_Charter 'ESEAP Hub/Governance/Charter/Previous draft' 'Martin Urbanec' # T425504 2412212 wikitext text/x-wiki p9jd77p3hcel5k1cufx871etpuca74l 2412213 2412212 2026-05-10T18:11:32Z Stashbot 7414 urbanecm@deploy1003: mwscript-k8s job started: extensions/Translate/scripts/moveTranslatableBundle.php --wiki=metawiki '--reason=per [[:phab:T425503]]' ESEAP_Preparatory_Council/Proposed_theory_of_change 'ESEAP Hub/Governance/ESEAP Preparatory Council/Proposed theory of change' 'Martin Urbanec' # T425503 2412213 wikitext text/x-wiki t69bt8b3ua5p11pa32ktxsrj57jdpay 2412214 2412213 2026-05-10T18:11:47Z Stashbot 7414 urbanecm@deploy1003: mwscript-k8s job started: extensions/Translate/scripts/moveTranslatableBundle.php --wiki=metawiki '--reason=per [[:phab:T425504]]' ESEAP_Hub_Charter 'ESEAP Hub/Governance/Charter/Previous draft' 'Martin Urbanec' # T425504 2412214 wikitext text/x-wiki buqi1s244x7jmf9w65aanfz7pvvro6r 2412215 2412214 2026-05-10T18:20:01Z Stashbot 7414 urbanecm@deploy1003: mwscript-k8s job started: extensions/Translate/scripts/moveTranslatableBundle.php --wiki=metawiki '--reason=per [[:phab:T425503]]' ESEAP_Preparatory_Council/Proposed_theory_of_change 'ESEAP Hub/Governance/ESEAP Preparatory Council/Proposed theory of change' 'Martin Urbanec' # T425503 2412215 wikitext text/x-wiki sqf292q9rsw6zhlbtgpp7p0ajkf3wvg 2412216 2412215 2026-05-10T18:20:52Z Stashbot 7414 urbanecm@deploy1003: mwscript-k8s job started: extensions/Translate/scripts/moveTranslatableBundle.php --wiki=metawiki '--reason=per [[:phab:T425504]]' ESEAP_Hub_Charter 'ESEAP Hub/Governance/Charter/Previous draft' 'Martin Urbanec' # T425504 2412216 wikitext text/x-wiki be5yd5k5uo2ha4c3qdx9i91ye7le7k4 2412217 2412216 2026-05-10T18:25:34Z Stashbot 7414 urbanecm@deploy1003: mwscript-k8s job started: extensions/Translate/scripts/moveTranslatableBundle.php --wiki=metawiki '--reason=per [[:phab:T425504]]' ESEAP_Hub_Charter 'ESEAP Hub/Governance/Charter/Previous draft' 'Martin Urbanec' # T425504 2412217 wikitext text/x-wiki 49wcji23xqx9li7hciul63bqw9bds3o 2412227 2412217 2026-05-11T02:00:17Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2412227 wikitext text/x-wiki hrulf1ra1sw22g9uo7n9moqnck28iq7 2412232 2412227 2026-05-11T02:07:16Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 06m 58s) 2412232 wikitext text/x-wiki 17etgr16a8q0m1tqfgnn6ahs34v77ja 2412242 2412232 2026-05-11T05:53:27Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reimage for host ganeti5004.eqsin.wmnet with OS bookworm 2412242 wikitext text/x-wiki mi3haam965to8i56fhc6vc4087ooh09 2412243 2412242 2026-05-11T05:57:33Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.reboot-vm for VM bast6003.wikimedia.org 2412243 wikitext text/x-wiki hvus2dlgy11yuce05xc8xlw5pjscb9u 2412244 2412243 2026-05-11T06:03:44Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM bast6003.wikimedia.org 2412244 wikitext text/x-wiki b2vq21x4f0p9h7dsyxqmgsar47ikdrw 2412245 2412244 2026-05-11T06:08:18Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.reboot-vm for VM acmechief2002.codfw.wmnet 2412245 wikitext text/x-wiki e6randtpphov9xrai53zp198wleib8n 2412246 2412245 2026-05-11T06:12:17Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM acmechief2002.codfw.wmnet 2412246 wikitext text/x-wiki f4w974h2ybdy3q1nkjsq1v0ul2rs97t 2412247 2412246 2026-05-11T06:25:06Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on ganeti5004.eqsin.wmnet with reason: host reimage 2412247 wikitext text/x-wiki 8db90md9hoql3h9sltudoytskf0vkow 2412248 2412247 2026-05-11T06:29:13Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ganeti5004.eqsin.wmnet with reason: host reimage 2412248 wikitext text/x-wiki bh6u98jkywxuteq3zsekyp46zrp2dls 2412249 2412248 2026-05-11T06:50:50Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti5004.eqsin.wmnet with OS bookworm 2412249 wikitext text/x-wiki 4wg1bgvwhgr1wiywjki8b91d258tli8 2412250 2412249 2026-05-11T07:08:56Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.dns.wipe-cache zarcillo.discovery.wmnet on all recursors 2412250 wikitext text/x-wiki rmtrq02krtmpcovtlgxrp687pvqzllq 2412251 2412250 2026-05-11T07:09:00Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) zarcillo.discovery.wmnet on all recursors 2412251 wikitext text/x-wiki 074xcms9l4yjxtx913dgotssokxoa9m 2412252 2412251 2026-05-11T07:21:01Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: apply 2412252 wikitext text/x-wiki 1krn2tzsj8wixm4dqro8xv8k9dy12vc 2412253 2412252 2026-05-11T07:21:25Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: apply 2412253 wikitext text/x-wiki 5qg1na7mopo5t2l7wwiaz2uh44yjgzq 2412254 2412253 2026-05-11T07:24:00Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: apply 2412254 wikitext text/x-wiki 9sf937kgma130pxucw8pqt7liigwwe5 2412255 2412254 2026-05-11T07:24:22Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: apply 2412255 wikitext text/x-wiki 3e41tuy1j7tx907kxxl2dfb7wpcx40v 2412256 2412255 2026-05-11T07:47:04Z Stashbot 7414 jayme@deploy1003: helmfile [staging] START helmfile.d/services/ratelimit: apply 2412256 wikitext text/x-wiki 6d99xjba20qdc93yntcp03s0q1glxev 2412257 2412256 2026-05-11T07:48:26Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2412257 wikitext text/x-wiki oo99e7dxkittx1smek5ye1x6cmcu2dj 2412258 2412257 2026-05-11T07:49:00Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2412258 wikitext text/x-wiki prgy7w2zua2taxw8yqm71ym60jk37dg 2412259 2412258 2026-05-11T07:49:45Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. 2412259 wikitext text/x-wiki 9x7znz2l1rrzfvau2xy3pif5cmrkrmu 2412260 2412259 2026-05-11T07:50:36Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. 2412260 wikitext text/x-wiki m1d9o7hvl90xfle7xspwiun6apuyk0u 2412261 2412260 2026-05-11T07:55:33Z Stashbot 7414 jayme@deploy1003: helmfile [staging] DONE helmfile.d/services/ratelimit: apply 2412261 wikitext text/x-wiki q44nx4avcy6zblypi577pmbx3k8at7m 2412262 2412261 2026-05-11T07:56:41Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.dns.netbox 2412262 wikitext text/x-wiki d46oh3rgrziwtkn577ahtdgsi7a38uw 2412263 2412262 2026-05-11T08:00:42Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: remove old eqsin ganeti cluster VIP - ayounsi@cumin1003" 2412263 wikitext text/x-wiki 781sdt2s2lfy383cqjtx1ddfp49ha25 2412264 2412263 2026-05-11T08:00:47Z Stashbot 7414 ayounsi@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: remove old eqsin ganeti cluster VIP - ayounsi@cumin1003" 2412264 wikitext text/x-wiki 2495m144ktir028dj3043a92wdx3eyf 2412265 2412264 2026-05-11T08:00:49Z Stashbot 7414 ayounsi@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2412265 wikitext text/x-wiki csjshk0vquu7yi5ujte3gyhrnjrxulh 2412266 2412265 2026-05-11T08:05:04Z Stashbot 7414 jayme@deploy1003: helmfile [staging] START helmfile.d/services/ratelimit: apply 2412266 wikitext text/x-wiki lf6po2q3ctjjjw74tp0mnipa1pb92ug 2412267 2412266 2026-05-11T08:05:07Z Stashbot 7414 jayme@deploy1003: helmfile [staging] DONE helmfile.d/services/ratelimit: apply 2412267 wikitext text/x-wiki qovs9gfunkpvz36xykmg58wsxqas80y 2412268 2412267 2026-05-11T08:08:45Z Stashbot 7414 slyngshede@dns1004: START - running authdns-update 2412268 wikitext text/x-wiki rc4ey4uloh172yd35hkrj5rlwsu60rd 2412269 2412268 2026-05-11T08:10:13Z Stashbot 7414 slyngshede@dns1004: END - running authdns-update 2412269 wikitext text/x-wiki qvrrd9dhxqr5wd4ze0c1hnymns763aq 2412273 2412269 2026-05-11T08:16:43Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host ganeti5004.eqsin.wmnet 2412273 wikitext text/x-wiki khcp24muethzlxekl36p73t6ytmllhv 2412274 2412273 2026-05-11T08:26:51Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti5004.eqsin.wmnet 2412274 wikitext text/x-wiki 8h1fh4fhsm7vvdc1l4t7ycizo87jwz1 2412276 2412274 2026-05-11T08:41:06Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.addnode for new host ganeti5004.eqsin.wmnet to cluster eqsin02 and group 01 2412276 wikitext text/x-wiki 1zxg4rox8uqyltwsfd5fma7vy4rzujq 2412277 2412276 2026-05-11T08:42:29Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2218.codfw.wmnet with reason: Maintenance 2412277 wikitext text/x-wiki ktmjalnktzwj2av7cqn116g3oegr4x5 2412278 2412277 2026-05-11T08:42:34Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.addnode (exit_code=0) for new host ganeti5004.eqsin.wmnet to cluster eqsin02 and group 01 2412278 wikitext text/x-wiki 2rq4wnqh5nwilfskij9ik8q3hzvyww8 2412279 2412278 2026-05-11T08:42:37Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db2218 (T419961)', diff saved to https://phabricator.wikimedia.org/P92450 and previous config saved to /var/cache/conftool/dbconfig/20260511-084236-fceratto.json 2412279 wikitext text/x-wiki m6kp292ok624ftldybv5i4hwl1dnepo 2412280 2412279 2026-05-11T08:43:27Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.ganeti.changedisk for changing disk type of install5004.wikimedia.org to drbd 2412280 wikitext text/x-wiki ba1xbixswm1mdci5gyzx29nbyl5omnz 2412282 2412280 2026-05-11T08:49:47Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db2218 (T419961)', diff saved to https://phabricator.wikimedia.org/P92451 and previous config saved to /var/cache/conftool/dbconfig/20260511-084945-fceratto.json 2412282 wikitext text/x-wiki ckculcw5xf01dgzzsqr0840cr66o220 2412283 2412282 2026-05-11T08:50:39Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1230.eqiad.wmnet with reason: Maintenance 2412283 wikitext text/x-wiki sk6bi008mqaixuzkuh2nmmich4h0ouo 2412284 2412283 2026-05-11T08:55:46Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1230.eqiad.wmnet with reason: Maintenance 2412284 wikitext text/x-wiki 3uqljiypa83fgdhq2k05d4h2f6n5gaj 2412285 2412284 2026-05-11T08:56:45Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.mysql.pool pool db1230: T419635 2412285 wikitext text/x-wiki bwz8pwlcri6y3fowt20cfd8xgwer8m2 2412286 2412285 2026-05-11T08:58:29Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply 2412286 wikitext text/x-wiki ln38uz7qfof7xot4dv0r3y1l1kkqhdh 2412287 2412286 2026-05-11T08:58:48Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply 2412287 wikitext text/x-wiki 4xmno4u9k42q11d69cws4yde5vizoba 2412288 2412287 2026-05-11T08:59:55Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db2218', diff saved to https://phabricator.wikimedia.org/P92453 and previous config saved to /var/cache/conftool/dbconfig/20260511-085954-fceratto.json 2412288 wikitext text/x-wiki p27qubcwpyr4k4h26x7jkrof1wb6u5v 2412289 2412288 2026-05-11T09:04:18Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of install5004.wikimedia.org to drbd 2412289 wikitext text/x-wiki n9wn5qft1uol165prppyhcapi2o4sto 2412290 2412289 2026-05-11T09:06:45Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply 2412290 wikitext text/x-wiki 45nsaic27xdicuwzqbk43pwh4nd9b8o 2412292 2412290 2026-05-11T09:07:14Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply 2412292 wikitext text/x-wiki m6rb98htrw2714i0sq3v9sik2zv6u7x 2412294 2412292 2026-05-11T09:08:42Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/services/miscweb: apply 2412294 wikitext text/x-wiki ari776ibszr4k2723pfuwfvt9f0smyt 2412295 2412294 2026-05-11T09:09:01Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/services/miscweb: apply 2412295 wikitext text/x-wiki l62fh1yupgf6agxit9qmofr0mvbwk9p 2412296 2412295 2026-05-11T09:10:03Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db2218', diff saved to https://phabricator.wikimedia.org/P92454 and previous config saved to /var/cache/conftool/dbconfig/20260511-091001-fceratto.json 2412296 wikitext text/x-wiki elg602q1rxfs2hhbcqitxap7vwopbo8 2412300 2412296 2026-05-11T09:20:11Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db2218 (T419961)', diff saved to https://phabricator.wikimedia.org/P92456 and previous config saved to /var/cache/conftool/dbconfig/20260511-092010-fceratto.json 2412300 wikitext text/x-wiki 950u5sirs32634rh29qpkfrsgh66eza 2412301 2412300 2026-05-11T09:24:47Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply 2412301 wikitext text/x-wiki 74s2k4lf7taxsmzz0l70fiyyto5pvw2 2412302 2412301 2026-05-11T09:25:25Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply 2412302 wikitext text/x-wiki hcszko36unb2nsx36lfw1vf2qet2oio 2412303 2412302 2026-05-11T09:31:34Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply 2412303 wikitext text/x-wiki 2rtjjyiuwgmbi6ba4g3s1m5k1tz74na 2412304 2412303 2026-05-11T09:32:00Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply 2412304 wikitext text/x-wiki 2hq0uinitzjnxf7f0kfsyng4qxs98ag 2412305 2412304 2026-05-11T09:36:44Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply 2412305 wikitext text/x-wiki tae9wpharpoh7ur3y0ciz14z14l3m9p 2412306 2412305 2026-05-11T09:37:12Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply 2412306 wikitext text/x-wiki kci2fcfy4l7ctkfo1855h1wgubjpox1 2412307 2412306 2026-05-11T09:40:09Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply 2412307 wikitext text/x-wiki c8bdeyfwpg7f5x10ovss008kcfvmfkr 2412308 2412307 2026-05-11T09:40:35Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply 2412308 wikitext text/x-wiki rg5rv1n2ijdikvn2akgnrg2tigc6vgq 2412309 2412308 2026-05-11T09:41:36Z Stashbot 7414 kharlan@deploy1003: Started scap sync-world: Backport for [[gerrit:1285731|hCaptcha: Enable for group0 wikis (T425354)]] 2412309 wikitext text/x-wiki rj59md3fya5b8rmmrg4vud2xgjrv7xn 2412310 2412309 2026-05-11T09:42:11Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1230: T419635 2412310 wikitext text/x-wiki jobodsbf5mq8hbwqkq9ka155clixcza 2412311 2412310 2026-05-11T09:46:09Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/services/miscweb: apply 2412311 wikitext text/x-wiki pogcjti9zlm4o7b6u3to5f9ihyxyy2s 2412312 2412311 2026-05-11T09:46:37Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/services/miscweb: apply 2412312 wikitext text/x-wiki je965th23h1lr0ppjdyrvjlv1keirer 2412313 2412312 2026-05-11T09:57:07Z Stashbot 7414 slyngshede@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on lvs2012.codfw.wmnet with reason: Hardware failure 2412313 wikitext text/x-wiki 2abuu7wtjzq61e0qddk9tlivcqiebtu 2412315 2412313 2026-05-11T09:57:52Z Stashbot 7414 slyngshede@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 30 days, 0:00:00 on lvs2012.codfw.wmnet with reason: Hardware failure 2412315 wikitext text/x-wiki bi255xkgsma12irim71bik77bhxymkb 2412316 2412315 2026-05-11T09:57:58Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/services/miscweb: apply 2412316 wikitext text/x-wiki hau29ngwjrb88x4ml9ah7hnhar43si5 2412317 2412316 2026-05-11T09:58:17Z Stashbot 7414 kharlan@deploy1003: kharlan: Backport for [[gerrit:1285731|hCaptcha: Enable for group0 wikis (T425354)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2412317 wikitext text/x-wiki qkhrt66f34p9ve12c0jwh0aoxy23uc5 2412318 2412317 2026-05-11T09:58:18Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/services/miscweb: apply 2412318 wikitext text/x-wiki tfltp722n4ljj7jzfdlbijdeb2cskml 2412319 2412318 2026-05-11T09:58:33Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/services/miscweb: apply 2412319 wikitext text/x-wiki lb4geu1qg6u2j25llw7l6ig9sqw57sn 2412320 2412319 2026-05-11T09:58:58Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/services/miscweb: apply 2412320 wikitext text/x-wiki cwa1ju8vi9t0tiipky4yqldvx2inj1h 2412321 2412320 2026-05-11T09:59:38Z Stashbot 7414 kharlan@deploy1003: kharlan: Continuing with deployment 2412321 wikitext text/x-wiki n9sargdf170acmhujsemk2l1uol48ko 2412322 2412321 2026-05-11T10:01:09Z Stashbot 7414 fceratto@cumin1003: DONE (ERROR) - Cookbook sre.hosts.downtime (exit_code=97) for 12:00:00 on db1245.eqiad.wmnet with reason: Maintenance 2412322 wikitext text/x-wiki 43rpivzbjyget0jhn8fb4qmmyuix11k 2412323 2412322 2026-05-11T10:01:24Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1245.eqiad.wmnet with reason: Maintenance 2412323 wikitext text/x-wiki 2cuk7y1ej2y3hcykglsyjrjvo4iy92k 2412325 2412323 2026-05-11T10:04:48Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1245.eqiad.wmnet with reason: Maintenance 2412325 wikitext text/x-wiki fb6at2f958tp27sz5dcnq1dp23oj4kc 2412326 2412325 2026-05-11T10:06:22Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1245.eqiad.wmnet with reason: Maintenance 2412326 wikitext text/x-wiki kqzt0w9t1xnv853oirtcvncunqqss7z 2412327 2412326 2026-05-11T10:10:42Z Stashbot 7414 moritzm: rebalance routed Ganeti cluster in eqsin T421863 2412327 wikitext text/x-wiki keklgabbg01880gekmt69a5ahkbdmfh 2412328 2412327 2026-05-11T10:11:53Z Stashbot 7414 kharlan@deploy1003: Finished scap sync-world: Backport for [[gerrit:1285731|hCaptcha: Enable for group0 wikis (T425354)]] (duration: 30m 15s) 2412328 wikitext text/x-wiki m1l91kt2186wv95yrnn87zl7wvnsx0k 2412329 2412328 2026-05-11T10:12:57Z Stashbot 7414 jayme@deploy1003: helmfile [staging] START helmfile.d/services/ratelimit: apply 2412329 wikitext text/x-wiki k6qbatv69b4sjgnfhtivxdygyzhdyj3 2412330 2412329 2026-05-11T10:13:09Z Stashbot 7414 jayme@deploy1003: helmfile [staging] DONE helmfile.d/services/ratelimit: apply 2412330 wikitext text/x-wiki 56l1ohc3oifov3imukox3rtfwtucoww 2412331 2412330 2026-05-11T10:13:16Z Stashbot 7414 jayme@deploy1003: helmfile [staging] START helmfile.d/services/ratelimit: apply 2412331 wikitext text/x-wiki 2qy4nrcbp9zoskbxuue80zd8vz1ize5 2412332 2412331 2026-05-11T10:13:34Z Stashbot 7414 jayme@deploy1003: helmfile [staging] DONE helmfile.d/services/ratelimit: apply 2412332 wikitext text/x-wiki l4tagpte4yy8a0k2qgpdi8cfkcu7cty 2412333 2412332 2026-05-11T10:13:45Z Stashbot 7414 jayme@deploy1003: helmfile [staging] START helmfile.d/services/ratelimit: apply 2412333 wikitext text/x-wiki 8u40dzbr0hesovvsouvfabwbmowg26m 2412334 2412333 2026-05-11T10:14:23Z Stashbot 7414 jayme@deploy1003: helmfile [staging] DONE helmfile.d/services/ratelimit: apply 2412334 wikitext text/x-wiki i6hrsfn2fnkxct0lgrbkzkd0ztdmqg8 2412335 2412334 2026-05-11T10:16:35Z Stashbot 7414 slyngs: Migrate of lvs2012 due to hardware issues 2412335 wikitext text/x-wiki icpcx9gotv02yiu703tsru7m5hhy8ef 2412336 2412335 2026-05-11T10:21:06Z Stashbot 7414 jayme@deploy1003: helmfile [codfw] START helmfile.d/services/ratelimit: apply 2412336 wikitext text/x-wiki ev9wtyeyktncvnto1xgi6l6xc2mcijc 2412337 2412336 2026-05-11T10:21:40Z Stashbot 7414 jayme@deploy1003: helmfile [codfw] DONE helmfile.d/services/ratelimit: apply 2412337 wikitext text/x-wiki bcf6brqhc8i0vhjhg15b0zyzb0qo5ax 2412338 2412337 2026-05-11T10:21:57Z Stashbot 7414 jayme@deploy1003: helmfile [eqiad] START helmfile.d/services/ratelimit: apply 2412338 wikitext text/x-wiki 7pw2d3jsxuymreddlzhjyjgefusqd6x 2412339 2412338 2026-05-11T10:22:34Z Stashbot 7414 jayme@deploy1003: helmfile [eqiad] DONE helmfile.d/services/ratelimit: apply 2412339 wikitext text/x-wiki eeqfmdfce51g3cuho36m0ghhg8ywctb 2412340 2412339 2026-05-11T10:23:22Z Stashbot 7414 jayme@deploy1003: Started scap sync-world: update rsyslog image 2412340 wikitext text/x-wiki jafwybfnbtu9y11szvel6i1l8oa3ysa 2412341 2412340 2026-05-11T10:26:24Z Stashbot 7414 jayme@deploy1003: Finished scap sync-world: update rsyslog image (duration: 03m 48s) 2412341 wikitext text/x-wiki c21pnlo1fx2jf71axzcb0jnsijlsfdn 2412344 2412341 2026-05-11T10:41:26Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on dbstore1008.eqiad.wmnet with reason: Maintenance 2412344 wikitext text/x-wiki 1nfjhgrn14zz1iag8qtqxd8r6v5qe2m 2412345 2412344 2026-05-11T10:52:11Z Stashbot 7414 taavi@cumin1003: DONE (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Clément Goubert out of all services on: 2459 hosts 2412345 wikitext text/x-wiki fb96slvxdy4hid0r5nu8hsln2v24bm5 2412346 2412345 2026-05-11T10:59:48Z Stashbot 7414 jayme: uprading rsyslog to 8.2504.0-1 in all mediawiki deployments - T418200 2412346 wikitext text/x-wiki nj81uaop6wtzl7yqn3jpm5iy5py3hmo 2412347 2412346 2026-05-11T11:00:47Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on dbstore1009.eqiad.wmnet with reason: Maintenance 2412347 wikitext text/x-wiki fewl8b73metyd59oiyeujr8hu9kwfak 2412348 2412347 2026-05-11T11:03:22Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on dbstore1008.eqiad.wmnet with reason: Maintenance 2412348 wikitext text/x-wiki 36soucwn9eaybtkfyfw9v9gltwgd6zz 2412349 2412348 2026-05-11T11:08:34Z Stashbot 7414 jayme@deploy1003: Started scap sync-world: upgrade rsyslog on all deployments T418200 2412349 wikitext text/x-wiki ll7yhspoqnotd8t1hmhhhmgjmahtsex 2412350 2412349 2026-05-11T11:21:14Z Stashbot 7414 jayme@deploy1003: Rolling back deployment 2412350 wikitext text/x-wiki tgw831ymc6lvbbr8ollacjc1sos186g 2412351 2412350 2026-05-11T11:21:17Z Stashbot 7414 jayme@deploy1003: Finished scap sync-world: upgrade rsyslog on all deployments T418200 (duration: 13m 28s) 2412351 wikitext text/x-wiki qabgzz98vswji99a2v3pratqr378ixo 2412352 2412351 2026-05-11T11:27:11Z Stashbot 7414 jayme@deploy1003: helmfile [codfw] START helmfile.d/services/mw-videoscaler: apply 2412352 wikitext text/x-wiki bb61g59v3hyk2w78bsc3ocsdzs2b3n2 2412353 2412352 2026-05-11T11:27:22Z Stashbot 7414 jayme@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-videoscaler: apply 2412353 wikitext text/x-wiki mp0qfihui1afut17w3swik47r2m9ndx 2412354 2412353 2026-05-11T11:31:53Z Stashbot 7414 moritzm: installing Linux 6.12.86 on Trixie hosts 2412354 wikitext text/x-wiki h98i0qkmvp0a6dmpp9k2ekvrvuv1ecq 2412356 2412354 2026-05-11T11:48:16Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2185.codfw.wmnet with reason: Reboot 2412356 wikitext text/x-wiki tq8pojs57ueqdzc51uysh5owc6hoelr Annual Toolforge Survey 0 441684 2412230 2033818 2026-05-11T02:04:20Z SSapaty (WMF) 28955 Update link to point to current process 2412230 wikitext text/x-wiki ltp6rpcbrw15za13akpfzvfsuirbpr3 2412234 2412230 2026-05-11T02:25:41Z SSapaty (WMF) 28955 Add link to Developer Satisfaction Survey 2412234 wikitext text/x-wiki 22qc4o9hthzvmlbrhusjio17m9azqcn Annual Toolforge Survey/Opt out 0 441685 2412233 2381101 2026-05-11T02:19:27Z SSapaty (WMF) 28955 Remove archive template since the updated survey process still makes use of this page 2412233 wikitext text/x-wiki jmz1x6obrlq7z4qcci5xr6faonycazi Nova Resource:Tools.integraality/SAL 498 443949 2412199 2412135 2026-05-10T12:11:08Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy f57a49d (Remove unused local variable in RedisCache.list_keys) 2412199 wikitext text/x-wiki c7mpo28rs1e0w5ezhljh4f46df26bhw 2412200 2412199 2026-05-10T12:11:09Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 2bd496d (Fix ruff config: use extend-select instead of select) 2412200 wikitext text/x-wiki ohqir1mxashpvieeshenzet4js392qm 2412201 2412200 2026-05-10T12:11:10Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 4262f3e (Extract config assembly from PagesProcessor into ConfigAssembler) 2412201 wikitext text/x-wiki 1tfpsqa9rooqn0jtsh9zhi5oot8j6n3 2412202 2412201 2026-05-10T12:11:11Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy f348720 (Move ConfigAssembler tests to their own test_config_assembler.py) 2412202 wikitext text/x-wiki jr7xl740j815yovnzfeg19f92g2ps2r 2412203 2412202 2026-05-10T12:11:12Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 0b7171b (Add Ansible handler to log deploys to Server Admin Log via dologmsg) 2412203 wikitext text/x-wiki n6i6pwt36fiaa1l834u8hbiyhxnn89x MariaDB/Upgrading a section 0 447862 2412275 2411037 2026-05-11T08:28:31Z FCeratto-WMF 39104 More clear headers 2412275 wikitext text/x-wiki ofvekf9sj0vpw60sxufzpf7woou14mn Annual Toolforge Survey/How to 0 448709 2412228 2366991 2026-05-11T02:01:34Z SSapaty (WMF) 28955 Add historical template and point to current process. 2412228 wikitext text/x-wiki jno05hier2m9zhka1plh34ftdfhr5h9 Map of database maintenance 0 449160 2412219 2412192 2026-05-11T00:01:08Z Dexbot 30554 Bot: Updating the report 2412219 wikitext text/x-wiki e6c955dzdvh3f0v0rx59w88u1mrj1ta 2412281 2412219 2026-05-11T08:44:03Z Dexbot 30554 Bot: Updating the report 2412281 wikitext text/x-wiki 9ui9zg587vi95xr5h723mdx2y0vtg4p Test Kitchen/Decommission an instrument 0 454135 2412314 2365681 2026-05-11T09:57:36Z Adam Wight (WMDE) 3064 typo 2412314 wikitext text/x-wiki adchpsyq6jnxwt44bezdasz40sgk2b0 Yubikey-SSH-FIDO 0 457955 2412204 2401054 2026-05-10T12:47:38Z Novem Linguae 23682 /* 1. Install Yubikey management software */ add bash command 2412204 wikitext text/x-wiki dw60p7vcr6rbinhyjhg0vlitcht7w47 Tool:Etherpad-backup/Log 116 460070 2412207 2411534 2026-05-10T18:00:30Z EtherpadBackupBot 54504 wep_data_task_force_meeting_#1 archived by BryanDavis 2412207 wikitext text/x-wiki c48wsa2hrfgwnofy92jv0ijntposb3o 2412208 2412207 2026-05-10T18:01:34Z EtherpadBackupBot 54504 wdqs-500s archived by BryanDavis 2412208 wikitext text/x-wiki cjuqs38g6puwxusbwn23jurgtkkg6z7 2412209 2412208 2026-05-10T18:03:28Z EtherpadBackupBot 54504 wmh2023-Past,_Present_and_Future_of_Wikimedia archived by BryanDavis 2412209 wikitext text/x-wiki ppphwas9f4c4xaqkygr3d3i0lz4lqs6 2412211 2412209 2026-05-10T18:10:36Z EtherpadBackupBot 54504 wmhackshowcase2020 archived by BryanDavis 2412211 wikitext text/x-wiki 0w1hi2lldulwifqwxz0qreo25tm52my User:SSapaty (WMF)/Draft/Annual Cloud Services Survey 2 460108 2412218 2407849 2026-05-10T23:41:20Z SSapaty (WMF) 28955 Update documentation with Phab ticket for context 2412218 wikitext text/x-wiki kmahxel4f0gu4iau8orr74x38oik7lm 2412237 2412218 2026-05-11T02:29:12Z SSapaty (WMF) 28955 2412237 wikitext text/x-wiki diwfm5yydazn40ge7squ7vamsf2aklk Nova Resource:Tools.wikimonitor/SAL 498 460126 2412205 2411899 2026-05-10T13:21:06Z Stashbot 7414 wmbot~gergesshamon@tools-bastion-15: A pull request (https://github.com/wiki-connect/wikimonitor/pull/57) has been submitted by Gerges on GitHub (T424152) 2412205 wikitext text/x-wiki ojk5n9qxvct0t51vi1atvvjn5qaijxc 2412206 2412205 2026-05-10T13:22:47Z Stashbot 7414 wmbot~gergesshamon@tools-bastion-15: A pull request (https://github.com/wiki-connect/wikimonitor/pull/57) has been submitted by Gerges has been merged (T424152) 2412206 wikitext text/x-wiki 6wsweyf7vnw6lhx09mwj5bbx1mlde6t Template:Blazegraph Migration Navbar 10 460153 2412293 2412034 2026-05-11T09:08:35Z Udehb-WMF 40856 2412293 wikitext text/x-wiki a1g9il1x8a4uhq8j97f18jhtvpt1v4f Annual Toolforge Survey/Ops 0 460159 2412226 2026-05-11T01:57:38Z SSapaty (WMF) 28955 First draft 2412226 wikitext text/x-wiki kmahxel4f0gu4iau8orr74x38oik7lm 2412229 2412226 2026-05-11T02:02:34Z SSapaty (WMF) 28955 /* Bulk emailing instructions */ 2412229 wikitext text/x-wiki 38ftpewtgiwywrzfr82g66eiev4yh1x 2412231 2412229 2026-05-11T02:06:54Z SSapaty (WMF) 28955 Add comment to instructions 2412231 wikitext text/x-wiki o63abyqsge9gk0zis402z7zoh3zqm70 2412235 2412231 2026-05-11T02:26:56Z SSapaty (WMF) 28955 2412235 wikitext text/x-wiki 74s22u95pt467rfs531gou65h08y9oh 2412236 2412235 2026-05-11T02:27:13Z SSapaty (WMF) 28955 2412236 wikitext text/x-wiki 3xuapc9a52618iasfjw8n8m9ofig05o 2412238 2412236 2026-05-11T02:33:19Z SSapaty (WMF) 28955 And documentation page for the python script for sending out emails 2412238 wikitext text/x-wiki ptvtqrf302iifikel1fm7nxgwpx2zfc 2412241 2412238 2026-05-11T03:14:42Z SSapaty (WMF) 28955 /* Bulk emailing instructions */ 2412241 wikitext text/x-wiki 79uv3khb73hi8jgbjoz0f6u6bwzcoo7 Annual Toolforge Survey/Ops/SendEmailViaToolforge.py 0 460160 2412240 2026-05-11T03:07:32Z SSapaty (WMF) 28955 New page for email script 2412240 wikitext text/x-wiki nc6c5sts5582suiozspnoycstrcxb4h Wikidata Query Service/WDQS Architecture re-design 0 460161 2412291 2026-05-11T09:07:09Z Udehb-WMF 40856 Created page with "{{Template:Blazegraph_Migration_Navbar}} '''NoTeam''': [[Wikidata Platform]]<br />'''Date:''' 2026-5 == Overview == This document describes the design of the architecture of the next version of the WDQS service. As we move the backend away from Blazegraph, we need to decouple the database from service layers, and handle bespoke logic that is currently implemented in the database itself. We want the next version of WDQS to be database agnostic, with an API contract that..." 2412291 wikitext text/x-wiki 1t0t5pp7ffnayicrv6ds5mn4iry2pxb Talk:Wikidata Query Service/WDQS Architecture re-design 1 460162 2412297 2026-05-11T09:15:42Z Udehb-WMF 40856 Redirected page to [[wikidata:Wikidata talk:SPARQL query service/WDQS backend update]] 2412297 wikitext text/x-wiki au5pdasf7b9knggcu2grayox8xtsvbj 2412298 2412297 2026-05-11T09:16:52Z Udehb-WMF 40856 Removed redirect to [[wikidata:Wikidata talk:SPARQL query service/WDQS backend update]] 2412298 wikitext text/x-wiki 3hv8bwhz05stej8b5hjun25ukdikp6a 2412299 2412298 2026-05-11T09:17:55Z Udehb-WMF 40856 Redirected page to [[wikidata:Wikidata talk:SPARQL query service/WDQS backend update]] 2412299 wikitext text/x-wiki au5pdasf7b9knggcu2grayox8xtsvbj