Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.21 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 0 4108 2461141 2461097 2026-09-27T17:04:19Z Mmullie (WMF) 291 /* {{Deployment_day|date=2026-09-28}} */ 2461141 wikitext text/x-wiki 24mslvzdj31f35b4cnpmzjwspno6brd 2461157 2461141 2026-09-28T06:48:40Z Mmullie (WMF) 291 /* {{Deployment_day|date=2026-09-28}} */ 2461157 wikitext text/x-wiki nsf7pwuafiz8v73r70ul6upjpyasnnj 2461158 2461157 2026-09-28T06:51:01Z Mmullie (WMF) 291 /* {{Deployment_day|date=2026-09-28}} */ 2461158 wikitext text/x-wiki 01ui88bs3f8xmkzyjbc15j0s678plus 2461164 2461158 2026-09-28T07:29:09Z Adam Wight (WMDE) 3064 /* {{Deployment_day|date=2026-09-28}} */ cancelling a deployment 2461164 wikitext text/x-wiki jcguja6u7f38w2q3tu7bnwlhzhzjzls 2461208 2461164 2026-09-28T08:44:36Z Mmullie (WMF) 291 /* {{Deployment_day|date=2026-09-28}} */ 2461208 wikitext text/x-wiki nsdfd8al6vo6maqukff2guejdm255da 0 7919 2461146 2461138 2026-09-28T02:00:22Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2461146 wikitext text/x-wiki q8y0n4tgz5tzf0yl86o32nxnxiid9iy 2461147 2461146 2026-09-28T02:08:10Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 07m 48s) 2461147 wikitext text/x-wiki 8qm4z15mn9jn8kbgqmtrc9qucae0ifo 2461151 2461147 2026-09-28T06:09:46Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/ferretdb-growthbook: apply 2461151 wikitext text/x-wiki h0ngq68gl7r55hiausqkiwamgiz4k8i 2461152 2461151 2026-09-28T06:09:47Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/ferretdb-growthbook: apply 2461152 wikitext text/x-wiki 3rhnp174ps6el4lseduyvavw96pbwj4 2461153 2461152 2026-09-28T06:10:05Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/ferretdb-growthbook-next: apply 2461153 wikitext text/x-wiki a2n4iy4bgewymuuy6vgpniibt959zg6 2461154 2461153 2026-09-28T06:10:08Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/ferretdb-growthbook-next: apply 2461154 wikitext text/x-wiki 2zimlw0yrviwjifd9mctgvlekl1zrhz 2461155 2461154 2026-09-28T06:27:59Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-growthbook-next: apply 2461155 wikitext text/x-wiki pl3utykxufd7qghc4oi5r2itbzb7h4m 2461156 2461155 2026-09-28T06:28:03Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-growthbook-next: apply 2461156 wikitext text/x-wiki 3qf9ivitw26r2znn3cvwe7lte9e2v08 2461161 2461156 2026-09-28T07:08:09Z Stashbot 7414 mlitn@deploy1003: Started scap sync-world: Backport for [[gerrit:1345070|[MultimediaViewer] Testwiki use same carousel config as other wikis]], [[gerrit:1345371|Fix jump to image break in carousel retest (T439252)]], [[gerrit:1345369|Remove reliance on ParserOutput (T439182)]], [[gerrit:1345370|Remove reliance on file repo (T439182)]] 2461161 wikitext text/x-wiki 4sali1h3qoeqrd12a9eny5eyjc6lfi9 2461162 2461161 2026-09-28T07:26:48Z Stashbot 7414 mlitn@deploy1003: mlitn: Backport for [[gerrit:1345070|[MultimediaViewer] Testwiki use same carousel config as other wikis]], [[gerrit:1345371|Fix jump to image break in carousel retest (T439252)]], [[gerrit:1345369|Remove reliance on ParserOutput (T439182)]], [[gerrit:1345370|Remove reliance on file repo (T439182)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verifi 2461162 wikitext text/x-wiki n421glbj9rde9um4q8zpoxwi848akun 2461163 2461162 2026-09-28T07:27:36Z Stashbot 7414 mlitn@deploy1003: mlitn: Continuing with deployment 2461163 wikitext text/x-wiki mxo3ccn0z9sowcg7c2mobqnjluzqux6 2461165 2461163 2026-09-28T07:38:06Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on A:cp-text_codfw and not P{cp2059.*} and A:cp - 3.2.23 upgrade (T438828) 2461165 wikitext text/x-wiki 9uayj0picgna3qousnluoyrrg3ncauj 2461166 2461165 2026-09-28T07:38:19Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on A:cp-upload_codfw and A:cp - 3.2.23 upgrade (T438828) 2461166 wikitext text/x-wiki n44chik4mzzbfxka0kc9j4pquhzxbvg 2461167 2461166 2026-09-28T07:40:15Z Stashbot 7414 mlitn@deploy1003: Finished scap sync-world: Backport for [[gerrit:1345070|[MultimediaViewer] Testwiki use same carousel config as other wikis]], [[gerrit:1345371|Fix jump to image break in carousel retest (T439252)]], [[gerrit:1345369|Remove reliance on ParserOutput (T439182)]], [[gerrit:1345370|Remove reliance on file repo (T439182)]] (duration: 32m 06s) 2461167 wikitext text/x-wiki 31o596gw6oudtv4tic14estmb5qo8kv 2461168 2461167 2026-09-28T07:44:56Z Stashbot 7414 mlitn@deploy1003: Started scap sync-world: Backport for [[gerrit:1343611|Growth: Set minimum registration date for A/B test (T432126)]], [[gerrit:1344594|EarlyOnboarding: record account setup motivation in `action_context` (T437339)]] 2461168 wikitext text/x-wiki hzj91yqtogab38uowatvds5yd59czah 2461169 2461168 2026-09-28T07:47:44Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.hosts.rename from ganeti-jumbo2001 to dse-k8s-worker2006 2461169 wikitext text/x-wiki mzaehai5iarbzdvxhmn4inx035muy2s 2461170 2461169 2026-09-28T07:48:06Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.dns.netbox 2461170 wikitext text/x-wiki hd7dy8ybldv7pz5mgk5ma44gerseeeg 2461171 2461170 2026-09-28T07:49:12Z Stashbot 7414 mlitn@deploy1003: migr, mlitn: Backport for [[gerrit:1343611|Growth: Set minimum registration date for A/B test (T432126)]], [[gerrit:1344594|EarlyOnboarding: record account setup motivation in `action_context` (T437339)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2461171 wikitext text/x-wiki 4f3kx41bxxnd9lve4cqrajvd4i5fcez 2461172 2461171 2026-09-28T07:51:48Z Stashbot 7414 mlitn@deploy1003: migr, mlitn: Continuing with deployment 2461172 wikitext text/x-wiki tdsop10k8jn071a7rcjgap0efqfz7vy 2461173 2461172 2026-09-28T07:52:03Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming ganeti-jumbo2001 to dse-k8s-worker2006 - brouberol@cumin1004" 2461173 wikitext text/x-wiki t9lwr8jpt4uqlzbr8xgx2i9t1dtqin6 2461174 2461173 2026-09-28T07:52:17Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming ganeti-jumbo2001 to dse-k8s-worker2006 - brouberol@cumin1004" 2461174 wikitext text/x-wiki 3d3mkk1nu3ggsfikyoafwg2a89kcb8l 2461175 2461174 2026-09-28T07:52:18Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2461175 wikitext text/x-wiki ho2gzyfdk0zrg48v5ioz1avvsdxbke2 2461176 2461175 2026-09-28T07:52:19Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.dns.wipe-cache dse-k8s-worker2006 on all recursors 2461176 wikitext text/x-wiki l6awtij6czcrge7pfvbcph0927lpbs7 2461177 2461176 2026-09-28T07:52:21Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) dse-k8s-worker2006 on all recursors 2461177 wikitext text/x-wiki 2cthb14s1brsu3m6wskvemu9d51urvf 2461178 2461177 2026-09-28T07:52:22Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.network.configure-switch-interfaces for host dse-k8s-worker2006 2461178 wikitext text/x-wiki 4bii6jqnxn2krp0sib5bo5lyb6zcols 2461179 2461178 2026-09-28T07:52:34Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dse-k8s-worker2006 2461179 wikitext text/x-wiki 3yr0i2vyn28wo5e9ctvongazk7a3l5r 2461180 2461179 2026-09-28T07:53:10Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from ganeti-jumbo2001 to dse-k8s-worker2006 2461180 wikitext text/x-wiki 0wxcuoysns9nn7wv5pvvrb9wessg9j3 2461184 2461180 2026-09-28T07:58:06Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.hosts.reimage for host dse-k8s-worker2006.codfw.wmnet with OS bookworm 2461184 wikitext text/x-wiki qz3wof5kt4gr2xl6iog1cidrvhcee7m 2461185 2461184 2026-09-28T07:59:08Z Stashbot 7414 mlitn@deploy1003: Finished scap sync-world: Backport for [[gerrit:1343611|Growth: Set minimum registration date for A/B test (T432126)]], [[gerrit:1344594|EarlyOnboarding: record account setup motivation in `action_context` (T437339)]] (duration: 14m 12s) 2461185 wikitext text/x-wiki 3q5vavsib6jufzamv46zcxjw4fsv5m8 2461186 2461185 2026-09-28T07:59:31Z Stashbot 7414 matthiasmullie: UTC morning backport window complete 2461186 wikitext text/x-wiki 6wrmqewn9mj7cqnin0tlza5st1jo274 2461187 2461186 2026-09-28T08:04:43Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on A:cp-upload_codfw and A:cp - 3.2.23 upgrade (T438828) 2461187 wikitext text/x-wiki ed2dxc8swl6nj8d3yypb0ew3n37wa0m 2461199 2461187 2026-09-28T08:16:08Z Stashbot 7414 moritzm: installing Exim security updates 2461199 wikitext text/x-wiki 4vexmpwcj81ftaxvi12v824da52csml 2461201 2461199 2026-09-28T08:18:39Z Stashbot 7414 brouberol@cumin1004: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host dse-k8s-worker2006.codfw.wmnet with OS bookworm 2461201 wikitext text/x-wiki nl7sppd3iz8tesil38kffepcqtv2101 2461202 2461201 2026-09-28T08:18:54Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.hosts.reimage for host dse-k8s-worker2006.codfw.wmnet with OS bookworm 2461202 wikitext text/x-wiki j9awfmjl1582bt7hvln7hu1vso2ib4y 2461203 2461202 2026-09-28T08:26:25Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on A:cp-text_codfw and not P{cp2059.*} and A:cp - 3.2.23 upgrade (T438828) 2461203 wikitext text/x-wiki fhk9m5q29k6de20x1t3mzv59y0hkf0w 2461204 2461203 2026-09-28T08:29:43Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on dse-k8s-worker2006.codfw.wmnet with reason: host reimage 2461204 wikitext text/x-wiki hf449jexxiusm7pcojgij549r831w6j 2461205 2461204 2026-09-28T08:33:08Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dse-k8s-worker2006.codfw.wmnet with reason: host reimage 2461205 wikitext text/x-wiki 77f6cwitrwit589yw2ulz6jtvc3e9aq 2461206 2461205 2026-09-28T08:36:53Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/liftwing-studio: sync 2461206 wikitext text/x-wiki 0ru7s7o3ekxjcnq65hgqhs5z5pa2lwx 2461207 2461206 2026-09-28T08:44:14Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/liftwing-studio: sync 2461207 wikitext text/x-wiki k1rqnx5fqp7onk0izq7qajuqskyb8dk 2461210 2461207 2026-09-28T08:50:13Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dse-k8s-worker2006.codfw.wmnet with OS bookworm 2461210 wikitext text/x-wiki 7kgbtydiyy8xv993ljcep93s6wv0jw0 2461211 2461210 2026-09-28T08:51:16Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/ferretdb-liftwing-studio: sync 2461211 wikitext text/x-wiki jjy5yvyrhs94af5v2ys39eqsa46llec 2461212 2461211 2026-09-28T08:51:24Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/ferretdb-liftwing-studio: sync 2461212 wikitext text/x-wiki iujkbmr90z0bpxwxxy1r7oy7pxd35g8 2461213 2461212 2026-09-28T08:52:03Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-liftwing-studio: sync 2461213 wikitext text/x-wiki kyjxdabpyclxfza6xh1cra5xdq05o28 2461214 2461213 2026-09-28T08:52:05Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-liftwing-studio: sync 2461214 wikitext text/x-wiki cewd8e103g5rm9amcsqiltkf3ke6zey 2461215 2461214 2026-09-28T08:52:22Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/liftwing-studio: sync 2461215 wikitext text/x-wiki owbhycyzr7pxfnw1k66aeb5x7kwdgne 2461216 2461215 2026-09-28T09:00:21Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply 2461216 wikitext text/x-wiki o2fh4cqb38pybibtuus0sz22c8f643h 2461217 2461216 2026-09-28T09:00:31Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply 2461217 wikitext text/x-wiki nri85rw7hv3hvixlk0yih5cht7urr3x 2461218 2461217 2026-09-28T09:03:51Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/liftwing-studio: sync 2461218 wikitext text/x-wiki oht0lf35dokebjog8xartrojcawjxkm 2461219 2461218 2026-09-28T09:04:51Z Stashbot 7414 dkertesz: running ncmonitor manually on ncmonitor1001 since last execution failed due to a 504 from MarkMonitor 2461219 wikitext text/x-wiki cfv73ozq3oogernj356i2mbzfskc67g 2461220 2461219 2026-09-28T09:05:14Z Stashbot 7414 jelto@cumin1004: START - Cookbook sre.loadbalancer.migrate-service-ipip for alias: wikikube-worker-codfw@codfw 2461220 wikitext text/x-wiki br5bxzi7iuucf5d7zi2lmsl1444l5sm 2461221 2461220 2026-09-28T09:09:20Z Stashbot 7414 jelto@cumin1004: START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on (A:lvs-low-traffic-codfw or A:lvs-secondary-codfw) and A:bullseye and A:lvs 2461221 wikitext text/x-wiki l7xhb49c98gyw1frrypznkaro91qyip 2461222 2461221 2026-09-28T09:10:15Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on A:cp-upload_drmrs and A:cp - 3.2.23 upgrade (T438828) 2461222 wikitext text/x-wiki q35vlujhxcio2rwz5s7hjv3ilizxn3k 2461223 2461222 2026-09-28T09:10:26Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on A:cp-text_drmrs and A:cp - 3.2.23 upgrade (T438828) 2461223 wikitext text/x-wiki f675lx7ibyaeq9gz32t7eqt8woqnjt4 2461224 2461223 2026-09-28T09:10:28Z Stashbot 7414 jelto@cumin1004: END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on (A:lvs-low-traffic-codfw or A:lvs-secondary-codfw) and A:bullseye and A:lvs 2461224 wikitext text/x-wiki 5x2pgccj8l75mt4dchag0cfnq0h051s 2461225 2461224 2026-09-28T09:10:29Z Stashbot 7414 jelto@cumin1004: END (PASS) - Cookbook sre.loadbalancer.migrate-service-ipip (exit_code=0) for alias: wikikube-worker-codfw@codfw 2461225 wikitext text/x-wiki 2edmfqxbxj31n7o9dt3gfgwcryibxcq 2461227 2461225 2026-09-28T09:19:47Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/liftwing-studio: sync 2461227 wikitext text/x-wiki 84dwrz7yfni4c53d0vktdbz0e9p7os6 2461228 2461227 2026-09-28T09:20:59Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.hosts.reboot-single for host dse-k8s-worker2006.codfw.wmnet 2461228 wikitext text/x-wiki f0v4ger6zelb57g69g3xr3rkfr6ggbz 2461229 2461228 2026-09-28T09:22:27Z Stashbot 7414 jelto@cumin1004: START - Cookbook sre.loadbalancer.migrate-service-ipip for alias: wikikube-worker-eqiad@eqiad 2461229 wikitext text/x-wiki sh4dm80vhfosxgioyixpktd4kb6f596 2461231 2461229 2026-09-28T09:26:15Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dse-k8s-worker2006.codfw.wmnet 2461231 wikitext text/x-wiki lg94alv66kdyek3kigdn2t3bvzz6ofx 2461232 2461231 2026-09-28T09:26:22Z Stashbot 7414 jelto@cumin1004: START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on (A:lvs-low-traffic-eqiad or A:lvs-secondary-eqiad) and A:bullseye and A:lvs 2461232 wikitext text/x-wiki mbh37mrufpunck35tbst596yjkvnlny 2461233 2461232 2026-09-28T09:27:20Z Stashbot 7414 brouberol@cumin1004: conftool action : set/weight=10; selector: name=dse-k8s-worker2006.codfw.wmnet 2461233 wikitext text/x-wiki fha1hemox2i4706nckkch8whz0j1v5b 2461234 2461233 2026-09-28T09:27:27Z Stashbot 7414 jelto@cumin1004: END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on (A:lvs-low-traffic-eqiad or A:lvs-secondary-eqiad) and A:bullseye and A:lvs 2461234 wikitext text/x-wiki pawhmsv9fk53socwa6jenlwwknfvs8n 2461235 2461234 2026-09-28T09:27:28Z Stashbot 7414 jelto@cumin1004: END (PASS) - Cookbook sre.loadbalancer.migrate-service-ipip (exit_code=0) for alias: wikikube-worker-eqiad@eqiad 2461235 wikitext text/x-wiki 05xhjsnd2h63a93r1jq07e0pmfl7bvu 2461236 2461235 2026-09-28T09:27:34Z Stashbot 7414 brouberol@cumin1004: conftool action : set/pooled=yes; selector: name=dse-k8s-worker2006.codfw.wmnet 2461236 wikitext text/x-wiki 7baiiha9vvlekabdg0ohk132isbdjvq 2461237 2461236 2026-09-28T09:29:50Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/liftwing-studio: sync 2461237 wikitext text/x-wiki iy43u5zk5dx4kvw1w9qvk41gbdnyjqw 2461238 2461237 2026-09-28T09:31:17Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.hosts.rename from ganeti-jumbo2002 to dse-k8s-worker2007 2461238 wikitext text/x-wiki p1h052est3xjdgh5arg8scsndetdvhv 2461239 2461238 2026-09-28T09:31:39Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.dns.netbox 2461239 wikitext text/x-wiki gc83e44rbbssrl26xeftfag5g88xzh0 2461240 2461239 2026-09-28T09:35:31Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming ganeti-jumbo2002 to dse-k8s-worker2007 - brouberol@cumin1004" 2461240 wikitext text/x-wiki nv54ti48zdy8yo44rrhq9mbls8kjaga 2461241 2461240 2026-09-28T09:35:47Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming ganeti-jumbo2002 to dse-k8s-worker2007 - brouberol@cumin1004" 2461241 wikitext text/x-wiki b9n3uhie70qtt9ydi29kp3x2m9mv1dr 2461242 2461241 2026-09-28T09:35:47Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2461242 wikitext text/x-wiki ldalve8h86jmufa8x42wtwh6iwp4ri8 2461243 2461242 2026-09-28T09:35:48Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.dns.wipe-cache dse-k8s-worker2007 on all recursors 2461243 wikitext text/x-wiki 3zijj98fv3qwpgm910srera2hrr3kkn 2461244 2461243 2026-09-28T09:35:50Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) dse-k8s-worker2007 on all recursors 2461244 wikitext text/x-wiki bchx6vmmnubi97ibpahffhgk6y53vuj 2461245 2461244 2026-09-28T09:35:51Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.network.configure-switch-interfaces for host dse-k8s-worker2007 2461245 wikitext text/x-wiki ore3ivxttvsgtfwhn267mlk7ew21iqa 2461246 2461245 2026-09-28T09:36:02Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dse-k8s-worker2007 2461246 wikitext text/x-wiki 8ce9vodjo5v6q4donsp7jsgubajz7rt 2461247 2461246 2026-09-28T09:36:38Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from ganeti-jumbo2002 to dse-k8s-worker2007 2461247 wikitext text/x-wiki h92y0lw71ikhtl7y7kzg40sbqh58a7t 2461248 2461247 2026-09-28T09:39:16Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.hosts.reimage for host dse-k8s-worker2007.codfw.wmnet with OS bookworm 2461248 wikitext text/x-wiki nkhat5hqyvj6yqtf2ygtycl0j8fybko 2461250 2461248 2026-09-28T09:45:52Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook-next: apply 2461250 wikitext text/x-wiki 23qdznvaknak4wnfm1pbdf6t8rcj7t8 2461251 2461250 2026-09-28T09:46:21Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on A:cp-upload_drmrs and A:cp - 3.2.23 upgrade (T438828) 2461251 wikitext text/x-wiki tmrgl9nh1p35wkcphceiqmtqe5vncmg 2461252 2461251 2026-09-28T09:46:31Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthboo-next: apply 2461252 wikitext text/x-wiki tiylrbrh3v5mxy87isfvq57burngzyo 2461253 2461252 2026-09-28T09:50:14Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on dse-k8s-worker2007.codfw.wmnet with reason: host reimage 2461253 wikitext text/x-wiki 1fltsaroxoemr8eod3wbh4mwpzcnlis 2461254 2461253 2026-09-28T09:53:39Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dse-k8s-worker2007.codfw.wmnet with reason: host reimage 2461254 wikitext text/x-wiki j1hssku3l3u128tjfynrr6pgijcjyv2 2461255 2461254 2026-09-28T09:54:54Z Stashbot 7414 jayme@cumin1004: START - Cookbook sre.k8s.roll-reimage-nodes rolling reimage on P{wikikube-worker2041.codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) 2461255 wikitext text/x-wiki mbws7zoz4ttywte6i386m7tefmmweqj 2461256 2461255 2026-09-28T09:54:58Z Stashbot 7414 jayme@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2041.codfw.wmnet 2461256 wikitext text/x-wiki p877lljsx56fju2yf3a07xu2njlh99g 2461257 2461256 2026-09-28T10:00:03Z Stashbot 7414 jayme@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2041.codfw.wmnet 2461257 wikitext text/x-wiki ooq7jzb0bk565nscn4zp5pkfwesr8d1 2461258 2461257 2026-09-28T10:00:27Z Stashbot 7414 jayme@cumin1004: START - Cookbook sre.hosts.reimage for host wikikube-worker2041.codfw.wmnet with OS trixie 2461258 wikitext text/x-wiki e000wjc902vzr0gjk9nsewok6s4pw8p 2461259 2461258 2026-09-28T10:12:13Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host dse-k8s-worker2007.codfw.wmnet with OS bookworm 2461259 wikitext text/x-wiki hbbzu4i66qnqvjraslar0csagah74o5 2461260 2461259 2026-09-28T10:17:53Z Stashbot 7414 jayme@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker2041.codfw.wmnet with reason: host reimage 2461260 wikitext text/x-wiki f8pw59310b384768ng2xevfav3nfx19 2461261 2461260 2026-09-28T10:18:00Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on A:cp-text_drmrs and A:cp - 3.2.23 upgrade (T438828) 2461261 wikitext text/x-wiki eu0hwjo1zet1zsbek0u9xpo8no29w0u 2461262 2461261 2026-09-28T10:19:46Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on A:cp-upload_eqiad and A:cp - 3.2.23 upgrade (T438828) 2461262 wikitext text/x-wiki tbthsn7fesc6fzshqpi5dr0obuqkon2 2461263 2461262 2026-09-28T10:19:49Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on A:cp-text_eqiad and A:cp - 3.2.23 upgrade (T438828) 2461263 wikitext text/x-wiki 45yo0iy08h7wndduzfkqhde8w3nyjf6 2461264 2461263 2026-09-28T10:23:54Z Stashbot 7414 jayme@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker2041.codfw.wmnet with reason: host reimage 2461264 wikitext text/x-wiki 9gekmpxoctdn3i9ekgop14ma39kaq0k 2461265 2461264 2026-09-28T10:25:11Z Stashbot 7414 moritzm: installing chromium security updates 2461265 wikitext text/x-wiki 8obeggt5dxltmf7f6c1570yhwush5m1 2461266 2461265 2026-09-28T10:25:54Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/mw-web: apply 2461266 wikitext text/x-wiki i1pwep03grt5b5671b9fh7lhu0wyvwh 2461267 2461266 2026-09-28T10:26:11Z Stashbot 7414 jmm@deploy1003: helmfile [staging] START helmfile.d/services/proton: apply 2461267 wikitext text/x-wiki 8ukjn107ynkis0wwlnwphgl7g6c1xu2 2461268 2461267 2026-09-28T10:27:17Z Stashbot 7414 jmm@deploy1003: helmfile [staging] DONE helmfile.d/services/proton: apply 2461268 wikitext text/x-wiki k2uw7txt1dgh0pj9qsq7sx3amuc0hmu 2461269 2461268 2026-09-28T10:28:20Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-web: apply 2461269 wikitext text/x-wiki j77jilpy24caycvmiyr5ynvamrpcwan 2461270 2461269 2026-09-28T10:28:21Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-web: apply 2461270 wikitext text/x-wiki r3p1bvsef8p3stama3jjmh4kehgdgpm 2461271 2461270 2026-09-28T10:30:02Z Stashbot 7414 jmm@deploy1003: helmfile [codfw] START helmfile.d/services/proton: apply 2461271 wikitext text/x-wiki dyf7zz7rwbtbg4u2aoi3avkgajjnkl1 2461272 2461271 2026-09-28T10:30:33Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-web: apply 2461272 wikitext text/x-wiki crec4qmxeofcphau509twgybl2qco81 2461273 2461272 2026-09-28T10:41:56Z Stashbot 7414 jmm@deploy1003: helmfile [codfw] DONE helmfile.d/services/proton: apply 2461273 wikitext text/x-wiki 4ms2u0jwa4y60futwf447cnz151dqos 2461274 2461273 2026-09-28T10:42:11Z Stashbot 7414 jmm@deploy1003: helmfile [eqiad] START helmfile.d/services/proton: apply 2461274 wikitext text/x-wiki j5nj5thpo4jbkbprz003tf52x65gcp2 2461275 2461274 2026-09-28T10:42:58Z Stashbot 7414 jayme@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker2041.codfw.wmnet with OS trixie 2461275 wikitext text/x-wiki hv7yac0888hsjc4m9v9dsur4q45pat2 2461276 2461275 2026-09-28T10:43:04Z Stashbot 7414 jayme@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2041.codfw.wmnet 2461276 wikitext text/x-wiki 46ijjgyaz7hy3s7xnrg4u5yrlmr23bq 2461277 2461276 2026-09-28T10:43:05Z Stashbot 7414 jayme@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2041.codfw.wmnet 2461277 wikitext text/x-wiki pexv8p35hb492d8pfuzq2aw9wt82f4r 2461278 2461277 2026-09-28T10:43:06Z Stashbot 7414 jayme@cumin1004: END (PASS) - Cookbook sre.k8s.roll-reimage-nodes (exit_code=0) rolling reimage on P{wikikube-worker2041.codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) 2461278 wikitext text/x-wiki k04ggy5yofbptwuy05tkpcf0zfeuzak 2461279 2461278 2026-09-28T10:43:23Z Stashbot 7414 jmm@deploy1003: helmfile [eqiad] DONE helmfile.d/services/proton: apply 2461279 wikitext text/x-wiki o1t6izbxmlu0f0sjtns3wras16fbnp0 2461280 2461279 2026-09-28T10:49:52Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on A:cp-upload_eqiad and A:cp - 3.2.23 upgrade (T438828) 2461280 wikitext text/x-wiki s6u6oz13gexoax7gc3uceyumk6qm6ny 2461281 2461280 2026-09-28T11:14:54Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on A:cp-text_eqiad and A:cp - 3.2.23 upgrade (T438828) 2461281 wikitext text/x-wiki 76kqb8q2sgbsok7jytaw4le0592mvrw 2461282 2461281 2026-09-28T11:15:45Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on A:cp-text_esams and A:cp - 3.2.23 upgrade (T438828) 2461282 wikitext text/x-wiki kgcv407nagq9xd10v6n2wzb1yxj8vcv 2461283 2461282 2026-09-28T11:15:50Z Stashbot 7414 vgutierrez@cumin1004: START - Cookbook sre.cdn.roll-upgrade-haproxy rolling upgrade of HAProxy on A:cp-upload_esams and A:cp - 3.2.23 upgrade (T438828) 2461283 wikitext text/x-wiki 4w7mbjr5q11lka4vxsge22demrdc539 2461284 2461283 2026-09-28T11:17:13Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.hosts.reboot-single for host dse-k8s-worker2007.codfw.wmnet 2461284 wikitext text/x-wiki 7fupe34xx0due6179wtcozf4yhczxi5 2461285 2461284 2026-09-28T11:17:18Z Stashbot 7414 zabe@deploy1003: Started scap sync-world: Backport for [[gerrit:1345344|reconcileTables: Add sleep option (T438750)]] 2461285 wikitext text/x-wiki t0temqf7rm6x5d7dkhdt22s55l6u63o 2461286 2461285 2026-09-28T11:20:17Z Stashbot 7414 brouberol@cumin1004: conftool action : set/pooled=yes; selector: name=dse-k8s-worker2007.codfw.wmnet 2461286 wikitext text/x-wiki nz0lrjmujdsv5hr78mpf4d21zx09udb 2461287 2461286 2026-09-28T11:20:24Z Stashbot 7414 brouberol@cumin1004: conftool action : set/weight=10; selector: name=dse-k8s-worker2007.codfw.wmnet 2461287 wikitext text/x-wiki 6jjxl2sj7fgh3up7lihc1zbt4d4hd8g 2461288 2461287 2026-09-28T11:21:36Z Stashbot 7414 zabe@deploy1003: zabe: Backport for [[gerrit:1345344|reconcileTables: Add sleep option (T438750)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2461288 wikitext text/x-wiki t4f9e6ye8fxerm1l4tlt4c91r9ces5r 2461289 2461288 2026-09-28T11:22:29Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dse-k8s-worker2007.codfw.wmnet 2461289 wikitext text/x-wiki hfc13e2km01z6c6n2idu1ha01zlyvt2 2461290 2461289 2026-09-28T11:22:51Z Stashbot 7414 zabe@deploy1003: zabe: Continuing with deployment 2461290 wikitext text/x-wiki gxoelpojtiqikca8871dqaw7o8drhpy 2461291 2461290 2026-09-28T11:22:52Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.hosts.rename from ganeti-jumbo2003 to dse-k8s-worker2008 2461291 wikitext text/x-wiki o5xy2qaeo84t1j9r19lo1enu7lsbm2w 2461292 2461291 2026-09-28T11:23:12Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.dns.netbox 2461292 wikitext text/x-wiki gh1p68hslit50p0bjw5z17hl8y79vq1 2461293 2461292 2026-09-28T11:28:11Z Stashbot 7414 zabe@deploy1003: Finished scap sync-world: Backport for [[gerrit:1345344|reconcileTables: Add sleep option (T438750)]] (duration: 10m 52s) 2461293 wikitext text/x-wiki 01a0b9611uvyd5r34xyr54lqi173pbi 2461294 2461293 2026-09-28T11:42:04Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming ganeti-jumbo2003 to dse-k8s-worker2008 - brouberol@cumin1004" 2461294 wikitext text/x-wiki dc4xc5n3pkx4zs39q1p3tkyq54ugcxk 2461295 2461294 2026-09-28T11:43:00Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming ganeti-jumbo2003 to dse-k8s-worker2008 - brouberol@cumin1004" 2461295 wikitext text/x-wiki f5b2xu6dle2ftsjhhj3il7pj7wxfoxv 2461296 2461295 2026-09-28T11:43:00Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2461296 wikitext text/x-wiki io604o4g8tbcrd6vsp45m5rtrb4nue6 2461297 2461296 2026-09-28T11:43:01Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.dns.wipe-cache dse-k8s-worker2008 on all recursors 2461297 wikitext text/x-wiki h6sy3vlgigia0ws9bz9g9xzqwvx9xqp 2461298 2461297 2026-09-28T11:43:03Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) dse-k8s-worker2008 on all recursors 2461298 wikitext text/x-wiki k8an5lk5n80afvkqni2ouqp0s932euj 2461299 2461298 2026-09-28T11:43:04Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.network.configure-switch-interfaces for host dse-k8s-worker2008 2461299 wikitext text/x-wiki ee4jh6csnug8w9734jj7mcg9xq70fsv 2461300 2461299 2026-09-28T11:43:15Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dse-k8s-worker2008 2461300 wikitext text/x-wiki smyj6g5tdupg0kfv8zh9ajy8vddpoy6 2461301 2461300 2026-09-28T11:43:51Z Stashbot 7414 brouberol@cumin1004: END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from ganeti-jumbo2003 to dse-k8s-worker2008 2461301 wikitext text/x-wiki iu7hwadhpqi63a6nzbjxa05dhfkcqt9 2461302 2461301 2026-09-28T11:46:13Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.hosts.reimage for host dse-k8s-worker2008.codfw.wmnet with OS bookworm 2461302 wikitext text/x-wiki 98juw87g4j4hrskutikkdl9hnlhnvxo 2461303 2461302 2026-09-28T11:49:53Z Stashbot 7414 vgutierrez@cumin1004: END (PASS) - Cookbook sre.cdn.roll-upgrade-haproxy (exit_code=0) rolling upgrade of HAProxy on A:cp-upload_esams and A:cp - 3.2.23 upgrade (T438828) 2461303 wikitext text/x-wiki svzbwlfoeyv2t821ojnuttxgfc2moh2 2461304 2461303 2026-09-28T11:53:07Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/mw-web: apply 2461304 wikitext text/x-wiki ngawus8ipuask40q0lgnktnzoxe7vlo 2461305 2461304 2026-09-28T11:53:21Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-web: apply 2461305 wikitext text/x-wiki 40lyztvj1r3jahvde6t1mmy6u2ynmm1 2461306 2461305 2026-09-28T11:53:22Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-web: apply 2461306 wikitext text/x-wiki ku1ow8tng0fdtteznb62xojp9k4n6hd 2461307 2461306 2026-09-28T11:53:42Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-web: apply 2461307 wikitext text/x-wiki mbadwxgwm500hrig48pf6kq1p1yex0a 2461308 2461307 2026-09-28T11:53:57Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/liftwing-studio: sync 2461308 wikitext text/x-wiki kabmxuwarzejuf7spq2ipnxbpdmc84t 2461309 2461308 2026-09-28T11:54:11Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/liftwing-studio: sync 2461309 wikitext text/x-wiki gld3tr5trfiuwxqg4jenh1edwjt4m43 2461310 2461309 2026-09-28T11:57:26Z Stashbot 7414 brouberol@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on dse-k8s-worker2008.codfw.wmnet with reason: host reimage 2461310 wikitext text/x-wiki t1ssw2foaw73rdqt4q6erkehzpn7har 498 30942 2461159 2460577 2026-09-28T06:54:20Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (T437407) 2461159 wikitext text/x-wiki qgjdathtwpnzjvtr6ao5zwont9ainw5 2461160 2461159 2026-09-28T06:54:25Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) (T437407) 2461160 wikitext text/x-wiki ls4gkohufyblvq4fk34q5z5d1pjicel 2461249 2461160 2026-09-28T09:44:09Z Stashbot 7414 godog: set cloudvirt1077 governor to 'performance' - T437407 2461249 wikitext text/x-wiki q7pusnlx223w2lvjr725bayj9dhse8n 0 91251 2461226 2461077 2026-09-28T09:12:03Z BJensen-WMF 48942 /* Dashboards */ add links 2461226 wikitext text/x-wiki tvw3waj8ujivxnhlnc4bholvc5l61vy 0 449160 2461144 2461136 2026-09-28T00:02:06Z Dexbot 30554 Bot: Updating the report 2461144 wikitext text/x-wiki 181udvd0qg10h0swlocar3cfffuhsyr 116 453426 2461209 2459088 2026-09-28T08:49:24Z Phabbanbot 37210 Ida_Ragnarsson was disabled by Sebastian_Berlin-WMSE 2461209 wikitext text/x-wiki hik17e9ui41cpaea8q3oq7zs9o0odsa 116 453906 2461142 2461139 2026-09-27T20:12:27Z Gitlabaccountapprovalbot 37332 @brokensegue was approved. 2461142 wikitext text/x-wiki q6zo0jhwadwvdlhixaz2yuo28oznoth 2 455874 2461143 2457343 2026-09-27T23:59:45Z Quiddity 1884 Interwiki redirect to evade bot 2461143 wikitext text/x-wiki 9ejldn6r3wzuivshxpu3onsijqhdwzq 2 460586 2461181 2457873 2026-09-28T07:56:36Z SSapaty (WMF) 28955 2461181 wikitext text/x-wiki hxliebwqdauhvlkmxkpyee1881zwifs 0 460710 2461149 2460250 2026-09-28T05:31:47Z AWesterinen-WMF 54189 /* Named subqueries */ 2461149 wikitext text/x-wiki fmlbzbxe3228p3snb02gvdchkk7zdmx 2461150 2461149 2026-09-28T05:36:37Z AWesterinen-WMF 54189 /* Named subqueries */ 2461150 wikitext text/x-wiki eh34xvqu6zjg0tf9yocm5uux8dr8pew 0 460718 2461145 2460873 2026-09-28T00:02:11Z Quiddity 1884 lang="text" 2461145 wikitext text/x-wiki 4e401vo85ly0tekrc6ltnpi296c1e0c 12 460726 2461140 2461131 2026-09-27T16:05:17Z JJMC89 7474 fix 2461140 wikitext text/x-wiki 64u8cmt69asjte0t4rixwc5ppx8ibsr 0 460730 2461148 2026-09-28T03:28:31Z AndrewBogott (WMF) 51047 Created page with "On 2026-09-23, maintenance work in the Dallas datacenter caused total power loss for all of the servers hosting the codfw1dev test/dev cloud-vps cluster. Here are notes from the recovery process after power was restored. These are here in case something like this happens in our mail cluster and we need guidance about what to expect. == What happened when codfw1dev lost power? == === Ceph === After power returned, ceph reports health OK, no thrashing or rebalancing in..." 2461148 wikitext text/x-wiki dptkozj7g9qhauk8z8cncs9td25tc6c 2 460731 2461182 2026-09-28T07:56:50Z SSapaty (WMF) 28955 Created page with "= Scheduled and continuous jobs with Toolforge Components = This tutorial shows how to configure and deploy scheduled and continuous jobs using Toolforge Components Service. It assumes that you have already completed an introductory Push-to-Deploy tutorial such as [[Help:Toolforge/My first Python tool|My first Python tool]] or [[Help:Toolforge/My first PHP tool|My first PHP tool]], and are familiar with deploying a tool using <code>toolforge.yaml</code>. In this tutor..." 2461182 wikitext text/x-wiki q2ngxi2kko4tbkslgtv409mgonpvy1v 2461188 2461182 2026-09-28T08:04:58Z SSapaty (WMF) 28955 /* Create the scheduled program */ 2461188 wikitext text/x-wiki k22go2789eubz17877yp73g94e6ktbb 2461189 2461188 2026-09-28T08:05:26Z SSapaty (WMF) 28955 /* Create the scheduled program */ 2461189 wikitext text/x-wiki 5fuq9b4v68xv44rlsvh8x6wpln64h5n 2461190 2461189 2026-09-28T08:06:43Z SSapaty (WMF) 28955 /* Create the continuous program */ 2461190 wikitext text/x-wiki 7pja9fjy85zy0iqlzl6ropawqmgdoay 2461191 2461190 2026-09-28T08:07:12Z SSapaty (WMF) 28955 /* Create the continuous program */ 2461191 wikitext text/x-wiki btt7zanq9wdc19rhe1okphdi9dr67f9 2461192 2461191 2026-09-28T08:08:20Z SSapaty (WMF) 28955 /* Configure the scheduled component */ 2461192 wikitext text/x-wiki klq01sagxbg2o2d9y8t6g1t5vzxyuxh 2461193 2461192 2026-09-28T08:08:48Z SSapaty (WMF) 28955 /* Configure the continuous component */ 2461193 wikitext text/x-wiki 0ze4dvkbetxh4r68utfridpeherl7k6 2461194 2461193 2026-09-28T08:09:01Z SSapaty (WMF) 28955 /* Reuse the build */ 2461194 wikitext text/x-wiki nepzs1i62at7hoqghjsnliq0ewgg5h9 2461195 2461194 2026-09-28T08:09:24Z SSapaty (WMF) 28955 /* Create the complete tool configuration */ 2461195 wikitext text/x-wiki dcuh17nwqllr0zgb8i17seonho80tol 2461196 2461195 2026-09-28T08:10:27Z SSapaty (WMF) 28955 /* Optional: publish the continuous component */ 2461196 wikitext text/x-wiki jd9eksb3efdo0yqxwr1yba3q3xly543 2461197 2461196 2026-09-28T08:15:18Z SSapaty (WMF) 28955 /* Create the scheduled program */ 2461197 wikitext text/x-wiki ixhjte9erxgrult03fobzncioxnguua 2461198 2461197 2026-09-28T08:15:48Z SSapaty (WMF) 28955 /* Create the scheduled program */ 2461198 wikitext text/x-wiki ka8ckfz7bbc8rur04qvuxbporntjouy 2461200 2461198 2026-09-28T08:16:24Z SSapaty (WMF) 28955 /* Create the continuous program */ 2461200 wikitext text/x-wiki 14l76xmybtu3met9f87hm1o32xs2hiz