Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.16 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk Deployments 0 4108 2450640 2450380 2026-08-22T02:00:21Z DeploymentCalendarTool 20896 Remove Week of August 17 2450640 wikitext text/x-wiki 27r74kj0wms2rj61gcz9ftt8svf3xpp 2450645 2450640 2026-08-22T04:46:14Z ScheduleDeploymentBot 37566 Add [[gerrit:1307270]] to Monday, August 24 UTC morning backport window 2450645 wikitext text/x-wiki 0lnpdueitrri4rkg54oqgmtuqm9o6t3 Server Admin Log 0 7919 2450486 2450485 2026-08-21T12:00:19Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . 2450486 wikitext text/x-wiki eukduinyrg70n5oer5mjzjjofb6cyii 2450487 2450486 2026-08-21T12:01:42Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host urldownloader2006.wikimedia.org with OS trixie 2450487 wikitext text/x-wiki cnhnenitwjarnfbwf3x2cw08yblf3ss 2450490 2450487 2026-08-21T12:11:24Z Stashbot 7414 filippo@cumin1003: START - Cookbook sre.dns.netbox 2450490 wikitext text/x-wiki fibgcrbt9rmmc4wbuhxjcni0nk4pu2x 2450491 2450490 2026-08-21T12:16:33Z Stashbot 7414 filippo@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: T431682 - filippo@cumin1003" 2450491 wikitext text/x-wiki 967pvw08be4hh2gmoed8m5lu1jz16cp 2450492 2450491 2026-08-21T12:16:39Z Stashbot 7414 filippo@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: T431682 - filippo@cumin1003" 2450492 wikitext text/x-wiki d7um3j1iyxdqk5uzyp4f1yhavi2rupz 2450493 2450492 2026-08-21T12:16:42Z Stashbot 7414 filippo@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2450493 wikitext text/x-wiki naw2dt8gjki1rw9bxdh35hqzrt0d1oh 2450501 2450493 2026-08-21T13:14:11Z Stashbot 7414 hashar@deploy1003: Started deploy [integration/docroot@2d5ff9b]: opensource: add PersonalDashboard docs to MW components - T435392 2450501 wikitext text/x-wiki eiod5435znmed5tcaiebree71ubwzcu 2450502 2450501 2026-08-21T13:14:26Z Stashbot 7414 hashar@deploy1003: Finished deploy [integration/docroot@2d5ff9b]: opensource: add PersonalDashboard docs to MW components - T435392 (duration: 00m 15s) 2450502 wikitext text/x-wiki nafogjt2jnoet70org8napktjw8vta2 2450504 2450502 2026-08-21T13:24:00Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "sync cr2-eqord router offline - cmooney@cumin1003" 2450504 wikitext text/x-wiki 1otvu998v3tzg0zyp3uf6viqmw35weg 2450505 2450504 2026-08-21T13:25:30Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "sync cr2-eqord router offline - cmooney@cumin1003" 2450505 wikitext text/x-wiki mk05sn7stkxa4p5t9bd00czy56kqzir 2450507 2450505 2026-08-21T14:11:24Z Stashbot 7414 moritzm: imported openjdk 8u504-ga-1~deb12u1 for bookworm-wikimedia (backport of the latest Java 8 security fixes for bookworm) 2450507 wikitext text/x-wiki b60mxqsrfm5dcen3q5eu8w3h3bnq4dp 2450508 2450507 2026-08-21T14:13:55Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.netbox 2450508 wikitext text/x-wiki q7na0tstkjpwu7sdrp8i6bxwtpmdxg5 2450509 2450508 2026-08-21T14:21:23Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: remove entries for cr2-eqord - cmooney@cumin1003" 2450509 wikitext text/x-wiki pqxmesg54hsp3e26elfnaiqnt5qutry 2450510 2450509 2026-08-21T14:21:27Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: remove entries for cr2-eqord - cmooney@cumin1003" 2450510 wikitext text/x-wiki 2qormko91lhjxuth23goypok7s8j0eb 2450511 2450510 2026-08-21T14:21:31Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2450511 wikitext text/x-wiki k83ua11o4l1zdfeiv0med7tykjyofpd 2450512 2450511 2026-08-21T14:29:09Z Stashbot 7414 cdobbins@cumin1003: conftool action : set/pooled=no; selector: name=dns5004.* [reason: trixie upgrade] 2450512 wikitext text/x-wiki r48mrfbpnrh8ztkaaqftwt0oc08njx8 2450513 2450512 2026-08-21T14:30:20Z Stashbot 7414 cdobbins@cumin1003: START - Cookbook sre.hosts.reimage for host dns5004.wikimedia.org with OS trixie 2450513 wikitext text/x-wiki sac1ijbhjbfbn8tae28t63eqglc0wif 2450514 2450513 2026-08-21T14:53:50Z Stashbot 7414 andrew@cumin2003: START - Cookbook sre.hosts.reimage for host cloudcephosd1042.eqiad.wmnet with OS bookworm 2450514 wikitext text/x-wiki aiibh51ljqitri3zp001kh5ujaqgnl0 2450516 2450514 2026-08-21T15:05:49Z Stashbot 7414 cdobbins@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on dns5004.wikimedia.org with reason: host reimage 2450516 wikitext text/x-wiki 59rrzmyqm3e7gawtfezer46oo2cnosh 2450517 2450516 2026-08-21T15:09:21Z Stashbot 7414 cdobbins@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dns5004.wikimedia.org with reason: host reimage 2450517 wikitext text/x-wiki sqh0id1703v9upzry6tr10up60ydxkk 2450519 2450517 2026-08-21T15:13:48Z Stashbot 7414 andrew@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd1042.eqiad.wmnet with reason: host reimage 2450519 wikitext text/x-wiki hpx98gddrphinz1miv6zqb2ippxxpmp 2450520 2450519 2026-08-21T15:17:42Z Stashbot 7414 dancy@deploy1003: Started deploy [gerrit/gerrit@2cc11cc]: Deploying https://gerrit.wikimedia.org/r/c/operations/software/gerrit/+/1327669 (T434726) 2450520 wikitext text/x-wiki aumn25zydnqul93sd8lnuzzlytxmcyc 2450521 2450520 2026-08-21T15:17:56Z Stashbot 7414 dancy@deploy1003: Finished deploy [gerrit/gerrit@2cc11cc]: Deploying https://gerrit.wikimedia.org/r/c/operations/software/gerrit/+/1327669 (T434726) (duration: 00m 14s) 2450521 wikitext text/x-wiki cvkm5aeb0l35bjpljcz7pexnglm1yc9 2450522 2450521 2026-08-21T15:18:23Z Stashbot 7414 andrew@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd1042.eqiad.wmnet with reason: host reimage 2450522 wikitext text/x-wiki 17uw9ljo72xlcnvl3meawizkx7h6qk6 2450526 2450522 2026-08-21T15:38:11Z Stashbot 7414 andrew@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1042.eqiad.wmnet with OS bookworm 2450526 wikitext text/x-wiki taflqv9cbdnc1nl93ukdj821mnzbyzc 2450536 2450526 2026-08-21T15:51:52Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.netbox 2450536 wikitext text/x-wiki qeab22qtgjznxn5jjrotfchb8xcupth 2450537 2450536 2026-08-21T15:51:55Z Stashbot 7414 cmooney@cumin1003: END (ERROR) - Cookbook sre.dns.netbox (exit_code=97) 2450537 wikitext text/x-wiki r27z2xghwjesm4hpzxvgeimu7fkgxxj 2450538 2450537 2026-08-21T15:53:15Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.netbox 2450538 wikitext text/x-wiki 0txtmgu7sqkklokln8oicgo73wru5d9 2450540 2450538 2026-08-21T15:55:59Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: remove dns entries for IPs formerly used on eqord<->codfw arelion - cmooney@cumin1003" 2450540 wikitext text/x-wiki 1inngy7d5nqoxt6zuxh11g2t5zx9kbf 2450542 2450540 2026-08-21T15:56:51Z Stashbot 7414 cdobbins@cumin1003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=1) for host dns5004.wikimedia.org with OS trixie 2450542 wikitext text/x-wiki 2v7bpwr1ugi6gew7xnmq9sxkbgt3204 2450544 2450542 2026-08-21T16:00:25Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: remove dns entries for IPs formerly used on eqord<->codfw arelion - cmooney@cumin1003" 2450544 wikitext text/x-wiki cm5xbvjoebkr6o39e17cyane5oz1b8x 2450545 2450544 2026-08-21T16:00:28Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2450545 wikitext text/x-wiki ef606imnsv5gfcaq13bggg13b4wlcpn 2450546 2450545 2026-08-21T16:02:15Z Stashbot 7414 cmooney@dns3003: START - running authdns-update 2450546 wikitext text/x-wiki f3j726ky8j1122ik2ea6c74zyh5w34r 2450549 2450546 2026-08-21T16:05:00Z Stashbot 7414 cmooney@dns3003: END - running authdns-update 2450549 wikitext text/x-wiki 41e3ql6hgctcdpojhn62lf0aqzofz7w 2450552 2450549 2026-08-21T16:06:40Z Stashbot 7414 sukhe@dns1004: START - running authdns-update 2450552 wikitext text/x-wiki 421cxz765ugs715xwjxz1zqvdcjyf93 2450555 2450552 2026-08-21T16:08:35Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2450555 wikitext text/x-wiki 6k2845so1eljxu8obrxuha4xzn6f5un 2450558 2450555 2026-08-21T16:08:56Z Stashbot 7414 sukhe@dns1004: END - running authdns-update 2450558 wikitext text/x-wiki t9dq8o2de5nijum4uv37scnsmxp2mq0 2450560 2450558 2026-08-21T16:11:58Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2450560 wikitext text/x-wiki qrnzy35ywvh2oiyunxeetw6ie58aned 2450563 2450560 2026-08-21T16:33:13Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.netbox 2450563 wikitext text/x-wiki 0jffhoczylkcv1ywuuucncbk20xgxky 2450564 2450563 2026-08-21T16:37:45Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: remove dns entries for IPs formerly used on eqsin<->codfw arelion - cmooney@cumin1003" 2450564 wikitext text/x-wiki 6yw611635ubce5aeqqqer5ssxmcqlmb 2450565 2450564 2026-08-21T16:41:06Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: remove dns entries for IPs formerly used on eqsin<->codfw arelion - cmooney@cumin1003" 2450565 wikitext text/x-wiki pwdr30z73qcjkwuqo7d04zav6j2y0sc 2450566 2450565 2026-08-21T16:41:09Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2450566 wikitext text/x-wiki g71zp1a6oxepynqk641503iwb5sng1y 2450567 2450566 2026-08-21T16:41:23Z Stashbot 7414 cmooney@dns3003: START - running authdns-update 2450567 wikitext text/x-wiki 5ysalkpr36cd6ta7u4oyc8lu4iqnww9 2450568 2450567 2026-08-21T16:44:12Z Stashbot 7414 cmooney@dns3003: END - running authdns-update 2450568 wikitext text/x-wiki 167v85xudzzrq47dxwos0cdi3wqz3c5 2450569 2450568 2026-08-21T16:52:09Z Stashbot 7414 cdobbins@cumin1003: START - Cookbook sre.hosts.remove-downtime for dns5004.wikimedia.org 2450569 wikitext text/x-wiki 0sz2wx1cbzc008y4qt7nibykdlsqbox 2450570 2450569 2026-08-21T16:52:12Z Stashbot 7414 cdobbins@cumin1003: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for dns5004.wikimedia.org 2450570 wikitext text/x-wiki eymw6w96yrgv6dq3bxdbrj8k67t0y54 2450571 2450570 2026-08-21T16:53:17Z Stashbot 7414 cdobbins@cumin1003: conftool action : set/pooled=yes; selector: name=dns5004.* [reason: trixie upgrade] 2450571 wikitext text/x-wiki trm6wxv4a7b0uw0u95v2vawktwssnqm 2450572 2450571 2026-08-21T16:56:08Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs: apply 2450572 wikitext text/x-wiki db0jg4oilzgwkfpfl4hivwd1coyphgy 2450573 2450572 2026-08-21T16:59:55Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply 2450573 wikitext text/x-wiki ook4e7lpz28t94gdnoedgvzrskvzpt9 2450574 2450573 2026-08-21T17:02:00Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2450574 wikitext text/x-wiki 2zesio4xe29e0zc607jq4hfd3ubtcmg 2450575 2450574 2026-08-21T17:05:07Z Stashbot 7414 sukhe@dns1004: START - running authdns-update 2450575 wikitext text/x-wiki pqefxogtm6sxvgga54clu8wq79hv7x2 2450576 2450575 2026-08-21T17:05:25Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2450576 wikitext text/x-wiki buc60x82auj0ce8zdqxxbhi1ok7n7oq 2450577 2450576 2026-08-21T17:07:20Z Stashbot 7414 sukhe@dns1004: FAIL - running authdns-update 2450577 wikitext text/x-wiki 8q59sx5froxxfqzo02iic9tr7rth96l 2450578 2450577 2026-08-21T17:08:02Z Stashbot 7414 sukhe@puppetserver1001: conftool action : set/pooled=no; selector: name=dns5004.wikimedia.org [reason: resolving authdns-update issues] 2450578 wikitext text/x-wiki hsiu5fw2gxnyub80rrih3rnyw9vzmwp 2450579 2450578 2026-08-21T17:08:06Z Stashbot 7414 sukhe@dns1004: START - running authdns-update 2450579 wikitext text/x-wiki pkxcdtnjpljho8rlxonchilld48vlou 2450580 2450579 2026-08-21T17:10:17Z Stashbot 7414 sukhe@dns1004: END - running authdns-update 2450580 wikitext text/x-wiki chdlcs1wbxghe7giw2dnn71krozmz7l 2450581 2450580 2026-08-21T17:12:54Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs: apply 2450581 wikitext text/x-wiki 945koowmogak0zjyurhjhm08j6sgipu 2450582 2450581 2026-08-21T17:16:47Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply 2450582 wikitext text/x-wiki nqj3obwzfgfu13bm3px4hprufqsekpm 2450583 2450582 2026-08-21T17:23:48Z Stashbot 7414 sukhe@cumin1003: START - Cookbook sre.dns.netbox 2450583 wikitext text/x-wiki smu4kgydcc9u8dl3rk8nubur9nl6b7q 2450584 2450583 2026-08-21T17:24:04Z Stashbot 7414 sukhe@cumin1003: END (ERROR) - Cookbook sre.dns.netbox (exit_code=97) 2450584 wikitext text/x-wiki hj0ily7l7soa4evk6db6ewk1jz3ouxb 2450585 2450584 2026-08-21T17:24:13Z Stashbot 7414 sukhe@cumin1003: START - Cookbook sre.dns.netbox 2450585 wikitext text/x-wiki 2r2lxir1b4wbn8p5lccb03z06ovdskd 2450586 2450585 2026-08-21T17:28:01Z Stashbot 7414 sukhe@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: force HEAD to be26e30ae101 - sukhe@cumin1003" 2450586 wikitext text/x-wiki oh6d6u2cws3w48r05wqtvp2y6mh7avp 2450587 2450586 2026-08-21T17:28:05Z Stashbot 7414 sukhe@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: force HEAD to be26e30ae101 - sukhe@cumin1003" 2450587 wikitext text/x-wiki eyaf98sqigcb3syy42w036mqfxuw914 2450588 2450587 2026-08-21T17:28:08Z Stashbot 7414 sukhe@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2450588 wikitext text/x-wiki r9x58tthugs4tk1w9su2tstwu0mzd4k 2450589 2450588 2026-08-21T17:28:39Z Stashbot 7414 sukhe@puppetserver1001: conftool action : set/pooled=yes; selector: service=authdns-update,name=dns5004.wikimedia.org [reason: resolving authdns-update issues] 2450589 wikitext text/x-wiki nru87fc5psqt2tsjw131g48erfr1psx 2450590 2450589 2026-08-21T17:28:42Z Stashbot 7414 sukhe@cumin1003: START - Cookbook sre.dns.netbox 2450590 wikitext text/x-wiki oup3umefls35rkfpfnx2bt8c4km0qvt 2450591 2450590 2026-08-21T17:32:32Z Stashbot 7414 sukhe@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: force HEAD to be26e30ae101 - sukhe@cumin1003" 2450591 wikitext text/x-wiki 46rzfl1mbxenoo0q25rx5ykzjq2w5b4 2450592 2450591 2026-08-21T17:32:36Z Stashbot 7414 sukhe@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: force HEAD to be26e30ae101 - sukhe@cumin1003" 2450592 wikitext text/x-wiki i51qv9657zk3csvxzwrp46framygchv 2450593 2450592 2026-08-21T17:32:39Z Stashbot 7414 sukhe@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2450593 wikitext text/x-wiki 84sg7rrz1kq87y0mba2yc7s4eqfojlx 2450594 2450593 2026-08-21T17:33:00Z Stashbot 7414 sukhe@puppetserver1001: conftool action : set/pooled=yes; selector: name=dns5004.wikimedia.org [reason: resolved authdns-update issues] 2450594 wikitext text/x-wiki hq68aop30etpknd2x4nhfq85wfhze12 2450595 2450594 2026-08-21T17:33:08Z Stashbot 7414 sukhe@dns1004: START - running authdns-update 2450595 wikitext text/x-wiki g94i0o3t3oa29m8lfemkkdbckuhtiwm 2450596 2450595 2026-08-21T17:35:20Z Stashbot 7414 sukhe@dns1004: END - running authdns-update 2450596 wikitext text/x-wiki 2620xyqyxgyje0zksnnmr04wu3vffh4 2450602 2450596 2026-08-21T18:16:04Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.reimage for host krb1002.eqiad.wmnet with OS bookworm 2450602 wikitext text/x-wiki bwadihhmmkpmuv8a985ozai4485we1p 2450604 2450602 2026-08-21T18:27:27Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2450604 wikitext text/x-wiki pcmex16cw819w73nhttin20z8obetf1 2450605 2450604 2026-08-21T18:27:53Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2450605 wikitext text/x-wiki 92cl086b89olrt3w814abczu2y1lprn 2450607 2450605 2026-08-21T18:35:34Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2450607 wikitext text/x-wiki kjuhgbb2o5dq75bsgnof00rfxw5g26r 2450608 2450607 2026-08-21T18:35:52Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2450608 wikitext text/x-wiki 9skdamv2u9lhn9v7765tb3bzov4mvx8 2450611 2450608 2026-08-21T18:51:02Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs: apply 2450611 wikitext text/x-wiki ogfk4b44os7eq2cs2kr415ko93g3nlj 2450612 2450611 2026-08-21T18:51:32Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply 2450612 wikitext text/x-wiki kahba2pnjikoz0hbc5b6ojuzgtr248j 2450615 2450612 2026-08-21T18:59:58Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs: apply 2450615 wikitext text/x-wiki synqj4eijn69n7wf0nc2psq7hr344q6 2450616 2450615 2026-08-21T19:00:32Z Stashbot 7414 lerickson@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs: apply 2450616 wikitext text/x-wiki 9bxgokdu3buxqk6un2dl6gk96k72v7q 2450619 2450616 2026-08-21T19:37:17Z Stashbot 7414 bking@cumin2003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host krb1002.eqiad.wmnet with OS bookworm 2450619 wikitext text/x-wiki 302krk1mmvhh5gons4fj037b1t6ga1e 2450620 2450619 2026-08-21T20:25:51Z Stashbot 7414 jhathaway@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on mx-out2001.wikimedia.org with reason: T434750 2450620 wikitext text/x-wiki mle8e9f310kr36b6frqbzehyl0y8jie 2450621 2450620 2026-08-21T20:33:14Z Stashbot 7414 jhathaway@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on mx-out1001.wikimedia.org with reason: T434750 2450621 wikitext text/x-wiki 004wmmt8fark9txb8eeq02v3tzrtzo7 2450623 2450621 2026-08-21T20:34:56Z Stashbot 7414 jhathaway@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on mx-in2001.wikimedia.org with reason: T434750 2450623 wikitext text/x-wiki 9rcbzf8sd6o9voghpdxjqfcpmyzle3e 2450625 2450623 2026-08-21T20:36:05Z Stashbot 7414 jhathaway@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on mx-in1001.wikimedia.org with reason: T434750 2450625 wikitext text/x-wiki dpeie0eoldim3t5pmarmuphhi0om8kr 2450642 2450625 2026-08-22T02:00:55Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2450642 wikitext text/x-wiki l3v62j6mbmmcsdgdpax9xwhj1lxlldu 2450643 2450642 2026-08-22T02:08:30Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 07m 35s) 2450643 wikitext text/x-wiki tee2dryafbo9ahh87kevbd0ddtj6dor Release Engineering/SAL 0 17290 2450498 2450324 2026-08-21T13:07:58Z Stashbot 7414 hashar: integration: triggered Doxygen doc for PersonalDashboard extension using: `zuul enqueue --trigger gerrit --pipeline postmerge --project mediawiki/extensions/PersonalDashboard --change 1328044,1` # T435392 2450498 wikitext text/x-wiki g9qox5eyb7kbdl37g00t68lkj9gazph Help talk:SSH Fingerprints/gerrit.wikimedia.org:29418 13 26680 2450644 176459 2026-08-22T02:43:15Z Mr. Starfleet Command 42828 /* Edit request */ new section 2450644 wikitext text/x-wiki k1qygboco6kstl4f62e1frjpfa5ggf2 Nova Resource:Admin/SAL 498 30942 2450515 2450349 2026-08-21T14:55:56Z Stashbot 7414 andrewbogott: reimaging cloudvirt1042, getting a 100% fresh start for T429387 testing 2450515 wikitext text/x-wiki f0ln3iuy17evm87ixp5k932fzamb9d7 2450547 2450515 2026-08-21T16:03:03Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.bootstrap_and_add 2450547 wikitext text/x-wiki psrfy3tbzog37r9ffx3p1t73iy9l05n 2450548 2450547 2026-08-21T16:03:06Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=0) 2450548 wikitext text/x-wiki bg08kdtt0ugyudh24ivf66wmm8zme0u 2450550 2450548 2026-08-21T16:05:43Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.depool_and_destroy 2450550 wikitext text/x-wiki 5fk4nstczcduuw40opk6pyge8xxs8bl 2450551 2450550 2026-08-21T16:05:46Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.ceph.osd.depool_and_destroy (exit_code=99) 2450551 wikitext text/x-wiki jmejk50vb50b3fc77sxrmq18gglf65i 2450556 2450551 2026-08-21T16:08:39Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.bootstrap_and_add 2450556 wikitext text/x-wiki 548pgfivyxbb79i7ux90bhhzb9co4tg 2450557 2450556 2026-08-21T16:08:42Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=0) 2450557 wikitext text/x-wiki 0kcx90jc6wlfd18n2wkar7vb4ryv2pn 2450559 2450557 2026-08-21T16:11:15Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.bootstrap_and_add 2450559 wikitext text/x-wiki dtbf4uxqpjpx3dq2rl0z54dgds51vsg 2450633 2450559 2026-08-22T00:01:03Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.bootstrap_and_add 2450633 wikitext text/x-wiki 510b6ndmetncvl69j8zu87r5oxor072 2450634 2450633 2026-08-22T00:01:06Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=0) 2450634 wikitext text/x-wiki 6rzbea2bpmhchkffcta17wlq6h4omrs 2450635 2450634 2026-08-22T00:01:56Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.reactivate 2450635 wikitext text/x-wiki gintyslo8zrkdvf6l2jqn8cxaciv6kp 2450636 2450635 2026-08-22T00:02:01Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.ceph.osd.reactivate (exit_code=0) 2450636 wikitext text/x-wiki db77h46ypart1bbeqqvdha00rsncgon 2450637 2450636 2026-08-22T00:02:37Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.undrain_node 2450637 wikitext text/x-wiki 0zu5lym2xqbv5ucjvrdhk0y06gm4d9m Switch Datacenter 0 56257 2450531 2430586 2026-08-21T15:42:57Z BCornwall-WMF 31521 Remove "Introduction", there's already a built-in "Beginning" in MW 2450531 wikitext text/x-wiki ezaa43hn0902kfqpyhhauqz7ev8iw1u 2450532 2450531 2026-08-21T15:43:38Z BCornwall-WMF 31521 Remove what/when from introduction section 2450532 wikitext text/x-wiki 0hhfmhjpleiywtdc25qdtnd0peabz6z 2450539 2450532 2026-08-21T15:55:12Z JJMC89 7474 blogs to the end; auto TOC placement 2450539 wikitext text/x-wiki rupx6peh4tf70aj9loo160bad6p1lcb 2450541 2450539 2026-08-21T15:56:48Z JJMC89 7474 unnecessary heading 2450541 wikitext text/x-wiki o8sxqltpcsnkurv8finwumc7pfxo0af Network monitoring 0 441095 2450518 2449119 2026-08-21T15:10:26Z CMooney (WMF) 24288 /* RejectingBGPPrefixes */ 2450518 wikitext text/x-wiki k4cok15r1b32066sspdgzhzhvmg3l4f Data Platform/Systems/Stat hosts 0 444523 2450626 2449930 2026-08-21T20:57:33Z Neil Shah-Quinn (WMF) 36601 All stat hosts are now on Debian Bookworm 2450626 wikitext text/x-wiki 5uur5z2jq9ywyp9wkjnmfjniymn7iag File:Latency.png 6 445095 2450627 1940246 2026-08-21T22:24:57Z Lucas Werkmeister 8093 update description after file was overwritten 2450627 wikitext text/x-wiki ji5k7t0ncldqq7yufkfu174dze2vrpt 2450628 2450627 2026-08-21T22:25:05Z Lucas Werkmeister 8093 bah, where did that space come from 2450628 wikitext text/x-wiki mivcnt6xhg5563cdjjiaw99aw13r1o2 Httpbb 0 445686 2450631 2450335 2026-08-22T00:00:46Z BryanDavis 1604 /* Adding tests */ spelling 2450631 wikitext text/x-wiki qhtfj7fvjc57ljzdnryx0h41cgykcko Map of database maintenance 0 449160 2450632 2450331 2026-08-22T00:00:51Z Dexbot 30554 Bot: Updating the report 2450632 wikitext text/x-wiki 6pzbqolp2p9ce5fms93lenrfip2ecul Fundraising/Internal-facing/CiviCRM 0 451490 2450543 2426560 2026-08-21T15:57:20Z LSandergreen-WMF 46345 /* Database schema changes: Informing Analytics */ database schema change procedures 2450543 wikitext text/x-wiki l2howml76kx8xdgqrolhmves5ztrxqp Test Kitchen/Test Kitchen UI/Administration 0 455635 2450488 2428803 2026-08-21T12:07:29Z SFaci-WMF 35637 /* Troubleshoot wmftkbot */ 2450488 wikitext text/x-wiki qilbaubh55tsfk53j06bl27rpg1nucx 2450489 2450488 2026-08-21T12:08:22Z SFaci-WMF 35637 /* Known issues */ 2450489 wikitext text/x-wiki pl38kpmcxtpdnxoeuwk36g9i3oycctp Test Kitchen/Contextual attributes/JavaScript 0 455782 2450497 2365685 2026-08-21T12:58:43Z SFaci-WMF 35637 2450497 wikitext text/x-wiki iqo1l847oao9o8j2o0bemwuo5khpwnh Test Kitchen/Conduct an experiment 0 455989 2450496 2450483 2026-08-21T12:52:45Z SFaci-WMF 35637 /* HTTP header */ 2450496 wikitext text/x-wiki f16uy1w4zmb5rzn3c2xmqeuopvzddyl 2450506 2450496 2026-08-21T13:57:32Z MPopov (WMF) 5891 Update risk level 2450506 wikitext text/x-wiki cd4xwe4z6a9ixaxe5er6g95o38tiokz 2450553 2450506 2026-08-21T16:07:13Z SFaci-WMF 35637 /* Enrollment override */ 2450553 wikitext text/x-wiki 7rbane6bqyum7rj2oow96j8p9tdgjbf 2450554 2450553 2026-08-21T16:08:32Z SFaci-WMF 35637 /* Enrollment override */ 2450554 wikitext text/x-wiki fp0vam4q6xmf4wfjuascndsvguegirf 2450561 2450554 2026-08-21T16:14:04Z SFaci-WMF 35637 /* Monitor event production */ 2450561 wikitext text/x-wiki 9djq42lczfn9o8v0b83kg1bhhqavqrk Test Kitchen/Feature availability 0 456374 2450500 2381843 2026-08-21T13:12:30Z SFaci-WMF 35637 2450500 wikitext text/x-wiki 377hiliuaa3ojsa0pxbvyxgv5uinxwe Deployments/Archive/2026/08 0 460539 2450641 2447758 2026-08-22T02:00:31Z DeploymentCalendarTool 20896 Add last week 2450641 wikitext text/x-wiki 6ai2ci6mzann4s9gg7q7x2y92ymix07 Data Platform/Data Lake/Traffic/API requests 0 460561 2450524 2450469 2026-08-21T15:30:08Z KCVelaga (WMF) 38150 /* mrt_ratelimit_class_daily */ 2450524 wikitext text/x-wiki eju9y6xxn98j7ubi7lmo74r46y6h9lg 2450525 2450524 2026-08-21T15:37:57Z KCVelaga (WMF) 38150 /* mediawiki_api_request */ 2450525 wikitext text/x-wiki ctoe8nukz429lvacity936472yncoss 2450527 2450525 2026-08-21T15:38:30Z KCVelaga (WMF) 38150 /* mediawiki_api_request */ 2450527 wikitext text/x-wiki hd655h2s1v3bch7lwwfa4g7y89aophy 2450528 2450527 2026-08-21T15:38:51Z KCVelaga (WMF) 38150 /* mediawiki_api_request */ 2450528 wikitext text/x-wiki e2ssoje4rccztm0utnad2a9tzj1owpv 2450534 2450528 2026-08-21T15:45:15Z KCVelaga (WMF) 38150 /* Changes and known issues */ 2450534 wikitext text/x-wiki 429bj2xhtgwh7ue14crhvajvpu66fs3 2450597 2450534 2026-08-21T17:51:09Z KCVelaga (WMF) 38150 /* Sample queries */ 2450597 wikitext text/x-wiki s98hlb9pd6239j9bynfthckb93r3ms4 2450598 2450597 2026-08-21T17:51:44Z KCVelaga (WMF) 38150 /* Common dimensions glossary */ 2450598 wikitext text/x-wiki oujxv7xriiitd5fvkslflljkbu82ir0 2450599 2450598 2026-08-21T18:02:54Z KCVelaga (WMF) 38150 /* Common dimensions glossary */ 2450599 wikitext text/x-wiki 566gwo7wwz4xlakc12lmq48db7s79w8 2450600 2450599 2026-08-21T18:07:11Z KCVelaga (WMF) 38150 /* Changes and known issues */ 2450600 wikitext text/x-wiki 70ps8vb2tfgbfq9i6kdp3lb1cirywv5 2450601 2450600 2026-08-21T18:13:43Z KCVelaga (WMF) 38150 /* Top User-Agents by Action API requests */ 2450601 wikitext text/x-wiki dkv2g0hfe59yj641vqvx62fcgpwrrte 2450603 2450601 2026-08-21T18:20:51Z KCVelaga (WMF) 38150 /* Datasets */ 2450603 wikitext text/x-wiki impy0sjsd7yv418a49wpvf9rsb4ubep 2450606 2450603 2026-08-21T18:33:42Z KCVelaga (WMF) 38150 /* Top non-compliant User-Agents by Action API requests */ 2450606 wikitext text/x-wiki n3g7qi8c847lyhdhitezvvk9qgjs2zu 2450609 2450606 2026-08-21T18:37:35Z KCVelaga (WMF) 38150 /* Distinct IPs by ratelimit class */ 2450609 wikitext text/x-wiki dgjho7m93tpaeev8pdh5s1bakgvft7a 2450610 2450609 2026-08-21T18:43:57Z KCVelaga (WMF) 38150 /* Usage notes */ 2450610 wikitext text/x-wiki jexidgxpp5bpbqiaihgd40co4pdfu6g 2450613 2450610 2026-08-21T18:55:24Z KCVelaga (WMF) 38150 2450613 wikitext text/x-wiki 6tzewls54ab420tqiucqvtfq8knvskd 2450614 2450613 2026-08-21T18:55:56Z KCVelaga (WMF) 38150 /* Datasets */ 2450614 wikitext text/x-wiki 734c6i1snkmm25sw772dp8lj9eogmi6 2450617 2450614 2026-08-21T19:04:43Z KCVelaga (WMF) 38150 /* mrt_api_requests_hourly */ 2450617 wikitext text/x-wiki rjy84ozev5wh0fb11nqs52cw1q46shm 2450618 2450617 2026-08-21T19:05:51Z KCVelaga (WMF) 38150 /* Usage notes */ 2450618 wikitext text/x-wiki cvf47crroh3u4y5s6cfjtsl9zudz0qd SLO/Wikipedia/Read view 0 460574 2450494 2450402 2026-08-21T12:29:01Z JGiannelos (WMF) 17083 /* Service Level Indicators (SLIs) */ 2450494 wikitext text/x-wiki 97vzl826j6lf31879u5f6nbqf17c96m 2450495 2450494 2026-08-21T12:30:43Z JGiannelos (WMF) 17083 /* Service Level Indicators (SLIs) */ 2450495 wikitext text/x-wiki si5v18nbsdd0c8rsczcj6nltkmcjaz0 2450499 2450495 2026-08-21T13:12:17Z JGiannelos (WMF) 17083 /* Operational */ 2450499 wikitext text/x-wiki 5okyee3tyela96ywitkrpz2x9rvfl7m 2450503 2450499 2026-08-21T13:19:00Z JGiannelos (WMF) 17083 /* Deployment */ 2450503 wikitext text/x-wiki imfccd2nwrwpo422m59rpmu6yyjkza8 2450562 2450503 2026-08-21T16:16:11Z JGiannelos (WMF) 17083 /* Service Level Objectives */ 2450562 wikitext text/x-wiki ms5pit0hnpkk9e3xjc2x3osm1xy62ug Search Platform/Weekly Updates/2026-08-21 0 460575 2450523 2026-08-21T15:25:00Z PFischer-WMF 38527 Created page with "= Highlights = * [https://phabricator.wikimedia.org/T421757 T421757] The production OpenSearch clusters are off 1.x. Both sites are across — [https://phabricator.wikimedia.org/T429844 codfw] and [https://phabricator.wikimedia.org/T431311 eqiad] — along with Cloudelastic and Relforge, retiring a version line that stopped being maintained when OpenSearch 3.x shipped in May 2025. This is the payoff from the migration plan written back in June ([https://phabricator.wiki..." 2450523 wikitext text/x-wiki pef37s2mpb0183v6jviqzr7jb5z3gvy Talk:Switch Datacenter 1 460576 2450529 2026-08-21T15:40:38Z BCornwall-WMF 31521 /* Reducing burden in TOC */ new section 2450529 wikitext text/x-wiki 45rgo5nu16g2ueu5qb9oef0ye5uutkf 2450530 2450529 2026-08-21T15:42:06Z BCornwall-WMF 31521 /* Creation of Switch Datacenter/History */ new section 2450530 wikitext text/x-wiki rikpkxi0toy7oiuzevp20ha8h3tm5xw 2450533 2450530 2026-08-21T15:44:06Z BCornwall-WMF 31521 /* Reducing burden in TOC */ Reply 2450533 wikitext text/x-wiki ligbvwq5dr35kna51pshmg05vdoixv4 2450535 2450533 2026-08-21T15:48:10Z BCornwall-WMF 31521 /* Creation of "#External links section */ new section 2450535 wikitext text/x-wiki seyuquzfe8kgvduyrmpa45ysgjng97m 2450629 2450535 2026-08-21T23:55:46Z WhatamIdoing 8096 /* Creation of "#External links section */ Reply 2450629 wikitext text/x-wiki 5pex7ia9230vkh204glzevao7s9s81x 2450630 2450629 2026-08-21T23:56:29Z WhatamIdoing 8096 /* Creation of "#External links section */ 2450630 wikitext text/x-wiki 1swlf68bsrc4v3yzu7bc3g7j0g5re1z Nova Resource:Tools.wheres-my-code-running/SAL 498 460577 2450622 2026-08-21T20:34:41Z Stashbot 7414 wmbot~bd808@tools-bastion-14: First! (initialze SAL page) 2450622 wikitext text/x-wiki os51n0fovd7osnwg5ryi3qup2j60cui Tool:Wheres-my-code-running 116 460578 2450624 2026-08-21T20:35:48Z BryanDavis 1604 Tool documentation stub ([[phab:T434726]]) 2450624 wikitext text/x-wiki l2khru2awpikby5opkhqr7uwzkt4ps4 2450639 2450624 2026-08-22T00:41:06Z BryanDavis 1604 Added screenshot 2450639 wikitext text/x-wiki mxofffryclog8tuykj7vn1g4rjvv2wk File:Where's my code running? Gerrit integration example.png 6 460579 2450638 2026-08-22T00:34:45Z BryanDavis 1604 {{File information |Description=Screenshot of a merged Gerrit patch with the Where's my code running? Gerrit integration showing the code deployed to all wikis |Source=[[phab:T434726#12239916|Imported from Phabricator]], Own work by the original uploader |Date=2026-09-21 |Author=[[User:ADancy (WMF)|ADancy (WMF)]] |other_versions= }} 2450638 wikitext text/x-wiki n182n9ewfbrzocwgopmwvpamdi26ev7