Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.18 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 420 2453576 2430945 2026-09-01T17:43:57Z BryanDavis 1604 /* Documentation */ fix deep link puppetserver instructions 2453576 wikitext text/x-wiki rttlejr00s36kcmqedch6izvt6tbxy0 498 549 2453521 2195858 2026-09-01T14:41:05Z Stashbot 7414 andrewbogott: shutting down incubator-1 for T435774; still running bullseye 2453521 wikitext text/x-wiki prchpsal58w75p8xrdygh4d5dd5cnxg 498 845 2453628 2428349 2026-09-01T19:26:43Z Southparkfan 1843 2453628 wikitext text/x-wiki hnari7m86lrnpnxkokx9fptm3deiq65 2453656 2453628 2026-09-01T20:24:21Z Southparkfan 1843 2453656 wikitext text/x-wiki cr7nelvxj9omaqlsfiox3r6dvbmfieh 2453666 2453656 2026-09-01T21:24:13Z Southparkfan 1843 2453666 wikitext text/x-wiki 1d26d50qpdgq00fwk675p0ilfef6qdm 498 1319 2453525 2196474 2026-09-01T14:47:45Z Stashbot 7414 andrewbogott: shutting down signwriting-swis-2022 and signwriting-swserver-2022 for T435781; still running Bullseye 2453525 wikitext text/x-wiki o4ybawnkpqh3iqlzr4ttsnts32de9vd 498 1516 2453582 2453040 2026-09-01T18:01:19Z Stashbot 7414 Krinkle: Delete cvn-app13 and cvn-app14 (empty Debian 12 Bookworm instances), to be replaced with Debian 13 Trixie. ref T395164 2453582 wikitext text/x-wiki sjgzgfeib2m6s9pqktqx9scw62e7qkz 2453687 2453582 2026-09-02T02:14:05Z Stashbot 7414 Krinkle: Switch cvn.wmflabs.org and cvn.wmcloud.org web proxy from cvn-apache11 to cvn-apache12, ref T395164 2453687 wikitext text/x-wiki qdtwl7fi91gakju57fkaahccjkqv3nf 2453718 2453687 2026-09-02T07:02:01Z Stashbot 7414 Krinkle: Disable /etc/cron.hourly/cvn-backup-data on cvn-app10 and cvn-app12 2453718 wikitext text/x-wiki ndjjq0vn3ngklsqg71yo9bdhgbbfjb8 2453742 2453718 2026-09-02T08:08:29Z Stashbot 7414 Krinkle: Delete cvn-app10 and cvn-app12, ref T395164 2453742 wikitext text/x-wiki gnm0s48o5h41gu989o5wetwyw07mz2t 498 2161 2453557 2452920 2026-09-01T16:02:36Z Stashbot 7414 taavi: shutdown maps-proxies, migrated to main proxy service T431284 2453557 wikitext text/x-wiki iqss7lpdflq92yodnpsdnvg2tnbaf8n 2453776 2453557 2026-09-02T09:27:02Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.remove_instance for instance maps-proxy-5 2453776 wikitext text/x-wiki 5ztd36cshyioa0l69bjc4p5yp2z298q 2453777 2453776 2026-09-02T09:27:48Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance maps-proxy-5 2453777 wikitext text/x-wiki q3p3zpi6gf17lc65284ce364auyeuxb 2453779 2453777 2026-09-02T09:28:42Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.remove_instance for instance maps-proxy-6 2453779 wikitext text/x-wiki 2g1trpaxx1t2na8m04bxc5s7lfuneja 2453780 2453779 2026-09-02T09:28:58Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance maps-proxy-6 2453780 wikitext text/x-wiki a2l3xur7uwyw9lgdpawxu1jk8zw05o1 498 3086 2453845 2452978 2026-09-02T11:22:02Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.remove_instance for instance tools-elastic-4 2453845 wikitext text/x-wiki rp3ag3jr1beiwyp3j7e6id4am9tm0ot 2453846 2453845 2026-09-02T11:22:51Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance tools-elastic-4 2453846 wikitext text/x-wiki 5tmitmtgq6n0v4257xhhlxixbww1tnm 2453848 2453846 2026-09-02T11:23:11Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.remove_instance for instance tools-elastic-5 2453848 wikitext text/x-wiki 80kj2y5rjc9j8o48bdn9fwf55a42eoi 2453850 2453848 2026-09-02T11:24:01Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance tools-elastic-5 2453850 wikitext text/x-wiki b9z8xlpb24av18838tp21z7hk9aisgg 2453851 2453850 2026-09-02T11:24:23Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.remove_instance for instance tools-elastic-6 2453851 wikitext text/x-wiki sm6h2legzrbhz9nh84n4qqyc32qxjk9 2453853 2453851 2026-09-02T11:25:13Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance tools-elastic-6 2453853 wikitext text/x-wiki go2lu0ttswxp0bprva3tbbib3kae842 0 4108 2453395 2453244 2026-09-01T13:17:43Z ScheduleDeploymentBot 37566 Add [[gerrit:1333200]] to Tuesday, September 01 UTC afternoon backport window 2453395 wikitext text/x-wiki s2fpz0720qmyslwz4fr334ujs7lw2gt 2453683 2453395 2026-09-02T01:02:19Z ScheduleDeploymentBot 37566 Add [[gerrit:1333338]] to Wednesday, September 02 UTC morning backport window 2453683 wikitext text/x-wiki rw4ljiaocyi1b9wab2ohjqrgn1g028o 2453684 2453683 2026-09-02T01:03:17Z ScheduleDeploymentBot 37566 Add [[gerrit:1333343]] to Wednesday, September 02 UTC morning backport window 2453684 wikitext text/x-wiki nhe3oqdy5icsfhfa1lrby7tfrr0pb4l 2453710 2453684 2026-09-02T06:41:30Z ScheduleDeploymentBot 37566 Add [[gerrit:1333559]] to Wednesday, September 02 UTC morning backport window 2453710 wikitext text/x-wiki 9udfyrutkihk5xq5m37zpwd3sk6wwhr 2453711 2453710 2026-09-02T06:41:38Z ScheduleDeploymentBot 37566 Add [[gerrit:1333560]] to Wednesday, September 02 UTC morning backport window 2453711 wikitext text/x-wiki 5ta88gosop259bsgjr96ar891p2lb4d 2453712 2453711 2026-09-02T06:41:47Z ScheduleDeploymentBot 37566 Add [[gerrit:1333561]] to Wednesday, September 02 UTC morning backport window 2453712 wikitext text/x-wiki 61qqkrkec8jmqbzae7682ua6s6m0i3h 2453713 2453712 2026-09-02T06:41:53Z ScheduleDeploymentBot 37566 Add [[gerrit:1333562]] to Wednesday, September 02 UTC morning backport window 2453713 wikitext text/x-wiki 88pyupm853jkjhozu0kah6tdszv151w 2453714 2453713 2026-09-02T06:42:00Z ScheduleDeploymentBot 37566 Add [[gerrit:1332684]] to Wednesday, September 02 UTC morning backport window 2453714 wikitext text/x-wiki nagxy5y5xbpr7tg16jt0ti9mq1jbv92 2453717 2453714 2026-09-02T06:53:28Z ScheduleDeploymentBot 37566 Add [[gerrit:1333390]] to Wednesday, September 02 UTC morning backport window 2453717 wikitext text/x-wiki jk9xso6pb7gnxmero9g6ijbeegius2r 2453866 2453717 2026-09-02T11:39:57Z ScheduleDeploymentBot 37566 Add [[gerrit:1328201]] to Wednesday, September 02 UTC afternoon backport window 2453866 wikitext text/x-wiki cq021isls8qzsx1svv53rkkg268bmpb 2453873 2453866 2026-09-02T11:57:01Z ScheduleDeploymentBot 37566 Add [[gerrit:1333264]] to Wednesday, September 02 UTC afternoon backport window 2453873 wikitext text/x-wiki ibs38gl53moyzj88rdvfxjpm2go1eda 2453874 2453873 2026-09-02T11:57:09Z ScheduleDeploymentBot 37566 Add [[gerrit:1333263]] to Wednesday, September 02 UTC afternoon backport window 2453874 wikitext text/x-wiki bwuqvmjnzjic8o9s4gfw9a02jrxpvlh 0 6839 2453617 2438598 2026-09-01T19:17:38Z Nintendofan885 17301 invert on dark mode 2453617 wikitext text/x-wiki po08zumt9hse0dfqfn48q5ai2u870mz 0 6919 2453616 2401104 2026-09-01T19:16:30Z Nintendofan885 17301 /* Media storage */ invert on dark mode 2453616 wikitext text/x-wiki jygcq54ehkr2azp3eoa09bw67ad0x01 0 7919 2453298 2453296 2026-09-01T12:05:47Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host urldownloader2003.wikimedia.org with OS bookworm 2453298 wikitext text/x-wiki bkpw2gpq68bcv2chef8s4fjoa1t3wax 2453299 2453298 2026-09-01T12:06:11Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-ipoid: apply 2453299 wikitext text/x-wiki 6uq3tgo0ni3dfa7f1vd4segequ6ent1 2453300 2453299 2026-09-01T12:06:15Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-ipoid: apply 2453300 wikitext text/x-wiki hs4mgjtkpecnyvybr87zbh5rk17ekm3 2453301 2453300 2026-09-01T12:06:22Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/dse-k8s-services/opensearch-ipoid: apply 2453301 wikitext text/x-wiki mrxfhs0ivimhlnz037uyjflcrpt0wof 2453302 2453301 2026-09-01T12:06:29Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/dse-k8s-services/opensearch-ipoid: apply 2453302 wikitext text/x-wiki qoozvf3smrse37yr4yx85a9rbew07wg 2453303 2453302 2026-09-01T12:07:29Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply 2453303 wikitext text/x-wiki 1falybl7toimm6683s8tnn2nlg5qyxb 2453304 2453303 2026-09-01T12:09:01Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply 2453304 wikitext text/x-wiki 5s01wl9v3n500lkg0i7rsxeyy15w1sf 2453305 2453304 2026-09-01T12:09:31Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs-next: apply 2453305 wikitext text/x-wiki sm9ik1xdreev3zhgfvakvuvcocfi0n7 2453306 2453305 2026-09-01T12:14:12Z Stashbot 7414 jmm@deploy1003: helmfile [staging] START helmfile.d/services/proton: apply 2453306 wikitext text/x-wiki 1a03ym13pxat80x051d4zn9lueyp4hs 2453307 2453306 2026-09-01T12:14:59Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reimage for host urldownloader2004.wikimedia.org with OS bookworm 2453307 wikitext text/x-wiki gcotfyd07z1wrd88oacpw0t3pq9p6qa 2453308 2453307 2026-09-01T12:15:00Z Stashbot 7414 jmm@deploy1003: helmfile [staging] DONE helmfile.d/services/proton: apply 2453308 wikitext text/x-wiki nf8fp3vwc061w8cbophdb4ob1qxf1w2 2453309 2453308 2026-09-01T12:16:52Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.ganeti.makevm for new host netflow1004.eqiad.wmnet 2453309 wikitext text/x-wiki eilstpjdnbv673hfh8qx0duebnefcox 2453310 2453309 2026-09-01T12:16:53Z Stashbot 7414 jmm@deploy1003: helmfile [codfw] START helmfile.d/services/proton: apply 2453310 wikitext text/x-wiki n93zyawkv8s8ngmtih51a0hp0omx7o8 2453311 2453310 2026-09-01T12:16:54Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.dns.netbox 2453311 wikitext text/x-wiki dugvnrf731tiivv15zqggs6bsg1zpd1 2453312 2453311 2026-09-01T12:20:02Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs-next: apply 2453312 wikitext text/x-wiki 3xe2k3377si5r3y8skhidfrn402e603 2453313 2453312 2026-09-01T12:20:42Z Stashbot 7414 jmm@deploy1003: helmfile [codfw] DONE helmfile.d/services/proton: apply 2453313 wikitext text/x-wiki bdp4pg7v74dk6zo6qngwtbhl13f9w37 2453314 2453313 2026-09-01T12:21:07Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM netflow1004.eqiad.wmnet - ayounsi@cumin1003" 2453314 wikitext text/x-wiki 3s8yvirz8fieib6mktk5k4wa9t305ls 2453315 2453314 2026-09-01T12:21:11Z Stashbot 7414 ayounsi@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM netflow1004.eqiad.wmnet - ayounsi@cumin1003" 2453315 wikitext text/x-wiki bdz2l7x4gt0jwpjfsvgtgwdn7bkt9dl 2453316 2453315 2026-09-01T12:21:12Z Stashbot 7414 ayounsi@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2453316 wikitext text/x-wiki siwx9qtldp1cr326meyvl5nztgiw3mv 2453317 2453316 2026-09-01T12:21:13Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.dns.wipe-cache netflow1004.eqiad.wmnet on all recursors 2453317 wikitext text/x-wiki d0oin1uhod7gp6f853d8bsr5nbl5xil 2453318 2453317 2026-09-01T12:21:14Z Stashbot 7414 ayounsi@cumin1003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) netflow1004.eqiad.wmnet on all recursors 2453318 wikitext text/x-wiki fc9ije62r4v8t51efbs6xxepss7j4gx 2453319 2453318 2026-09-01T12:21:48Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM netflow1004.eqiad.wmnet - ayounsi@cumin1003" 2453319 wikitext text/x-wiki qj2ho2kor3d0htdlmcfc45gk11h8ne0 2453320 2453319 2026-09-01T12:21:52Z Stashbot 7414 ayounsi@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM netflow1004.eqiad.wmnet - ayounsi@cumin1003" 2453320 wikitext text/x-wiki t8bznw5xqp6zj5b5z14k5mg9ujskqvj 2453321 2453320 2026-09-01T12:22:31Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.hosts.reimage for host netflow1004.eqiad.wmnet with OS trixie 2453321 wikitext text/x-wiki axh6tk2fg4uyzbajeletmsifma2qjk0 2453322 2453321 2026-09-01T12:25:33Z Stashbot 7414 dreamyjazz@deploy1003: Started scap sync-world: Backport for [[gerrit:1333182|EventStreamConfig: Fix User-Agent stream config for some schemas (T432848)]] 2453322 wikitext text/x-wiki ohrck1lwmbvh6bfv4zlbeierga854g7 2453323 2453322 2026-09-01T12:28:46Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-airflow-test-k8s: apply 2453323 wikitext text/x-wiki bb0c9897wgra6jhxws8e71ossybhle5 2453324 2453323 2026-09-01T12:28:50Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-airflow-test-k8s: apply 2453324 wikitext text/x-wiki gdqv8cb3x3wl8pmtbas1e3vwgak4r31 2453325 2453324 2026-09-01T12:29:50Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Backport for [[gerrit:1333182|EventStreamConfig: Fix User-Agent stream config for some schemas (T432848)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2453325 wikitext text/x-wiki f1xesja8p71ed2cvc8ciqie85gvephn 2453326 2453325 2026-09-01T12:30:29Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-airflow-analytics-test: apply 2453326 wikitext text/x-wiki 6pk6nzzx5wo6k5da3utkdxq8enit987 2453327 2453326 2026-09-01T12:30:32Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-airflow-analytics-test: apply 2453327 wikitext text/x-wiki 2btoh7lyv52fcg7ee50vtowlf7rwfqe 2453328 2453327 2026-09-01T12:31:05Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-airflow-platform-eng: apply 2453328 wikitext text/x-wiki l0wq4wqw6t6utfwotdlz9z0rmr0cd22 2453329 2453328 2026-09-01T12:31:09Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-airflow-platform-eng: apply 2453329 wikitext text/x-wiki iik3xnyebaqome5a8ko7mcb6y2irac9 2453330 2453329 2026-09-01T12:31:15Z Stashbot 7414 jmm@deploy1003: helmfile [eqiad] START helmfile.d/services/proton: apply 2453330 wikitext text/x-wiki 95kn0vtcd7gjji1kxis3r4l3wqos0dm 2453332 2453330 2026-09-01T12:32:30Z Stashbot 7414 jmm@deploy1003: helmfile [eqiad] DONE helmfile.d/services/proton: apply 2453332 wikitext text/x-wiki cmi2jw6ixemveo0vdbj02oegbh0edmx 2453333 2453332 2026-09-01T12:32:33Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-growthbook-next: apply 2453333 wikitext text/x-wiki 52pceeh4nslc0qlbe7hd2vh6etyo9ia 2453334 2453333 2026-09-01T12:32:34Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on netflow1004.eqiad.wmnet with reason: host reimage 2453334 wikitext text/x-wiki 8gf9x82ah6qry302yknb6182wojzjiu 2453335 2453334 2026-09-01T12:32:37Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-growthbook-next: apply 2453335 wikitext text/x-wiki d052h8l9m7oqt18y55on351qpqik4zk 2453336 2453335 2026-09-01T12:32:55Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-growthbook: apply 2453336 wikitext text/x-wiki f0ul5ghror26u5je2zxn045cxq3vwa8 2453337 2453336 2026-09-01T12:32:59Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-growthbook: apply 2453337 wikitext text/x-wiki ah9fmhwtlmj7j7i9lt0b29erx1jbopy 2453338 2453337 2026-09-01T12:33:20Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on urldownloader2004.wikimedia.org with reason: host reimage 2453338 wikitext text/x-wiki mprjppbsi0b94lkpvbkq3z5siysjkpv 2453339 2453338 2026-09-01T12:34:13Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/spark-history: apply 2453339 wikitext text/x-wiki ieym4mxjvvw83uh9ierluash8ikpzcu 2453340 2453339 2026-09-01T12:34:45Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Continuing with deployment 2453340 wikitext text/x-wiki aj1rlww0kycj85ib3ccrf6tqwfqbd3d 2453341 2453340 2026-09-01T12:35:09Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/spark-history: apply 2453341 wikitext text/x-wiki r5bsdb0t5e6swo1y706g399skoc8qwi 2453342 2453341 2026-09-01T12:35:42Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/superset-next: apply 2453342 wikitext text/x-wiki 8eku9bcmc3bqtai9xcemk3fsjc302ba 2453343 2453342 2026-09-01T12:36:34Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/superset-next: apply 2453343 wikitext text/x-wiki qmn7d8g09ldoumfkbv43hr2xyc5ha7o 2453344 2453343 2026-09-01T12:38:03Z Stashbot 7414 ayounsi@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on netflow1004.eqiad.wmnet with reason: host reimage 2453344 wikitext text/x-wiki rcb7407u5gxsfw97hj38frc6arr04dt 2453345 2453344 2026-09-01T12:41:09Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on urldownloader2004.wikimedia.org with reason: host reimage 2453345 wikitext text/x-wiki dhzgen6cfyc1wiytw8dlv0nsuxp8k2n 2453346 2453345 2026-09-01T12:41:58Z Stashbot 7414 dreamyjazz@deploy1003: Finished scap sync-world: Backport for [[gerrit:1333182|EventStreamConfig: Fix User-Agent stream config for some schemas (T432848)]] (duration: 16m 25s) 2453346 wikitext text/x-wiki p97shunxdu1qhceth4lkcivw8m0b9s9 2453347 2453346 2026-09-01T12:47:39Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/test-kitchen-next: apply 2453347 wikitext text/x-wiki cp5qor7j2k6yhx5sbo81llz4jb6hld3 2453348 2453347 2026-09-01T12:48:04Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/test-kitchen-next: apply 2453348 wikitext text/x-wiki 5anntsdiivdh5o61o695dmiw9krnhu7 2453349 2453348 2026-09-01T12:52:44Z Stashbot 7414 ayounsi@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host netflow1004.eqiad.wmnet with OS trixie 2453349 wikitext text/x-wiki 8yevwu6c065dwtnfn5cgli8dcw5496g 2453350 2453349 2026-09-01T12:52:46Z Stashbot 7414 ayounsi@cumin1003: END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host netflow1004.eqiad.wmnet 2453350 wikitext text/x-wiki 4l2msn8r1h9w60q9k5d7k5gge0v9xzs 2453352 2453350 2026-09-01T12:57:44Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host urldownloader2004.wikimedia.org with OS bookworm 2453352 wikitext text/x-wiki p6smaidn4vwrq7szg8641mnbue8tqsy 2453353 2453352 2026-09-01T12:59:17Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s_services/services/datahub-next: apply 2453353 wikitext text/x-wiki tovy990eb54ectn2vced1toad2kajmw 2453354 2453353 2026-09-01T13:00:05Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s_services/services/datahub-next: apply 2453354 wikitext text/x-wiki mpdtkcoxnhi9ho2fqjp10mx3yqfryi5 2453355 2453354 2026-09-01T13:00:15Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/datasets-config-next: apply 2453355 wikitext text/x-wiki kpr1x95duuwo9tdojtptynsq0iwrwoa 2453356 2453355 2026-09-01T13:00:23Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/datasets-config-next: apply 2453356 wikitext text/x-wiki osl09ije049htif5wh26mlh1y9ukgtg 2453357 2453356 2026-09-01T13:00:42Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook-next: apply 2453357 wikitext text/x-wiki 9924bgpqp7behco4qaqd3pkegw907sq 2453358 2453357 2026-09-01T13:01:56Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthboo-next: apply 2453358 wikitext text/x-wiki ontm0v3zsqw188px8wxnev0d14eepe8 2453359 2453358 2026-09-01T13:02:22Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich-next: apply 2453359 wikitext text/x-wiki nh8fka5z22vhn2sjkinl4549pjb9r7i 2453360 2453359 2026-09-01T13:02:26Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich-next: apply 2453360 wikitext text/x-wiki nx2qxbdmwpyxgsqulsrtfmpflcha1lp 2453361 2453360 2026-09-01T13:02:47Z Stashbot 7414 aude@deploy1003: Started scap sync-world: Backport for [[gerrit:1332717|Enable ReadingLists for logged-in users on phase 1 wikis (T434922)]] 2453361 wikitext text/x-wiki q7hkzaeemeyrwt1kg1g2shggb43a95k 2453362 2453361 2026-09-01T13:02:48Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-feature-counts-change-enrich-next: apply 2453362 wikitext text/x-wiki 7w0u74stwpcftx14ooxe1td3yk5grbx 2453363 2453362 2026-09-01T13:02:52Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-feature-counts-change-enrich-next: apply 2453363 wikitext text/x-wiki nu1xkst6loc8mmbpabw055hkd9c5th5 2453364 2453363 2026-09-01T13:07:30Z Stashbot 7414 aude@deploy1003: aude: Backport for [[gerrit:1332717|Enable ReadingLists for logged-in users on phase 1 wikis (T434922)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2453364 wikitext text/x-wiki mxw5eu536uuszh2be3s2wzklj0cye51 2453365 2453364 2026-09-01T13:10:40Z Stashbot 7414 fnegri@deploy1003: helmfile [staging] START helmfile.d/services/toolhub: apply 2453365 wikitext text/x-wiki of8etd1cli3iemspwtfui584e8tcx7r 2453366 2453365 2026-09-01T13:11:02Z Stashbot 7414 aude@deploy1003: aude: Continuing with deployment 2453366 wikitext text/x-wiki 39whckxir15ustwd2izl0ee5e8tmuh8 2453367 2453366 2026-09-01T13:11:22Z Stashbot 7414 fnegri@deploy1003: helmfile [staging] DONE helmfile.d/services/toolhub: apply 2453367 wikitext text/x-wiki 821j063njxykecg2jktm82784nd8w5z 2453368 2453367 2026-09-01T13:12:47Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-airflow-analytics-product: apply 2453368 wikitext text/x-wiki 13pd60pp9ndnghruxzt07l91l3q9053 2453369 2453368 2026-09-01T13:12:51Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-airflow-analytics-product: apply 2453369 wikitext text/x-wiki 3f7eqs29cjuh1kj1t67t7rtc5ega3al 2453370 2453369 2026-09-01T13:12:56Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-airflow-dev: apply 2453370 wikitext text/x-wiki c02ikufatpw61s93fs3t6vqy0kmpdv0 2453371 2453370 2026-09-01T13:13:00Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-airflow-dev: apply 2453371 wikitext text/x-wiki 9olq9zuxgotorontb4gbf8643nptyin 2453372 2453371 2026-09-01T13:13:04Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-airflow-dumps: apply 2453372 wikitext text/x-wiki 7dm2rb39dso0n9ww28tyuslg46ltqqu 2453373 2453372 2026-09-01T13:13:08Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-airflow-dumps: apply 2453373 wikitext text/x-wiki trcy2jbuusgh0nxx1w87fxb1hgnton6 2453374 2453373 2026-09-01T13:13:17Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-airflow-fr-tech: apply 2453374 wikitext text/x-wiki izvj0n3pu8bheegv1fr1fy0v3cizq1v 2453375 2453374 2026-09-01T13:13:21Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-airflow-fr-tech: apply 2453375 wikitext text/x-wiki oqawttrcnla8l9no8rxqanl8mf16arn 2453376 2453375 2026-09-01T13:13:28Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-airflow-main: apply 2453376 wikitext text/x-wiki 9knwbgd3oy72ygddx83s87r1itlw0zj 2453377 2453376 2026-09-01T13:13:32Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-airflow-main: apply 2453377 wikitext text/x-wiki loa5dq2xxc92ckrwwd1v760hgpa0khv 2453378 2453377 2026-09-01T13:14:09Z Stashbot 7414 fnegri@deploy1003: helmfile [codfw] START helmfile.d/services/toolhub: apply 2453378 wikitext text/x-wiki 9rsc5tpbsbi5cuhzwzzvcafytaqo0hz 2453379 2453378 2026-09-01T13:14:28Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-airflow-ml: apply 2453379 wikitext text/x-wiki q1pu1cywn2sgyw0l4i137gxgmuoyw0m 2453380 2453379 2026-09-01T13:14:32Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-airflow-ml: apply 2453380 wikitext text/x-wiki jjc5vl6pp1ectgk87vvzc0hfibx4jv0 2453381 2453380 2026-09-01T13:14:37Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-airflow-research: apply 2453381 wikitext text/x-wiki fkydo983lvpu93apapkucxca03zk3js 2453382 2453381 2026-09-01T13:14:42Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-airflow-research: apply 2453382 wikitext text/x-wiki 95t5ggrs7lwxgakvh0fufrqkojvyu50 2453383 2453382 2026-09-01T13:15:04Z Stashbot 7414 fnegri@deploy1003: helmfile [codfw] DONE helmfile.d/services/toolhub: apply 2453383 wikitext text/x-wiki 4ldv7vav98ekrgst5ot7w4lb7u0a7bt 2453384 2453383 2026-09-01T13:15:11Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453384 wikitext text/x-wiki suxjrlnxkap6088rrhj53vl88jxosvb 2453385 2453384 2026-09-01T13:15:17Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-airflow-search: apply 2453385 wikitext text/x-wiki 0qurk9d1idqg0k1f7lymwjd0xddyfi8 2453386 2453385 2026-09-01T13:15:21Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-airflow-search: apply 2453386 wikitext text/x-wiki 4hk9r9no5yn0l8hyfb8mwq06gb1b8kx 2453387 2453386 2026-09-01T13:15:40Z Stashbot 7414 moritzm: bump urldownloader[12]00[34] to 8G RAM T429175 2453387 wikitext text/x-wiki o4y8itdjjggwab8orz8i4bzmvpsborg 2453388 2453387 2026-09-01T13:16:06Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-airflow-sre: apply 2453388 wikitext text/x-wiki j0jp3i0nof7iuo79mnrefwk40w2omjz 2453389 2453388 2026-09-01T13:16:10Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-airflow-sre: apply 2453389 wikitext text/x-wiki 2bpwnr65fu8h7rwhy8rab9ze002iexg 2453390 2453389 2026-09-01T13:16:20Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.reboot-vm for VM urldownloader1003.wikimedia.org 2453390 wikitext text/x-wiki 40h6c7kna0eqx3dju6ytej7t3w2vheq 2453391 2453390 2026-09-01T13:17:00Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-airflow-wikidata: apply 2453391 wikitext text/x-wiki 7qusqcamd6j96hfr9tabjafcxspa6f6 2453392 2453391 2026-09-01T13:17:04Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-airflow-wikidata: apply 2453392 wikitext text/x-wiki nfiv6c0npuz51b8s2bd2wlz525haj95 2453393 2453392 2026-09-01T13:17:36Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/postgresql-airflow-wmde: apply 2453393 wikitext text/x-wiki rp3ux39zwrczalzmgy3xr2un9ff7us7 2453394 2453393 2026-09-01T13:17:39Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/postgresql-airflow-wmde: apply 2453394 wikitext text/x-wiki f7p2qcxwtxkqp7veuiiaklsk086p2za 2453396 2453394 2026-09-01T13:19:28Z Stashbot 7414 fnegri@deploy1003: helmfile [eqiad] START helmfile.d/services/toolhub: apply 2453396 wikitext text/x-wiki kg1g7a0640eicw7ur7k5knzyllrncla 2453397 2453396 2026-09-01T13:20:19Z Stashbot 7414 fnegri@deploy1003: helmfile [eqiad] DONE helmfile.d/services/toolhub: apply 2453397 wikitext text/x-wiki gbpdcqc539syr85zx8z5bgf1kprq9ro 2453399 2453397 2026-09-01T13:20:50Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM urldownloader1003.wikimedia.org 2453399 wikitext text/x-wiki jcoy9j0b0vtj5mlc32kso9ksy2ip8ur 2453400 2453399 2026-09-01T13:23:11Z Stashbot 7414 aude@deploy1003: Finished scap sync-world: Backport for [[gerrit:1332717|Enable ReadingLists for logged-in users on phase 1 wikis (T434922)]] (duration: 20m 24s) 2453400 wikitext text/x-wiki 7bxvkhfazwd5q6vbxbhjznodb63iiel 2453401 2453400 2026-09-01T13:24:09Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-product: apply 2453401 wikitext text/x-wiki s5t5960i6pdmvn7t1dkq9sunrd0q5mu 2453402 2453401 2026-09-01T13:24:45Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.reboot-vm for VM urldownloader1004.wikimedia.org 2453402 wikitext text/x-wiki 3ub4fiev2gho81h3fug58b5la6vyo50 2453403 2453402 2026-09-01T13:24:49Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-product: apply 2453403 wikitext text/x-wiki he2cygn79am4tz67nv1i0d1s8w2qmcw 2453404 2453403 2026-09-01T13:25:51Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453404 wikitext text/x-wiki drfznuzs75ps5xespiawbo1irw4sm2t 2453405 2453404 2026-09-01T13:26:17Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453405 wikitext text/x-wiki rpayu18arxwm990qsbkhi1kjhoq16sg 2453406 2453405 2026-09-01T13:26:52Z Stashbot 7414 kharlan@deploy1003: Started scap sync-world: Backport for [[gerrit:1333200|Special:AbuseReview: Show changes as core's inline diff (T436490)]] 2453406 wikitext text/x-wiki p0zwpyiauu2mfyvd8r47iv8yexzpevs 2453407 2453406 2026-09-01T13:29:18Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM urldownloader1004.wikimedia.org 2453407 wikitext text/x-wiki 4ybdztburlu905ric2f0vpyzsz0v9m5 2453408 2453407 2026-09-01T13:29:33Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2453408 wikitext text/x-wiki 8miaud4p3zg1ccfsri4o4ehlm9psyul 2453409 2453408 2026-09-01T13:30:12Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2453409 wikitext text/x-wiki 32ji76fsp1f4scqubcjhwxdy2ytugzv 2453410 2453409 2026-09-01T13:32:55Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-dumps: apply 2453410 wikitext text/x-wiki 3h5hf44lediagfau8t3rzdr41cqt9pp 2453411 2453410 2026-09-01T13:33:25Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-dumps: apply 2453411 wikitext text/x-wiki sx8fkrc0z2hjrfai0opv8a5b6j5py8l 2453412 2453411 2026-09-01T13:34:22Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.reboot-vm for VM urldownloader2003.wikimedia.org 2453412 wikitext text/x-wiki fhzxwfd4fyisnz4lq1ilq4w8g7vkhp6 2453413 2453412 2026-09-01T13:38:45Z Stashbot 7414 jmm@dns1004: START - running authdns-update 2453413 wikitext text/x-wiki k2rv4sx5f4wvnw2qgmq7791fhut3wu0 2453414 2453413 2026-09-01T13:38:51Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM urldownloader2003.wikimedia.org 2453414 wikitext text/x-wiki 3t6jdy7nxjxvsazafesmap0730kllxp 2453415 2453414 2026-09-01T13:39:05Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.reboot-vm for VM urldownloader2004.wikimedia.org 2453415 wikitext text/x-wiki np94r8xn1otvcvaa63ariqgyk08e0zd 2453416 2453415 2026-09-01T13:40:56Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453416 wikitext text/x-wiki e72ksv0fie0cjruififtmlp4ansq5b4 2453417 2453416 2026-09-01T13:41:09Z Stashbot 7414 jmm@dns1004: END - running authdns-update 2453417 wikitext text/x-wiki 8uro0ou77iimjqnsij0d06l4o3hyb7d 2453418 2453417 2026-09-01T13:42:02Z Stashbot 7414 joal@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: apply 2453418 wikitext text/x-wiki dgdxcnyzk416tlu8ut109tud5hgqly1 2453419 2453418 2026-09-01T13:43:23Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM urldownloader2004.wikimedia.org 2453419 wikitext text/x-wiki fm60sn9lambxi80mr9ipmyyn81piven 2453421 2453419 2026-09-01T13:48:19Z Stashbot 7414 kharlan@deploy1003: kharlan: Backport for [[gerrit:1333200|Special:AbuseReview: Show changes as core's inline diff (T436490)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2453421 wikitext text/x-wiki jmjs1vzdteiczhiiqjxd3qfzn4gvu9t 2453422 2453421 2026-09-01T13:49:40Z Stashbot 7414 kharlan@deploy1003: kharlan: Continuing with deployment 2453422 wikitext text/x-wiki 8e30ivld8oijnwk21rywm6ucovno1he 2453424 2453422 2026-09-01T13:50:19Z Stashbot 7414 joal@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: apply 2453424 wikitext text/x-wiki 0vumvofa2ljhb8ey1p72bx3k7g1qxwj 2453427 2453424 2026-09-01T13:53:43Z Stashbot 7414 ladsgroup@dns1004: START - running authdns-update 2453427 wikitext text/x-wiki mm1zwp6prabfzaq13kkq8ngi3qyhsh4 2453430 2453427 2026-09-01T13:55:44Z Stashbot 7414 joal@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: apply 2453430 wikitext text/x-wiki jai2lhe531j0kjyolgfpsl4in5p3ygv 2453432 2453430 2026-09-01T13:56:01Z Stashbot 7414 ladsgroup@dns1004: END - running authdns-update 2453432 wikitext text/x-wiki 1jxyynptiyg67duhpqr9kdx27g0qqak 2453433 2453432 2026-09-01T13:56:20Z Stashbot 7414 joal@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: apply 2453433 wikitext text/x-wiki 01rmbv63l07j1w3pzqrrfogfph69k9w 2453434 2453433 2026-09-01T13:56:26Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-fr-tech: apply 2453434 wikitext text/x-wiki d5q5mq7hzxcdxve6t52cqcig8tujna2 2453435 2453434 2026-09-01T13:56:31Z Stashbot 7414 ladsgroup@dns1004: START - running authdns-update 2453435 wikitext text/x-wiki 7o4fblaaieczlelycdwldvt1fxan37m 2453436 2453435 2026-09-01T13:57:05Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-fr-tech: apply 2453436 wikitext text/x-wiki o6m3yhol8tubdlporp9fxq7hl5cjydq 2453437 2453436 2026-09-01T13:58:22Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-ml: apply 2453437 wikitext text/x-wiki j7qr2yg1kgb0xopc00jr3e7v5vt8wu0 2453438 2453437 2026-09-01T13:58:55Z Stashbot 7414 ladsgroup@dns1004: END - running authdns-update 2453438 wikitext text/x-wiki lowi9f798dgzm8crj1rgeth6to0m2pg 2453439 2453438 2026-09-01T13:58:56Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-ml: apply 2453439 wikitext text/x-wiki 1vvk529saykhvrrv2t91bejd2xcx7t8 2453440 2453439 2026-09-01T13:59:08Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-platform-eng: apply 2453440 wikitext text/x-wiki qazfv9acl41zl5x5a01rv34hlwwfru1 2453441 2453440 2026-09-01T13:59:42Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-platform-eng: apply 2453441 wikitext text/x-wiki 1q9phq8l62to52s8l6ofaaiyz7t43us 2453442 2453441 2026-09-01T13:59:58Z Stashbot 7414 joal@deploy1003: Started deploy [analytics/refinery@19f4b59] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@19f4b595] 2453442 wikitext text/x-wiki m5t1rxuglzbxbaftevantepht1ntir6 2453443 2453442 2026-09-01T14:00:02Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-research: apply 2453443 wikitext text/x-wiki lsls3ovgqa03tuzbuhnonrsfps89fyg 2453444 2453443 2026-09-01T14:00:28Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-research: apply 2453444 wikitext text/x-wiki 7d7g0wznh4mhcycb4qqh241aruylqva 2453447 2453444 2026-09-01T14:00:50Z Stashbot 7414 joal@deploy1003: Finished deploy [analytics/refinery@19f4b59] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@19f4b595] (duration: 00m 45s) 2453447 wikitext text/x-wiki okpkzyc53xrmmfbpoquni239m1j0b8l 2453449 2453447 2026-09-01T14:01:18Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-search: apply 2453449 wikitext text/x-wiki 9it4oa7u4u1mn6g2j47pdpsdvtd9iva 2453451 2453449 2026-09-01T14:01:57Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-search: apply 2453451 wikitext text/x-wiki 00o8c9fkrio2dn0di6zmvgfrnq4jhq7 2453452 2453451 2026-09-01T14:02:21Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-sre: apply 2453452 wikitext text/x-wiki rz527jq9ha5rcx06iriuw1mn2lt3oh3 2453453 2453452 2026-09-01T14:02:35Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.puppet.disable-merges 2453453 wikitext text/x-wiki t9cx7posfugwztigudhuxzs8egs11i1 2453454 2453453 2026-09-01T14:02:37Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.puppet.disable-merges (exit_code=0) 2453454 wikitext text/x-wiki n31mwutq2friqint53mcdanu09dve8p 2453456 2453454 2026-09-01T14:03:07Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-sre: apply 2453456 wikitext text/x-wiki tfpdy4zt2ihxdkfst00pv9bzrx8szul 2453457 2453456 2026-09-01T14:03:14Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host puppetserver1003.eqiad.wmnet 2453457 wikitext text/x-wiki rt5w6gwtd6ey20oivkaq02xs41qv45b 2453458 2453457 2026-09-01T14:03:21Z Stashbot 7414 hashar: Removed openjdk-17 packages from contint1002/contint2002 following relocation of CI Jenkins to contint1003/contint2003 # T418521 2453458 wikitext text/x-wiki oafqdwqqyuih8x66rbxdqx12dswtsva 2453459 2453458 2026-09-01T14:03:37Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-wikidata: apply 2453459 wikitext text/x-wiki 32vwm1vmxo7zahtbgdcppdwthso0uhv 2453460 2453459 2026-09-01T14:04:26Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-wikidata: apply 2453460 wikitext text/x-wiki s2omo5em482c1qh4687i34kgumlax1b 2453461 2453460 2026-09-01T14:04:30Z Stashbot 7414 kharlan@deploy1003: Finished scap sync-world: Backport for [[gerrit:1333200|Special:AbuseReview: Show changes as core's inline diff (T436490)]] (duration: 37m 37s) 2453461 wikitext text/x-wiki kipq2tbp2ghjioekvpy7l0wdl8wcql6 2453462 2453461 2026-09-01T14:04:41Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-wmde: apply 2453462 wikitext text/x-wiki t02juren6oboll8t3t01152t26bemmc 2453463 2453462 2026-09-01T14:05:08Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-wmde: apply 2453463 wikitext text/x-wiki 1nlbdyrpsxz329j16p4grckrhibqjss 2453464 2453463 2026-09-01T14:05:39Z Stashbot 7414 joal@deploy1003: Started deploy [analytics/refinery@19f4b59] (thin): Regular analytics weekly train THIN [analytics/refinery@19f4b595] 2453464 wikitext text/x-wiki 621825olm4nrkm0kxoyouc9k6ywtk4w 2453465 2453464 2026-09-01T14:06:14Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-main: apply 2453465 wikitext text/x-wiki lt504jca633a9zu33opyrtf3gk8mamj 2453468 2453465 2026-09-01T14:06:50Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-main: apply 2453468 wikitext text/x-wiki e4atqz7tf4ys5ajmr87jxt8l4ca47q5 2453469 2453468 2026-09-01T14:07:10Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.mysql.depool depool pc1022: Test 2453469 wikitext text/x-wiki 345kdbbaqpsxnfvnyyrv19obvzd0cm6 2453470 2453469 2026-09-01T14:07:11Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.mysql.parsercache 2453470 wikitext text/x-wiki jwdpttpvp7h36xy3b8074mqgc6yth5b 2453471 2453470 2026-09-01T14:07:13Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) 2453471 wikitext text/x-wiki qww00ztgim1yr6pldxspa3swutmqc9q 2453472 2453471 2026-09-01T14:07:14Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool pc1022: Test 2453472 wikitext text/x-wiki 830x9rgsvka6kiie6zwlebqr02l89ql 2453473 2453472 2026-09-01T14:09:03Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host puppetserver1003.eqiad.wmnet 2453473 wikitext text/x-wiki k10ugycakgaqgglr1kybsbghxi8s2uu 2453474 2453473 2026-09-01T14:09:32Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host puppetserver2004.codfw.wmnet 2453474 wikitext text/x-wiki t0wun7pqcxe13nzfbq5h3rqzcm24dbh 2453475 2453474 2026-09-01T14:10:09Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.mysql.pool pool pc1022: Test 2453475 wikitext text/x-wiki iddj1w2m3qto36trlyw247cc9hteafp 2453476 2453475 2026-09-01T14:10:09Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.mysql.parsercache 2453476 wikitext text/x-wiki po3kyxq2sdasos7k1xwwkal6af52gfv 2453477 2453476 2026-09-01T14:10:16Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) 2453477 wikitext text/x-wiki n813nrhjrlb7e4ui4apg6ch3sjuqcjv 2453478 2453477 2026-09-01T14:10:17Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool pc1022: Test 2453478 wikitext text/x-wiki iy0m6fg7xiydnynthqc73cgfa221m0y 2453479 2453478 2026-09-01T14:13:06Z Stashbot 7414 joal@deploy1003: Finished deploy [analytics/refinery@19f4b59] (thin): Regular analytics weekly train THIN [analytics/refinery@19f4b595] (duration: 07m 26s) 2453479 wikitext text/x-wiki jl06ndt805moevkaiffaeuzuhnq6rdy 2453482 2453479 2026-09-01T14:14:24Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.puppet.disable-merges 2453482 wikitext text/x-wiki imxj4duhj9pttzjjdwxltovwaqttv71 2453483 2453482 2026-09-01T14:14:26Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.puppet.disable-merges (exit_code=0) 2453483 wikitext text/x-wiki cnmprlx5681cfnty9f9r8jjumbdykv5 2453484 2453483 2026-09-01T14:15:31Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host puppetserver2004.codfw.wmnet 2453484 wikitext text/x-wiki 1l1woilpkdpdim0q3fveyn3soz5qgbe 2453485 2453484 2026-09-01T14:15:38Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/analytics-test: apply 2453485 wikitext text/x-wiki lu6a2pe593qezbuhoaa2wocv0q9p6sv 2453486 2453485 2026-09-01T14:15:44Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/analytics-test: apply 2453486 wikitext text/x-wiki 1jwqslw2l2ue54tkj3nh2sd5612aynl 2453487 2453486 2026-09-01T14:17:13Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply 2453487 wikitext text/x-wiki c1u56s1509zz1lb9ptyrma6afqdfi3l 2453488 2453487 2026-09-01T14:17:40Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply 2453488 wikitext text/x-wiki rsmgqbzmfet101peb0xc9zurx8unzk2 2453491 2453488 2026-09-01T14:19:32Z Stashbot 7414 jmm@dns1004: START - running authdns-update 2453491 wikitext text/x-wiki l7pqzjgmj697orehq83firec4nzedbr 2453492 2453491 2026-09-01T14:20:09Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply 2453492 wikitext text/x-wiki 899u8cwn2az91zuc2gkjari8emvl0rx 2453493 2453492 2026-09-01T14:20:30Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply 2453493 wikitext text/x-wiki 559egyzal8y5dqbmrmd5o9njd6zlcu9 2453494 2453493 2026-09-01T14:21:48Z Stashbot 7414 jmm@dns1004: END - running authdns-update 2453494 wikitext text/x-wiki kjxbjurfch88hknjg4miyy8lecr7v8n 2453495 2453494 2026-09-01T14:21:58Z Stashbot 7414 jmm@dns1004: START - running authdns-update 2453495 wikitext text/x-wiki 9ukj89251gfwk5yh1np6m7xyzvvamt0 2453496 2453495 2026-09-01T14:22:23Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/mediawiki-dumps-legacy: apply 2453496 wikitext text/x-wiki 8n79vlzc9z9vthkofbm0vr1qm3c5pgd 2453497 2453496 2026-09-01T14:22:32Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/mediawiki-dumps-legacy: apply 2453497 wikitext text/x-wiki p78yoo8dkbt7eawxf500wvri0sw4oqm 2453498 2453497 2026-09-01T14:23:44Z Stashbot 7414 hashar@deploy1003: Started deploy [integration/docroot@780c44c]: opensource.yaml: Add CheckUser 2453498 wikitext text/x-wiki h7wpa8qo9zj3kh8hy7o5cagj0plqcl7 2453499 2453498 2026-09-01T14:23:59Z Stashbot 7414 hashar@deploy1003: Finished deploy [integration/docroot@780c44c]: opensource.yaml: Add CheckUser (duration: 00m 14s) 2453499 wikitext text/x-wiki nhymbott5jb23q5emtjw7c7byh51ta5 2453500 2453499 2026-09-01T14:24:22Z Stashbot 7414 jmm@dns1004: END - running authdns-update 2453500 wikitext text/x-wiki csnpthm865h1opv3fx0pn20qz371k54 2453501 2453500 2026-09-01T14:24:41Z Stashbot 7414 moritzm: installing curl security updates 2453501 wikitext text/x-wiki bstbmsq77qcv7zw51gmnrdoxfwzxvh9 2453503 2453501 2026-09-01T14:25:14Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply 2453503 wikitext text/x-wiki q3zycdz88mexahbwa5h4bgj146bb4o2 2453504 2453503 2026-09-01T14:25:15Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-content-history-reconcile-enrich: apply 2453504 wikitext text/x-wiki 9epdcbfsmdgsniojbsoqow9yimbuh2h 2453505 2453504 2026-09-01T14:27:40Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich: apply 2453505 wikitext text/x-wiki i4czhvh2ddc13qr513ozziixozf3quf 2453506 2453505 2026-09-01T14:27:44Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich: apply 2453506 wikitext text/x-wiki 7lbjeon1zb0ye08i6p27p1civm1ujck 2453507 2453506 2026-09-01T14:28:01Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-feature-counts-change-enrich: apply 2453507 wikitext text/x-wiki a0rrz0zm519ic5zltubntdnnn27zeky 2453508 2453507 2026-09-01T14:28:05Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-feature-counts-change-enrich: apply 2453508 wikitext text/x-wiki sd03al405hywsraqa6q5q62yoepc6sq 2453511 2453508 2026-09-01T14:31:40Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/spark-history: apply 2453511 wikitext text/x-wiki rxb5wadkehyvboseq6e92de626etx79 2453512 2453511 2026-09-01T14:32:27Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/spark-history: apply 2453512 wikitext text/x-wiki chrjesyjosuwnm7toe8t7rl56iggp7q 2453514 2453512 2026-09-01T14:33:17Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/superset: apply 2453514 wikitext text/x-wiki hu4wex6qzivih6yb88j0lify8aptg0z 2453515 2453514 2026-09-01T14:34:14Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/superset: apply 2453515 wikitext text/x-wiki mseb17h0szb11wtendj0r2v8qfrryw8 2453516 2453515 2026-09-01T14:35:45Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/test-kitchen: apply 2453516 wikitext text/x-wiki 3bjje7l1c6nrt5q12h5sw3iq2jorxvz 2453517 2453516 2026-09-01T14:35:54Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/test-kitchen: apply 2453517 wikitext text/x-wiki 0zsh7u77l8y1o6xygysv7zvsbvanaay 2453518 2453517 2026-09-01T14:36:04Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/webrequest-pageview: apply 2453518 wikitext text/x-wiki pwnphru2txmbzv843odsabd3q3dpl3v 2453519 2453518 2026-09-01T14:36:07Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/webrequest-pageview: apply 2453519 wikitext text/x-wiki j129ip6lbp314ecs9h2ubd6pq4j6iob 2453523 2453519 2026-09-01T14:45:54Z Stashbot 7414 hashar: Restarted Gerrit on gerrit1003 and gerrit2002 2453523 wikitext text/x-wiki 5e76qx50x6orajuajddpnr8428c4dy7 2453528 2453523 2026-09-01T14:48:58Z Stashbot 7414 hashar: Restarting Gerrit primary on gerrit2003 2453528 wikitext text/x-wiki eo5zmnspbuu83hq5qykzz81ny51ixrb 2453536 2453528 2026-09-01T14:51:59Z Stashbot 7414 hashar: Restarted CI Jenkins on contint1003 2453536 wikitext text/x-wiki 6bndtxrfoqsadq6654lhbmtzi3k4jrq 2453540 2453536 2026-09-01T14:55:42Z Stashbot 7414 hashar: Restarted Jenkins on releases1003 2453540 wikitext text/x-wiki t9jtlmhlybffjz93scbrkxrceaqywh3 2453544 2453540 2026-09-01T15:08:53Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/datasets-config: apply 2453544 wikitext text/x-wiki 6kstkb9pzpz1m8pk10lhpnqfhofwtip 2453545 2453544 2026-09-01T15:09:00Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/datasets-config: apply 2453545 wikitext text/x-wiki 0rn93cine4nib6fwgqpf7fd8igbgdl6 2453546 2453545 2026-09-01T15:09:07Z Stashbot 7414 joal@deploy1003: Started deploy [analytics/refinery@19f4b59]: Regular analytics weekly train [analytics/refinery@19f4b595] 2453546 wikitext text/x-wiki q5xhdtcgis2bmuaspz3fhu70vl2h382 2453547 2453546 2026-09-01T15:11:36Z Stashbot 7414 aokoth@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5 days, 0:00:00 on phab1004.eqiad.wmnet with reason: Decom 2453547 wikitext text/x-wiki jwd914f8aq07rlj98cee7bz28varxsj 2453548 2453547 2026-09-01T15:14:29Z Stashbot 7414 aokoth@cumin1003: START - Cookbook sre.hosts.decommission for hosts phab1004.eqiad.wmnet 2453548 wikitext text/x-wiki fgyxonabbt70yypgeussr7t9v1xxqpn 2453549 2453548 2026-09-01T15:14:40Z Stashbot 7414 joal@deploy1003: Finished deploy [analytics/refinery@19f4b59]: Regular analytics weekly train [analytics/refinery@19f4b595] (duration: 05m 32s) 2453549 wikitext text/x-wiki 9bj0fbtn6ox0jl5wflveno9y8ukpp9w 2453550 2453549 2026-09-01T15:20:18Z Stashbot 7414 aokoth@cumin1003: START - Cookbook sre.dns.netbox 2453550 wikitext text/x-wiki b39bg08ynl7ybq3fbwi157ntdckee9y 2453552 2453550 2026-09-01T15:27:59Z Stashbot 7414 aokoth@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: phab1004.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - aokoth@cumin1003" 2453552 wikitext text/x-wiki lu1alawpzxg68wbt2m7vr9ih9hts0yp 2453553 2453552 2026-09-01T15:29:15Z Stashbot 7414 aokoth@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: phab1004.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - aokoth@cumin1003" 2453553 wikitext text/x-wiki 5qysazcn4nyc068diudjbwwiraw233e 2453554 2453553 2026-09-01T15:29:16Z Stashbot 7414 aokoth@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2453554 wikitext text/x-wiki 9lk4xeb425yupited2t7yssl422x4zt 2453555 2453554 2026-09-01T15:29:17Z Stashbot 7414 aokoth@cumin1003: END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts phab1004.eqiad.wmnet 2453555 wikitext text/x-wiki jrgvls5yisnc8x1sbemccqfqnegpmuz 2453556 2453555 2026-09-01T15:51:38Z Stashbot 7414 moritzm: installing mesa security updates 2453556 wikitext text/x-wiki 9yf7xpef4po7m49r9g1twt7y8bvxctw 2453561 2453556 2026-09-01T16:23:17Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply 2453561 wikitext text/x-wiki nfu7xmxljenugzed8zwhw9ua2qjgqm1 2453562 2453561 2026-09-01T16:24:14Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply 2453562 wikitext text/x-wiki 7cunl8ybr5zemxyldw2lejr6big3g29 2453567 2453562 2026-09-01T16:42:57Z Stashbot 7414 dancy@deploy1003: Installing scap version "4.287.0" for 156 host(s) 2453567 wikitext text/x-wiki lu936frshvinfnvtohytd8fo3zmd14l 2453568 2453567 2026-09-01T16:47:23Z Stashbot 7414 dancy@deploy1003: Installation of scap version "4.287.0" completed for 156 hosts 2453568 wikitext text/x-wiki jdh94srlcz36lykkuglxtt5wpsfteoe 2453569 2453568 2026-09-01T16:48:19Z Stashbot 7414 dancy@deploy1003: Started scap sync-world: testing 2453569 wikitext text/x-wiki faql5t3pcwtjpk9ks45p112w78hd7yd 2453570 2453569 2026-09-01T16:48:25Z Stashbot 7414 dancy@deploy1003: sync-world aborted: testing (duration: 00m 05s) 2453570 wikitext text/x-wiki 2paqf899et46e0zgj4j8ol4ergptuu0 2453571 2453570 2026-09-01T16:52:53Z Stashbot 7414 dancy@deploy1003: Started scap sync-world: testing 2453571 wikitext text/x-wiki 5yg5lo8ahzwqii3rr0g7nl1vrt8gv0a 2453572 2453571 2026-09-01T17:01:00Z Stashbot 7414 dancy@deploy1003: Finished scap sync-world: testing (duration: 08m 07s) 2453572 wikitext text/x-wiki 8bo2f2sa3513y3wq7j53elrk41b3a28 2453573 2453572 2026-09-01T17:04:15Z Stashbot 7414 bking@cumin2003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on matomo1003.eqiad.wmnet with reason: Matomo version upgrade T431608 2453573 wikitext text/x-wiki glyxfn4ws09zdxi5w93u9h77cszno96 2453584 2453573 2026-09-01T18:14:05Z Stashbot 7414 dancy@deploy1003: rebuilt and synchronized wikiversions files: group0 to 1.47.0-wmf.18 refs T430837 2453584 wikitext text/x-wiki 0jw1ud177asnxnry9nun59jkaz79q35 2453600 2453584 2026-09-01T19:03:38Z Stashbot 7414 sukhe@dns1004: START - running authdns-update 2453600 wikitext text/x-wiki 34lycmn7skvn74aml83apeo9pbbln60 2453601 2453600 2026-09-01T19:06:01Z Stashbot 7414 sukhe@dns1004: END - running authdns-update 2453601 wikitext text/x-wiki 1u78ed2vduntzmfc3wz91sqji4bf02z 2453602 2453601 2026-09-01T19:06:08Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.dns.netbox 2453602 wikitext text/x-wiki tw67nlchdjz60bbyxcun1ukcr5dl541 2453603 2453602 2026-09-01T19:11:15Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding cloudcephosd1055 to eqiad - jclark@cumin1003" 2453603 wikitext text/x-wiki r6ij2lycg09va5ohxy49tfnrodb7kqy 2453604 2453603 2026-09-01T19:11:18Z Stashbot 7414 jclark@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding cloudcephosd1055 to eqiad - jclark@cumin1003" 2453604 wikitext text/x-wiki 6nnepyxvfe03r8z64o72dawovgii970 2453605 2453604 2026-09-01T19:11:19Z Stashbot 7414 jclark@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2453605 wikitext text/x-wiki 2n7q48be9gkntn460bemm2def7llu6w 2453606 2453605 2026-09-01T19:12:26Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host cloudcephosd1054 2453606 wikitext text/x-wiki enc4jrtsvg4isqc6kxn5wzygjvac5ue 2453607 2453606 2026-09-01T19:12:30Z Stashbot 7414 jclark@cumin1003: END (ERROR) - Cookbook sre.network.configure-switch-interfaces (exit_code=97) for host cloudcephosd1054 2453607 wikitext text/x-wiki 8ec84bmoyaj2zuhxlah4ofo4jx0w4w6 2453608 2453607 2026-09-01T19:12:33Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host cloudcephosd1055 2453608 wikitext text/x-wiki q8fabkfir4p8cnpsgk22wnj4avs3zo0 2453609 2453608 2026-09-01T19:12:42Z Stashbot 7414 jclark@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudcephosd1055 2453609 wikitext text/x-wiki onx0ndsjh6w3sp4crhm1rmffv43q99z 2453610 2453609 2026-09-01T19:12:45Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host cloudcephosd1056 2453610 wikitext text/x-wiki bfa1fhcix6o0gllhqcm2uml1dndgfv8 2453611 2453610 2026-09-01T19:12:55Z Stashbot 7414 jclark@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudcephosd1056 2453611 wikitext text/x-wiki 2okpa1kt0a4u72z2rqdhldd5fydbwjo 2453612 2453611 2026-09-01T19:13:24Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.provision for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453612 wikitext text/x-wiki 7vnlwkpgfy9rickiielgbdf27378v3k 2453613 2453612 2026-09-01T19:14:37Z Stashbot 7414 jclark@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453613 wikitext text/x-wiki 6gxult2ccecge1blr3ev3y1695k4pma 2453614 2453613 2026-09-01T19:14:50Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.provision for host cloudcephosd1056.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453614 wikitext text/x-wiki lns8pzfwq094nwmfyvqsg3hhusul5ad 2453615 2453614 2026-09-01T19:16:16Z Stashbot 7414 jclark@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1056.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453615 wikitext text/x-wiki fbvphjs7892qchbic2b21s9jarln5i2 2453618 2453615 2026-09-01T19:21:47Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hosts.reimage for host aqs1016.eqiad.wmnet with OS bookworm 2453618 wikitext text/x-wiki q85yfqd9clew68tkxxzl83h11su6w7p 2453619 2453618 2026-09-01T19:22:50Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.provision for host cloudcephosd1056.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453619 wikitext text/x-wiki fik6jm2zwo713guxdvmsuqgossmk9o8 2453620 2453619 2026-09-01T19:23:48Z Stashbot 7414 jclark@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1056.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453620 wikitext text/x-wiki hdur1fxs78k92cj4c9lwzfsjmroi3pl 2453621 2453620 2026-09-01T19:24:03Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.provision for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453621 wikitext text/x-wiki cth6vhga2qeorivl1bqhauv6flbykeo 2453622 2453621 2026-09-01T19:24:37Z Stashbot 7414 jclark@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453622 wikitext text/x-wiki j1tqkh0k6ixdef7upsbc7zhjfk79s8v 2453623 2453622 2026-09-01T19:25:07Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.provision for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453623 wikitext text/x-wiki k2dtnypo9vo360z2oa4nfwsg9owehjf 2453624 2453623 2026-09-01T19:25:19Z Stashbot 7414 jclark@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453624 wikitext text/x-wiki 6pmb1yq9j22wth2yj15bouyich2sazp 2453626 2453624 2026-09-01T19:25:33Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.provision for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453626 wikitext text/x-wiki 9nkdn7on15t6au23q8wujaj4aztz3p1 2453627 2453626 2026-09-01T19:25:54Z Stashbot 7414 jclark@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453627 wikitext text/x-wiki 1eb1x5rriacrf3pprr1wxg64ig3tava 2453629 2453627 2026-09-01T19:30:40Z Stashbot 7414 cdobbins@cumin1003: START - Cookbook sre.hosts.remove-downtime for cp5022.eqsin.wmnet 2453629 wikitext text/x-wiki 5hh8dtmh5hg14xzhcfjvvdntdv5wk2u 2453630 2453629 2026-09-01T19:30:41Z Stashbot 7414 cdobbins@cumin1003: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp5022.eqsin.wmnet 2453630 wikitext text/x-wiki eudfofhaamvgrxojsykjgxo94islb7f 2453631 2453630 2026-09-01T19:30:54Z Stashbot 7414 cdobbins@cumin1003: conftool action : set/pooled=yes; selector: name=cp5022.* [reason: update IP addrs] 2453631 wikitext text/x-wiki 8r1vyb6rqy1apzu015ju2rqu0sw3o76 2453632 2453631 2026-09-01T19:32:28Z Stashbot 7414 jhancock@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host cloudcephosd1055 2453632 wikitext text/x-wiki qtp8lfl2zb96z04focdsx807yn2v7mz 2453633 2453632 2026-09-01T19:32:35Z Stashbot 7414 jhancock@cumin1003: END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host cloudcephosd1055 2453633 wikitext text/x-wiki 2g8qs8xk8l7kb9c5u6u3lumt2z57m0v 2453634 2453633 2026-09-01T19:35:29Z Stashbot 7414 jhancock@cumin1003: START - Cookbook sre.hosts.provision for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453634 wikitext text/x-wiki kcn3lr4uv8eztt2atasofpuwf2xv0j9 2453635 2453634 2026-09-01T19:39:45Z Stashbot 7414 eevans@cumin1003: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host aqs1016.eqiad.wmnet with OS bookworm 2453635 wikitext text/x-wiki dciutuq5vi9001xxvwsb2ra19cswbgu 2453636 2453635 2026-09-01T19:40:56Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hosts.provision for host aqs1016.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2453636 wikitext text/x-wiki 39rucwc7lwqf0skosfhesn8d5jqhnfd 2453637 2453636 2026-09-01T19:41:58Z Stashbot 7414 jhancock@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453637 wikitext text/x-wiki b7t9vek5ian4ndva50bf6u7id5uoh0a 2453638 2453637 2026-09-01T19:42:51Z Stashbot 7414 eevans@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host aqs1016.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2453638 wikitext text/x-wiki nankalo62opwjpimob2iei8dfjh1srp 2453639 2453638 2026-09-01T19:45:41Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hosts.reimage for host aqs1016.eqiad.wmnet with OS bookworm 2453639 wikitext text/x-wiki ee71yzv6jo3k4716ozivexj62axe7qw 2453640 2453639 2026-09-01T19:47:31Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.provision for host cloudcephosd1056.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453640 wikitext text/x-wiki ir99prkbxim7hcye0bqpljj2vr81xr6 2453641 2453640 2026-09-01T19:52:59Z Stashbot 7414 jclark@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1056.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453641 wikitext text/x-wiki aqa101a1oo5v1qte6cx5i2aohs9ml3j 2453644 2453641 2026-09-01T19:54:57Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.provision for host cloudcephosd1056.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453644 wikitext text/x-wiki 0iqsclvwtfvhosb80rbxqbniq1a6e6k 2453645 2453644 2026-09-01T19:56:37Z Stashbot 7414 jclark@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1056.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453645 wikitext text/x-wiki lyzp1fmmcpcw57zdu2j8mvgoog3yjip 2453646 2453645 2026-09-01T19:56:54Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.provision for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453646 wikitext text/x-wiki 04akf9l6zdziq9m3miloh21kuvtrcp3 2453647 2453646 2026-09-01T19:56:56Z Stashbot 7414 eevans@cumin1003: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host aqs1016.eqiad.wmnet with OS bookworm 2453647 wikitext text/x-wiki 92t7t2cuwk6gkb9twvll53cxgqbkk6p 2453648 2453647 2026-09-01T19:57:11Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hosts.reimage for host aqs1016.eqiad.wmnet with OS bookworm 2453648 wikitext text/x-wiki 2y230525c8q95ognt33u665vopagwtt 2453649 2453648 2026-09-01T19:57:15Z Stashbot 7414 jclark@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453649 wikitext text/x-wiki 7qkmhfaizfsbzog7ow48cy71yqepsv6 2453652 2453649 2026-09-01T20:11:38Z Stashbot 7414 eevans@cumin1003: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host aqs1016.eqiad.wmnet with OS bookworm 2453652 wikitext text/x-wiki qxsh18wjjcndizne07k8bhbpijomb2f 2453653 2453652 2026-09-01T20:11:53Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hosts.reimage for host aqs1016.eqiad.wmnet with OS bookworm 2453653 wikitext text/x-wiki 93xvwmerqm3hu3te92s63fhsbao5tun 2453657 2453653 2026-09-01T20:24:43Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on aqs1016.eqiad.wmnet with reason: host reimage 2453657 wikitext text/x-wiki dwujzrd64csktwrd104j3i00ujujsdk 2453658 2453657 2026-09-01T20:28:27Z Stashbot 7414 eevans@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on aqs1016.eqiad.wmnet with reason: host reimage 2453658 wikitext text/x-wiki 865ny9qjnmfgqtmnh2kwy03h10rzd3m 2453659 2453658 2026-09-01T20:47:51Z Stashbot 7414 eevans@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host aqs1016.eqiad.wmnet with OS bookworm 2453659 wikitext text/x-wiki 0529o00qaj4giwyogjj7xqdt9t3dufo 2453664 2453659 2026-09-01T21:14:54Z Stashbot 7414 jdlrobson@deploy1003: Started scap sync-world: Backport for [[gerrit:1333293|Merge branch 'master' into wmf_deploy]], [[gerrit:1333277|Preserve showlogin query parameter on redirects (T435248)]] 2453664 wikitext text/x-wiki 3qvkgskaptdvcwgn17syc3ysjal5bxs 2453665 2453664 2026-09-01T21:20:50Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Backport for [[gerrit:1333293|Merge branch 'master' into wmf_deploy]], [[gerrit:1333277|Preserve showlogin query parameter on redirects (T435248)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2453665 wikitext text/x-wiki 59d915rghrq05izt7mg1d2iag2km38i 2453667 2453665 2026-09-01T21:28:35Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Continuing with deployment 2453667 wikitext text/x-wiki cel3a3d8m742jnld5o969z67kpyb3k9 2453668 2453667 2026-09-01T21:38:50Z Stashbot 7414 jdlrobson@deploy1003: Finished scap sync-world: Backport for [[gerrit:1333293|Merge branch 'master' into wmf_deploy]], [[gerrit:1333277|Preserve showlogin query parameter on redirects (T435248)]] (duration: 23m 55s) 2453668 wikitext text/x-wiki pc92zmt6on43mhbo8ruq1p4uuwhlxun 2453669 2453668 2026-09-01T21:41:51Z Stashbot 7414 jdlrobson@deploy1003: Started scap sync-world: Backport for [[gerrit:1333294|Merge branch 'master' into wmf_deploy]] 2453669 wikitext text/x-wiki iqpbzlgx87u7s306tuqc2oquv04xv5u 2453672 2453669 2026-09-01T21:47:43Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Backport for [[gerrit:1333294|Merge branch 'master' into wmf_deploy]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2453672 wikitext text/x-wiki qi446qoqbqs5jr3kpyj5z9rv4o99yba 2453673 2453672 2026-09-01T21:52:37Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Continuing with deployment 2453673 wikitext text/x-wiki j77lwsgwbox8rg5dfbggedg558wm3qd 2453674 2453673 2026-09-01T21:59:57Z Stashbot 7414 jdlrobson@deploy1003: Finished scap sync-world: Backport for [[gerrit:1333294|Merge branch 'master' into wmf_deploy]] (duration: 18m 05s) 2453674 wikitext text/x-wiki 702g19joj5cbutf4a0seybsgptclknv 2453685 2453674 2026-09-02T02:00:45Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2453685 wikitext text/x-wiki 6dkfdh5h64plv8ds805arz3flz47j3k 2453686 2453685 2026-09-02T02:08:28Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 07m 43s) 2453686 wikitext text/x-wiki mclbazlzs81ot6xqt1ubyl30dbgramt 2453691 2453686 2026-09-02T04:25:01Z Stashbot 7414 tstarling@deploy1003: Started scap sync-world: Backport for [[gerrit:1333470|Updater: Normalize MW_VERSION (T436741)]], [[gerrit:1333423|Set a short CC:max-age on cacheable REST responses]] 2453691 wikitext text/x-wiki 4xedjupjcq7jvkq6kdz387cq83tn7rc 2453692 2453691 2026-09-02T04:29:41Z Stashbot 7414 tstarling@deploy1003: tstarling: Backport for [[gerrit:1333470|Updater: Normalize MW_VERSION (T436741)]], [[gerrit:1333423|Set a short CC:max-age on cacheable REST responses]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2453692 wikitext text/x-wiki 1v6z56l91fmkuba0s1rycohfmrxhhv6 2453693 2453692 2026-09-02T04:53:48Z Stashbot 7414 tstarling@deploy1003: tstarling: Continuing with deployment 2453693 wikitext text/x-wiki czlh2a34t76rve8ph8z4tbmwo0anuyr 2453694 2453693 2026-09-02T05:01:15Z Stashbot 7414 tstarling@deploy1003: Scap cancelled without rolling back. 2453694 wikitext text/x-wiki 67vluvzk8qx02jw37xuz91x1fkw1n5g 2453695 2453694 2026-09-02T05:01:51Z Stashbot 7414 tstarling@deploy1003: Started scap sync-world: Backport for [[gerrit:1333470|Updater: Normalize MW_VERSION (T436741)]], [[gerrit:1333423|Set a short CC:max-age on cacheable REST responses]] 2453695 wikitext text/x-wiki b5cp08zj592bj6v538ab8k361y9cwn8 2453696 2453695 2026-09-02T05:03:26Z Stashbot 7414 tstarling@deploy1003: tstarling: Backport for [[gerrit:1333470|Updater: Normalize MW_VERSION (T436741)]], [[gerrit:1333423|Set a short CC:max-age on cacheable REST responses]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2453696 wikitext text/x-wiki s4d544t5see9d6f8z9cdyynbydvyzyy 2453697 2453696 2026-09-02T05:04:27Z Stashbot 7414 tstarling@deploy1003: tstarling: Continuing with deployment 2453697 wikitext text/x-wiki qa6zfyq1i0n93dkxarypar9oqis781n 2453698 2453697 2026-09-02T05:06:33Z Stashbot 7414 tstarling@deploy1003: Finished scap sync-world: Backport for [[gerrit:1333470|Updater: Normalize MW_VERSION (T436741)]], [[gerrit:1333423|Set a short CC:max-age on cacheable REST responses]] (duration: 04m 42s) 2453698 wikitext text/x-wiki tbmw2wvfl89kpmmmz81ijj924u2mhle 2453703 2453698 2026-09-02T06:13:46Z Stashbot 7414 XioNoX: re-enable magru cr1/asw1-b3 link - T436675 2453703 wikitext text/x-wiki quwa9lnwsgn8yretvmyx68k23mmqsta 2453704 2453703 2026-09-02T06:18:17Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.reimage for host db1228.eqiad.wmnet with OS trixie 2453704 wikitext text/x-wiki jlrq6rw6ew8kpawqufos3rn4tq1b4f3 2453705 2453704 2026-09-02T06:20:21Z Stashbot 7414 slyngshede@dns1004: START - running authdns-update 2453705 wikitext text/x-wiki j630vpt0km18cirldvucrvloe0j8ise 2453706 2453705 2026-09-02T06:21:09Z Stashbot 7414 marostegui: Drop cu* tables from s3 bswiktionary T435965 2453706 wikitext text/x-wiki tdprgzgr1l3a6lxj6980ie55u688pzm 2453707 2453706 2026-09-02T06:23:05Z Stashbot 7414 slyngshede@dns1004: END - running authdns-update 2453707 wikitext text/x-wiki 8t16wyo3izjhtfc112q0xmp0ght9hb6 2453708 2453707 2026-09-02T06:32:00Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1228.eqiad.wmnet with reason: host reimage 2453708 wikitext text/x-wiki kn94nzne32yft2urc3s5ci8gg5e13g9 2453709 2453708 2026-09-02T06:39:25Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1228.eqiad.wmnet with reason: host reimage 2453709 wikitext text/x-wiki qr03o4qjvg78lydjmba6mxcq8lv5cs1 2453715 2453709 2026-09-02T06:43:21Z Stashbot 7414 hashar@deploy1003: Started deploy [integration/docroot@780c44c]: build: Updating npm dependencies 2453715 wikitext text/x-wiki 1nxsy2n7in4a0ayuiswjsh1jnwjlsg9 2453716 2453715 2026-09-02T06:43:34Z Stashbot 7414 hashar@deploy1003: Finished deploy [integration/docroot@780c44c]: build: Updating npm dependencies (duration: 00m 13s) 2453716 wikitext text/x-wiki 0rltzyfg8nxh1rq3qxo9es0j5vm4cmk 2453719 2453716 2026-09-02T07:06:13Z Stashbot 7414 mszwarc@deploy1003: Started scap sync-world: Backport for [[gerrit:1333338|throttle.php: Lift IP cap for Mapudungun editathon on 2026-09-05 (T436672)]], [[gerrit:1333343|InitialiseSettings.php: Set $wgUploadNavigationUrl for ukwiki (T436712)]], [[gerrit:1333390|Add two wmf groups to privileged status (T436734)]] 2453719 wikitext text/x-wiki bvjj5lcnoy3fmbqcgq9eyl4dzyzqgzq 2453720 2453719 2026-09-02T07:10:40Z Stashbot 7414 mszwarc@deploy1003: mszwarc, eggroll97, tryvix1509: Backport for [[gerrit:1333338|throttle.php: Lift IP cap for Mapudungun editathon on 2026-09-05 (T436672)]], [[gerrit:1333343|InitialiseSettings.php: Set $wgUploadNavigationUrl for ukwiki (T436712)]], [[gerrit:1333390|Add two wmf groups to privileged status (T436734)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be veri 2453720 wikitext text/x-wiki qr7n4ej0j4s1ho8wl0rk48281gxu93z 2453721 2453720 2026-09-02T07:12:10Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1228.eqiad.wmnet with OS trixie 2453721 wikitext text/x-wiki niexi45nh5budo56c2gu98w80xapg19 2453722 2453721 2026-09-02T07:17:09Z Stashbot 7414 mszwarc@deploy1003: mszwarc, eggroll97, tryvix1509: Continuing with deployment 2453722 wikitext text/x-wiki 1t5xmvz9xc893byxayw637q9bdxcuk0 2453723 2453722 2026-09-02T07:18:53Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db[1228,1242].eqiad.wmnet with reason: db1242 needs to clone db1228 2453723 wikitext text/x-wiki pmydfqrmh2w0dqa7c1orb26y6q59f4u 2453724 2453723 2026-09-02T07:20:35Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool db1242: Cloning db1228 2453724 wikitext text/x-wiki 087wwob1y83pbv8gw4od2w2by2kz2au 2453725 2453724 2026-09-02T07:20:58Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1242: Cloning db1228 2453725 wikitext text/x-wiki nhp40wy06szb20rxmv80wv3yl198x2s 2453726 2453725 2026-09-02T07:22:17Z Stashbot 7414 mszwarc@deploy1003: Finished scap sync-world: Backport for [[gerrit:1333338|throttle.php: Lift IP cap for Mapudungun editathon on 2026-09-05 (T436672)]], [[gerrit:1333343|InitialiseSettings.php: Set $wgUploadNavigationUrl for ukwiki (T436712)]], [[gerrit:1333390|Add two wmf groups to privileged status (T436734)]] (duration: 16m 04s) 2453726 wikitext text/x-wiki qv4ewy4h91l1fnsmevvb8al4ms0eojn 2453727 2453726 2026-09-02T07:27:35Z Stashbot 7414 jmm@dns1004: START - running authdns-update 2453727 wikitext text/x-wiki ohihxnnb69krjufqs0mhqcjmb0ad15o 2453728 2453727 2026-09-02T07:27:54Z Stashbot 7414 mszwarc@deploy1003: Started scap sync-world: Backport for [[gerrit:1333559|UserInfoCard: Send the source page with the api_request event (T435585)]], [[gerrit:1333560|UserInfoCard: Send the source page with the api_request event (T435585)]], [[gerrit:1333561|UserInfoCard: Send the place of the trigger with api_request (T435585)]], [[gerrit:1333562|UserInfoCard: Send the place of the trigger with api_request (T435585)] 2453728 wikitext text/x-wiki f3tb74p6eywqod02ukbsy62scvom3k5 2453729 2453728 2026-09-02T07:30:01Z Stashbot 7414 jmm@dns1004: END - running authdns-update 2453729 wikitext text/x-wiki e2mh8cj3ypzxsr9q7dmlw4x5dbohp6p 2453730 2453729 2026-09-02T07:30:51Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host cumin1004.eqiad.wmnet 2453730 wikitext text/x-wiki ikt87bhy0zzno750b0w4fnsirhskpk8 2453731 2453730 2026-09-02T07:36:41Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cumin1004.eqiad.wmnet 2453731 wikitext text/x-wiki a7wvj4yrq360dn29rjqtpd83uxxz7oh 2453732 2453731 2026-09-02T07:49:11Z Stashbot 7414 mszwarc@deploy1003: mszwarc: Backport for [[gerrit:1333559|UserInfoCard: Send the source page with the api_request event (T435585)]], [[gerrit:1333560|UserInfoCard: Send the source page with the api_request event (T435585)]], [[gerrit:1333561|UserInfoCard: Send the place of the trigger with api_request (T435585)]], [[gerrit:1333562|UserInfoCard: Send the place of the trigger with api_request (T435585)]] synced to the 2453732 wikitext text/x-wiki kc2irxfrkw76r8v9txm0x1x8jwhofuy 2453733 2453732 2026-09-02T07:49:46Z Stashbot 7414 mszwarc@deploy1003: mszwarc: Continuing with deployment 2453733 wikitext text/x-wiki 4ko03d4a9tplqgcp5jlap8oqaqsfwm0 2453734 2453733 2026-09-02T08:03:44Z Stashbot 7414 mszwarc@deploy1003: Finished scap sync-world: Backport for [[gerrit:1333559|UserInfoCard: Send the source page with the api_request event (T435585)]], [[gerrit:1333560|UserInfoCard: Send the source page with the api_request event (T435585)]], [[gerrit:1333561|UserInfoCard: Send the place of the trigger with api_request (T435585)]], [[gerrit:1333562|UserInfoCard: Send the place of the trigger with api_request (T435585) 2453734 wikitext text/x-wiki g1ntij0m630qzc59l4eswad65p17ms1 2453735 2453734 2026-09-02T08:03:45Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.puppet.disable-merges 2453735 wikitext text/x-wiki 4pk5sr3uq53z7t9klkuozqo0o52ix75 2453736 2453735 2026-09-02T08:03:46Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.puppet.disable-merges (exit_code=0) 2453736 wikitext text/x-wiki gzoi6ifmxsdyn6aafhvpdr3lowl410q 2453737 2453736 2026-09-02T08:04:14Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host puppetserver2002.codfw.wmnet 2453737 wikitext text/x-wiki 9axnqy7t9fgshh949wqvzrq7cd6jv0k 2453738 2453737 2026-09-02T08:07:13Z Stashbot 7414 fabfur: depooling and silencing cp5022 (T414411) 2453738 wikitext text/x-wiki lbma1ztmcshiawiwmqwg8dzi5zfit9c 2453739 2453738 2026-09-02T08:07:48Z Stashbot 7414 slyngshede@cumin1003: conftool action : set/pooled=no; selector: name=cp5022.* 2453739 wikitext text/x-wiki 4m071zb1rs7aep7tpmwzjnek8g6zdqi 2453740 2453739 2026-09-02T08:07:53Z Stashbot 7414 mszwarc@deploy1003: Started scap sync-world: Backport for [[gerrit:1332684|Update stream config for user_info_card_interaction (T435585)]] 2453740 wikitext text/x-wiki lxrzcie4ecziidmps5sf9y0ycjdhcwo 2453741 2453740 2026-09-02T08:08:25Z Stashbot 7414 fabfur@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on cp5022.eqsin.wmnet with reason: investigating 2453741 wikitext text/x-wiki 46rous6yzuu8bt9pmp0debcd3dv8pdd 2453743 2453741 2026-09-02T08:10:02Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host puppetserver2002.codfw.wmnet 2453743 wikitext text/x-wiki 8i3x8vdtcd58jouvngr6dzfa37tf977 2453744 2453743 2026-09-02T08:11:48Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host puppetserver1002.eqiad.wmnet 2453744 wikitext text/x-wiki 9wgwqic4kwkei1p7y6k6l7c2mp95xtj 2453745 2453744 2026-09-02T08:14:18Z Stashbot 7414 mszwarc@deploy1003: mszwarc: Backport for [[gerrit:1332684|Update stream config for user_info_card_interaction (T435585)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2453745 wikitext text/x-wiki adh0jkwotxm80en5kx9wcq1prkgp653 2453746 2453745 2026-09-02T08:14:38Z Stashbot 7414 mszwarc@deploy1003: mszwarc: Continuing with deployment 2453746 wikitext text/x-wiki ejicvgylfvuj4o842fpdvulykx63fut 2453748 2453746 2026-09-02T08:18:24Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host puppetserver1002.eqiad.wmnet 2453748 wikitext text/x-wiki eotupgckfhic8nm8uu3qkjl3md27wjb 2453749 2453748 2026-09-02T08:19:10Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.puppet.disable-merges 2453749 wikitext text/x-wiki sgdc1azlethf940iyf03xpj7a61nn3x 2453750 2453749 2026-09-02T08:19:11Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.puppet.disable-merges (exit_code=0) 2453750 wikitext text/x-wiki 9wy9238e6foi1xa44xq2057jv1tp4dk 2453751 2453750 2026-09-02T08:22:30Z Stashbot 7414 mszwarc@deploy1003: Finished scap sync-world: Backport for [[gerrit:1332684|Update stream config for user_info_card_interaction (T435585)]] (duration: 14m 36s) 2453751 wikitext text/x-wiki 1a9wmczmyc2enonrx3f1qfgki69qr3h 2453752 2453751 2026-09-02T08:23:35Z Stashbot 7414 Msz2001: UTC morning backport window done 2453752 wikitext text/x-wiki mh959d6hrr252x7ycpyr04ailckes2i 2453753 2453752 2026-09-02T08:26:02Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: apply 2453753 wikitext text/x-wiki dc8pq2n4fwrxi806q6jd03f1zoifuxn 2453754 2453753 2026-09-02T08:26:11Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: apply 2453754 wikitext text/x-wiki als0tvwkiarlczuxro5xpncx51tp7wb 2453756 2453754 2026-09-02T08:36:05Z Stashbot 7414 moritzm: installing libgraphite2 security updates 2453756 wikitext text/x-wiki sj5f83kq45ddedl8a16sd4b9y2gim5t 2453758 2453756 2026-09-02T08:39:07Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.hosts.reimage for host netflow7002.magru.wmnet with OS trixie 2453758 wikitext text/x-wiki mjbsf1v54qhang7vyb7k7399b1ap3ex 2453760 2453758 2026-09-02T08:46:22Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: apply 2453760 wikitext text/x-wiki 98wxox79qxbiivib9o5b2jgqfqqon2n 2453761 2453760 2026-09-02T08:46:25Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: apply 2453761 wikitext text/x-wiki t2c4wdkx0uvc8kj2szlq4aq7mk5s6bn 2453762 2453761 2026-09-02T08:46:30Z Stashbot 7414 tappof: bump space for prometheus k8s-dse in eqiad 2453762 wikitext text/x-wiki qvpztyw49z1qnuxoc67pyktyh4xi3if 2453765 2453762 2026-09-02T09:08:57Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.provision for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453765 wikitext text/x-wiki silpfee8ywd6bm0rmj916a7thhyg3qz 2453766 2453765 2026-09-02T09:09:36Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on netflow7002.magru.wmnet with reason: host reimage 2453766 wikitext text/x-wiki drcx101d05l3avvzrqituwl7hvci6sp 2453767 2453766 2026-09-02T09:10:10Z Stashbot 7414 moritzm: installing openjdk-8 security updates 2453767 wikitext text/x-wiki 5ed92ebrijgamhuiivaiwf425dec688 2453768 2453767 2026-09-02T09:14:33Z Stashbot 7414 ayounsi@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on netflow7002.magru.wmnet with reason: host reimage 2453768 wikitext text/x-wiki rtkmlwxeubsk563sdjprox93jcoanak 2453769 2453768 2026-09-02T09:14:49Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453769 wikitext text/x-wiki jmu0mtj4tyqn39dhkw6yl6pybfnldv9 2453770 2453769 2026-09-02T09:16:34Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: apply 2453770 wikitext text/x-wiki am0s21qm80qgw8h6phbk43ds66u9iiu 2453771 2453770 2026-09-02T09:17:43Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: apply 2453771 wikitext text/x-wiki bycu3mmwj1ndamkmzukbcya9awlnnj9 2453772 2453771 2026-09-02T09:17:54Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.provision for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453772 wikitext text/x-wiki hbxpycyb4ca7yc7wbrx31icj6rlt382 2453773 2453772 2026-09-02T09:22:36Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453773 wikitext text/x-wiki oz6hdobyowomcb5x7eblydpdfrq4zab 2453774 2453773 2026-09-02T09:23:40Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: apply 2453774 wikitext text/x-wiki 6n0qrwua9ilb8qpwdoh0f5mw8be3dda 2453775 2453774 2026-09-02T09:23:47Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: apply 2453775 wikitext text/x-wiki jja4pzux4bni1wyocq59w9wylq3hm4p 2453778 2453775 2026-09-02T09:28:08Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cloudcephosd1055.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART 2453778 wikitext text/x-wiki q6t71gbwzp8f0x6y7upp0p86o4u8xuu 2453781 2453778 2026-09-02T09:30:44Z Stashbot 7414 moritzm: installing openjdk-21 security updates 2453781 wikitext text/x-wiki isfrz8bso5b3zal9nmt1ruhfv0b7w2m 2453782 2453781 2026-09-02T09:31:33Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453782 wikitext text/x-wiki rbs3ihyebza1516o6bzrktrr8z4hh3r 2453784 2453782 2026-09-02T09:34:14Z Stashbot 7414 ayounsi@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host netflow7002.magru.wmnet with OS trixie 2453784 wikitext text/x-wiki 6auica8h38q3a136fcu91lscdpqmra0 2453785 2453784 2026-09-02T09:42:21Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.hosts.reimage for host netflow4003.ulsfo.wmnet with OS trixie 2453785 wikitext text/x-wiki 2wawns7bb59k2voibhugshflty5kkul 2453786 2453785 2026-09-02T09:44:02Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453786 wikitext text/x-wiki ospzg7ig23zzl27o4sj8o4ksqzurh4q 2453787 2453786 2026-09-02T09:45:51Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: apply 2453787 wikitext text/x-wiki sozeohgvmzi3euslouv77lzkexom4cl 2453788 2453787 2026-09-02T09:45:58Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: apply 2453788 wikitext text/x-wiki rug626jge1em5cc0u5if8nxogjcxzv8 2453789 2453788 2026-09-02T09:46:12Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: apply 2453789 wikitext text/x-wiki ddfcohk9yiomcfm1b673rqfjdddikrd 2453790 2453789 2026-09-02T09:46:22Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: apply 2453790 wikitext text/x-wiki icm75lzf7njamsci1abh8fsmw1tfhfr 2453791 2453790 2026-09-02T09:47:16Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Add db1228 to dbctl T435892', diff saved to https://phabricator.wikimedia.org/P96313 and previous config saved to /var/cache/conftool/dbconfig/20260902-094713-marostegui.json 2453791 wikitext text/x-wiki ke97mui3c3xqxwx38exbm8qjmqafepu 2453792 2453791 2026-09-02T09:51:06Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool db1242: Pool back db1242 2453792 wikitext text/x-wiki pvuc4gzn6guftikvelh354axevzujpn 2453793 2453792 2026-09-02T09:53:43Z Stashbot 7414 jmm@dns1004: START - running authdns-update 2453793 wikitext text/x-wiki 0nt8b1c28bg0jw6f4szi3553al1polr 2453794 2453793 2026-09-02T09:54:40Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453794 wikitext text/x-wiki coglp1tr82i3yr0leefy5nmgio9j9ak 2453795 2453794 2026-09-02T09:55:02Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453795 wikitext text/x-wiki j2gi1xbtat7e91bkruy35y4f00h9om6 2453796 2453795 2026-09-02T09:56:05Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453796 wikitext text/x-wiki a9m9knlg9f28imfgsyergbzj5vhpy57 2453797 2453796 2026-09-02T09:56:07Z Stashbot 7414 jmm@dns1004: END - running authdns-update 2453797 wikitext text/x-wiki cst8c6c3ijv568h4eg7easr8826i8kk 2453798 2453797 2026-09-02T09:57:07Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453798 wikitext text/x-wiki l8raxsnbb8lrfywh959l3v9zn66gqc4 2453799 2453798 2026-09-02T09:58:33Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453799 wikitext text/x-wiki 9hvzzpdqodia9daqcbxsa8070fmk04a 2453800 2453799 2026-09-02T09:58:52Z Stashbot 7414 marostegui@cumin1003: END (ERROR) - Cookbook sre.mysql.pool (exit_code=97) pool db1242: Pool back db1242 2453800 wikitext text/x-wiki 5mu64jya72qqwukutsnylaometjeyky 2453801 2453800 2026-09-02T09:59:14Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool db1242: Pool back db1242 2453801 wikitext text/x-wiki 04akpy6pczs79vrcwwvt45isbe39w3g 2453802 2453801 2026-09-02T09:59:36Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453802 wikitext text/x-wiki hxxiotxn4kwavaihctgi1rxc4g4hiqa 2453803 2453802 2026-09-02T10:00:03Z Stashbot 7414 marostegui@cumin1003: END (ERROR) - Cookbook sre.mysql.pool (exit_code=97) pool db1242: Pool back db1242 2453803 wikitext text/x-wiki hg0tyq8ah8xog330rgx09sgzsv9lqa5 2453804 2453803 2026-09-02T10:00:04Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453804 wikitext text/x-wiki cd09e39w23k9r8oxk0fjhqrerf44fex 2453805 2453804 2026-09-02T10:01:00Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool db1242: Pool back db1242 2453805 wikitext text/x-wiki i0qtdsdjmlytttdjyfcgt0nfj96kheh 2453806 2453805 2026-09-02T10:03:40Z Stashbot 7414 blake@deploy1003: Started scap sync-world: non-build deployment for T417800 2453806 wikitext text/x-wiki d9f38ryov5z77us4arx0ijmusc6s3az 2453807 2453806 2026-09-02T10:04:52Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453807 wikitext text/x-wiki ovngrq9lq3yspbilrpxbn5ktbu5vcfk 2453808 2453807 2026-09-02T10:05:43Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453808 wikitext text/x-wiki hehup1uto8fygunvn8gs377n87mx79h 2453809 2453808 2026-09-02T10:06:08Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453809 wikitext text/x-wiki 2lfiwt97v65hwd412jmcfgd2ol9i4fo 2453811 2453809 2026-09-02T10:08:10Z Stashbot 7414 blake@deploy1003: Finished scap sync-world: non-build deployment for T417800 (duration: 05m 37s) 2453811 wikitext text/x-wiki ah2sx0e3i9lhefotvjvvfth2mygu3rg 2453812 2453811 2026-09-02T10:08:34Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on netflow4003.ulsfo.wmnet with reason: host reimage 2453812 wikitext text/x-wiki 7uv88ydjeqaperofzj9wa2z6mpdcx2l 2453813 2453812 2026-09-02T10:14:20Z Stashbot 7414 ayounsi@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on netflow4003.ulsfo.wmnet with reason: host reimage 2453813 wikitext text/x-wiki 9mcpoxfxwtndrw5ccwqfd0w5bkomqgn 2453814 2453813 2026-09-02T10:26:17Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453814 wikitext text/x-wiki 8wvvrmirlzww22sqr0c66jhykn2vyi2 2453815 2453814 2026-09-02T10:26:39Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453815 wikitext text/x-wiki t2ko26cimudivuk7a2qp8u139vm4pe9 2453816 2453815 2026-09-02T10:31:55Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Remove db1172 from dbctl T436763', diff saved to https://phabricator.wikimedia.org/P96318 and previous config saved to /var/cache/conftool/dbconfig/20260902-103152-marostegui.json 2453816 wikitext text/x-wiki 9p6actyqjjvnowk4q3eqemfzlex20u4 2453817 2453816 2026-09-02T10:32:16Z Stashbot 7414 ayounsi@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host netflow4003.ulsfo.wmnet with OS trixie 2453817 wikitext text/x-wiki 9yf5s0fdxoqy7to20yh52l4l286dycs 2453818 2453817 2026-09-02T10:44:25Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453818 wikitext text/x-wiki ib2s755tv9j1wn4g5s9c4m6ua4u2jfm 2453819 2453818 2026-09-02T10:45:16Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453819 wikitext text/x-wiki 23olf10t8wdqycokrwbnjv88vfcs8m7 2453820 2453819 2026-09-02T10:46:05Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1242: Pool back db1242 2453820 wikitext text/x-wiki aoq0uiucr2j32bhytytp40mel1xbdrb 2453821 2453820 2026-09-02T10:46:32Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453821 wikitext text/x-wiki 22i638ixdyvu4ygwzsh2h920t4vu78f 2453822 2453821 2026-09-02T10:46:48Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453822 wikitext text/x-wiki 5m65rqb08w4tsz39cixn5lsw98wpwlq 2453823 2453822 2026-09-02T10:46:59Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453823 wikitext text/x-wiki 4yk8mt50kyofr90lhbtea7bd0s57fdf 2453824 2453823 2026-09-02T10:48:22Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453824 wikitext text/x-wiki 3ioeibbyqdllhrydjpt1hnzns9bhbus 2453825 2453824 2026-09-02T10:49:48Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453825 wikitext text/x-wiki plm4e3rwjof9lys9xphlkby09nn4ys7 2453826 2453825 2026-09-02T10:50:39Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453826 wikitext text/x-wiki 70azjbndj2l2puolebu58vluga2g874 2453827 2453826 2026-09-02T10:52:54Z Stashbot 7414 fceratto@deploy1003: helmfile [aux-k8s-eqiad] 'sync' command on namespace 'zarcillo' for release 'main' . 2453827 wikitext text/x-wiki n9w40mhm0nxxdin8n04wmrjd92h8uay 2453828 2453827 2026-09-02T10:59:11Z Stashbot 7414 mvolz@deploy1003: helmfile [staging] START helmfile.d/services/zotero: apply 2453828 wikitext text/x-wiki kixwnv2g9h1cx2s8ctt71p74uovgacd 2453829 2453828 2026-09-02T10:59:30Z Stashbot 7414 mvolz@deploy1003: helmfile [staging] DONE helmfile.d/services/zotero: apply 2453829 wikitext text/x-wiki 4kng2ersg7007g7ek7q24mr4vwdt1qu 2453830 2453829 2026-09-02T11:00:12Z Stashbot 7414 mvolz@deploy1003: helmfile [eqiad] START helmfile.d/services/zotero: apply 2453830 wikitext text/x-wiki dtyf5gpurh8u845khe55pmfreg0df00 2453831 2453830 2026-09-02T11:00:48Z Stashbot 7414 mvolz@deploy1003: helmfile [eqiad] DONE helmfile.d/services/zotero: apply 2453831 wikitext text/x-wiki flxfzwu9pxb1ru3jww9hzrcpbacpurm 2453832 2453831 2026-09-02T11:03:01Z Stashbot 7414 mvolz@deploy1003: helmfile [codfw] START helmfile.d/services/zotero: apply 2453832 wikitext text/x-wiki iffynlglu2shfmu00mlbulcwrcb27os 2453833 2453832 2026-09-02T11:03:29Z Stashbot 7414 mvolz@deploy1003: helmfile [codfw] DONE helmfile.d/services/zotero: apply 2453833 wikitext text/x-wiki qvw2hnjxmmrr5xns3fvvja6k6g6mc72 2453834 2453833 2026-09-02T11:05:02Z Stashbot 7414 slyngshede@cumin1003: START - Cookbook sre.hosts.remove-downtime for cp5022.eqsin.wmnet 2453834 wikitext text/x-wiki i5kc3m4b2657mns4j5svbfsaxjvnrwm 2453835 2453834 2026-09-02T11:05:03Z Stashbot 7414 slyngshede@cumin1003: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp5022.eqsin.wmnet 2453835 wikitext text/x-wiki 2637ori20fly8arh7wm7xr6wvhlzdwe 2453836 2453835 2026-09-02T11:05:43Z Stashbot 7414 slyngshede@cumin1003: conftool action : set/pooled=yes; selector: name=cp5022.* 2453836 wikitext text/x-wiki tdo2sgkxach8qllzg0w8gotr2r5peli 2453837 2453836 2026-09-02T11:08:09Z Stashbot 7414 mvolz@deploy1003: helmfile [staging] START helmfile.d/services/citoid: apply 2453837 wikitext text/x-wiki pcma7o6z3wctav3ckvpuk442liscgla 2453838 2453837 2026-09-02T11:08:28Z Stashbot 7414 mvolz@deploy1003: helmfile [staging] DONE helmfile.d/services/citoid: apply 2453838 wikitext text/x-wiki 4bs3439oa1s4dnwox3p0gd1ubadpmh9 2453839 2453838 2026-09-02T11:09:44Z Stashbot 7414 mvolz@deploy1003: helmfile [codfw] START helmfile.d/services/citoid: apply 2453839 wikitext text/x-wiki 7qwo6k5yfpu6ig9fqc9awft3itk1a87 2453840 2453839 2026-09-02T11:10:11Z Stashbot 7414 mvolz@deploy1003: helmfile [codfw] DONE helmfile.d/services/citoid: apply 2453840 wikitext text/x-wiki hrw1rxbbbq5kuzemzdu9nba0nhgg59j 2453841 2453840 2026-09-02T11:11:34Z Stashbot 7414 mvolz@deploy1003: helmfile [eqiad] START helmfile.d/services/citoid: apply 2453841 wikitext text/x-wiki 7mi1h76y29z8ed0mvw85ojx493sueuy 2453842 2453841 2026-09-02T11:12:01Z Stashbot 7414 mvolz@deploy1003: helmfile [eqiad] DONE helmfile.d/services/citoid: apply 2453842 wikitext text/x-wiki dtb9ysad6qytc9e4qimv06ew5hf10rw 2453843 2453842 2026-09-02T11:20:23Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.decommission 2453843 wikitext text/x-wiki kim0jfa9b77f9wimqdqccobzazl2kr5 2453844 2453843 2026-09-02T11:20:48Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.decommission for hosts db1172.eqiad.wmnet 2453844 wikitext text/x-wiki 7q10741275dboasboe7xbpuvlmblih3 2453847 2453844 2026-09-02T11:23:03Z Stashbot 7414 mvolz@deploy1003: helmfile [staging] START helmfile.d/services/citoid: apply 2453847 wikitext text/x-wiki 3icycj9pi1cw5cibe3et5crqk7c1r3e 2453849 2453847 2026-09-02T11:23:20Z Stashbot 7414 mvolz@deploy1003: helmfile [staging] DONE helmfile.d/services/citoid: apply 2453849 wikitext text/x-wiki lhi5pcmf7hq2wkkmcwtjmk7h8lmyu1f 2453852 2453849 2026-09-02T11:24:46Z Stashbot 7414 mvolz@deploy1003: helmfile [codfw] START helmfile.d/services/citoid: apply 2453852 wikitext text/x-wiki sjeul5iivzd1uffmrm5ougvoyvwc4f5 2453854 2453852 2026-09-02T11:25:14Z Stashbot 7414 mvolz@deploy1003: helmfile [codfw] DONE helmfile.d/services/citoid: apply 2453854 wikitext text/x-wiki l0jn1km5ylgkv1k9e4vdjaemx2tcpnn 2453855 2453854 2026-09-02T11:25:47Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.dns.netbox 2453855 wikitext text/x-wiki 5zqrnc1v818jsi0h4tfk2topr2gener 2453856 2453855 2026-09-02T11:26:10Z Stashbot 7414 mvolz@deploy1003: helmfile [eqiad] START helmfile.d/services/citoid: apply 2453856 wikitext text/x-wiki 93iyh70d0rg5kiajnc6pd6sfzsnwl69 2453857 2453856 2026-09-02T11:26:35Z Stashbot 7414 mvolz@deploy1003: helmfile [eqiad] DONE helmfile.d/services/citoid: apply 2453857 wikitext text/x-wiki f5io7ef7qgorqcbwstcnkod3gvriywh 2453858 2453857 2026-09-02T11:30:45Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db1172.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - marostegui@cumin1003" 2453858 wikitext text/x-wiki gqlmjar6rltbxaloz1r1zoxbfqod0wa 2453859 2453858 2026-09-02T11:31:16Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db1172.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - marostegui@cumin1003" 2453859 wikitext text/x-wiki 7oj55wc42sbl6l3b4n1cqdwqo7d4nf1 2453860 2453859 2026-09-02T11:31:17Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2453860 wikitext text/x-wiki i6oolcrixh68z7vn1iy155qd1nctp6p 2453861 2453860 2026-09-02T11:31:18Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db1172.eqiad.wmnet 2453861 wikitext text/x-wiki s51o1xe0g3xhi0y5qwpl8ba38o7xti8 2453862 2453861 2026-09-02T11:31:34Z Stashbot 7414 marostegui@cumin1003: Removing db1172 from zarcillo T436763 2453862 wikitext text/x-wiki 81u1mzcsaxe8p1yyw2udirqiredur9o 2453863 2453862 2026-09-02T11:31:38Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.decommission (exit_code=0) 2453863 wikitext text/x-wiki rdy0w70poj9f6rsbz9llfogjp9jw3lo 2453870 2453863 2026-09-02T11:51:19Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-serve-eqiad] 'sync' command on namespace 'liftwing-openapi-server' for release 'main' . 2453870 wikitext text/x-wiki dilpsm3kddwv2ebe1lvz8mumqnyqo40 2453871 2453870 2026-09-02T11:51:43Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-serve-codfw] 'sync' command on namespace 'liftwing-openapi-server' for release 'main' . 2453871 wikitext text/x-wiki a84m3veiktapeukyvddwlhgxphav4bb 498 9925 2453575 2453048 2026-09-01T17:43:23Z Stashbot 7414 Southparkfan: revoked Puppet certs for deployment-docker-cxserver02 and deployment-docker-citoid02 - T436619 2453575 wikitext text/x-wiki 6a6wi0hqp6m8j48u1pateksv8jlr2lx 2453578 2453575 2026-09-01T17:47:58Z Stashbot 7414 Southparkfan: switch profile::restbase::citoid_uri and profile::restbase::cxserver_uri to resp. citoid03 and cxserver03, old VMs no longer exist - T436619 2453578 wikitext text/x-wiki b6b4jeiy1ha1omckdah35jrlmdv546q 2453580 2453578 2026-09-01T17:54:09Z Stashbot 7414 Southparkfan: switch webproxy for wikifeeds-beta to deployment-docker-wikifeeds01 - T436462 2453580 wikitext text/x-wiki buevwze0kk86jkas0viza5jfigqcmoe 2453651 2453580 2026-09-01T19:59:21Z Stashbot 7414 Southparkfan: decommission deployment-webperf32 - T436464 2453651 wikitext text/x-wiki rf2qg64kygb85of14j583q12ojn1i7d 2453661 2453651 2026-09-01T20:52:54Z Stashbot 7414 Southparkfan: https://gerrit.wikimedia.org/r/c/operations/puppet/+/1333288 cherry-picked on project puppetserver - T436464 2453661 wikitext text/x-wiki fsdesy6qqez3ux3awyz6zk0hqqo4v44 2453663 2453661 2026-09-01T20:55:24Z Stashbot 7414 Southparkfan: decommission deployment-webperf22 - T436464 2453663 wikitext text/x-wiki 86dxooq71ifajxek21b5cy31ui4vip2 2453671 2453663 2026-09-01T21:45:19Z Stashbot 7414 Southparkfan: hiera: switch ATS routing for performance.beta.wmcloud.org from webperf21 to webperf31 - T436464 2453671 wikitext text/x-wiki mqas2mf25ejtyynl3sq156kkp9n3glu 498 14874 2453538 2196882 2026-09-01T14:52:39Z Stashbot 7414 andrewbogott: shutting down for T435790 2453538 wikitext text/x-wiki sy5kojiqihfje4e6abtrexz2qyobi7c 0 17290 2453520 2453047 2026-09-01T14:36:39Z Stashbot 7414 hashar: integration: deleted Cypress from codehealth job after the job learn to instruct Cypress & Puppeter to no more download binary blobs. `rm -fR /srv/castor/castor-mw-ext-and-skins/master/mwext-codehealth-master-non-voting/Cypress` # T427471 2453520 wikitext text/x-wiki as88zw7eat9wak094v678y9h1tx3z48 2453574 2453520 2026-09-01T17:43:21Z Stashbot 7414 Southparkfan: revoked Puppet certs for deployment-docker-cxserver02 and deployment-docker-citoid02 - T436619 2453574 wikitext text/x-wiki c9srg1c26z1s8popo4as3o24w7yxyau 2453577 2453574 2026-09-01T17:47:56Z Stashbot 7414 Southparkfan: switch profile::restbase::citoid_uri and profile::restbase::cxserver_uri to resp. citoid03 and cxserver03, old VMs no longer exist - T436619 2453577 wikitext text/x-wiki ryb1juknpllwlp6nsn407vab8kfhvh2 2453579 2453577 2026-09-01T17:54:07Z Stashbot 7414 Southparkfan: switch webproxy for wikifeeds-beta to deployment-docker-wikifeeds01 - T436462 2453579 wikitext text/x-wiki noamexnsbe0lpaga2yg10lgmzp9uexi 2453650 2453579 2026-09-01T19:59:19Z Stashbot 7414 Southparkfan: decommission deployment-webperf32 - T436464 2453650 wikitext text/x-wiki 09vtchzw8e7elsu7m6fzho482iel4hl 2453660 2453650 2026-09-01T20:52:52Z Stashbot 7414 Southparkfan: https://gerrit.wikimedia.org/r/c/operations/puppet/+/1333288 cherry-picked on project puppetserver - T436464 2453660 wikitext text/x-wiki h09zgn3amrg4dw4vzbruo29wh8owgzb 2453662 2453660 2026-09-01T20:55:22Z Stashbot 7414 Southparkfan: decommission deployment-webperf22 - T436464 2453662 wikitext text/x-wiki 08a4b75cigrtm6b6h2w6cao4yrb93xo 2453670 2453662 2026-09-01T21:45:16Z Stashbot 7414 Southparkfan: hiera: switch ATS routing for performance.beta.wmcloud.org from webperf21 to webperf31 - T436464 2453670 wikitext text/x-wiki 47ypguix06fsjt8cfycrnc73tiscrks 498 30942 2453429 2453166 2026-09-01T13:54:42Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirtlocal1001.eqiad.wmnet' (T436113) 2453429 wikitext text/x-wiki lft3ath671rkosj607102xcgtp3ja1g 2453445 2453429 2026-09-01T14:00:41Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirtlocal1001.eqiad.wmnet' (T436113) 2453445 wikitext text/x-wiki 4bgod4c0bzuqx7ow29lonju90dd04om 2453446 2453445 2026-09-01T14:00:45Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirtlocal1002.eqiad.wmnet' (T436113) 2453446 wikitext text/x-wiki cp4lrmxefyrmshagob6yqtqfavk9dgx 2453466 2453446 2026-09-01T14:06:43Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirtlocal1002.eqiad.wmnet' (T436113) 2453466 wikitext text/x-wiki q4pra9t7og1fwsn72lpowfpgy3hke3o 2453467 2453466 2026-09-01T14:06:47Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirtlocal1003.eqiad.wmnet' (T436113) 2453467 wikitext text/x-wiki kxzn1k5ua8imm4qj9vlreugqf2j7tjh 2453480 2453467 2026-09-01T14:13:26Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirtlocal1003.eqiad.wmnet' (T436113) 2453480 wikitext text/x-wiki ry58mssji2cqjxx16ijis0xsr9cfkka 2453481 2453480 2026-09-01T14:13:29Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1060.eqiad.wmnet' (T436113) 2453481 wikitext text/x-wiki limpmznuob6l7nbdt5rxbnmd61zdxvo 2453489 2453481 2026-09-01T14:19:25Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1060.eqiad.wmnet' (T436113) 2453489 wikitext text/x-wiki 19fre7g4mqfbs9702bv3vkvtbt9bonk 2453490 2453489 2026-09-01T14:19:30Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack on host 'cloudvirt1061.eqiad.wmnet' (T436113) 2453490 wikitext text/x-wiki j4j36wwx8j31fvjenn9csfts0z5s80g 2453502 2453490 2026-09-01T14:25:11Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.live_upgrade_openstack (exit_code=0) on host 'cloudvirt1061.eqiad.wmnet' (T436113) 2453502 wikitext text/x-wiki 2otk8qvjyzkk9kpmedih8l7odox2thl 2453864 2453502 2026-09-02T11:34:15Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/348 2453864 wikitext text/x-wiki tft7mk58kgavexs3xdkvf8w3t86pv6x 2453865 2453864 2026-09-02T11:34:38Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/348 2453865 wikitext text/x-wiki r8l5nnvyl7nqo2m8qftpr1dd33jxyrg 0 84340 2453690 2452768 2026-09-02T03:53:05Z 엔디지2 59213 2453690 wikitext text/x-wiki cbmgk5d5e68zn0k71bz3sm671xvm0j1 2453702 2453690 2026-09-02T05:57:49Z NDG 39502 Reverted edit by [[Special:Contributions/엔디지2|엔디지2]] ([[User talk:엔디지2|talk]]) to last revision by [[User:BOplaid|BOplaid]] 2452768 wikitext text/x-wiki jefqgras3mujamsfhu832yhdq4vhv3g 498 221642 2453747 2400863 2026-09-02T08:14:55Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Register update-database-wlm2026 Toolforge job, running every 30 minutes 2453747 wikitext text/x-wiki fo8t347fbsiwlg2w0fa0db56yut71ni 12 440881 2453351 2424919 2026-09-01T12:55:26Z FNegri-WMF 32595 /* Container memory limits */ add note about current ~6GB limit 2453351 wikitext text/x-wiki m58hgu5mcx2n40pyuwoyh0dbhjeb9ws 0 441821 2453527 1984768 2026-09-01T14:48:46Z TBurmeister (WMF) 27417 Add category 2453527 wikitext text/x-wiki rvpw6rmeys4zuennrzt7j9wgcf8itfb 0 442288 2453543 2448688 2026-09-01T15:04:26Z TBurmeister (WMF) 27417 Update old doc and outdated templates 2453543 wikitext text/x-wiki hbv96utzdz3cecsfrj7kft0f8zmjt43 0 442598 2453526 2408266 2026-09-01T14:48:21Z TBurmeister (WMF) 27417 Add category 2453526 wikitext text/x-wiki lyi603j8bo0i9kggi6v4pii0qtcldf3 0 443291 2453625 2432968 2026-09-01T19:25:28Z Milimetric 612 /* Things to do at some point during the week */ 2453625 wikitext text/x-wiki 7pezmp1yutbt8q1tjwp4apabbztpbm6 2453869 2453625 2026-09-02T11:44:14Z Milimetric (WMF) 39785 /* Data loss alarms */ 2453869 wikitext text/x-wiki gozffh937f08wo8n94vsk82cwzxvvez 0 443299 2453867 2452678 2026-09-02T11:43:16Z Milimetric (WMF) 39785 Milimetric (WMF) moved page [[Data Platform/Systems/Dealing with data loss alarms]] to [[Data Platform/Systems/Dealing with webrequest data loss]]: monitoring is shifting from email alerts to a dashboard 2452678 wikitext text/x-wiki 1er8iw6hr9dizkey5uktvvcodoa2g91 0 443309 2453541 2201923 2026-09-01T14:56:00Z Milimetric (WMF) 39785 /* Shut off / Reset Icinga alert already fired */ 2453541 wikitext text/x-wiki it6js42scmgsrosaxjfzlat9fh1nidl 0 443404 2453529 2155506 2026-09-01T14:49:12Z TBurmeister (WMF) 27417 Add category 2453529 wikitext text/x-wiki eyc5hoski2bx0srs7yjor8ec98cewin 498 443628 2453564 2451503 2026-09-01T16:27:39Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/33531639211 (https://github.com/cluebotng/component-configs/commits/348098934d025cf69ee0caa7262b0dfd90ad0b14) 2453564 wikitext text/x-wiki noydu0vsiogw3eu93vdoy75wg20p0zp 2453643 2453564 2026-09-01T19:54:15Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/33551856122 (https://github.com/cluebotng/component-configs/commits/0c6ef4655c137d241bf31075ef088ea0dc85c8a3) 2453643 wikitext text/x-wiki hf75jcx0hezem4yofz9lnhxa7wqonn6 10 444620 2453699 2428631 2026-09-02T05:24:35Z JOYANNMACHETEDAUBA 59217 Example.typo.context.content 2453699 wikitext text/x-wiki hh0rm3nn88zv9whae1ycszvnpg5kynu 2453783 2453699 2026-09-02T09:32:11Z Taavi 13997 Reverted edit by [[Special:Contributions/JOYANNMACHETEDAUBA|JOYANNMACHETEDAUBA]] ([[User talk:JOYANNMACHETEDAUBA|talk]]) to last revision by [[User:JJMC89|JJMC89]] 2428631 wikitext text/x-wiki l27pb9t9u4tehx9ijwmaegc6f0sgah5 0 444997 2453531 1907879 2026-09-01T14:50:06Z TBurmeister (WMF) 27417 Add category 2453531 wikitext text/x-wiki n1gecxy4dzmq88julq72jdhvnmew60b 0 446030 2453530 2443334 2026-09-01T14:49:45Z TBurmeister (WMF) 27417 Add category 2453530 wikitext text/x-wiki n27o0piu4sk0k9h7cpzn2owtdvkvdtl 498 446211 2453563 2452971 2026-09-01T16:26:16Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/33531533466 (https://github.com/cluebotng/component-configs/commits/348098934d025cf69ee0caa7262b0dfd90ad0b14) 2453563 wikitext text/x-wiki 9azil28haz7c8a0cajhldgidlspnphr 0 446856 2453539 2253371 2026-09-01T14:53:12Z TBurmeister (WMF) 27417 Add category 2453539 wikitext text/x-wiki 6vrgy2mldbdfaj88qkc40o8zl3w4c9r 0 446978 2453595 2232801 2026-09-01T18:53:00Z ADenisse-WMF 31462 Added new GitLab repo. 2453595 wikitext text/x-wiki mi6yu6m21ahzxnox3ui5sxbz4vgl6eg 2453596 2453595 2026-09-01T18:53:24Z ADenisse-WMF 31462 2453596 wikitext text/x-wiki 70vy2g956h7w4u96opya9fzyisb29go 2453597 2453596 2026-09-01T18:53:51Z ADenisse-WMF 31462 2453597 wikitext text/x-wiki 4jc1qs916u6wpkdbs3k8dcl0igcjy13 0 447017 2453455 2440126 2026-09-01T14:02:45Z APizzata-WMF 47941 2453455 wikitext text/x-wiki 3st1elktw1hjjey4bzpsk77d9uq2olx 0 447187 2453532 1926748 2026-09-01T14:50:26Z TBurmeister (WMF) 27417 Add category 2453532 wikitext text/x-wiki akorarh8ueo4el01uclq9ziz3iqkw7c 0 448254 2453535 1925354 2026-09-01T14:51:54Z TBurmeister (WMF) 27417 Add historical template 2453535 wikitext text/x-wiki 4xsspgyuzfvcm4tcwij1yy5dmcdgtaj 0 449160 2453682 2453100 2026-09-02T00:01:39Z Dexbot 30554 Bot: Updating the report 2453682 wikitext text/x-wiki swm83fdd4e6e0jv4bt3j8t0ptoxchhk 0 450823 2453524 2359401 2026-09-01T14:46:40Z TBurmeister (WMF) 27417 Add category 2453524 wikitext text/x-wiki tk7un43mjk9j5cp0t1r9snc3wod1gru 0 452383 2453566 2441906 2026-09-01T16:41:22Z HNowlan (WMF) 15760 Clarify outdated wording, add expectation of when an SRE goes on call. 2453566 wikitext text/x-wiki bkx3gz361uyduezqu3irztb0pzkwzhh 116 453426 2453689 2452767 2026-09-02T03:31:42Z Phabbanbot 37210 NguoiDongKhongDinhDahn was disabled by JJMC89 2453689 wikitext text/x-wiki 9c31hecn6emwhjr0q87hbhjmwx2gjnv 116 453906 2453599 2453175 2026-09-01T19:03:16Z Gitlabaccountapprovalbot 37332 t-rt15 was rejected. 2453599 wikitext text/x-wiki tp0igq01nioricrs3yqdhuez2ij8zwp 2453654 2453599 2026-09-01T20:15:25Z Gitlabaccountapprovalbot 37332 sinaider2000 was rejected. 2453654 wikitext text/x-wiki 0tedifc8vo5nxgwoh6tww71ozqm89id 0 454105 2453537 2232820 2026-09-01T14:52:13Z TBurmeister (WMF) 27417 Add category 2453537 wikitext text/x-wiki lgy5s18xdsa9au4w9c7bf3me4zy79q5 498 454469 2453510 2379412 2026-09-01T14:31:34Z Stashbot 7414 andrewbogott: shutting down bub2-instance for T435761; still running bullseye 2453510 wikitext text/x-wiki 223t4umhyh3rsqh30k31wshmec1gimq 498 455195 2453522 2195860 2026-09-01T14:42:12Z Stashbot 7414 andrewbogott: shutting down m2c for T435776; still running bullseye 2453522 wikitext text/x-wiki lqbthws3qgcrlsrhojsdf2ns7q0mqjv 0 455928 2453810 2452787 2026-09-02T10:07:49Z Phuedx (WMF) 47850 Minor tweaks. Changed the example as it wasn't generic enough 2453810 wikitext text/x-wiki buu9nrd53yp4du91upmnb00571mnhwf 0 455989 2453542 2452024 2026-09-01T15:02:40Z SFaci-WMF 35637 /* Enrollment override */ 2453542 wikitext text/x-wiki l5lgd21fqdtyi066re4oz061goszpen 2453598 2453542 2026-09-01T18:55:14Z MPopov (WMF) 5891 /* Evaluate */ 2453598 wikitext text/x-wiki fti886yttmhzits7muibo4dy7ezeyrq 0 457898 2453533 2271331 2026-09-01T14:50:45Z TBurmeister (WMF) 27417 Add category 2453533 wikitext text/x-wiki 9v4qyuqvy0ywzg16939by0lwjq7jffi 0 458775 2453586 2429687 2026-09-01T18:25:24Z MPopov (WMF) 5891 Archive notice 2453586 wikitext text/x-wiki rmki28kqpg3eq7y4yvhhdf4xngsbeim 2453588 2453586 2026-09-01T18:26:29Z MPopov (WMF) 5891 MPopov (WMF) moved page [[Test Kitchen/Automated analysis of experiments]] to [[Test Kitchen/Archive/Automated analysis of experiments]]: Archiving page 2453586 wikitext text/x-wiki rmki28kqpg3eq7y4yvhhdf4xngsbeim 0 458776 2453587 2382677 2026-09-01T18:25:29Z MPopov (WMF) 5891 Archive notice 2453587 wikitext text/x-wiki entlds1h2xgxnvijzi6bz1p20h8a0zl 2453590 2453587 2026-09-01T18:26:45Z MPopov (WMF) 5891 MPopov (WMF) moved page [[Test Kitchen/Automated analysis of experiments/Prepared metrics]] to [[Test Kitchen/Archive/Automated analysis of experiments/Prepared metrics]]: Archiving page 2453587 wikitext text/x-wiki entlds1h2xgxnvijzi6bz1p20h8a0zl 498 458787 2453642 2435844 2026-09-01T19:53:52Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/33551856145 (https://github.com/cluebotng/component-configs/commits/0c6ef4655c137d241bf31075ef088ea0dc85c8a3) 2453642 wikitext text/x-wiki kgfo7q5lde0vfmllxuyybezyhi5z5z1 0 458789 2453585 2419921 2026-09-01T18:25:18Z MPopov (WMF) 5891 Archive notice 2453585 wikitext text/x-wiki io7hmjd6ux5gov3net98gk28jfewtff 2453592 2453585 2026-09-01T18:27:01Z MPopov (WMF) 5891 MPopov (WMF) moved page [[Test Kitchen/Measuring clickthrough rates]] to [[Test Kitchen/Archive/Measuring clickthrough rates]]: Archiving page 2453585 wikitext text/x-wiki io7hmjd6ux5gov3net98gk28jfewtff 498 459243 2453565 2433025 2026-09-01T16:27:44Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/33418019250 (https://github.com/cluebotng/component-configs/commits/c689d315eb65ad2cb2f8d0b28293864f7948ce53) 2453565 wikitext text/x-wiki ivj5hxf9tpqtv8p8i8m9vy5jtkrmryb 0 459290 2453420 2451498 2026-09-01T13:47:23Z XCollazo-WMF 31846 2453420 wikitext text/x-wiki 6d9rhsmtkqh5ae0uck2fs4ckvg3488h 2453551 2453420 2026-09-01T15:23:59Z JAllemandou (WMF) 37709 Add 2026-09-01 deployment 2453551 wikitext text/x-wiki dbiam4saret5w7yvabbmgcbp3314cu9 0 459699 2453681 2453169 2026-09-01T23:56:34Z Stashbot 7414 eileen: * civicrm upgraded from 1871f4c7 to f4f09304 2453681 wikitext text/x-wiki a60in7lkpykeykp8pop9ub6fjlo1kwg 0 460018 2453534 2440091 2026-09-01T14:51:09Z TBurmeister (WMF) 27417 Add category 2453534 wikitext text/x-wiki d2wgwtfeufx5fc4xdv9o34u8u0d6va8 0 460424 2453431 2439733 2026-09-01T13:55:57Z DMburugu (WMF) 25135 Add quick references and update owner 2453431 wikitext text/x-wiki ag3s0z8msg79wmn4hppg77bidved85n 2453448 2453431 2026-09-01T14:00:56Z DMburugu (WMF) 25135 Update service summary 2453448 wikitext text/x-wiki 48ctvgvv9bzvlss2k9v0tomphvjiyl4 0 460521 2453426 2451108 2026-09-01T13:51:37Z CGoubert-WMF 32775 2453426 wikitext text/x-wiki 9418swhakqeagzyazgrp1v84u6107cl 0 460571 2453675 2452574 2026-09-01T22:15:50Z AMastilovic-WMF 40067 /* Overview */ 2453675 wikitext text/x-wiki 0h9nxyraqtywmg3e2jsb2mdb2bvpm8p 2453676 2453675 2026-09-01T22:17:11Z AMastilovic-WMF 40067 /* Quick start: add a scheduled job */ 2453676 wikitext text/x-wiki 3lazjz3rlnumknz4epvwgo2wlkacp5e 2453677 2453676 2026-09-01T22:18:17Z AMastilovic-WMF 40067 /* File structure */ 2453677 wikitext text/x-wiki nwf6d6ja6cdy5liqree4f4v7gaec4og 2453678 2453677 2026-09-01T22:19:13Z AMastilovic-WMF 40067 /* Group fields */ 2453678 wikitext text/x-wiki 2fzepanzscgv3trxnjxeioglbh2tg1k 2453679 2453678 2026-09-01T22:20:44Z AMastilovic-WMF 40067 /* Run jobs in order (sequential group) */ 2453679 wikitext text/x-wiki sw28a08x9gmf72tvyc0bcdyl1vwlrh6 2453680 2453679 2026-09-01T22:21:55Z AMastilovic-WMF 40067 /* Troubleshooting */ 2453680 wikitext text/x-wiki 9zq3bix5q8ulreb90a78reh2f8dm8pk 0 460598 2453581 2452995 2026-09-01T17:55:51Z AMastilovic-WMF 40067 Move wiring the domain under layers section 2453581 wikitext text/x-wiki kn4zqy1oox76j417mkgps1dwlyrq7lh 0 460600 2453509 2453015 2026-09-01T14:30:22Z CGoubert-WMF 32775 Assigning SCROLL bearer 2453509 wikitext text/x-wiki h8e7k9zftffmz46ku3rcq3zn7ggleja 2453513 2453509 2026-09-01T14:32:28Z AKhatun (WMF) 50461 2453513 wikitext text/x-wiki 8stzhm2iztnou1m9vsohnd3eq66qayk 2453655 2453513 2026-09-01T20:18:35Z AKhatun (WMF) 50461 2453655 wikitext text/x-wiki 7lrzkzvdrwah2napg1hf0nb7k2ifa8p 0 460602 2453558 2453174 2026-09-01T16:14:34Z TBurmeister (WMF) 27417 TBurmeister (WMF) moved page [[Blazegraph Migration: Example Rewrites of the GAS Service]] to [[Wikidata Query Service/Migration/Rewrite of GAS/Examples]]: Nest this page under the rewrite doc to which it corresponds 2453174 wikitext text/x-wiki tiod9w8ycpu7r7vn9q46yuwpf6opsl7 2453560 2453558 2026-09-01T16:15:23Z TBurmeister (WMF) 27417 Add category 2453560 wikitext text/x-wiki kmkyw9a7m74mq4gtt3ldnguked4wkk1 0 460605 2453331 2026-09-01T12:31:51Z DPogorzelski-WMF 48508 Created page with "'''Chart name''': kserve-llmisvc-resources '''Chart version''': v0.20.0 (WMF chart version 0.1.0) '''Phab task''': {{Phabricator/en|T433973}} '''Reviewers''': dpogorzelski '''Link to repo''': <code>oci://ghcr.io/kserve/charts/kserve-llmisvc-resources</code> '''Link to source code''': https://github.com/kserve/kserve/tree/v0.20.0/charts/kserve-llmisvc-resources '''Topics''': * LLM inference * Model serving * Machine Learning * Gateway API Please note the followin..." 2453331 wikitext text/x-wiki lds8sxrjka0uiwiviwb8behs3fpor6r 3 460606 2453398 2026-09-01T13:20:46Z StrikerBot 8475 Welcome to Toolforge! 2453398 wikitext text/x-wiki caqxzm6x7cwu350nqyunigyomdbz33i 0 460607 2453423 2026-09-01T13:49:42Z DMburugu (WMF) 25135 Initial creation 2453423 wikitext text/x-wiki 3vifbdopmji9bx8a35tlbo30nhy7fnm 2453425 2453423 2026-09-01T13:50:56Z DMburugu (WMF) 25135 2453425 wikitext text/x-wiki 4ssg1r0tqj3i1wp8txl843bb5875tx1 2453428 2453425 2026-09-01T13:54:09Z DMburugu (WMF) 25135 Correct redirect placement 2453428 wikitext text/x-wiki ff35cychg7rc6l7zt1hoo94addt691w 0 460608 2453450 2026-09-01T14:01:51Z APizzata-WMF 47941 Created page with "<mark>To get started, make a copy of this page, named after your service, as a subpage of [[SLO]]. (For example, "SLO/Foobaroid".) Also open the [[SLO/Template_instructions|instructions]], which guide you in more detail through the steps outlined here. Answer the questions in your new copy, removing ''all'' the yellow text, in mark tags, as you go. (Save early and often.)</mark> Status: '''[[SLO/Runbook#Drafting|draft]]''' <mark>(Replace with "approved" when the SLO is..." 2453450 wikitext text/x-wiki c2v9e69iid8s89iqumybv8ad9dm6eay 0 460609 2453559 2026-09-01T16:14:34Z TBurmeister (WMF) 27417 TBurmeister (WMF) moved page [[Blazegraph Migration: Example Rewrites of the GAS Service]] to [[Wikidata Query Service/Migration/Rewrite of GAS/Examples]]: Nest this page under the rewrite doc to which it corresponds 2453559 wikitext text/x-wiki c2zexlz08onxm2gkh2xlcsqoa73v5fv 2 460610 2453583 2026-09-01T18:13:18Z BryanDavis 1604 provider overrides 2453583 wikitext text/x-wiki 5v5f8vqfk5msnmamp9t1htmnyy2bqoq 0 460611 2453589 2026-09-01T18:26:30Z MPopov (WMF) 5891 MPopov (WMF) moved page [[Test Kitchen/Automated analysis of experiments]] to [[Test Kitchen/Archive/Automated analysis of experiments]]: Archiving page 2453589 wikitext text/x-wiki iw5oshcf9tddzuqg135vvhhvg9gn50i 0 460612 2453591 2026-09-01T18:26:45Z MPopov (WMF) 5891 MPopov (WMF) moved page [[Test Kitchen/Automated analysis of experiments/Prepared metrics]] to [[Test Kitchen/Archive/Automated analysis of experiments/Prepared metrics]]: Archiving page 2453591 wikitext text/x-wiki ea3149809diewh4m0ft0plt8xxtgcr2 0 460613 2453593 2026-09-01T18:27:01Z MPopov (WMF) 5891 MPopov (WMF) moved page [[Test Kitchen/Measuring clickthrough rates]] to [[Test Kitchen/Archive/Measuring clickthrough rates]]: Archiving page 2453593 wikitext text/x-wiki aht128xmgvyfei675libpls47s8q94v 0 460614 2453594 2026-09-01T18:28:23Z MPopov (WMF) 5891 Listing all sub-pages 2453594 wikitext text/x-wiki kxx9x0abbwh4seqfa4k3vn6rcnrxs8g 2 460615 2453688 2026-09-02T02:37:26Z AmorEterno21 59212 /* */ 2453688 wikitext text/x-wiki 97z6ryahtdfh8uwwlwda9zx6g05vbtx 0 460616 2453700 2026-09-02T05:30:47Z GLavagetto (WMF) 2905 First draft of the SRE code review cultural norms 2453700 wikitext text/x-wiki hihq8qw8ottj9luvaq3aqqm871ofvw7 2453701 2453700 2026-09-02T05:31:42Z GLavagetto (WMF) 2905 Add underline where missing 2453701 wikitext text/x-wiki ci9cj0h76ykhyeuaqmm8vmg3muqg553 1 460617 2453755 2026-09-02T08:27:49Z MVernon (WMF) 25893 /* When do we need code review? */ new section 2453755 wikitext text/x-wiki bxkwnobm5jirvve7sgz5v4bjwn48pk7 2453757 2453755 2026-09-02T08:36:25Z MVernon (WMF) 25893 /* Pick one reviewer and ping them */ new section 2453757 wikitext text/x-wiki 2mlgo5upjmx5j0jxlkz15qsqfc1kqk6 2453759 2453757 2026-09-02T08:42:40Z MVernon (WMF) 25893 /* Do not comment on a patch without casting a vote */ new section 2453759 wikitext text/x-wiki k3zrtjop19ez6t857smqmbi78ye1h8d 2453763 2453759 2026-09-02T09:00:32Z FFurnari-WMF 36523 /* Another exception for pushing code without review */ new section 2453763 wikitext text/x-wiki 6g12emle4puvaomwkhgrtzu6k9yfh05 3 460618 2453764 2026-09-02T09:06:33Z StrikerBot 8475 Welcome to Toolforge! 2453764 wikitext text/x-wiki 4nh8tzyebnpo6benuw1tvriv93p0xbp 0 460619 2453868 2026-09-02T11:43:16Z Milimetric (WMF) 39785 Milimetric (WMF) moved page [[Data Platform/Systems/Dealing with data loss alarms]] to [[Data Platform/Systems/Dealing with webrequest data loss]]: monitoring is shifting from email alerts to a dashboard 2453868 wikitext text/x-wiki 5bb25q04mazubwqwunu9hab67p1cm6s 2 460620 2453872 2026-09-02T11:54:14Z STrug-WMF 51028 initial 2453872 wikitext text/x-wiki qmtla8vwweg6o3hsa7k90c4ksm7kb7v