Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.19 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 3086 2456477 2455717 2026-09-10T13:57:43Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2456477 wikitext text/x-wiki ohpkrsk4etuoukz1hzuawqwv4mj20u0 2456478 2456477 2026-09-10T14:02:53Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api 2456478 wikitext text/x-wiki flliu746bzjsf73vm1ddlu9boa2rajm 2456481 2456478 2026-09-10T14:06:44Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-cli 2456481 wikitext text/x-wiki 05kxc5f27f4mnaiqiacg5ad9c45p9j2 2456483 2456481 2026-09-10T14:10:04Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-cli 2456483 wikitext text/x-wiki lwsjb3iup6oh6rb7fb0k1x22zboufeo 2456497 2456483 2026-09-10T14:54:04Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component jobs-emailer 2456497 wikitext text/x-wiki 4km8xutmkz4kthm5ld7ck7d2etqtozu 2456508 2456497 2026-09-10T15:14:26Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-emailer 2456508 wikitext text/x-wiki jwz3yetjkoaexy3s8ea4ea9h8bfgsag 2456518 2456508 2026-09-10T15:43:28Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component envvars-admission 2456518 wikitext text/x-wiki 41r90vii2x96qnqx0jjnfa0h0jvku0a 2456520 2456518 2026-09-10T15:54:14Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component envvars-admission 2456520 wikitext text/x-wiki 1ov2k3ryx3v063loevn2ghc9hhuiq5j 2456534 2456520 2026-09-10T16:45:23Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component builds-cli 2456534 wikitext text/x-wiki bw1idstuc4tcfcqn5gq1u0cxzj9grzg 2456538 2456534 2026-09-10T16:49:33Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-cli 2456538 wikitext text/x-wiki foganllbgr9ux7ahqztgsj9qb9c9mip 2456744 2456538 2026-09-11T08:58:02Z Stashbot 7414 tlepage@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-api 2456744 wikitext text/x-wiki qbx4prtpjd4bouawmj9gvkbje4agy4p 2456745 2456744 2026-09-11T09:08:16Z Stashbot 7414 tlepage@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-api 2456745 wikitext text/x-wiki hwld1qydhkjcztp470ze5waaciw75w5 0 4108 2456519 2456184 2026-09-10T15:48:59Z JDrewniak (WMF) 38238 /* Thursday, September 10 */ 2456519 wikitext text/x-wiki 1qh9amt4lffufs0kggqgaxsrstt4ovy 2456547 2456519 2026-09-10T18:10:38Z ScheduleDeploymentBot 37566 Add [[gerrit:1328215]] to Thursday, September 10 UTC late backport window 2456547 wikitext text/x-wiki 344m08hs50zcbo8zv8iaoixrq92y9h5 2456551 2456547 2026-09-10T18:11:18Z ScheduleDeploymentBot 37566 Add [[gerrit:1328215]] to Thursday, September 10 UTC late backport window 2456551 wikitext text/x-wiki h2kxjp4kmpkesee3gwwjg98q0wqx7yp 2456591 2456551 2026-09-10T20:01:37Z ScheduleDeploymentBot 37566 Add [[gerrit:1330446]] to Thursday, September 10 UTC late backport window 2456591 wikitext text/x-wiki rhs52xgk5p8k89u734axdog6kttu34d 2456621 2456591 2026-09-10T21:01:58Z Tgr (WMF) 39134 /* Thursday, September 10 */ 2456621 wikitext text/x-wiki lm2yhpulom19h9hna2fcymlbxsdk1qz 2456690 2456621 2026-09-10T22:44:43Z ScheduleDeploymentBot 37566 Add [[gerrit:1338902]] to Monday, September 14 UTC afternoon backport window 2456690 wikitext text/x-wiki tpufo87g8eatcs7o4p2idb4i5wjp1jm 0 4627 2456660 2399803 2026-09-10T21:54:49Z Southparkfan 1843 2456660 wikitext text/x-wiki m5643zl2bbenifuhbmbk9jyjcejyo0l 498 6726 2456470 2455332 2026-09-10T13:47:47Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2456470 wikitext text/x-wiki m77076tl42suvs0cil7c1m7ftz6ue0t 2456472 2456470 2026-09-10T13:52:17Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api 2456472 wikitext text/x-wiki 7j6e7ni1buojbt0619fus2x57mz8ixl 2456479 2456472 2026-09-10T14:03:33Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-cli 2456479 wikitext text/x-wiki e3mzwozuvleuzw9gr94kka70ak4p3w1 2456480 2456479 2026-09-10T14:06:26Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-cli 2456480 wikitext text/x-wiki 0pt355bgl6jd07gjlmpg49y5tkt93ba 2456490 2456480 2026-09-10T14:31:31Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component jobs-emailer 2456490 wikitext text/x-wiki sjb0tgm7okon10hug4osqgxpfxlfkk5 2456491 2456490 2026-09-10T14:31:33Z Stashbot 7414 dcaro@cloudcumin1001: END (ERROR) - Cookbook wmcs.toolforge.component.deploy (exit_code=97) for component jobs-emailer 2456491 wikitext text/x-wiki oy520jaepqfg21ojf7gu5wmj4zqbt00 2456492 2456491 2026-09-10T14:34:01Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component jobs-emailer 2456492 wikitext text/x-wiki 8u23km3mu27vy0lv8bs3k4fjkeiir7e 2456496 2456492 2026-09-10T14:51:56Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-emailer 2456496 wikitext text/x-wiki n50p40grg8fyw22zro94rexli8v2jvj 2456514 2456496 2026-09-10T15:32:14Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component envvars-admission 2456514 wikitext text/x-wiki r2l02hw6zb0w0pqq2dthn44hdgn36mo 2456517 2456514 2026-09-10T15:42:26Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component envvars-admission 2456517 wikitext text/x-wiki mocunvoeorqgl4fr3kc0uc2yhv8y787 2456532 2456517 2026-09-10T16:43:29Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component builds-cli 2456532 wikitext text/x-wiki quizap4cs71fdzy3ydsou57qnw686hk 2456533 2456532 2026-09-10T16:45:05Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-cli 2456533 wikitext text/x-wiki skv003aud8bu85j97xol3h1gt5yegyn 2456742 2456533 2026-09-11T08:46:53Z Stashbot 7414 tlepage@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-api 2456742 wikitext text/x-wiki plqwzj24q6uhecs4bctgm97bazzikru 2456743 2456742 2026-09-11T08:57:27Z Stashbot 7414 tlepage@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-api 2456743 wikitext text/x-wiki 7q4hvlt6rkokayp2xlh2tz66rrqsgeh 0 6919 2456537 2453616 2026-09-10T16:48:15Z Nintendofan885 17301 no longer serves thumbnails (needs an update) 2456537 wikitext text/x-wiki mwz6eqt7zds4juwvsskdlv3q5cxp6wp 0 7269 2456588 2132782 2026-09-10T19:47:59Z WhatamIdoing 8096 /* Cabling options */ Deprecated = discouraged; deprec-i-ated = something the accountants do with old assets 2456588 wikitext text/x-wiki eboh4o5zjgu1xr6ixw3ez66j5aqoo74 0 7919 2456454 2456453 2026-09-10T12:01:11Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dse-k8s-worker2005.codfw.wmnet 2456454 wikitext text/x-wiki davfj71q3y4h5k0o7jyz8djy1zt8w2k 2456455 2456454 2026-09-10T12:05:35Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on clouddb1025.eqiad.wmnet with reason: Cloning x4 2456455 wikitext text/x-wiki qf9l3phzuhj2mz37ab2r7va3oe055d4 2456458 2456455 2026-09-10T12:33:03Z Stashbot 7414 dbrant@deploy1003: helmfile [staging] START helmfile.d/services/wikifeeds: apply 2456458 wikitext text/x-wiki 0f8ciocmfyi93caot739rphno2d5yu7 2456459 2456458 2026-09-10T12:33:48Z Stashbot 7414 dbrant@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifeeds: apply 2456459 wikitext text/x-wiki q3x2a9l2ku8kmaoh6iu0zronddw0z3n 2456460 2456459 2026-09-10T12:34:15Z Stashbot 7414 dbrant@deploy1003: helmfile [eqiad] START helmfile.d/services/wikifeeds: apply 2456460 wikitext text/x-wiki 7azwjzteo9zxiruaub9pjwqzgihzuou 2456461 2456460 2026-09-10T12:34:42Z Stashbot 7414 dbrant@deploy1003: helmfile [eqiad] DONE helmfile.d/services/wikifeeds: apply 2456461 wikitext text/x-wiki soz7n6sfns5x16o6hn3dmtcu0dg7qhi 2456462 2456461 2026-09-10T12:35:26Z Stashbot 7414 dbrant@deploy1003: helmfile [codfw] START helmfile.d/services/wikifeeds: apply 2456462 wikitext text/x-wiki 5fq89liogjqwh7qys8yfrsddehq5x90 2456463 2456462 2026-09-10T12:35:54Z Stashbot 7414 dbrant@deploy1003: helmfile [codfw] DONE helmfile.d/services/wikifeeds: apply 2456463 wikitext text/x-wiki 56uv76sxeku1bt8njesd6h52pbiv278 2456464 2456463 2026-09-10T12:46:45Z Stashbot 7414 klausman@dns1004: START - running authdns-update 2456464 wikitext text/x-wiki chx1f1u386emh8tkhj31hi381y4k0wf 2456465 2456464 2026-09-10T12:48:57Z Stashbot 7414 klausman@dns1004: END - running authdns-update 2456465 wikitext text/x-wiki jyb1h4hxs5t0yv25t352da5drhyfrt8 2456466 2456465 2026-09-10T13:37:05Z Stashbot 7414 jelto@cumin1003: START - Cookbook sre.loadbalancer.migrate-service-ipip for alias: wikikube-worker-codfw@codfw 2456466 wikitext text/x-wiki f7f1qeahbm3al4vl691erq2jx0gapua 2456467 2456466 2026-09-10T13:41:03Z Stashbot 7414 jelto@cumin1003: START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on (A:lvs-low-traffic-codfw or A:lvs-secondary-codfw) and A:bullseye and A:lvs 2456467 wikitext text/x-wiki g68zg3dsgohb2hg4gaxojv6g40wiy5o 2456468 2456467 2026-09-10T13:41:59Z Stashbot 7414 jelto@cumin1003: END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on (A:lvs-low-traffic-codfw or A:lvs-secondary-codfw) and A:bullseye and A:lvs 2456468 wikitext text/x-wiki 2e8cf83iwhkrjtf8dbb33cm3g2rqmk9 2456469 2456468 2026-09-10T13:42:00Z Stashbot 7414 jelto@cumin1003: END (PASS) - Cookbook sre.loadbalancer.migrate-service-ipip (exit_code=0) for alias: wikikube-worker-codfw@codfw 2456469 wikitext text/x-wiki e4bh31gwqfodb3xxjf12pa968wf1ql6 2456471 2456469 2026-09-10T13:51:37Z Stashbot 7414 jelto@cumin1003: START - Cookbook sre.loadbalancer.migrate-service-ipip for alias: wikikube-worker-eqiad@eqiad 2456471 wikitext text/x-wiki nnc4ex27z7o4a0q10j9fr38rgxwa897 2456473 2456471 2026-09-10T13:55:18Z Stashbot 7414 jelto@cumin1003: START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on (A:lvs-low-traffic-eqiad or A:lvs-secondary-eqiad) and A:bullseye and A:lvs 2456473 wikitext text/x-wiki 5huqxua4q8zjvts2zkbvu6o7ihexoe5 2456474 2456473 2026-09-10T13:56:33Z Stashbot 7414 jelto@cumin1003: END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on (A:lvs-low-traffic-eqiad or A:lvs-secondary-eqiad) and A:bullseye and A:lvs 2456474 wikitext text/x-wiki tcnqjn3azmwxjuyzcasbq0vsyowhsmn 2456475 2456474 2026-09-10T13:56:34Z Stashbot 7414 jelto@cumin1003: END (PASS) - Cookbook sre.loadbalancer.migrate-service-ipip (exit_code=0) for alias: wikikube-worker-eqiad@eqiad 2456475 wikitext text/x-wiki 87hw9zw4k3n9c68bdsbm983evtrc4aj 2456476 2456475 2026-09-10T13:57:24Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.reimage for host clouddumps1001.wikimedia.org with OS bookworm 2456476 wikitext text/x-wiki 77dx69ow7jqzldi1tjpdj53dztsmst6 2456482 2456476 2026-09-10T14:07:35Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.presto.roll-restart-workers for Presto an-presto cluster: Roll restart of all Presto's jvm daemons. 2456482 wikitext text/x-wiki qsrotmh6spneetcbec7uzrji8a8yvxk 2456484 2456482 2026-09-10T14:13:41Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on clouddumps1001.wikimedia.org with reason: host reimage 2456484 wikitext text/x-wiki 0t9ume6c7i7wphnlsxa0kxiivdk89wy 2456485 2456484 2026-09-10T14:17:56Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on clouddumps1001.wikimedia.org with reason: host reimage 2456485 wikitext text/x-wiki bs0ncpc1arbc0b0ahqad39fjifvr11a 2456486 2456485 2026-09-10T14:20:10Z Stashbot 7414 cdanis@cumin1004: START - Cookbook sre.deploy.hiddenparma Hiddenparma deployment to the alerting hosts with reason: "etcd fanout fix & details UX - cdanis@cumin1004" 2456486 wikitext text/x-wiki 8iusf2p99vtfu3gajtl9cqlaxf70ezl 2456487 2456486 2026-09-10T14:20:12Z Stashbot 7414 cdanis@cumin1004: START - Cookbook sre.deploy.python-code hiddenparma to alert[1002,2002].wikimedia.org with reason: etcd fanout fix & details UX - cdanis@cumin1004 2456487 wikitext text/x-wiki 43gvd5swuwmnhs5uucr8kp7oz7e6glx 2456488 2456487 2026-09-10T14:21:02Z Stashbot 7414 cdanis@cumin1004: END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) hiddenparma to alert[1002,2002].wikimedia.org with reason: etcd fanout fix & details UX - cdanis@cumin1004 2456488 wikitext text/x-wiki 9jejhflsss81x61tfd9w5jy7mej4msl 2456489 2456488 2026-09-10T14:21:04Z Stashbot 7414 cdanis@cumin1004: END (PASS) - Cookbook sre.deploy.hiddenparma (exit_code=0) Hiddenparma deployment to the alerting hosts with reason: "etcd fanout fix & details UX - cdanis@cumin1004" 2456489 wikitext text/x-wiki 9uuw85sezb4qpnq68ubexbdoic00ilo 2456494 2456489 2026-09-10T14:40:16Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.presto.roll-restart-workers (exit_code=0) for Presto an-presto cluster: Roll restart of all Presto's jvm daemons. 2456494 wikitext text/x-wiki etyzboy8afys7rvooolnse27ppnjyt1 2456498 2456494 2026-09-10T14:56:19Z Stashbot 7414 samtar@deploy1003: Started scap sync-world: Backport for [[gerrit:1335032|IS: enable wgEnableWatchstarPopover on test.wikipedia (T436955)]] 2456498 wikitext text/x-wiki mh1npt3o35dw88erj1quv65v46z961i 2456499 2456498 2026-09-10T14:58:46Z Stashbot 7414 samtar@deploy1003: samtar: Backport for [[gerrit:1335032|IS: enable wgEnableWatchstarPopover on test.wikipedia (T436955)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2456499 wikitext text/x-wiki k0zxfucrzlo6xpe3edxjxi28nfjoed6 2456500 2456499 2026-09-10T14:59:46Z Stashbot 7414 samtar@deploy1003: samtar: Continuing with deployment 2456500 wikitext text/x-wiki bx4mi14ycyzg73xyvvv5r3mhgwzi48o 2456501 2456500 2026-09-10T15:02:27Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host clouddumps1001.wikimedia.org with OS bookworm 2456501 wikitext text/x-wiki fqr1bjgxx6e0oipqsrjac837ro6nh5p 2456503 2456501 2026-09-10T15:04:27Z Stashbot 7414 samtar@deploy1003: Finished scap sync-world: Backport for [[gerrit:1335032|IS: enable wgEnableWatchstarPopover on test.wikipedia (T436955)]] (duration: 08m 08s) 2456503 wikitext text/x-wiki hwxanmdyzlmowiq3ghau3e5owv984iv 2456515 2456503 2026-09-10T15:33:15Z Stashbot 7414 marostegui@cumin1003: conftool action : set/pooled=no; selector: name=clouddb1025.eqiad.wmnet,service=s4 2456515 wikitext text/x-wiki rp5vmvjv3xtv73rb4gjxlxzlboghmgj 2456525 2456515 2026-09-10T16:28:47Z Stashbot 7414 urbanecm@deploy1003: Started scap sync-world: Backport for [[gerrit:1338984|refactor: Provider: Add IConfigurationProvider::invalidateCache() (T437588)]], [[gerrit:1338990|Provider: Cache the valid configuration in the process (T437588)]], [[gerrit:1338983|refactor: Provider: Add IConfigurationProvider::invalidateCache() (T437588)]], [[gerrit:1338986|Provider: Cache the valid configuration in the process (T437588)]] 2456525 wikitext text/x-wiki l9smwrmftzsztaisenkcqqs2qcx4idh 2456526 2456525 2026-09-10T16:33:12Z Stashbot 7414 urbanecm@deploy1003: urbanecm: Backport for [[gerrit:1338984|refactor: Provider: Add IConfigurationProvider::invalidateCache() (T437588)]], [[gerrit:1338990|Provider: Cache the valid configuration in the process (T437588)]], [[gerrit:1338983|refactor: Provider: Add IConfigurationProvider::invalidateCache() (T437588)]], [[gerrit:1338986|Provider: Cache the valid configuration in the process (T437588)]] synced to the te 2456526 wikitext text/x-wiki fub1h6jkviu7ncyh9jhgehcq2b84qya 2456527 2456526 2026-09-10T16:35:44Z Stashbot 7414 urbanecm@deploy1003: urbanecm: Continuing with deployment 2456527 wikitext text/x-wiki 25ippvx129mwsslyq1fzim63cp32oum 2456530 2456527 2026-09-10T16:40:15Z Stashbot 7414 urbanecm@deploy1003: Finished scap sync-world: Backport for [[gerrit:1338984|refactor: Provider: Add IConfigurationProvider::invalidateCache() (T437588)]], [[gerrit:1338990|Provider: Cache the valid configuration in the process (T437588)]], [[gerrit:1338983|refactor: Provider: Add IConfigurationProvider::invalidateCache() (T437588)]], [[gerrit:1338986|Provider: Cache the valid configuration in the process (T437588)]] 2456530 wikitext text/x-wiki abz6skshfwj6km93eshdbp8qgh25a8d 2456543 2456530 2026-09-10T18:06:43Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/mediawiki-dumps-legacy: apply 2456543 wikitext text/x-wiki efb4c2ylcta0clnx2flwov61uk114lc 2456545 2456543 2026-09-10T18:08:52Z Stashbot 7414 dbrant@deploy1003: helmfile [staging] START helmfile.d/services/wikifeeds: apply 2456545 wikitext text/x-wiki 53v53krkvwgvmm2er98l5prl2io41hb 2456546 2456545 2026-09-10T18:09:14Z Stashbot 7414 dbrant@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifeeds: apply 2456546 wikitext text/x-wiki 3vl7kk9svf7iscizfor9mz6dummmcp5 2456548 2456546 2026-09-10T18:10:53Z Stashbot 7414 dzahn@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on gerrit1003.wikimedia.org with reason: maintenance upgrade 2456548 wikitext text/x-wiki qirax9pq4bwvre2a70azxam0b4taq5l 2456549 2456548 2026-09-10T18:11:05Z Stashbot 7414 dbrant@deploy1003: helmfile [eqiad] START helmfile.d/services/wikifeeds: apply 2456549 wikitext text/x-wiki izb1plqqtkiqkxktdqwqjikp4okbvdv 2456550 2456549 2026-09-10T18:11:13Z Stashbot 7414 dancy@deploy1003: rebuilt and synchronized wikiversions files: group2 to 1.47.0-wmf.19 refs T430838 2456550 wikitext text/x-wiki 22xs1bwskj9h5ruzzelr5em7od8a511 2456552 2456550 2026-09-10T18:11:28Z Stashbot 7414 dzahn@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on gerrit2002.wikimedia.org with reason: maintenance upgrade 2456552 wikitext text/x-wiki hpke1z14bp72i6p6wjbw0np5nt8cz64 2456553 2456552 2026-09-10T18:11:31Z Stashbot 7414 dbrant@deploy1003: helmfile [eqiad] DONE helmfile.d/services/wikifeeds: apply 2456553 wikitext text/x-wiki dxaig8xho885grucdlavf7gtpy027lx 2456554 2456553 2026-09-10T18:12:02Z Stashbot 7414 dbrant@deploy1003: helmfile [codfw] START helmfile.d/services/wikifeeds: apply 2456554 wikitext text/x-wiki iwoq764nuaya9ad4ge4jebmjwa5r1xs 2456555 2456554 2026-09-10T18:13:01Z Stashbot 7414 dbrant@deploy1003: helmfile [codfw] DONE helmfile.d/services/wikifeeds: apply 2456555 wikitext text/x-wiki pxdg8vthqukf1ykl6psqpt0mn637el0 2456556 2456555 2026-09-10T18:13:09Z Stashbot 7414 otto@deploy1003: Started deploy [analytics/refinery@92b5c04] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@92b5c04e] 2456556 wikitext text/x-wiki i0hm75o7dzxqekas0l1vi3dx8i7iccz 2456557 2456556 2026-09-10T18:13:48Z Stashbot 7414 otto@deploy1003: Finished deploy [analytics/refinery@92b5c04] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@92b5c04e] (duration: 00m 39s) 2456557 wikitext text/x-wiki biqlmidwz0nbm4nvsar9myebpo8oaau 2456558 2456557 2026-09-10T18:14:29Z Stashbot 7414 otto@deploy1003: Started deploy [analytics/refinery@92b5c04]: Regular analytics weekly train [analytics/refinery@92b5c04e] 2456558 wikitext text/x-wiki bm29rflp187z1wu2wrps7e2l6p00pc9 2456559 2456558 2026-09-10T18:14:37Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/mediawiki-dumps-legacy: apply 2456559 wikitext text/x-wiki d9kjpixx2hq61sl2j67tu0hql6lghnz 2456560 2456559 2026-09-10T18:19:43Z Stashbot 7414 otto@deploy1003: Finished deploy [analytics/refinery@92b5c04]: Regular analytics weekly train [analytics/refinery@92b5c04e] (duration: 05m 13s) 2456560 wikitext text/x-wiki jvpq29i46encgbg4lbfb3lzfaz9crug 2456561 2456560 2026-09-10T18:20:37Z Stashbot 7414 otto@deploy1003: Started deploy [analytics/refinery@92b5c04] (thin): Regular analytics weekly train THIN [analytics/refinery@92b5c04e] 2456561 wikitext text/x-wiki 2bn6np75y2sb5z769xmqzarupnz2cfl 2456562 2456561 2026-09-10T18:21:37Z Stashbot 7414 otto@deploy1003: Finished deploy [analytics/refinery@92b5c04] (thin): Regular analytics weekly train THIN [analytics/refinery@92b5c04e] (duration: 00m 59s) 2456562 wikitext text/x-wiki d8nd6ggclm2n3aanuxquele0epqgwme 2456566 2456562 2026-09-10T19:04:44Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hadoop.roll-restart-workers restart workers for Hadoop test cluster: Roll restart of jvm daemons for openjdk upgrade. 2456566 wikitext text/x-wiki pghhg04tla4c4y9qod9ekd76xmad0ta 2456567 2456566 2026-09-10T19:16:22Z Stashbot 7414 dzahn@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on gerrit2003.wikimedia.org with reason: maintenance upgrade 2456567 wikitext text/x-wiki 2axobihvf4uuhek5h9wgotjz6xs4alp 2456568 2456567 2026-09-10T19:17:04Z Stashbot 7414 dzahn@cumin1003: DONE (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 0:30:00 on gerrit.wikimedia.org with reason: maintenance upgrade 2456568 wikitext text/x-wiki 4j2v7d2husfuu460xs129kcnglr622u 2456569 2456568 2026-09-10T19:17:07Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hadoop.roll-restart-workers (exit_code=0) restart workers for Hadoop test cluster: Roll restart of jvm daemons for openjdk upgrade. 2456569 wikitext text/x-wiki oy436u53tzvzjsuikn59x03efdl0ttd 2456570 2456569 2026-09-10T19:17:48Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hadoop.roll-restart-workers restart workers for Hadoop analytics cluster: Roll restart of jvm daemons for openjdk upgrade. 2456570 wikitext text/x-wiki nvk5fbd1pc11oa7tg8glbkgn9wq4p4k 2456571 2456570 2026-09-10T19:17:57Z Stashbot 7414 thcipriani: Gerrit downtime incoming for upgrade 2456571 wikitext text/x-wiki ohmgd4b3q5v3d3zau3wya6xwrlwvepe 2456572 2456571 2026-09-10T19:21:15Z Stashbot 7414 bking@cumin2003: END (FAIL) - Cookbook sre.hadoop.roll-restart-workers (exit_code=99) restart workers for Hadoop analytics cluster: Roll restart of jvm daemons for openjdk upgrade. 2456572 wikitext text/x-wiki kyi8teio9ugmbe9l8n27vi0ihj3bddu 2456574 2456572 2026-09-10T19:32:19Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker1346.eqiad.wmnet 2456574 wikitext text/x-wiki r5fx5w7d3abn7f0un8ii7n4ypvr7k12 2456575 2456574 2026-09-10T19:32:23Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1346.eqiad.wmnet 2456575 wikitext text/x-wiki gcvubenhcsqnf5p3ecgkgarpw0yuui0 2456576 2456575 2026-09-10T19:32:58Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1346.eqiad.wmnet 2456576 wikitext text/x-wiki b4k8ou0viojy2md443wis7rfm677g7f 2456577 2456576 2026-09-10T19:33:14Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.hosts.reimage for host wikikube-worker1346.eqiad.wmnet with OS trixie 2456577 wikitext text/x-wiki 8g0gwau0xcwo5qj60gjfvmi1rgdkv53 2456578 2456577 2026-09-10T19:33:33Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.hosts.move-vlan for host wikikube-worker1346 2456578 wikitext text/x-wiki i2y45fkyxiocfe92kn1wu7toopiqobm 2456579 2456578 2026-09-10T19:33:53Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.dns.netbox 2456579 wikitext text/x-wiki qegemrrrwtoskecpksi1tjbahj48ukh 2456580 2456579 2026-09-10T19:38:00Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1346 - rzl@cumin2003" 2456580 wikitext text/x-wiki s55ouabcha0bxf5mrh86d4ievhavldu 2456581 2456580 2026-09-10T19:38:04Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1346 - rzl@cumin2003" 2456581 wikitext text/x-wiki rubw4h9521f6c76x87pgoxzcj60xyaf 2456582 2456581 2026-09-10T19:38:05Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2456582 wikitext text/x-wiki d7oe096uwnmv4ghx3c1bg99ub6souua 2456583 2456582 2026-09-10T19:38:06Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.dns.wipe-cache wikikube-worker1346.eqiad.wmnet 196.48.64.10.in-addr.arpa 6.9.1.0.8.4.0.0.4.6.0.0.0.1.0.0.7.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2456583 wikitext text/x-wiki o6vps4avzeonidg12e5iw7g588agpbw 2456584 2456583 2026-09-10T19:38:08Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker1346.eqiad.wmnet 196.48.64.10.in-addr.arpa 6.9.1.0.8.4.0.0.4.6.0.0.0.1.0.0.7.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2456584 wikitext text/x-wiki q9t2gk2p18zxenr3bw66lkve2jcjk73 2456585 2456584 2026-09-10T19:38:09Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1346 2456585 wikitext text/x-wiki bgs6yzgd4nqyt6h3sp6aedsexhudwi7 2456586 2456585 2026-09-10T19:38:36Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1346 2456586 wikitext text/x-wiki 3w2y5srh5f9gt3xoh0b0xl3ocuo238k 2456587 2456586 2026-09-10T19:38:37Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1346 2456587 wikitext text/x-wiki ri9m8f281gkxgg5v8tgnjk4glb1grzl 2456589 2456587 2026-09-10T19:50:41Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1346.eqiad.wmnet with reason: host reimage 2456589 wikitext text/x-wiki kx9z33cdsihl0hohijpplr7zblc77d7 2456590 2456589 2026-09-10T19:53:44Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1346.eqiad.wmnet with reason: host reimage 2456590 wikitext text/x-wiki 0eo9pe6v58i9qvmib3phsar9lbned04 2456592 2456590 2026-09-10T20:01:48Z Stashbot 7414 eevans@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on sessionstore2005.codfw.wmnet with reason: Firmware upgrades — T437516 2456592 wikitext text/x-wiki cqw2m4dbqz9c63zas2w6i1aasyoribd 2456593 2456592 2026-09-10T20:02:18Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts sessionstore2005.codfw.wmnet 2456593 wikitext text/x-wiki e9pndjhxkq1msnrnm2zvozsp5mkth4c 2456594 2456593 2026-09-10T20:05:50Z Stashbot 7414 jdrewniak@deploy1003: Started scap sync-world: Backport for [[gerrit:1338975|Bumping portals to master (T128546)]] 2456594 wikitext text/x-wiki 71zjj4qcrbuwvrzot7pznak1lzyv80u 2456595 2456594 2026-09-10T20:07:04Z Stashbot 7414 jdrewniak@deploy1003: sync-world failed: <CalledProcessError> Command 'sudo -u mwbuilder /srv/mwbuilder/release/make-container-image/build-images.py --http-proxy http://webproxy:8080 --https-proxy http://webproxy:8080 /srv/mediawiki-staging/scap/image-build --staging-dir /srv/mediawiki-staging --mediawiki-versions 1.47.0-wmf.18,1.47.0-wmf.19,next --multiversion-image-basename docker-registry.discovery.wmnet/restricted 2456595 wikitext text/x-wiki 5mr4vxjfe99a1d3j89jst74xb5ipn4z 2456596 2456595 2026-09-10T20:11:01Z Stashbot 7414 jdrewniak@deploy1003: Started scap sync-world: Backport for [[gerrit:1338975|Bumping portals to master (T128546)]] 2456596 wikitext text/x-wiki 6rag6d4b0swju1vm3iz18vbtmzb1i2d 2456597 2456596 2026-09-10T20:12:59Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1346.eqiad.wmnet with OS trixie 2456597 wikitext text/x-wiki tm6dutue4zhx7ogyud6yvj3h0xa2pct 2456598 2456597 2026-09-10T20:14:51Z Stashbot 7414 jdrewniak@deploy1003: jdrewniak: Backport for [[gerrit:1338975|Bumping portals to master (T128546)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2456598 wikitext text/x-wiki g24x688flrz36k7g5ra4bx0ddgb58a8 2456599 2456598 2026-09-10T20:15:14Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hosts.reboot-single for host sessionstore2005.codfw.wmnet 2456599 wikitext text/x-wiki 0j8f4ulqyqpe2jd0xeli28reiwhdm7x 2456600 2456599 2026-09-10T20:17:54Z Stashbot 7414 jdrewniak@deploy1003: jdrewniak: Continuing with deployment 2456600 wikitext text/x-wiki 8l4of4b6vjht9n52jnsmp4lsrd700os 2456601 2456600 2026-09-10T20:22:25Z Stashbot 7414 jdrewniak@deploy1003: Finished scap sync-world: Backport for [[gerrit:1338975|Bumping portals to master (T128546)]] (duration: 11m 24s) 2456601 wikitext text/x-wiki jyw6761e1rfvqb6y3gubz04dooh3ykq 2456602 2456601 2026-09-10T20:24:54Z Stashbot 7414 ssastry@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2456602 wikitext text/x-wiki ib9y4uuks0nytnvjyddlh1n3lmxhvf1 2456603 2456602 2026-09-10T20:25:33Z Stashbot 7414 ssastry@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2456603 wikitext text/x-wiki 149jze1hqy2kozxn3mji251bl7thqtp 2456604 2456603 2026-09-10T20:25:34Z Stashbot 7414 ssastry@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2456604 wikitext text/x-wiki axmwcubmcnpir56t92ogo4m2dmcwb9g 2456605 2456604 2026-09-10T20:26:11Z Stashbot 7414 ssastry@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2456605 wikitext text/x-wiki b85edkr7smf2lzf3szzg4tl34m92nh2 2456606 2456605 2026-09-10T20:27:09Z Stashbot 7414 eevans@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sessionstore2005.codfw.wmnet 2456606 wikitext text/x-wiki 8h2xidwtlib6acz3yn2q51rgkmq4cov 2456607 2456606 2026-09-10T20:27:11Z Stashbot 7414 eevans@cumin1003: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts sessionstore2005.codfw.wmnet 2456607 wikitext text/x-wiki 2r2i55eeu5w7kkat4hzea9ldh3qcfhb 2456608 2456607 2026-09-10T20:27:51Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hosts.provision for host sessionstore2005.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2456608 wikitext text/x-wiki dsmj3mgqfc7ficyvjduyj8c2g0766oq 2456609 2456608 2026-09-10T20:28:23Z Stashbot 7414 jdrewniak@deploy1003: Started scap sync-world: Backport for [[gerrit:1328215|Remove mode from RestModuleOverrides (T434267)]] 2456609 wikitext text/x-wiki cq9is0phmr8lissgpyixio08y8yzrnv 2456610 2456609 2026-09-10T20:28:30Z Stashbot 7414 eevans@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sessionstore2005.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2456610 wikitext text/x-wiki omztaja4cdm4sgm9f8ifhw3hn9guc9n 2456611 2456610 2026-09-10T20:30:57Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hosts.reimage for host sessionstore2005.codfw.wmnet with OS bookworm 2456611 wikitext text/x-wiki ltmp92bphwymvjefaknqszl9xangwvp 2456612 2456611 2026-09-10T20:32:45Z Stashbot 7414 jdrewniak@deploy1003: jdrewniak, milazg: Backport for [[gerrit:1328215|Remove mode from RestModuleOverrides (T434267)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2456612 wikitext text/x-wiki 6mtr8dqa91yty9osvwdih6mhajwvq04 2456613 2456612 2026-09-10T20:34:55Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1346.eqiad.wmnet 2456613 wikitext text/x-wiki e69cihjq8j90rey38b27am79xv38cn5 2456614 2456613 2026-09-10T20:34:57Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1346.eqiad.wmnet 2456614 wikitext text/x-wiki ou1zzqp8unny4xzq17079ubdygzjoo8 2456615 2456614 2026-09-10T20:35:00Z Stashbot 7414 rzl@cumin2003: END (FAIL) - Cookbook sre.k8s.renumber-node (exit_code=1) Renumbering for host wikikube-worker1346.eqiad.wmnet 2456615 wikitext text/x-wiki r9nayp1cekaxhji0jxyt58fqqnbbc26 2456616 2456615 2026-09-10T20:47:39Z Stashbot 7414 jdrewniak@deploy1003: jdrewniak, milazg: Continuing with deployment 2456616 wikitext text/x-wiki ey59muk5ujvb1mmmgn91mbdtfjdo7so 2456617 2456616 2026-09-10T20:51:25Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on sessionstore2005.codfw.wmnet with reason: host reimage 2456617 wikitext text/x-wiki lyjfgz00y6hbkggk8ehx30w3uits5lp 2456618 2456617 2026-09-10T20:52:13Z Stashbot 7414 jdrewniak@deploy1003: Finished scap sync-world: Backport for [[gerrit:1328215|Remove mode from RestModuleOverrides (T434267)]] (duration: 23m 49s) 2456618 wikitext text/x-wiki dobz1gltzl4t7dd7sy3t6xpade0rd6z 2456620 2456618 2026-09-10T20:54:58Z Stashbot 7414 eevans@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sessionstore2005.codfw.wmnet with reason: host reimage 2456620 wikitext text/x-wiki pnczws2aaape7r5rbc4lmxyk9acqgph 2456622 2456620 2026-09-10T21:03:18Z Stashbot 7414 jdlrobson@deploy1003: Started scap sync-world: Backport for [[gerrit:1339076|Instrument donor ID dialog: hooks defined (T435565)]], [[gerrit:1339075|Instrument the donor account dialog (T435565)]], [[gerrit:1338301|DonorIdentification: Adjust experiment behavior (T435534)]], [[gerrit:1338287|Allow donor consent workflow to work on non-Minerva skins (T436572)]] 2456622 wikitext text/x-wiki rm3x8q7rz752pae5qolht19rgavmj51 2456623 2456622 2026-09-10T21:07:38Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Backport for [[gerrit:1339076|Instrument donor ID dialog: hooks defined (T435565)]], [[gerrit:1339075|Instrument the donor account dialog (T435565)]], [[gerrit:1338301|DonorIdentification: Adjust experiment behavior (T435534)]], [[gerrit:1338287|Allow donor consent workflow to work on non-Minerva skins (T436572)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdeb 2456623 wikitext text/x-wiki otbjlq5k5hlg0vxbqyb8wrr8lsuikaj 2456626 2456623 2026-09-10T21:12:25Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Continuing with deployment 2456626 wikitext text/x-wiki kfh4uxnbsy3ygdfrvxtu0iactzqbxyv 2456627 2456626 2026-09-10T21:14:44Z Stashbot 7414 eevans@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sessionstore2005.codfw.wmnet with OS bookworm 2456627 wikitext text/x-wiki axa4f4oeea0i8xqdxng8ls22l862a8h 2456628 2456627 2026-09-10T21:17:11Z Stashbot 7414 jdlrobson@deploy1003: Finished scap sync-world: Backport for [[gerrit:1339076|Instrument donor ID dialog: hooks defined (T435565)]], [[gerrit:1339075|Instrument the donor account dialog (T435565)]], [[gerrit:1338301|DonorIdentification: Adjust experiment behavior (T435534)]], [[gerrit:1338287|Allow donor consent workflow to work on non-Minerva skins (T436572)]] (duration: 13m 54s) 2456628 wikitext text/x-wiki 4pl2i135bgkchmic04cyxwxzpisy616 2456629 2456628 2026-09-10T21:19:19Z Stashbot 7414 eevans@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on sessionstore2006.codfw.wmnet with reason: Firmware upgrades — T437516 2456629 wikitext text/x-wiki sj2x4okq2b137iuzbyug1vo5pr9q339 2456630 2456629 2026-09-10T21:19:37Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts sessionstore2006.codfw.wmnet 2456630 wikitext text/x-wiki 7wy755skfxjqyi87jld7xz0jexjipdy 2456631 2456630 2026-09-10T21:21:48Z Stashbot 7414 jdlrobson@deploy1003: Started scap sync-world: Backport for [[gerrit:1337984|Enable ReadingLists on mediawiki and wikitech (T437113)]] 2456631 wikitext text/x-wiki asx8354x4z3rj1sabkai2jpone1sajb 2456632 2456631 2026-09-10T21:26:23Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Backport for [[gerrit:1337984|Enable ReadingLists on mediawiki and wikitech (T437113)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2456632 wikitext text/x-wiki lirj876yqos1meml0awdog8yquu3imx 2456633 2456632 2026-09-10T21:27:02Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Continuing with deployment 2456633 wikitext text/x-wiki n34lcsrrgw31c5ryw78m5ezg2k7f1ul 2456634 2456633 2026-09-10T21:31:33Z Stashbot 7414 jdlrobson@deploy1003: Finished scap sync-world: Backport for [[gerrit:1337984|Enable ReadingLists on mediawiki and wikitech (T437113)]] (duration: 09m 45s) 2456634 wikitext text/x-wiki pwu72nxvyruoh5vdy55xt8xkm1o9m6f 2456635 2456634 2026-09-10T21:31:46Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hosts.reboot-single for host sessionstore2006.codfw.wmnet 2456635 wikitext text/x-wiki 555g6434nwnxe5a921bn4imkxe11xq5 2456636 2456635 2026-09-10T21:32:27Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker1348.eqiad.wmnet 2456636 wikitext text/x-wiki i3ydjchs1euqjmm8c9kbxsul41ldcwe 2456637 2456636 2026-09-10T21:32:31Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1348.eqiad.wmnet 2456637 wikitext text/x-wiki 0chbp408a1u822nnu8inxbtdyfovxt6 2456638 2456637 2026-09-10T21:33:44Z Stashbot 7414 derenrich@deploy1003: Started scap sync-world: Backport for [[gerrit:1338439|Enable discord preview extension code on testwiki (tk 2) (T437344 T431352)]] 2456638 wikitext text/x-wiki jql489x98xmmh4pgxisysny47fakw5v 2456639 2456638 2026-09-10T21:33:48Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1348.eqiad.wmnet 2456639 wikitext text/x-wiki bcktmr9kztahpkl4bawad854hn4acjb 2456640 2456639 2026-09-10T21:33:57Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.hosts.reimage for host wikikube-worker1348.eqiad.wmnet with OS trixie 2456640 wikitext text/x-wiki q96w3d65qcjbo5gcap9m3kbwfg3fe9g 2456641 2456640 2026-09-10T21:34:27Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.hosts.move-vlan for host wikikube-worker1348 2456641 wikitext text/x-wiki t9fwaj9nx9ppp7ntt36oxrvj9gv0usd 2456642 2456641 2026-09-10T21:35:21Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.dns.netbox 2456642 wikitext text/x-wiki lpaq8mbeyblmkqywet1h7nygvche7ag 2456643 2456642 2026-09-10T21:37:56Z Stashbot 7414 derenrich@deploy1003: derenrich: Backport for [[gerrit:1338439|Enable discord preview extension code on testwiki (tk 2) (T437344 T431352)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2456643 wikitext text/x-wiki s8j3l2bpika4d7lrdlqrqljntonv106 2456644 2456643 2026-09-10T21:39:22Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1348 - rzl@cumin2003" 2456644 wikitext text/x-wiki 7pckhh8g0j8ullye2ngf3to0u0wmrj0 2456645 2456644 2026-09-10T21:39:26Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1348 - rzl@cumin2003" 2456645 wikitext text/x-wiki lck0khf5f1i33ar9eqbdryppi5nfhny 2456646 2456645 2026-09-10T21:39:27Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2456646 wikitext text/x-wiki kmnvhgl3c0a5qey63ontmn0qdenv21r 2456647 2456646 2026-09-10T21:39:28Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.dns.wipe-cache wikikube-worker1348.eqiad.wmnet 197.48.64.10.in-addr.arpa 7.9.1.0.8.4.0.0.4.6.0.0.0.1.0.0.7.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2456647 wikitext text/x-wiki rdi00vccjtcysnrc53ntqwuxizw0sma 2456648 2456647 2026-09-10T21:39:30Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker1348.eqiad.wmnet 197.48.64.10.in-addr.arpa 7.9.1.0.8.4.0.0.4.6.0.0.0.1.0.0.7.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2456648 wikitext text/x-wiki 7ogls7pyz8negke6opiuic6j0jms4xu 2456649 2456648 2026-09-10T21:39:31Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1348 2456649 wikitext text/x-wiki 3sea87ivo3xnvbxzfi68a70arj30pqv 2456650 2456649 2026-09-10T21:40:08Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1348 2456650 wikitext text/x-wiki 7hgv48s84hks7a5rb1n5yfo0fgtesje 2456651 2456650 2026-09-10T21:40:10Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1348 2456651 wikitext text/x-wiki oxon7258p5ygmzf9y0it99ku7u9zwoo 2456652 2456651 2026-09-10T21:42:34Z Stashbot 7414 derenrich@deploy1003: derenrich: Continuing with deployment 2456652 wikitext text/x-wiki 4hicfhbh8z522kbpucduhyjdglbyydk 2456653 2456652 2026-09-10T21:44:25Z Stashbot 7414 eevans@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sessionstore2006.codfw.wmnet 2456653 wikitext text/x-wiki r87s8hk0986ckjwn82qr3wahafnz4r4 2456654 2456653 2026-09-10T21:44:26Z Stashbot 7414 eevans@cumin1003: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts sessionstore2006.codfw.wmnet 2456654 wikitext text/x-wiki hsr661asgykvo56f9pm6anuygkaw3ph 2456655 2456654 2026-09-10T21:46:10Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hosts.provision for host sessionstore2006.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2456655 wikitext text/x-wiki p9sqwh8kc9nw89te1di86jegyykmw4j 2456656 2456655 2026-09-10T21:46:49Z Stashbot 7414 eevans@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sessionstore2006.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2456656 wikitext text/x-wiki kqbp917s06z1wv6dgc1hdx6pvtqb697 2456657 2456656 2026-09-10T21:47:07Z Stashbot 7414 derenrich@deploy1003: Finished scap sync-world: Backport for [[gerrit:1338439|Enable discord preview extension code on testwiki (tk 2) (T437344 T431352)]] (duration: 13m 23s) 2456657 wikitext text/x-wiki jr35b5cpueqmm1cpcx5gagvcugeehsh 2456658 2456657 2026-09-10T21:47:38Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hosts.reimage for host sessionstore2006.codfw.wmnet with OS bookworm 2456658 wikitext text/x-wiki ml2p9ei685n9wlwgb2t850h49o1vio1 2456659 2456658 2026-09-10T21:52:15Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1348.eqiad.wmnet with reason: host reimage 2456659 wikitext text/x-wiki h57brgny7o49tns98qbnj4zev5iyuzy 2456661 2456659 2026-09-10T21:57:59Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1348.eqiad.wmnet with reason: host reimage 2456661 wikitext text/x-wiki skh8fqfm9pgpbr6x704pobo6pm4rusa 2456662 2456661 2026-09-10T22:00:28Z Stashbot 7414 eevans@cumin1003: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host sessionstore2006.codfw.wmnet with OS bookworm 2456662 wikitext text/x-wiki rvl26m67jv2t02cbakr5rwwuq2nlkwn 2456663 2456662 2026-09-10T22:00:43Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hosts.reimage for host sessionstore2006.codfw.wmnet with OS bookworm 2456663 wikitext text/x-wiki byr4059vzp9lg22ts1z69xe9280w51c 2456664 2456663 2026-09-10T22:01:04Z Stashbot 7414 musikanimal@deploy1003: Started scap sync-world: Backport for [[gerrit:1322175|CodeMirror: turn on the new 2017 editor integration (T432558)]], [[gerrit:1338308|[CodeMirror] enable for new and logged-out users by default on enwiki (T288161)]] 2456664 wikitext text/x-wiki lc0u18e5d11favfvpk8jjo980d605v9 2456667 2456664 2026-09-10T22:05:50Z Stashbot 7414 musikanimal@deploy1003: kemayo, musikanimal: Backport for [[gerrit:1322175|CodeMirror: turn on the new 2017 editor integration (T432558)]], [[gerrit:1338308|[CodeMirror] enable for new and logged-out users by default on enwiki (T288161)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2456667 wikitext text/x-wiki 0c96zipdm0w63zbp18mi29ebv655esw 2456668 2456667 2026-09-10T22:06:56Z Stashbot 7414 musikanimal@deploy1003: kemayo, musikanimal: Rolling back deployment 2456668 wikitext text/x-wiki qeagedwmp4cmb9wlw03077nokbgydnh 2456669 2456668 2026-09-10T22:12:04Z Stashbot 7414 musikanimal@deploy1003: Finished scap sync-world: Backport for [[gerrit:1322175|CodeMirror: turn on the new 2017 editor integration (T432558)]], [[gerrit:1338308|[CodeMirror] enable for new and logged-out users by default on enwiki (T288161)]] (duration: 10m 59s) 2456669 wikitext text/x-wiki t244y6fr8q588vqkj5lnnb2adoasv7f 2456670 2456669 2026-09-10T22:15:17Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1348.eqiad.wmnet with OS trixie 2456670 wikitext text/x-wiki pveo3gylj9ll9p3s82dzs73injmd7u9 2456671 2456670 2026-09-10T22:20:34Z Stashbot 7414 eevans@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on sessionstore2006.codfw.wmnet with reason: host reimage 2456671 wikitext text/x-wiki i6z4uww599s7b80k0zgax80oyuski5p 2456672 2456671 2026-09-10T22:23:47Z Stashbot 7414 eevans@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sessionstore2006.codfw.wmnet with reason: host reimage 2456672 wikitext text/x-wiki ssngjmyjomm32diqpvxf80724yazvxp 2456673 2456672 2026-09-10T22:25:20Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1348.eqiad.wmnet 2456673 wikitext text/x-wiki aw9x2l5hdpxrqq4n1gu6wyzwfvwau6o 2456674 2456673 2026-09-10T22:25:22Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1348.eqiad.wmnet 2456674 wikitext text/x-wiki e1v481ol71e2jh3q9l4mdwjlmr4is0p 2456675 2456674 2026-09-10T22:25:23Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.k8s.renumber-node (exit_code=0) Renumbering for host wikikube-worker1348.eqiad.wmnet 2456675 wikitext text/x-wiki 5itajoedq4cmyg6blezm63253d04ru4 2456676 2456675 2026-09-10T22:26:34Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker1349.eqiad.wmnet 2456676 wikitext text/x-wiki ipg1xmul3wb10g1e8ehtpqv3gjihwu2 2456677 2456676 2026-09-10T22:26:38Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1349.eqiad.wmnet 2456677 wikitext text/x-wiki shuzsxmli65gmvji4rsw3qsjmcsb9i7 2456678 2456677 2026-09-10T22:27:15Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1349.eqiad.wmnet 2456678 wikitext text/x-wiki agw0c5ygu5q1kzlyvjc2h7yaer0shah 2456679 2456678 2026-09-10T22:27:55Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.hosts.reimage for host wikikube-worker1349.eqiad.wmnet with OS trixie 2456679 wikitext text/x-wiki rdw1p7dgk35osymwb82x08vzts4v4cr 2456680 2456679 2026-09-10T22:28:25Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.hosts.move-vlan for host wikikube-worker1349 2456680 wikitext text/x-wiki mss0k7fso3p95mwrj4p7a92mtn0zc5c 2456681 2456680 2026-09-10T22:28:43Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.dns.netbox 2456681 wikitext text/x-wiki m5ltm0vih27r8q0wcrblss2qa5d4m10 2456682 2456681 2026-09-10T22:32:45Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1349 - rzl@cumin2003" 2456682 wikitext text/x-wiki 8gcz2h4xxyg4a46x1zenlu94l0mjpnq 2456683 2456682 2026-09-10T22:32:48Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1349 - rzl@cumin2003" 2456683 wikitext text/x-wiki a96tfy3orki7ldzyhoowwv9l6qs8pw4 2456684 2456683 2026-09-10T22:32:49Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2456684 wikitext text/x-wiki 31j8d20630wwq50i7sk27e4prmbxcxl 2456685 2456684 2026-09-10T22:32:51Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.dns.wipe-cache wikikube-worker1349.eqiad.wmnet 198.48.64.10.in-addr.arpa 8.9.1.0.8.4.0.0.4.6.0.0.0.1.0.0.7.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2456685 wikitext text/x-wiki 3v1k1xbaoz7tyss9tvv2ocexmte4vjf 2456686 2456685 2026-09-10T22:32:52Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker1349.eqiad.wmnet 198.48.64.10.in-addr.arpa 8.9.1.0.8.4.0.0.4.6.0.0.0.1.0.0.7.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2456686 wikitext text/x-wiki e8ymjsupclwrrwzvt6ftazogytpj0qv 2456687 2456686 2026-09-10T22:32:53Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1349 2456687 wikitext text/x-wiki pukfaqp8ngnzz2th1a1yxtkrfvmn00a 2456688 2456687 2026-09-10T22:33:47Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1349 2456688 wikitext text/x-wiki gcxolaq0sdttig98o67hkt68avwpqz0 2456689 2456688 2026-09-10T22:33:48Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1349 2456689 wikitext text/x-wiki 2u1w4qfjzqs9zenxdl763u77nyuppek 2456691 2456689 2026-09-10T22:44:46Z Stashbot 7414 eevans@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sessionstore2006.codfw.wmnet with OS bookworm 2456691 wikitext text/x-wiki 3xnj049v5v8zc6uqy349h4ciz4q70nw 2456692 2456691 2026-09-10T22:46:02Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1349.eqiad.wmnet with reason: host reimage 2456692 wikitext text/x-wiki tosofbe75303cynply590gal7o8jtke 2456693 2456692 2026-09-10T22:49:57Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1349.eqiad.wmnet with reason: host reimage 2456693 wikitext text/x-wiki pxappwwb100rmc9amf3h5s766zlomyt 2456694 2456693 2026-09-10T23:09:14Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1349.eqiad.wmnet with OS trixie 2456694 wikitext text/x-wiki t0mvskfwggtft7kh16h9wovkvwzq7n4 2456695 2456694 2026-09-10T23:20:59Z Stashbot 7414 rzl@cumin2003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1349.eqiad.wmnet 2456695 wikitext text/x-wiki 0460mltstfj0zkj4chblv5pjqh1c4zk 2456696 2456695 2026-09-10T23:21:01Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1349.eqiad.wmnet 2456696 wikitext text/x-wiki mg7juyzv6uit0zmty283ait34yfcmgt 2456697 2456696 2026-09-10T23:21:08Z Stashbot 7414 rzl@cumin2003: END (PASS) - Cookbook sre.k8s.renumber-node (exit_code=0) Renumbering for host wikikube-worker1349.eqiad.wmnet 2456697 wikitext text/x-wiki eflos3w4y4tyvql78l6sm4p3j04itja 2456700 2456697 2026-09-11T02:00:58Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2456700 wikitext text/x-wiki mhph6pk5wihb9xj9w63hlxt3v2fp756 2456701 2456700 2026-09-11T02:08:48Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 07m 50s) 2456701 wikitext text/x-wiki k0e98im78yjkv16mokcq22bdlxtiuex 2456704 2456701 2026-09-11T05:15:56Z Stashbot 7414 tstarling@deploy1003: Started scap sync-world: Backport for [[gerrit:1339441|Revert Lua 5.4 support patches (T437056)]] 2456704 wikitext text/x-wiki fhvg8zyq1ncb1ekrkyxx990bnnwkyso 2456705 2456704 2026-09-11T05:20:20Z Stashbot 7414 tstarling@deploy1003: tstarling: Backport for [[gerrit:1339441|Revert Lua 5.4 support patches (T437056)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2456705 wikitext text/x-wiki d2a99fapd5hq0b0e7b18zinmwa3nz27 2456706 2456705 2026-09-11T05:21:23Z Stashbot 7414 tstarling@deploy1003: tstarling: Continuing with deployment 2456706 wikitext text/x-wiki fx2xe7la49a3ol2s36dk7psw6dh9j67 2456707 2456706 2026-09-11T05:25:55Z Stashbot 7414 tstarling@deploy1003: Finished scap sync-world: Backport for [[gerrit:1339441|Revert Lua 5.4 support patches (T437056)]] (duration: 09m 59s) 2456707 wikitext text/x-wiki myav15e5xf9iyf020dfmxk5keyq2h6n 2456708 2456707 2026-09-11T05:27:37Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2171.codfw.wmnet,db1245.eqiad.wmnet with reason: Cloning 2456708 wikitext text/x-wiki rvpr4vl0muwmfjt40c68jsovxozgula 2456709 2456708 2026-09-11T05:29:27Z Stashbot 7414 marostegui: Start cloning db1245:s5 T437563 2456709 wikitext text/x-wiki 31pxeg3e4fbnvbybimpde6xso4jkn0l 2456710 2456709 2026-09-11T05:30:39Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1159.eqiad.wmnet with reason: Cloning 2456710 wikitext text/x-wiki rcjp79aeciakxypqssxzmxomq05wqec 2456711 2456710 2026-09-11T05:31:21Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool db1159: Needs to clone another host from this one 2456711 wikitext text/x-wiki 8qc7stngnnrk65uq03blmyxcpl25t7c 2456712 2456711 2026-09-11T05:31:34Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1159: Needs to clone another host from this one 2456712 wikitext text/x-wiki lardunu30qircnjppcev87on3gjbflt 2456714 2456712 2026-09-11T06:27:35Z Stashbot 7414 TimStarling: for T437056: mwscript-k8s refreshLinks.php --wiki=eswiki --tracking-category scribunto-common-error-category 2456714 wikitext text/x-wiki ndnb245t61u6vudhodo1rz0hlsd68rn 2456715 2456714 2026-09-11T06:38:02Z Stashbot 7414 TimStarling: also started refreshLinks for ptwiki and zhwiki, reparsing ~3000 pages altogether T437056 2456715 wikitext text/x-wiki ou9rqsffx47sl1mu496kjhrk1vm5hqc 2456716 2456715 2026-09-11T07:10:22Z Stashbot 7414 TimStarling: killed jobs for T437056 since they weren't purging 2456716 wikitext text/x-wiki h6zxy4o5lpjh0o2sr1of8zfpoibrgim 2456717 2456716 2026-09-11T07:15:16Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db1199.eqiad.wmnet with reason: Cloning s4 2456717 wikitext text/x-wiki 3ne33ogs56m6daad48i52092osftc7x 2456718 2456717 2026-09-11T07:16:11Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool db1159: Repooling db1159 2456718 wikitext text/x-wiki f2ye1w0d6tmc2i6nxlnl5y98rhn7aih 2456719 2456718 2026-09-11T07:19:22Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool db1199: Needs to clone another host from this one 2456719 wikitext text/x-wiki qi14ra6zhxt7ytte16u7imiu3u4isuk 2456720 2456719 2026-09-11T07:20:10Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1199: Needs to clone another host from this one 2456720 wikitext text/x-wiki llocexmgfhcm54qysdkqyp42kg0gfpi 2456721 2456720 2026-09-11T07:27:11Z Stashbot 7414 arnaudb@cumin1003: START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1003.wikimedia.org with reason: Upgrade gitlab 2456721 wikitext text/x-wiki ee4gjz7b19ia6y72tcihxkn6b0v8169 2456722 2456721 2026-09-11T07:28:26Z Stashbot 7414 arnaudb@cumin1003: START - Cookbook sre.gitlab.upgrade on GitLab host gitlab2002.wikimedia.org with reason: Upgrade gitlab 2456722 wikitext text/x-wiki ojaeu1vjh7fs6rm4rgx3mfjv6eiv71h 2456723 2456722 2026-09-11T07:29:05Z Stashbot 7414 arnaudb@cumin1003: END (ERROR) - Cookbook sre.gitlab.upgrade (exit_code=97) on GitLab host gitlab1003.wikimedia.org with reason: Upgrade gitlab 2456723 wikitext text/x-wiki 3rjnib58zndo1jtrwhmwrklr6wsdr2a 2456724 2456723 2026-09-11T07:29:29Z Stashbot 7414 arnaudb@cumin1003: START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1003.wikimedia.org with reason: Upgrade gitlab 2456724 wikitext text/x-wiki emzw7f8e7kugtw0kpf9htx89917newq 2456725 2456724 2026-09-11T07:29:54Z Stashbot 7414 arnaudb@cumin1003: END (ERROR) - Cookbook sre.gitlab.upgrade (exit_code=97) on GitLab host gitlab1003.wikimedia.org with reason: Upgrade gitlab 2456725 wikitext text/x-wiki q4c19xbvgxvim9ba2l9fgil14mzpkb5 2456726 2456725 2026-09-11T07:54:08Z Stashbot 7414 arnaudb@cumin1003: END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab2002.wikimedia.org with reason: Upgrade gitlab 2456726 wikitext text/x-wiki odz5ps680tq53qpt9mr4ez7lqd0rjom 2456727 2456726 2026-09-11T07:58:28Z Stashbot 7414 arnaudb@cumin1003: START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1003.wikimedia.org with reason: Upgrade gitlab 2456727 wikitext text/x-wiki tcjy9tmcuaicg92j8pusodi47h01r4c 2456728 2456727 2026-09-11T07:58:35Z Stashbot 7414 arnaudb@cumin1003: END (FAIL) - Cookbook sre.gitlab.upgrade (exit_code=99) on GitLab host gitlab1003.wikimedia.org with reason: Upgrade gitlab 2456728 wikitext text/x-wiki 7ztyopbvb2lfog3t6stvlziyg03ubn0 2456729 2456728 2026-09-11T08:01:18Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1159: Repooling db1159 2456729 wikitext text/x-wiki 0rgoe4t6dnmos2lj7uz1jlbc1lhx0vo 2456730 2456729 2026-09-11T08:20:44Z Stashbot 7414 arnaudb@cumin1003: START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1003.wikimedia.org with reason: Upgrade gitlab 2456730 wikitext text/x-wiki 77ue43ibj4uk5eflp7z4evb25mi6zso 2456731 2456730 2026-09-11T08:20:52Z Stashbot 7414 arnaudb@cumin1003: END (FAIL) - Cookbook sre.gitlab.upgrade (exit_code=99) on GitLab host gitlab1003.wikimedia.org with reason: Upgrade gitlab 2456731 wikitext text/x-wiki 77byrz5ulgqb7as4vgfejqbypizvf8v 2456732 2456731 2026-09-11T08:27:26Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db[1154,1269].eqiad.wmnet with reason: Restarting s5 2456732 wikitext text/x-wiki 3zbuixb8lnh9ktoozohk8ppjbwzom1t 2456733 2456732 2026-09-11T08:28:21Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 7 hosts with reason: Restarting s5 2456733 wikitext text/x-wiki fmlxveihbai6fw6ow7shb5pxf4ii7as 2456734 2456733 2026-09-11T08:29:05Z Stashbot 7414 arnaudb@cumin1003: START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1003.wikimedia.org with reason: Upgrade gitlab 2456734 wikitext text/x-wiki 6f7t9tgoy70j11ukkms8q6rib737bfe 2456735 2456734 2026-09-11T08:29:13Z Stashbot 7414 arnaudb@cumin1003: END (FAIL) - Cookbook sre.gitlab.upgrade (exit_code=99) on GitLab host gitlab1003.wikimedia.org with reason: Upgrade gitlab 2456735 wikitext text/x-wiki 8d3bakwqgklzwqnxntbkgu1suibd42p 2456737 2456735 2026-09-11T08:36:09Z Stashbot 7414 arnaudb@cumin1003: START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1003.wikimedia.org with reason: Upgrade gitlab 2456737 wikitext text/x-wiki qw7l6frtwuqqwigz1j591fr4fjz5770 2456738 2456737 2026-09-11T08:43:19Z Stashbot 7414 slyngshede@dns1004: START - running authdns-update 2456738 wikitext text/x-wiki ry3305agpndoy1efl9ubux3t6qucjrd 2456739 2456738 2026-09-11T08:45:29Z Stashbot 7414 slyngshede@dns1004: END - running authdns-update 2456739 wikitext text/x-wiki coh83ztrjobjgv0a5kvzu2n8pian0fz 2456740 2456739 2026-09-11T08:45:31Z Stashbot 7414 arnaudb@cumin1003: END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1003.wikimedia.org with reason: Upgrade gitlab 2456740 wikitext text/x-wiki 857hfsnwy4pu3ckki8jhcn3gnqxtq00 2456741 2456740 2026-09-11T08:46:34Z Stashbot 7414 slyngs: Update CAS/SSO to CAS 7.3.8.3 2456741 wikitext text/x-wiki icq7l0cdgxk37o06jsgzzq555loxtgc 2456746 2456741 2026-09-11T10:15:28Z Stashbot 7414 aokoth@cumin1004: START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1004.wikimedia.org with reason: Security Release - T437680 2456746 wikitext text/x-wiki 1i0yp4pwyqxaxufqznf2qcekwqrr25x 2456747 2456746 2026-09-11T10:17:04Z Stashbot 7414 Emperor: restart versitygw@objectstorage00.service on backup1015 2456747 wikitext text/x-wiki qn6nuu84b15ek6d8ruvlg5uibsanjv9 2456748 2456747 2026-09-11T10:20:32Z Stashbot 7414 Emperor: restart versitygw@objectstorage0[1-3].service on backup1015 in turn 2456748 wikitext text/x-wiki i4ox1ydpip8vjphx43qxocipug8t6qj 2456749 2456748 2026-09-11T10:30:32Z Stashbot 7414 Emperor: restart versitygw@objectstorage0[0-3].service on backup1016 in turn 2456749 wikitext text/x-wiki tfn87v4dvuuk4qdch5f5yo4yp6cronq 2456750 2456749 2026-09-11T10:32:05Z Stashbot 7414 Emperor: restart versitygw@objectstorage0[0-3].service on backup1017 in turn 2456750 wikitext text/x-wiki pgwhvlspmyno89e5xlycoyq5ssoie05 2456751 2456750 2026-09-11T10:33:34Z Stashbot 7414 Emperor: restart versitygw@objectstorage0[0-3].service on backup1018 in turn 2456751 wikitext text/x-wiki 3ktu1e49rnhoinbvxeiob5415nl246k 2456752 2456751 2026-09-11T10:34:54Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool db1199: db1199 repool 2456752 wikitext text/x-wiki c5pai22kkweg1csccwvecnxvwtyc4mk 2456753 2456752 2026-09-11T10:35:18Z Stashbot 7414 Emperor: restart versitygw@objectstorage0[0-3].service on backup1019 in turn 2456753 wikitext text/x-wiki b8f7bmzxizywgkdvm6qadg85mw6ws9x 2456754 2456753 2026-09-11T10:36:19Z Stashbot 7414 Emperor: restart versitygw@objectstorage0[0-3].service on backup1020 in turn 2456754 wikitext text/x-wiki dgw37cj9k0l2lcl4peacj3pdetahtqa 2456755 2456754 2026-09-11T10:37:04Z Stashbot 7414 Emperor: restart versitygw@objectstorage0[0-3].service on backup2015 in turn 2456755 wikitext text/x-wiki nwtd8bn0o218e01zp0eke3m4zf0dob4 2456756 2456755 2026-09-11T10:39:18Z Stashbot 7414 Emperor: restart versitygw@objectstorage0[0-3].service on backup2016 in turn 2456756 wikitext text/x-wiki mf6po9klq1izsnob0lx0k6fgfattikq 2456757 2456756 2026-09-11T10:40:26Z Stashbot 7414 Emperor: restart versitygw@objectstorage0[0-3].service on backup2017 in turn 2456757 wikitext text/x-wiki 9fkd5pj03wf7mns0zphuu2aww16chj5 2456758 2456757 2026-09-11T10:41:07Z Stashbot 7414 Emperor: restart versitygw@objectstorage0[0-3].service on backup2018 in turn 2456758 wikitext text/x-wiki q94u6055150yguk6uqih6i9flm6evc4 2456759 2456758 2026-09-11T10:43:00Z Stashbot 7414 Emperor: restart versitygw@objectstorage0[0-3].service on backup2019 in turn 2456759 wikitext text/x-wiki alg8gw9wbhw9njqlez64rdkvr1w9ogy 2456760 2456759 2026-09-11T10:43:45Z Stashbot 7414 Emperor: restart versitygw@objectstorage0[0-3].service on backup2020 in turn 2456760 wikitext text/x-wiki freqowsb6f28ral7lmgvu3rv2qtau2x 2456761 2456760 2026-09-11T10:44:37Z Stashbot 7414 aokoth@cumin1004: END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1004.wikimedia.org with reason: Security Release - T437680 2456761 wikitext text/x-wiki 4jan61eo8wg809qy3x9kqcdijap8ewh 2456762 2456761 2026-09-11T11:05:12Z Stashbot 7414 jmm@cumin2003: DONE (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Jcrespo out of all services on: 2443 hosts 2456762 wikitext text/x-wiki 0lwsf2vlhww3bwk5tqisqke7espex1w 2456763 2456762 2026-09-11T11:05:57Z Stashbot 7414 moritzm: installing Linux 6.1.187 on Bookworm hosts 2456763 wikitext text/x-wiki 0gae4vdy0kcmfwbfhef5v0aclp9rkyu 2456764 2456763 2026-09-11T11:20:00Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1199: db1199 repool 2456764 wikitext text/x-wiki 4mx0zn8040or5iiiz8rc3pp36yd3b8k 498 9925 2456625 2456289 2026-09-10T21:08:20Z Stashbot 7414 Southparkfan: masked and stopped stray udp2log.service on deployment-mwlog03, claimed 8420/udp which should have been assigned to udp_tee - T436469 2456625 wikitext text/x-wiki hmrkbtmdm61f9ie4ooxku1l8a7o35u5 2456666 2456625 2026-09-10T22:01:53Z Stashbot 7414 Southparkfan: decommission deployment-mwlog02 - T436469 2456666 wikitext text/x-wiki 4ss4t4xuk642q6tl53k22wu1p7r5wa3 0 17290 2456563 2456345 2026-09-10T18:55:41Z Stashbot 7414 James_F: Zuul: [mediawiki/extensions/ArticleGuidance] Add CommunityConfiguration for phan for T437586 2456563 wikitext text/x-wiki rarn5jme1mw33437sc26sx2vu48zxdc 2456564 2456563 2026-09-10T18:56:21Z Stashbot 7414 James_F: Zuul: [mediawiki/extensions/PersonalDashboard] Add ORES & Wikibase phan deps for T436570 and T437491 2456564 wikitext text/x-wiki 8xfh8w4bkp0yxhm5b26bnh93n1osx1d 2456624 2456564 2026-09-10T21:08:18Z Stashbot 7414 Southparkfan: masked and stopped stray udp2log.service on deployment-mwlog03, claimed 8420/udp which should have been assigned to udp_tee - T436469 2456624 wikitext text/x-wiki 2yk9ox52k8vlpcqydcl5poe26i9bk2x 2456665 2456624 2026-09-10T22:01:51Z Stashbot 7414 Southparkfan: decommission deployment-mwlog02 - T436469 2456665 wikitext text/x-wiki 8niav0ubkxl54y0qwf3rjsvl3d75mrf 2456713 2456665 2026-09-11T06:05:42Z Stashbot 7414 phedenskog: Updating Jenkins jobs from https://gerrit.wikimedia.org/r/c/integration/config/+/1338086 (quibble*, api-testing-*, mwext-phpunit-coverage*): run npm cache verify at most once a day per cache T437377 2456713 wikitext text/x-wiki rndjo1pwz910cdccbsm12upl6ow134b 0 35071 2456540 2442101 2026-09-10T17:04:25Z Nintendofan885 17301 mention thumb domain 2456540 wikitext text/x-wiki 73gmkea26kc46o31pxaoedth7yk0v0f 0 49472 2456703 2456038 2026-09-11T03:18:17Z Quiddity 1884 cleanup 2456703 wikitext text/x-wiki tkvt9gpyr774nr8f6xvxgk1vwnnldgd 0 441753 2456493 2455687 2026-09-10T14:34:33Z Taavi-WMF 41365 /* Add or split a new section */ do not advice against way that's more likely to break 2456493 wikitext text/x-wiki i9yd11fuiv8b7860g80lcfqey42ere0 0 443303 2456736 2405547 2026-09-11T08:31:17Z SLyngshede-WMF 31501 Update documentation email alias documentation to reflect that we're using Postfix now, not Exim 2456736 wikitext text/x-wiki jprq8go19om4q53oloo2jbc29ga0d12 498 443949 2456504 2455376 2026-09-10T15:07:53Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy d10f832 (Add format_report tests for qualifier/description columns and totals-only) 2456504 wikitext text/x-wiki 0vb94q22764se9aqsk1tbwk0b6fcwgg 2456505 2456504 2026-09-10T15:07:55Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 6e9571d (Add format_report test for reference column) for T428637 2456505 wikitext text/x-wiki ljbt6iasyna3rmr2uz5qe5k6w2a5gub 2456506 2456505 2026-09-10T15:07:57Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy e567cca (Add PropertyStatistics.build_formatter factory) 2456506 wikitext text/x-wiki lz91mfsn3pkcr7vnfaifp09g6nsqmqt 2456507 2456506 2026-09-10T15:07:58Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 7987fe9 (Move formatting out of PropertyStatistics to PagesProcessor) 2456507 wikitext text/x-wiki f3sm9392evq1fepmja8uw2gvw2d5kyv 0 449160 2456699 2456330 2026-09-11T00:01:58Z Dexbot 30554 Bot: Updating the report 2456699 wikitext text/x-wiki 6a9wdfi8orj2khlgrnmv1f56hop57pp 0 451180 2456524 2438596 2026-09-10T16:24:20Z BCornwall-WMF 31521 /* HTTPS */ note https cert deployment on cache hosts 2456524 wikitext text/x-wiki 75sf8niipe6qglzyq1sj5u2wm1kgws8 2456535 2456524 2026-09-10T16:46:42Z BCornwall-WMF 31521 /* Deployment */ acme-chief, not puppet 2456535 wikitext text/x-wiki 1rfmwgl25lqa3dmml2gyeqobrzd3zd2 0 453597 2456513 2451050 2026-09-10T15:31:02Z DCaro (WMF) 18271 /* 2026 */ 2456513 wikitext text/x-wiki 8phxxe2l211pje5ffjevul8617zrsp5 2 455625 2456702 2454941 2026-09-11T03:04:02Z Quiddity 1884 fix [[User:Martin Urbanec|martin]]'s addition of deprecated <source> ;-) 2456702 wikitext text/x-wiki reb5zithhaznhzr8v6yu9z3r4hn9j68 12 458860 2456512 2450959 2026-09-10T15:28:10Z DCaro (WMF) 18271 /* Publishing a component to the web */ 2456512 wikitext text/x-wiki 8nq36a66qcv9a5czxiw5p1zub8ucixg 0 459290 2456522 2455707 2026-09-10T16:06:57Z Mforns (WMF) 3929 /* YYYY-MM-DD NEXT TUESDAY TRAIN (REPLACE THIS AFTER DEPLOY) */ Add patch to deploy 2456522 wikitext text/x-wiki ho7kypqhvktazwieh7xxpi4edbmz0gw 2456523 2456522 2026-09-10T16:23:45Z Ottomata 88 2456523 wikitext text/x-wiki oc6m9zwboe3qtkae6d2s13djq97r548 2456531 2456523 2026-09-10T16:41:07Z JAllemandou (WMF) 37709 Add new line to train 2456531 wikitext text/x-wiki hzamouxhd6dfvtharzlxp8w3n0mlzel 0 459699 2456544 2456250 2026-09-10T18:08:49Z Stashbot 7414 ejegg: fundraising civicrm upgraded from 89d5c0e6 to ba563432 2456544 wikitext text/x-wiki j1i8t38ach87utd968ugrrnel0lupuz 2456698 2456544 2026-09-10T23:38:35Z Stashbot 7414 ejegg: fundraising civicrm upgraded from ba563432 to 9436540f 2456698 wikitext text/x-wiki mqw46sfn6yix01wj3k7laumrl744mst 0 459966 2456456 2456425 2026-09-10T12:22:53Z Phuedx (WMF) 47850 Add case study per https://phabricator.wikimedia.org/T432384 2456456 wikitext text/x-wiki nd9pz0thekylv2anskyqi0sevuxmhdp 2456457 2456456 2026-09-10T12:25:08Z Phuedx (WMF) 47850 Formatting 2456457 wikitext text/x-wiki luq9wactxadozsgo1r32r9cfhdmrg2m 0 460052 2456541 2456118 2026-09-10T17:25:23Z JVanderhoop-WMF 41069 Made relationship between GB, TK and ExP team clear 2456541 wikitext text/x-wiki 1nqgijojjt19idxydbeq31xrozvozak 0 460366 2456495 2454864 2026-09-10T14:51:44Z TBurmeister (WMF) 27417 wording update for consistency across docs 2456495 wikitext text/x-wiki 774h34982w7dgs4o067c7kdkzi9vq9c 2456502 2456495 2026-09-10T15:03:33Z TBurmeister (WMF) 27417 add link to backend replacement landing page in first paragraph 2456502 wikitext text/x-wiki svaeoq9ui3qz9s8mhid57q6imqx1xze 0 460375 2456536 2456290 2026-09-10T16:48:05Z TBurmeister (WMF) 27417 Revise GeoSPARQL sections and code formatting 2456536 wikitext text/x-wiki 7bcigu68g1kapmhd96pj1298uyx118h 2456542 2456536 2026-09-10T17:31:38Z TBurmeister (WMF) 27417 Update table 2456542 wikitext text/x-wiki ay4iht5yyuf5t9d3g64nafupc63axau 2456565 2456542 2026-09-10T19:00:29Z TBurmeister (WMF) 27417 Revising first two rewrite sections 2456565 wikitext text/x-wiki ttuxzt36qrofqricb1hwmhpjj6owk8d 2456619 2456565 2026-09-10T20:54:06Z TBurmeister (WMF) 27417 Replace images with tables, revise remaining query rewrite sections, standardize formatting 2456619 wikitext text/x-wiki s1y9j66m9oilmwit3hbdtplzon8th7f 0 460424 2456509 2455478 2026-09-10T15:15:44Z DMburugu (WMF) 25135 /* Service Summary */ add remarks 2456509 wikitext text/x-wiki 4ts5euv7ym56rmhqo0a29qftaml07oc 2456510 2456509 2026-09-10T15:18:09Z DMburugu (WMF) 25135 /* Operating Procedures */ add remarks 2456510 wikitext text/x-wiki qimoyqnvygqowjl3hgnhickqxipimaa 2456511 2456510 2026-09-10T15:27:51Z DMburugu (WMF) 25135 /* Release Confidence */ add remarks 2456511 wikitext text/x-wiki aprwo9uzs8bh1h98cv1it5n40nkvhg4 2456516 2456511 2026-09-10T15:36:06Z DMburugu (WMF) 25135 /* Release Confidence */ marks as done 2456516 wikitext text/x-wiki gqgr1jx64hkst8h55yu9ar5wrcvguyv 2456521 2456516 2026-09-10T16:06:09Z RCoccioli (WMF) 7416 Update SCROLL bearer to myself 2456521 wikitext text/x-wiki sgigyl06ll41w578fp325mz3ni0gtw7 2456528 2456521 2026-09-10T16:37:53Z DMburugu (WMF) 25135 Include changes from call with SRE 2456528 wikitext text/x-wiki 1o90kk91q04jg31hfqihprypdu18mon 2456529 2456528 2026-09-10T16:38:37Z DMburugu (WMF) 25135 /* Operating Procedures */ remove styling bugs. 2456529 wikitext text/x-wiki bqngmk3wnqbz82qb0t8rr5d44x157jp 3 460650 2456539 2026-09-10T16:50:45Z StrikerBot 8475 Welcome to Toolforge! 2456539 wikitext text/x-wiki 9rt4miygb25ptn94gig5kd7t47jy2pt 2 460651 2456573 2026-09-10T19:30:57Z Ashissarkar001 59471 /* */ 2456573 wikitext text/x-wiki jt3tgt18zp15culwbzsf3nexmlhh841