Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.16 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 2161 2451343 2371798 2026-08-25T10:41:51Z Stashbot 7414 taavi: merging https://gerrit.wikimedia.org/r/c/operations/puppet/+/1328644 to move novaproxy backend selection and proxying to haproxy T429930 2451343 wikitext text/x-wiki r1pwwyiqqav9l7f8knrsoiycxhpfta5 498 3086 2451256 2450763 2026-08-25T08:17:19Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component api-gateway 2451256 wikitext text/x-wiki mpovf0r0vi1g9anu4iqnrwevgf8ly3x 2451260 2451256 2026-08-25T08:22:08Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway 2451260 wikitext text/x-wiki erkik3qa7vd2hmjnq7mwlb2zr9jvpaf 2451271 2451260 2026-08-25T08:37:22Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-api 2451271 wikitext text/x-wiki 4s5rnj2vdoka3n0tp1jdtqzs9uzo4kd 2451279 2451271 2026-08-25T08:48:21Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-api 2451279 wikitext text/x-wiki t2081dvnqk8noj4fxiau1a8ld7iyyk3 0 4108 2450842 2450674 2026-08-24T12:47:30Z ScheduleDeploymentBot 37566 Add [[gerrit:1319945]] to Monday, August 24 UTC late backport window 2450842 wikitext text/x-wiki 8gnhfra9sb9md5dhn9y5jv15m28giti 2450925 2450842 2026-08-24T15:09:25Z ScheduleDeploymentBot 37566 Add [[gerrit:1326410]] to Monday, August 24 UTC late backport window 2450925 wikitext text/x-wiki 74v8ta5gx0qz7s1pg2ggdn7y7snbz9n 2450939 2450925 2026-08-24T15:38:15Z ScheduleDeploymentBot 37566 Add [[gerrit:1324819]] to Monday, August 24 UTC late backport window 2450939 wikitext text/x-wiki qcignh6d7kyv8p1itycbyzio9vqzlwu 2451008 2450939 2026-08-24T16:50:55Z ScheduleDeploymentBot 37566 Add [[gerrit:1259251]] to Tuesday, August 25 UTC late backport window 2451008 wikitext text/x-wiki toiedbvhmiw1ots9d75aagd6lkaguhm 2451010 2451008 2026-08-24T16:51:26Z ScheduleDeploymentBot 37566 Add [[gerrit:1328239]] to Tuesday, August 25 UTC late backport window 2451010 wikitext text/x-wiki hiytm3b72fatqyrvn7ql4exwvs2frof 2451012 2451010 2026-08-24T16:57:25Z ScheduleDeploymentBot 37566 Add [[gerrit:1328674]] to Monday, August 24 UTC late backport window 2451012 wikitext text/x-wiki n7troqr82nyk262ws8i264o317ms1hi 2451141 2451012 2026-08-24T20:15:26Z ScheduleDeploymentBot 37566 Add [[gerrit:1328707]] to Monday, August 24 UTC late backport window 2451141 wikitext text/x-wiki pzcghrvetmplc977149wma5uztijzz1 2451378 2451141 2026-08-25T11:35:04Z ScheduleDeploymentBot 37566 Add [[gerrit:1324031]] to Tuesday, August 25 UTC afternoon backport window 2451378 wikitext text/x-wiki 3xp81s3w32qnaehx7fo5ltn9wkk0q5e 498 6726 2451262 2450203 2026-08-25T08:23:07Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component api-gateway 2451262 wikitext text/x-wiki 0uigxkppep58p0pjr66flxspnps92ng 2451264 2451262 2026-08-25T08:26:56Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway 2451264 wikitext text/x-wiki kjizog9rfqnzaets666mhe6teyaqssd 2451265 2451264 2026-08-25T08:27:35Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-api 2451265 wikitext text/x-wiki r01oxvbpejbf352jxgp6bkp6e5dfri8 2451270 2451265 2026-08-25T08:37:15Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-api 2451270 wikitext text/x-wiki jnyelwxtiphc82daje48lyqx61mnosf 2451285 2451270 2026-08-25T08:54:34Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-api 2451285 wikitext text/x-wiki 0tex0voilp111evf22h56zz536oim21 2451286 2451285 2026-08-25T08:54:46Z Stashbot 7414 dcaro@cloudcumin1001: END (ERROR) - Cookbook wmcs.toolforge.component.deploy (exit_code=97) for component logs-api 2451286 wikitext text/x-wiki rhasyo9vldg71e2471buivcg6e5oqub 0 7919 2450818 2450817 2026-08-24T12:08:32Z Stashbot 7414 jayme@deploy1003: helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. 2450818 wikitext text/x-wiki fct2tmuh5vu0yixp0ojk6c2beh65rqa 2450819 2450818 2026-08-24T12:08:41Z Stashbot 7414 jayme@deploy1003: helmfile [staging-codfw] START helmfile.d/admin 'apply'. 2450819 wikitext text/x-wiki 1806y566hjcj8f0lidwig0zemz4nr2w 2450820 2450819 2026-08-24T12:10:52Z Stashbot 7414 jayme@deploy1003: helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. 2450820 wikitext text/x-wiki 6v77b41h4hnkbidmn967l9i53sdlhph 2450821 2450820 2026-08-24T12:11:00Z Stashbot 7414 jayme@deploy1003: helmfile [ml-serve-eqiad] START helmfile.d/admin 'apply'. 2450821 wikitext text/x-wiki terpql7u6mnzashsjt4yw7x479nazw1 2450822 2450821 2026-08-24T12:12:43Z Stashbot 7414 jayme@deploy1003: helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'apply'. 2450822 wikitext text/x-wiki f0vd6h6148afiuzapdsrylstg11rk76 2450823 2450822 2026-08-24T12:12:51Z Stashbot 7414 jayme@deploy1003: helmfile [ml-serve-codfw] START helmfile.d/admin 'apply'. 2450823 wikitext text/x-wiki 17nmimthicxai7ntqi0mayoyjiojtxm 2450825 2450823 2026-08-24T12:19:41Z Stashbot 7414 jayme@deploy1003: helmfile [ml-serve-codfw] DONE helmfile.d/admin 'apply'. 2450825 wikitext text/x-wiki 6nw5ozw9lum43n1g928sc6nxtya9ee2 2450826 2450825 2026-08-24T12:19:49Z Stashbot 7414 jayme@deploy1003: helmfile [ml-staging-codfw] START helmfile.d/admin 'apply'. 2450826 wikitext text/x-wiki 2jwgf7hteilw13ydi5s7q92y54r210t 2450827 2450826 2026-08-24T12:20:41Z Stashbot 7414 jayme@deploy1003: helmfile [ml-staging-codfw] DONE helmfile.d/admin 'apply'. 2450827 wikitext text/x-wiki p55ob5z4lla1kxr4lkm0qniz9ze4n6c 2450828 2450827 2026-08-24T12:20:49Z Stashbot 7414 jayme@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2450828 wikitext text/x-wiki rykdactcu2g2z3u3rpfi5pht5w5p5xo 2450829 2450828 2026-08-24T12:25:48Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. 2450829 wikitext text/x-wiki ruccg05mogvsme1dq95msg3gt8gz42r 2450830 2450829 2026-08-24T12:27:23Z Stashbot 7414 jayme@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2450830 wikitext text/x-wiki ckl9hqr9b8ob9ewdqwdvol9ub4yw0j4 2450831 2450830 2026-08-24T12:27:31Z Stashbot 7414 jayme@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. 2450831 wikitext text/x-wiki d0luls6yuxuiv6nnzvpkbp2wn7adjk1 2450832 2450831 2026-08-24T12:28:23Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. 2450832 wikitext text/x-wiki 1zi4fizkywothsolfvnjfjj8cwmjdgk 2450833 2450832 2026-08-24T12:28:56Z Stashbot 7414 jayme@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. 2450833 wikitext text/x-wiki dur4d1aqx0ntq1fzo1kbowtn7oudo8r 2450834 2450833 2026-08-24T12:29:03Z Stashbot 7414 jayme@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/admin 'apply'. 2450834 wikitext text/x-wiki p4826t1c765fkyobv5bn3lvhopept6x 2450835 2450834 2026-08-24T12:30:21Z Stashbot 7414 jayme@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2450835 wikitext text/x-wiki q4i65r4pzir6i0fx58xemahiuel70ds 2450836 2450835 2026-08-24T12:30:28Z Stashbot 7414 jayme@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/admin 'apply'. 2450836 wikitext text/x-wiki p2dz5jdli90rfmo8a92vhflwu4nda0y 2450837 2450836 2026-08-24T12:31:50Z Stashbot 7414 jayme@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/admin 'apply'. 2450837 wikitext text/x-wiki m9edrb6kaw1pdtou5njc5zqzemfsdpe 2450838 2450837 2026-08-24T12:35:18Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. 2450838 wikitext text/x-wiki p36ebyqhnzngva17yewujondw9kp994 2450839 2450838 2026-08-24T12:35:37Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. 2450839 wikitext text/x-wiki 35f4h9ncv5timf661gre83zj0n7w5u5 2450840 2450839 2026-08-24T12:38:10Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. 2450840 wikitext text/x-wiki dh4ag8xu35qlqa8c2lisdt37vj7fhcq 2450841 2450840 2026-08-24T12:38:50Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. 2450841 wikitext text/x-wiki rg4t48botww7zo0f305raakv0t7jzws 2450843 2450841 2026-08-24T12:49:19Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.mysql.clone of db-test1002.eqiad.wmnet onto db1901.eqiad.wmnet 2450843 wikitext text/x-wiki ectcsepvi6lp6h8ttfeknayf6808ggz 2450844 2450843 2026-08-24T12:49:22Z Stashbot 7414 fceratto@cumin1003: END (FAIL) - Cookbook sre.mysql.clone (exit_code=99) of db-test1002.eqiad.wmnet onto db1901.eqiad.wmnet 2450844 wikitext text/x-wiki flde2xv4htm728j34ug7pmekah5pq59 2450845 2450844 2026-08-24T12:53:35Z Stashbot 7414 jelto@deploy1003: helmfile [codfw] START helmfile.d/admin 'sync'. 2450845 wikitext text/x-wiki etwidecewagagmrpuwjl6jmwjdukop4 2450846 2450845 2026-08-24T12:54:07Z Stashbot 7414 jelto@deploy1003: helmfile [codfw] DONE helmfile.d/admin 'sync'. 2450846 wikitext text/x-wiki q30oyfq8r4d3ion6za9k7ew6d9y92k7 2450847 2450846 2026-08-24T12:54:12Z Stashbot 7414 jelto: update cert-manager to 1.19.6 on wikikube codfw - T427402 2450847 wikitext text/x-wiki oo9qaws5o9wu9hoisdvupbhjis8yakw 2450848 2450847 2026-08-24T12:58:41Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on db1901.eqiad.wmnet with reason: Cloning 2450848 wikitext text/x-wiki k2qpdydie9bfz0kfksvdv08yzaa3frq 2450849 2450848 2026-08-24T12:59:19Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on db1901.eqiad.wmnet with reason: Cloning 2450849 wikitext text/x-wiki e8rqz61b5kcgll4lu7tju1r66j662i2 2450850 2450849 2026-08-24T13:02:49Z Stashbot 7414 jelto@deploy1003: helmfile [eqiad] START helmfile.d/admin 'sync'. 2450850 wikitext text/x-wiki gcrci2ecrv9ce9q1iepbc8y9b0a2qx1 2450851 2450850 2026-08-24T13:03:16Z Stashbot 7414 jelto@deploy1003: helmfile [eqiad] DONE helmfile.d/admin 'sync'. 2450851 wikitext text/x-wiki sbuj280svr9c4k4koo548o1t41x4876 2450852 2450851 2026-08-24T13:03:23Z Stashbot 7414 jelto: update cert-manager to 1.19.6 on wikikube eqiad - T427402 2450852 wikitext text/x-wiki mbrn7lo96gmubsdij3ovd3aj1oumfur 2450853 2450852 2026-08-24T13:09:06Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Started scap sync-world: Backport for [[gerrit:1325527|Growth: Drop now unused config for benefits block (T433783)]], [[gerrit:1328315|arwikiquote: update wordmark (T435505)]] 2450853 wikitext text/x-wiki d27hdupk1wzwn0wz5qvmlybzdb55yna 2450854 2450853 2026-08-24T13:11:05Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: lucaswerkmeister-wmde, anzx, migr: Backport for [[gerrit:1325527|Growth: Drop now unused config for benefits block (T433783)]], [[gerrit:1328315|arwikiquote: update wordmark (T435505)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2450854 wikitext text/x-wiki o9mt6ka0tjqtvs0aguwep2vfblm46tz 2450855 2450854 2026-08-24T13:12:06Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on db1901.eqiad.wmnet with reason: Cloning 2450855 wikitext text/x-wiki 9tqzw3bk27hsmfvj2wko3u0fm8ntbux 2450856 2450855 2026-08-24T13:12:35Z Stashbot 7414 topranks: drain Lumen transport circuit from eqiad<->codfw due to link flaps/errors (T435810) 2450856 wikitext text/x-wiki hnczlquzhjb1iua7psmvcd6khj8fypq 2450857 2450856 2026-08-24T13:13:11Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: lucaswerkmeister-wmde, anzx, migr: Continuing with deployment 2450857 wikitext text/x-wiki qy3x54etnecdxrje4tn8e6p1e31mh43 2450858 2450857 2026-08-24T13:14:07Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.mysql.update-replication 2450858 wikitext text/x-wiki 22z1066q5ra8sxtklxetf1l4d58i9a5 2450859 2450858 2026-08-24T13:14:17Z Stashbot 7414 fceratto@cumin1003: END (FAIL) - Cookbook sre.mysql.update-replication (exit_code=99) 2450859 wikitext text/x-wiki 6kq68j5v0je4axrombvtzeiuc6zckph 2450860 2450859 2026-08-24T13:14:29Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'llm' . 2450860 wikitext text/x-wiki bgt92y5k179ahb3746wlkgyc47da3re 2450861 2450860 2026-08-24T13:17:39Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Finished scap sync-world: Backport for [[gerrit:1325527|Growth: Drop now unused config for benefits block (T433783)]], [[gerrit:1328315|arwikiquote: update wordmark (T435505)]] (duration: 08m 33s) 2450861 wikitext text/x-wiki ccvi0w7o0sywey3vvcdwbjpope5v0tt 2450862 2450861 2026-08-24T13:19:05Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'llm' . 2450862 wikitext text/x-wiki 5me7o408p19aegpm2x0xi7h72wbk1es 2450864 2450862 2026-08-24T13:22:52Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Started scap sync-world: Backport for [[gerrit:1328310|Lift IP cap for Mapudungun editathon on 2026-08-29 (T435523)]], [[gerrit:1326848|Disable Wikidata Bridge on Catalan Wikipedia (T433713)]] 2450864 wikitext text/x-wiki p5tb9b56q1pdsjqq588gtmz0cqcjr4f 2450865 2450864 2026-08-24T13:24:50Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: lucaswerkmeister-wmde, anzx, sadiyamohammed13: Backport for [[gerrit:1328310|Lift IP cap for Mapudungun editathon on 2026-08-29 (T435523)]], [[gerrit:1326848|Disable Wikidata Bridge on Catalan Wikipedia (T433713)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2450865 wikitext text/x-wiki 5fgt0r9vd7klfhxdkfrveofu9igq8n0 2450866 2450865 2026-08-24T13:25:58Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'llm' . 2450866 wikitext text/x-wiki k6l8vnbylmagyypxru255i8tvat39y7 2450867 2450866 2026-08-24T13:26:59Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . 2450867 wikitext text/x-wiki skaugnzxxi7uyh5f9vwt0fcenqoddux 2450868 2450867 2026-08-24T13:34:39Z Stashbot 7414 Lucas_WMDE: lucaswerkmeister-wmde@deploy1003:/srv/mediawiki-staging$ echo 'https://en.wikipedia.org/static/images/mobile/copyright/wikiquote-wordmark-ar.svg' | mwscript-k8s --comment=T435505 --attach -- purgeList enwiki 2450868 wikitext text/x-wiki brxtxrdkg5pbjvrpmkat7484gxbmzct 2450869 2450868 2026-08-24T13:35:18Z Stashbot 7414 Emperor: upgrading apus codfw cluster to Reef 18.2.8 2450869 wikitext text/x-wiki ogq9by8ofrbokmfhxc2pe2l95uh2bm0 2450870 2450869 2026-08-24T13:37:06Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'llm' . 2450870 wikitext text/x-wiki 5qoqhw0hzf2bozzyt69p3x4ei4wcmhf 2450871 2450870 2026-08-24T13:37:13Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . 2450871 wikitext text/x-wiki 5f1i96ddxtorrehg1j0ewbyqazj25gy 2450872 2450871 2026-08-24T13:37:22Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . 2450872 wikitext text/x-wiki i00xsls12qstltx163c0g815fks05mt 2450873 2450872 2026-08-24T13:42:02Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: lucaswerkmeister-wmde, anzx, sadiyamohammed13: Continuing with deployment 2450873 wikitext text/x-wiki rmqq86845ep1b4lpkmuaomxs2uxahzj 2450878 2450873 2026-08-24T13:45:26Z Stashbot 7414 andrew@cumin2003: START - Cookbook sre.hosts.reimage for host cloudcephosd1041.eqiad.wmnet with OS bookworm 2450878 wikitext text/x-wiki 7q6uj2l6bijtwmt8qyntte73m00fj5k 2450879 2450878 2026-08-24T13:46:21Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Finished scap sync-world: Backport for [[gerrit:1328310|Lift IP cap for Mapudungun editathon on 2026-08-29 (T435523)]], [[gerrit:1326848|Disable Wikidata Bridge on Catalan Wikipedia (T433713)]] (duration: 23m 28s) 2450879 wikitext text/x-wiki g8g1sk2y0ugudeqgx4tikyenhra06xb 2450880 2450879 2026-08-24T13:46:26Z Stashbot 7414 Lucas_WMDE: UTC afternoon backport+config window done 2450880 wikitext text/x-wiki pluezxwm7l5p67crytj4i9vanuwjkh5 2450882 2450880 2026-08-24T13:51:26Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.mysql.update-replication 2450882 wikitext text/x-wiki 0dfmds2a11od2i000tli7fdaxkifarb 2450884 2450882 2026-08-24T13:51:42Z Stashbot 7414 fceratto@cumin1003: END (FAIL) - Cookbook sre.mysql.update-replication (exit_code=99) 2450884 wikitext text/x-wiki lqw64j1qy4ta69yuomk69j1sd6gi48a 2450887 2450884 2026-08-24T13:54:35Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.mysql.update-replication 2450887 wikitext text/x-wiki kfcljaocj38vdf30x3brk94ha3uzwf5 2450888 2450887 2026-08-24T13:54:55Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) 2450888 wikitext text/x-wiki h3vstezd8pr9fxt2dedh3a3nk66g093 2450890 2450888 2026-08-24T13:55:41Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.mysql.update-replication 2450890 wikitext text/x-wiki 00k4ehqen2ce886gdw573iw0pxl3gox 2450891 2450890 2026-08-24T13:55:53Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) 2450891 wikitext text/x-wiki ml6wri1z1gsmmr3oqgngry25lvri4f9 2450893 2450891 2026-08-24T14:07:33Z Stashbot 7414 andrew@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd1041.eqiad.wmnet with reason: host reimage 2450893 wikitext text/x-wiki m7d074l79gk1oqlbwmcrxqfqjhx0znb 2450894 2450893 2026-08-24T14:15:14Z Stashbot 7414 andrew@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd1041.eqiad.wmnet with reason: host reimage 2450894 wikitext text/x-wiki 3fzfvty1rryva5zh4ezdd7qn18ck9gl 2450895 2450894 2026-08-24T14:26:22Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on db1902.eqiad.wmnet with reason: Cloning 2450895 wikitext text/x-wiki n0fls0ukz673xakslzttgb6awh22a03 2450896 2450895 2026-08-24T14:29:14Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.mysql.update-replication 2450896 wikitext text/x-wiki 9fckxqekj7zeec7d10uqkztelx13sm5 2450897 2450896 2026-08-24T14:29:29Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) 2450897 wikitext text/x-wiki ajedpyhr9sfgaoss80i3zctkqzi042o 2450898 2450897 2026-08-24T14:30:51Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on db1903.eqiad.wmnet with reason: Cloning 2450898 wikitext text/x-wiki 71aaozsrjwwcqt2o2vleubcnq2abv4f 2450899 2450898 2026-08-24T14:31:43Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on db1903.eqiad.wmnet with reason: Cloning 2450899 wikitext text/x-wiki noq2vlurhthdhedxc21gp68t6qjdtv6 2450900 2450899 2026-08-24T14:38:21Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on db1903.eqiad.wmnet with reason: Cloning 2450900 wikitext text/x-wiki a1a5yfelru1nrqfeg2oljp9zed8uqq7 2450901 2450900 2026-08-24T14:38:41Z Stashbot 7414 gmodena@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply 2450901 wikitext text/x-wiki 87ivuczpoa6suqkq9c2atpbfv8lkeze 2450902 2450901 2026-08-24T14:41:04Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host krb1003 2450902 wikitext text/x-wiki ievz5jkjl5sdkjd9xcrf1pxs5n2ioxh 2450903 2450902 2026-08-24T14:41:25Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host krb1003 2450903 wikitext text/x-wiki 5rs42ww5gtk0nz6g86ltjd48lua3p5p 2450904 2450903 2026-08-24T14:42:00Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.dns.netbox 2450904 wikitext text/x-wiki 3m5ptc9eqi9hhxly2zi1m43jx68swva 2450905 2450904 2026-08-24T14:43:15Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.mysql.update-replication 2450905 wikitext text/x-wiki jrjwn5vzuohob59r4cifi4dpkrnf2ur 2450906 2450905 2026-08-24T14:43:35Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) 2450906 wikitext text/x-wiki 7i8p4l08d95qzabvvu9tq71tcgg0e3f 2450907 2450906 2026-08-24T14:45:54Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [krb1003] - vriley@cumin1003" 2450907 wikitext text/x-wiki 8yi2ldmmvebweendmwztttkw3oa8tw3 2450908 2450907 2026-08-24T14:45:58Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [krb1003] - vriley@cumin1003" 2450908 wikitext text/x-wiki dmw4zjujesuh8pwthr1sksuy1zw9eba 2450909 2450908 2026-08-24T14:46:02Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2450909 wikitext text/x-wiki ft2unbhiq2hxyuj345clz026qzt518w 2450912 2450909 2026-08-24T14:59:30Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/superset: apply 2450912 wikitext text/x-wiki gd0b1svbxfm78kgxjw5pa4ny4nkxig8 2450913 2450912 2026-08-24T14:59:34Z Stashbot 7414 andrew@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd1041.eqiad.wmnet with OS bookworm 2450913 wikitext text/x-wiki a5kke0wmilbp1qu7rkob3fyr0k9kfqm 2450914 2450913 2026-08-24T15:00:22Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/superset: apply 2450914 wikitext text/x-wiki mei2go9toe0mfqgatq409xoc9bsmjmr 2450915 2450914 2026-08-24T15:00:28Z Stashbot 7414 ladsgroup@deploy1003: Started scap sync-world: Backport for [[gerrit:1328626|Fix keyframe interval regression from fpsmax refactor (T318419 T435744)]] 2450915 wikitext text/x-wiki cicowk2bjw3cprfgygqlpze1mkr3d2p 2450918 2450915 2026-08-24T15:02:34Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup: Backport for [[gerrit:1328626|Fix keyframe interval regression from fpsmax refactor (T318419 T435744)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2450918 wikitext text/x-wiki 8uxvfikk2xy9d5el0qe3ycjtky94x6w 2450919 2450918 2026-08-24T15:02:39Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/superset-next: apply 2450919 wikitext text/x-wiki i4pm8zac504kwu4l6szwrlc365umcks 2450920 2450919 2026-08-24T15:03:05Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/superset-next: apply 2450920 wikitext text/x-wiki sri5gaqc4zkprura4okuwpawbfacq3a 2450922 2450920 2026-08-24T15:03:59Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup: Continuing with deployment 2450922 wikitext text/x-wiki 39hlpfw5u1gw61qeab4lfy0972b84gy 2450924 2450922 2026-08-24T15:08:36Z Stashbot 7414 ladsgroup@deploy1003: Finished scap sync-world: Backport for [[gerrit:1328626|Fix keyframe interval regression from fpsmax refactor (T318419 T435744)]] (duration: 08m 08s) 2450924 wikitext text/x-wiki 1vuzfqczbh9tsbclcn5q5q93r0l29k7 2450926 2450924 2026-08-24T15:09:57Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/spark-history: apply 2450926 wikitext text/x-wiki m95thd8qt5esdyreht8wez1twqnml2b 2450927 2450926 2026-08-24T15:10:44Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/spark-history: apply 2450927 wikitext text/x-wiki fc7rymexyf0x39qjcrbwb7fq473lj83 2450928 2450927 2026-08-24T15:10:54Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/spark-history: apply 2450928 wikitext text/x-wiki mij63k7wd0xax4fitx9s53iujajrk87 2450929 2450928 2026-08-24T15:11:31Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/spark-history: apply 2450929 wikitext text/x-wiki le060v7g7d327zziv1ha921wzt1nxol 2450930 2450929 2026-08-24T15:18:13Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.reimage for host krb1003.eqiad.wmnet with OS bookworm 2450930 wikitext text/x-wiki if88upu5drlmh21v6shmstf4wvmy19w 2450931 2450930 2026-08-24T15:23:43Z Stashbot 7414 bking@cumin2003: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host krb1003.eqiad.wmnet with OS bookworm 2450931 wikitext text/x-wiki i7yp5p80jtjf8fkwebrivukatw9m4b3 2450932 2450931 2026-08-24T15:24:18Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.reimage for host krb1003.eqiad.wmnet with OS bookworm 2450932 wikitext text/x-wiki iodb4we4v6f38b1ps1y0it1zy4k0z2t 2450933 2450932 2026-08-24T15:29:46Z Stashbot 7414 bking@cumin2003: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host krb1003.eqiad.wmnet with OS bookworm 2450933 wikitext text/x-wiki 5h6nc8vfb1l7fo85a8ry0ogb26chq0p 2450934 2450933 2026-08-24T15:34:24Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.swift.remove-ghost-objects from container wikipedia-commons-local-public.c7 in eqiad 2450934 wikitext text/x-wiki qmi0c6r05fw18vvf5tls2hofbddbcaq 2450937 2450934 2026-08-24T15:35:15Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['krb1003.eqiad.wmnet'] 2450937 wikitext text/x-wiki o1ndh1j8kaevbjnimz1ocrr770zqpj1 2450938 2450937 2026-08-24T15:36:56Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.swift.remove-ghost-objects (exit_code=0) from container wikipedia-commons-local-public.c7 in eqiad 2450938 wikitext text/x-wiki b9v7pi80wilqppbysd7ecsq48ie5jzp 2450940 2450938 2026-08-24T15:41:38Z Stashbot 7414 ladsgroup@deploy1003: helmfile [staging] START helmfile.d/services/thumbor: apply 2450940 wikitext text/x-wiki ghglrldzndsvquo0fpjln7o02bqvysb 2450941 2450940 2026-08-24T15:41:49Z Stashbot 7414 ladsgroup@deploy1003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2450941 wikitext text/x-wiki gc8jbk1njkyz9yitzh41uagbdff71yq 2450942 2450941 2026-08-24T15:42:26Z Stashbot 7414 bking@cumin2003: END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['krb1003.eqiad.wmnet'] 2450942 wikitext text/x-wiki 3qkrg5r9z5qlaw4e48icju6si3s4it9 2450943 2450942 2026-08-24T15:42:37Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['krb1003.eqiad.wmnet'] 2450943 wikitext text/x-wiki j39s9nx6uyucz4a17am0aqzifsgazai 2450944 2450943 2026-08-24T15:44:49Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2450944 wikitext text/x-wiki qa8erg0stsyt2hrrhg078wtvysnrg8x 2450945 2450944 2026-08-24T15:45:23Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2450945 wikitext text/x-wiki cr83r5qel1rtw6swyfvolj4mycd1h25 2450946 2450945 2026-08-24T15:52:16Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['krb1003.eqiad.wmnet'] 2450946 wikitext text/x-wiki 0v1ngv0f66wn8jfhsdazbf7pz8vsih4 2450947 2450946 2026-08-24T15:52:35Z Stashbot 7414 mpostoronca@deploy1003: Started scap sync-world: Backport for [[gerrit:1328280|ModelToRun: Add getContentPolicyName() before getModelName() changes (T432848)]] 2450947 wikitext text/x-wiki 14ewgmqvic9enu3hqqrvswbz6esjwww 2450948 2450947 2026-08-24T15:52:38Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['krb1003.eqiad.wmnet'] 2450948 wikitext text/x-wiki ikikh4w4t04nty0gjf58wyy7qpbcx7p 2450949 2450948 2026-08-24T15:52:44Z Stashbot 7414 bking@cumin2003: END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['krb1003.eqiad.wmnet'] 2450949 wikitext text/x-wiki grhljz3vq2nh1dyggc8urj315uf26h2 2450950 2450949 2026-08-24T15:52:52Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['krb1003.eqiad.wmnet'] 2450950 wikitext text/x-wiki c2bl4humsac77qvrck9sfw64vqqs1vp 2450951 2450950 2026-08-24T15:53:16Z Stashbot 7414 bking@cumin2003: END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['krb1003.eqiad.wmnet'] 2450951 wikitext text/x-wiki svtetl82fx84yhynwo9toggkyrwd36o 2450952 2450951 2026-08-24T15:53:32Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['krb1003.eqiad.wmnet'] 2450952 wikitext text/x-wiki 6mf78e21elzgc9wfn6eret44dhxyirb 2450953 2450952 2026-08-24T15:53:49Z Stashbot 7414 bking@cumin2003: END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['krb1003.eqiad.wmnet'] 2450953 wikitext text/x-wiki 6eiq4945mym5td97lcgcsbpz319kc8c 2450954 2450953 2026-08-24T15:54:18Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.reimage for host krb1003.eqiad.wmnet with OS bookworm 2450954 wikitext text/x-wiki 23ys6xrsvplkk27u1a2aw53unhpereq 2450955 2450954 2026-08-24T15:54:32Z Stashbot 7414 mpostoronca@deploy1003: dreamyjazz, mpostoronca: Backport for [[gerrit:1328280|ModelToRun: Add getContentPolicyName() before getModelName() changes (T432848)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2450955 wikitext text/x-wiki gkzpssl59zpafnw5zrkljztio0b6xj9 2450956 2450955 2026-08-24T15:54:46Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2450956 wikitext text/x-wiki 0wjmu5u8ml3lbhvd4ly0ejn0a2jwqwz 2450957 2450956 2026-08-24T15:54:51Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2450957 wikitext text/x-wiki hqfjlbv5p9ckq4z9x5ipdwns4wk5ftz 2450958 2450957 2026-08-24T15:55:44Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2450958 wikitext text/x-wiki ewuz2v6gnzrlxdn1kysxpxopw7qtb13 2450960 2450958 2026-08-24T15:56:11Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2450960 wikitext text/x-wiki gytlej1ss4s4m114lzebxy8xrm7jubn 2450961 2450960 2026-08-24T15:57:27Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2450961 wikitext text/x-wiki 131saokczme43o3ne9c5w6kv8as4rkm 2450962 2450961 2026-08-24T15:57:31Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2450962 wikitext text/x-wiki 9jsxo89g54xuvhz5zo11xsovmoqxvv0 2450963 2450962 2026-08-24T15:58:26Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2450963 wikitext text/x-wiki mvbjfu9wda7d01zolq59lysw9fb1jvn 2450964 2450963 2026-08-24T15:58:37Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2450964 wikitext text/x-wiki 5hnk0oekh6of19dqyiz64kkl2wji3gl 2450965 2450964 2026-08-24T15:59:07Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2450965 wikitext text/x-wiki graxx1zj7gn5rsoprmmltsop4d3v9wu 2450966 2450965 2026-08-24T15:59:11Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2450966 wikitext text/x-wiki bnu6u9vwoqxbi26s2q7g7fc6jn3pxss 2450968 2450966 2026-08-24T15:59:54Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2450968 wikitext text/x-wiki 6ity54b49yb8e70pvnebq5yznk6j0sy 2450969 2450968 2026-08-24T16:00:07Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2450969 wikitext text/x-wiki 9mcl4c1cmjz8ovja851r3hvnv15zc0x 2450970 2450969 2026-08-24T16:00:47Z Stashbot 7414 bking@cumin2003: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host krb1003.eqiad.wmnet with OS bookworm 2450970 wikitext text/x-wiki 9v17hhhsia5i1lvwln4b764ihpojmi9 2450971 2450970 2026-08-24T16:03:28Z Stashbot 7414 mpostoronca@deploy1003: dreamyjazz, mpostoronca: Continuing with deployment 2450971 wikitext text/x-wiki 7fklv36wxrse0ofmsx4czhl3db7hh5m 2450972 2450971 2026-08-24T16:04:35Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.ganeti.makevm for new host db2901.codfw.wmnet 2450972 wikitext text/x-wiki gh3xjr0174finzve2io0e7itxxid0c0 2450973 2450972 2026-08-24T16:04:38Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.dns.netbox 2450973 wikitext text/x-wiki 5j1wbqugvxjd656somh61g5vjqd23uk 2450974 2450973 2026-08-24T16:05:34Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2450974 wikitext text/x-wiki 0cmlg41b3urrs0o02ywhikoo7om5cyl 2450975 2450974 2026-08-24T16:05:39Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2450975 wikitext text/x-wiki j2knqn1joecry7itpuja6yhz2l1llme 2450976 2450975 2026-08-24T16:05:46Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2450976 wikitext text/x-wiki gkg8qlehr29czv2s596vugihqa699ln 2450977 2450976 2026-08-24T16:05:52Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2450977 wikitext text/x-wiki 229fomv5a72cz4xd65uu477eoiffr2b 2450978 2450977 2026-08-24T16:06:01Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2450978 wikitext text/x-wiki ke0ozrf7vlgxzylfu6zmnchq7f3tctx 2450979 2450978 2026-08-24T16:06:18Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2450979 wikitext text/x-wiki a68twcqvydnq9v0zunqdudtw3h49gi4 2450980 2450979 2026-08-24T16:06:29Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2450980 wikitext text/x-wiki oh9jb5j453ckz9iwn6bpn9cl1dhswfh 2450981 2450980 2026-08-24T16:06:34Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2450981 wikitext text/x-wiki 57the9b1cnmnplm2khows2ggscdygnz 2450982 2450981 2026-08-24T16:07:43Z Stashbot 7414 mpostoronca@deploy1003: Finished scap sync-world: Backport for [[gerrit:1328280|ModelToRun: Add getContentPolicyName() before getModelName() changes (T432848)]] (duration: 15m 08s) 2450982 wikitext text/x-wiki 0um8xc505x0nrune7qufs1bgm520urs 2450983 2450982 2026-08-24T16:07:46Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2450983 wikitext text/x-wiki 0bkm1ka8nynzia4s8rwjvvduiegc49f 2450984 2450983 2026-08-24T16:07:48Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2450984 wikitext text/x-wiki pfov2ciqfjt23aa8ixqnk65ot9cpn19 2450985 2450984 2026-08-24T16:10:13Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2450985 wikitext text/x-wiki covbkgchotgowctx8su2a6obwg2qigx 2450986 2450985 2026-08-24T16:10:47Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2450986 wikitext text/x-wiki f7mzzu3ycp2qyjj2gvtniwxx7vnbhap 2450991 2450986 2026-08-24T16:26:16Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . 2450991 wikitext text/x-wiki 6o88fmyxra4tut9g2a582s8kv297ccs 2450997 2450991 2026-08-24T16:39:31Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . 2450997 wikitext text/x-wiki 79y73txuk41jhs43v2q0nazkj4dvst4 2450998 2450997 2026-08-24T16:39:41Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . 2450998 wikitext text/x-wiki lfxn5cbqqye1j7jqjt0xaape8662bzg 2451001 2450998 2026-08-24T16:49:56Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM db2901.codfw.wmnet - fceratto@cumin1003" 2451001 wikitext text/x-wiki 9f6epv3err1pe6bo8rwtlsba5v946vn 2451002 2451001 2026-08-24T16:50:01Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM db2901.codfw.wmnet - fceratto@cumin1003" 2451002 wikitext text/x-wiki j5hiortylpky1kjz3p937swa6ke3fcm 2451003 2451002 2026-08-24T16:50:03Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2451003 wikitext text/x-wiki dc39k5cfsjjdycs7mat1w7mpt9bghcx 2451004 2451003 2026-08-24T16:50:07Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.dns.wipe-cache db2901.codfw.wmnet on all recursors 2451004 wikitext text/x-wiki pfmbkrk2e5taq76b4j219647ni1tvef 2451005 2451004 2026-08-24T16:50:09Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) db2901.codfw.wmnet on all recursors 2451005 wikitext text/x-wiki rm53vpqdr5h28zr9gxpp87enayxzjay 2451006 2451005 2026-08-24T16:50:40Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM db2901.codfw.wmnet - fceratto@cumin1003" 2451006 wikitext text/x-wiki b1flsb67vtcragjpf2kilezfcx8c326 2451007 2451006 2026-08-24T16:50:44Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM db2901.codfw.wmnet - fceratto@cumin1003" 2451007 wikitext text/x-wiki pen2uzee5x7yy8l4bngfvvrtgo86hsi 2451009 2451007 2026-08-24T16:50:55Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.hosts.reimage for host db2901.codfw.wmnet with OS trixie 2451009 wikitext text/x-wiki t0wdtv03l67eilrxvq3ipel1bhkvnjw 2451011 2451009 2026-08-24T16:54:04Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.reimage for host krb1003.eqiad.wmnet with OS bookworm 2451011 wikitext text/x-wiki pcdefrford13y4i26976opzjuwlsbjk 2451017 2451011 2026-08-24T17:07:37Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on krb1003.eqiad.wmnet with reason: host reimage 2451017 wikitext text/x-wiki gk4rl3mu6x0jqv3vef44q35uegobss2 2451018 2451017 2026-08-24T17:08:03Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db2901.codfw.wmnet with reason: host reimage 2451018 wikitext text/x-wiki hsjzep2f0qw9b6ihkzrngbqjtswgbdx 2451020 2451018 2026-08-24T17:12:16Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on krb1003.eqiad.wmnet with reason: host reimage 2451020 wikitext text/x-wiki 5is6ucgul7muvlpka1yrrnagl6dwhkc 2451021 2451020 2026-08-24T17:16:05Z Stashbot 7414 jayme@deploy1003: helmfile [codfw] START helmfile.d/admin 'apply'. 2451021 wikitext text/x-wiki 4nfvcduc907uxjij7q9ndbjmm9kyq63 2451023 2451021 2026-08-24T17:16:14Z Stashbot 7414 jayme@deploy1003: helmfile [codfw] DONE helmfile.d/admin 'apply'. 2451023 wikitext text/x-wiki 9yd7e7lj7be7w3ldlzw3e0g15djow44 2451024 2451023 2026-08-24T17:16:17Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2901.codfw.wmnet with reason: host reimage 2451024 wikitext text/x-wiki snbw8lhajkqv82gipvkb6o1tq400a74 2451026 2451024 2026-08-24T17:16:54Z Stashbot 7414 jayme@deploy1003: helmfile [codfw] START helmfile.d/admin 'sync'. 2451026 wikitext text/x-wiki dsv0c54lbgdumj1c7iuer4u1boj6nxi 2451034 2451026 2026-08-24T17:19:05Z Stashbot 7414 jayme@deploy1003: helmfile [codfw] DONE helmfile.d/admin 'sync'. 2451034 wikitext text/x-wiki l0xkklajl6f33ndi26ovurrphbnx1wr 2451035 2451034 2026-08-24T17:19:22Z Stashbot 7414 jayme@deploy1003: helmfile [eqiad] START helmfile.d/admin 'sync'. 2451035 wikitext text/x-wiki qj5lc5uzfnwqcebo5tm369qgdsn4kw4 2451037 2451035 2026-08-24T17:20:12Z Stashbot 7414 swfrench@deploy1003: Started scap sync-world: Noop deployment to validate pretrain httpbb check configuration - T428972 2451037 wikitext text/x-wiki ml3zh7b2vvqobjecwuxp4cdmesl0dnt 2451038 2451037 2026-08-24T17:21:26Z Stashbot 7414 jayme@deploy1003: helmfile [eqiad] DONE helmfile.d/admin 'sync'. 2451038 wikitext text/x-wiki eg6zwe18qojy65pzd5mn62al19ho239 2451039 2451038 2026-08-24T17:22:42Z Stashbot 7414 swfrench@deploy1003: Finished scap sync-world: Noop deployment to validate pretrain httpbb check configuration - T428972 (duration: 02m 30s) 2451039 wikitext text/x-wiki 4dsj0ktuyvtcxa7kk42iqv4sasm2fmk 2451040 2451039 2026-08-24T17:23:56Z Stashbot 7414 jayme@deploy1003: helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. 2451040 wikitext text/x-wiki tobkueyh95jdh3nmcw4kt0aogkygoqv 2451041 2451040 2026-08-24T17:25:21Z Stashbot 7414 jayme@deploy1003: helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. 2451041 wikitext text/x-wiki om7idy8qc5s1cpk76c95wtd1bnmdt27 2451042 2451041 2026-08-24T17:25:29Z Stashbot 7414 jayme@deploy1003: helmfile [ml-serve-codfw] START helmfile.d/admin 'sync'. 2451042 wikitext text/x-wiki 2og3i4bywwip37zt9yonyjc7lg0xs8s 2451043 2451042 2026-08-24T17:26:56Z Stashbot 7414 jayme@deploy1003: helmfile [ml-serve-codfw] DONE helmfile.d/admin 'sync'. 2451043 wikitext text/x-wiki exmdle6efoo3uavptu3qelu0im2ps2b 2451045 2451043 2026-08-24T17:29:12Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - bking@cumin2003" 2451045 wikitext text/x-wiki hb79rlpjutsfhbdbmv9xdgozs9a7xc5 2451047 2451045 2026-08-24T17:31:50Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.netbox 2451047 wikitext text/x-wiki p5z0rpvhwicjvw9tugy271o2u7eomzw 2451048 2451047 2026-08-24T17:32:27Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.hosts.reimage: Host reimage - bking@cumin2003" 2451048 wikitext text/x-wiki r3bc38a5ro2sohbwux4oly0i94w1dro 2451049 2451048 2026-08-24T17:32:30Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host krb1003.eqiad.wmnet with OS bookworm 2451049 wikitext text/x-wiki lx8cvypdipne1ttol12gu4ulq4t411z 2451051 2451049 2026-08-24T17:38:45Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update entry for telxius circuit IP in magru - cmooney@cumin1003" 2451051 wikitext text/x-wiki 6nlelniyeg0j41bfqo96m9o4s885qd9 2451052 2451051 2026-08-24T17:38:48Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update entry for telxius circuit IP in magru - cmooney@cumin1003" 2451052 wikitext text/x-wiki glihp8f03o0t02xy4d0jyq06pendpmw 2451053 2451052 2026-08-24T17:38:50Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2451053 wikitext text/x-wiki bb75e9pvokjoix78unmzp7loopqdqlm 2451054 2451053 2026-08-24T17:42:24Z Stashbot 7414 bd808@deploy1003: helmfile [staging] START helmfile.d/services/shellbox: apply 2451054 wikitext text/x-wiki hv87muz0b73pi0e1etpxvz7a4r4ja9x 2451055 2451054 2026-08-24T17:42:31Z Stashbot 7414 swfrench-wmf: disable-puppet on A:cp for ATS Lua change - T427666 2451055 wikitext text/x-wiki dkwfpt0lfdp9pyn9a6i77faepgmbncb 2451056 2451055 2026-08-24T17:43:04Z Stashbot 7414 bd808@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox: apply 2451056 wikitext text/x-wiki ds1p98zgt3l4iz9iv5e2recueb33x3x 2451057 2451056 2026-08-24T17:45:46Z Stashbot 7414 bd808@deploy1003: helmfile [staging] START helmfile.d/services/shellbox: apply 2451057 wikitext text/x-wiki ttak2vlhh5ljtoxytuf1soyqgu8r5v1 2451058 2451057 2026-08-24T17:45:55Z Stashbot 7414 bd808@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox: apply 2451058 wikitext text/x-wiki 0sc6979ixggfv7wfrhua5qpxmr39r5b 2451059 2451058 2026-08-24T17:45:58Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2901.codfw.wmnet with OS trixie 2451059 wikitext text/x-wiki gbmzww5egjz4yub5wfsuij7pvzu0id8 2451060 2451059 2026-08-24T17:46:01Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host db2901.codfw.wmnet 2451060 wikitext text/x-wiki lz77t75m0iwuj4thm1z6pkiesg0q1hh 2451061 2451060 2026-08-24T17:48:04Z Stashbot 7414 bd808@deploy1003: helmfile [staging] START helmfile.d/services/shellbox: apply 2451061 wikitext text/x-wiki dxfyw2wgfxavwd2hhvagr1n8jak747y 2451062 2451061 2026-08-24T17:48:11Z Stashbot 7414 bd808@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox: apply 2451062 wikitext text/x-wiki bdbmnj7sqyoznbhdszogrfy4e416vs5 2451063 2451062 2026-08-24T17:48:18Z Stashbot 7414 bd808@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-constraints: apply 2451063 wikitext text/x-wiki 8cbfgbn2paenoym3sq3ihpsiee46e8r 2451064 2451063 2026-08-24T17:48:56Z Stashbot 7414 bd808@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-constraints: apply 2451064 wikitext text/x-wiki t9y97h6b2lms9p1mfl0ofj6vlb9cyk6 2451065 2451064 2026-08-24T17:49:03Z Stashbot 7414 bd808@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-media: apply 2451065 wikitext text/x-wiki p1ygu1njzotilzmxz6kvca7bra915lu 2451066 2451065 2026-08-24T17:49:18Z Stashbot 7414 bd808@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-media: apply 2451066 wikitext text/x-wiki 820hzj1vr80ye0pc9ihfm9e4qpqbcuz 2451067 2451066 2026-08-24T17:49:24Z Stashbot 7414 bd808@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-syntaxhighlight: apply 2451067 wikitext text/x-wiki 5fcd65rq99ubpqhe3w6w5d85feuj4d1 2451068 2451067 2026-08-24T17:49:48Z Stashbot 7414 bd808@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-syntaxhighlight: apply 2451068 wikitext text/x-wiki 5336azbhgcwalveq6gsxi0w9xv6iiv6 2451069 2451068 2026-08-24T17:49:54Z Stashbot 7414 bd808@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-timeline: apply 2451069 wikitext text/x-wiki fw0qux3l1hkw7f7o5xzsyyvxkcnwh5w 2451070 2451069 2026-08-24T17:50:46Z Stashbot 7414 bd808@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-timeline: apply 2451070 wikitext text/x-wiki s4kznkecliuvhidfwcaqtqs7kq1sp8l 2451071 2451070 2026-08-24T17:50:53Z Stashbot 7414 bd808@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-video: apply 2451071 wikitext text/x-wiki eg9ud740diiv3ma4n994c32gqddtg6q 2451072 2451071 2026-08-24T17:51:48Z Stashbot 7414 bd808@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-video: apply 2451072 wikitext text/x-wiki r61g4rzgovosz44s55g7ahqeiapgszg 2451074 2451072 2026-08-24T17:55:33Z Stashbot 7414 swfrench-wmf: start rolling run-puppet-agent on A:cp after validation on cp4041 - T427666 2451074 wikitext text/x-wiki rawy4odku1sftck28t8g2euxbceefrb 2451075 2451074 2026-08-24T17:59:16Z Stashbot 7414 bd808@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox: apply 2451075 wikitext text/x-wiki 82jkqyl6qh2wpljpp9gfke2qalj0si9 2451076 2451075 2026-08-24T18:00:06Z Stashbot 7414 bd808@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox: apply 2451076 wikitext text/x-wiki pje6ttodf5lj66jocs7gk3au9o5aiww 2451077 2451076 2026-08-24T18:00:12Z Stashbot 7414 bd808@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-constraints: apply 2451077 wikitext text/x-wiki bgpjr10mcxc5h0ptdjhc4m3cxkau2b9 2451079 2451077 2026-08-24T18:01:15Z Stashbot 7414 bd808@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-constraints: apply 2451079 wikitext text/x-wiki g3r96t6ll00pumga3plcck2uqw8onbz 2451080 2451079 2026-08-24T18:01:21Z Stashbot 7414 bd808@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-media: apply 2451080 wikitext text/x-wiki f7wzpx28hug0e4981sqj584mkivgivw 2451081 2451080 2026-08-24T18:01:43Z Stashbot 7414 bd808@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-media: apply 2451081 wikitext text/x-wiki n55xtxzz8jjr1lj8u5i1zb2jupmy64m 2451082 2451081 2026-08-24T18:01:49Z Stashbot 7414 bd808@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-syntaxhighlight: apply 2451082 wikitext text/x-wiki jbvo9dflmdtrexbtg4jflyl7qe9o9dm 2451083 2451082 2026-08-24T18:02:19Z Stashbot 7414 bd808@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-syntaxhighlight: apply 2451083 wikitext text/x-wiki 0tunvo0isojnogcqxodl5yo23nrfprk 2451084 2451083 2026-08-24T18:02:26Z Stashbot 7414 bd808@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-timeline: apply 2451084 wikitext text/x-wiki 9ifew441yr7tcupzpa35t0m4e2tye1b 2451085 2451084 2026-08-24T18:03:10Z Stashbot 7414 bd808@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: apply 2451085 wikitext text/x-wiki adu6lqxwmuisq9wlkhby5196wfbnpf6 2451086 2451085 2026-08-24T18:03:16Z Stashbot 7414 bd808@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-video: apply 2451086 wikitext text/x-wiki gdhj6bl4ei2o17ud8273ql5utjkwsk2 2451091 2451086 2026-08-24T18:04:56Z Stashbot 7414 bd808@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-video: apply 2451091 wikitext text/x-wiki 3oy2tfzdv9590c6opzgqdstmroisbmp 2451093 2451091 2026-08-24T18:10:28Z Stashbot 7414 bd808@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox: apply 2451093 wikitext text/x-wiki pm2rsgnzyk6fj5wtoqrbdctxom2s1uv 2451094 2451093 2026-08-24T18:11:19Z Stashbot 7414 bd808@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox: apply 2451094 wikitext text/x-wiki ifule3vi272asxwuj7hhp4y2r57symd 2451095 2451094 2026-08-24T18:11:26Z Stashbot 7414 bd808@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-constraints: apply 2451095 wikitext text/x-wiki epvqyt1o6rkv2dmyf34bj3a0p9aym3h 2451096 2451095 2026-08-24T18:12:21Z Stashbot 7414 bd808@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-constraints: apply 2451096 wikitext text/x-wiki nn6067rt0ymc5newmu3msir0j9hls81 2451097 2451096 2026-08-24T18:12:27Z Stashbot 7414 bd808@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-media: apply 2451097 wikitext text/x-wiki cc2otir2671zsn71ezff2w03744odpt 2451098 2451097 2026-08-24T18:13:24Z Stashbot 7414 bd808@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-media: apply 2451098 wikitext text/x-wiki 5qdcf7wwe8hxrjaze5oplu4yflpcurf 2451099 2451098 2026-08-24T18:13:30Z Stashbot 7414 bd808@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-syntaxhighlight: apply 2451099 wikitext text/x-wiki rs7vcapwrs0jro4oj0bz0c9j0x32z8s 2451100 2451099 2026-08-24T18:14:04Z Stashbot 7414 bd808@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-syntaxhighlight: apply 2451100 wikitext text/x-wiki 6aoodzai6xye3owbqriyd0ev96thjlz 2451101 2451100 2026-08-24T18:14:07Z Stashbot 7414 bd808@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-timeline: apply 2451101 wikitext text/x-wiki acowoluznolyvs9y4461ix226omcz5o 2451102 2451101 2026-08-24T18:14:53Z Stashbot 7414 bd808@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-timeline: apply 2451102 wikitext text/x-wiki h68apch41aa07y5g6a65grz3g4x5qej 2451103 2451102 2026-08-24T18:14:59Z Stashbot 7414 bd808@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-video: apply 2451103 wikitext text/x-wiki d57jl355p2dbm3jo565jkimi5f2605v 2451104 2451103 2026-08-24T18:16:40Z Stashbot 7414 bd808@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-video: apply 2451104 wikitext text/x-wiki tk757ya0jm5jokh559pdhbkj5wj3ben 2451109 2451104 2026-08-24T18:45:36Z Stashbot 7414 urbanecm@deploy1003: Started scap sync-world: Backport for [[gerrit:1328660|[Growth] eswiki: Increase mentorship to 85% (T394867)]] 2451109 wikitext text/x-wiki iab6i6xy5q6lo6mpivlbn5i55stvvnt 2451110 2451109 2026-08-24T18:47:37Z Stashbot 7414 urbanecm@deploy1003: urbanecm: Backport for [[gerrit:1328660|[Growth] eswiki: Increase mentorship to 85% (T394867)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2451110 wikitext text/x-wiki r55zv7rr4ynirp7rarmwggzmshfl84w 2451111 2451110 2026-08-24T18:48:02Z Stashbot 7414 urbanecm@deploy1003: urbanecm: Continuing with deployment 2451111 wikitext text/x-wiki 4z62ghtdvqw560wwig46hzfbu3lxsio 2451117 2451111 2026-08-24T18:54:23Z Stashbot 7414 urbanecm@deploy1003: Finished scap sync-world: Backport for [[gerrit:1328660|[Growth] eswiki: Increase mentorship to 85% (T394867)]] (duration: 08m 47s) 2451117 wikitext text/x-wiki 7vus0ed60mrrh3chmee8ssjivj1wtyl 2451120 2451117 2026-08-24T19:09:54Z Stashbot 7414 inflatador: bking@krb2002 addprinc -randkey host/krb1003.eqiad.wmnet@WIKIMEDIA T435854 2451120 wikitext text/x-wiki 7m918snmtsa790qnxx1igl1mmn3sdyn 2451121 2451120 2026-08-24T19:10:26Z Stashbot 7414 inflatador: bking@krb2002 ktadd -k /tmp/krb1003.keytab host/krb1003.eqiad.wmnet@WIKIMEDIA T435854 2451121 wikitext text/x-wiki c1ks02k8jgkm5rhuo6euedw1gtn91n1 2451131 2451121 2026-08-24T19:40:51Z Stashbot 7414 musikanimal@deploy1003: Started scap sync-world: Backport for [[gerrit:1328386|CodeMirror: enable JSONC mode (T127682)]] 2451131 wikitext text/x-wiki t4px6j4hul8ysmgzgvj25tom2ywk7qg 2451132 2451131 2026-08-24T19:42:51Z Stashbot 7414 musikanimal@deploy1003: musikanimal: Backport for [[gerrit:1328386|CodeMirror: enable JSONC mode (T127682)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2451132 wikitext text/x-wiki bcadhh47lv1n2iikys01s0leb9782qn 2451133 2451132 2026-08-24T19:43:35Z Stashbot 7414 musikanimal@deploy1003: musikanimal: Continuing with deployment 2451133 wikitext text/x-wiki j0x2i63wae7io42d9oytsscq1v32v2d 2451134 2451133 2026-08-24T19:47:54Z Stashbot 7414 musikanimal@deploy1003: Finished scap sync-world: Backport for [[gerrit:1328386|CodeMirror: enable JSONC mode (T127682)]] (duration: 07m 04s) 2451134 wikitext text/x-wiki 8m3hcmp3si03wh0bbz3kjeib2snfxfa 2451137 2451134 2026-08-24T20:05:25Z Stashbot 7414 kemayo@deploy1003: Started scap sync-world: Backport for [[gerrit:1328674|Update VE core submodule to master (5e8709982) (T414328 T433533 T435688)]] 2451137 wikitext text/x-wiki dlongfr53nt7h0b3tzt2vfhfyhlwcll 2451138 2451137 2026-08-24T20:07:26Z Stashbot 7414 kemayo@deploy1003: kemayo: Backport for [[gerrit:1328674|Update VE core submodule to master (5e8709982) (T414328 T433533 T435688)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2451138 wikitext text/x-wiki nktapwgmisjsbnfpw9rbzyf5z9ze3wt 2451139 2451138 2026-08-24T20:09:56Z Stashbot 7414 kemayo@deploy1003: kemayo: Continuing with deployment 2451139 wikitext text/x-wiki inbpkps3qrpkr1m04m7z29a0vr04knh 2451142 2451139 2026-08-24T20:16:10Z Stashbot 7414 kemayo@deploy1003: Finished scap sync-world: Backport for [[gerrit:1328674|Update VE core submodule to master (5e8709982) (T414328 T433533 T435688)]] (duration: 10m 47s) 2451142 wikitext text/x-wiki 286tacfghl3yl7eiix1qaaqk43arfdw 2451145 2451142 2026-08-24T20:24:30Z Stashbot 7414 aaron@deploy1003: Started scap sync-world: Backport for [[gerrit:1324819|Add configurable RestModuleOverrides (T434267)]] 2451145 wikitext text/x-wiki q0hpvtnr41utw0ft939s0bwf5lxbvh8 2451146 2451145 2026-08-24T20:26:31Z Stashbot 7414 aaron@deploy1003: aaron, milazg: Backport for [[gerrit:1324819|Add configurable RestModuleOverrides (T434267)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2451146 wikitext text/x-wiki iiz141d4q8bf25yv54gfrywlnxj5nj4 2451148 2451146 2026-08-24T20:29:46Z Stashbot 7414 aaron@deploy1003: aaron, milazg: Continuing with deployment 2451148 wikitext text/x-wiki 9ww9hbdxxga1quo6cum7xfjys0oq5lh 2451149 2451148 2026-08-24T20:34:05Z Stashbot 7414 aaron@deploy1003: Finished scap sync-world: Backport for [[gerrit:1324819|Add configurable RestModuleOverrides (T434267)]] (duration: 09m 35s) 2451149 wikitext text/x-wiki 1p7cr38kf5f4sos655q0v4lhhi7lqi1 2451151 2451149 2026-08-24T20:35:58Z Stashbot 7414 aaron@deploy1003: Started scap sync-world: Backport for [[gerrit:1326410|Mark all Mathoid-based endpoints as deprecated (T431372)]] 2451151 wikitext text/x-wiki 6gbttd01quf4mbu2nzp0zzjs0wjwv2f 2451152 2451151 2026-08-24T20:38:00Z Stashbot 7414 aaron@deploy1003: aaron: Backport for [[gerrit:1326410|Mark all Mathoid-based endpoints as deprecated (T431372)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2451152 wikitext text/x-wiki 12qcve015p9td5k9wa3l9v7xqouihta 2451153 2451152 2026-08-24T20:44:11Z Stashbot 7414 aaron@deploy1003: aaron: Continuing with deployment 2451153 wikitext text/x-wiki euvehq2jp1otv57la9uouc2alndiaci 2451154 2451153 2026-08-24T20:48:31Z Stashbot 7414 aaron@deploy1003: Finished scap sync-world: Backport for [[gerrit:1326410|Mark all Mathoid-based endpoints as deprecated (T431372)]] (duration: 12m 33s) 2451154 wikitext text/x-wiki 6svmv4kc9i3n0zejn4yu7m3ec20l43a 2451155 2451154 2026-08-24T20:55:24Z Stashbot 7414 arlolra@deploy1003: Started scap sync-world: Backport for [[gerrit:1328707|Set a default for wgUseParsoidLinksUpdate in prod (T432760)]] 2451155 wikitext text/x-wiki 2iqcbx7n7a0zgmaddtyf15aox0kuwpt 2451156 2451155 2026-08-24T20:57:27Z Stashbot 7414 arlolra@deploy1003: arlolra: Backport for [[gerrit:1328707|Set a default for wgUseParsoidLinksUpdate in prod (T432760)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2451156 wikitext text/x-wiki j0e9ygbepp821lqd2oe8jl12u7lxdq0 2451157 2451156 2026-08-24T20:58:12Z Stashbot 7414 arlolra@deploy1003: arlolra: Continuing with deployment 2451157 wikitext text/x-wiki kox96fy2neznq526eq5xvv2ul5qw5tk 2451158 2451157 2026-08-24T21:02:31Z Stashbot 7414 arlolra@deploy1003: Finished scap sync-world: Backport for [[gerrit:1328707|Set a default for wgUseParsoidLinksUpdate in prod (T432760)]] (duration: 07m 07s) 2451158 wikitext text/x-wiki 17hjadywrl9pmq2lze0c9lce6vf756t 2451159 2451158 2026-08-24T21:21:25Z Stashbot 7414 sbassett: Deployed security mitigation for T435455 2451159 wikitext text/x-wiki 3uezcfdi7n8kffsmht792gmfxl9t1rt 2451160 2451159 2026-08-24T21:41:05Z Stashbot 7414 sbassett: Deployed security fix for T435624 2451160 wikitext text/x-wiki ql8fs7jtmv2n19o4vrfsaoco147iroc 2451161 2451160 2026-08-24T21:44:10Z Stashbot 7414 ryankemper@cumin2003: START - Cookbook sre.presto.roll-restart-workers for Presto an-presto cluster: Roll restart of all Presto's jvm daemons. 2451161 wikitext text/x-wiki r8xzibky49r45hlcryvss9z09j7snta 2451162 2451161 2026-08-24T21:45:08Z Stashbot 7414 ryankemper: T435861 [presto] Kicking off rolling restart to pick up `experimental.spill-enabled=false` changes 2451162 wikitext text/x-wiki 8kqf9nb3wj9jvfaxndhe0ltpqt578b5 2451163 2451162 2026-08-24T21:49:39Z Stashbot 7414 ryankemper: T435862 [presto] Rolling restart in progress to activate `experimental.spill-enabled=false `from https://gerrit.wikimedia.org/r/c/operations/puppet/+/1328713 2451163 wikitext text/x-wiki coh74lrdxgn5hty8ixrt9qqjejkcbvk 2451169 2451163 2026-08-24T22:17:51Z Stashbot 7414 ryankemper@cumin2003: END (PASS) - Cookbook sre.presto.roll-restart-workers (exit_code=0) for Presto an-presto cluster: Roll restart of all Presto's jvm daemons. 2451169 wikitext text/x-wiki 561tzluzaz0ea5bj4lptxd5gu0i6h1a 2451170 2451169 2026-08-24T22:28:56Z Stashbot 7414 RScout-WMF: Deployed security fix for T435822 2451170 wikitext text/x-wiki niq4f04hzt8fdt2bq9ip2kuixealul6 2451171 2451170 2026-08-24T22:47:35Z Stashbot 7414 maryum: Deployed security fix for T435457 2451171 wikitext text/x-wiki 130mvv0ow1u2bvf957kdcktbmlenken 2451172 2451171 2026-08-24T22:57:41Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: WikimediaAntiAbusePrivate change for T432848 synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2451172 wikitext text/x-wiki owxy1pveibkpbqz18mpo0vr7uac7xjo 2451173 2451172 2026-08-24T23:00:29Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Continuing with deployment 2451173 wikitext text/x-wiki b97stac6k2ogwqr00bt0vpdyqiog0r9 2451174 2451173 2026-08-24T23:04:51Z Stashbot 7414 dreamyjazz@deploy1003: Synchronized private/PrivateSettings.php: WikimediaAntiAbusePrivate change for T432848 (duration: 08m 59s) 2451174 wikitext text/x-wiki pmr6y9qytqu5loxj4ozhh0yp1h4ja4l 2451175 2451174 2026-08-24T23:09:30Z Stashbot 7414 jdlrobson@deploy1003: Started scap sync-world: Backport for [[gerrit:1328722|[beta] Set $wgCentralNoticeProhibitedExperiments]], [[gerrit:1328721|Deploy ReaderExperiments in fa,cs,bn]], [[gerrit:1328376|Support change tags for anonymous users on English Wikivoyage]] 2451175 wikitext text/x-wiki anu9u42dd4zo4bfakn19upysjimpms9 2451176 2451175 2026-08-24T23:11:32Z Stashbot 7414 jdlrobson@deploy1003: ksarabia, jdlrobson: Backport for [[gerrit:1328722|[beta] Set $wgCentralNoticeProhibitedExperiments]], [[gerrit:1328721|Deploy ReaderExperiments in fa,cs,bn]], [[gerrit:1328376|Support change tags for anonymous users on English Wikivoyage]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2451176 wikitext text/x-wiki ptmv5fz8njywchbft5k7vgnrpbvkozf 2451177 2451176 2026-08-24T23:14:09Z Stashbot 7414 jdlrobson@deploy1003: ksarabia, jdlrobson: Continuing with deployment 2451177 wikitext text/x-wiki auie7nv2ilkm3fsxyklba95akvu9kv8 2451178 2451177 2026-08-24T23:18:28Z Stashbot 7414 jdlrobson@deploy1003: Finished scap sync-world: Backport for [[gerrit:1328722|[beta] Set $wgCentralNoticeProhibitedExperiments]], [[gerrit:1328721|Deploy ReaderExperiments in fa,cs,bn]], [[gerrit:1328376|Support change tags for anonymous users on English Wikivoyage]] (duration: 08m 58s) 2451178 wikitext text/x-wiki r2hbglitcj7o2zmgkxrn588vqp2bn99 2451179 2451178 2026-08-24T23:57:28Z Stashbot 7414 TimStarling: on db1220 x1 wikishared created Produnto tables T421436 2451179 wikitext text/x-wiki 4ejx8ea384c08vpyihwp10z0lv910rc 2451181 2451179 2026-08-25T02:00:53Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2451181 wikitext text/x-wiki 6xed5eiq6nbinrngsk1n7ir8xeyncte 2451183 2451181 2026-08-25T02:08:21Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 07m 28s) 2451183 wikitext text/x-wiki 2jsk5hp4etycvrulgs9moa8n436gtt6 2451190 2451183 2026-08-25T03:03:20Z Stashbot 7414 mwpresync@deploy1003: Started scap sync-world: testwikis to 1.47.0-wmf.17 refs T430836 2451190 wikitext text/x-wiki 5l5fnsfimz2g21egyktwoojmqemfmog 2451191 2451190 2026-08-25T03:29:37Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db[1217,1243].eqiad.wmnet with reason: Cloning 2451191 wikitext text/x-wiki 7mmteki2hfkzzbz1eeph74lg0cjy08w 2451192 2451191 2026-08-25T03:29:55Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Remove db1243 from dbctl T435892', diff saved to https://phabricator.wikimedia.org/P96240 and previous config saved to /var/cache/conftool/dbconfig/20260825-032952-marostegui.json 2451192 wikitext text/x-wiki b3o842r5zt4o97lsluaqq6o7o5edrbh 2451193 2451192 2026-08-25T03:40:24Z Stashbot 7414 mwpresync@deploy1003: Finished scap sync-world: testwikis to 1.47.0-wmf.17 refs T430836 (duration: 37m 04s) 2451193 wikitext text/x-wiki fzzk2ikh5qw9nsol7wqezxg367ogng9 2451194 2451193 2026-08-25T04:02:31Z Stashbot 7414 mwpresync@deploy1003: Pruned MediaWiki: 1.47.0-wmf.14 (duration: 02m 24s) 2451194 wikitext text/x-wiki c8cps5ne547mt461pxjramdl6cvlgyz 2451195 2451194 2026-08-25T04:47:40Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db[2160,2235].codfw.wmnet,db[1217,1228,1243].eqiad.wmnet with reason: m5 master switch T432967 2451195 wikitext text/x-wiki 79mi81bus8xwumiqag2yx32jozd3rec 2451196 2451195 2026-08-25T04:56:54Z Stashbot 7414 marostegui: Failover m5 from db1228 to db1243 - T435895 2451196 wikitext text/x-wiki an91gty5w45eqeeuib8990er1vm0bgo 2451200 2451196 2026-08-25T07:04:52Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-product: apply 2451200 wikitext text/x-wiki gu4h2lll3fsrwlqk3egafbgeepqiw1d 2451201 2451200 2026-08-25T07:05:13Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-product: apply 2451201 wikitext text/x-wiki 0n4cx9juazqbsxsbk4kvbqjuz05h88t 2451202 2451201 2026-08-25T07:07:02Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2451202 wikitext text/x-wiki k5kaanykjowze8op5hnpswl95rxanrf 2451203 2451202 2026-08-25T07:07:48Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2451203 wikitext text/x-wiki 1byi759gbhirrknxe78xb2xkwtbnml9 2451204 2451203 2026-08-25T07:08:36Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. 2451204 wikitext text/x-wiki stx4uh6ilfdi51g0jtanwipuyw9c6eh 2451205 2451204 2026-08-25T07:08:42Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2451205 wikitext text/x-wiki adruywtpy3pxgsszgphecphe8j6vdyx 2451206 2451205 2026-08-25T07:09:11Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2451206 wikitext text/x-wiki 5p5h8p6h225eyzlhnwo3oouod4dk1vi 2451207 2451206 2026-08-25T07:09:19Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-dumps: apply 2451207 wikitext text/x-wiki mbrjl5lv9zm9l55w54uzgbg077ys439 2451208 2451207 2026-08-25T07:09:29Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. 2451208 wikitext text/x-wiki 2lg3e6jcf8de92dezmyqroyd6qrjmso 2451209 2451208 2026-08-25T07:09:49Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-dumps: apply 2451209 wikitext text/x-wiki sf12qd2uwpzvvptr1cyr6tti0hl5uyh 2451210 2451209 2026-08-25T07:10:28Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-fr-tech: apply 2451210 wikitext text/x-wiki 53co28inygfuqmzm3m83um5dltmbz32 2451211 2451210 2026-08-25T07:10:52Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-fr-tech: apply 2451211 wikitext text/x-wiki 60x2diqm5i5z2tsawa67bb1kt5iil8y 2451212 2451211 2026-08-25T07:12:02Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-main: apply 2451212 wikitext text/x-wiki i1qs4uhpss7bv0as51d8bhtymfp5y4p 2451213 2451212 2026-08-25T07:12:36Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-main: apply 2451213 wikitext text/x-wiki habr5o1a7zkb1ow4fzyru7rroaxy4rm 2451214 2451213 2026-08-25T07:12:42Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-ml: apply 2451214 wikitext text/x-wiki 5e3y2rgdi0eynl7n74k52nnqvw52rbz 2451215 2451214 2026-08-25T07:13:05Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-ml: apply 2451215 wikitext text/x-wiki 2tw7rsbrqh9oo1lj7l3uecev75tunbc 2451216 2451215 2026-08-25T07:13:19Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-platform-eng: apply 2451216 wikitext text/x-wiki td4cxay9szymp7mwhb4ysrdir667k66 2451217 2451216 2026-08-25T07:13:52Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-platform-eng: apply 2451217 wikitext text/x-wiki 6kvqqty9uj2wmudxnpwd2ir0gclzluh 2451218 2451217 2026-08-25T07:14:00Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-research: apply 2451218 wikitext text/x-wiki ol590lwb968oa6poj2him5g1zq6dd93 2451219 2451218 2026-08-25T07:14:22Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-research: apply 2451219 wikitext text/x-wiki ljctvnd6moorhhucffr3ewwymhj4n40 2451220 2451219 2026-08-25T07:14:49Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-search: apply 2451220 wikitext text/x-wiki r5mu6ds2f5wblt8u1ybwvi3bssugcue 2451221 2451220 2026-08-25T07:15:31Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-search: apply 2451221 wikitext text/x-wiki taghdej04ygmdme6ewpmzqpfq8m1760 2451222 2451221 2026-08-25T07:15:51Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-sre: apply 2451222 wikitext text/x-wiki az1dui94plkwjawrz49qxiecukceqht 2451223 2451222 2026-08-25T07:16:23Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-sre: apply 2451223 wikitext text/x-wiki rt72sklnf1m0v0log39wl2t8psz2zgc 2451224 2451223 2026-08-25T07:17:33Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2451224 wikitext text/x-wiki jgig9l8b2qnvvdvtatoch6npcf30wjo 2451225 2451224 2026-08-25T07:17:56Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2451225 wikitext text/x-wiki nw42zb3lj954l5z0yb5wjtv2lruzwf3 2451226 2451225 2026-08-25T07:18:03Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-wikidata: apply 2451226 wikitext text/x-wiki tmf6jaq8d3502ys1luy37h2heyquybv 2451227 2451226 2026-08-25T07:18:40Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-wikidata: apply 2451227 wikitext text/x-wiki 2vj7di0fke18bgswvw7k1qhebuc6zz3 2451228 2451227 2026-08-25T07:19:12Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-wmde: apply 2451228 wikitext text/x-wiki 01t3tunosimixxafmcpz00d4u7jxod3 2451229 2451228 2026-08-25T07:19:51Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-wmde: apply 2451229 wikitext text/x-wiki s5gxs1jeyie4mgb2g2q4esdq8ytrkku 2451230 2451229 2026-08-25T07:24:48Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-product: apply 2451230 wikitext text/x-wiki kmm2e9v9emua9bu7807petta7wqh8ku 2451231 2451230 2026-08-25T07:24:57Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-product: apply 2451231 wikitext text/x-wiki gcwl273q93vdev5c199gaen10vo990g 2451232 2451231 2026-08-25T07:25:08Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/superset-next: apply 2451232 wikitext text/x-wiki 2hrtzwihbej7fng28zifs1wekn5jrej 2451233 2451232 2026-08-25T07:26:12Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/superset-next: apply 2451233 wikitext text/x-wiki 19g1atprzvidzlf5bwqrfhclscm1rpj 2451234 2451233 2026-08-25T07:26:14Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/superset: apply 2451234 wikitext text/x-wiki m14bsc79fdr9lhq31gwxjluxdq3ba8z 2451235 2451234 2026-08-25T07:27:16Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/superset: apply 2451235 wikitext text/x-wiki 6mma2ff0nwlx198golm3f2979tv8pmm 2451236 2451235 2026-08-25T07:27:18Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook-next: apply 2451236 wikitext text/x-wiki agehajcn4jr1uov0q2ur9ky4eqbe496 2451237 2451236 2026-08-25T07:28:41Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthboo-next: apply 2451237 wikitext text/x-wiki 4qm074dyf0cb3x9og1ia7xsrj8evpf8 2451238 2451237 2026-08-25T07:28:44Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook: apply 2451238 wikitext text/x-wiki lubfybr5ypm56g4zsjaxgt902bg652x 2451239 2451238 2026-08-25T07:29:09Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthbook: apply 2451239 wikitext text/x-wiki 281zvzmqxfifeokzh8h5pmjvz1cb1xt 2451240 2451239 2026-08-25T07:29:11Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/spark-history: apply 2451240 wikitext text/x-wiki 9o9t0hx5kv7j35smzqs4gj8csahqj8h 2451241 2451240 2026-08-25T07:30:16Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/spark-history: apply 2451241 wikitext text/x-wiki dj4pej41ab8v2zs5jrnv3vyqwllepwe 2451242 2451241 2026-08-25T07:30:19Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/spark-history: apply 2451242 wikitext text/x-wiki jv11lrbsrw2pyi0iab9jjo9y0hzfa71 2451243 2451242 2026-08-25T07:31:28Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/spark-history: apply 2451243 wikitext text/x-wiki ht3taz5fkqj2rzn5u7khunq9t8mh7ey 2451248 2451243 2026-08-25T07:46:36Z Stashbot 7414 filippo@cumin1003: START - Cookbook sre.hosts.reboot-single for host cloudvirt1049.eqiad.wmnet 2451248 wikitext text/x-wiki 66zlgj4wwwhpjytlmii9546n5o39c0z 2451249 2451248 2026-08-25T07:48:41Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on db1901.eqiad.wmnet with reason: Cloning 2451249 wikitext text/x-wiki 5d9ys2oqe3bfcuczoahtl8c8snhgr53 2451250 2451249 2026-08-25T07:52:20Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.mysql.update-replication 2451250 wikitext text/x-wiki 317bi3jq2a05t9jjp943ixssc2ypcyc 2451251 2451250 2026-08-25T07:53:17Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.mysql.update-replication (exit_code=0) 2451251 wikitext text/x-wiki 6udufopb36m5gdhk7fjh3fw4d83712f 2451253 2451251 2026-08-25T08:07:01Z Stashbot 7414 jelto@dns1004: START - running authdns-update 2451253 wikitext text/x-wiki fzzo614lxcyemq6lo964nw7xrtlv2m8 2451254 2451253 2026-08-25T08:09:21Z Stashbot 7414 jelto@dns1004: END - running authdns-update 2451254 wikitext text/x-wiki jv4jf0k08izjqv8tyvm0odcs6c5esd3 2451255 2451254 2026-08-25T08:14:57Z Stashbot 7414 hashar@deploy1003: rebuilt and synchronized wikiversions files: group0 to 1.47.0-wmf.17 refs T430836 2451255 wikitext text/x-wiki sukabyiax7a2vya631c67ngpfwybf1i 2451257 2451255 2026-08-25T08:17:29Z Stashbot 7414 filippo@cumin1003: END (ERROR) - Cookbook sre.hosts.reboot-single (exit_code=97) for host cloudvirt1049.eqiad.wmnet 2451257 wikitext text/x-wiki ll95c16lw7b60lzva34uh7hu7y9yn09 2451258 2451257 2026-08-25T08:17:58Z Stashbot 7414 godog: put cloudvirts back in service T431682 2451258 wikitext text/x-wiki bislf4b1dsi8g98akom4nhau3uehdfc 2451261 2451258 2026-08-25T08:22:56Z Stashbot 7414 filippo@cumin1003: START - Cookbook sre.hosts.reimage for host cloudvirt1049.eqiad.wmnet with OS trixie 2451261 wikitext text/x-wiki mw8arbk5u7ulstnsdiz5rxi12crg1bd 2451263 2451261 2026-08-25T08:24:06Z Stashbot 7414 filippo@cumin1003: START - Cookbook sre.hosts.reimage for host cloudvirt1051.eqiad.wmnet with OS trixie 2451263 wikitext text/x-wiki 5dctho5n6m3kilxz3855kgrn18dj3pe 2451266 2451263 2026-08-25T08:29:26Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Add db1276 to dbctl T407942', diff saved to https://phabricator.wikimedia.org/P96242 and previous config saved to /var/cache/conftool/dbconfig/20260825-082922-marostegui.json 2451266 wikitext text/x-wiki lonl3otrj2g5qdh8xhkcmreaku2dflb 2451267 2451266 2026-08-25T08:29:30Z Stashbot 7414 moritzm: installing Expat security updates 2451267 wikitext text/x-wiki qig4nryojl9gnhhyfkat4k27rahuqen 2451268 2451267 2026-08-25T08:29:44Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool db1276: Pool back 2451268 wikitext text/x-wiki bsw5tpdthljl9cx3mmu10l6irpg5uaj 2451269 2451268 2026-08-25T08:31:47Z Stashbot 7414 gmodena@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply 2451269 wikitext text/x-wiki e2cc80brl86hr0q3qm4tfke9jwijc52 2451272 2451269 2026-08-25T08:39:56Z Stashbot 7414 filippo@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1051.eqiad.wmnet with reason: host reimage 2451272 wikitext text/x-wiki az882y37591s8f0rqxs7qu4zpekahg0 2451273 2451272 2026-08-25T08:40:41Z Stashbot 7414 filippo@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on cloudvirt1049.eqiad.wmnet with reason: host reimage 2451273 wikitext text/x-wiki tcedyft8t30503nx299mw28rxwzjk6r 2451274 2451273 2026-08-25T08:43:46Z Stashbot 7414 filippo@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1051.eqiad.wmnet with reason: host reimage 2451274 wikitext text/x-wiki h9beroryqhkwdpa3omvp8uefu02pscx 2451275 2451274 2026-08-25T08:43:55Z Stashbot 7414 atsuko@dns1004: START - running authdns-update 2451275 wikitext text/x-wiki 4ncmp8piqk9nktxfc0ipavx8oirgst3 2451276 2451275 2026-08-25T08:44:26Z Stashbot 7414 atsuko@dns1004: START - running authdns-update 2451276 wikitext text/x-wiki n2dltgsy8xf0y1m1kjdfmhigw18zl4u 2451277 2451276 2026-08-25T08:46:44Z Stashbot 7414 atsuko@dns1004: END - running authdns-update 2451277 wikitext text/x-wiki 1hcdzjupoi7pioeagwo3dd6qjihr014 2451278 2451277 2026-08-25T08:47:09Z Stashbot 7414 filippo@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudvirt1049.eqiad.wmnet with reason: host reimage 2451278 wikitext text/x-wiki cnnr3vk7ar3t35a8e4qrfm2vmmjwnb2 2451280 2451278 2026-08-25T08:51:55Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply 2451280 wikitext text/x-wiki 45jnlsok93unmx5rbabix1p5678e26m 2451281 2451280 2026-08-25T08:52:04Z Stashbot 7414 mszwarc@deploy1003: Started scap sync-world: Backport for [[gerrit:1329222|enwikivoyage: Fix the applychangetags assignment to '*' (T435907)]] 2451281 wikitext text/x-wiki luelzol2w6dgirjwj5z3bwf6j7s9pav 2451282 2451281 2026-08-25T08:52:13Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply 2451282 wikitext text/x-wiki jqaik72i8e85sjalakmjaqo4z18az90 2451283 2451282 2026-08-25T08:54:22Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply 2451283 wikitext text/x-wiki asltg4bi8wa0b3l3gkqc81tf5fugeef 2451284 2451283 2026-08-25T08:54:26Z Stashbot 7414 mszwarc@deploy1003: mszwarc: Backport for [[gerrit:1329222|enwikivoyage: Fix the applychangetags assignment to '*' (T435907)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2451284 wikitext text/x-wiki 69zcprhxe57bvu0dkluh3h3nm1bqgum 2451287 2451284 2026-08-25T08:54:49Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply 2451287 wikitext text/x-wiki 1iynd9i7mb0thbuqg1gw4lbw8xuayjw 2451288 2451287 2026-08-25T08:55:12Z Stashbot 7414 mszwarc@deploy1003: mszwarc: Continuing with deployment 2451288 wikitext text/x-wiki t9prntqxhoi5xjc9fosf2f9zr31bc0l 2451289 2451288 2026-08-25T08:56:38Z Stashbot 7414 jelto@cumin1003: START - Cookbook sre.loadbalancer.migrate-service-ipip for alias: wikikube-worker-codfw@codfw 2451289 wikitext text/x-wiki k53vlmp478s4us7css43tnbvn0dgvnm 2451290 2451289 2026-08-25T09:00:38Z Stashbot 7414 mszwarc@deploy1003: Finished scap sync-world: Backport for [[gerrit:1329222|enwikivoyage: Fix the applychangetags assignment to '*' (T435907)]] (duration: 08m 34s) 2451290 wikitext text/x-wiki g08v48ouf422z4il3atx5ejxccsx63j 2451291 2451290 2026-08-25T09:14:48Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1276: Pool back 2451291 wikitext text/x-wiki crxh2k4pl5ir0grf2p2cx45xy2eq047 2451292 2451291 2026-08-25T09:20:14Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.mysql.decommission 2451292 wikitext text/x-wiki 48q4a0x9srus3s60iducwd54yej4j71 2451293 2451292 2026-08-25T09:20:26Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.hosts.decommission for hosts db-test1001.eqiad.wmnet 2451293 wikitext text/x-wiki nz6ldaoij6zjw63mjac2dlqge5qib17 2451294 2451293 2026-08-25T09:25:27Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.dns.netbox 2451294 wikitext text/x-wiki te3fec0zu1pnhzrtu0ydr5flgt69a8r 2451295 2451294 2026-08-25T09:30:43Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.netbox 2451295 wikitext text/x-wiki 2nzb91e0cl6e7nny7j8df3yp390jlun 2451296 2451295 2026-08-25T09:34:58Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db-test1001.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - fceratto@cumin1003" 2451296 wikitext text/x-wiki es2ts4ufkbyrniq61n5vqdc7h0rppax 2451297 2451296 2026-08-25T09:35:19Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db-test1001.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - fceratto@cumin1003" 2451297 wikitext text/x-wiki oop2f8ezeaecelxcjlj99lxo4yg48hu 2451298 2451297 2026-08-25T09:35:21Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2451298 wikitext text/x-wiki 95huglprai9p4jj4fi44g3z7outumsn 2451299 2451298 2026-08-25T09:35:24Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db-test1001.eqiad.wmnet 2451299 wikitext text/x-wiki ndte09xgkbaocvo7pvobg2tni2e7oct 2451301 2451299 2026-08-25T09:36:33Z Stashbot 7414 cmooney@cumin1003: END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) 2451301 wikitext text/x-wiki dou9cm6p6o9u3ay5g8if2e0q1hpykho 2451302 2451301 2026-08-25T09:36:44Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.netbox 2451302 wikitext text/x-wiki ofae44h5vnqnjzb3k3hetyk5mtmcx3h 2451303 2451302 2026-08-25T09:39:13Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2451303 wikitext text/x-wiki mzjtmpdlv7g0rvcw5k29oa6t35e7m13 2451304 2451303 2026-08-25T09:40:14Z Stashbot 7414 jelto@cumin1003: START - Cookbook sre.loadbalancer.restart-pybal rolling-restart of pybal on (A:lvs-low-traffic-codfw or A:lvs-secondary-codfw) and A:bullseye and A:lvs 2451304 wikitext text/x-wiki qn1pm99doglq3ontyxl8ck4bxuclaz6 2451305 2451304 2026-08-25T09:41:45Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on db2901.codfw.wmnet with reason: Cloning 2451305 wikitext text/x-wiki e7u41oj7q72o2ttkf4c0ed6fm2h3p3r 2451306 2451305 2026-08-25T09:42:49Z Stashbot 7414 jelto@cumin1003: END (PASS) - Cookbook sre.loadbalancer.restart-pybal (exit_code=0) rolling-restart of pybal on (A:lvs-low-traffic-codfw or A:lvs-secondary-codfw) and A:bullseye and A:lvs 2451306 wikitext text/x-wiki 6zpnk5lavj70odhtgoryynl1nj3080c 2451307 2451306 2026-08-25T09:42:51Z Stashbot 7414 jelto@cumin1003: END (PASS) - Cookbook sre.loadbalancer.migrate-service-ipip (exit_code=0) for alias: wikikube-worker-codfw@codfw 2451307 wikitext text/x-wiki ef3qgwiulc0zm1ztfktesu3sl8pr5zk 2451308 2451307 2026-08-25T09:43:49Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Add db1176 and db2230 to dbctl T427059', diff saved to https://phabricator.wikimedia.org/P96248 and previous config saved to /var/cache/conftool/dbconfig/20260825-094345-marostegui.json 2451308 wikitext text/x-wiki 58pw4hhayj4seygatk094u0lc2ct9f6 2451309 2451308 2026-08-25T09:46:11Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Add test-s4 to dbctl T427059', diff saved to https://phabricator.wikimedia.org/P96249 and previous config saved to /var/cache/conftool/dbconfig/20260825-094607-marostegui.json 2451309 wikitext text/x-wiki b9i4uwd37dsqy2pqqb6ka7cft4im3xt 2451311 2451309 2026-08-25T09:54:40Z Stashbot 7414 filippo@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1051.eqiad.wmnet with OS trixie 2451311 wikitext text/x-wiki 1o00av3iraoadflqkvtkjw2mxc7eu1h 2451312 2451311 2026-08-25T09:58:15Z Stashbot 7414 filippo@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host cloudvirt1051 2451312 wikitext text/x-wiki b2en2cd1agqurneic3amccj87hr9yww 2451313 2451312 2026-08-25T09:58:44Z Stashbot 7414 filippo@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudvirt1049.eqiad.wmnet with OS trixie 2451313 wikitext text/x-wiki a6vlqe8a0k2ih3ztb7om2fdzt50cqhf 2451314 2451313 2026-08-25T09:58:46Z Stashbot 7414 filippo@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudvirt1051 2451314 wikitext text/x-wiki aev67muytbncvtxgnk2md33ql169igl 2451315 2451314 2026-08-25T10:02:23Z Stashbot 7414 filippo@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host cloudvirt1051 2451315 wikitext text/x-wiki 7a3ci8u6fvhfxssam71zwc0d9rbnq9r 2451316 2451315 2026-08-25T10:02:53Z Stashbot 7414 filippo@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudvirt1051 2451316 wikitext text/x-wiki 1iq2jspgb6x9r0tufvj7qvg3iyz9zl8 2451318 2451316 2026-08-25T10:09:00Z Stashbot 7414 filippo@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host cloudvirt1051 2451318 wikitext text/x-wiki ne75n1i5d0wtay7dsw57h0zelgdl9oo 2451319 2451318 2026-08-25T10:09:39Z Stashbot 7414 filippo@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudvirt1051 2451319 wikitext text/x-wiki gmm6qetsmpq18l6y4t6p4x4cfiifc5v 2451320 2451319 2026-08-25T10:12:07Z Stashbot 7414 Emperor: upgrading apus eqiad cluster to Reef 18.2.8 2451320 wikitext text/x-wiki 8hdi34ml0jd95gd5v4efsqrne0z5fru 2451321 2451320 2026-08-25T10:12:45Z Stashbot 7414 filippo@cumin1003: START - Cookbook sre.hosts.reboot-single for host cloudvirt1054.eqiad.wmnet 2451321 wikitext text/x-wiki tubttplkxt400ltv45h1qasxur4lfa1 2451323 2451321 2026-08-25T10:19:03Z Stashbot 7414 filippo@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudvirt1054.eqiad.wmnet 2451323 wikitext text/x-wiki 0xsvwk6814hhvo25dv5aq9q3q1kzzku 2451325 2451323 2026-08-25T10:22:45Z Stashbot 7414 filippo@cumin1003: START - Cookbook sre.hosts.reboot-single for host cloudvirt1055.eqiad.wmnet 2451325 wikitext text/x-wiki jov3v6dd52xuxfkvoey7241u0j5lfqy 2451326 2451325 2026-08-25T10:23:02Z Stashbot 7414 filippo@cumin1003: START - Cookbook sre.hosts.reboot-single for host cloudvirt1056.eqiad.wmnet 2451326 wikitext text/x-wiki 85mh3c6o0y9irsazhk8eo21tz9ak70p 2451327 2451326 2026-08-25T10:23:21Z Stashbot 7414 filippo@cumin1003: START - Cookbook sre.hosts.reboot-single for host cloudvirt1057.eqiad.wmnet 2451327 wikitext text/x-wiki 6qrdztcgap86mnwoq5y86oap3bed50g 2451328 2451327 2026-08-25T10:29:04Z Stashbot 7414 filippo@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudvirt1055.eqiad.wmnet 2451328 wikitext text/x-wiki l4vfyj0om3hopyqydzg0r786rmqij5o 2451329 2451328 2026-08-25T10:29:28Z Stashbot 7414 filippo@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudvirt1057.eqiad.wmnet 2451329 wikitext text/x-wiki iqkq7kxcepyvnwk73g6ba0j4vp40r1b 2451330 2451329 2026-08-25T10:29:31Z Stashbot 7414 filippo@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cloudvirt1056.eqiad.wmnet 2451330 wikitext text/x-wiki 3zpw170agl4byqe1lqczyo5ji9eha7r 2451344 2451330 2026-08-25T10:49:57Z Stashbot 7414 blake@deploy1003: helmfile [codfw] START helmfile.d/services/rest-gateway: apply 2451344 wikitext text/x-wiki sqwxqgbuqocsycqc1n2gt6c7npb5w45 2451345 2451344 2026-08-25T10:50:26Z Stashbot 7414 blake@deploy1003: helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply 2451345 wikitext text/x-wiki 6f75jw5xr28o5csxqsnqewvzi3yvq7z 2451346 2451345 2026-08-25T10:53:33Z Stashbot 7414 blake@deploy1003: helmfile [staging] START helmfile.d/services/rest-gateway: apply 2451346 wikitext text/x-wiki a7mrvt23zdb9i4o3ligesmwhglsj5c9 2451347 2451346 2026-08-25T10:53:52Z Stashbot 7414 blake@deploy1003: helmfile [staging] DONE helmfile.d/services/rest-gateway: apply 2451347 wikitext text/x-wiki eccoazmhf3rymdgnm39yqv712a2s58l 2451348 2451347 2026-08-25T10:55:31Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] START helmfile.d/services/rest-gateway: apply 2451348 wikitext text/x-wiki 2befptwc4z0cqqipzsubbvil4w7x9fh 2451349 2451348 2026-08-25T10:55:44Z Stashbot 7414 blake@deploy1003: helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply 2451349 wikitext text/x-wiki hap8v2pi632jpbxmk89dcs8u3614928 2451350 2451349 2026-08-25T11:07:05Z Stashbot 7414 fceratto@cumin1003: Removing db-test1001 from zarcillo T435912 2451350 wikitext text/x-wiki pt4ugm7jehg62pecg1isfiou7jarkkz 2451351 2451350 2026-08-25T11:07:09Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.mysql.decommission (exit_code=0) 2451351 wikitext text/x-wiki nl1dk1qzva8sxeo0452j4fiptksa2s8 2451352 2451351 2026-08-25T11:08:46Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 7 days, 0:00:00 on db2901.codfw.wmnet with reason: Cloning 2451352 wikitext text/x-wiki n4hs5lg4cjbcyotwcfp1z1wqwt9wdw7 2451353 2451352 2026-08-25T11:15:32Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.dns.netbox 2451353 wikitext text/x-wiki svxtr6zfe5jmejtlofke0ypbsyiesyn 2451354 2451353 2026-08-25T11:16:41Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.ganeti.makevm for new host db2903.codfw.wmnet 2451354 wikitext text/x-wiki ivvc36k0te231iqoskh631a0p3aiqei 2451355 2451354 2026-08-25T11:19:12Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'llm' for release 'main' . 2451355 wikitext text/x-wiki 2s3o7qv9mpavv6b3yik93jnrwzx21vk 2451356 2451355 2026-08-25T11:20:08Z Stashbot 7414 jmm@deploy1003: helmfile [staging] START helmfile.d/services/proton: apply 2451356 wikitext text/x-wiki 0nesgh6e1lx85au13d3ddl0j7v3qzef 2451357 2451356 2026-08-25T11:21:18Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.dns.netbox 2451357 wikitext text/x-wiki fvvrj2gwds00cfli8p3lxhydtfunsxt 2451358 2451357 2026-08-25T11:22:02Z Stashbot 7414 jmm@deploy1003: helmfile [staging] DONE helmfile.d/services/proton: apply 2451358 wikitext text/x-wiki dwmx3c24gi245xv3cxg79tobeh6gtvx 2451359 2451358 2026-08-25T11:24:13Z Stashbot 7414 jmm@deploy1003: helmfile [codfw] START helmfile.d/services/proton: apply 2451359 wikitext text/x-wiki rcyes9wt28m5p9wizw09jh2vpoo6ecz 2451360 2451359 2026-08-25T11:25:38Z Stashbot 7414 jmm@deploy1003: helmfile [codfw] DONE helmfile.d/services/proton: apply 2451360 wikitext text/x-wiki bb5wpi34lj8cvqqws2x32amgltmhz6d 2451361 2451360 2026-08-25T11:25:50Z Stashbot 7414 jmm@deploy1003: helmfile [eqiad] START helmfile.d/services/proton: apply 2451361 wikitext text/x-wiki jhid247rz3fk8mxh7tpbey7er9pf8z5 2451362 2451361 2026-08-25T11:27:04Z Stashbot 7414 jmm@deploy1003: helmfile [eqiad] DONE helmfile.d/services/proton: apply 2451362 wikitext text/x-wiki p3bvemsnm4oxon12guno3aj9nook3nb 2451363 2451362 2026-08-25T11:27:26Z Stashbot 7414 fceratto@cumin1003: END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) 2451363 wikitext text/x-wiki sey737qs0b7os0qtacvyjf9thr2926b 2451364 2451363 2026-08-25T11:27:32Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.dns.netbox 2451364 wikitext text/x-wiki hwbssvu9u95hdngzq0kfo66rtpzp1oy 2451365 2451364 2026-08-25T11:28:19Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'llm' for release 'main' . 2451365 wikitext text/x-wiki dql2orwnxaidy5aga59mpj1sb9ng9p7 2451366 2451365 2026-08-25T11:28:31Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Delete db2901 ipv6 addr - fceratto@cumin1003" 2451366 wikitext text/x-wiki nwbja463ft5vv0xpro9jzd92pgkd0zt 2451367 2451366 2026-08-25T11:28:36Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Delete db2901 ipv6 addr - fceratto@cumin1003" 2451367 wikitext text/x-wiki kfp7ymmx8hw55g5pqldn7wgxpt7ddyt 2451368 2451367 2026-08-25T11:28:39Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2451368 wikitext text/x-wiki syir5awrkcm0m72fng0gjqv0tbfakg4 2451369 2451368 2026-08-25T11:31:47Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM db2903.codfw.wmnet - fceratto@cumin1003" 2451369 wikitext text/x-wiki eqi2x2wsd2vkxjiqzdo8ra3n6r89q8h 2451370 2451369 2026-08-25T11:31:51Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM db2903.codfw.wmnet - fceratto@cumin1003" 2451370 wikitext text/x-wiki 3zifzzbburge7hcu2jw2lsvqei6r02m 2451371 2451370 2026-08-25T11:31:53Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2451371 wikitext text/x-wiki hi14azso5f4aalxfplxlt124wgis8j9 2451372 2451371 2026-08-25T11:31:57Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.dns.wipe-cache db2903.codfw.wmnet on all recursors 2451372 wikitext text/x-wiki 2vmind8vzn9jul20wsnyadqlz824d9m 2451373 2451372 2026-08-25T11:32:00Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) db2903.codfw.wmnet on all recursors 2451373 wikitext text/x-wiki 3y0mr9baf0flh43u5fue4inh2gefxyb 2451374 2451373 2026-08-25T11:32:27Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM db2903.codfw.wmnet - fceratto@cumin1003" 2451374 wikitext text/x-wiki me6s0w1apevcj3s5x8r1gbrboky8iaa 2451375 2451374 2026-08-25T11:32:31Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM db2903.codfw.wmnet - fceratto@cumin1003" 2451375 wikitext text/x-wiki edk8idy28fyh2ae8gu5zt1igzi2m3cb 2451376 2451375 2026-08-25T11:34:05Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'llm' for release 'main' . 2451376 wikitext text/x-wiki lhjidrugoau5u9lexbmq9kmvzp08ktt 2451377 2451376 2026-08-25T11:34:15Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'llm' for release 'main' . 2451377 wikitext text/x-wiki tdtbpf3iue0jm07xhnvbzalolghg8mm 2451379 2451377 2026-08-25T11:38:17Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.hosts.reimage for host db2903.codfw.wmnet with OS trixie 2451379 wikitext text/x-wiki dkef40qka9mtmxg2gbsds71q552133y 2451380 2451379 2026-08-25T11:38:51Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'article-models' for release 'main' . 2451380 wikitext text/x-wiki gtsolmwwfvm337avx78jjt7102xyvvk 2451381 2451380 2026-08-25T11:47:55Z Stashbot 7414 ladsgroup@deploy1003: Started scap sync-world: Backport for [[gerrit:1329255|etcd: Ignore test-s4 in externalLoads too (T435059)]] 2451381 wikitext text/x-wiki 5zkw5wu8fezk9vgrkyzktic7xhmqv7t 2451382 2451381 2026-08-25T11:49:45Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'article-models' for release 'main' . 2451382 wikitext text/x-wiki 9932hs1l55fsac7n2yitfdrdu1ghctb 2451383 2451382 2026-08-25T11:49:53Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'article-models' for release 'main' . 2451383 wikitext text/x-wiki 83pmge5hnrjuwm5e4vb9ze0wk6ouuj1 2451384 2451383 2026-08-25T11:50:10Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup: Backport for [[gerrit:1329255|etcd: Ignore test-s4 in externalLoads too (T435059)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2451384 wikitext text/x-wiki rdydt2hm07i4z0kr2s0yyhibkjqt1ym 2451385 2451384 2026-08-25T11:50:43Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup: Continuing with deployment 2451385 wikitext text/x-wiki klv4ngb9s438432mci71sqlpc1zjrws 2451386 2451385 2026-08-25T11:53:02Z Stashbot 7414 fceratto@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db2903.codfw.wmnet with reason: host reimage 2451386 wikitext text/x-wiki j2g78nxudi1ifjadyvmxlhu5b3u2ood 2451387 2451386 2026-08-25T11:55:09Z Stashbot 7414 ladsgroup@deploy1003: Finished scap sync-world: Backport for [[gerrit:1329255|etcd: Ignore test-s4 in externalLoads too (T435059)]] (duration: 07m 13s) 2451387 wikitext text/x-wiki hhbqc154n6n2zdgqab26b3cybemb0as 2451388 2451387 2026-08-25T11:58:46Z Stashbot 7414 fceratto@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2903.codfw.wmnet with reason: host reimage 2451388 wikitext text/x-wiki jdl1u0few7y4015qa5sed5k7cqvn0vn 498 9925 2451245 2430788 2026-08-25T07:35:10Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.remove_instance for instance deployment-ircd03 2451245 wikitext text/x-wiki 4t9mxkbxpn2egnanatyfscp9uxa56hn 2451247 2451245 2026-08-25T07:35:31Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance deployment-ircd03 2451247 wikitext text/x-wiki 9zmcrr51loskozr13mdxlq3g1pf5n3q 0 14218 2450911 2423654 2026-08-24T14:51:31Z FCeratto-WMF 39104 Add testbed 2450911 wikitext text/x-wiki mid6aaq33efoqyzyiritkbguzg36uyn 0 17290 2451244 2450719 2026-08-25T07:35:09Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.remove_instance for instance deployment-ircd03 2451244 wikitext text/x-wiki 4hcxp1g7c57sa979dp0n9vsqwifeclj 2451246 2451244 2026-08-25T07:35:31Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance deployment-ircd03 2451246 wikitext text/x-wiki hr8g3w8a9xzw4uoyubb7jnyrpq3xdjb 0 21400 2451300 2201791 2026-08-25T09:35:55Z KCVelaga (WMF) 38150 /* Hive tables */ +api 2451300 wikitext text/x-wiki q383dzhgdygehjnwb7axqv3hv95etmh 498 30942 2450874 2450660 2026-08-24T13:43:22Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.bootstrap_and_add 2450874 wikitext text/x-wiki tmi6eegiuuvma8hdrfg6cupkub26wvk 2450875 2450874 2026-08-24T13:43:27Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=0) 2450875 wikitext text/x-wiki ri0qche7p6j4duyg3i1zyxrilh0f0ga 2450876 2450875 2026-08-24T13:44:29Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.reactivate 2450876 wikitext text/x-wiki f9wc7nucnwya5f3rp8p9u9o21ksk3bi 2450877 2450876 2026-08-24T13:44:34Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.ceph.osd.reactivate (exit_code=0) 2450877 wikitext text/x-wiki hestf81cv6cq6oeh3m34uww006m17g6 2450916 2450877 2026-08-24T15:00:38Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.bootstrap_and_add 2450916 wikitext text/x-wiki 8r4r5bm0nghm2c3uxwngqjmsnrbv8m1 2450917 2450916 2026-08-24T15:00:41Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=0) 2450917 wikitext text/x-wiki kixfjeqen55d3b9trr7jfl6lpsonxbt 2450923 2450917 2026-08-24T15:04:12Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.bootstrap_and_add 2450923 wikitext text/x-wiki 5r4rwi4pvw67l0hztn9tkpmt61uuybo 2450936 2450923 2026-08-24T15:35:11Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1080.eqiad.wmnet' (T435537) 2450936 wikitext text/x-wiki mr3egtjv18cd9ik8svy4en16jb7n66k 2450967 2450936 2026-08-24T15:59:18Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=0) on host 'cloudvirt1080.eqiad.wmnet' (T435537) 2450967 wikitext text/x-wiki id4bncd4dzz0s1q1ed9h8jh04z2mjk3 2450987 2450967 2026-08-24T16:25:05Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (T435537) 2450987 wikitext text/x-wiki jh8w0qandi4kx85b6g04ws5b8eyvbdw 2450988 2450987 2026-08-24T16:25:10Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) (T435537) 2450988 wikitext text/x-wiki t7oqya4jvwmswfffd698j2vlyqhbj0e 2450996 2450988 2026-08-24T16:33:15Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1079.eqiad.wmnet' (T435537) 2450996 wikitext text/x-wiki acomwhzb9b6qbx01pohgspt5n30kfm9 2451019 2450996 2026-08-24T17:10:58Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=0) on host 'cloudvirt1079.eqiad.wmnet' (T435537) 2451019 wikitext text/x-wiki skvrx2r4zrnuebhpcab9vsy1m85jxee 2451029 2451019 2026-08-24T17:17:46Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (T435537) 2451029 wikitext text/x-wiki o1fxte5435r0pm62glemlgn2jc4al5d 2451030 2451029 2026-08-24T17:17:51Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) (T435537) 2451030 wikitext text/x-wiki pwwf0tg2hi1ilvb48weiit8eigr6rhv 2451033 2451030 2026-08-24T17:19:01Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1078.eqiad.wmnet' (T435537) 2451033 wikitext text/x-wiki 8zvq64sb72flt0eg2x6dxow28yeuj20 2451073 2451033 2026-08-24T17:53:50Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=0) on host 'cloudvirt1078.eqiad.wmnet' (T435537) 2451073 wikitext text/x-wiki 7530iodivnp5za4rznfovt08yuupnby 2451087 2451073 2026-08-24T18:04:14Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (T435537) 2451087 wikitext text/x-wiki gxhgz6xqsn05m2s7580htufdassf0y9 2451088 2451087 2026-08-24T18:04:18Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) (T435537) 2451088 wikitext text/x-wiki n1vzyxkpzj9h7id38j8abqms0eofbb6 2451092 2451088 2026-08-24T18:05:06Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.drain on host 'cloudvirt1077.eqiad.wmnet' (T435537) 2451092 wikitext text/x-wiki fuxo9t82j596fxckmonuqzo6m9d2rma 2451107 2451092 2026-08-24T18:34:10Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.openstack.cloudvirt.drain (exit_code=99) on host 'cloudvirt1077.eqiad.wmnet' (T435537) 2451107 wikitext text/x-wiki rl3x86ayuqzeh3f8myo1syy6q5tktw3 2451113 2451107 2026-08-24T18:52:32Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (T435537) 2451113 wikitext text/x-wiki qu83nwidvoiaseqql4t8ov5jzdgpzjx 2451114 2451113 2026-08-24T18:52:38Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) (T435537) 2451114 wikitext text/x-wiki 9yprq31kd3jlp34t62ec7w026l9uw43 2451164 2451114 2026-08-24T22:01:22Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.bootstrap_and_add 2451164 wikitext text/x-wiki 4zlns3ab0p3x16t7mwyaoc0kn36zbpw 2451165 2451164 2026-08-24T22:01:25Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=0) 2451165 wikitext text/x-wiki bqti2kmzbet577b4q83zzn9nniwx7cu 2451166 2451165 2026-08-24T22:01:42Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.reactivate 2451166 wikitext text/x-wiki 06gkoz8l7jylo4r6peyi03ma5z62cvi 2451167 2451166 2026-08-24T22:01:47Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.ceph.osd.reactivate (exit_code=0) 2451167 wikitext text/x-wiki 1nf6lxnartke9hxx9l8151r5pyh56ra 2451168 2451167 2026-08-24T22:02:28Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.ceph.osd.undrain_node 2451168 wikitext text/x-wiki b3huyt1n8wu3mqz5gorwvh6pq7zqq1g 2451259 2451168 2026-08-25T08:22:05Z Stashbot 7414 godog: put cloudvirts back in service T431682 2451259 wikitext text/x-wiki 42vblr7o0ut0qherdukryworfaaystm 2451317 2451259 2026-08-25T10:05:42Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.ceph.osd.undrain_node (exit_code=0) 2451317 wikitext text/x-wiki d8uza3ullm8dcen8ghr8fpetpxu7tma 2451331 2451317 2026-08-25T10:30:56Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance 2451331 wikitext text/x-wiki h9sfailgf0g7rahzbxc7fgb8bcnqv8d 2451332 2451331 2026-08-25T10:31:00Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) 2451332 wikitext text/x-wiki c1hy1vgl5iaxum08phygaiz18zap4u9 2451333 2451332 2026-08-25T10:31:04Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance 2451333 wikitext text/x-wiki kpmjexky9u66ltq6uz0gw8i8xkolvnv 2451334 2451333 2026-08-25T10:31:07Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) 2451334 wikitext text/x-wiki tufasp3itscj3zwpfmfn57e6xowti49 2451335 2451334 2026-08-25T10:31:12Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance 2451335 wikitext text/x-wiki gto3lmmpq9sz6lw7ifhzkx8us3utg4p 2451336 2451335 2026-08-25T10:31:16Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) 2451336 wikitext text/x-wiki op3gu1e4t9momg9wiikbjsy2cpew6bv 2451337 2451336 2026-08-25T10:31:20Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance 2451337 wikitext text/x-wiki n272r6el60tmgdtn3nj9h0v91v9wxru 2451338 2451337 2026-08-25T10:31:24Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) 2451338 wikitext text/x-wiki 1iir5mcffe1b9crhahfwwc1ottmkhhu 2451339 2451338 2026-08-25T10:31:27Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance 2451339 wikitext text/x-wiki 93w60wi8ogpaid8runsnse8z7tudjtd 2451340 2451339 2026-08-25T10:31:30Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) 2451340 wikitext text/x-wiki m21uer8a4bh51bwp5s8owhvrp8o023x 2451341 2451340 2026-08-25T10:31:34Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance 2451341 wikitext text/x-wiki l5dzn3hst4mdspjc72x5bckcss4mwoc 2451342 2451341 2026-08-25T10:31:37Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) 2451342 wikitext text/x-wiki 7rfjq34i0gqrrqbpfgvtwfcfzk9k0jd 0 56257 2450999 2450541 2026-08-24T16:39:43Z BCornwall-WMF 31521 MOS:HEAD: Remove custom formatting from headings 2450999 wikitext text/x-wiki 5ss099iz8pg685j52ptbn7a17glgiw6 2451000 2450999 2026-08-24T16:45:56Z BCornwall-WMF 31521 Move various custom note messages to template 2451000 wikitext text/x-wiki 25wzn4k0m1ab89grze3oecyrk5wpirt 0 440900 2451324 2435266 2026-08-25T10:21:17Z Filippo Giunchedi 2939 /* new cloudvirt install */ mention tagged vlan 2451324 wikitext text/x-wiki sar81w8hnei6ojjbk0lrt9ozp1bjemg 0 444427 2451123 2345534 2026-08-24T19:22:47Z BKing (WMF) 29017 /* Replica node */ fix typo 2451123 wikitext text/x-wiki qw477j72g6nkehhydh2h5ysqbmwsvqm 2 445910 2451106 1864276 2026-08-24T18:23:37Z BryanDavis 1604 /* Wikitext examples */ use lang=wikitext 2451106 wikitext text/x-wiki m28clbj5ua9wope1vx7tzja5d2ub81u 498 446692 2450989 2372206 2026-08-24T16:25:45Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary on eqiad1, with recreate False, for hosts list: ['cloudvirt1040', 'cloudvirt1044', 'cloudvirt1042', 'cloudvirt1045', 'cloudvirt1043', 'cloudvirt1046', 'cloudvirt1041', 'cloudvirt1047', 'cloudvirt1048', 'cloudvirt1049', 'cloudvirt1052', 'cloudvirt1053', 'cloudvirt1050', 'cloudvirt1051', 'cloudvirt1057', 'cloudvirt1056', 2450989 wikitext text/x-wiki 7m0wvz8r5cpps7ds4i1v9l4t0tjx0bn 2450990 2450989 2026-08-24T16:25:56Z Stashbot 7414 andrew@cloudcumin1001: END (ERROR) - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary (exit_code=97) on eqiad1, with recreate False, for hosts list: ['cloudvirt1040', 'cloudvirt1044', 'cloudvirt1042', 'cloudvirt1045', 'cloudvirt1043', 'cloudvirt1046', 'cloudvirt1041', 'cloudvirt1047', 'cloudvirt1048', 'cloudvirt1049', 'cloudvirt1052', 'cloudvirt1053', 'cloudvirt1050', 'cloudvirt1051', 'cloudvirt105 2450990 wikitext text/x-wiki aou18io94z8uju77o1sv9xshtxuoksz 2450992 2450990 2026-08-24T16:26:24Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary on eqiad1, with recreate False, for hosts list: ['cloudvirt1040', 'cloudvirt1044', 'cloudvirt1042', 'cloudvirt1045', 'cloudvirt1043', 'cloudvirt1046', 'cloudvirt1041', 'cloudvirt1047', 'cloudvirt1048', 'cloudvirt1049', 'cloudvirt1052', 'cloudvirt1053', 'cloudvirt1050', 'cloudvirt1051', 'cloudvirt1057', 'cloudvirt1056', 2450992 wikitext text/x-wiki 1evqphx79utoiy0gwght7syn9nfh8ud 2450993 2450992 2026-08-24T16:31:52Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary (exit_code=99) on eqiad1, with recreate False, for hosts list: ['cloudvirt1040', 'cloudvirt1044', 'cloudvirt1042', 'cloudvirt1045', 'cloudvirt1043', 'cloudvirt1046', 'cloudvirt1041', 'cloudvirt1047', 'cloudvirt1048', 'cloudvirt1049', 'cloudvirt1052', 'cloudvirt1053', 'cloudvirt1050', 'cloudvirt1051', 'cloudvirt1057 2450993 wikitext text/x-wiki 6qypscbwktjk3db90thn3ha8sa2ii3y 2450994 2450993 2026-08-24T16:32:34Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary on eqiad1, with recreate False, for hosts list: ['cloudvirt1080'] 2450994 wikitext text/x-wiki fl1rjqxmq3a9n6wnge431gre5qe1fgi 2450995 2450994 2026-08-24T16:32:57Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary (exit_code=0) on eqiad1, with recreate False, for hosts list: ['cloudvirt1080'] 2450995 wikitext text/x-wiki 11s2udphvei6adto68iw8ftxrff00au 2451022 2450995 2026-08-24T17:16:09Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary on eqiad1, with recreate False, for hosts list: ['cloudvirt1079'] 2451022 wikitext text/x-wiki 20irqlk8403jnaa5tb68cz0v37i72hq 2451025 2451022 2026-08-24T17:16:19Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary (exit_code=99) on eqiad1, with recreate False, for hosts list: ['cloudvirt1079'] 2451025 wikitext text/x-wiki d0ejxfecah4ry2syuipi46fr1x2w843 2451027 2451025 2026-08-24T17:17:09Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary on eqiad1, with recreate False, for hosts list: ['cloudvirt1040', 'cloudvirt1044', 'cloudvirt1042', 'cloudvirt1045', 'cloudvirt1043', 'cloudvirt1046', 'cloudvirt1041', 'cloudvirt1047', 'cloudvirt1048', 'cloudvirt1049', 'cloudvirt1052', 'cloudvirt1053', 'cloudvirt1050', 'cloudvirt1051', 'cloudvirt1057', 'cloudvirt1056', 2451027 wikitext text/x-wiki jgehzo9lo6ay9mbsriyyg3g2nidk1a3 2451028 2451027 2026-08-24T17:17:21Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary (exit_code=99) on eqiad1, with recreate False, for hosts list: ['cloudvirt1040', 'cloudvirt1044', 'cloudvirt1042', 'cloudvirt1045', 'cloudvirt1043', 'cloudvirt1046', 'cloudvirt1041', 'cloudvirt1047', 'cloudvirt1048', 'cloudvirt1049', 'cloudvirt1052', 'cloudvirt1053', 'cloudvirt1050', 'cloudvirt1051', 'cloudvirt1057 2451028 wikitext text/x-wiki rfmerwnb8gtqco0i6i40mmhywsodxnw 2451031 2451028 2026-08-24T17:18:04Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary on eqiad1, with recreate False, for hosts list: ['cloudvirt1079'] 2451031 wikitext text/x-wiki 3zj499zc6pdg9bhrcsvfu5cwrnedjz1 2451032 2451031 2026-08-24T17:18:32Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary (exit_code=0) on eqiad1, with recreate False, for hosts list: ['cloudvirt1079'] 2451032 wikitext text/x-wiki 36ph575o0n189vo4arzuuyu7ig1yk73 2451089 2451032 2026-08-24T18:04:24Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary on eqiad1, with recreate False, for hosts list: ['cloudvirt1078'] 2451089 wikitext text/x-wiki p2jc8m43rt0ukgtrlbggwqm6jk2tpt3 2451090 2451089 2026-08-24T18:04:52Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary (exit_code=0) on eqiad1, with recreate False, for hosts list: ['cloudvirt1078'] 2451090 wikitext text/x-wiki 2z1v1h8tqpq57d7ut0f7fqgi87w0rbj 2451115 2451090 2026-08-24T18:52:42Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary on eqiad1, with recreate False, for hosts list: ['cloudvirt1077'] 2451115 wikitext text/x-wiki 6orso2k5mnrjo5g7r25kbcr4zm2cgz8 2451116 2451115 2026-08-24T18:53:05Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.lib.ensure_canary (exit_code=0) on eqiad1, with recreate False, for hosts list: ['cloudvirt1077'] 2451116 wikitext text/x-wiki c0496qu5o6dvmoogzgkc906aa3nc2ft 0 449160 2451180 2450687 2026-08-25T00:00:09Z Dexbot 30554 Bot: Updating the report 2451180 wikitext text/x-wiki npmbvbq31afymkn08d4mhcopfvwk1ck 0 450294 2450824 2450788 2026-08-24T12:14:01Z Atsuko-WMF 54082 /* experiment-platform (in progress) */ 2450824 wikitext text/x-wiki nd8b16rbh8ibmu85lirw7q73jlduhea 0 451075 2451143 2445933 2026-08-24T20:19:20Z WFan (WMF) 38087 2451143 wikitext text/x-wiki 3xpf67w4st13s4o22gjfhaj1rz76hpt 0 451533 2451322 2443024 2026-08-25T10:14:56Z DCaro (WMF) 18271 /* Next meeting agenda */ 2451322 wikitext text/x-wiki n820g79022r6jm96tgeat6fx2spnk1s 498 451627 2451013 2449792 2026-08-24T17:01:23Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.delete_project for project wikifunctions in eqiad1 2451013 wikitext text/x-wiki lmxufe25uj2cfnixwc1yvyj37l363zb 2451014 2451013 2026-08-24T17:01:26Z Stashbot 7414 taavi@cloudcumin1001: END (FAIL) - Cookbook wmcs.vps.delete_project (exit_code=99) for project wikifunctions in eqiad1 2451014 wikitext text/x-wiki 2tj7t9kf5pve7hycu8mlw6a313roxb2 2451015 2451014 2026-08-24T17:03:50Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.delete_project for project wikifunctions in eqiad1 2451015 wikitext text/x-wiki ti5q5u0qfmopx5i5l5lc42sbggq3kke 2451016 2451015 2026-08-24T17:05:38Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.delete_project (exit_code=0) for project wikifunctions in eqiad1 2451016 wikitext text/x-wiki m1lf4uy8grzdy1640mxp3kbre8n8xug 0 453597 2450935 2450121 2026-08-24T15:34:31Z Raymond Ndibe 16522 2450935 wikitext text/x-wiki 4lljugvfqddrp101lc2vjt2bkcvn10a 2451046 2450935 2026-08-24T17:30:35Z DCaro (WMF) 18271 /* 2026 */ 2451046 wikitext text/x-wiki 8pkgqwofzieja7bffv562zn3al982fa 2451050 2451046 2026-08-24T17:37:29Z Lucas Werkmeister 8093 /* 2026 */ fix heading 2451050 wikitext text/x-wiki 4h52f76d5llfvsv973wowef2lr4ugbi 116 453906 2451252 2450675 2026-08-25T08:03:36Z Gitlabaccountapprovalbot 37332 @noahmvf was approved. 2451252 wikitext text/x-wiki evifswhcdvgh76e76aopivsducz1ymz 0 455715 2450863 2403095 2026-08-24T13:20:21Z MVernon (WMF) 25893 /* Upgrades */ 18.2.8 2450863 wikitext text/x-wiki m9fhp25tbd43ym4t61d2vtq6kdhn4v4 12 458860 2450959 2448931 2026-08-24T15:56:11Z Raymond Ndibe 16522 add publish option documentation 2450959 wikitext text/x-wiki ni1dfkaf522sgrrwsx6lp4zwi5i0mvk 0 458871 2450910 2367039 2026-08-24T14:48:10Z FCeratto-WMF 39104 /* Loading data / provisioning */ 2450910 wikitext text/x-wiki oq53zkiwqsj5ygi2tbu7t5nss2ixa3b 0 459699 2451036 2449940 2026-08-24T17:19:24Z Stashbot 7414 damilare: payments-wiki upgraded from c56b3ad7 to c3ed1fa0 2451036 wikitext text/x-wiki opw31zbvpjrz1ne05v4276esowtlnh4 2451044 2451036 2026-08-24T17:27:44Z Stashbot 7414 ejegg: disabled payment attempt queue consumer 2451044 wikitext text/x-wiki ehgtcm43ids04iurd4n1qlyhm95bmmg 2451078 2451044 2026-08-24T18:01:08Z Stashbot 7414 ejegg: civicrm upgraded from 225dc534 to 33fac802 2451078 wikitext text/x-wiki lk9vwp09nnelvax8ung5g7j0bug6dxt 2451119 2451078 2026-08-24T18:58:52Z Stashbot 7414 ejegg: re-enabled payment attempts queue consumer 2451119 wikitext text/x-wiki gw09yshpwnm9h6rkl8c43xamjv8fqpn 2451189 2451119 2026-08-25T02:43:43Z Stashbot 7414 larssandergreen: civicrm upgraded from 33fac802 to 438f38be 2451189 wikitext text/x-wiki 4albs0lhppnejx8pm33sv5pp6skgw7k 0 460366 2451136 2449822 2026-08-24T20:05:06Z TBurmeister (WMF) 27417 Add resources section 2451136 wikitext text/x-wiki aqf90f00pr2ta3axrnox8lnjwxebq5j 2451182 2451136 2026-08-25T02:08:11Z AWesterinen-WMF 54189 /* Breadth First Search */ 2451182 wikitext text/x-wiki cyk82oiabd9zqpi5jnut7lp0y5sfxu5 2451184 2451182 2026-08-25T02:10:31Z AWesterinen-WMF 54189 /* Breadth First Search */ 2451184 wikitext text/x-wiki 026jbbglzgjfc6y08202z7euo5xu91e 2451185 2451184 2026-08-25T02:11:26Z AWesterinen-WMF 54189 /* Breadth First Search */ 2451185 wikitext text/x-wiki 7nkq44fxkv5pucri4anldrcysd49ton 2451186 2451185 2026-08-25T02:22:14Z AWesterinen-WMF 54189 2451186 wikitext text/x-wiki kuy1d98vfqqz866kwtacilte1hw0k8q 2451187 2451186 2026-08-25T02:24:10Z AWesterinen-WMF 54189 /* Multiple Frontiers */ 2451187 wikitext text/x-wiki 8s70cl5u7xu61iqnkk3hv9hhoiwahc3 2451188 2451187 2026-08-25T02:27:56Z AWesterinen-WMF 54189 /* Query Rewrite Patterns */ 2451188 wikitext text/x-wiki dgq02oenhjm718m9evgrgul4gq5zcj7 0 460375 2451140 2449299 2026-08-24T20:11:13Z TBurmeister (WMF) 27417 Add related resources section 2451140 wikitext text/x-wiki 1q531t1f01cob6tqk1hf3ph60i4rapx 0 460376 2451112 2449230 2026-08-24T18:50:35Z AWesterinen-WMF 54189 /* Named Subqueries */ 2451112 wikitext text/x-wiki 8kcj1iknrgt1bejv3tuetwsodjs0fvk 2451118 2451112 2026-08-24T18:55:37Z AWesterinen-WMF 54189 /* Named Subqueries */ 2451118 wikitext text/x-wiki d8ipz69fkrxx184i96feb10uku1repw 2451122 2451118 2026-08-24T19:11:35Z AWesterinen-WMF 54189 /* Named Subqueries */ 2451122 wikitext text/x-wiki 3wxbznra8ae5ebmrs476icueo2nmdyo 2451125 2451122 2026-08-24T19:30:26Z TBurmeister (WMF) 27417 TBurmeister (WMF) moved page [[Wikidata Query Service/Migration/Rewrite of Label and Utility Services and Functions]] to [[Wikidata Query Service/Migration/Rewrite of Label Service]]: Splitting former page into two pages 2451122 wikitext text/x-wiki 3wxbznra8ae5ebmrs476icueo2nmdyo 2451129 2451125 2026-08-24T19:33:46Z TBurmeister (WMF) 27417 Remove content now split into its own subpage /Rewrite_of_Utility_Services_and_Functions 2451129 wikitext text/x-wiki l2mz4vtmkig7yeu5scpfh0bwtdesl3n 2451135 2451129 2026-08-24T20:00:31Z TBurmeister (WMF) 27417 Add related resources section and clean up introduction post-page split 2451135 wikitext text/x-wiki 7qo8beonvc1u2lc1l9lg0gn3kb8izv2 0 460377 2451144 2446289 2026-08-24T20:22:56Z TBurmeister (WMF) 27417 Add related resources section 2451144 wikitext text/x-wiki 36nh9ihyqp3wuxmrdxx3t22oxsiz0zn 1 460409 2451127 2444973 2026-08-24T19:30:26Z TBurmeister (WMF) 27417 TBurmeister (WMF) moved page [[Talk:Wikidata Query Service/Migration/Rewrite of Label and Utility Services and Functions]] to [[Talk:Wikidata Query Service/Migration/Rewrite of Label Service]]: Splitting former page into two pages 2444973 wikitext text/x-wiki s8hxsyio7rr1g0ap85iarytmhftirm3 0 460521 2451108 2444719 2026-08-24T18:41:43Z APaskulin (WMF) 14880 Fill in a few basic fields to get started 2451108 wikitext text/x-wiki lu4bjwg2fs2uzu2dwxzo1yq39sd6nsj 0 460561 2450881 2450762 2026-08-24T13:49:33Z KCVelaga 26729 /* Datasets */ 2450881 wikitext text/x-wiki 7mxx4tf3mmhuougl5wa54ybecqtl4rd 2450883 2450881 2026-08-24T13:51:44Z KCVelaga 26729 /* Usage notes */ +typo + updates 2450883 wikitext text/x-wiki po01ui5oqqxb0eu72fgr6yjnncrn0py 2450885 2450883 2026-08-24T13:52:51Z KCVelaga 26729 /* Average response size by API family */ 2450885 wikitext text/x-wiki gjptwkqtw8zieem1e5a71tq7w1htldp 2450886 2450885 2026-08-24T13:53:07Z KCVelaga 26729 /* Cache behaviour by API families */ 2450886 wikitext text/x-wiki nr6a7yy2hxatxv14951w9k73c6tvogw 2450889 2450886 2026-08-24T13:55:24Z KCVelaga 26729 /* Glossary */ 2450889 wikitext text/x-wiki qfwq0pdvodnhjzvbk7uj3oegjg58i0r 2450892 2450889 2026-08-24T13:57:16Z KCVelaga 26729 /* Glossary */ 2450892 wikitext text/x-wiki 646gw5wbsdf9uu47kebcy8412a31xqh 2451310 2450892 2026-08-25T09:49:45Z KCVelaga (WMF) 38150 ready to go 2451310 wikitext text/x-wiki szequn48qsn6z9irrh4ii8yfpjebq44 0 460580 2450921 2026-08-24T15:03:48Z FCeratto-WMF 39104 Document testbed 2450921 wikitext text/x-wiki 79vrizwlvs0ibpic4wx3vdp1c5reedv 2 460581 2451105 2026-08-24T18:22:47Z Akd.2303 58755 /* */ Administración 2451105 wikitext text/x-wiki pgekstk24ltljziwo334go1axvhqc97 0 460582 2451124 2026-08-24T19:29:15Z TBurmeister (WMF) 27417 Create new page to splitWikidata_Query_Service/Migration/Rewrite_of_Label_and_Utility_Services_and_Functions into two pages 2451124 wikitext text/x-wiki jfq7prh0iq933hzhp5kcnn77cc5dmiq 2451147 2451124 2026-08-24T20:28:09Z TBurmeister (WMF) 27417 Add related resources section 2451147 wikitext text/x-wiki 887ik4zll9nkqq2ok0gvdnw22azwuu8 0 460583 2451126 2026-08-24T19:30:26Z TBurmeister (WMF) 27417 TBurmeister (WMF) moved page [[Wikidata Query Service/Migration/Rewrite of Label and Utility Services and Functions]] to [[Wikidata Query Service/Migration/Rewrite of Label Service]]: Splitting former page into two pages 2451126 wikitext text/x-wiki 4sul3ernejsx74xqalap9vrqupkjy48 2451130 2451126 2026-08-24T19:35:25Z TBurmeister (WMF) 27417 Replace redirect with links to the two replacement pages 2451130 wikitext text/x-wiki c0idxlasxwgin3d4b9tumlhbjvk5i53 1 460584 2451128 2026-08-24T19:30:26Z TBurmeister (WMF) 27417 TBurmeister (WMF) moved page [[Talk:Wikidata Query Service/Migration/Rewrite of Label and Utility Services and Functions]] to [[Talk:Wikidata Query Service/Migration/Rewrite of Label Service]]: Splitting former page into two pages 2451128 wikitext text/x-wiki 4n5dietubule70fafzw60ymlj02jnzv 0 460585 2451150 2026-08-24T20:35:19Z TBurmeister (WMF) 27417 Create content to clarify use of this page and help people find page on wikidata 2451150 wikitext text/x-wiki r04w74ogkcxm2l4ta7wx7tcbmsy4lxt 2 460586 2451197 2026-08-25T05:37:34Z SSapaty (WMF) 28955 Created page with "Drafts for PTD" 2451197 wikitext text/x-wiki actdxmy40n1wh48772424p1pahh2av9 2451199 2451197 2026-08-25T05:58:29Z SSapaty (WMF) 28955 2451199 wikitext text/x-wiki qq3d8xuk3ltts8s467btef8luxp2rl2 2 460587 2451198 2026-08-25T05:57:50Z SSapaty (WMF) 28955 First draft 2451198 wikitext text/x-wiki 93zwgirznoalg5h70tvrd21vgskvopo