Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.8 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk Nova Resource:Maps/SAL 498 802 2429761 2349336 2026-06-23T16:03:43Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.add_server 2429761 wikitext text/x-wiki sxa07jk9gkr8koheuq4mqd494445gen 2429762 2429761 2026-06-23T16:05:02Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.nfs.add_server (exit_code=99) 2429762 wikitext text/x-wiki dsa8bpxwgj820kt0dn2v03647os1fz3 2429769 2429762 2026-06-23T16:09:09Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.add_server 2429769 wikitext text/x-wiki djid2vt8sm4if21rf59qy4c2u36metx 2429770 2429769 2026-06-23T16:10:28Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.nfs.add_server (exit_code=99) 2429770 wikitext text/x-wiki 087cukr5ix6rposb8bp8jzf7gl2ydfp 2429775 2429770 2026-06-23T16:17:51Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.add_server 2429775 wikitext text/x-wiki gxvkmn9z1dm1k7o6t0htsz3ufxzld2k 2429776 2429775 2026-06-23T16:29:46Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.nfs.add_server (exit_code=0) 2429776 wikitext text/x-wiki i7mrsppkfm9tgzwnxpkl2xd0u8t0rm7 2429777 2429776 2026-06-23T16:31:01Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.add_server 2429777 wikitext text/x-wiki ct2ia2tacwzs8pyu4ugc6bw84yzkwmc 2429778 2429777 2026-06-23T16:43:58Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.nfs.add_server (exit_code=0) 2429778 wikitext text/x-wiki 02scci8ktxz6hc0xemtvwitnvni4i8q 2429866 2429778 2026-06-23T18:03:21Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.migrate_service 2429866 wikitext text/x-wiki 0mao8t690p96zwo2cwql74i4elesw1x 2429867 2429866 2026-06-23T18:03:47Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.nfs.migrate_service (exit_code=99) 2429867 wikitext text/x-wiki 96z83aea3r03vde79ufs0rvhxif0ef6 2429871 2429867 2026-06-23T18:16:59Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.add_server 2429871 wikitext text/x-wiki 99pbeyc5dv67watyutw7ccv01lmzsc3 2429872 2429871 2026-06-23T18:17:06Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.nfs.add_server (exit_code=99) 2429872 wikitext text/x-wiki 75az9lh73bzgibwohof7kq1zp3cigwd 2429873 2429872 2026-06-23T18:17:23Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.add_server 2429873 wikitext text/x-wiki ougzkheq4ugn0k7nuvzo5oi6ddvondd 2429874 2429873 2026-06-23T18:17:30Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.nfs.add_server (exit_code=99) 2429874 wikitext text/x-wiki gtwlmukyzndhxqde5jwkmdxi1f3nypb 2429875 2429874 2026-06-23T18:17:56Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.add_server 2429875 wikitext text/x-wiki k2kh7bhioy9sjgno5xwbxx1u8ja9lzg 2429881 2429875 2026-06-23T18:29:47Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.nfs.add_server (exit_code=0) 2429881 wikitext text/x-wiki 79ecn1ay7sflw6y8cq6yr0y3xrhi43b 2429883 2429881 2026-06-23T18:31:57Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.migrate_service 2429883 wikitext text/x-wiki c07u623ca00pe9grd5aep8ezr17iq3j 2429884 2429883 2026-06-23T18:32:24Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.nfs.migrate_service (exit_code=99) 2429884 wikitext text/x-wiki 4hhvpy3k6qbtstx9nayccu7lkmnrveh Nova Resource:Video/SAL 498 2367 2429670 2429270 2026-06-23T14:17:19Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.migrate_service 2429670 wikitext text/x-wiki gnbv4gzrcyjuot89t7oolx74wpuwzot 2429671 2429670 2026-06-23T14:17:27Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.nfs.migrate_service (exit_code=99) 2429671 wikitext text/x-wiki 4d1f2bnr14pvsdwggqv9kz4mag0ftrf 2429675 2429671 2026-06-23T14:20:19Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.add_server 2429675 wikitext text/x-wiki k3rdnjw10sei0v08pjm68rfdn3g5j23 2429676 2429675 2026-06-23T14:20:29Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.nfs.add_server (exit_code=99) 2429676 wikitext text/x-wiki ct847tkp20noeh0gxo6swuatt12vmnk 2429684 2429676 2026-06-23T14:24:37Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.add_server 2429684 wikitext text/x-wiki f7icx2392cvwbjq70c2bf2a4q6jnl4u 2429685 2429684 2026-06-23T14:24:43Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.nfs.add_server (exit_code=99) 2429685 wikitext text/x-wiki 0knrsih63csyn7uzcdce1nk6jtswg1y 2429689 2429685 2026-06-23T14:26:48Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.add_server 2429689 wikitext text/x-wiki hfs5gd7fs9q97ia5ntbtyl1qxcbb56y 2429702 2429689 2026-06-23T14:38:42Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.nfs.add_server (exit_code=0) 2429702 wikitext text/x-wiki ahj6djim6a2medz7egs0q460toqwuqo 2429704 2429702 2026-06-23T14:40:24Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.migrate_service 2429704 wikitext text/x-wiki 6izdbnimu7696einsbq026sfnyrzvn9 2429705 2429704 2026-06-23T14:41:08Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.nfs.migrate_service (exit_code=99) 2429705 wikitext text/x-wiki qknv99cat9atq29c0h8bmyar27xglkh 2429706 2429705 2026-06-23T14:42:45Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.migrate_service 2429706 wikitext text/x-wiki r12mifmd0anftcw837j19polj86fmxv 2429707 2429706 2026-06-23T14:43:30Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.nfs.migrate_service (exit_code=99) 2429707 wikitext text/x-wiki 21ij9govxh9uvfyz83c5vdcwqgd6e9j 2429710 2429707 2026-06-23T14:46:00Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.migrate_service 2429710 wikitext text/x-wiki dpta09pcd0c0blf6bkvggnulopm5xe0 2429712 2429710 2026-06-23T14:53:42Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.nfs.migrate_service (exit_code=99) 2429712 wikitext text/x-wiki 8ks7h7p0kk99teyqdvxqetysd7q487p 2429714 2429712 2026-06-23T14:54:53Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.migrate_service 2429714 wikitext text/x-wiki 5j4v95t1bply9sc0tjznlfmf58ou2st 2429715 2429714 2026-06-23T14:54:54Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.nfs.migrate_service (exit_code=99) 2429715 wikitext text/x-wiki ryblkpitpl63sn8mdwlxyy5b386k6y3 2429716 2429715 2026-06-23T14:55:06Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.migrate_service 2429716 wikitext text/x-wiki rsbvjv31z93kp5gdtdpyzxpauttpg4d 2429718 2429716 2026-06-23T14:55:09Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.nfs.migrate_service (exit_code=99) 2429718 wikitext text/x-wiki roxuvffdagr6xcpvon6ev3be6dqdi7t Deployments 0 4108 2429583 2429568 2026-06-23T12:06:21Z ScheduleDeploymentBot 37566 Add [[gerrit:1305064]] to Tuesday, June 23 UTC late backport window 2429583 wikitext text/x-wiki f6v34ln7hpqotbz24grdwv9w0mec980 2429619 2429583 2026-06-23T13:11:47Z ScheduleDeploymentBot 37566 Add [[gerrit:1305123]] to Tuesday, June 23 UTC afternoon backport window 2429619 wikitext text/x-wiki pfgzhlu5ji58ttx3no0ix9n8bwj5au6 2429620 2429619 2026-06-23T13:12:07Z ScheduleDeploymentBot 37566 Add [[gerrit:1305122]] to Tuesday, June 23 UTC afternoon backport window 2429620 wikitext text/x-wiki q17sd93jrgynl72if4ce8xvbfz3ysjj 2429660 2429620 2026-06-23T13:55:31Z Mmullie (WMF) 291 /* {{Deployment_day|date=2026-06-23}} */ 2429660 wikitext text/x-wiki 9geg7cl50ddqzeja63rg5c108wtrh57 2429664 2429660 2026-06-23T14:01:46Z ScheduleDeploymentBot 37566 Add [[gerrit:1305049]] to Tuesday, June 23 UTC late backport window 2429664 wikitext text/x-wiki bkq2wzlxn7ddhqx9k0paprdaq2llaz0 2429779 2429664 2026-06-23T16:44:19Z SFrench-WMF 37362 /* {{Deployment_day|date=2026-06-23}} */ UTC-late infra window 2429779 wikitext text/x-wiki 1n78p0kqyifbwftcrd84bgxc9bv23h0 2429827 2429779 2026-06-23T17:33:57Z ScheduleDeploymentBot 37566 Add [[gerrit:1305215]] to Tuesday, June 23 UTC late backport window 2429827 wikitext text/x-wiki 5l6o17m86su5zrozx3f34hc51t6vgl9 2429868 2429827 2026-06-23T18:04:03Z ScheduleDeploymentBot 37566 Add [[gerrit:1305223]] to Tuesday, June 23 UTC late backport window 2429868 wikitext text/x-wiki 4ua4bhwk9cdo2et34ewcn5gnf4e2jo3 2429897 2429868 2026-06-23T20:02:30Z ScheduleDeploymentBot 37566 Add [[gerrit:1305241]] to Tuesday, June 23 UTC late backport window 2429897 wikitext text/x-wiki drklzifmkkqkshmy7u4p1nzeozew10m 2429898 2429897 2026-06-23T20:02:51Z ScheduleDeploymentBot 37566 Add [[gerrit:1305242]] to Tuesday, June 23 UTC late backport window 2429898 wikitext text/x-wiki gon6srnljfux2y9u9upef8e7oqwow50 2429952 2429898 2026-06-24T03:55:52Z ScheduleDeploymentBot 37566 Add [[gerrit:1305290]] to Thursday, June 25 UTC late backport window 2429952 wikitext text/x-wiki lsst7s6nnq21s3espxjr4hjmbwuxfbd 2429991 2429952 2026-06-24T06:55:14Z ScheduleDeploymentBot 37566 Add [[gerrit:1305329]] to Wednesday, June 24 UTC morning backport window 2429991 wikitext text/x-wiki qtma0lee96gieo2isp4dbjzwo5xzcnr 2430088 2429991 2026-06-24T10:53:31Z ScheduleDeploymentBot 37566 Add [[gerrit:1302201]] to Wednesday, June 24 UTC afternoon backport window 2430088 wikitext text/x-wiki avzh4pv3ajegg9zjzzukr44tvwbvwjv 2430090 2430088 2026-06-24T10:57:53Z ScheduleDeploymentBot 37566 Add [[gerrit:1305378]] to Wednesday, June 24 UTC afternoon backport window 2430090 wikitext text/x-wiki dizb8kd4qj78evfyhx3eefbb3onsn3o Delete a wiki 0 4118 2429666 2355783 2026-06-23T14:04:11Z WBrown (WMF) 37696 +/* Clean up after deletion */ 2429666 wikitext text/x-wiki tbjkdvo6oahngnn5cm65fxp73ybgude Server Admin Log 0 7919 2429584 2429582 2026-06-23T12:15:24Z Stashbot 7414 klausman@cumin2002: START - Cookbook sre.k8s.reboot-nodes rolling reboot on A:ml-staging-master 2429584 wikitext text/x-wiki oxzs9gufp86io6i48rbzlvhf219xjpz 2429585 2429584 2026-06-23T12:15:27Z Stashbot 7414 klausman@cumin2002: START - Cookbook sre.k8s.pool-depool-node depool for host ml-staging-ctrl2001.codfw.wmnet 2429585 wikitext text/x-wiki 1ts2l4a5r0dvbxvhxdo2lxpo3de0c6i 2429586 2429585 2026-06-23T12:15:29Z Stashbot 7414 klausman@cumin2002: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-staging-ctrl2001.codfw.wmnet 2429586 wikitext text/x-wiki ksf1ls1ew87mvsa7vb6z88acreh43s8 2429587 2429586 2026-06-23T12:18:52Z Stashbot 7414 klausman@cumin2002: START - Cookbook sre.k8s.pool-depool-node pool for host ml-staging-ctrl2001.codfw.wmnet 2429587 wikitext text/x-wiki pz3zg64381w1xu81w1dbbxf0wawopl0 2429588 2429587 2026-06-23T12:18:54Z Stashbot 7414 klausman@cumin2002: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-staging-ctrl2001.codfw.wmnet 2429588 wikitext text/x-wiki 8tkjt5e8g3xwvc3n8hyk7sydm9kbncb 2429589 2429588 2026-06-23T12:18:58Z Stashbot 7414 klausman@cumin2002: START - Cookbook sre.k8s.pool-depool-node depool for host ml-staging-ctrl2002.codfw.wmnet 2429589 wikitext text/x-wiki pl2jbuam23y95nw0zan3fxq644lnm8g 2429590 2429589 2026-06-23T12:19:01Z Stashbot 7414 klausman@cumin2002: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host ml-staging-ctrl2002.codfw.wmnet 2429590 wikitext text/x-wiki 3rakc1qq1awfxs4qalwov20q1br9k0m 2429591 2429590 2026-06-23T12:22:23Z Stashbot 7414 klausman@cumin2002: START - Cookbook sre.k8s.pool-depool-node pool for host ml-staging-ctrl2002.codfw.wmnet 2429591 wikitext text/x-wiki d6lmjdugy3s1ojh4mv5h9yzufvxtf59 2429592 2429591 2026-06-23T12:22:26Z Stashbot 7414 klausman@cumin2002: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host ml-staging-ctrl2002.codfw.wmnet 2429592 wikitext text/x-wiki dbl0xv5oduyhplt6wfnw2wr6cdc7v8h 2429593 2429592 2026-06-23T12:22:27Z Stashbot 7414 klausman@cumin2002: END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on A:ml-staging-master 2429593 wikitext text/x-wiki 2treoc7f2z5pvmce2fg6crb8i08rqht 2429594 2429593 2026-06-23T12:31:31Z Stashbot 7414 dcausse@deploy1003: helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply 2429594 wikitext text/x-wiki adi55pj6pwxtldiaxt76qzceklui7gc 2429595 2429594 2026-06-23T12:32:02Z Stashbot 7414 dcausse@deploy1003: helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply 2429595 wikitext text/x-wiki saamumo1k9fnitjfismn1k6pxcacmgo 2429596 2429595 2026-06-23T12:36:14Z Stashbot 7414 sbisson@deploy1003: helmfile [ml-staging-codfw] 'sync' command on namespace 'recommendation-api-ng' for release 'main' . 2429596 wikitext text/x-wiki 5h5wjmpj80pvenf5t7pzxnr2mbr56rd 2429597 2429596 2026-06-23T12:39:50Z Stashbot 7414 dcausse@deploy1003: helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply 2429597 wikitext text/x-wiki fjhhabtclw45sdqkcaqun6lyadckk7t 2429599 2429597 2026-06-23T12:40:00Z Stashbot 7414 dcausse@deploy1003: helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply 2429599 wikitext text/x-wiki bdvxv4smmpy0kruz9vigeh0q0u9rdww 2429600 2429599 2026-06-23T12:40:21Z Stashbot 7414 sbisson@deploy1003: helmfile [ml-serve-eqiad] 'sync' command on namespace 'recommendation-api-ng' for release 'main' . 2429600 wikitext text/x-wiki c0gadf8ykb0p5gfa2lpg12ih8vo1o6u 2429601 2429600 2026-06-23T12:42:54Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-semantic-search: apply 2429601 wikitext text/x-wiki 2jlx7h18h01wvt65ku4xr4iakmgedbx 2429602 2429601 2026-06-23T12:42:59Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search: apply 2429602 wikitext text/x-wiki 1khldqnuulx503hhyamx2wg9wrt8ez4 2429603 2429602 2026-06-23T12:45:57Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/dse-k8s-services/opensearch-semantic-search: apply 2429603 wikitext text/x-wiki h0fpovv3mgc2zxtluuwgvi3ywv020u4 2429604 2429603 2026-06-23T12:46:05Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search: apply 2429604 wikitext text/x-wiki 9fmv3q11vas3naktwvuxcicjfopshct 2429605 2429604 2026-06-23T12:46:35Z Stashbot 7414 sbisson@deploy1003: helmfile [ml-serve-codfw] 'sync' command on namespace 'recommendation-api-ng' for release 'main' . 2429605 wikitext text/x-wiki 22it9m5nvun398zab4e0vd3arvr3sg8 2429606 2429605 2026-06-23T12:48:30Z Stashbot 7414 dcausse@deploy1003: helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply 2429606 wikitext text/x-wiki 5xmuyz5qg2gru45py444nvu0fhcduc3 2429607 2429606 2026-06-23T12:48:41Z Stashbot 7414 dcausse@deploy1003: helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply 2429607 wikitext text/x-wiki o0whuucw6glp50lzhphtrwqxsbk9q8w 2429608 2429607 2026-06-23T12:48:51Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.major-upgrade 2429608 wikitext text/x-wiki ogwnnno1k8m3278ok7kucyj4crm5h6e 2429609 2429608 2026-06-23T12:48:55Z Stashbot 7414 cwilliams@cumin1003: dbmaint on s4@eqiad T429893 2429609 wikitext text/x-wiki tbsu6ixyscfrz4foct8ycly4df1z11v 2429610 2429609 2026-06-23T12:49:11Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.depool depool db1160: Upgrading db1160.eqiad.wmnet 2429610 wikitext text/x-wiki knc91mtbpn2ws8f3fa4mjj5hibhak0r 2429611 2429610 2026-06-23T12:49:41Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1160: Upgrading db1160.eqiad.wmnet 2429611 wikitext text/x-wiki hh7clswb6ardy446gvinv8b7jkrsz07 2429612 2429611 2026-06-23T12:53:53Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reimage for host db1160.eqiad.wmnet with OS trixie 2429612 wikitext text/x-wiki rmf6ecukmnpblv197qdofo6t6vn3s04 2429613 2429612 2026-06-23T12:55:15Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.major-upgrade 2429613 wikitext text/x-wiki cbvgtdlireq96n76fazxadf2ekzcuef 2429614 2429613 2026-06-23T12:55:19Z Stashbot 7414 cwilliams@cumin1003: dbmaint on s4@codfw T429893 2429614 wikitext text/x-wiki 8a0cw5rsc6bvdfoouopnenl591ajbsj 2429615 2429614 2026-06-23T12:55:36Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.depool depool db2155: Upgrading db2155.codfw.wmnet 2429615 wikitext text/x-wiki 4xvlz7kg9tggxoz3gj2ni192bdxuati 2429616 2429615 2026-06-23T12:55:58Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2155: Upgrading db2155.codfw.wmnet 2429616 wikitext text/x-wiki 5tny2mlnxoxjzbt73waq18vhcvgs8sv 2429617 2429616 2026-06-23T12:58:18Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reimage for host db2155.codfw.wmnet with OS trixie 2429617 wikitext text/x-wiki gnwhx4lz95rowl8kgd4kxklywv0cmyr 2429618 2429617 2026-06-23T13:07:58Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1160.eqiad.wmnet with reason: host reimage 2429618 wikitext text/x-wiki gmdqi4r7jiv2wvw5jh0ohos11f8hvyf 2429621 2429618 2026-06-23T13:13:14Z Stashbot 7414 jelto@cumin1003: START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1003.wikimedia.org with reason: Test apt-mark hold 2429621 wikitext text/x-wiki egw1f70lg8s2hzweppcsmjn4efdd4gp 2429622 2429621 2026-06-23T13:15:23Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1160.eqiad.wmnet with reason: host reimage 2429622 wikitext text/x-wiki 43vt6hswoa5puydpz3r16dvaty615pu 2429623 2429622 2026-06-23T13:16:50Z Stashbot 7414 jelto@cumin1003: END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1003.wikimedia.org with reason: Test apt-mark hold 2429623 wikitext text/x-wiki 46941a395a9h6dg06o2ujxusmxa1i0m 2429624 2429623 2026-06-23T13:16:53Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db2155.codfw.wmnet with reason: host reimage 2429624 wikitext text/x-wiki it9pvu9fwj185ilfgcry5y5od2strae 2429625 2429624 2026-06-23T13:23:44Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.netbox 2429625 wikitext text/x-wiki 7jocmvgi6eang7m8ewyrj4apc9xwjlw 2429626 2429625 2026-06-23T13:23:47Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2155.codfw.wmnet with reason: host reimage 2429626 wikitext text/x-wiki i9oxnksef62g6zps9ov0wsgic4ujcd9 2429627 2429626 2026-06-23T13:28:20Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add entries for sretest1006 - cmooney@cumin1003" 2429627 wikitext text/x-wiki 2s82916ja1hwuy3vopeenofw8mk3owa 2429628 2429627 2026-06-23T13:29:33Z Stashbot 7414 cscott@deploy1003: Started scap sync-world: Backport for [[gerrit:1305015|[parser] Return HeadingPFragments while preprocessing (T391624 T387520 T387521 T384490 T387374)]], [[gerrit:1305026|[parser] Return ExtTagPFragments while preprocessing (T429624)]] 2429628 wikitext text/x-wiki 2mzq7hk9o7mc52tkql1i3343ne62znv 2429629 2429628 2026-06-23T13:31:42Z Stashbot 7414 cscott@deploy1003: cscott: Backport for [[gerrit:1305015|[parser] Return HeadingPFragments while preprocessing (T391624 T387520 T387521 T384490 T387374)]], [[gerrit:1305026|[parser] Return ExtTagPFragments while preprocessing (T429624)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2429629 wikitext text/x-wiki 8xw5vwvjntvm1jdszo9ynm7nwjs3q0r 2429630 2429629 2026-06-23T13:31:53Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add entries for sretest1006 - cmooney@cumin1003" 2429630 wikitext text/x-wiki rysu6yt0k1g79dofeil5vygp6c4wcp9 2429631 2429630 2026-06-23T13:31:55Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2429631 wikitext text/x-wiki f3j249n6o5fbqlq15r7bl5krj3d3pvj 2429632 2429631 2026-06-23T13:32:21Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1160.eqiad.wmnet with OS trixie 2429632 wikitext text/x-wiki 5mzluvy9i5ntvagzjm8zdirw4djawki 2429633 2429632 2026-06-23T13:33:22Z Stashbot 7414 cscott@deploy1003: cscott: Continuing with deployment 2429633 wikitext text/x-wiki sd2pkn98rdjt7qvfex5e9mwae8m4ake 2429637 2429633 2026-06-23T13:41:52Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2155.codfw.wmnet with OS trixie 2429637 wikitext text/x-wiki rm8ps54wc7qcasann0l7dbncrmhrsdj 2429638 2429637 2026-06-23T13:42:05Z Stashbot 7414 cscott@deploy1003: Finished scap sync-world: Backport for [[gerrit:1305015|[parser] Return HeadingPFragments while preprocessing (T391624 T387520 T387521 T384490 T387374)]], [[gerrit:1305026|[parser] Return ExtTagPFragments while preprocessing (T429624)]] (duration: 12m 31s) 2429638 wikitext text/x-wiki da2qhj4jr7f6fnkxxre68lxuav6gjkf 2429639 2429638 2026-06-23T13:44:12Z Stashbot 7414 cscott@deploy1003: Started scap sync-world: Backport for [[gerrit:1305017|[parser] Add configuration to return experimental PFragment types]], [[gerrit:1305018|[parser] Return HeadingPFragments while preprocessing (T391624 T387520 T387521 T384490 T387374)]], [[gerrit:1305025|[parser] Return ExtTagPFragments while preprocessing (T429624)]] 2429639 wikitext text/x-wiki beabvbqv4f0bous8cvlz5gsep3t77ah 2429640 2429639 2026-06-23T13:45:13Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.network.cloud-host for host cloudcephosd1054 2429640 wikitext text/x-wiki 2vsj49rozlgdbv1vh8y3inzxbunvdh4 2429641 2429640 2026-06-23T13:45:15Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host cloudcephosd1054 2429641 wikitext text/x-wiki efy42j0pvly65cfqi65rsiagdraclug 2429642 2429641 2026-06-23T13:45:30Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudcephosd1054 2429642 wikitext text/x-wiki 0063tpd788n038xe10x1ks2bt8g79et 2429643 2429642 2026-06-23T13:45:32Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.network.cloud-host (exit_code=0) for host cloudcephosd1054 2429643 wikitext text/x-wiki s9nd819zbc9ypjkuijlq652ouw4eycv 2429644 2429643 2026-06-23T13:46:21Z Stashbot 7414 cscott@deploy1003: cscott: Backport for [[gerrit:1305017|[parser] Add configuration to return experimental PFragment types]], [[gerrit:1305018|[parser] Return HeadingPFragments while preprocessing (T391624 T387520 T387521 T384490 T387374)]], [[gerrit:1305025|[parser] Return ExtTagPFragments while preprocessing (T429624)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be v 2429644 wikitext text/x-wiki ldv714a80bmr10pv1ehq1fr8e2qcujz 2429645 2429644 2026-06-23T13:46:38Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.network.cloud-host for host cloudcephosd10543 2429645 wikitext text/x-wiki 036hzre36tejgddxoxxl1fd29ufx2e3 2429646 2429645 2026-06-23T13:46:40Z Stashbot 7414 cmooney@cumin1003: END (FAIL) - Cookbook sre.network.cloud-host (exit_code=99) for host cloudcephosd10543 2429646 wikitext text/x-wiki 0ofd9iar61tgzgutps1advpnlbv5gel 2429647 2429646 2026-06-23T13:46:43Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.network.cloud-host for host cloudcephosd1053 2429647 wikitext text/x-wiki 31foqaf1ed1f94ow483gbxcryfdht2y 2429648 2429647 2026-06-23T13:46:46Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host cloudcephosd1053 2429648 wikitext text/x-wiki 0z2n8len06z4zq18ydf90m1vahuegh8 2429649 2429648 2026-06-23T13:46:53Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.pool pool db1160: Migration of db1160.eqiad.wmnet completed 2429649 wikitext text/x-wiki 46aeg07iiy7qiwpces9i38yskv84yml 2429650 2429649 2026-06-23T13:47:13Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host cloudcephosd1053 2429650 wikitext text/x-wiki qh91gebz0v8i8xmgpfmqv4o2as59dz6 2429651 2429650 2026-06-23T13:47:15Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.network.cloud-host (exit_code=0) for host cloudcephosd1053 2429651 wikitext text/x-wiki dzyf83i9e216vsf5wzhjp4hj9pjcqpk 2429653 2429651 2026-06-23T13:48:16Z Stashbot 7414 cscott@deploy1003: cscott: Continuing with deployment 2429653 wikitext text/x-wiki bogqyzm7x39bkry6hzwrjmhyekwm85a 2429654 2429653 2026-06-23T13:50:52Z Stashbot 7414 brennen@deploy1003: Started deploy [phabricator/deployment@a640ed9]: test deploy phab2003 2429654 wikitext text/x-wiki ep4h6lkrv56brenzzv4fib3fo4nbil4 2429656 2429654 2026-06-23T13:52:14Z Stashbot 7414 brennen@deploy1003: Finished deploy [phabricator/deployment@a640ed9]: test deploy phab2003 (duration: 01m 22s) 2429656 wikitext text/x-wiki 2776gk9dv1s3rl5cv5j8vr42i0ndswq 2429657 2429656 2026-06-23T13:52:42Z Stashbot 7414 cscott@deploy1003: Finished scap sync-world: Backport for [[gerrit:1305017|[parser] Add configuration to return experimental PFragment types]], [[gerrit:1305018|[parser] Return HeadingPFragments while preprocessing (T391624 T387520 T387521 T384490 T387374)]], [[gerrit:1305025|[parser] Return ExtTagPFragments while preprocessing (T429624)]] (duration: 08m 29s) 2429657 wikitext text/x-wiki 9dzupg9hg32kb64gsze738e6af5ud16 2429658 2429657 2026-06-23T13:53:08Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.wipe-cache sretest1006.mgmt.eqiad.wmnet on all recursors 2429658 wikitext text/x-wiki jqt718f56ns6u1bxgllvfw9n0ogvedf 2429659 2429658 2026-06-23T13:53:12Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) sretest1006.mgmt.eqiad.wmnet on all recursors 2429659 wikitext text/x-wiki 5n3r8rv217evoaiukw8le47vceqqatb 2429661 2429659 2026-06-23T13:58:23Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.hosts.reimage for host sretest1006.eqiad.wmnet with OS trixie 2429661 wikitext text/x-wiki 0ajlcbzx6lrxw52w18oo5ng7831a520 2429662 2429661 2026-06-23T13:58:45Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.pool pool db2155: Migration of db2155.codfw.wmnet completed 2429662 wikitext text/x-wiki 67a61zmbw07n80azbzraj7su47kt7ks 2429663 2429662 2026-06-23T14:01:05Z Stashbot 7414 atsuko@deploy1003: Started scap sync-world: Backport for [[gerrit:1305062|translate: remove CirrusSearch endpoints (T425377)]] 2429663 wikitext text/x-wiki o53qk33hjg510chjpr0sn1j9mb6b9ez 2429665 2429663 2026-06-23T14:03:36Z Stashbot 7414 atsuko@deploy1003: atsuko: Backport for [[gerrit:1305062|translate: remove CirrusSearch endpoints (T425377)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2429665 wikitext text/x-wiki liykin5aokzqqkcuwy5rh5vp92mskhq 2429668 2429665 2026-06-23T14:05:47Z Stashbot 7414 atsuko@deploy1003: atsuko: Continuing with deployment 2429668 wikitext text/x-wiki a29djdsgppjz9ogo9uttndylck8w64u 2429669 2429668 2026-06-23T14:10:02Z Stashbot 7414 atsuko@deploy1003: Finished scap sync-world: Backport for [[gerrit:1305062|translate: remove CirrusSearch endpoints (T425377)]] (duration: 08m 59s) 2429669 wikitext text/x-wiki 64dvzdpoba489f1n9vblubnpw6tusrr 2429672 2429669 2026-06-23T14:18:14Z Stashbot 7414 ebysans@deploy1003: Started deploy [analytics/refinery@83cc0ad] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@83cc0ad3] 2429672 wikitext text/x-wiki a48tzv6sr1tznneiopqsh8vsdxzgr2j 2429674 2429672 2026-06-23T14:20:15Z Stashbot 7414 ebysans@deploy1003: Finished deploy [analytics/refinery@83cc0ad] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@83cc0ad3] (duration: 02m 00s) 2429674 wikitext text/x-wiki m0v39btiusd4ypdv0htsxqbkhsxhmc8 2429677 2429674 2026-06-23T14:20:46Z Stashbot 7414 ebysans@deploy1003: Started deploy [analytics/refinery@83cc0ad]: Regular analytics weekly train [analytics/refinery@83cc0ad3] 2429677 wikitext text/x-wiki 52b8kmrsr4r4t2sy63wnm26og8d0kmw 2429678 2429677 2026-06-23T14:22:13Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-product: apply 2429678 wikitext text/x-wiki klr81b2rkdmtf0raexcn1jblk68wa39 2429679 2429678 2026-06-23T14:22:53Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-product: apply 2429679 wikitext text/x-wiki 92e592vl7nam9bqdras7gh0htrkz90k 2429680 2429679 2026-06-23T14:23:12Z Stashbot 7414 cscott@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2429680 wikitext text/x-wiki mwtpmc5unvs4hdakc1km2qu21x05psn 2429681 2429680 2026-06-23T14:23:43Z Stashbot 7414 cscott@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2429681 wikitext text/x-wiki hp7lnl6z0ctihh1io42hbn2x0ka1x5t 2429682 2429681 2026-06-23T14:23:46Z Stashbot 7414 cscott@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2429682 wikitext text/x-wiki kkbqgwogmttlgu883yspj4tqxmtiyqq 2429683 2429682 2026-06-23T14:24:15Z Stashbot 7414 cscott@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2429683 wikitext text/x-wiki gx2xgf6uh85oqd7c40fhdx8of7gcnbs 2429688 2429683 2026-06-23T14:26:44Z Stashbot 7414 ebysans@deploy1003: Finished deploy [analytics/refinery@83cc0ad]: Regular analytics weekly train [analytics/refinery@83cc0ad3] (duration: 05m 57s) 2429688 wikitext text/x-wiki frxolrf17pqq4sc7jta9iekvth2nu4g 2429690 2429688 2026-06-23T14:28:58Z Stashbot 7414 ebysans@deploy1003: Started deploy [analytics/refinery@83cc0ad] (thin): Regular analytics weekly train THIN [analytics/refinery@83cc0ad3] 2429690 wikitext text/x-wiki cg7p56z9c3v6zu4c8uahszgahijo2pq 2429691 2429690 2026-06-23T14:30:57Z Stashbot 7414 ebysans@deploy1003: Finished deploy [analytics/refinery@83cc0ad] (thin): Regular analytics weekly train THIN [analytics/refinery@83cc0ad3] (duration: 01m 59s) 2429691 wikitext text/x-wiki aje3289yhxw5jci0ayo427x140hfbac 2429693 2429691 2026-06-23T14:32:24Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1160: Migration of db1160.eqiad.wmnet completed 2429693 wikitext text/x-wiki t9prd1aydqs70hcqv6nsz3r5vwsc2pn 2429694 2429693 2026-06-23T14:32:26Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2429694 wikitext text/x-wiki 5gyyi1bonr90g4wnl7jcqxynnbdyjp2 2429695 2429694 2026-06-23T14:34:04Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.major-upgrade 2429695 wikitext text/x-wiki ka0xynnzmmyilgk6run2g19dcjm0akj 2429696 2429695 2026-06-23T14:34:08Z Stashbot 7414 cwilliams@cumin1003: dbmaint on s4@eqiad T429893 2429696 wikitext text/x-wiki imzq733i5futvsabn5j9d91j8bssfjb 2429697 2429696 2026-06-23T14:34:24Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.depool depool db1190: Upgrading db1190.eqiad.wmnet 2429697 wikitext text/x-wiki mc314ibo5xpurvhmy1wh64ow7h82r4b 2429698 2429697 2026-06-23T14:34:57Z Stashbot 7414 cmooney@cumin1003: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host sretest1006.eqiad.wmnet with OS trixie 2429698 wikitext text/x-wiki 6c5lb6v3j845k6lawytohrudwju1fnq 2429699 2429698 2026-06-23T14:35:10Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1190: Upgrading db1190.eqiad.wmnet 2429699 wikitext text/x-wiki 6t4lw9p3i1n4kz8qt7swsrehbztp9om 2429700 2429699 2026-06-23T14:36:46Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reimage for host db1190.eqiad.wmnet with OS trixie 2429700 wikitext text/x-wiki gfuptowul2jr7nni1n0qyth7lp244e2 2429701 2429700 2026-06-23T14:37:04Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.hosts.reimage for host sretest1006.eqiad.wmnet with OS trixie 2429701 wikitext text/x-wiki 5pql7rq1evcrjkiyfb4f1ttjvmozt0v 2429703 2429701 2026-06-23T14:40:09Z Stashbot 7414 kamila@deploy1003: Started scap sync-world: switch default image to Debian Bookworm, disable Bullseye 2429703 wikitext text/x-wiki tvuxuk4dbp8p01jjlkn72r7ly94ow0n 2429708 2429703 2026-06-23T14:44:16Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2155: Migration of db2155.codfw.wmnet completed 2429708 wikitext text/x-wiki qnp84qu143p3h6wwawl2w2j94wnwnph 2429709 2429708 2026-06-23T14:44:18Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2429709 wikitext text/x-wiki 6rah08hccoqg68pb7tf5gy5q6fuj44l 2429711 2429709 2026-06-23T14:51:21Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1190.eqiad.wmnet with reason: host reimage 2429711 wikitext text/x-wiki ln3smo99x4129bchczvlqmpyevignq7 2429719 2429711 2026-06-23T14:55:14Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1190.eqiad.wmnet with reason: host reimage 2429719 wikitext text/x-wiki dqpefaqii389e8zjw3pxoy64ivsq2bl 2429723 2429719 2026-06-23T14:56:41Z Stashbot 7414 SandraEbele_: Deployed Refinery as part of weekly deployment train 2429723 wikitext text/x-wiki f1wspcfig4ji2i4fdo0980inv03oqc1 2429726 2429723 2026-06-23T15:06:32Z Stashbot 7414 dzahn@cumin2002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on phab2003.codfw.wmnet with reason: deploy 2429726 wikitext text/x-wiki 6lk02l2ijx3fp7mi4cy9gil7aecljs4 2429727 2429726 2026-06-23T15:06:58Z Stashbot 7414 dzahn@cumin2002: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on phab1004.eqiad.wmnet with reason: deploy 2429727 wikitext text/x-wiki ous74fhku3ztsc9p4831sfdl5e54s60 2429728 2429727 2026-06-23T15:07:01Z Stashbot 7414 brennen@deploy1003: Started deploy [phabricator/deployment@4d1f033]: deploy phab2003 for T429925 2429728 wikitext text/x-wiki 027hqhn9hesrqma2m31a51vjm0prbln 2429729 2429728 2026-06-23T15:07:51Z Stashbot 7414 brennen@deploy1003: Finished deploy [phabricator/deployment@4d1f033]: deploy phab2003 for T429925 (duration: 00m 50s) 2429729 wikitext text/x-wiki fdlwzbnzsmzkobbge8nxa5m2g2dg8i1 2429730 2429729 2026-06-23T15:08:20Z Stashbot 7414 brennen@deploy1003: Started deploy [phabricator/deployment@4d1f033]: deploy phab1004 for T429925 2429730 wikitext text/x-wiki mhlqmbgp9ol0icuiulv13p4w8lu2o66 2429732 2429730 2026-06-23T15:09:11Z Stashbot 7414 brennen@deploy1003: Finished deploy [phabricator/deployment@4d1f033]: deploy phab1004 for T429925 (duration: 00m 48s) 2429732 wikitext text/x-wiki osnzrjqpwgytwh42kzc5g827n2rw6m9 2429733 2429732 2026-06-23T15:09:13Z Stashbot 7414 kamila@deploy1003: Finished scap sync-world: switch default image to Debian Bookworm, disable Bullseye (duration: 29m 18s) 2429733 wikitext text/x-wiki tdov4yuf410zx94pf29err4ijwt06bc 2429734 2429733 2026-06-23T15:09:43Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1190.eqiad.wmnet with OS trixie 2429734 wikitext text/x-wiki bwpdkjuko60t4av482r6xg49q1jwxz1 2429735 2429734 2026-06-23T15:15:46Z Stashbot 7414 dreamyjazz@deploy1003: Started scap sync-world: Backport for [[gerrit:1305123|CaptchaFactory: Fallback config for badloginperuser from badlogin (T429902)]], [[gerrit:1305122|CaptchaFactory: Fallback config for badloginperuser from badlogin (T429902)]], [[gerrit:1305051|ULS rewrite: Don't initialize IME and undo tooltip on Minerva skin (T429774)]] 2429735 wikitext text/x-wiki 31spd80jmxzdfsb2es6kirtpw6qig3e 2429736 2429735 2026-06-23T15:16:39Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-product: apply 2429736 wikitext text/x-wiki sofr9ow6ck12sy0xjkbn0lcts8tfyue 2429737 2429736 2026-06-23T15:17:12Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-product: apply 2429737 wikitext text/x-wiki c6zm3rnce7z93lo7hw4ndx1lccwvs7h 2429738 2429737 2026-06-23T15:17:27Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.major-upgrade 2429738 wikitext text/x-wiki e8w6i1ttcknubqrz9icy5jk3i83gi1m 2429739 2429738 2026-06-23T15:17:30Z Stashbot 7414 cwilliams@cumin1003: dbmaint on s4@codfw T429893 2429739 wikitext text/x-wiki so01j27z7meff5k6n0vn7kmtn618c9a 2429740 2429739 2026-06-23T15:17:48Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.depool depool db2172: Upgrading db2172.codfw.wmnet 2429740 wikitext text/x-wiki jrnzp5lf6i53iyi6zbvlmzhf7qhg36n 2429741 2429740 2026-06-23T15:18:08Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. 2429741 wikitext text/x-wiki 0y11s3x3cnjxqjdykmw6l6ll0c9e5s4 2429742 2429741 2026-06-23T15:18:10Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2172: Upgrading db2172.codfw.wmnet 2429742 wikitext text/x-wiki e2b3ya00qxghshqc3kkig9bo1wl81o9 2429743 2429742 2026-06-23T15:18:25Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. 2429743 wikitext text/x-wiki gax7e703chjag30ie9re93z19wzg542 2429744 2429743 2026-06-23T15:19:55Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz, abi: Backport for [[gerrit:1305123|CaptchaFactory: Fallback config for badloginperuser from badlogin (T429902)]], [[gerrit:1305122|CaptchaFactory: Fallback config for badloginperuser from badlogin (T429902)]], [[gerrit:1305051|ULS rewrite: Don't initialize IME and undo tooltip on Minerva skin (T429774)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Cha 2429744 wikitext text/x-wiki 9e4vpr4dzvta9s9j7fxp7xd6d69882u 2429745 2429744 2026-06-23T15:20:01Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2429745 wikitext text/x-wiki cjo0oc0x3k3fjps9vq1svuf99tnm88b 2429746 2429745 2026-06-23T15:20:11Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz, abi: Continuing with deployment 2429746 wikitext text/x-wiki rmm874c10klz69vvi3a4c4u1ihglv84 2429747 2429746 2026-06-23T15:20:21Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2429747 wikitext text/x-wiki 91grzl7cl0vz1csquk0vb5spqm03wyo 2429748 2429747 2026-06-23T15:20:36Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reimage for host db2172.codfw.wmnet with OS trixie 2429748 wikitext text/x-wiki 1mdz5ffrhtjvf82jh6znxwi7x7hbbs6 2429749 2429748 2026-06-23T15:21:31Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.pool pool db1190: Migration of db1190.eqiad.wmnet completed 2429749 wikitext text/x-wiki i38cmqffv3d7pxs3ipsqavo7lutwkp0 2429750 2429749 2026-06-23T15:26:45Z Stashbot 7414 dreamyjazz@deploy1003: Finished scap sync-world: Backport for [[gerrit:1305123|CaptchaFactory: Fallback config for badloginperuser from badlogin (T429902)]], [[gerrit:1305122|CaptchaFactory: Fallback config for badloginperuser from badlogin (T429902)]], [[gerrit:1305051|ULS rewrite: Don't initialize IME and undo tooltip on Minerva skin (T429774)]] (duration: 10m 59s) 2429750 wikitext text/x-wiki ciylowrjn8bdntho8wfxl6x70y7y4by 2429751 2429750 2026-06-23T15:38:30Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db2172.codfw.wmnet with reason: host reimage 2429751 wikitext text/x-wiki sg674usy11xh131120sc436m3c64779 2429752 2429751 2026-06-23T15:42:48Z Stashbot 7414 rzl: rzl@deploy1003:~$ kube-env mw-script-deploy eqiad; helm uninstall yhn94m3m # job completed successfully but helm release stuck in pending-install 2429752 wikitext text/x-wiki 6h84ipiydyf0i5jl0pk2a4vas8a3jml 2429753 2429752 2026-06-23T15:43:49Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2172.codfw.wmnet with reason: host reimage 2429753 wikitext text/x-wiki 5ehgwqabjdwvnvpw12z8u8aqlqpvrgr 2429754 2429753 2026-06-23T15:46:16Z Stashbot 7414 dreamyjazz@deploy1003: Started scap sync-world: Backport for [[gerrit:1305165|hCaptcha: Enable for badlogin on all wikis (T429843)]] 2429754 wikitext text/x-wiki ttutl2auvgwp4tqgkfpj80lzsx92hb9 2429755 2429754 2026-06-23T15:48:17Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Backport for [[gerrit:1305165|hCaptcha: Enable for badlogin on all wikis (T429843)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2429755 wikitext text/x-wiki 25yxwh195w00ec5zknvneyuad0016gm 2429756 2429755 2026-06-23T15:49:07Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Continuing with deployment 2429756 wikitext text/x-wiki 6lqkte8dxs6gseniy1tg3dy6ddozukc 2429758 2429756 2026-06-23T15:53:22Z Stashbot 7414 dreamyjazz@deploy1003: Finished scap sync-world: Backport for [[gerrit:1305165|hCaptcha: Enable for badlogin on all wikis (T429843)]] (duration: 07m 06s) 2429758 wikitext text/x-wiki eanmzhojwwjtzbiz24ttukvhuoq7zzc 2429759 2429758 2026-06-23T15:57:17Z Stashbot 7414 cmooney@cumin1003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest1006.eqiad.wmnet with OS trixie 2429759 wikitext text/x-wiki jd9jhtwu5ozmltjaz364h1y1xgqzkz0 2429760 2429759 2026-06-23T16:01:40Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2172.codfw.wmnet with OS trixie 2429760 wikitext text/x-wiki sbpx748fzdp3czsqj71ufzrqdi05hic 2429763 2429760 2026-06-23T16:05:57Z Stashbot 7414 ladsgroup@dns1004: START - running authdns-update 2429763 wikitext text/x-wiki 1nl9etlm40epopsxrwl6redc14pmvr6 2429764 2429763 2026-06-23T16:07:01Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1190: Migration of db1190.eqiad.wmnet completed 2429764 wikitext text/x-wiki 7q1l97m44f9r0y1vly2qyuhn8u2y0o7 2429765 2429764 2026-06-23T16:07:03Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2429765 wikitext text/x-wiki to428qlkelg0z9t4wh6dqhyafrkjyp0 2429766 2429765 2026-06-23T16:07:16Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.hosts.reimage for host sretest1006.eqiad.wmnet with OS trixie 2429766 wikitext text/x-wiki g9gn7d7umozkdzd0lh2cptlzghddnqv 2429767 2429766 2026-06-23T16:07:50Z Stashbot 7414 ladsgroup@dns1004: END - running authdns-update 2429767 wikitext text/x-wiki rjcbttk4mkpoba8h63w37gsg47l7da6 2429768 2429767 2026-06-23T16:08:38Z Stashbot 7414 ladsgroup@dns1004: START - running authdns-update 2429768 wikitext text/x-wiki krvssjwds4kmaws90uhabpt468oyg5l 2429771 2429768 2026-06-23T16:10:30Z Stashbot 7414 ladsgroup@dns1004: END - running authdns-update 2429771 wikitext text/x-wiki h087hw5722yuz4gdt1hwy6scg5bsg6j 2429772 2429771 2026-06-23T16:14:10Z Stashbot 7414 cmooney@cumin1003: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host sretest1006.eqiad.wmnet with OS trixie 2429772 wikitext text/x-wiki 0rr0vdjpfexsl2arwd7o7a0faektttp 2429773 2429772 2026-06-23T16:15:20Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.hosts.reimage for host sretest1006.eqiad.wmnet with OS trixie 2429773 wikitext text/x-wiki g9ayecuc0i312mkrm7v1gw4h5ixfkjo 2429774 2429773 2026-06-23T16:16:33Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.pool pool db2172: Migration of db2172.codfw.wmnet completed 2429774 wikitext text/x-wiki cxo1zegl5hjnlkzv6cerpwvqzkaq99k 2429782 2429774 2026-06-23T16:50:35Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] START helmfile.d/services/shellbox: apply 2429782 wikitext text/x-wiki 31j7wvefuu025fp4fzy994y8q0lq0vm 2429783 2429782 2026-06-23T16:51:02Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox: apply 2429783 wikitext text/x-wiki du9n7gwdsbn7jqrjchraf4hfdjne5ag 2429784 2429783 2026-06-23T16:51:04Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-constraints: apply 2429784 wikitext text/x-wiki r3atls9p649gwim1y8nwappbakxvxvi 2429785 2429784 2026-06-23T16:51:15Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-constraints: apply 2429785 wikitext text/x-wiki awadfhsdgp5l17hnxvdgld8v54v4ger 2429786 2429785 2026-06-23T16:51:17Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-media: apply 2429786 wikitext text/x-wiki 3o0pt43nkf0m7wjghsxj8b2bfo15mzi 2429788 2429786 2026-06-23T16:51:29Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-media: apply 2429788 wikitext text/x-wiki l5s2m4cytw9yxi76wfthfal3rhsf7qh 2429789 2429788 2026-06-23T16:51:33Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-syntaxhighlight: apply 2429789 wikitext text/x-wiki 5q8txgvyapl8u2qdexh9gbu08npklc0 2429791 2429789 2026-06-23T16:51:44Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-syntaxhighlight: apply 2429791 wikitext text/x-wiki oqmdchjyhlul87zfqo5hfpg81ox5r1b 2429792 2429791 2026-06-23T16:51:46Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-timeline: apply 2429792 wikitext text/x-wiki e2d0yw7kekp2a7y33wpevv9yf2bbs6d 2429793 2429792 2026-06-23T16:52:02Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-timeline: apply 2429793 wikitext text/x-wiki h7vfp0w8age7wofe1moj4zmgwu6dwv9 2429794 2429793 2026-06-23T16:52:04Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-video: apply 2429794 wikitext text/x-wiki 953x7m33dpo6jgbgchrpd4507kxu2j4 2429795 2429794 2026-06-23T16:52:25Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-video: apply 2429795 wikitext text/x-wiki 755mz3hgs5fadn0p1q86bfjlkiibbmy 2429796 2429795 2026-06-23T16:53:14Z Stashbot 7414 ladsgroup@deploy1003: Started scap sync-world: Backport for [[gerrit:1305196|Init Wikipedia Interslavic (T429920)]] 2429796 wikitext text/x-wiki l06zbydadkypsvstauyep53o8byz89c 2429798 2429796 2026-06-23T16:55:19Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup: Backport for [[gerrit:1305196|Init Wikipedia Interslavic (T429920)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2429798 wikitext text/x-wiki fhwevd2uadba9gwnna5ms6ew299az2g 2429799 2429798 2026-06-23T16:55:49Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup: Continuing with deployment 2429799 wikitext text/x-wiki d20irnms7968o1j29unxfah22dtyb23 2429801 2429799 2026-06-23T17:00:08Z Stashbot 7414 ladsgroup@deploy1003: Finished scap sync-world: Backport for [[gerrit:1305196|Init Wikipedia Interslavic (T429920)]] (duration: 06m 55s) 2429801 wikitext text/x-wiki o2y3kk2p562098niu5evt7tqmop5uzr 2429802 2429801 2026-06-23T17:00:25Z Stashbot 7414 cmooney@cumin1003: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host sretest1006.eqiad.wmnet with OS trixie 2429802 wikitext text/x-wiki liq0asagdo12sq0q6atzqtrp7duz49i 2429804 2429802 2026-06-23T17:01:36Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.hosts.reimage for host sretest1006.eqiad.wmnet with OS trixie 2429804 wikitext text/x-wiki 78d3ls1lqavdjx8k8fv7f6eum1qewf5 2429805 2429804 2026-06-23T17:02:05Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2172: Migration of db2172.codfw.wmnet completed 2429805 wikitext text/x-wiki hxcqwf2rqr6f88iybbg4wmiza58cyxp 2429806 2429805 2026-06-23T17:02:07Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2429806 wikitext text/x-wiki b8i8gf8sxss3ialjstfmzcss2lq677j 2429812 2429806 2026-06-23T17:08:30Z Stashbot 7414 ladsgroup@deploy1003: Started scap sync-world: Backport for [[gerrit:1305199|Activate Wikipedia Interslavic (T429920)]] 2429812 wikitext text/x-wiki 2itn3vk0arozxfb2eyirhxqy247nykv 2429813 2429812 2026-06-23T17:10:36Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup: Backport for [[gerrit:1305199|Activate Wikipedia Interslavic (T429920)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2429813 wikitext text/x-wiki l8tzgbgqh76ljq7bkqwmlymtrtgn9a4 2429814 2429813 2026-06-23T17:10:55Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup: Continuing with deployment 2429814 wikitext text/x-wiki 2mcrvh9pl2woybfosq5burh6iebiiuv 2429817 2429814 2026-06-23T17:13:52Z Stashbot 7414 cmooney@cumin1003: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host sretest1006.eqiad.wmnet with OS trixie 2429817 wikitext text/x-wiki hb45nkoak2q8avwvn1nklavm8hbwxlm 2429818 2429817 2026-06-23T17:15:13Z Stashbot 7414 ladsgroup@deploy1003: Finished scap sync-world: Backport for [[gerrit:1305199|Activate Wikipedia Interslavic (T429920)]] (duration: 06m 43s) 2429818 wikitext text/x-wiki ax4vbait2b6npqg4n4kqr38pdoyn07y 2429821 2429818 2026-06-23T17:23:09Z Stashbot 7414 reedy@deploy1003: Started scap sync-world: Backport for [[gerrit:1305202|Updated guzzlehttp/guzzle from 7.12.1 to 7.12.3 (T429965)]], [[gerrit:1305201|Upgrade guzzlehttp/* (T429965)]], [[gerrit:1305198|Updated guzzlehttp/guzzle from 7.12.1 to 7.12.3 (T429965)]], [[gerrit:1305197|Upgrade guzzlehttp/* (T429965)]] 2429821 wikitext text/x-wiki 2sy0x9bkegh2st2f9pkzdr5mp8gej1k 2429822 2429821 2026-06-23T17:25:08Z Stashbot 7414 reedy@deploy1003: reedy: Backport for [[gerrit:1305202|Updated guzzlehttp/guzzle from 7.12.1 to 7.12.3 (T429965)]], [[gerrit:1305201|Upgrade guzzlehttp/* (T429965)]], [[gerrit:1305198|Updated guzzlehttp/guzzle from 7.12.1 to 7.12.3 (T429965)]], [[gerrit:1305197|Upgrade guzzlehttp/* (T429965)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2429822 wikitext text/x-wiki 72spphr3ecd6n6wyfkrliwe5a44xmjn 2429823 2429822 2026-06-23T17:29:25Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-product: apply 2429823 wikitext text/x-wiki 3zlvijooxwyzw084ds7sfvtmsjn8l5w 2429824 2429823 2026-06-23T17:30:00Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-product: apply 2429824 wikitext text/x-wiki 5o2kx1dynxsj9rwglr0ya75bc095qf1 2429828 2429824 2026-06-23T17:36:58Z Stashbot 7414 reedy@deploy1003: reedy: Continuing with deployment 2429828 wikitext text/x-wiki iqk7s94kqxznjmo1pv4x4ihx55ccwhw 2429829 2429828 2026-06-23T17:37:59Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-product: apply 2429829 wikitext text/x-wiki 1zvan8v68sk2r1up5m6ntoucn9ujqws 2429830 2429829 2026-06-23T17:38:02Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-product: apply 2429830 wikitext text/x-wiki in5cr7d410ygn4fsnpsbztaspoxwi91 2429832 2429830 2026-06-23T17:41:12Z Stashbot 7414 reedy@deploy1003: Finished scap sync-world: Backport for [[gerrit:1305202|Updated guzzlehttp/guzzle from 7.12.1 to 7.12.3 (T429965)]], [[gerrit:1305201|Upgrade guzzlehttp/* (T429965)]], [[gerrit:1305198|Updated guzzlehttp/guzzle from 7.12.1 to 7.12.3 (T429965)]], [[gerrit:1305197|Upgrade guzzlehttp/* (T429965)]] (duration: 18m 03s) 2429832 wikitext text/x-wiki 3q98pg2k6lrnkumjdtd7sm1r270scdw 2429833 2429832 2026-06-23T17:41:54Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox: apply 2429833 wikitext text/x-wiki dg1ogb81sdukgv9rxn930vhpqpoz1r6 2429834 2429833 2026-06-23T17:42:58Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox: apply 2429834 wikitext text/x-wiki sdydijtwjeemyzz41e6879ufg7z8eh3 2429836 2429834 2026-06-23T17:43:30Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-constraints: apply 2429836 wikitext text/x-wiki 839ffytgsaqz3kteq1s1qqepcn17fgt 2429837 2429836 2026-06-23T17:44:02Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-constraints: apply 2429837 wikitext text/x-wiki gjbqxihudccewde2zveau7io5cywjyf 2429838 2429837 2026-06-23T17:44:33Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-media: apply 2429838 wikitext text/x-wiki p1v2ky27zrhqwzb9fq8rdtry0pvm9r7 2429839 2429838 2026-06-23T17:44:52Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-media: apply 2429839 wikitext text/x-wiki 8s5s2bd24tgkpve623fqco08ydp867j 2429840 2429839 2026-06-23T17:45:23Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-syntaxhighlight: apply 2429840 wikitext text/x-wiki kgma6v1uquwn4z97sydvjpnqnj8pxnw 2429841 2429840 2026-06-23T17:45:41Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-syntaxhighlight: apply 2429841 wikitext text/x-wiki g0nfej359r9j1iwaoxsepg920ij4tq5 2429842 2429841 2026-06-23T17:46:12Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-timeline: apply 2429842 wikitext text/x-wiki arrthnfljur7zumnxwggpjcdlk628th 2429843 2429842 2026-06-23T17:46:39Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: apply 2429843 wikitext text/x-wiki 7f6vq5hh261bxd0ghx55yb0cvzboty8 2429844 2429843 2026-06-23T17:47:10Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-video: apply 2429844 wikitext text/x-wiki kg5q6noa3jbttymkp6vtoy6a6jy7ekm 2429845 2429844 2026-06-23T17:48:11Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-video: apply 2429845 wikitext text/x-wiki 8m3oii5r9ek4lmwk76sy2bgp4v4e2ly 2429849 2429845 2026-06-23T17:56:27Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox: apply 2429849 wikitext text/x-wiki drm6poyqu9dq001td8e465tjc8xgpzj 2429851 2429849 2026-06-23T17:57:42Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox: apply 2429851 wikitext text/x-wiki kazobqdxnq9fhy2hxlv5kf0pjhxs8tp 2429853 2429851 2026-06-23T17:58:13Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-constraints: apply 2429853 wikitext text/x-wiki ljuzkkas86413pssryqkr9nxdsg78h5 2429854 2429853 2026-06-23T17:59:01Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-constraints: apply 2429854 wikitext text/x-wiki hikoziiqcqs9ek96eb9aa27f2qpgmtl 2429857 2429854 2026-06-23T17:59:31Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-media: apply 2429857 wikitext text/x-wiki qv4ic3rrb3hooxf3q7m806f1fiscoi1 2429858 2429857 2026-06-23T17:59:44Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-media: apply 2429858 wikitext text/x-wiki hx2cbiujtpwvsrllfbngz0ldfkixnu1 2429859 2429858 2026-06-23T18:00:15Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-syntaxhighlight: apply 2429859 wikitext text/x-wiki 2jum9f1qmfbaf7v7s9gunlznkgmrar0 2429860 2429859 2026-06-23T18:00:34Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-syntaxhighlight: apply 2429860 wikitext text/x-wiki g2l9rf3op4d60vy5x76ppz84gionvoi 2429861 2429860 2026-06-23T18:01:05Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-timeline: apply 2429861 wikitext text/x-wiki eckj9q3dapc0z669da5z43cje6htx6m 2429862 2429861 2026-06-23T18:01:31Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-timeline: apply 2429862 wikitext text/x-wiki btvm6v1zejhtklvyoufuma0cbeu1xpa 2429863 2429862 2026-06-23T18:02:02Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-video: apply 2429863 wikitext text/x-wiki 9uoerzp5rud5onwl8jjurmju997ob2o 2429865 2429863 2026-06-23T18:03:02Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-video: apply 2429865 wikitext text/x-wiki i0jsctrwtktvpj8l4hwkyc2pg1a6yel 2429879 2429865 2026-06-23T18:26:56Z Stashbot 7414 brennen@deploy1003: Started scap sync-world: Backport for [[gerrit:1305223|[parser] Rename mStripExtTags to useParsoidFragments (T429928)]] 2429879 wikitext text/x-wiki nym8s4jql702uzjg3fj2kkhp2chw4w3 2429880 2429879 2026-06-23T18:28:57Z Stashbot 7414 brennen@deploy1003: brennen, cscott: Backport for [[gerrit:1305223|[parser] Rename mStripExtTags to useParsoidFragments (T429928)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2429880 wikitext text/x-wiki 15h6ewanh4l30eh5r9ftkd6ngaitg3t 2429882 2429880 2026-06-23T18:31:26Z Stashbot 7414 brennen@deploy1003: brennen, cscott: Continuing with deployment 2429882 wikitext text/x-wiki fgyt7sgxp46ld8zm1bp7zdsqdbjygx9 2429885 2429882 2026-06-23T18:37:44Z Stashbot 7414 brennen@deploy1003: Finished scap sync-world: Backport for [[gerrit:1305223|[parser] Rename mStripExtTags to useParsoidFragments (T429928)]] (duration: 10m 49s) 2429885 wikitext text/x-wiki d7uxwghae2j1itoefderrobf639njjl 2429886 2429885 2026-06-23T18:52:19Z Stashbot 7414 brennen@deploy1003: rebuilt and synchronized wikiversions files: group0 to 1.47.0-wmf.8 refs T423917 2429886 wikitext text/x-wiki 3u29nopkdpg367d8tv91csqnmwopq18 2429892 2429886 2026-06-23T19:59:40Z Stashbot 7414 arlolra@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2429892 wikitext text/x-wiki dnsjkxf19p5f4eaqkanh8n5pioxsmjp 2429893 2429892 2026-06-23T20:00:13Z Stashbot 7414 arlolra@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2429893 wikitext text/x-wiki ceypyj0z111czrzzia72dz5356n24fk 2429894 2429893 2026-06-23T20:00:15Z Stashbot 7414 arlolra@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2429894 wikitext text/x-wiki 61aaex901ncy9k9fqspcgf0ufzruqqq 2429895 2429894 2026-06-23T20:00:50Z Stashbot 7414 arlolra@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2429895 wikitext text/x-wiki lj994ufxmqec4smietvpg90ekpiy2kl 2429900 2429895 2026-06-23T20:08:11Z Stashbot 7414 sbassett@deploy1003: Started scap sync-world: Backport for [[gerrit:1304876|Lazily reject pre-fix parser-cache entries for noreferrer/noopener links (T429090 T429244)]], [[gerrit:1305049|Enable MMV carousel on non-en wikipedias (T429509)]] 2429900 wikitext text/x-wiki m5eh0pifavjvbxx4rom0qpa5flph6zi 2429901 2429900 2026-06-23T20:10:16Z Stashbot 7414 sbassett@deploy1003: sbassett, mlitn: Backport for [[gerrit:1304876|Lazily reject pre-fix parser-cache entries for noreferrer/noopener links (T429090 T429244)]], [[gerrit:1305049|Enable MMV carousel on non-en wikipedias (T429509)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2429901 wikitext text/x-wiki 9tyd1dsem9gbt2ev9rpe2r3fhe5mbt2 2429902 2429901 2026-06-23T20:14:08Z Stashbot 7414 sbassett@deploy1003: sbassett, mlitn: Continuing with deployment 2429902 wikitext text/x-wiki rkbk4oclzd8aqf434859bjb7i99zi7v 2429903 2429902 2026-06-23T20:18:28Z Stashbot 7414 sbassett@deploy1003: Finished scap sync-world: Backport for [[gerrit:1304876|Lazily reject pre-fix parser-cache entries for noreferrer/noopener links (T429090 T429244)]], [[gerrit:1305049|Enable MMV carousel on non-en wikipedias (T429509)]] (duration: 10m 17s) 2429903 wikitext text/x-wiki i0ak28r0682lpv98fpt7y91qz1t9jrw 2429904 2429903 2026-06-23T20:33:32Z Stashbot 7414 dreamyjazz@deploy1003: Started scap sync-world: Backport for [[gerrit:1305241|hCaptcha: Define login interface name for secureEnclave.js (T429963)]], [[gerrit:1305242|hCaptcha: Define login interface name for secureEnclave.js (T429963)]], [[gerrit:1305064|Improve click intent event logging and exposure tracking]], [[gerrit:1305215|Expand strip markers when they are present in attribute values (T383004)]] 2429904 wikitext text/x-wiki hl4oid334wbstomf3fu18yp2p7kymcr 2429905 2429904 2026-06-23T20:35:31Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz, wmde-fisch, arlolra: Backport for [[gerrit:1305241|hCaptcha: Define login interface name for secureEnclave.js (T429963)]], [[gerrit:1305242|hCaptcha: Define login interface name for secureEnclave.js (T429963)]], [[gerrit:1305064|Improve click intent event logging and exposure tracking]], [[gerrit:1305215|Expand strip markers when they are present in attribute values (T383004)]] synce 2429905 wikitext text/x-wiki aebzythy1wb7bsrl73kh6qbuuik9eb3 2429906 2429905 2026-06-23T20:37:22Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz, wmde-fisch, arlolra: Continuing with deployment 2429906 wikitext text/x-wiki rtre2zuj0t1cc39f83g6lfnbjv3txow 2429907 2429906 2026-06-23T20:41:41Z Stashbot 7414 dreamyjazz@deploy1003: Finished scap sync-world: Backport for [[gerrit:1305241|hCaptcha: Define login interface name for secureEnclave.js (T429963)]], [[gerrit:1305242|hCaptcha: Define login interface name for secureEnclave.js (T429963)]], [[gerrit:1305064|Improve click intent event logging and exposure tracking]], [[gerrit:1305215|Expand strip markers when they are present in attribute values (T383004)]] (duration: 0 2429907 wikitext text/x-wiki ftlpdsyw12y94c3v92fj60gu6zlh7i9 2429908 2429907 2026-06-23T20:44:27Z Stashbot 7414 Dreamy_Jazz: Evening UTC backport window done 2429908 wikitext text/x-wiki rz1ryfk0x9vdy4c6fp2shuk90o07iwf 2429909 2429908 2026-06-23T21:16:39Z Stashbot 7414 dreamyjazz@deploy1003: Started scap sync-world: Backport for [[gerrit:1305251|Revert "SourceEditorOverlay: Show CAPTCHA if has content in onStageChanges" (T429996)]] 2429909 wikitext text/x-wiki t2i8m26wmu7md9on24nykb3zje93gbw 2429910 2429909 2026-06-23T21:18:40Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Backport for [[gerrit:1305251|Revert "SourceEditorOverlay: Show CAPTCHA if has content in onStageChanges" (T429996)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2429910 wikitext text/x-wiki l4mia5krh3b73u249pxf2n2o8vartde 2429911 2429910 2026-06-23T21:19:12Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Continuing with deployment 2429911 wikitext text/x-wiki 1js0mngm4zss8ma5tbwvy95oliadd75 2429912 2429911 2026-06-23T21:23:30Z Stashbot 7414 dreamyjazz@deploy1003: Finished scap sync-world: Backport for [[gerrit:1305251|Revert "SourceEditorOverlay: Show CAPTCHA if has content in onStageChanges" (T429996)]] (duration: 06m 50s) 2429912 wikitext text/x-wiki 10wr7uvhoxv8gimckb0tsyb4xyow6ui 2429919 2429912 2026-06-23T22:06:39Z Stashbot 7414 dreamyjazz@deploy1003: Started scap sync-world: Backport for [[gerrit:1305256|hCaptcha: Temporarily disable risk score block collection (T428659)]], [[gerrit:1305257|hCaptcha: Reenable risk score block collection (T428659)]], [[gerrit:1305255|Update HCaptchaRiskScoreRetrievedForBlocks hook to not use IDs (T428659)]] 2429919 wikitext text/x-wiki jfwszvqd7ge0xok85naggwk1jbm9ku4 2429920 2429919 2026-06-23T22:08:39Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Backport for [[gerrit:1305256|hCaptcha: Temporarily disable risk score block collection (T428659)]], [[gerrit:1305257|hCaptcha: Reenable risk score block collection (T428659)]], [[gerrit:1305255|Update HCaptchaRiskScoreRetrievedForBlocks hook to not use IDs (T428659)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2429920 wikitext text/x-wiki b95i6dytxguxdyqjtun3jn25h9uojei 2429921 2429920 2026-06-23T22:11:33Z Stashbot 7414 dreamyjazz@deploy1003: dreamyjazz: Continuing with deployment 2429921 wikitext text/x-wiki cbbq43e0xd7ihtrd4nju549yur7s997 2429922 2429921 2026-06-23T22:15:52Z Stashbot 7414 dreamyjazz@deploy1003: Finished scap sync-world: Backport for [[gerrit:1305256|hCaptcha: Temporarily disable risk score block collection (T428659)]], [[gerrit:1305257|hCaptcha: Reenable risk score block collection (T428659)]], [[gerrit:1305255|Update HCaptchaRiskScoreRetrievedForBlocks hook to not use IDs (T428659)]] (duration: 09m 14s) 2429922 wikitext text/x-wiki 3wpym6ann51ofv4rgq45vamp65krkek 2429923 2429922 2026-06-23T22:20:22Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.network.peering with action 'configure' for AS: 12389 2429923 wikitext text/x-wiki e0b7m5o96e6m8j5nqqttu1wzoqmn967 2429925 2429923 2026-06-23T22:21:08Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'configure' for AS: 12389 2429925 wikitext text/x-wiki 75op82i9njzdfjpcz2vyhwsjs2yjh9v 2429950 2429925 2026-06-24T02:00:42Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2429950 wikitext text/x-wiki 0p9jybpruy3yx5yx0u4xsvv713js7b9 2429951 2429950 2026-06-24T02:07:27Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 06m 45s) 2429951 wikitext text/x-wiki ray4d5zo2p1k22ywmfbmx7y44pr506q 2429953 2429951 2026-06-24T05:13:40Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.sanitize-wiki Managing sanitization for wikis isvwiki in section s5 2429953 wikitext text/x-wiki 90tahsh3mtglu8coke5tjrgj0jxc2jz 2429954 2429953 2026-06-24T05:22:42Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.sanitize-wiki (exit_code=0) Managing sanitization for wikis isvwiki in section s5 2429954 wikitext text/x-wiki eu64po8cgp9ac3s6yh9g7ghp9xaro70 2429956 2429954 2026-06-24T05:41:09Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Set es7 eqiad as read-only for maintenance - T429867', diff saved to https://phabricator.wikimedia.org/P94392 and previous config saved to /var/cache/conftool/dbconfig/20260624-054106-marostegui.json 2429956 wikitext text/x-wiki ep7uxaqsk01qqf86iq8j9pnh2o2mkws 2429957 2429956 2026-06-24T05:41:25Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 9 hosts with reason: Primary switchover es7 T429867 2429957 wikitext text/x-wiki 20epoqv88vmpv5htxl60dah7y2o2gjy 2429958 2429957 2026-06-24T05:41:34Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Set es1039 with weight 0 T429867', diff saved to https://phabricator.wikimedia.org/P94393 and previous config saved to /var/cache/conftool/dbconfig/20260624-054131-marostegui.json 2429958 wikitext text/x-wiki bi5clhylindxammvbk6os17i25d9vg4 2429960 2429958 2026-06-24T05:44:26Z Stashbot 7414 marostegui: Starting es7 eqiad failover from es1035 to es1039 - T429867 2429960 wikitext text/x-wiki kqz7b1bm5u3rvst066j7q2xlhvqyyez 2429961 2429960 2026-06-24T05:44:49Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Promote es1039 to es7 primary T429867', diff saved to https://phabricator.wikimedia.org/P94394 and previous config saved to /var/cache/conftool/dbconfig/20260624-054446-marostegui.json 2429961 wikitext text/x-wiki fvmhsevcyt23zekrnksvxuq539yxqw6 2429962 2429961 2026-06-24T05:45:16Z Stashbot 7414 marostegui@dns1004: START - running authdns-update 2429962 wikitext text/x-wiki 4mij8jvmbr1h65ew22h17gjosxsfcg6 2429963 2429962 2026-06-24T05:45:51Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Depool es1035 T429867', diff saved to https://phabricator.wikimedia.org/P94395 and previous config saved to /var/cache/conftool/dbconfig/20260624-054547-marostegui.json 2429963 wikitext text/x-wiki 4rbiehvveck2b0zs49augazdntsqknx 2429964 2429963 2026-06-24T05:46:14Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Set es7 eqiad back to read-write - T429867', diff saved to https://phabricator.wikimedia.org/P94396 and previous config saved to /var/cache/conftool/dbconfig/20260624-054611-marostegui.json 2429964 wikitext text/x-wiki hcfvedacdsd0qgf7ypbl5o1bs3qp7oo 2429965 2429964 2026-06-24T05:47:08Z Stashbot 7414 marostegui@dns1004: END - running authdns-update 2429965 wikitext text/x-wiki bk6jgyhlfb5vf8h1vkz31hkv4yub9ao 2429966 2429965 2026-06-24T05:55:42Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.major-upgrade 2429966 wikitext text/x-wiki 2q8esbvl3ntcrgpwqz09mcwj5k74r6x 2429967 2429966 2026-06-24T05:55:45Z Stashbot 7414 marostegui@cumin1003: dbmaint on es7@eqiad T429463 2429967 wikitext text/x-wiki 57pqquug67mcbrfco6abiplztkyj6uf 2429968 2429967 2026-06-24T05:55:52Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool es1035: Upgrading es1035.eqiad.wmnet 2429968 wikitext text/x-wiki ezi3zigg6c36woc1rh0ej8yl4olqcp8 2429969 2429968 2026-06-24T05:56:02Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es1035: Upgrading es1035.eqiad.wmnet 2429969 wikitext text/x-wiki qh5yk12zbggxrelhbdgmog24l9ibtyb 2429971 2429969 2026-06-24T06:08:56Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.reimage for host es1035.eqiad.wmnet with OS trixie 2429971 wikitext text/x-wiki nqplhot9tsif1m7r261gnthkk7hw22g 2429976 2429971 2026-06-24T06:24:37Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on es1035.eqiad.wmnet with reason: host reimage 2429976 wikitext text/x-wiki jcyc5ipgjymy2cwg6d4avpbj32ka5oz 2429978 2429976 2026-06-24T06:29:20Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es1035.eqiad.wmnet with reason: host reimage 2429978 wikitext text/x-wiki h0tf8a269l0dhyh2mmpesrroek3i9fz 2429983 2429978 2026-06-24T06:45:08Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host cumin2003.codfw.wmnet 2429983 wikitext text/x-wiki 95putryvusvlc3jfqyn3flrde9ydie1 2429984 2429983 2026-06-24T06:46:34Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es1035.eqiad.wmnet with OS trixie 2429984 wikitext text/x-wiki s59qekglwyk7n4ktuj1ey555adwxut0 2429985 2429984 2026-06-24T06:51:24Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cumin2003.codfw.wmnet 2429985 wikitext text/x-wiki errvtqx2dids16wc7hbi6urt8xhhhw0 2429986 2429985 2026-06-24T06:53:39Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2028.codfw.wmnet 2429986 wikitext text/x-wiki cc9slk5thcnkgof1mzmpno800lggf40 2429987 2429986 2026-06-24T06:54:07Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool es1035: Migration of es1035.eqiad.wmnet completed 2429987 wikitext text/x-wiki ao0xfcaew2hd3ck38xp2s4hznxcecp4 2429988 2429987 2026-06-24T06:54:22Z Stashbot 7414 jmm@cumin2003: END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti2028.codfw.wmnet 2429988 wikitext text/x-wiki qctvnj3jfn5xdl4ar76zkjhf1n1q448 2429989 2429988 2026-06-24T06:54:29Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2046.codfw.wmnet 2429989 wikitext text/x-wiki if17uaaa9rn2y19mgqlgicqlf2w6zxd 2429990 2429989 2026-06-24T06:54:50Z Stashbot 7414 jmm@cumin2003: END (FAIL) - Cookbook sre.ganeti.drain-node (exit_code=99) for draining ganeti node ganeti2046.codfw.wmnet 2429990 wikitext text/x-wiki 24nxqhpzt5utbz9ea1t0gm51c5thq9x 2429992 2429990 2026-06-24T06:57:02Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.changedisk for changing disk type of ml-staging-etcd2001.codfw.wmnet to drbd 2429992 wikitext text/x-wiki tooj8gj6dtk2jyq4g3ggbtx4sxyfyhp 2429993 2429992 2026-06-24T07:01:25Z Stashbot 7414 mlitn@deploy1003: Started scap sync-world: Backport for [[gerrit:1305329|Enable MMV carousel on enwiki (T429509)]] 2429993 wikitext text/x-wiki sb9xvrdoofvhs3n48nmh81k7256eqx0 2429994 2429993 2026-06-24T07:03:56Z Stashbot 7414 mlitn@deploy1003: mlitn: Backport for [[gerrit:1305329|Enable MMV carousel on enwiki (T429509)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2429994 wikitext text/x-wiki 11oroggugi3mbn1iuy50ms0zll4xt8v 2429995 2429994 2026-06-24T07:04:48Z Stashbot 7414 mlitn@deploy1003: mlitn: Continuing with deployment 2429995 wikitext text/x-wiki 1180vi6n24sca4vb510n39wpwxal7fk 2429996 2429995 2026-06-24T07:07:05Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.changedisk (exit_code=0) for changing disk type of ml-staging-etcd2001.codfw.wmnet to drbd 2429996 wikitext text/x-wiki q19n0aziay77e0wgoxy1grk7zl2zqus 2429997 2429996 2026-06-24T07:08:27Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2028.codfw.wmnet 2429997 wikitext text/x-wiki svbd5c5vnap41u5lwhvl1q9x0vi7vxi 2429998 2429997 2026-06-24T07:09:15Z Stashbot 7414 mlitn@deploy1003: Finished scap sync-world: Backport for [[gerrit:1305329|Enable MMV carousel on enwiki (T429509)]] (duration: 07m 49s) 2429998 wikitext text/x-wiki 8qdnnhuxp6777zxezrqmjtv2ir64k7p 2429999 2429998 2026-06-24T07:09:32Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2028.codfw.wmnet 2429999 wikitext text/x-wiki 3qdcf5ecxvgy4cs2muy9jfbseuu4ti5 2430000 2429999 2026-06-24T07:11:33Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2028.codfw.wmnet 2430000 wikitext text/x-wiki ad09ggw5oks36egtbhnhjcrjkscdak8 2430001 2430000 2026-06-24T07:39:38Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool es1035: Migration of es1035.eqiad.wmnet completed 2430001 wikitext text/x-wiki tg2hm07s2ric8t70gyzugdb5tvgl4fz 2430002 2430001 2026-06-24T07:39:40Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2430002 wikitext text/x-wiki jbedgrvgswcx42zsi3630yeg4rmxeck 2430003 2430002 2026-06-24T07:41:00Z Stashbot 7414 jmm@dns1004: START - running authdns-update 2430003 wikitext text/x-wiki 6os99yj3m7epuay1q2akuewh6sr82wg 2430004 2430003 2026-06-24T07:42:53Z Stashbot 7414 jmm@dns1004: END - running authdns-update 2430004 wikitext text/x-wiki 325aolhm2szu50evwgoyvf1mvkttkzc 2430005 2430004 2026-06-24T07:50:34Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.major-upgrade 2430005 wikitext text/x-wiki gb30wf4kask5d54xv66u6ls0qn44u93 2430006 2430005 2026-06-24T07:50:38Z Stashbot 7414 cwilliams@cumin1003: dbmaint on s4@eqiad T429893 2430006 wikitext text/x-wiki l1rb2hsl4yasrrw8pudzb49k83032xl 2430007 2430006 2026-06-24T07:50:54Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.depool depool db1199: Upgrading db1199.eqiad.wmnet 2430007 wikitext text/x-wiki 25u2osefpyj9ic6donmo4e2qyz980bi 2430008 2430007 2026-06-24T07:51:49Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.provision for host kafka-logging2006.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART 2430008 wikitext text/x-wiki qn7c7h1vxl4p897kmtlhvila1fkz8i4 2430009 2430008 2026-06-24T07:52:51Z Stashbot 7414 elukey@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host kafka-logging2006.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART 2430009 wikitext text/x-wiki eqgb2dofgn2ds1a4tl4b0sz2fxj0wm5 2430010 2430009 2026-06-24T07:53:15Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1199: Upgrading db1199.eqiad.wmnet 2430010 wikitext text/x-wiki 47prwn9vkte93xr8hkd0xwuy3rkuu1m 2430011 2430010 2026-06-24T07:54:45Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.major-upgrade 2430011 wikitext text/x-wiki onkmjilqbkby9zohvxglaeaqzfpuonk 2430012 2430011 2026-06-24T07:54:49Z Stashbot 7414 cwilliams@cumin1003: dbmaint on s4@codfw T429893 2430012 wikitext text/x-wiki 5k7db9bc1hj509dktoreusbclz4pfrq 2430013 2430012 2026-06-24T07:55:07Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.depool depool db2179: Upgrading db2179.codfw.wmnet 2430013 wikitext text/x-wiki kpiepavtcmgxpu6i2q99thu31pky474 2430014 2430013 2026-06-24T07:55:18Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.provision for host kafka-logging2006.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART 2430014 wikitext text/x-wiki qpesx8ku9gnozs9looujgujnk8tg2qf 2430015 2430014 2026-06-24T07:55:39Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2179: Upgrading db2179.codfw.wmnet 2430015 wikitext text/x-wiki eivbrd21j6qvudxz1c5jg2mkx4gmovo 2430016 2430015 2026-06-24T07:56:33Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reimage for host db1199.eqiad.wmnet with OS trixie 2430016 wikitext text/x-wiki o33wtsszaenrcsrf1kltmxkuo6x94a4 2430017 2430016 2026-06-24T07:58:11Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reimage for host db2179.codfw.wmnet with OS trixie 2430017 wikitext text/x-wiki l30f92z8wfzkrz6cmpcjuqikh4xz4s9 2430018 2430017 2026-06-24T08:06:35Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host kafka-logging2006.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART 2430018 wikitext text/x-wiki biu5djxe3r75jlvhkhm3f46fcuuc76t 2430019 2430018 2026-06-24T08:07:34Z Stashbot 7414 fabfur: depooling cp7001 and cp7009 to reimage (T419825) 2430019 wikitext text/x-wiki hpwwhykx4ic2ljr8tr1mb5q5ors1w59 2430020 2430019 2026-06-24T08:08:49Z Stashbot 7414 fabfur@cumin1003: conftool action : set/pooled=yes; selector: name=cp7001.* 2430020 wikitext text/x-wiki fce6ivkv9d7mh8hfm5iuggppbxwewnx 2430021 2430020 2026-06-24T08:08:57Z Stashbot 7414 fabfur@cumin1003: conftool action : set/pooled=no; selector: name=cp7001.* 2430021 wikitext text/x-wiki ec4hsodxa0uce6ljr6mcjdq7xczg42b 2430022 2430021 2026-06-24T08:09:08Z Stashbot 7414 fabfur@cumin1003: conftool action : set/pooled=no; selector: name=cp7009.* 2430022 wikitext text/x-wiki 0y4zxydocv27ms3frak2dbmz72orh4f 2430023 2430022 2026-06-24T08:10:50Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1199.eqiad.wmnet with reason: host reimage 2430023 wikitext text/x-wiki 5d93wain06lzognk0yfvywzlkb80kj5 2430024 2430023 2026-06-24T08:13:48Z Stashbot 7414 fabfur@cumin1003: START - Cookbook sre.hosts.reimage for host cp7001.magru.wmnet with OS trixie 2430024 wikitext text/x-wiki hglfwapquzmr1dqo4dng89m7frtln19 2430025 2430024 2026-06-24T08:14:36Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1199.eqiad.wmnet with reason: host reimage 2430025 wikitext text/x-wiki bmdpxh1561fdx31a6tw3pyabr6qrjv3 2430026 2430025 2026-06-24T08:16:57Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db2179.codfw.wmnet with reason: host reimage 2430026 wikitext text/x-wiki 4rb3ux38ygt3pmnfdoyjsqa5a7jc0zz 2430027 2430026 2026-06-24T08:18:41Z Stashbot 7414 marostegui@cumin1003: conftool action : set/pooled=no; selector: name=clouddb1013.eqiad.wmnet,service=s1 2430027 wikitext text/x-wiki ni1yx3ogdctqkp2gqyf271fuovvh42y 2430028 2430027 2026-06-24T08:21:59Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on clouddb1013.eqiad.wmnet with reason: Cloning cloddb1026 2430028 wikitext text/x-wiki fp31u49e5zahxpfpak8g89gfbsxlz6y 2430029 2430028 2026-06-24T08:24:41Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2179.codfw.wmnet with reason: host reimage 2430029 wikitext text/x-wiki a0liigfyo4hnuobo99lhd6wyhg8smow 2430030 2430029 2026-06-24T08:27:41Z Stashbot 7414 fabfur@cumin1003: START - Cookbook sre.hosts.reimage for host cp7009.magru.wmnet with OS trixie 2430030 wikitext text/x-wiki mzo7y4gfe4ajqemytqi7tm80joe7gp4 2430031 2430030 2026-06-24T08:31:54Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1199.eqiad.wmnet with OS trixie 2430031 wikitext text/x-wiki au9cordytm0wqvm6lgwtlk1jwpvk3pt 2430032 2430031 2026-06-24T08:32:15Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.provision for host kafka-logging2007.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART 2430032 wikitext text/x-wiki g39a3merqbcc1eivikapu5ekj4fr77b 2430033 2430032 2026-06-24T08:33:08Z Stashbot 7414 elukey@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host kafka-logging2007.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART 2430033 wikitext text/x-wiki 3q3h2ct2lcz1ig3l0v6l1p4dtm561vo 2430034 2430033 2026-06-24T08:38:38Z Stashbot 7414 fabfur@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on cp7001.magru.wmnet with reason: host reimage 2430034 wikitext text/x-wiki 88cfd8f246h6f0o9smihzofltwwa69k 2430036 2430034 2026-06-24T08:43:25Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2179.codfw.wmnet with OS trixie 2430036 wikitext text/x-wiki n1y3sio7q9l1rvbn3diu18is4a0jlak 2430037 2430036 2026-06-24T08:43:46Z Stashbot 7414 fabfur@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp7001.magru.wmnet with reason: host reimage 2430037 wikitext text/x-wiki n8jwcww06ix1o84uujg7xcrqtzw9k03 2430038 2430037 2026-06-24T08:46:42Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.pool pool db1199: Migration of db1199.eqiad.wmnet completed 2430038 wikitext text/x-wiki mts802y0v6sr9v3ys9n719058vc3xqb 2430039 2430038 2026-06-24T08:50:03Z Stashbot 7414 fabfur@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on cp7009.magru.wmnet with reason: host reimage 2430039 wikitext text/x-wiki 8wdf31ix1fkun2pi0ei4wizn633me7h 2430040 2430039 2026-06-24T08:50:07Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2028.codfw.wmnet 2430040 wikitext text/x-wiki r98oob3a0y183rzc7mgfkwrb2doa596 2430041 2430040 2026-06-24T08:53:57Z Stashbot 7414 fabfur@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp7009.magru.wmnet with reason: host reimage 2430041 wikitext text/x-wiki 8ego8sowysvmagbtwcks1bxbxhpz8q4 2430042 2430041 2026-06-24T09:00:00Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.pool pool db2179: Migration of db2179.codfw.wmnet completed 2430042 wikitext text/x-wiki s5yowjg5jx70k2ivudj00xvuxc8rveh 2430043 2430042 2026-06-24T09:03:15Z Stashbot 7414 moritzm: temporarily remove ganeti2028 from the codfw cluster T429817 2430043 wikitext text/x-wiki jw18y60sednr335d39y6vb3sv26mtgm 2430044 2430043 2026-06-24T09:08:08Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.provision for host kafka-logging2007.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART 2430044 wikitext text/x-wiki js78hu777ehm7a6v6fr7pen5rs6tdg1 2430045 2430044 2026-06-24T09:08:35Z Stashbot 7414 fabfur@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp7001.magru.wmnet with OS trixie 2430045 wikitext text/x-wiki ibe36pukjaidgfolzcp6tsjbhpysbtc 2430047 2430045 2026-06-24T09:18:55Z Stashbot 7414 fabfur@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp7009.magru.wmnet with OS trixie 2430047 wikitext text/x-wiki hn3sqcgkivzoegrdl5u188t3euhtgaa 2430049 2430047 2026-06-24T09:22:07Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti2046.codfw.wmnet 2430049 wikitext text/x-wiki 7esl7fxqdjwkqf3njo64n2uhszl3s73 2430050 2430049 2026-06-24T09:22:58Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti2046.codfw.wmnet 2430050 wikitext text/x-wiki efbvecw4pf234o7mhot76qjlz9qfdus 2430051 2430050 2026-06-24T09:25:47Z Stashbot 7414 elukey@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host kafka-logging2007.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART 2430051 wikitext text/x-wiki 3vus6pbm1xcy04k29578j24abhlsfk0 2430052 2430051 2026-06-24T09:26:49Z Stashbot 7414 fabfur: repooling cp7001 and cp7009 after reimage (T419825) 2430052 wikitext text/x-wiki hxbozwdpm4q91trvdsi1u8ftfgfcy2n 2430053 2430052 2026-06-24T09:27:10Z Stashbot 7414 fabfur@cumin1003: conftool action : set/pooled=yes; selector: name=cp7009.* 2430053 wikitext text/x-wiki ok38su2slv22pcy127ssrs4z2d6lkd4 2430054 2430053 2026-06-24T09:27:14Z Stashbot 7414 fabfur@cumin1003: conftool action : set/pooled=yes; selector: name=cp7001.* 2430054 wikitext text/x-wiki 70smv89goiva0k6kz4p5ingay7r0ytw 2430055 2430054 2026-06-24T09:27:24Z Stashbot 7414 fabfur@cumin1003: START - Cookbook sre.hosts.remove-downtime for cp7001.magru.wmnet 2430055 wikitext text/x-wiki lkiv23hccmv24prv2phm0drpzi14lwo 2430056 2430055 2026-06-24T09:27:26Z Stashbot 7414 fabfur@cumin1003: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp7001.magru.wmnet 2430056 wikitext text/x-wiki ga4fgki3u7lbn837nkcb6yttbdr5dcv 2430057 2430056 2026-06-24T09:27:31Z Stashbot 7414 fabfur@cumin1003: START - Cookbook sre.hosts.remove-downtime for cp7009.magru.wmnet 2430057 wikitext text/x-wiki gd98ztwqlbk3qb9j46xwylheanp80ps 2430058 2430057 2026-06-24T09:27:33Z Stashbot 7414 fabfur@cumin1003: END (PASS) - Cookbook sre.hosts.remove-downtime (exit_code=0) for cp7009.magru.wmnet 2430058 wikitext text/x-wiki anqrl132gdclc199g3a8n42fumyob8f 2430059 2430058 2026-06-24T09:32:14Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1199: Migration of db1199.eqiad.wmnet completed 2430059 wikitext text/x-wiki r74yp1x5p2n7b7f0r41a1hb7afk4lyu 2430060 2430059 2026-06-24T09:32:17Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2430060 wikitext text/x-wiki qzp33i1gjl6uy5lb9jgn5laer9gmub8 2430061 2430060 2026-06-24T09:34:46Z Stashbot 7414 jforrester@deploy1003: Started scap sync-world: Backport for [[gerrit:1304800|[testwiki] Enable Abstract Client integration mode, not just previews (T422657)]], [[gerrit:1304770|[abstractwiki] Add the 'allowed' temporary vars for cross-wiki content (T422657)]], [[gerrit:1305182|WikiLambda: Expose wikilambda-abstract-optin for global group assignment (T422698)]], [[gerrit:1304110|[abstractwiki] Update favicon with new 2430061 wikitext text/x-wiki 62qgyf0lchuo4vfr1rkwk169rp2xu9s 2430062 2430061 2026-06-24T09:36:53Z Stashbot 7414 jforrester@deploy1003: jforrester: Backport for [[gerrit:1304800|[testwiki] Enable Abstract Client integration mode, not just previews (T422657)]], [[gerrit:1304770|[abstractwiki] Add the 'allowed' temporary vars for cross-wiki content (T422657)]], [[gerrit:1305182|WikiLambda: Expose wikilambda-abstract-optin for global group assignment (T422698)]], [[gerrit:1304110|[abstractwiki] Update favicon with new version (T429 2430062 wikitext text/x-wiki pq4dkegljky8mlpbssweud65fjdkng2 2430063 2430062 2026-06-24T09:37:47Z Stashbot 7414 jforrester@deploy1003: jforrester: Continuing with deployment 2430063 wikitext text/x-wiki 7l9rvsn4ls0fc4tklmfvsh50hml23by 2430066 2430063 2026-06-24T09:42:10Z Stashbot 7414 jforrester@deploy1003: Finished scap sync-world: Backport for [[gerrit:1304800|[testwiki] Enable Abstract Client integration mode, not just previews (T422657)]], [[gerrit:1304770|[abstractwiki] Add the 'allowed' temporary vars for cross-wiki content (T422657)]], [[gerrit:1305182|WikiLambda: Expose wikilambda-abstract-optin for global group assignment (T422698)]], [[gerrit:1304110|[abstractwiki] Update favicon with new 2430066 wikitext text/x-wiki 9ezna5dauitkzagk9gbrg8ogn6lkjve 2430068 2430066 2026-06-24T09:45:31Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2179: Migration of db2179.codfw.wmnet completed 2430068 wikitext text/x-wiki 8w7lxrj05prarcw2pbwd43595wpbud3 2430069 2430068 2026-06-24T09:45:33Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2430069 wikitext text/x-wiki l0vfs43mvtooyrnov0m7lefcy8id6p6 2430071 2430069 2026-06-24T09:54:18Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . 2430071 wikitext text/x-wiki n89ros5p5arctoaca9ffkgda8yevkhj 2430072 2430071 2026-06-24T09:54:28Z Stashbot 7414 gkyziridis@deploy1003: helmfile [ml-serve-codfw] Ran 'sync' command on namespace 'articletopic-outlink' for release 'main' . 2430072 wikitext text/x-wiki bqbgb03eqxat6830e1m1dea1wj1z7df 2430073 2430072 2026-06-24T09:58:15Z Stashbot 7414 marostegui@cumin1003: conftool action : set/pooled=yes; selector: name=clouddb1013.eqiad.wmnet,service=s1 2430073 wikitext text/x-wiki czg5jumjalkpcg4n8tbvs5gmytswfxi 2430074 2430073 2026-06-24T10:05:05Z Stashbot 7414 fabfur@cumin1003: conftool action : set/pooled=no; selector: name=cp2043.* 2430074 wikitext text/x-wiki s33k6yasg11tog5mudyuyw8dt7g75dj 2430075 2430074 2026-06-24T10:05:09Z Stashbot 7414 fabfur@cumin1003: conftool action : set/pooled=no; selector: name=cp2044.* 2430075 wikitext text/x-wiki oudytahx8o59hw8qhgekwnmtwc5ztgq 2430076 2430075 2026-06-24T10:05:26Z Stashbot 7414 fabfur: depooling cp2043 and cp2044 to reimage (T419825) 2430076 wikitext text/x-wiki 5oasmcw18bxf3nttd113itlu2suzv9t 2430078 2430076 2026-06-24T10:10:34Z Stashbot 7414 fabfur@cumin1003: START - Cookbook sre.hosts.reimage for host cp2044.codfw.wmnet with OS trixie 2430078 wikitext text/x-wiki i1g2dazowu1ylr61i7rss06rjzx35zn 2430079 2430078 2026-06-24T10:10:37Z Stashbot 7414 fabfur@cumin1003: START - Cookbook sre.hosts.reimage for host cp2043.codfw.wmnet with OS trixie 2430079 wikitext text/x-wiki mez4ej4ao0e6laes2tbnuc849esamjq 2430080 2430079 2026-06-24T10:26:17Z Stashbot 7414 fabfur@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on cp2044.codfw.wmnet with reason: host reimage 2430080 wikitext text/x-wiki 4wwopwyn2c4nq8p9muvcppp9ijrjhue 2430081 2430080 2026-06-24T10:26:19Z Stashbot 7414 fabfur@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on cp2043.codfw.wmnet with reason: host reimage 2430081 wikitext text/x-wiki i57dxpnyud06xepo5jxy2bejvubbidv 2430082 2430081 2026-06-24T10:30:18Z Stashbot 7414 fabfur@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp2044.codfw.wmnet with reason: host reimage 2430082 wikitext text/x-wiki l0vluqbpep70wu1psd2zivl92mzj4kz 2430083 2430082 2026-06-24T10:34:13Z Stashbot 7414 fabfur@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp2043.codfw.wmnet with reason: host reimage 2430083 wikitext text/x-wiki 3ownuo4hyd94glnzla8lgjrzzix0qfx 2430085 2430083 2026-06-24T10:45:06Z Stashbot 7414 cgoubert@deploy1003: Locking from deployment [ALL REPOSITORIES]: Testing apiportalwiki deletion in beta - T418494 2430085 wikitext text/x-wiki qr235uakelk6hf5rden9qvvxdqmgf0o 2430087 2430085 2026-06-24T10:51:23Z Stashbot 7414 fabfur@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp2044.codfw.wmnet with OS trixie 2430087 wikitext text/x-wiki d977rpqhhh66j6l3ekw9shwe81567sh 2430089 2430087 2026-06-24T10:57:02Z Stashbot 7414 fabfur@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp2043.codfw.wmnet with OS trixie 2430089 wikitext text/x-wiki j1g2kuuepev2ewpgk9gk5wztkm7plm5 2430091 2430089 2026-06-24T11:11:20Z Stashbot 7414 jmm@deploy1003: helmfile [staging] START helmfile.d/services/thumbor: apply 2430091 wikitext text/x-wiki rlpu36onm85ej5f327ebo4y1y9grf2x 2430092 2430091 2026-06-24T11:11:27Z Stashbot 7414 jmm@deploy1003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2430092 wikitext text/x-wiki carjnli6fql6f52bj1ngzii0dg45s25 2430094 2430092 2026-06-24T11:27:36Z Stashbot 7414 jmm@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2430094 wikitext text/x-wiki rdjjtppleemgpuqq99x8lxn3hr6jklq 2430096 2430094 2026-06-24T11:33:40Z Stashbot 7414 jmm@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2430096 wikitext text/x-wiki r1pdnk9jf4wfnaqv4oibh0uhqorrsic 2430097 2430096 2026-06-24T11:34:09Z Stashbot 7414 jmm@deploy1003: helmfile [eqiad] START helmfile.d/services/thumbor: apply 2430097 wikitext text/x-wiki cxgthnawmsywf3mezi9xba2mvai6h6k 2430100 2430097 2026-06-24T11:36:39Z Stashbot 7414 jmm@deploy1003: helmfile [eqiad] DONE helmfile.d/services/thumbor: apply 2430100 wikitext text/x-wiki 874fp6z6f7wkalolu1ufygmcj0oh9ze 2430101 2430100 2026-06-24T11:42:42Z Stashbot 7414 jmm@dns1004: START - running authdns-update 2430101 wikitext text/x-wiki k4k0co6m8pjj0bhc9bop8vxc3rxdmsx 2430104 2430101 2026-06-24T11:44:47Z Stashbot 7414 jmm@dns1004: END - running authdns-update 2430104 wikitext text/x-wiki dag4p9adi45nor37ln0dufkgk9xaidc 2430105 2430104 2026-06-24T11:46:39Z Stashbot 7414 jmm@dns1004: START - running authdns-update 2430105 wikitext text/x-wiki 31s9a9p27j2em512wjnvuvje20tljni 2430106 2430105 2026-06-24T11:47:22Z Stashbot 7414 mvolz@deploy1003: helmfile [staging] START helmfile.d/services/citoid: apply 2430106 wikitext text/x-wiki bl4ax7eg9u0qa1rwn9hm0oorn171lkz 2430107 2430106 2026-06-24T11:47:39Z Stashbot 7414 mvolz@deploy1003: helmfile [staging] DONE helmfile.d/services/citoid: apply 2430107 wikitext text/x-wiki sk48n79gya83h11y5st1xjuyname0hl 2430108 2430107 2026-06-24T11:48:12Z Stashbot 7414 btullis@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1208.eqiad.wmnet 2430108 wikitext text/x-wiki 5mr0z5l5hyxpc5t6de7t0qlkj5l49y3 2430109 2430108 2026-06-24T11:48:28Z Stashbot 7414 jmm@dns1004: END - running authdns-update 2430109 wikitext text/x-wiki qtqsprwwaschu6knr2qyhf84jn49ldh 2430110 2430109 2026-06-24T11:49:29Z Stashbot 7414 marostegui@cumin1003: conftool action : set/pooled=no; selector: name=clouddb1026.eqiad.wmnet,service=s1 2430110 wikitext text/x-wiki 5c5nc4dzc56umcbuni769gm43xcmazw 2430111 2430110 2026-06-24T11:50:22Z Stashbot 7414 marostegui@cumin1003: conftool action : set/weight=100; selector: name=clouddb1026.eqiad.wmnet 2430111 wikitext text/x-wiki luq2xazufqb68qb55jo1aro6s1oun6q 2430112 2430111 2026-06-24T11:53:44Z Stashbot 7414 moritzm: installing postgresql security updates 2430112 wikitext text/x-wiki ng346sy3s346zzap8070i85dvic9s6p 2430113 2430112 2026-06-24T11:53:47Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.network.depool-rack with action 'depool' for codfw rack A6 2430113 wikitext text/x-wiki cgx9wqrvcx6g2aecfxvcphnietvqubu Release Engineering/SAL 0 17290 2429692 2429355 2026-06-23T14:31:58Z Stashbot 7414 brennen: deploying patchdemo for https://gitlab.wikimedia.org/repos/test-platform/catalyst/patchdemo/-/merge_requests/361 2429692 wikitext text/x-wiki mzgp6wr92471niq0rchjkjt5gfba75b Template:Navigation Wikimedia infrastructure 10 37907 2429932 2422601 2026-06-23T22:38:50Z BCornwall-WMF 31521 Replace Katran with Liberica 2429932 wikitext text/x-wiki s4hqmkos5qi54ms6frg09whhjmjbt1x Nova Resource:Paws/SAL 498 55577 2429887 2429191 2026-06-23T19:08:44Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.add_server 2429887 wikitext text/x-wiki 2ear666xykj5j6j11snan7ixflxj7u1 2429888 2429887 2026-06-23T19:20:03Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.nfs.add_server (exit_code=0) 2429888 wikitext text/x-wiki fdzocjy62pd6mx83ykau80n3v24cfzu 2429889 2429888 2026-06-23T19:30:44Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.migrate_service 2429889 wikitext text/x-wiki 4hjvmvilrj9qt6pt7boe1pqhcmavy1l 2429890 2429889 2026-06-23T19:30:53Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.nfs.migrate_service (exit_code=99) 2429890 wikitext text/x-wiki hp6z98mhf0f0wejri6rt0sqmxahphm8 Global traffic routing 0 76447 2429931 2426595 2026-06-23T22:37:52Z BCornwall-WMF 31521 /* Edge routing */ Mention the load balancer rather than LVS, point to liberica 2429931 wikitext text/x-wiki fn88ixjw9r0hlzr0bkl0ryrxklyxo4i MariaDB/misc 0 199474 2429724 2423657 2026-06-23T14:59:36Z MArostegui (WMF) 8620 /* Current schemas */ Fix link 2429724 wikitext text/x-wiki 38ngywoxzcck4jcjxs9bj84g3mriw1e 2429725 2429724 2026-06-23T15:00:48Z MArostegui (WMF) 8620 /* db_inventory */ Add a new section, to make it clearer 2429725 wikitext text/x-wiki mb0zg6g47qa6d3dn8k4fjq08e61d31x HTTPS 0 441183 2429934 2265615 2026-06-23T22:48:06Z BCornwall-WMF 31521 /* Related information */ Remove ex-employee user page 2429934 wikitext text/x-wiki lm49bpn39w1ac9dolf3cjo48mirb7gx Event Platform/Producing events 0 446051 2429673 2426457 2026-06-23T14:20:12Z Ottomata 88 /* Decommissioning */ 2429673 wikitext text/x-wiki 0fwnfbsqyej4b8olf3uc9xymq2fp715 2429686 2429673 2026-06-23T14:24:49Z Ottomata 88 2429686 wikitext text/x-wiki e91xodpp5dg9cek4v5cbn1an0zmqcjc Purged 0 446187 2429933 2421042 2026-06-23T22:40:16Z BCornwall-WMF 31521 Add caching cat 2429933 wikitext text/x-wiki eur4oy857b8e0sqd6pkpmgsubbe81nq API Portal 0 446977 2429864 2421913 2026-06-23T18:02:08Z APaskulin (WMF) 14880 Mark as historical 2429864 wikitext text/x-wiki gu2rwf0rf0weepaimxjjt8z05fw0y6z Test Kitchen 0 447310 2430095 2427002 2026-06-24T11:30:10Z Phuedx (WMF) 47850 /* Test Kitchen maintainer documentation */ 2430095 wikitext text/x-wiki q5247nn7u2cf9pp1ndbx4yl2ipldmwa GitLab/Upgrade 0 448411 2430035 2372492 2026-06-24T08:40:26Z ABran-WMF 37196 /* Prerequisites */ 2430035 wikitext text/x-wiki mrtmbdo1atp9yj1z4h1rrv3psv9xwsc Fundraising/Team processes/Onboarding 0 448996 2429916 2429267 2026-06-23T21:58:11Z DWisehaupt (WMF) 14911 /* Prep */ Update to make git reviewers and collab contact list correct instead of combined. 2429916 wikitext text/x-wiki 137ly7x29eoim05rdpfzgr9q3wxi18s 2429918 2429916 2026-06-23T21:58:49Z DWisehaupt (WMF) 14911 /* Prep */ capitalization fix 2429918 wikitext text/x-wiki al3wz7fedd2q8n9k757cskyc68vybz4 Map of database maintenance 0 449160 2429935 2429518 2026-06-24T00:01:16Z Dexbot 30554 Bot: Updating the report 2429935 wikitext text/x-wiki m506gpiesl9qutz93gjd67hurdyrl27 2429959 2429935 2026-06-24T05:44:05Z Dexbot 30554 Bot: Updating the report 2429959 wikitext text/x-wiki fk3ls1m94jty7vp2u1w8uw27d1tlb6f 2429970 2429959 2026-06-24T05:56:07Z Dexbot 30554 Bot: Updating the report 2429970 wikitext text/x-wiki c3ebz149oooebru4g4swdnkxmkotu8q Event Platform/Maintainers 0 451267 2429731 2282080 2026-06-23T15:08:26Z Ottomata 88 Updated some maintainers to reflect mid 2026 reality. More to come. 2429731 wikitext text/x-wiki k60rqgikpiks53sznnxhrm5fllpifh3 2429757 2429731 2026-06-23T15:51:24Z JMonton-WMF 47887 link to user 2429757 wikitext text/x-wiki 9marohhemk4hf1sfrf9hpv4ev88zssp Tool:Gitlab-account-approval/Log 116 453906 2430077 2429269 2026-06-24T10:09:15Z Gitlabaccountapprovalbot 37332 tanmay789q was rejected. 2430077 wikitext text/x-wiki i4tti1dnth5p69xkqkstwd433c50vbq 2430114 2430077 2026-06-24T11:54:25Z Gitlabaccountapprovalbot 37332 @sanskardubeydev was approved. 2430114 wikitext text/x-wiki pitn2lqe9saj9qd32jqqqghwucp1o1o Liberica 0 454364 2429780 2397689 2026-06-23T16:46:04Z BCornwall-WMF 31521 /* Operating Liberica */ ce: Remove "liberica" from title, we're in the context of a liberica article already 2429780 wikitext text/x-wiki a2o5zvpunlytd8w0xfilt0nm55idk0o 2429781 2429780 2026-06-23T16:49:39Z BCornwall-WMF 31521 /* Depooling a liberica instance */ ce: period 2429781 wikitext text/x-wiki 3wods0ap4sd1op01cs2fq6gtxnc2trw 2429787 2429781 2026-06-23T16:51:20Z BCornwall-WMF 31521 /* Operation */ ce: Remove extraneous use of "liberica" in headings 2429787 wikitext text/x-wiki qpso5we0bdvxl4cpk2cu07idk0afadd 2429807 2429787 2026-06-23T17:03:01Z BCornwall-WMF 31521 /* Depooling */ Condense the "alternative depool" article into the regular depool: It's educational, so let's inform the reader as to the inner workings while telling them how to use the convenient script 2429807 wikitext text/x-wiki j45velnrj8xu9m7goh4wiqlvsr093qd 2429811 2429807 2026-06-23T17:08:15Z BCornwall-WMF 31521 /* Depooling */ Rename full/temporary headings to explain method 2429811 wikitext text/x-wiki 7083rjsh8lu01ttl0v0h0w1l2cjfeoa 2429815 2429811 2026-06-23T17:12:10Z BCornwall-WMF 31521 /* Full depooling via BGP priority adjustment */ Remove revert heading as the steps are specific to that section anyway and can be confused as general repooling behavior 2429815 wikitext text/x-wiki 32kwv46n5rv50o68r9srmmcgirc7nx0 2429820 2429815 2026-06-23T17:21:30Z BCornwall-WMF 31521 /* Control Plane */ mention its role in pooling 2429820 wikitext text/x-wiki sb6rhr5m4eus6iclkgg2jrtz84yqdm3 2429825 2429820 2026-06-23T17:30:23Z BCornwall-WMF 31521 /* Daemons */ Note systemd daemon naming/availability; Add healthcheck identifier 2429825 wikitext text/x-wiki bygb61f6cqgftzfu8yfozyz15jahxww 2429826 2429825 2026-06-23T17:33:27Z BCornwall-WMF 31521 /* Forwarding Plane */ link ipvs/katran 2429826 wikitext text/x-wiki 9wt11clcws7z2awtx3iabiset5lumjd 2429917 2429826 2026-06-23T21:58:32Z BCornwall-WMF 31521 /* Operation */ clarify prod status 2429917 wikitext text/x-wiki j3zz3e9o77iqnblvbwyj0lgkdhfzqrn 2429924 2429917 2026-06-23T22:20:27Z BCornwall-WMF 31521 Move super-specific public IP address change header to general info about reloading 2429924 wikitext text/x-wiki a5xibm6b1o92pp64h22udnn82v2tlw6 2429926 2429924 2026-06-23T22:22:05Z BCornwall-WMF 31521 /* Reloading */ link to dns checklist 2429926 wikitext text/x-wiki gcvvghaeg4ez19hickyb8om8u118qpo 2429927 2429926 2026-06-23T22:28:56Z BCornwall-WMF 31521 /* Operation */ Merge in #Pooling section as that isn't relevant for both types of depooling and is more general info 2429927 wikitext text/x-wiki gjeqxzmy5lnnyep1a283qvtdw3xlxq2 2429928 2429927 2026-06-23T22:29:34Z BCornwall-WMF 31521 /* Operation */ Move grafana dash link to note 2429928 wikitext text/x-wiki k0kjt2jb96wzop6bkas7047ie9cheeu 2429929 2429928 2026-06-23T22:31:21Z BCornwall-WMF 31521 /* Depooling */ Add metion of how to re-pool temporary depool 2429929 wikitext text/x-wiki bc24l1s9vpbte602apw2cvbcid070he 2429930 2429929 2026-06-23T22:33:05Z BCornwall-WMF 31521 Add cats 2429930 wikitext text/x-wiki g51h7v9t9wcyrej41vinl1jaqzryl0b MariaDB/PII 0 455253 2429955 2355127 2026-06-24T05:25:15Z MArostegui (WMF) 8620 /* Notify Relevant Teams */ Changed the resolution text for the task. 2429955 wikitext text/x-wiki 9e36cg894fh89hsrogueuxd8d3sbuob Ircstream 0 455726 2430084 2309336 2026-06-24T10:36:18Z MMuhlenhoff (WMF) 5268 /* Bots still using the legacy setup */ Add link for cluebot 2430084 wikitext text/x-wiki snsmn1ugjff0ssnt57tao8xol7wxa8w 2430086 2430084 2026-06-24T10:50:20Z MMuhlenhoff (WMF) 5268 /* Bots still using the legacy setup */ Add link for Earwigbot 2430086 wikitext text/x-wiki 10gt7fx2zmlyohmrst0qqrd7m4ml5hb Test Kitchen/Conduct an experiment 0 455989 2429655 2429136 2026-06-23T13:52:03Z MPopov (WMF) 5891 Note about GrowthBook 2429655 wikitext text/x-wiki fq58brjvyzmfy5nxf1v2em1613sjcle 2429667 2429655 2026-06-23T14:04:23Z MPopov (WMF) 5891 /* Case study: account creation form improvements V1 A/B test */ Link to V2 2429667 wikitext text/x-wiki t9o8gyw5i89mnj1atm4nzxgdjig7gli Test Kitchen/Architecture 0 456356 2430065 2382014 2026-06-24T09:40:47Z Phuedx (WMF) 47850 Import from Phuedx_(WMF)/Test_Kitchen/Architecture 2430065 wikitext text/x-wiki jlpl2v43vz76m3m134xjw1on3b34ib1 2430067 2430065 2026-06-24T09:43:21Z Phuedx (WMF) 47850 Add GrowthBook description 2430067 wikitext text/x-wiki s38pljnvgy8hhn0offj4xx2y4cer5um 2430070 2430067 2026-06-24T09:53:15Z Phuedx (WMF) 47850 Add subheadings to lifecycle section 2430070 wikitext text/x-wiki 7j5wsalemi5dsin3xxy77ccsqi3i0t4 2430093 2430070 2026-06-24T11:23:34Z Phuedx (WMF) 47850 Add details of the DAGs that power experiment analysis in GrowthBook 2430093 wikitext text/x-wiki nmyq7wumbzr12kpbth74k86s7gvnb7w 2430098 2430093 2026-06-24T11:34:28Z Phuedx (WMF) 47850 Link to Test_Kitchen/Troubleshooting 2430098 wikitext text/x-wiki ohv9p5ztfwp0phqkwxvwz7po4kgte3z 2430099 2430098 2026-06-24T11:35:16Z Phuedx (WMF) 47850 Adjust title casing style 2430099 wikitext text/x-wiki d7vku081jhxls7hzmiuvc6q6a2yank7 Test Kitchen/Automated analysis of experiments 0 458775 2429652 2420704 2026-06-23T13:47:19Z MPopov (WMF) 5891 2429652 wikitext text/x-wiki 3v9glcn1b6tfd1rano0x61hp3n9w0g1 2429687 2429652 2026-06-23T14:26:12Z MPopov (WMF) 5891 2429687 wikitext text/x-wiki mrdmhcbhgj3yvct0edtp6x4l4iz3uc6 Data Platform Engineering/Ops week/Analytics weekly train 0 459290 2429717 2428236 2026-06-23T14:55:07Z SNwachukwu (WMF) 39521 2429717 wikitext text/x-wiki 8osswd4xpvrdhalam4r7520dhtpdyrp 2429720 2429717 2026-06-23T14:55:29Z SNwachukwu (WMF) 39521 2429720 wikitext text/x-wiki psvtofptr8qsia1br16e7du8s0kgbm7 2429722 2429720 2026-06-23T14:55:45Z SNwachukwu (WMF) 39521 2429722 wikitext text/x-wiki nqkuhelay5g83pc2qb5j6xbvya7pgf8 2429803 2429722 2026-06-23T17:00:59Z JAllemandou (WMF) 37709 /* YYYY-MM-DD NEXT TUESDAY TRAIN (REPLACE THIS AFTER DEPLOY) */ Add pageview allowlist changes 2429803 wikitext text/x-wiki 3welp20rxtrdqv3tyy7tr8sk22pfks2 Data Platform/Systems/OpenSearch-on-K8s 0 459342 2430115 2407624 2026-06-24T11:57:02Z Atsuko-WMF 54082 /* Platform Info */ namespaces 2430115 wikitext text/x-wiki ptqxz6xlv8ulutcg20evl3ro771aena API Portal/Deprecation 0 459695 2429855 2427116 2026-06-23T17:59:14Z APaskulin (WMF) 14880 Update status 2429855 wikitext text/x-wiki rulj8ksohglik59y3bfdu682cgcdvvr Kubernetes/Clusters/IPIP 0 459948 2429598 2420127 2026-06-23T12:39:57Z TKlausmann (WMF) 18780 /* Kubernetes API (control plane) */ 2429598 wikitext text/x-wiki mphvrn7ueklt73kip0c0pfwio6jdo7j SCROLL/Docs/Guide 0 460194 2429975 2428990 2026-06-24T06:23:35Z JJMC89 7474 no h1s; 2429975 wikitext text/x-wiki 9qrwqj677qt3dumc7390g8yuk46aexl Test Kitchen/GrowthBook user guide 0 460232 2429913 2429152 2026-06-23T21:34:40Z MPopov (WMF) 5891 2429913 wikitext text/x-wiki 43u7j0lfeclkq998r9ikhpfmqzkts2l Test Kitchen/GrowthBook user guide/Metrics 0 460233 2429634 2428698 2026-06-23T13:39:57Z MPopov (WMF) 5891 Example of a metric 2429634 wikitext text/x-wiki 0w80jj5ykbafd18thym4sda4w0agxle 2429635 2429634 2026-06-23T13:40:40Z MPopov (WMF) 5891 Remove draft notice 2429635 wikitext text/x-wiki 9y7u4zl3s577d3adhvasvga0je415qg 2429636 2429635 2026-06-23T13:41:03Z MPopov (WMF) 5891 2429636 wikitext text/x-wiki ekqbd17c812vwoellubgp6y7qa4he5j Test Kitchen/GrowthBook user guide/Configuring experiments 0 460234 2429914 2429247 2026-06-23T21:37:50Z MPopov (WMF) 5891 Clarify tags 2429914 wikitext text/x-wiki m4fs2g1achjdzf1o1c1q3130ikox6sp 2429915 2429914 2026-06-23T21:38:23Z MPopov (WMF) 5891 /* Complete the Pre-Launch Checklist */ 2429915 wikitext text/x-wiki h6wcmxmtg9d4xisnqf1c18lreyxig4s Data Platform/Systems/OpenSearch-on-K8s/TTMServer 0 460318 2430103 2428979 2026-06-24T11:44:11Z Atsuko-WMF 54082 monitorings links update 2430103 wikitext text/x-wiki ixk4emcfa8ueofsgeq87eorq5ffa5lj SCROLL/Docs/FAQ 0 460344 2429974 2427794 2026-06-24T06:18:43Z JJMC89 7474 no H1 2429974 wikitext text/x-wiki pgpa6wtpb5mvnvbl43b6z2yh04zi0ln Help:Cloud VPS instance operating system migration 12 460354 2429972 2428634 2026-06-24T06:15:39Z SSapaty (WMF) 28955 Mention puppet setup for VM rebuild for users who might want to have this in place 2429972 wikitext text/x-wiki 4xfagse9q927qorvhhfv0iy6oob3kp0 2429973 2429972 2026-06-24T06:16:47Z SSapaty (WMF) 28955 /* Futureproofing Using Puppet */ 2429973 wikitext text/x-wiki p9fmyfsekhkj405uj6vu8dvt0f8rmfa 2429977 2429973 2026-06-24T06:25:19Z JJMC89 7474 ce 2429977 wikitext text/x-wiki e3z5ul9nv7xbwutr8r7oy02xq3ng8ta 2429979 2429977 2026-06-24T06:30:07Z JJMC89 7474 JJMC89 moved page [[Help:Cloud VPS VM Migration Guide]] to [[Help:Cloud VPS instance operating system migration]]: sentence case and more precise 2429977 wikitext text/x-wiki e3z5ul9nv7xbwutr8r7oy02xq3ng8ta 2429981 2429979 2026-06-24T06:31:50Z JJMC89 7474 /* Futureproofing using puppet */ link 2429981 wikitext text/x-wiki acs5324vbpb3tko6u7azhgpdnsvenxr 2429982 2429981 2026-06-24T06:32:49Z JJMC89 7474 instance 2429982 wikitext text/x-wiki 8p85suaozjagc96a1ou9jr2hyjigsnu Blazegraph Migration: Rewrite of GAS 0 460366 2429808 2429259 2026-06-23T17:04:13Z AWesterinen-WMF 54189 2429808 wikitext text/x-wiki 97wg2h9fpklghvljtj0w962nz0cj79d 2429809 2429808 2026-06-23T17:05:12Z AWesterinen-WMF 54189 2429809 wikitext text/x-wiki 01r8w9u24vjcnk4mtwl6915uoug3qh5 2429810 2429809 2026-06-23T17:07:08Z AWesterinen-WMF 54189 2429810 wikitext text/x-wiki sti3dazmemj65p09zdjjdy9b6g4dti8 2429816 2429810 2026-06-23T17:12:25Z AWesterinen-WMF 54189 2429816 wikitext text/x-wiki qmhb8r9voo1t13iosakw075kdjtqsp1 2429939 2429816 2026-06-24T00:40:44Z AWesterinen-WMF 54189 2429939 wikitext text/x-wiki ovafohow1awro26673b5j4x66ra06jg 2429940 2429939 2026-06-24T00:42:00Z AWesterinen-WMF 54189 2429940 wikitext text/x-wiki 9sw4oixasticny7yo1f16ia0o9acf74 2429941 2429940 2026-06-24T00:43:36Z AWesterinen-WMF 54189 2429941 wikitext text/x-wiki agk3efpnr17vokl78xok0glhfwzijlo Test Kitchen/Experimenting with Special:CreateAccount 0 460372 2430102 2429312 2026-06-24T11:43:48Z Tgr (WMF) 39134 /* Experiment exposure */ small clarification about the content type - we could still send cookies with JSON, but then CORS rules would apply and the events endpoint would have to support CORS headers / preflight responses 2430102 wikitext text/x-wiki 74qmo0bfw0qpyh39c2n4vg5df89oi54 User:SNwachukwu (WMF) 2 460373 2429713 2026-06-23T14:54:12Z SNwachukwu (WMF) 39521 Created page with "{{User info | full name = Sandra Ebele Nwoko | job title = Software Engineer | organization = Wikimedia Foundation | short quote = Knowledge is power | contact me = snwoko@wikimedia.org | about me = I love nature. I'm not sporty but love doing sports. | about my work = I am a contributor to the Data engineering team in WMF. I'm working with Data everyday, babysitting it and just doing anything to make sure it's available for it's users. }}" 2429713 wikitext text/x-wiki r26ioyy2l4tihynnoz8d08zmqoyfp5l User talk:ASanford-WMF 3 460374 2429721 2026-06-23T14:55:30Z StrikerBot 8475 Welcome to Toolforge! 2429721 wikitext text/x-wiki ogs4cs12el0yzg5xt1zolcbu96rd1ps Blazegraph Migration: Rewrite of Geospatial Services and Functions 0 460375 2429790 2026-06-23T16:51:41Z AWesterinen-WMF 54189 Created page with "Geospatial queries are currently addressed in WDQS using Blazegraph-specific SPARQL extensions. There are two SERVICE extensions - wikibase:around (proximity search) and wikibase:box (bounding-box search) - and a small set of helper functions (geof:globe, geof:latitude, geof:longitude). These have no equivalent in SPARQL but can be rewritten using GeoSPARQL. Describing each of the concepts in more detail: * wikibase:box finds entities whose coordinate lies within an..." 2429790 wikitext text/x-wiki rtmdlnk6feiuh1z6ajixxms8w5n8zyy 2429819 2429790 2026-06-23T17:21:12Z AWesterinen-WMF 54189 2429819 wikitext text/x-wiki kubqd2dgmhjrbqlf3dzknwbf9aa8y6l 2429831 2429819 2026-06-23T17:39:44Z AWesterinen-WMF 54189 2429831 wikitext text/x-wiki oji583jc5lu664lauqh406xtj2v7kc1 2429835 2429831 2026-06-23T17:43:15Z AWesterinen-WMF 54189 2429835 wikitext text/x-wiki k4corko1i59iwxby0c47qwkqzixljte 2429846 2429835 2026-06-23T17:51:19Z AWesterinen-WMF 54189 2429846 wikitext text/x-wiki l73i7mtqzwl0tfndcxgp1cgq4avw37o 2429847 2429846 2026-06-23T17:53:35Z AWesterinen-WMF 54189 2429847 wikitext text/x-wiki 925kpycylg0q394ogavq9p86mx4f35u 2429848 2429847 2026-06-23T17:55:05Z AWesterinen-WMF 54189 2429848 wikitext text/x-wiki qv7v0vmlusu0mpetb6u4gam9fdbbzwy 2429850 2429848 2026-06-23T17:57:07Z AWesterinen-WMF 54189 2429850 wikitext text/x-wiki gz6v5g5sf2fwdgv6lcpoenmzqeyasfl 2429852 2429850 2026-06-23T17:58:13Z AWesterinen-WMF 54189 2429852 wikitext text/x-wiki s0cukvna5hagjouws6bvapnisfrg5of 2429856 2429852 2026-06-23T17:59:24Z AWesterinen-WMF 54189 /* Example 2 */ 2429856 wikitext text/x-wiki aqfxba7eacwnodgjvuu2hnqk78oqt6u 2429869 2429856 2026-06-23T18:13:05Z AWesterinen-WMF 54189 2429869 wikitext text/x-wiki 4lzrtvomrrm71lumecyzcfce9qejb8q 2429870 2429869 2026-06-23T18:16:34Z AWesterinen-WMF 54189 /* Example 1 */ 2429870 wikitext text/x-wiki cvg9u6wsnarmsqy4khst7kgkqwvvwsv 2429876 2429870 2026-06-23T18:17:57Z AWesterinen-WMF 54189 /* Example 2 */ 2429876 wikitext text/x-wiki qlsz5vz656zauo71kp9oubgp4iuwzsd 2429877 2429876 2026-06-23T18:18:29Z AWesterinen-WMF 54189 /* Example 2 */ 2429877 wikitext text/x-wiki tjp6pjpy456mnledlfl4m1br4r8rx9t 2429878 2429877 2026-06-23T18:19:01Z AWesterinen-WMF 54189 2429878 wikitext text/x-wiki 8j8i7desrgiuv5jixtazdmopxcv1hob 2429942 2429878 2026-06-24T00:44:46Z AWesterinen-WMF 54189 2429942 wikitext text/x-wiki bqqs34t6vd0gac7uii7pz10pif3yfuk Blazegraph Migration: Rewrite of Label and Utility Services and Functions 0 460376 2429797 2026-06-23T16:54:24Z AWesterinen-WMF 54189 Created page with "This Wikitech page catalogs the rewrites needed to translate several utility query services provided by Blazegraph into portable, standards-conformant SPARQL 1.1. To port these queries, each Blazegraph-specific construct must be substituted with an equivalent SPARQL 1.1 pattern, restructured into a portable form, or (where no equivalent exists) removed with an explanatory note. The rewrites described in this document cover six such constructs: * bd:sample and bd:slice..." 2429797 wikitext text/x-wiki 4vn2orhb5lgq1s8i6woxwvketw8kms9 Blazegraph Migration: Rewrite of MWAPI 0 460377 2429800 2026-06-23T16:56:15Z AWesterinen-WMF 54189 Created page with "[https://www.mediawiki.org/wiki/Wikidata_Query_Service/User_Manual/MWAPI SERVICE wikibase:mwapi { ... }] is a Blazegraph-specific extension to WDQS that calls the MediaWiki Action API and binds its results to SPARQL variables. The service is not part of the SPARQL 1.1 standard since it is not possible to call a REST API within a query. MWAPI’s bridges the MediaWiki Action API into SPARQL - adding full-text search via CirrusSearch (backed by an Elasticsearch/OpenSearc..." 2429800 wikitext text/x-wiki c9oie9otes6m9w5qipovlrl9kryvc52 2429891 2429800 2026-06-23T19:51:04Z AWesterinen-WMF 54189 2429891 wikitext text/x-wiki k190ocyx58ws5f6eaxjim34ap80korp 2429896 2429891 2026-06-23T20:02:27Z AWesterinen-WMF 54189 2429896 wikitext text/x-wiki rak3jululs5baydgxf51dl2ear2f63r 2429899 2429896 2026-06-23T20:07:53Z AWesterinen-WMF 54189 2429899 wikitext text/x-wiki 8ktrwwn03l8gldtuxw80j71ejgttkh6 2429936 2429899 2026-06-24T00:16:27Z AWesterinen-WMF 54189 2429936 wikitext text/x-wiki h6mkuj5oz6qdw89fbmsaq1qxy4l5zh8 2429937 2429936 2026-06-24T00:39:24Z AWesterinen-WMF 54189 2429937 wikitext text/x-wiki osfa3e831hu8wv718yqo9yvzbualtof 2429938 2429937 2026-06-24T00:39:39Z AWesterinen-WMF 54189 2429938 wikitext text/x-wiki 14z1jis0c846vxvfhh51bnf6aadz67x 2429943 2429938 2026-06-24T00:45:40Z AWesterinen-WMF 54189 2429943 wikitext text/x-wiki nvevsbi542g1u5u0kl56drqjlw5m3vp 2429944 2429943 2026-06-24T00:47:51Z AWesterinen-WMF 54189 2429944 wikitext text/x-wiki s18pu0udsqwo835h6ybix6ko04g327o 2429945 2429944 2026-06-24T00:48:31Z AWesterinen-WMF 54189 2429945 wikitext text/x-wiki 2m3iprflgcwadjhy3w8npzodkzyqs07 2429946 2429945 2026-06-24T00:49:40Z AWesterinen-WMF 54189 2429946 wikitext text/x-wiki k3vhrqpgckts9crjagl57rhyovy8msl 2429947 2429946 2026-06-24T00:50:41Z AWesterinen-WMF 54189 2429947 wikitext text/x-wiki 0mh3tjsnvhgwghr0izoklf0rae2nprd 2429948 2429947 2026-06-24T00:51:30Z AWesterinen-WMF 54189 2429948 wikitext text/x-wiki shfo6x30ju6p5zjrkeex1u30gehlp7r 2429949 2429948 2026-06-24T00:52:08Z AWesterinen-WMF 54189 2429949 wikitext text/x-wiki cvi1dq751lekkzs211ybjlan2e332wv Help:Cloud VPS VM Migration Guide 12 460378 2429980 2026-06-24T06:30:07Z JJMC89 7474 JJMC89 moved page [[Help:Cloud VPS VM Migration Guide]] to [[Help:Cloud VPS instance operating system migration]]: sentence case and more precise 2429980 wikitext text/x-wiki pg87znmmusglqkcoqamqw3goiwre8wi User talk:Vitaly Zdanevich 3 460379 2430046 2026-06-24T09:18:18Z StrikerBot 8475 Welcome to Toolforge! 2430046 wikitext text/x-wiki 4qfcxpvt6a1wogkwsun1btq5z2r9zte User talk:Sanskardubeydev 3 460380 2430048 2026-06-24T09:19:25Z StrikerBot 8475 Welcome to Toolforge! 2430048 wikitext text/x-wiki nly7cn7qs3452p5x6ffogz6t68qplix 2430064 2430048 2026-06-24T09:38:53Z Sanskardubeydev 44795 /* Welcome to Toolforge! */ Reply 2430064 wikitext text/x-wiki 1zxco5dk3023tyhatgq27ltfez678p0