Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.5 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 0 4108 2423129 2422891 2026-06-03T12:36:07Z ScheduleDeploymentBot 37566 Add [[gerrit:1295910]] to Wednesday, June 03 UTC afternoon backport window 2423129 wikitext text/x-wiki 8u67gjnmymgqa6mi40y7v4hf9ho18ot 2423158 2423129 2026-06-03T13:19:45Z ScheduleDeploymentBot 37566 Add [[gerrit:1297129]] to Wednesday, June 03 UTC afternoon backport window 2423158 wikitext text/x-wiki gy4cxy3d7dy39xs5hyamkxf3rorbllh 2423159 2423158 2026-06-03T13:20:02Z ScheduleDeploymentBot 37566 Add [[gerrit:1297130]] to Wednesday, June 03 UTC afternoon backport window 2423159 wikitext text/x-wiki 62sqjxmzmjvetzb4hmyj7xq348om8w5 2423170 2423159 2026-06-03T13:32:11Z SGimeno (WMF) 27243 /* {{Deployment_day|date=2026-06-03}} */ 2423170 wikitext text/x-wiki tmt3kb5t3c66ijezhsi1dq2fbcp0r8v 2423174 2423170 2026-06-03T13:53:48Z ScheduleDeploymentBot 37566 Add [[gerrit:1297137]] to Wednesday, June 03 UTC late backport window 2423174 wikitext text/x-wiki ltzpl007jfg8ukqlgupvfiesh186j2c 2423184 2423174 2026-06-03T14:04:32Z SFrench-WMF 37362 /* {{Deployment_day|date=2026-06-03}} */ UTC-late infra window 2423184 wikitext text/x-wiki erejca3xbch3p37zrl92t2iadx1th0c 2423236 2423184 2026-06-03T14:41:31Z Mmullie (WMF) 291 /* {{Deployment_day|date=2026-06-03}} */ 2423236 wikitext text/x-wiki dicrv6wr7hs2xyjt6b7flz204u5pbiv 2423297 2423236 2026-06-03T15:53:09Z Martin Urbanec (WMF) 37730 /* {{Deployment_day|date=2026-06-04}} */ +1 2423297 wikitext text/x-wiki 2ofr4fltempi3agwxtqvxjk8ax8husn 2423438 2423297 2026-06-03T20:22:00Z ScheduleDeploymentBot 37566 Add [[gerrit:1297228]] to Wednesday, June 03 UTC late backport window 2423438 wikitext text/x-wiki lyc3vse5sckikrdku90n11z06ekfzqy 2423444 2423438 2026-06-03T20:29:58Z Matma Rex 562 /* Thursday, June 4 */ +Puppet 2423444 wikitext text/x-wiki bkk5574lg7v5miva68he9203td28e4i 2423510 2423444 2026-06-04T02:01:54Z ScheduleDeploymentBot 37566 Add [[gerrit:1281901]] to Thursday, June 04 UTC afternoon backport window 2423510 wikitext text/x-wiki 1xz4e9qhxveyjoby9i07tltzgvjkawh 2423542 2423510 2026-06-04T05:52:13Z ScheduleDeploymentBot 37566 Add [[gerrit:1297536]] to Thursday, June 04 UTC morning backport window 2423542 wikitext text/x-wiki gescww2oifc6p6jsx8k5dpojqaadbfr 2423543 2423542 2026-06-04T05:52:20Z ScheduleDeploymentBot 37566 Add [[gerrit:1297173]] to Thursday, June 04 UTC morning backport window 2423543 wikitext text/x-wiki lao7ncu72efsqzajftcb8os93cpz93m 2423544 2423543 2026-06-04T05:52:48Z ScheduleDeploymentBot 37566 Add [[gerrit:1297200]] to Thursday, June 04 UTC morning backport window 2423544 wikitext text/x-wiki s0a0x6y6fxzcd672rwtzr86d9iwg4zj 12 5649 2423644 2420644 2026-06-04T11:20:23Z Sebastian Berlin (WMSE) 7884 /* Constraints of Toolforge */ 2423644 wikitext text/x-wiki qllfowtfy2poe7zo5tlt84uwvalno8a 0 7919 2423105 2423104 2026-06-03T12:03:52Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1066.eqiad.wmnet with reason: host reimage 2423105 wikitext text/x-wiki eozlswe9k3alxres724zsemqn8r2tiz 2423106 2423105 2026-06-03T12:06:36Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1212 (T426633)', diff saved to https://phabricator.wikimedia.org/P93698 and previous config saved to /var/cache/conftool/dbconfig/20260603-120634-fceratto.json 2423106 wikitext text/x-wiki o7dwsmjailmwecjhy1c5k152rw51jbx 2423107 2423106 2026-06-03T12:07:18Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1158.eqiad.wmnet with reason: Maintenance 2423107 wikitext text/x-wiki qi5z8o851z2oli4tlbkvfkozfaluvio 2423108 2423107 2026-06-03T12:07:25Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1014,1018].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance 2423108 wikitext text/x-wiki bxk7xzt88ywr1c4h0i5wt0ocl00kk4v 2423109 2423108 2026-06-03T12:07:33Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1158 (T426633)', diff saved to https://phabricator.wikimedia.org/P93699 and previous config saved to /var/cache/conftool/dbconfig/20260603-120732-fceratto.json 2423109 wikitext text/x-wiki ljj1j3u5rx1c5mjpuiaz57lio2evvqf 2423112 2423109 2026-06-03T12:11:15Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1067.eqiad.wmnet with reason: host reimage 2423112 wikitext text/x-wiki 054bpzuepac18dxidy530b6nygai1zs 2423113 2423112 2026-06-03T12:13:16Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db2186.codfw.wmnet with reason: host reimage 2423113 wikitext text/x-wiki n4vfomym7llyzbn254nz8muedq9micj 2423114 2423113 2026-06-03T12:13:53Z Stashbot 7414 mvernon@cumin2002: END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on ms-be1066.eqiad.wmnet with reason: host reimage 2423114 wikitext text/x-wiki lwcaq2yaht5p2dftq0lurd424dhml41 2423117 2423114 2026-06-03T12:15:35Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1158 (T426633)', diff saved to https://phabricator.wikimedia.org/P93700 and previous config saved to /var/cache/conftool/dbconfig/20260603-121533-fceratto.json 2423117 wikitext text/x-wiki q78bgzo4m173vtsv3mgn416q736tocv 2423119 2423117 2026-06-03T12:18:27Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2186.codfw.wmnet with reason: host reimage 2423119 wikitext text/x-wiki 8fghez8tza5po3uvqyab6hri8zko0iu 2423120 2423119 2026-06-03T12:22:20Z Stashbot 7414 mvernon@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1067.eqiad.wmnet with reason: host reimage 2423120 wikitext text/x-wiki pjlqn6noqunadn3pd1mdlp8oliox5vk 2423121 2423120 2026-06-03T12:25:43Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1158', diff saved to https://phabricator.wikimedia.org/P93701 and previous config saved to /var/cache/conftool/dbconfig/20260603-122541-fceratto.json 2423121 wikitext text/x-wiki 2x28hw8eskgambo4gjkr756hwxqsmdm 2423122 2423121 2026-06-03T12:27:06Z Stashbot 7414 dreamyjazz@deploy1003: Started scap sync-world: Backport for [[gerrit:1292364|Update hCaptcha checks to retrieve API parameters from $_REQUEST (T427105)]] 2423122 wikitext text/x-wiki 7kez101atjunahgwf0oz3fn7wa794wi 2423123 2423122 2026-06-03T12:29:01Z Stashbot 7414 dreamyjazz@deploy1003: somerandomdeveloper, dreamyjazz: Backport for [[gerrit:1292364|Update hCaptcha checks to retrieve API parameters from $_REQUEST (T427105)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423123 wikitext text/x-wiki ryyflovfejurvlechq2rgjtxcg5ixnk 2423124 2423123 2026-06-03T12:31:49Z Stashbot 7414 mvernon@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1066.eqiad.wmnet with OS bullseye 2423124 wikitext text/x-wiki o47g2b48vw6oa3zk3k5yd0upz1u2zc2 2423127 2423124 2026-06-03T12:34:07Z Stashbot 7414 dreamyjazz@deploy1003: somerandomdeveloper, dreamyjazz: Continuing with deployment 2423127 wikitext text/x-wiki sqkn6rk6oc2sgmlm80nx22hgpsa4ovo 2423128 2423127 2026-06-03T12:35:50Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1158', diff saved to https://phabricator.wikimedia.org/P93702 and previous config saved to /var/cache/conftool/dbconfig/20260603-123548-fceratto.json 2423128 wikitext text/x-wiki 9y1zuxxy0cyta9i72sk69ie80br4kb1 2423130 2423128 2026-06-03T12:36:19Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2186.codfw.wmnet with OS trixie 2423130 wikitext text/x-wiki 5t4n44ss1spnv1z9b73f947wmtwnwje 2423132 2423130 2026-06-03T12:38:21Z Stashbot 7414 dreamyjazz@deploy1003: Finished scap sync-world: Backport for [[gerrit:1292364|Update hCaptcha checks to retrieve API parameters from $_REQUEST (T427105)]] (duration: 11m 15s) 2423132 wikitext text/x-wiki 7oc0s2zj3l77x6iqggrqhgwbaau29bt 2423133 2423132 2026-06-03T12:41:36Z Stashbot 7414 mvernon@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1067.eqiad.wmnet with OS bullseye 2423133 wikitext text/x-wiki e2cra3lknm4cfg4z17ajax35vy52as8 2423134 2423133 2026-06-03T12:43:16Z Stashbot 7414 jiji@deploy1003: Started scap sync-world: Backport for [[gerrit:1297110|ProductionServices.php: switch filebackend.php to rdb2013:6381 (T418261 T419976)]] 2423134 wikitext text/x-wiki 6o6lteuayhb2r5g5a02whmgobjmy6zg 2423135 2423134 2026-06-03T12:43:48Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool db2186: Migration of db2186.codfw.wmnet completed 2423135 wikitext text/x-wiki 92m9iky5qtx6dnti9c21h9xb774ru1l 2423136 2423135 2026-06-03T12:45:18Z Stashbot 7414 jiji@deploy1003: jiji: Backport for [[gerrit:1297110|ProductionServices.php: switch filebackend.php to rdb2013:6381 (T418261 T419976)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423136 wikitext text/x-wiki dcgtjag7tjszyfhb86v2yye803227pi 2423137 2423136 2026-06-03T12:45:58Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1158 (T426633)', diff saved to https://phabricator.wikimedia.org/P93704 and previous config saved to /var/cache/conftool/dbconfig/20260603-124556-fceratto.json 2423137 wikitext text/x-wiki 36coqxv204xyl5jmmdpv45mdhzrl0kr 2423138 2423137 2026-06-03T12:46:18Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1170.eqiad.wmnet with reason: Maintenance 2423138 wikitext text/x-wiki 0yc3tquke6928uyg7btjhmtexpygkux 2423139 2423138 2026-06-03T12:46:26Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1170 (T426633)', diff saved to https://phabricator.wikimedia.org/P93705 and previous config saved to /var/cache/conftool/dbconfig/20260603-124624-fceratto.json 2423139 wikitext text/x-wiki 4n6dfr0i9v3eyz9dulkjnaooa2n7wv6 2423140 2423139 2026-06-03T12:46:47Z Stashbot 7414 jiji@deploy1003: jiji: Continuing with deployment 2423140 wikitext text/x-wiki p2e6gzew6296z4d4b7knelft7nyjqev 2423141 2423140 2026-06-03T12:47:57Z Stashbot 7414 jgreen@dns1004: START - running authdns-update 2423141 wikitext text/x-wiki 5luq2wg7p5rye5ppl5enrm4iya1n08x 2423142 2423141 2026-06-03T12:49:28Z Stashbot 7414 jgreen@dns1004: END - running authdns-update 2423142 wikitext text/x-wiki dn51s1gbyf6wl3luoq6uqevl7mnrzix 2423143 2423142 2026-06-03T12:51:01Z Stashbot 7414 jiji@deploy1003: Finished scap sync-world: Backport for [[gerrit:1297110|ProductionServices.php: switch filebackend.php to rdb2013:6381 (T418261 T419976)]] (duration: 07m 44s) 2423143 wikitext text/x-wiki lm0mgivz3yxjvirfcrgd2xlgxjv5f2c 2423145 2423143 2026-06-03T12:55:42Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1170 (T426633)', diff saved to https://phabricator.wikimedia.org/P93706 and previous config saved to /var/cache/conftool/dbconfig/20260603-125540-fceratto.json 2423145 wikitext text/x-wiki amodyj55tioi99hhozmni9i1opeq6o1 2423146 2423145 2026-06-03T13:05:43Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.dns.netbox 2423146 wikitext text/x-wiki t6ibbyktgd56dhgx9fe3oblknt9tlsu 2423147 2423146 2026-06-03T13:05:50Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1170', diff saved to https://phabricator.wikimedia.org/P93708 and previous config saved to /var/cache/conftool/dbconfig/20260603-130548-fceratto.json 2423147 wikitext text/x-wiki 0hto4ruby5t8kwdegk4lp71bcuizyw9 2423148 2423147 2026-06-03T13:09:53Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add codfw d3 and e5 public vlans - ayounsi@cumin1003" 2423148 wikitext text/x-wiki ttjjobozwalzhsb7ahuhm7nmsp7wel4 2423149 2423148 2026-06-03T13:09:58Z Stashbot 7414 ayounsi@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: add codfw d3 and e5 public vlans - ayounsi@cumin1003" 2423149 wikitext text/x-wiki 5ty08vldrso7ceuycdkx9vfvarjy2e5 2423150 2423149 2026-06-03T13:10:00Z Stashbot 7414 ayounsi@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2423150 wikitext text/x-wiki 53sy01jvevjtbviinqni3969bw721nq 2423151 2423150 2026-06-03T13:10:16Z Stashbot 7414 kharlan@deploy1003: Started scap sync-world: Backport for [[gerrit:1296649|hCaptcha: Roll out to all except enwiki for mobile apps. (T426048)]] 2423151 wikitext text/x-wiki 2jm7b7k39jsqc75osmlubxig98u6t6f 2423152 2423151 2026-06-03T13:12:16Z Stashbot 7414 kharlan@deploy1003: dbrant, kharlan: Backport for [[gerrit:1296649|hCaptcha: Roll out to all except enwiki for mobile apps. (T426048)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423152 wikitext text/x-wiki 1ud2lkjigzia1y7yva5h17fk54u41pp 2423153 2423152 2026-06-03T13:13:50Z Stashbot 7414 kharlan@deploy1003: dbrant, kharlan: Continuing with deployment 2423153 wikitext text/x-wiki pqphs7yxkdze61rd5hd97tdnxcemb9d 2423154 2423153 2026-06-03T13:15:36Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. 2423154 wikitext text/x-wiki 0khrbga7k7tk54e5c7a8yodbxywmhal 2423155 2423154 2026-06-03T13:15:59Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1170', diff saved to and previous config saved to /var/cache/conftool/dbconfig/20260603-131556-fceratto.json 2423155 wikitext text/x-wiki pc8l9wallnd3umaa8xr13ac55t3btt4 2423156 2423155 2026-06-03T13:16:05Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. 2423156 wikitext text/x-wiki 57jxpofgtp350ziglh8qvgs3ulzcviy 2423157 2423156 2026-06-03T13:18:03Z Stashbot 7414 kharlan@deploy1003: Finished scap sync-world: Backport for [[gerrit:1296649|hCaptcha: Roll out to all except enwiki for mobile apps. (T426048)]] (duration: 07m 46s) 2423157 wikitext text/x-wiki pj14iyv2y3nsvjgzxz5hzrfglcrtlkq 2423160 2423157 2026-06-03T13:20:41Z Stashbot 7414 kharlan@deploy1003: Started scap sync-world: Backport for [[gerrit:1295910|hCaptcha: Roll out self-hosted secure-api.js to all wikis (T403829)]] 2423160 wikitext text/x-wiki d353rcrfkcbw0gfmy2bp0hv8tfa3uvp 2423161 2423160 2026-06-03T13:22:36Z Stashbot 7414 kharlan@deploy1003: kharlan: Backport for [[gerrit:1295910|hCaptcha: Roll out self-hosted secure-api.js to all wikis (T403829)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423161 wikitext text/x-wiki rmthfoz02edaj78u65296tiuco53nz7 2423162 2423161 2026-06-03T13:23:58Z Stashbot 7414 kharlan@deploy1003: kharlan: Continuing with deployment 2423162 wikitext text/x-wiki o829nawvjr5b3ulgh3r68iduahy2hxx 2423163 2423162 2026-06-03T13:25:43Z Stashbot 7414 sukhe: sudo cumin 'A:lvs or A:liberica' 'disable-puppet "merging CR 1282764"' 2423163 wikitext text/x-wiki rfwqqwxtg5er916zrsjxwbszj5cksme 2423164 2423163 2026-06-03T13:26:12Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1170 (T426633)', diff saved to https://phabricator.wikimedia.org/P93710 and previous config saved to /var/cache/conftool/dbconfig/20260603-132605-fceratto.json 2423164 wikitext text/x-wiki 8ogy3p6sjfwwlnzlbjjjipvq15cmxla 2423165 2423164 2026-06-03T13:26:32Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1174.eqiad.wmnet with reason: Maintenance 2423165 wikitext text/x-wiki hekxqv9gkkzqinlhwe8faeji4purjzq 2423166 2423165 2026-06-03T13:26:39Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1174 (T426633)', diff saved to and previous config saved to /var/cache/conftool/dbconfig/20260603-132638-fceratto.json 2423166 wikitext text/x-wiki p9vx0jkv9p8bv793ytc6rmjr0vy76a6 2423167 2423166 2026-06-03T13:28:14Z Stashbot 7414 kharlan@deploy1003: Finished scap sync-world: Backport for [[gerrit:1295910|hCaptcha: Roll out self-hosted secure-api.js to all wikis (T403829)]] (duration: 07m 36s) 2423167 wikitext text/x-wiki 27pxqlwh60dwr5s9ekde42xf4jkq817 2423168 2423167 2026-06-03T13:29:19Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2186: Migration of db2186.codfw.wmnet completed 2423168 wikitext text/x-wiki oaay8or20bproio7m4ofpf4sd0tk6po 2423169 2423168 2026-06-03T13:29:21Z Stashbot 7414 marostegui@cumin1003: END (FAIL) - Cookbook sre.mysql.major-upgrade (exit_code=99) 2423169 wikitext text/x-wiki sbfa0uihpaitvo4qdgte7cz821m7iei 2423171 2423169 2026-06-03T13:34:45Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1174 (T426633)', diff saved to and previous config saved to /var/cache/conftool/dbconfig/20260603-133440-fceratto.json 2423171 wikitext text/x-wiki 0xi1d49jvldm4lqb3ag1sgrtm8l81qw 2423172 2423171 2026-06-03T13:36:01Z Stashbot 7414 javiermonton@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply 2423172 wikitext text/x-wiki qapcagjcwlbi5w0jktm2dt48u2lxcho 2423173 2423172 2026-06-03T13:36:28Z Stashbot 7414 javiermonton@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply 2423173 wikitext text/x-wiki h0zk2rciwl98xvxzkvedp7s1o8orohj 2423175 2423173 2026-06-03T13:56:08Z Stashbot 7414 dcausse@deploy1003: atsuko, dcausse: Rolling back deployment 2423175 wikitext text/x-wiki 9dmxvs5uzlsw6nbwkb18xorfurilqui 2423176 2423175 2026-06-03T13:58:25Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.dns.netbox 2423176 wikitext text/x-wiki fesmwcscdsuova2cjmm1fmv4vs8fwhl 2423177 2423176 2026-06-03T13:58:49Z Stashbot 7414 javiermonton@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply 2423177 wikitext text/x-wiki k1c36oxg4m48nw98x2ooto4ilcnq4y1 2423178 2423177 2026-06-03T13:58:51Z Stashbot 7414 javiermonton@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply 2423178 wikitext text/x-wiki 90abdbkzuzfhsq8z8pok1gbio69nsbe 2423179 2423178 2026-06-03T13:59:33Z Stashbot 7414 javiermonton@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply 2423179 wikitext text/x-wiki futpc0yvaz33ztd1sz649jc6kntn1vp 2423180 2423179 2026-06-03T13:59:35Z Stashbot 7414 javiermonton@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply 2423180 wikitext text/x-wiki adh3rlsgkfqqz07wnrtkc9jbj5tzl4a 2423181 2423180 2026-06-03T13:59:48Z Stashbot 7414 javiermonton@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply 2423181 wikitext text/x-wiki 1ee9c7ltv49jhz44ktut4jds6nd0zrm 2423182 2423181 2026-06-03T14:00:04Z Stashbot 7414 javiermonton@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich-next: apply 2423182 wikitext text/x-wiki ortzamg2s47louvuhxrwrzufve4wv5e 2423183 2423182 2026-06-03T14:01:25Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2423183 wikitext text/x-wiki mo8kg9youmtnpb289qlqtjnxeq8bt6c 2423185 2423183 2026-06-03T14:05:10Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1174 (T426633)', diff saved to https://phabricator.wikimedia.org/P93714 and previous config saved to /var/cache/conftool/dbconfig/20260603-140507-fceratto.json 2423185 wikitext text/x-wiki 35pb68hoiyw4bh73aszcq19h9xyjg3v 2423186 2423185 2026-06-03T14:05:31Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1191.eqiad.wmnet with reason: Maintenance 2423186 wikitext text/x-wiki e4x3exclhwbc69whjp2wm2922mz2rcb 2423187 2423186 2026-06-03T14:05:39Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1191 (T426633)', diff saved to https://phabricator.wikimedia.org/P93715 and previous config saved to /var/cache/conftool/dbconfig/20260603-140537-fceratto.json 2423187 wikitext text/x-wiki rm8z5fi092ykx0ztmrvc8t2w8pbjvh0 2423188 2423187 2026-06-03T14:05:42Z Stashbot 7414 dcausse@deploy1003: Finished scap sync-world: Backport for [[gerrit:1296631|translate: adding separate read/write endpoints (T425377)]] (duration: 13m 06s) 2423188 wikitext text/x-wiki ct9trd7kka1jc616tn5dj6xqgeptdaf 2423189 2423188 2026-06-03T14:08:00Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host mc2055 2423189 wikitext text/x-wiki g7k952mx8mqwuukab1etaoxsq8evl9l 2423190 2423189 2026-06-03T14:08:02Z Stashbot 7414 jhancock@cumin2002: END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host mc2055 2423190 wikitext text/x-wiki d95zwf50rr8yvrf1v6xc3ecvy7nnecs 2423191 2423190 2026-06-03T14:09:35Z Stashbot 7414 gengh@deploy1003: helmfile [staging] START helmfile.d/services/wikifunctions: apply 2423191 wikitext text/x-wiki 0vzdpnb4ivmgqb3minamgzl3qzgr58i 2423192 2423191 2026-06-03T14:10:38Z Stashbot 7414 gengh@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifunctions: apply 2423192 wikitext text/x-wiki 4c6f9vcms84aogv0yqv2h2kaj6ha5dl 2423193 2423192 2026-06-03T14:10:53Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.provision for host mc2055.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2423193 wikitext text/x-wiki tv43nt2nfn9gb168xwy9puphsa6husa 2423194 2423193 2026-06-03T14:10:57Z Stashbot 7414 jhancock@cumin2002: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host mc2055.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2423194 wikitext text/x-wiki 2adovc3fjtf1d8qbp2dodcyxj556fev 2423195 2423194 2026-06-03T14:11:04Z Stashbot 7414 gengh@deploy1003: helmfile [codfw] START helmfile.d/services/wikifunctions: apply 2423195 wikitext text/x-wiki cpe7tpe700gqrursleslpu78w3ndb8s 2423196 2423195 2026-06-03T14:11:33Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host mc2055 2423196 wikitext text/x-wiki svbzj1xs9qoff27gi9h9v4179qo4v38 2423197 2423196 2026-06-03T14:11:35Z Stashbot 7414 jhancock@cumin2002: END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host mc2055 2423197 wikitext text/x-wiki mqget67wg56ok10irc4k5safnyhs1ve 2423198 2423197 2026-06-03T14:12:45Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1191 (T426633)', diff saved to https://phabricator.wikimedia.org/P93716 and previous config saved to /var/cache/conftool/dbconfig/20260603-141242-fceratto.json 2423198 wikitext text/x-wiki r778doi91wf6xpcukvdzmzhuvpg0cme 2423199 2423198 2026-06-03T14:12:57Z Stashbot 7414 gengh@deploy1003: helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply 2423199 wikitext text/x-wiki svksdcsnl8x1j9vsfn2vln6cx0980e6 2423200 2423199 2026-06-03T14:13:04Z Stashbot 7414 gengh@deploy1003: helmfile [eqiad] START helmfile.d/services/wikifunctions: apply 2423200 wikitext text/x-wiki 6uf7g4lhft2125oik7cnodl2sjt3sym 2423201 2423200 2026-06-03T14:16:05Z Stashbot 7414 gengh@deploy1003: helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply 2423201 wikitext text/x-wiki 9dzza3sg2hivxi990srcj73g0gmr437 2423202 2423201 2026-06-03T14:16:28Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host mc2055 2423202 wikitext text/x-wiki sz3qai3uwjsrn1w6qqg05nwa201xn2q 2423203 2423202 2026-06-03T14:16:31Z Stashbot 7414 vriley@cumin1003: END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host mc2055 2423203 wikitext text/x-wiki l6zi4zdt4gvwy0jt4ixfhxylcesoe59 2423204 2423203 2026-06-03T14:19:21Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host mc2055 2423204 wikitext text/x-wiki q12nwqqwn6kg9qppsua86uwyaeip0dc 2423205 2423204 2026-06-03T14:19:23Z Stashbot 7414 jhancock@cumin2002: END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host mc2055 2423205 wikitext text/x-wiki speb7jjo6jv87w5sg5zp4vglxc5xryv 2423207 2423205 2026-06-03T14:20:03Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host mc2055 2423207 wikitext text/x-wiki cx1sucwxvd6zeoz1vf2uhkoq9n6k9dq 2423208 2423207 2026-06-03T14:20:06Z Stashbot 7414 jhancock@cumin2002: END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host mc2055 2423208 wikitext text/x-wiki 52ku0xqrt2jnjztibbv6ixuoq953spu 2423209 2423208 2026-06-03T14:20:14Z Stashbot 7414 gengh@deploy1003: helmfile [staging] START helmfile.d/services/wikifunctions: apply 2423209 wikitext text/x-wiki 92u2tsjl2bv1xrwiyfgcads2hp4g7hg 2423210 2423209 2026-06-03T14:20:37Z Stashbot 7414 gengh@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifunctions: apply 2423210 wikitext text/x-wiki d8shdd9edxq1zlx36tl7d91lf83eyno 2423211 2423210 2026-06-03T14:21:41Z Stashbot 7414 gengh@deploy1003: helmfile [codfw] START helmfile.d/services/wikifunctions: apply 2423211 wikitext text/x-wiki t2mfvoszbgows1puwhec2eic3uztrho 2423212 2423211 2026-06-03T14:21:57Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host mc2055 2423212 wikitext text/x-wiki b6qzrp1mztihclqiwj41x822roeefiu 2423213 2423212 2026-06-03T14:22:00Z Stashbot 7414 cmooney@cumin1003: END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host mc2055 2423213 wikitext text/x-wiki hkzh1mo227n8hx1g3cbq4djq90dqtcp 2423214 2423213 2026-06-03T14:22:23Z Stashbot 7414 gengh@deploy1003: helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply 2423214 wikitext text/x-wiki jtjrd7dvijlfy2evuzigiakb4hrmot5 2423215 2423214 2026-06-03T14:22:31Z Stashbot 7414 gengh@deploy1003: helmfile [eqiad] START helmfile.d/services/wikifunctions: apply 2423215 wikitext text/x-wiki 1537p1grs7ejzi1w4hvqzucf6rwmwhc 2423216 2423215 2026-06-03T14:22:52Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1191', diff saved to https://phabricator.wikimedia.org/P93717 and previous config saved to /var/cache/conftool/dbconfig/20260603-142251-fceratto.json 2423216 wikitext text/x-wiki kjex1zbyxsaj3f290q75o4hajsj2iyr 2423217 2423216 2026-06-03T14:23:05Z Stashbot 7414 gengh@deploy1003: helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply 2423217 wikitext text/x-wiki sdtk37glu2ebqe3y9moh6hg00te8u06 2423218 2423217 2026-06-03T14:23:37Z Stashbot 7414 sgimeno@deploy1003: Started scap sync-world: Backport for [[gerrit:1297130|editor: make redesigned anon warning the default experience (T424595)]] 2423218 wikitext text/x-wiki 4ig8q6g8t233c8fb1j9qjpfeer02n9w 2423219 2423218 2026-06-03T14:24:52Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host mc2055 2423219 wikitext text/x-wiki 9c1qwx2q21ak06slb62na9e00vdurb2 2423220 2423219 2026-06-03T14:24:54Z Stashbot 7414 cmooney@cumin1003: END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host mc2055 2423220 wikitext text/x-wiki 1jbunv4l91sfsdrntd2ji9xnb8m6cho 2423221 2423220 2026-06-03T14:25:35Z Stashbot 7414 sgimeno@deploy1003: sgimeno: Backport for [[gerrit:1297130|editor: make redesigned anon warning the default experience (T424595)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423221 wikitext text/x-wiki aomccxhpwiww3c84xdwgkvxj9tylvwo 2423223 2423221 2026-06-03T14:28:09Z Stashbot 7414 sgimeno@deploy1003: sgimeno: Continuing with deployment 2423223 wikitext text/x-wiki ltodlfb1myapixvcng4sr9g1vxmh9k6 2423224 2423223 2026-06-03T14:30:18Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.provision for host thanos-be1006.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2423224 wikitext text/x-wiki j28tq35ep830sjymefadcuteq782lj8 2423225 2423224 2026-06-03T14:33:01Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1191', diff saved to https://phabricator.wikimedia.org/P93719 and previous config saved to /var/cache/conftool/dbconfig/20260603-143259-fceratto.json 2423225 wikitext text/x-wiki 5z5n8sac1g3z0b46lykzrakkwot0smn 2423226 2423225 2026-06-03T14:34:22Z Stashbot 7414 sgimeno@deploy1003: Finished scap sync-world: Backport for [[gerrit:1297130|editor: make redesigned anon warning the default experience (T424595)]] (duration: 10m 45s) 2423226 wikitext text/x-wiki 6bbvxcuisw6nbl0h6ly74az3punv5ph 2423227 2423226 2026-06-03T14:35:11Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host wdqs2031 2423227 wikitext text/x-wiki ay9iw1r246z8nd62bks8uaeslno5ydy 2423228 2423227 2026-06-03T14:35:20Z Stashbot 7414 jhancock@cumin2002: END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host wdqs2031 2423228 wikitext text/x-wiki qphj48jbbit9if37y1mndmrbstmds67 2423230 2423228 2026-06-03T14:38:35Z Stashbot 7414 jforrester@deploy1003: helmfile [staging] START helmfile.d/services/wikifunctions: apply 2423230 wikitext text/x-wiki m275veik0zj6mnvws0bowhf5ukol1f8 2423231 2423230 2026-06-03T14:39:25Z Stashbot 7414 jforrester@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifunctions: apply 2423231 wikitext text/x-wiki kb1h4drqr44tqn2y7enxdloid8gw8v8 2423232 2423231 2026-06-03T14:39:43Z Stashbot 7414 jforrester@deploy1003: helmfile [codfw] START helmfile.d/services/wikifunctions: apply 2423232 wikitext text/x-wiki okqe9xt9en3f34wuve4uosr91y9ki43 2423233 2423232 2026-06-03T14:39:45Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host mc2055 2423233 wikitext text/x-wiki 15t5bmqg1mij2bkx2t3g0nf4ojqg8ap 2423234 2423233 2026-06-03T14:39:47Z Stashbot 7414 cmooney@cumin1003: END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host mc2055 2423234 wikitext text/x-wiki jxh15e9sh8db6nbq8o5pgqwuh96urjy 2423235 2423234 2026-06-03T14:41:22Z Stashbot 7414 mlitn@deploy1003: Started scap sync-world: Backport for [[gerrit:1297137|Revert "MultimediaViewer: enable image carousel as a beta feature on Wikipedias"]] 2423235 wikitext text/x-wiki 9atc3e6841o6wy4kblg0gkiohsag66n 2423237 2423235 2026-06-03T14:41:34Z Stashbot 7414 jforrester@deploy1003: helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply 2423237 wikitext text/x-wiki m6zfmq7k6rd6w3lrxtnq28w68qrdd6e 2423238 2423237 2026-06-03T14:41:40Z Stashbot 7414 jforrester@deploy1003: helmfile [eqiad] START helmfile.d/services/wikifunctions: apply 2423238 wikitext text/x-wiki 1id0xbpq25wbro143zucqxork9ukr40 2423239 2423238 2026-06-03T14:43:08Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1191 (T426633)', diff saved to https://phabricator.wikimedia.org/P93721 and previous config saved to /var/cache/conftool/dbconfig/20260603-144306-fceratto.json 2423239 wikitext text/x-wiki ih5wrs3n78ia7fbcf9vhveqs3s6lndw 2423240 2423239 2026-06-03T14:43:22Z Stashbot 7414 mlitn@deploy1003: mlitn: Backport for [[gerrit:1297137|Revert "MultimediaViewer: enable image carousel as a beta feature on Wikipedias"]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423240 wikitext text/x-wiki ap6w8f6sscvrlb7yzcn1x2wpmc2pu76 2423241 2423240 2026-06-03T14:43:28Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1194.eqiad.wmnet with reason: Maintenance 2423241 wikitext text/x-wiki gm9e87p9m8c3jzdnh0g19k4uyujlsgi 2423242 2423241 2026-06-03T14:43:31Z Stashbot 7414 jforrester@deploy1003: helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply 2423242 wikitext text/x-wiki 69mqp6vrtizdvyz86kvpecb29yhcamr 2423243 2423242 2026-06-03T14:43:36Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1194 (T426633)', diff saved to https://phabricator.wikimedia.org/P93722 and previous config saved to /var/cache/conftool/dbconfig/20260603-144334-fceratto.json 2423243 wikitext text/x-wiki 67lgz5ntrdcdupls3vyz31qohubiwkz 2423244 2423243 2026-06-03T14:43:58Z Stashbot 7414 mlitn@deploy1003: mlitn: Continuing with deployment 2423244 wikitext text/x-wiki gwurr6pp44qzr8jhcal1xksicabo2vj 2423245 2423244 2026-06-03T14:46:05Z Stashbot 7414 eevans@deploy1003: helmfile [staging] START helmfile.d/services/linked-artifacts: apply 2423245 wikitext text/x-wiki q01xiwuwgocrv3wnegfz3jgyuuw0yxz 2423246 2423245 2026-06-03T14:46:17Z Stashbot 7414 eevans@deploy1003: helmfile [staging] DONE helmfile.d/services/linked-artifacts: apply 2423246 wikitext text/x-wiki n59nbxed7ynk08wxsui99qcox51ver9 2423247 2423246 2026-06-03T14:47:39Z Stashbot 7414 eevans@deploy1003: helmfile [eqiad] START helmfile.d/services/linked-artifacts: apply 2423247 wikitext text/x-wiki d89o89p0ckcyl06qom0q4a3kbq85k4s 2423248 2423247 2026-06-03T14:48:08Z Stashbot 7414 mlitn@deploy1003: Finished scap sync-world: Backport for [[gerrit:1297137|Revert "MultimediaViewer: enable image carousel as a beta feature on Wikipedias"]] (duration: 06m 46s) 2423248 wikitext text/x-wiki qel8qdustwjbmhszamozaqg9gw8j8g6 2423249 2423248 2026-06-03T14:50:41Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1194 (T426633)', diff saved to https://phabricator.wikimedia.org/P93723 and previous config saved to /var/cache/conftool/dbconfig/20260603-145039-fceratto.json 2423249 wikitext text/x-wiki 7e1v6vqi9fcdtc6rmcki0r46rtv9ygz 2423250 2423249 2026-06-03T14:51:44Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host thanos-be1006.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2423250 wikitext text/x-wiki dcgrnefydg5w93xz4ozudg21kw1tsw5 2423251 2423250 2026-06-03T14:52:58Z Stashbot 7414 cmooney@cumin1003: END (FAIL) - Cookbook sre.netbox.update-extras (exit_code=1) rolling restart_daemons on A:netbox 2423251 wikitext text/x-wiki 1dacafgnz6d81xeg9dtum8wymh4sick 2423252 2423251 2026-06-03T14:57:46Z Stashbot 7414 eevans@deploy1003: helmfile [eqiad] DONE helmfile.d/services/linked-artifacts: apply 2423252 wikitext text/x-wiki c181ffcbvns810ll5umsdlaxuztf8kw 2423254 2423252 2026-06-03T15:00:49Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1194', diff saved to https://phabricator.wikimedia.org/P93725 and previous config saved to /var/cache/conftool/dbconfig/20260603-150047-fceratto.json 2423254 wikitext text/x-wiki kttvcudfxxqbieq7cwa7h8ara4kuxld 2423255 2423254 2026-06-03T15:01:14Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.provision for host thanos-be1007.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2423255 wikitext text/x-wiki cfee12ec928niit7qpdlcxuern6tmot 2423256 2423255 2026-06-03T15:10:56Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1194', diff saved to https://phabricator.wikimedia.org/P93726 and previous config saved to /var/cache/conftool/dbconfig/20260603-151055-fceratto.json 2423256 wikitext text/x-wiki d14l2dnf9reg26fibv4dvu1ewdrm4y4 2423257 2423256 2026-06-03T15:16:34Z Stashbot 7414 brouberol@dns1004: START - running authdns-update 2423257 wikitext text/x-wiki r1hcnkei0797a9do706znuanpbm54e9 2423258 2423257 2026-06-03T15:16:52Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.dns.netbox 2423258 wikitext text/x-wiki gx4yjiwnqewvw6plvkvpykvufel4cqd 2423259 2423258 2026-06-03T15:18:01Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host thanos-be1007.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2423259 wikitext text/x-wiki 4thsg69pq94xs7gx7hf8xfhzpzi0y2g 2423260 2423259 2026-06-03T15:18:05Z Stashbot 7414 brouberol@dns1004: END - running authdns-update 2423260 wikitext text/x-wiki f04ja9m0dpuf7pi5cl46l6h825917nw 2423261 2423260 2026-06-03T15:20:53Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding sretest2012 to codfw - jhancock@cumin2002" 2423261 wikitext text/x-wiki 6kq0gu5bu6trxji4xc88izu8lm0q1b5 2423262 2423261 2026-06-03T15:21:04Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1194 (T426633)', diff saved to https://phabricator.wikimedia.org/P93727 and previous config saved to /var/cache/conftool/dbconfig/20260603-152102-fceratto.json 2423262 wikitext text/x-wiki cm32uf044hw5b7zy20kjwdkyay5xiah 2423263 2423262 2026-06-03T15:21:06Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. 2423263 wikitext text/x-wiki 3l7pyfpluxe4mcgsp5ekigz9ifvhy15 2423264 2423263 2026-06-03T15:21:12Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: adding sretest2012 to codfw - jhancock@cumin2002" 2423264 wikitext text/x-wiki 8sfr6wvzfijf3pwvcjdybs4c7fzfzv7 2423265 2423264 2026-06-03T15:21:14Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2423265 wikitext text/x-wiki cwfmb8wc9hckrl6tnq1urw4ewfvp2ln 2423266 2423265 2026-06-03T15:21:23Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1202.eqiad.wmnet with reason: Maintenance 2423266 wikitext text/x-wiki bchy1ipbhj9lcq0goti3or0o0p5malo 2423267 2423266 2026-06-03T15:21:32Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1202 (T426633)', diff saved to https://phabricator.wikimedia.org/P93728 and previous config saved to /var/cache/conftool/dbconfig/20260603-152129-fceratto.json 2423267 wikitext text/x-wiki g2cfr84vrfwujvikred7mm4q74bq6fc 2423268 2423267 2026-06-03T15:21:46Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. 2423268 wikitext text/x-wiki og1pvq9h89qb7x1xrpeey1pzyqpji55 2423269 2423268 2026-06-03T15:23:36Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host sretest2012 2423269 wikitext text/x-wiki 63yx9z0dhdn74gfs5j4olm6lu12ra7q 2423270 2423269 2026-06-03T15:23:38Z Stashbot 7414 jhancock@cumin2002: END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host sretest2012 2423270 wikitext text/x-wiki pb2qsqi6i3wmfda6xr4vt30s20fuoyd 2423271 2423270 2026-06-03T15:23:42Z Stashbot 7414 mutante: disabling jenkins on CI servers for maintenance 2423271 wikitext text/x-wiki 4op2eljfhpd13wpr4fe6lp2fd5burs4 2423272 2423271 2026-06-03T15:24:12Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.provision for host thanos-be1008.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2423272 wikitext text/x-wiki fn6jcc37pgl6x81wuvouflhdpcuvvng 2423273 2423272 2026-06-03T15:25:38Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host sretest2012 2423273 wikitext text/x-wiki q4rmm1k8py4ljng2lo4cedtz4dr6syj 2423274 2423273 2026-06-03T15:25:41Z Stashbot 7414 jhancock@cumin2002: END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host sretest2012 2423274 wikitext text/x-wiki 42j0spmlalaqvg1fdpxcicu58r2imxv 2423275 2423274 2026-06-03T15:25:46Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host sretest2012 2423275 wikitext text/x-wiki 4xxvqpfotxjap5ndtukm3v75d7lpmf6 2423276 2423275 2026-06-03T15:25:48Z Stashbot 7414 jhancock@cumin2002: END (FAIL) - Cookbook sre.network.configure-switch-interfaces (exit_code=99) for host sretest2012 2423276 wikitext text/x-wiki ghizzqdp5rfncia6x838fkplstx75yd 2423277 2423276 2026-06-03T15:28:38Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1202 (T426633)', diff saved to https://phabricator.wikimedia.org/P93729 and previous config saved to /var/cache/conftool/dbconfig/20260603-152836-fceratto.json 2423277 wikitext text/x-wiki 9erlh96kd2pnjls8b037838av3sp7p6 2423278 2423277 2026-06-03T15:38:46Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1202', diff saved to https://phabricator.wikimedia.org/P93731 and previous config saved to /var/cache/conftool/dbconfig/20260603-153844-fceratto.json 2423278 wikitext text/x-wiki 57jv7p1cqjk397z3rwg4invzlkuisi9 2423279 2423278 2026-06-03T15:39:50Z Stashbot 7414 eevans@deploy1003: helmfile [eqiad] START helmfile.d/services/linked-artifacts: apply 2423279 wikitext text/x-wiki i7kxhkpvg9o9nlr2p4rehfkxwaeu6h1 2423280 2423279 2026-06-03T15:40:03Z Stashbot 7414 eevans@deploy1003: helmfile [eqiad] DONE helmfile.d/services/linked-artifacts: apply 2423280 wikitext text/x-wiki jzvouigic00mct9i6oug3lgj12nr6ci 2423283 2423280 2026-06-03T15:40:18Z Stashbot 7414 eevans@deploy1003: helmfile [codfw] START helmfile.d/services/linked-artifacts: apply 2423283 wikitext text/x-wiki 1jsnptp5lrx84wg4bkyszzzoje91us1 2423284 2423283 2026-06-03T15:40:32Z Stashbot 7414 eevans@deploy1003: helmfile [codfw] DONE helmfile.d/services/linked-artifacts: apply 2423284 wikitext text/x-wiki g06jyh0wrtgesmb4xhdnhbpa74xrspv 2423285 2423284 2026-06-03T15:40:46Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host thanos-be1008.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2423285 wikitext text/x-wiki pihdd5tkkhmh35yypqhuzbrwj6ywsbc 2423287 2423285 2026-06-03T15:46:15Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.hosts.reimage for host sretest2012.wikimedia.org with OS trixie 2423287 wikitext text/x-wiki 0lsh46i9tvlz5i32x1hpxw3ktrubdg1 2423288 2423287 2026-06-03T15:46:49Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.provision for host thanos-be1009.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2423288 wikitext text/x-wiki 37zdog8vpj1z0djhwmcduvsqdvm63l6 2423290 2423288 2026-06-03T15:48:53Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1202', diff saved to https://phabricator.wikimedia.org/P93732 and previous config saved to /var/cache/conftool/dbconfig/20260603-154852-fceratto.json 2423290 wikitext text/x-wiki 8vlkz0f65lhl8vd1ial4nzv9ei788zl 2423292 2423290 2026-06-03T15:49:06Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2423292 wikitext text/x-wiki 8oz25j5utojvgorgn9okds6mpkbtkbw 2423294 2423292 2026-06-03T15:49:57Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2423294 wikitext text/x-wiki cto5ykz9ukjwq0qmwa5p13p2bzffi0c 2423299 2423294 2026-06-03T15:59:01Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1202 (T426633)', diff saved to https://phabricator.wikimedia.org/P93733 and previous config saved to /var/cache/conftool/dbconfig/20260603-155859-fceratto.json 2423299 wikitext text/x-wiki 0g1ytqllq1vqs24c394qn4px14zgw7r 2423300 2423299 2026-06-03T15:59:22Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1227.eqiad.wmnet with reason: Maintenance 2423300 wikitext text/x-wiki 1ss5m2x2tc7kxpq9yd7tidqvp29a5n1 2423301 2423300 2026-06-03T15:59:30Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1227 (T426633)', diff saved to https://phabricator.wikimedia.org/P93734 and previous config saved to /var/cache/conftool/dbconfig/20260603-155928-fceratto.json 2423301 wikitext text/x-wiki 2f554rgs808fe6l584d3c1o7tkqc7ln 2423302 2423301 2026-06-03T16:04:07Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host thanos-be1009.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2423302 wikitext text/x-wiki ei9zjqdsx68rz7hyi5x6f0iwggpupui 2423303 2423302 2026-06-03T16:06:37Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1227 (T426633)', diff saved to https://phabricator.wikimedia.org/P93735 and previous config saved to /var/cache/conftool/dbconfig/20260603-160635-fceratto.json 2423303 wikitext text/x-wiki ktzp9m8e07yib3ym74alxuuk5tms2vr 2423304 2423303 2026-06-03T16:16:45Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1227', diff saved to https://phabricator.wikimedia.org/P93736 and previous config saved to /var/cache/conftool/dbconfig/20260603-161643-fceratto.json 2423304 wikitext text/x-wiki akwk47snj4nr5hlf3mvqf0xfjadubpr 2423305 2423304 2026-06-03T16:17:59Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2423305 wikitext text/x-wiki eq1d6nzzu1kev2p6mck2b742yn3n3jk 2423306 2423305 2026-06-03T16:19:12Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2423306 wikitext text/x-wiki rp59v48ebgydejqcnds4ml0751uwmmx 2423307 2423306 2026-06-03T16:23:22Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2423307 wikitext text/x-wiki 43wt6rmsamaxhdpk60o2lrcpvb1um4t 2423308 2423307 2026-06-03T16:25:26Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2423308 wikitext text/x-wiki ay1zycpt03kw20o4raib041wnamr759 2423309 2423308 2026-06-03T16:25:31Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2423309 wikitext text/x-wiki f0dzeb6a75jmoyl4p013wggubvxmg3d 2423310 2423309 2026-06-03T16:26:52Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1227', diff saved to https://phabricator.wikimedia.org/P93737 and previous config saved to /var/cache/conftool/dbconfig/20260603-162650-fceratto.json 2423310 wikitext text/x-wiki 4c69ndvpsslnx4hw6rh9oqa2yu1wns8 2423311 2423310 2026-06-03T16:33:37Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2423311 wikitext text/x-wiki 56ir01bqztoz4cuguxudnib1ppb7pdy 2423312 2423311 2026-06-03T16:37:00Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1227 (T426633)', diff saved to https://phabricator.wikimedia.org/P93738 and previous config saved to /var/cache/conftool/dbconfig/20260603-163658-fceratto.json 2423312 wikitext text/x-wiki m6q0twcjupn0xrq0jfxhztxplg6b2m3 2423313 2423312 2026-06-03T16:37:20Z Stashbot 7414 btullis@deploy1003: Started scap sync-world: Backport for [[gerrit:1295922|Declare the webrequest.dumps.dev0 stream in EventStreamConfig (T291645 T425087)]] 2423313 wikitext text/x-wiki ttvx7d4wqcbaxpo8al1uaz9wf26wy0u 2423314 2423313 2026-06-03T16:37:23Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1231.eqiad.wmnet with reason: Maintenance 2423314 wikitext text/x-wiki mzx58irqfbwljxs5ky2tozd0xidt7ov 2423315 2423314 2026-06-03T16:37:28Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1231 (T426633)', diff saved to https://phabricator.wikimedia.org/P93739 and previous config saved to /var/cache/conftool/dbconfig/20260603-163726-fceratto.json 2423315 wikitext text/x-wiki jmw0iz4v3xnzlsidt2q0vxo1vrnvhlc 2423316 2423315 2026-06-03T16:39:20Z Stashbot 7414 btullis@deploy1003: btullis: Backport for [[gerrit:1295922|Declare the webrequest.dumps.dev0 stream in EventStreamConfig (T291645 T425087)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423316 wikitext text/x-wiki g6r027ry8uubaorb3l63w6fu06xb2at 2423317 2423316 2026-06-03T16:40:21Z Stashbot 7414 btullis@deploy1003: btullis: Continuing with deployment 2423317 wikitext text/x-wiki 4ge5p7sngae7bcg1fiw89di8qvkixsw 2423318 2423317 2026-06-03T16:42:00Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2423318 wikitext text/x-wiki hzueifpmy7av69gwbv8yoa37h3ouc9z 2423319 2423318 2026-06-03T16:42:20Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2423319 wikitext text/x-wiki m6c0eff9hqhnnycx15hinhnrrnlaeuh 2423321 2423319 2026-06-03T16:43:30Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2423321 wikitext text/x-wiki fwpu8ontlnm1989xykwitra7g2xeeqn 2423322 2423321 2026-06-03T16:43:40Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2423322 wikitext text/x-wiki s9qk2arroxtxl2qbrebwwyupk7ue3b8 2423324 2423322 2026-06-03T16:44:31Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1231 (T426633)', diff saved to https://phabricator.wikimedia.org/P93740 and previous config saved to /var/cache/conftool/dbconfig/20260603-164428-fceratto.json 2423324 wikitext text/x-wiki lp4rxkljm8934x1q7bfig2n0d7ozsji 2423325 2423324 2026-06-03T16:44:36Z Stashbot 7414 btullis@deploy1003: Finished scap sync-world: Backport for [[gerrit:1295922|Declare the webrequest.dumps.dev0 stream in EventStreamConfig (T291645 T425087)]] (duration: 07m 16s) 2423325 wikitext text/x-wiki b7qsmnun8wajw0wfdrjorwknajt7wpa 2423326 2423325 2026-06-03T16:46:33Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2423326 wikitext text/x-wiki jlrlir8xaask2qjx9621n1ahr05igez 2423327 2423326 2026-06-03T16:47:43Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2423327 wikitext text/x-wiki t0fmv437cb42ynr42dwhhp8xsyc9smk 2423328 2423327 2026-06-03T16:48:21Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2423328 wikitext text/x-wiki kgomapo78ewxmlvym4kf3no1o3b0adp 2423329 2423328 2026-06-03T16:48:29Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2423329 wikitext text/x-wiki 7ltob6kqvnp85kz2sz0ahyo72m72cks 2423330 2423329 2026-06-03T16:48:58Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2423330 wikitext text/x-wiki iqumgwzlqr313l0tk0zcrydb7ouutxx 2423331 2423330 2026-06-03T16:50:38Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2423331 wikitext text/x-wiki gcw3ng2j9hmljanlxdmz65s2cnxcqgs 2423332 2423331 2026-06-03T16:51:09Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2423332 wikitext text/x-wiki 6zqn1etbz0irtd1acv078kwnj3ux64l 2423333 2423332 2026-06-03T16:51:16Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2423333 wikitext text/x-wiki 7wdgqv0z9div7nmh8ojup6977u76jae 2423334 2423333 2026-06-03T16:51:32Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2423334 wikitext text/x-wiki lfawp4tpls3169lail5t83t1soa7glj 2423335 2423334 2026-06-03T16:51:39Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2423335 wikitext text/x-wiki aaoro1xi8hv36ye6eka0syn2ng1brmm 2423336 2423335 2026-06-03T16:51:55Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2423336 wikitext text/x-wiki p8g6ukp34zavpsak68j4utr971wdz9z 2423337 2423336 2026-06-03T16:52:02Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2423337 wikitext text/x-wiki nhiuetgsr22bcr06qwemf5utvynfump 2423338 2423337 2026-06-03T16:52:17Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2423338 wikitext text/x-wiki 78z0d4wi62rdwe2ddu7ti2tw3d674oy 2423339 2423338 2026-06-03T16:52:25Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2423339 wikitext text/x-wiki kk9ujt2y7hgg9omlw8gv6a72klh6v3x 2423340 2423339 2026-06-03T16:52:39Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs: apply 2423340 wikitext text/x-wiki 7q0nxpil5l256rvq3r6wml375u45ob4 2423341 2423340 2026-06-03T16:53:38Z Stashbot 7414 hashar: Restarting CI Jenkins one last time # T418521 2423341 wikitext text/x-wiki hc0ba8nh6mzy2yrjju4pwwmmqrdw9wu 2423342 2423341 2026-06-03T16:53:40Z Stashbot 7414 trueg@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs: apply 2423342 wikitext text/x-wiki qjong08o1c8935lhm5ultdqj3zqkegu 2423343 2423342 2026-06-03T16:54:38Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1231', diff saved to https://phabricator.wikimedia.org/P93741 and previous config saved to /var/cache/conftool/dbconfig/20260603-165436-fceratto.json 2423343 wikitext text/x-wiki 279qbv1544v870o1qcqwf42m6ijqiqi 2423344 2423343 2026-06-03T17:03:20Z Stashbot 7414 swfrench@deploy1003: Started scap sync-world: No-deploy scap run to verify clean state before config change 2423344 wikitext text/x-wiki lmosz1895zuj35lsk82pgaa7td7nx4a 2423345 2423344 2026-06-03T17:04:05Z Stashbot 7414 swfrench@deploy1003: Stopping before sync operations 2423345 wikitext text/x-wiki djhnsfvcn2xerg01zlbw30q2f3a7wwo 2423346 2423345 2026-06-03T17:04:46Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1231', diff saved to https://phabricator.wikimedia.org/P93742 and previous config saved to /var/cache/conftool/dbconfig/20260603-170444-fceratto.json 2423346 wikitext text/x-wiki 8icbcfotgklnllxakbfeoh6g7s6uxn4 2423347 2423346 2026-06-03T17:08:54Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] START helmfile.d/services/shellbox: apply 2423347 wikitext text/x-wiki ijty51x6w9mlqgaqhhkapnuke8zohce 2423348 2423347 2026-06-03T17:09:17Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox: apply 2423348 wikitext text/x-wiki cgwax7x6b4bp63x4cdwwupnj6sk9dwd 2423349 2423348 2026-06-03T17:09:18Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-constraints: apply 2423349 wikitext text/x-wiki 3attanftzr2mo9zowzs248y4mrv1t6h 2423350 2423349 2026-06-03T17:09:29Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-constraints: apply 2423350 wikitext text/x-wiki 52zgav4q3rbxo3ivj6rvhcvjn7wfx0o 2423351 2423350 2026-06-03T17:09:31Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-media: apply 2423351 wikitext text/x-wiki fpn6svcwfoshi21z0q5lty83pskzhld 2423352 2423351 2026-06-03T17:09:42Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-media: apply 2423352 wikitext text/x-wiki lgub2n9vkm98fwz6fkvqe207bkn09pe 2423353 2423352 2026-06-03T17:09:44Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-syntaxhighlight: apply 2423353 wikitext text/x-wiki 2c4x4x11c1rlfsi0pwd8y1q4fwmlft9 2423354 2423353 2026-06-03T17:09:46Z Stashbot 7414 ayounsi@cumin1003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sretest2012.wikimedia.org with OS trixie 2423354 wikitext text/x-wiki dxeuof0jfzqnhl2j2745dqugl87z2nz 2423355 2423354 2026-06-03T17:09:56Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-syntaxhighlight: apply 2423355 wikitext text/x-wiki p0m61iz191sseusdht5f58bdeupjg0s 2423356 2423355 2026-06-03T17:09:58Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-timeline: apply 2423356 wikitext text/x-wiki ilkcic9j89wxn1ca6vuk66q9cnwo2kw 2423357 2423356 2026-06-03T17:10:14Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-timeline: apply 2423357 wikitext text/x-wiki khubaj13w868p49cxyraiz7pz7zkymu 2423358 2423357 2026-06-03T17:10:16Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-video: apply 2423358 wikitext text/x-wiki js6gw5jc2kd9vbs0qf3vmv4q09hkbso 2423359 2423358 2026-06-03T17:10:37Z Stashbot 7414 swfrench@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-video: apply 2423359 wikitext text/x-wiki jt20ta5t4qi06hpzl9egut9mxziym15 2423360 2423359 2026-06-03T17:12:47Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox: apply 2423360 wikitext text/x-wiki 632lz59sunjs9g4oxdjew6ofg4bogx8 2423361 2423360 2026-06-03T17:13:25Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox: apply 2423361 wikitext text/x-wiki 1sxdmc2bbkpuarf3rfqokjtxfkfmyoj 2423362 2423361 2026-06-03T17:13:57Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-constraints: apply 2423362 wikitext text/x-wiki 30aejnrag1p7beu47p3kcs8xjvdd18n 2423363 2423362 2026-06-03T17:14:27Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-constraints: apply 2423363 wikitext text/x-wiki 5l2n4x0q5xazk6nv5ifbo6kf9xwx3ou 2423364 2423363 2026-06-03T17:14:54Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1231 (T426633)', diff saved to https://phabricator.wikimedia.org/P93743 and previous config saved to /var/cache/conftool/dbconfig/20260603-171452-fceratto.json 2423364 wikitext text/x-wiki iwej6ax7j4xg6dqlsggc49a2xmt16sj 2423365 2423364 2026-06-03T17:14:59Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-media: apply 2423365 wikitext text/x-wiki 2ad7iw6bgzegbzh0c7x7lwlld84aarr 2423366 2423365 2026-06-03T17:15:15Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1253.eqiad.wmnet with reason: Maintenance 2423366 wikitext text/x-wiki fvvwdr6y6jx0sytpk12vw4yd6axrkox 2423367 2423366 2026-06-03T17:15:16Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-media: apply 2423367 wikitext text/x-wiki 7uqe2tlrmhed2tcobixd8lacldc1ian 2423368 2423367 2026-06-03T17:15:23Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1253 (T426633)', diff saved to https://phabricator.wikimedia.org/P93744 and previous config saved to /var/cache/conftool/dbconfig/20260603-171521-fceratto.json 2423368 wikitext text/x-wiki cmcftc58h87y0cgv5zoe3bii43s6afh 2423369 2423368 2026-06-03T17:15:47Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-syntaxhighlight: apply 2423369 wikitext text/x-wiki 11zavrncd3cu4hpm0hmjc3tj2u5celd 2423370 2423369 2026-06-03T17:16:11Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-syntaxhighlight: apply 2423370 wikitext text/x-wiki r6t0bhhsximlau76e7k8ogkpy2md2ys 2423371 2423370 2026-06-03T17:16:42Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-timeline: apply 2423371 wikitext text/x-wiki 70t3ug9bh4zq4e0nnta2g0lb5amy56q 2423372 2423371 2026-06-03T17:17:05Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: apply 2423372 wikitext text/x-wiki 7o29qe3ixdihp9a8vdsgd48y3q3gi4a 2423373 2423372 2026-06-03T17:17:07Z Stashbot 7414 swfrench@deploy1003: Started scap sync-world: No-deploy scap run to verify scap config change 2423373 wikitext text/x-wiki 3vcuo56ss2omsdgyrtzatwr243hvuno 2423374 2423373 2026-06-03T17:17:36Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-video: apply 2423374 wikitext text/x-wiki 0qxu1bmtn2ohc48n7jnpfgttasjvklk 2423375 2423374 2026-06-03T17:17:49Z Stashbot 7414 swfrench@deploy1003: Stopping before sync operations 2423375 wikitext text/x-wiki icv63b9pcir4nl9mzhvdzts9rr7az78 2423376 2423375 2026-06-03T17:18:37Z Stashbot 7414 swfrench@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-video: apply 2423376 wikitext text/x-wiki j7lmga6h4fjne0pzajtolb9t8v49hfk 2423378 2423376 2026-06-03T17:23:23Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1253 (T426633)', diff saved to https://phabricator.wikimedia.org/P93745 and previous config saved to /var/cache/conftool/dbconfig/20260603-172319-fceratto.json 2423378 wikitext text/x-wiki j901u973w7m81c46cxbhmvvn9pqp3us 2423379 2423378 2026-06-03T17:26:55Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.hosts.provision for host sretest2012.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2423379 wikitext text/x-wiki g37jf7xdpxirjgkgg5j2b0l9y7okihx 2423380 2423379 2026-06-03T17:30:00Z Stashbot 7414 brett@puppetserver1001: conftool action : set/pooled=yes; selector: name=cp5032.* 2423380 wikitext text/x-wiki 288pwmhfdhrkxq2ao2yay7jw7lu7go9 2423381 2423380 2026-06-03T17:32:32Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox: apply 2423381 wikitext text/x-wiki ipiqa8dhheaje66e6p695jxd3gr5o0a 2423382 2423381 2026-06-03T17:33:16Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox: apply 2423382 wikitext text/x-wiki gsvritwupf8h92zd7kcmfne3x18wv0z 2423383 2423382 2026-06-03T17:33:28Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1253', diff saved to https://phabricator.wikimedia.org/P93746 and previous config saved to /var/cache/conftool/dbconfig/20260603-173327-fceratto.json 2423383 wikitext text/x-wiki b0rhj3lmn3uwf6sslp0k6glt3owp1t7 2423384 2423383 2026-06-03T17:33:47Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-constraints: apply 2423384 wikitext text/x-wiki gij2oxffsrviqv8rvppckzvgsuzd9zp 2423385 2423384 2026-06-03T17:34:21Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-constraints: apply 2423385 wikitext text/x-wiki 5o09fo7d9tul7vwssmysert5ft1nulh 2423386 2423385 2026-06-03T17:34:52Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-media: apply 2423386 wikitext text/x-wiki 508xh8n35zlm3xfp8gwni0h3bnl3c0h 2423387 2423386 2026-06-03T17:35:10Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-media: apply 2423387 wikitext text/x-wiki ntjwslklh033f8n4nrdy48w6j8md27u 2423388 2423387 2026-06-03T17:35:41Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-syntaxhighlight: apply 2423388 wikitext text/x-wiki f77y08gk5zw7fkwlznwvg0196zlpp5f 2423389 2423388 2026-06-03T17:35:59Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-syntaxhighlight: apply 2423389 wikitext text/x-wiki mnjkhhbc636uwf979bbdq4w5cbftr2x 2423390 2423389 2026-06-03T17:36:30Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-timeline: apply 2423390 wikitext text/x-wiki 1n7ixt2614nfln7k9leoj83vjb1vyai 2423391 2423390 2026-06-03T17:36:58Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-timeline: apply 2423391 wikitext text/x-wiki j2ait2w9o4foqo7qwv3s8nf9qw082w8 2423392 2423391 2026-06-03T17:37:29Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-video: apply 2423392 wikitext text/x-wiki jhqchvk7xhj33fgn5s4mkrfe4hqx620 2423393 2423392 2026-06-03T17:37:39Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2012.mgmt.codfw.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2423393 wikitext text/x-wiki mr9wdniqxn9933hssh4nr6kcl9qiq6b 2423394 2423393 2026-06-03T17:38:35Z Stashbot 7414 swfrench@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-video: apply 2423394 wikitext text/x-wiki 2tdzkv12t8xcvuz35kqohdjwjrj7sii 2423395 2423394 2026-06-03T17:43:36Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1253', diff saved to https://phabricator.wikimedia.org/P93747 and previous config saved to /var/cache/conftool/dbconfig/20260603-174334-fceratto.json 2423395 wikitext text/x-wiki j47kkn0wo7pp8seew2m72ohpvz8vfq8 2423396 2423395 2026-06-03T17:52:20Z Stashbot 7414 hashar: contint1003: sudo puppet agent --disable "Prevent Jenkins from coming back" 2423396 wikitext text/x-wiki p62ed9lzqmgfyzssq6hzwmzafyy21v7 2423397 2423396 2026-06-03T17:53:44Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1253 (T426633)', diff saved to https://phabricator.wikimedia.org/P93748 and previous config saved to /var/cache/conftool/dbconfig/20260603-175342-fceratto.json 2423397 wikitext text/x-wiki n268y43pqfb6snof3t9fgor85dy5qkd 2423398 2423397 2026-06-03T17:55:38Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1190.eqiad.wmnet with reason: Maintenance 2423398 wikitext text/x-wiki sn40g7te1vd81f3uxcqjp9x5s9jrn80 2423399 2423398 2026-06-03T17:55:46Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1190 (T426633)', diff saved to https://phabricator.wikimedia.org/P93749 and previous config saved to /var/cache/conftool/dbconfig/20260603-175544-fceratto.json 2423399 wikitext text/x-wiki 9ikxq79npitzvwyqt1m6xuvu4ze1pii 2423401 2423399 2026-06-03T17:57:58Z Stashbot 7414 brett@puppetserver1001: conftool action : set/pooled=no; selector: name=cp5032.* 2423401 wikitext text/x-wiki 6jsga533gyy147tnd2a54pdg3ah4z1q 2423403 2423401 2026-06-03T18:04:06Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1190 (T426633)', diff saved to https://phabricator.wikimedia.org/P93750 and previous config saved to /var/cache/conftool/dbconfig/20260603-180404-fceratto.json 2423403 wikitext text/x-wiki av5rcbq2akh0hzi1tmliiyklk33xijv 2423404 2423403 2026-06-03T18:10:08Z Stashbot 7414 dancy@deploy1003: rebuilt and synchronized wikiversions files: group1 to 1.47.0-wmf.5 refs T423914 2423404 wikitext text/x-wiki 6m1da0wmgk0wv60t88lvv6jwd28a8f2 2423405 2423404 2026-06-03T18:14:14Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1190', diff saved to https://phabricator.wikimedia.org/P93751 and previous config saved to /var/cache/conftool/dbconfig/20260603-181412-fceratto.json 2423405 wikitext text/x-wiki pp8kec5tes3th3bw8vo2jg39ojwg6pq 2423406 2423405 2026-06-03T18:24:21Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1190', diff saved to https://phabricator.wikimedia.org/P93752 and previous config saved to /var/cache/conftool/dbconfig/20260603-182420-fceratto.json 2423406 wikitext text/x-wiki 9calw50m1gdgk2gc8ckw2ap37hyhknz 2423407 2423406 2026-06-03T18:34:29Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1190 (T426633)', diff saved to https://phabricator.wikimedia.org/P93753 and previous config saved to /var/cache/conftool/dbconfig/20260603-183427-fceratto.json 2423407 wikitext text/x-wiki 559ut94omnwyixqlhqxrgfclhg5si9a 2423408 2423407 2026-06-03T18:34:49Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1199.eqiad.wmnet with reason: Maintenance 2423408 wikitext text/x-wiki 706s6q59vhif73thqugz3rn5whdhlfv 2423409 2423408 2026-06-03T18:34:57Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1199 (T426633)', diff saved to https://phabricator.wikimedia.org/P93754 and previous config saved to /var/cache/conftool/dbconfig/20260603-183455-fceratto.json 2423409 wikitext text/x-wiki io897i91drya4r4sh4t4i73jr9c3cex 2423410 2423409 2026-06-03T18:43:26Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1199 (T426633)', diff saved to https://phabricator.wikimedia.org/P93755 and previous config saved to /var/cache/conftool/dbconfig/20260603-184324-fceratto.json 2423410 wikitext text/x-wiki dnso0j5fmalle081rdy5po01jnj9oye 2423411 2423410 2026-06-03T18:53:34Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1199', diff saved to https://phabricator.wikimedia.org/P93756 and previous config saved to /var/cache/conftool/dbconfig/20260603-185331-fceratto.json 2423411 wikitext text/x-wiki ovhls3p00w2bwvzg41e8l8pevmrkeur 2423412 2423411 2026-06-03T19:03:42Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1199', diff saved to https://phabricator.wikimedia.org/P93757 and previous config saved to /var/cache/conftool/dbconfig/20260603-190340-fceratto.json 2423412 wikitext text/x-wiki 2muxfuc937pimpy099twlexelr29dzy 2423413 2423412 2026-06-03T19:13:50Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1199 (T426633)', diff saved to https://phabricator.wikimedia.org/P93758 and previous config saved to /var/cache/conftool/dbconfig/20260603-191348-fceratto.json 2423413 wikitext text/x-wiki h32ehduzozgq0spekk8q8s48yt5v095 2423414 2423413 2026-06-03T19:14:10Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1221.eqiad.wmnet with reason: Maintenance 2423414 wikitext text/x-wiki foz2a1c22l9rl2qj2qc9i1zmvc77j7t 2423415 2423414 2026-06-03T19:14:31Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1015,1024-1025].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance 2423415 wikitext text/x-wiki 15blqebsoe6xbdqvhrcgcc6u90jmlrz 2423416 2423415 2026-06-03T19:14:39Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1221 (T426633)', diff saved to https://phabricator.wikimedia.org/P93759 and previous config saved to /var/cache/conftool/dbconfig/20260603-191437-fceratto.json 2423416 wikitext text/x-wiki r3ave3sdsycjovs2ko7dozq8wfjtj0c 2423417 2423416 2026-06-03T19:22:08Z Stashbot 7414 eevans@deploy1003: helmfile [staging] START helmfile.d/services/linked-artifacts: apply 2423417 wikitext text/x-wiki lcpw6hcxoot215qqoo7ig5jqt0hojll 2423418 2423417 2026-06-03T19:22:45Z Stashbot 7414 eevans@deploy1003: helmfile [staging] DONE helmfile.d/services/linked-artifacts: apply 2423418 wikitext text/x-wiki bp8nnhxgjqt52h6bynibpj6xhiottpq 2423419 2423418 2026-06-03T19:22:52Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1221 (T426633)', diff saved to https://phabricator.wikimedia.org/P93760 and previous config saved to /var/cache/conftool/dbconfig/20260603-192250-fceratto.json 2423419 wikitext text/x-wiki 4wzr4covu9xds28q0r34540uefnkqyo 2423420 2423419 2026-06-03T19:25:16Z Stashbot 7414 eevans@deploy1003: helmfile [eqiad] START helmfile.d/services/linked-artifacts: apply 2423420 wikitext text/x-wiki h5pq297lh82t7yfrivhwdhfw6rotj6v 2423421 2423420 2026-06-03T19:25:36Z Stashbot 7414 eevans@deploy1003: helmfile [eqiad] DONE helmfile.d/services/linked-artifacts: apply 2423421 wikitext text/x-wiki 2cmso6f06dqavbeh3x8csrqxakb4tkg 2423422 2423421 2026-06-03T19:25:59Z Stashbot 7414 eevans@deploy1003: helmfile [codfw] START helmfile.d/services/linked-artifacts: apply 2423422 wikitext text/x-wiki 18fk1f8fvzdpvqvj26rz7i5dbdhj322 2423423 2423422 2026-06-03T19:26:21Z Stashbot 7414 eevans@deploy1003: helmfile [codfw] DONE helmfile.d/services/linked-artifacts: apply 2423423 wikitext text/x-wiki hwkcucuks7xexykd255yxa3k56fh7ti 2423424 2423423 2026-06-03T19:33:00Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1221', diff saved to https://phabricator.wikimedia.org/P93761 and previous config saved to /var/cache/conftool/dbconfig/20260603-193258-fceratto.json 2423424 wikitext text/x-wiki eopf7vgn1pif2x0m8g1aqvx9kzqw5mx 2423425 2423424 2026-06-03T19:37:49Z Stashbot 7414 brett@puppetserver1001: conftool action : set/pooled=yes; selector: name=cp5032.* 2423425 wikitext text/x-wiki 14wpfodw5qwtniiqwfucvrp0kojp5oy 2423426 2423425 2026-06-03T19:39:29Z Stashbot 7414 brett@puppetserver1001: conftool action : set/pooled=no; selector: name=cp5032.* 2423426 wikitext text/x-wiki fr90byousbkzdspg0g2srb1j9vfglvd 2423427 2423426 2026-06-03T19:43:08Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1221', diff saved to https://phabricator.wikimedia.org/P93762 and previous config saved to /var/cache/conftool/dbconfig/20260603-194306-fceratto.json 2423427 wikitext text/x-wiki f8erqmt1dgb4x05bqe2joofm8ub2ywu 2423428 2423427 2026-06-03T19:47:39Z Stashbot 7414 brett@puppetserver1001: conftool action : set/pooled=yes; selector: name=cp5032.* 2423428 wikitext text/x-wiki 1ej5j4j57f8bxfoee1a9sbg954jlxd5 2423429 2423428 2026-06-03T19:53:15Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1221 (T426633)', diff saved to https://phabricator.wikimedia.org/P93763 and previous config saved to /var/cache/conftool/dbconfig/20260603-195313-fceratto.json 2423429 wikitext text/x-wiki oq5uv5ifvaqswx8d37iy20gfkgt6zaj 2423430 2423429 2026-06-03T19:53:35Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1238.eqiad.wmnet with reason: Maintenance 2423430 wikitext text/x-wiki h9rbzl3xs76q0uav5ak7t3a2bwd4vh3 2423431 2423430 2026-06-03T19:53:43Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1238 (T426633)', diff saved to https://phabricator.wikimedia.org/P93764 and previous config saved to /var/cache/conftool/dbconfig/20260603-195341-fceratto.json 2423431 wikitext text/x-wiki 18jpu8k0e68ezoram6jcyd1pisr1a51 2423432 2423431 2026-06-03T19:59:20Z Stashbot 7414 eevans@deploy1003: helmfile [eqiad] START helmfile.d/services/linked-artifacts: apply 2423432 wikitext text/x-wiki cei96mtufsic7s15gwzfdoarw8b7suj 2423433 2423432 2026-06-03T19:59:26Z Stashbot 7414 eevans@deploy1003: helmfile [eqiad] DONE helmfile.d/services/linked-artifacts: apply 2423433 wikitext text/x-wiki cqndh54glv0e6rl2x235fmide4xw98u 2423434 2423433 2026-06-03T19:59:38Z Stashbot 7414 eevans@deploy1003: helmfile [codfw] START helmfile.d/services/linked-artifacts: apply 2423434 wikitext text/x-wiki 891uhtwpv7j6tstx9f7uguhvnhpp3t2 2423435 2423434 2026-06-03T19:59:47Z Stashbot 7414 eevans@deploy1003: helmfile [codfw] DONE helmfile.d/services/linked-artifacts: apply 2423435 wikitext text/x-wiki 09kloz2cer3h3nbapryp10vfnrpsqhs 2423436 2423435 2026-06-03T20:02:05Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1238 (T426633)', diff saved to https://phabricator.wikimedia.org/P93765 and previous config saved to /var/cache/conftool/dbconfig/20260603-200203-fceratto.json 2423436 wikitext text/x-wiki crbb5ubunt9z1v7unioqm9mjdurujww 2423437 2423436 2026-06-03T20:12:13Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1238', diff saved to https://phabricator.wikimedia.org/P93766 and previous config saved to /var/cache/conftool/dbconfig/20260603-201211-fceratto.json 2423437 wikitext text/x-wiki e7o2u9tedjptx14dcmji163fyt8n550 2423439 2423437 2026-06-03T20:22:21Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1238', diff saved to https://phabricator.wikimedia.org/P93769 and previous config saved to /var/cache/conftool/dbconfig/20260603-202219-fceratto.json 2423439 wikitext text/x-wiki dplcowvtvplato60q0ha9g4w9exp167 2423441 2423439 2026-06-03T20:27:00Z Stashbot 7414 cjming@deploy1003: Started scap sync-world: Backport for [[gerrit:1297228|Attribution research don't use testKitchen compatibility layer (T417050)]] 2423441 wikitext text/x-wiki ly8739t5nw7t5k4plxz6ezvm526xyye 2423442 2423441 2026-06-03T20:29:10Z Stashbot 7414 cjming@deploy1003: cjming: Backport for [[gerrit:1297228|Attribution research don't use testKitchen compatibility layer (T417050)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423442 wikitext text/x-wiki chpc489jjmdxgcijgcjv6q3ya8s68jy 2423443 2423442 2026-06-03T20:29:30Z Stashbot 7414 cjming@deploy1003: cjming: Continuing with deployment 2423443 wikitext text/x-wiki o2xi7g0bxdvnoeud6e974pqlvgs16dp 2423445 2423443 2026-06-03T20:32:29Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1238 (T426633)', diff saved to https://phabricator.wikimedia.org/P93770 and previous config saved to /var/cache/conftool/dbconfig/20260603-203227-fceratto.json 2423445 wikitext text/x-wiki 3ag68z4ngpqcxdznc4ct5mpioasrb62 2423446 2423445 2026-06-03T20:32:48Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1241.eqiad.wmnet with reason: Maintenance 2423446 wikitext text/x-wiki s84a5cfs8brnu51a6msqf6iw43sl7sl 2423447 2423446 2026-06-03T20:32:56Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1241 (T426633)', diff saved to https://phabricator.wikimedia.org/P93771 and previous config saved to /var/cache/conftool/dbconfig/20260603-203254-fceratto.json 2423447 wikitext text/x-wiki k1q83vji7jn4ac7kl2quspx1ye24h26 2423448 2423447 2026-06-03T20:33:41Z Stashbot 7414 cjming@deploy1003: Finished scap sync-world: Backport for [[gerrit:1297228|Attribution research don't use testKitchen compatibility layer (T417050)]] (duration: 06m 41s) 2423448 wikitext text/x-wiki ejk29jwr0s35skurdv2s3guzlljbqvj 2423449 2423448 2026-06-03T20:41:17Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1241 (T426633)', diff saved to https://phabricator.wikimedia.org/P93772 and previous config saved to /var/cache/conftool/dbconfig/20260603-204115-fceratto.json 2423449 wikitext text/x-wiki ofajiyiq4cvctds5d0g3dxb8o6op1q4 2423450 2423449 2026-06-03T20:51:24Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1241', diff saved to https://phabricator.wikimedia.org/P93773 and previous config saved to /var/cache/conftool/dbconfig/20260603-205122-fceratto.json 2423450 wikitext text/x-wiki kgfd6zpjzx6ycfbds1dxhktiq7tbdfl 2423451 2423450 2026-06-03T21:01:32Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1241', diff saved to https://phabricator.wikimedia.org/P93774 and previous config saved to /var/cache/conftool/dbconfig/20260603-210130-fceratto.json 2423451 wikitext text/x-wiki hqgnyd9b4mn1s2bjohxcn4pmrxpuxac 2423452 2423451 2026-06-03T21:11:40Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1241 (T426633)', diff saved to https://phabricator.wikimedia.org/P93778 and previous config saved to /var/cache/conftool/dbconfig/20260603-211138-fceratto.json 2423452 wikitext text/x-wiki 0rxf6cx1k6vr1g3mp9wbs8yhntowkte 2423453 2423452 2026-06-03T21:12:00Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1242.eqiad.wmnet with reason: Maintenance 2423453 wikitext text/x-wiki 1aeaqxsi8jdtgi8tfbum6tm9xj29kdo 2423454 2423453 2026-06-03T21:12:08Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1242 (T426633)', diff saved to https://phabricator.wikimedia.org/P93779 and previous config saved to /var/cache/conftool/dbconfig/20260603-211206-fceratto.json 2423454 wikitext text/x-wiki 8j7cn5x9mjw6omo89p2i6tizwbexkql 2423455 2423454 2026-06-03T21:20:32Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1242 (T426633)', diff saved to https://phabricator.wikimedia.org/P93781 and previous config saved to /var/cache/conftool/dbconfig/20260603-212030-fceratto.json 2423455 wikitext text/x-wiki 4ro0bvnz0zrg0zzke4xx0iy8zji8rrw 2423456 2423455 2026-06-03T21:30:40Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1242', diff saved to https://phabricator.wikimedia.org/P93782 and previous config saved to /var/cache/conftool/dbconfig/20260603-213038-fceratto.json 2423456 wikitext text/x-wiki o2gs7l4sshlrnxn6fz5jzm1sbvfohrg 2423457 2423456 2026-06-03T21:40:48Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1242', diff saved to https://phabricator.wikimedia.org/P93783 and previous config saved to /var/cache/conftool/dbconfig/20260603-214046-fceratto.json 2423457 wikitext text/x-wiki s4acn9ag6d9nsb716h2pvhkywc675ti 2423458 2423457 2026-06-03T21:50:55Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1242 (T426633)', diff saved to https://phabricator.wikimedia.org/P93784 and previous config saved to /var/cache/conftool/dbconfig/20260603-215053-fceratto.json 2423458 wikitext text/x-wiki m5owjiqm814esnhjiu4r1dstfulbyp6 2423459 2423458 2026-06-03T21:51:05Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1243.eqiad.wmnet with reason: Maintenance 2423459 wikitext text/x-wiki lz4qd37tsvov7undfqpryophjytcqeh 2423460 2423459 2026-06-03T21:51:12Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1243 (T426633)', diff saved to https://phabricator.wikimedia.org/P93785 and previous config saved to /var/cache/conftool/dbconfig/20260603-215110-fceratto.json 2423460 wikitext text/x-wiki kf7oaprswhr3tzsbvh6ifqj0lehibp5 2423461 2423460 2026-06-03T22:00:28Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1243 (T426633)', diff saved to https://phabricator.wikimedia.org/P93786 and previous config saved to /var/cache/conftool/dbconfig/20260603-220026-fceratto.json 2423461 wikitext text/x-wiki hxd1haujhv0vq0gjg7caz5j4s760yxz 2423462 2423461 2026-06-03T22:10:35Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1243', diff saved to https://phabricator.wikimedia.org/P93787 and previous config saved to /var/cache/conftool/dbconfig/20260603-221034-fceratto.json 2423462 wikitext text/x-wiki e1fdgz9cp41r5x6syeiwt4rl4qm0ylk 2423463 2423462 2026-06-03T22:20:43Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1243', diff saved to https://phabricator.wikimedia.org/P93788 and previous config saved to /var/cache/conftool/dbconfig/20260603-222041-fceratto.json 2423463 wikitext text/x-wiki 7voq6ps9y6d0ds0keuntc8ece5lybnu 2423465 2423463 2026-06-03T22:30:51Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1243 (T426633)', diff saved to https://phabricator.wikimedia.org/P93789 and previous config saved to /var/cache/conftool/dbconfig/20260603-223048-fceratto.json 2423465 wikitext text/x-wiki ek2856s2qzlimxwcfrpfz41m2lc5es4 2423466 2423465 2026-06-03T22:31:10Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1244.eqiad.wmnet with reason: Maintenance 2423466 wikitext text/x-wiki 3m5q86e52674hu5ptniywtuzaob7mo0 2423467 2423466 2026-06-03T22:31:18Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1244 (T426633)', diff saved to https://phabricator.wikimedia.org/P93790 and previous config saved to /var/cache/conftool/dbconfig/20260603-223116-fceratto.json 2423467 wikitext text/x-wiki bvvd5icpqmwmf3wzth2j647nzuj0qkx 2423468 2423467 2026-06-03T22:39:39Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1244 (T426633)', diff saved to https://phabricator.wikimedia.org/P93791 and previous config saved to /var/cache/conftool/dbconfig/20260603-223937-fceratto.json 2423468 wikitext text/x-wiki nzibl0eq1ofbuy32zw4x4dukd3sun9c 2423469 2423468 2026-06-03T22:49:47Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1244', diff saved to https://phabricator.wikimedia.org/P93792 and previous config saved to /var/cache/conftool/dbconfig/20260603-224945-fceratto.json 2423469 wikitext text/x-wiki 0qlak5mj4nfh4m9ofe8dn0szipbsufy 2423470 2423469 2026-06-03T22:59:55Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1244', diff saved to https://phabricator.wikimedia.org/P93793 and previous config saved to /var/cache/conftool/dbconfig/20260603-225953-fceratto.json 2423470 wikitext text/x-wiki ch5c3f0v0x5autws4mkjgk6tsvs0wp3 2423471 2423470 2026-06-03T23:10:03Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1244 (T426633)', diff saved to https://phabricator.wikimedia.org/P93794 and previous config saved to /var/cache/conftool/dbconfig/20260603-231001-fceratto.json 2423471 wikitext text/x-wiki 2c6il3s42djuykgt8t6kxjmetm1zsva 2423472 2423471 2026-06-03T23:10:24Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1247.eqiad.wmnet with reason: Maintenance 2423472 wikitext text/x-wiki 11rampjis6nuzjbdoqjjgkwpijlxfwk 2423473 2423472 2026-06-03T23:10:33Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1247 (T426633)', diff saved to https://phabricator.wikimedia.org/P93795 and previous config saved to /var/cache/conftool/dbconfig/20260603-231031-fceratto.json 2423473 wikitext text/x-wiki 8t4cvy21010d5d7i2roe4i1y9vacpzu 2423474 2423473 2026-06-03T23:18:46Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1247 (T426633)', diff saved to https://phabricator.wikimedia.org/P93796 and previous config saved to /var/cache/conftool/dbconfig/20260603-231844-fceratto.json 2423474 wikitext text/x-wiki c4b4vvdv8szguz4tgb328bhqw7b1r2p 2423475 2423474 2026-06-03T23:22:13Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/test-kitchen-next: apply 2423475 wikitext text/x-wiki 59hd6m36kdc0nxfwuprskwi7nqtk4wn 2423476 2423475 2026-06-03T23:22:39Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/test-kitchen-next: apply 2423476 wikitext text/x-wiki 97yr4eydomob1wgb77xltingsai1u7m 2423477 2423476 2026-06-03T23:28:54Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1247', diff saved to https://phabricator.wikimedia.org/P93797 and previous config saved to /var/cache/conftool/dbconfig/20260603-232852-fceratto.json 2423477 wikitext text/x-wiki gspq8ldrc8nndkj19m90lnnj4crjyw9 2423478 2423477 2026-06-03T23:34:59Z Stashbot 7414 ladsgroup@deploy1003: Started scap sync-world: Backport for [[gerrit:1296561|Add a maintenance script to delete old files]], [[gerrit:1296560|Add a maintenance script to delete old files]] 2423478 wikitext text/x-wiki gippxpbiy6ycggsa31os3koj2r1yy96 2423479 2423478 2026-06-03T23:36:55Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup, reedy: Backport for [[gerrit:1296561|Add a maintenance script to delete old files]], [[gerrit:1296560|Add a maintenance script to delete old files]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423479 wikitext text/x-wiki 11f6ergipj0rjvw0xz5ym2c1jqr7ygq 2423480 2423479 2026-06-03T23:37:54Z Stashbot 7414 ladsgroup@deploy1003: ladsgroup, reedy: Continuing with deployment 2423480 wikitext text/x-wiki qy8d5n9frqk9m4wof0jzphroknsif2k 2423481 2423480 2026-06-03T23:39:01Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1247', diff saved to https://phabricator.wikimedia.org/P93798 and previous config saved to /var/cache/conftool/dbconfig/20260603-233859-fceratto.json 2423481 wikitext text/x-wiki 5zh2naw4lbms5v1g2yf050kkd8csc9s 2423482 2423481 2026-06-03T23:42:08Z Stashbot 7414 ladsgroup@deploy1003: Finished scap sync-world: Backport for [[gerrit:1296561|Add a maintenance script to delete old files]], [[gerrit:1296560|Add a maintenance script to delete old files]] (duration: 07m 09s) 2423482 wikitext text/x-wiki i4axfivo3zyum0rolvhxjyvegw09jk4 2423483 2423482 2026-06-03T23:49:09Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1247 (T426633)', diff saved to https://phabricator.wikimedia.org/P93799 and previous config saved to /var/cache/conftool/dbconfig/20260603-234907-fceratto.json 2423483 wikitext text/x-wiki 34hnhzy2cy5zc5137mhp9zu3mhk5n8k 2423484 2423483 2026-06-03T23:49:29Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1248.eqiad.wmnet with reason: Maintenance 2423484 wikitext text/x-wiki pekyfu9bzsx31ns4e4qj1zy2jw0ngq8 2423485 2423484 2026-06-03T23:49:37Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1248 (T426633)', diff saved to https://phabricator.wikimedia.org/P93800 and previous config saved to /var/cache/conftool/dbconfig/20260603-234935-fceratto.json 2423485 wikitext text/x-wiki szf88l4zd4kxmx9ilciaq2hozbzpo1p 2423486 2423485 2026-06-03T23:58:00Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1248 (T426633)', diff saved to https://phabricator.wikimedia.org/P93801 and previous config saved to /var/cache/conftool/dbconfig/20260603-235758-fceratto.json 2423486 wikitext text/x-wiki pya5lm3cvtimx63q9wbc9ik81x58qu3 2423488 2423486 2026-06-04T00:08:07Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1248', diff saved to https://phabricator.wikimedia.org/P93802 and previous config saved to /var/cache/conftool/dbconfig/20260604-000805-fceratto.json 2423488 wikitext text/x-wiki n9jaqjoe5iwa8onkr9sajbmyu7e8qhs 2423489 2423488 2026-06-04T00:18:15Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1248', diff saved to https://phabricator.wikimedia.org/P93803 and previous config saved to /var/cache/conftool/dbconfig/20260604-001813-fceratto.json 2423489 wikitext text/x-wiki fmpb0k5s86mo3bwjvnyass7969s8ud7 2423490 2423489 2026-06-04T00:18:56Z Stashbot 7414 Amir1: mwscript-k8s --follow --dblist=all -- extensions/timeline/maintenance/DeleteOldTimelineFiles.php --date 20210101000000 2423490 wikitext text/x-wiki g58q4w1vys1gl6zlwbsgny9acv3ssfv 2423491 2423490 2026-06-04T00:24:36Z Stashbot 7414 otto@deploy1003: Started scap sync-world: Backport for [[gerrit:1297260|EventStreamConfig - webrequest.dumps.dev0 - enable canary events for hive ingestion (T425087)]] 2423491 wikitext text/x-wiki femhfteh9680k9iuvtlcuuo10gl0v7l 2423492 2423491 2026-06-04T00:26:42Z Stashbot 7414 otto@deploy1003: otto: Backport for [[gerrit:1297260|EventStreamConfig - webrequest.dumps.dev0 - enable canary events for hive ingestion (T425087)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423492 wikitext text/x-wiki rmzyeaqy37jz8zd1uu3itxr5n2yn9tb 2423493 2423492 2026-06-04T00:28:23Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1248 (T426633)', diff saved to https://phabricator.wikimedia.org/P93804 and previous config saved to /var/cache/conftool/dbconfig/20260604-002821-fceratto.json 2423493 wikitext text/x-wiki lqo6hsvlwxdsv6vzpg808k1ehq7jo3b 2423494 2423493 2026-06-04T00:28:45Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1252.eqiad.wmnet with reason: Maintenance 2423494 wikitext text/x-wiki atdjcmd1y9xstg4gabgppue1b1arxbt 2423495 2423494 2026-06-04T00:28:53Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1252 (T426633)', diff saved to https://phabricator.wikimedia.org/P93805 and previous config saved to /var/cache/conftool/dbconfig/20260604-002851-fceratto.json 2423495 wikitext text/x-wiki df9f7qfxsuu6tuttayxtyg07kg0ha6s 2423497 2423495 2026-06-04T00:39:16Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1252 (T426633)', diff saved to https://phabricator.wikimedia.org/P93806 and previous config saved to /var/cache/conftool/dbconfig/20260604-003914-fceratto.json 2423497 wikitext text/x-wiki 0mye3e41vv7ovosxlzjl4vz2jgvqzyr 2423498 2423497 2026-06-04T00:49:23Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1252', diff saved to https://phabricator.wikimedia.org/P93807 and previous config saved to /var/cache/conftool/dbconfig/20260604-004922-fceratto.json 2423498 wikitext text/x-wiki tfbx4xsbhjmke71l6fln0nnzsbsz4kt 2423499 2423498 2026-06-04T00:59:31Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1252', diff saved to https://phabricator.wikimedia.org/P93808 and previous config saved to /var/cache/conftool/dbconfig/20260604-005929-fceratto.json 2423499 wikitext text/x-wiki 01e7kvuzixz3wobug7bh5l5x4aonl54 2423500 2423499 2026-06-04T01:09:39Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1252 (T426633)', diff saved to https://phabricator.wikimedia.org/P93809 and previous config saved to /var/cache/conftool/dbconfig/20260604-010937-fceratto.json 2423500 wikitext text/x-wiki 27brn0vynd024key51hq98guj4qk039 2423501 2423500 2026-06-04T01:09:59Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1260.eqiad.wmnet with reason: Maintenance 2423501 wikitext text/x-wiki pkrwiclykf6bm456rb7uy3yaslnmz7n 2423502 2423501 2026-06-04T01:10:07Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1260 (T426633)', diff saved to https://phabricator.wikimedia.org/P93810 and previous config saved to /var/cache/conftool/dbconfig/20260604-011005-fceratto.json 2423502 wikitext text/x-wiki a9l8ubbgr32uute8e9bfynuuk6fdsnn 2423503 2423502 2026-06-04T01:18:20Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1260 (T426633)', diff saved to https://phabricator.wikimedia.org/P93811 and previous config saved to /var/cache/conftool/dbconfig/20260604-011818-fceratto.json 2423503 wikitext text/x-wiki rjagdn3zcauk890s4fodh1khjq4hety 2423504 2423503 2026-06-04T01:28:27Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1260', diff saved to https://phabricator.wikimedia.org/P93812 and previous config saved to /var/cache/conftool/dbconfig/20260604-012826-fceratto.json 2423504 wikitext text/x-wiki f4r96eicrmwjo1afbs7zr17u4z81345 2423505 2423504 2026-06-04T01:38:35Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1260', diff saved to https://phabricator.wikimedia.org/P93813 and previous config saved to /var/cache/conftool/dbconfig/20260604-013833-fceratto.json 2423505 wikitext text/x-wiki nhyys0wenxtosw9c2ya35va0ri202ap 2423506 2423505 2026-06-04T01:48:43Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1260 (T426633)', diff saved to https://phabricator.wikimedia.org/P93814 and previous config saved to /var/cache/conftool/dbconfig/20260604-014841-fceratto.json 2423506 wikitext text/x-wiki bfzw7p8vjqbhgxlhiacydx5herhjt3s 2423507 2423506 2026-06-04T01:49:03Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1261.eqiad.wmnet with reason: Maintenance 2423507 wikitext text/x-wiki exchsg26c7zzcs9pfrc51w5v7ycommv 2423508 2423507 2026-06-04T01:49:11Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1261 (T426633)', diff saved to https://phabricator.wikimedia.org/P93815 and previous config saved to /var/cache/conftool/dbconfig/20260604-014909-fceratto.json 2423508 wikitext text/x-wiki mbq9fdxiic3ra779wim8upj7yx4txs9 2423509 2423508 2026-06-04T01:57:20Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1261 (T426633)', diff saved to https://phabricator.wikimedia.org/P93816 and previous config saved to /var/cache/conftool/dbconfig/20260604-015718-fceratto.json 2423509 wikitext text/x-wiki 6mozr112myri6ap0rqt33cx0r6tqvms 2423511 2423509 2026-06-04T02:07:28Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1261', diff saved to https://phabricator.wikimedia.org/P93817 and previous config saved to /var/cache/conftool/dbconfig/20260604-020726-fceratto.json 2423511 wikitext text/x-wiki ai9ofwzl0weyqmiz906285se6in4nvo 2423512 2423511 2026-06-04T02:17:35Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1261', diff saved to https://phabricator.wikimedia.org/P93818 and previous config saved to /var/cache/conftool/dbconfig/20260604-021734-fceratto.json 2423512 wikitext text/x-wiki 9i8dfkxrnoyjn68k7763fb5jo5260tg 2423513 2423512 2026-06-04T02:27:44Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1261 (T426633)', diff saved to https://phabricator.wikimedia.org/P93819 and previous config saved to /var/cache/conftool/dbconfig/20260604-022742-fceratto.json 2423513 wikitext text/x-wiki 879claupru9v3p0llpcmxtc72jxgpwq 2423514 2423513 2026-06-04T02:28:03Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1262.eqiad.wmnet with reason: Maintenance 2423514 wikitext text/x-wiki 5iz3n3c43bwpe09lsrrrvh9cgek66hy 2423515 2423514 2026-06-04T02:28:11Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1262 (T426633)', diff saved to https://phabricator.wikimedia.org/P93820 and previous config saved to /var/cache/conftool/dbconfig/20260604-022809-fceratto.json 2423515 wikitext text/x-wiki d523z8l51r3gvmzptdzqezrb2epzrn5 2423516 2423515 2026-06-04T02:36:21Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1262 (T426633)', diff saved to https://phabricator.wikimedia.org/P93821 and previous config saved to /var/cache/conftool/dbconfig/20260604-023619-fceratto.json 2423516 wikitext text/x-wiki cmxha7uyfvqoobn5au94hef3sjr1p6e 2423517 2423516 2026-06-04T02:46:29Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1262', diff saved to https://phabricator.wikimedia.org/P93822 and previous config saved to /var/cache/conftool/dbconfig/20260604-024627-fceratto.json 2423517 wikitext text/x-wiki 1q9jl8uk2knk08xl1xvz10s1b8kssf8 2423518 2423517 2026-06-04T02:56:36Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1262', diff saved to https://phabricator.wikimedia.org/P93823 and previous config saved to /var/cache/conftool/dbconfig/20260604-025634-fceratto.json 2423518 wikitext text/x-wiki 08erdirjpx0rf3w3hsgeo26gge3hbza 2423519 2423518 2026-06-04T03:06:44Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1262 (T426633)', diff saved to https://phabricator.wikimedia.org/P93824 and previous config saved to /var/cache/conftool/dbconfig/20260604-030642-fceratto.json 2423519 wikitext text/x-wiki qpr4drnzbss8bm2f6nb7nfh868qq49p 2423520 2423519 2026-06-04T03:07:04Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1263.eqiad.wmnet with reason: Maintenance 2423520 wikitext text/x-wiki 75n1smo43brhna95rpvq2xnjwcuw3a1 2423521 2423520 2026-06-04T03:07:12Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db1263 (T426633)', diff saved to https://phabricator.wikimedia.org/P93825 and previous config saved to /var/cache/conftool/dbconfig/20260604-030710-fceratto.json 2423521 wikitext text/x-wiki e4sa8xoor3dyblx6tgs74b1e6iw4ea0 2423522 2423521 2026-06-04T03:15:25Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1263 (T426633)', diff saved to https://phabricator.wikimedia.org/P93826 and previous config saved to /var/cache/conftool/dbconfig/20260604-031523-fceratto.json 2423522 wikitext text/x-wiki hayx6311tmq3siu9rvu51z9tax5ukhd 2423523 2423522 2026-06-04T03:25:32Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1263', diff saved to https://phabricator.wikimedia.org/P93827 and previous config saved to /var/cache/conftool/dbconfig/20260604-032531-fceratto.json 2423523 wikitext text/x-wiki 84pi3jxoet5d04h75ijiwk19du89gea 2423524 2423523 2026-06-04T03:35:40Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1263', diff saved to https://phabricator.wikimedia.org/P93828 and previous config saved to /var/cache/conftool/dbconfig/20260604-033538-fceratto.json 2423524 wikitext text/x-wiki no0lkljp5wdia55zhsfaikfoc2sj65y 2423525 2423524 2026-06-04T03:45:48Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Repooling after maintenance db1263 (T426633)', diff saved to https://phabricator.wikimedia.org/P93829 and previous config saved to /var/cache/conftool/dbconfig/20260604-034546-fceratto.json 2423525 wikitext text/x-wiki nk3y5nkm11j9i149vll9p1xy0n8cogx 2423527 2423525 2026-06-04T05:19:18Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2423527 wikitext text/x-wiki 2sdm6lsy8fqesuk7p2b6fmbmb3gkx6n 2423528 2423527 2026-06-04T05:27:26Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Set db2215 with weight 0 T428120', diff saved to https://phabricator.wikimedia.org/P93830 and previous config saved to /var/cache/conftool/dbconfig/20260604-052722-marostegui.json 2423528 wikitext text/x-wiki 7ifwon3plhghmlcid7u4vmsy2txajih 2423529 2423528 2026-06-04T05:27:33Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 16 hosts with reason: Primary switchover x1 T428120 2423529 wikitext text/x-wiki oya4hrwuurznm1uw1n2trklnhdmlgom 2423531 2423529 2026-06-04T05:44:51Z Stashbot 7414 marostegui: Starting x1 codfw failover from db2191 to db2215 - T428120 2423531 wikitext text/x-wiki jbo7p0bs6210crmnbodfwl0qczoije4 2423532 2423531 2026-06-04T05:45:31Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Promote db2215 to x1 primary T428120', diff saved to https://phabricator.wikimedia.org/P93831 and previous config saved to /var/cache/conftool/dbconfig/20260604-054528-marostegui.json 2423532 wikitext text/x-wiki rywov0pjgng7l3hr2rjc3040w9lkrm6 2423533 2423532 2026-06-04T05:46:17Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Depool db2191 T428120', diff saved to https://phabricator.wikimedia.org/P93832 and previous config saved to /var/cache/conftool/dbconfig/20260604-054614-marostegui.json 2423533 wikitext text/x-wiki jd8jypiv2jrncydwpc7ikfzsksn68dh 2423534 2423533 2026-06-04T05:48:55Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2423534 wikitext text/x-wiki nz7f21vnnxe87tpgvlkgk13qhxowtw6 2423535 2423534 2026-06-04T05:50:09Z Stashbot 7414 cwilliams@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 18 hosts with reason: Primary switchover x3 T427895 2423535 wikitext text/x-wiki ogio29il9hei0k99o93j3no4r7u5ykp 2423536 2423535 2026-06-04T05:50:16Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.major-upgrade 2423536 wikitext text/x-wiki tbpryxbsiyzqna1wzhuavhhy4bzhpqm 2423537 2423536 2026-06-04T05:50:24Z Stashbot 7414 cwilliams@cumin1003: dbctl commit (dc=all): 'Set db1258 with weight 0 T427895', diff saved to https://phabricator.wikimedia.org/P93833 and previous config saved to /var/cache/conftool/dbconfig/20260604-055021-cwilliams.json 2423537 wikitext text/x-wiki 9khf8l0pam0rei9lx4og74bb7tpuhz5 2423538 2423537 2026-06-04T05:50:26Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool db2191: Upgrading db2191.codfw.wmnet 2423538 wikitext text/x-wiki tpr0w17i90lvwv9ijhwxg7dzhxb1x43 2423539 2423538 2026-06-04T05:50:36Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2191: Upgrading db2191.codfw.wmnet 2423539 wikitext text/x-wiki e0s995e288kkpz8i4tn9v9yyedqludz 2423541 2423539 2026-06-04T05:52:04Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.reimage for host db2191.codfw.wmnet with OS trixie 2423541 wikitext text/x-wiki pa445xw2yh0x1wg38mqmfxcpmz28x11 2423545 2423541 2026-06-04T05:53:24Z Stashbot 7414 cezmunsta: Starting x3 eqiad failover from db1255 to db1258 - T427895 2423545 wikitext text/x-wiki s53zqj58n1vgwv2neyd94v7y7inxj91 2423546 2423545 2026-06-04T05:53:49Z Stashbot 7414 cwilliams@cumin1003: dbctl commit (dc=all): 'Set x3 eqiad as read-only for maintenance - T427895', diff saved to https://phabricator.wikimedia.org/P93834 and previous config saved to /var/cache/conftool/dbconfig/20260604-055346-cwilliams.json 2423546 wikitext text/x-wiki 64gbfnn7qgtg1c3xumib4y1581s77a1 2423547 2423546 2026-06-04T05:54:34Z Stashbot 7414 cwilliams@cumin1003: dbctl commit (dc=all): 'Promote db1258 to x3 primary and set section read-write T427895', diff saved to https://phabricator.wikimedia.org/P93835 and previous config saved to /var/cache/conftool/dbconfig/20260604-055429-cwilliams.json 2423547 wikitext text/x-wiki 6ugra9xxevs8ff77uzdswxhxp92lryo 2423548 2423547 2026-06-04T06:02:03Z Stashbot 7414 cwilliams@dns1004: START - running authdns-update 2423548 wikitext text/x-wiki 8xmggz31f9jzuirkpcbz3n33ag6srga 2423549 2423548 2026-06-04T06:03:28Z Stashbot 7414 cwilliams@dns1004: END - running authdns-update 2423549 wikitext text/x-wiki p0bd5tipqxzj4xhaqdivysxcakncqbx 2423550 2423549 2026-06-04T06:04:32Z Stashbot 7414 cwilliams@cumin1003: dbctl commit (dc=all): 'Depool db1255 T427895', diff saved to https://phabricator.wikimedia.org/P93836 and previous config saved to /var/cache/conftool/dbconfig/20260604-060428-cwilliams.json 2423550 wikitext text/x-wiki 8r9uhh1a7x7zkjh5o45m4b3tvl1qj4p 2423551 2423550 2026-06-04T06:11:36Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db2191.codfw.wmnet with reason: host reimage 2423551 wikitext text/x-wiki b17voxkm065uhhjrbb8x0zjk6u34h4w 2423552 2423551 2026-06-04T06:12:48Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.major-upgrade 2423552 wikitext text/x-wiki fk3x4ko2a2uq9jih35hzxb7ddw72g3g 2423553 2423552 2026-06-04T06:12:57Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.depool depool db1255: Upgrading db1255.eqiad.wmnet 2423553 wikitext text/x-wiki bjaezr8bjtkyphwuwk1lwghkbp9lb9e 2423554 2423553 2026-06-04T06:13:07Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1255: Upgrading db1255.eqiad.wmnet 2423554 wikitext text/x-wiki 4688wb8e7puv9gkhv9mejn1h9i9laq4 2423555 2423554 2026-06-04T06:15:12Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db2191.codfw.wmnet with reason: host reimage 2423555 wikitext text/x-wiki l101rjbbkcfaw2keulm0lg1g2pnscfr 2423556 2423555 2026-06-04T06:16:49Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reimage for host db1255.eqiad.wmnet with OS trixie 2423556 wikitext text/x-wiki 5ul260u50umrtl2ya6n1ga06r8ss4ru 2423557 2423556 2026-06-04T06:31:32Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1255.eqiad.wmnet with reason: host reimage 2423557 wikitext text/x-wiki pvx3cib0s959pc0vovs11im7xggbmdv 2423558 2423557 2026-06-04T06:32:42Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db2191.codfw.wmnet with OS trixie 2423558 wikitext text/x-wiki 2q2sfzz8jwgqzco9pprzcz5zp8cacjs 2423559 2423558 2026-06-04T06:35:33Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1255.eqiad.wmnet with reason: host reimage 2423559 wikitext text/x-wiki cbr7d8h2flcnrn7btb2bblpjegvet90 2423560 2423559 2026-06-04T06:38:47Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool db2191: Migration of db2191.codfw.wmnet completed 2423560 wikitext text/x-wiki beyo9x3hmdxzw88152k01yx4avllksp 2423561 2423560 2026-06-04T06:51:46Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1255.eqiad.wmnet with OS trixie 2423561 wikitext text/x-wiki ij64okioqtk3fw8bkldorr81zoa8u97 2423562 2423561 2026-06-04T06:53:48Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.pool pool db1255: Migration of db1255.eqiad.wmnet completed 2423562 wikitext text/x-wiki ex4mhcf7lpyugfd7opzwbze1zlfsqve 2423563 2423562 2026-06-04T07:03:32Z Stashbot 7414 otto@deploy1003: otto: Rolling back deployment 2423563 wikitext text/x-wiki 2i82bvyolu558wpt07b2vhqaxopfj1n 2423564 2423563 2026-06-04T07:04:06Z Stashbot 7414 otto@deploy1003: Finished scap sync-world: Backport for [[gerrit:1297260|EventStreamConfig - webrequest.dumps.dev0 - enable canary events for hive ingestion (T425087)]] (duration: 399m 30s) 2423564 wikitext text/x-wiki 9ybbq2iqodmvclakr5dqhjebw2g8z1f 2423565 2423564 2026-06-04T07:06:11Z Stashbot 7414 kharlan@deploy1003: Started scap sync-world: Backport for [[gerrit:1297550|Revert "EventStreamConfig - webrequest.dumps.dev0 - enable canary events for hive ingestion"]] 2423565 wikitext text/x-wiki hlm3jc1jajrxsbi2x0sdxqpip7bg9i1 2423566 2423565 2026-06-04T07:08:19Z Stashbot 7414 kharlan@deploy1003: kharlan: Backport for [[gerrit:1297550|Revert "EventStreamConfig - webrequest.dumps.dev0 - enable canary events for hive ingestion"]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2423566 wikitext text/x-wiki pkw83f9oowuzefpn0hdrpn611bno96h 2423567 2423566 2026-06-04T07:08:46Z Stashbot 7414 kharlan@deploy1003: kharlan: Continuing with deployment 2423567 wikitext text/x-wiki 2uooysvgdaqye01ouj2udbd5szd5cpf 2423568 2423567 2026-06-04T07:12:57Z Stashbot 7414 kharlan@deploy1003: Finished scap sync-world: Backport for [[gerrit:1297550|Revert "EventStreamConfig - webrequest.dumps.dev0 - enable canary events for hive ingestion"]] (duration: 06m 45s) 2423568 wikitext text/x-wiki fycqx0jacyo6yimb1nnfnrta73lua5h 2423569 2423568 2026-06-04T07:24:18Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2191: Migration of db2191.codfw.wmnet completed 2423569 wikitext text/x-wiki lpspvo8qus4fub6mks2l5xdnmax0t5p 2423570 2423569 2026-06-04T07:24:20Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2423570 wikitext text/x-wiki oyw4ahxqfrt6iytmn2s9rctgc8s3buu 2423571 2423570 2026-06-04T07:25:15Z Stashbot 7414 kharlan@deploy1003: Started scap sync-world: Backport for [[gerrit:1297536|hCaptcha risk scores: VE plugin to collect risk scores for block notices (T426943)]], [[gerrit:1297200|hCaptcha: Render a fresh mobile widget for each captcha attempt (T425929)]], [[gerrit:1297173|hCaptcha: Enable risk-score collection for users blocked by IP blocks (T424629)]] 2423571 wikitext text/x-wiki 34g6sw2ygquf56s3mxfvdxh3tup874p 2423572 2423571 2026-06-04T07:27:17Z Stashbot 7414 kharlan@deploy1003: kharlan, harroyo-wmf: Backport for [[gerrit:1297536|hCaptcha risk scores: VE plugin to collect risk scores for block notices (T426943)]], [[gerrit:1297200|hCaptcha: Render a fresh mobile widget for each captcha attempt (T425929)]], [[gerrit:1297173|hCaptcha: Enable risk-score collection for users blocked by IP blocks (T424629)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwd 2423572 wikitext text/x-wiki cd0km09vnkukk3fbhbizgaaie7cd95s 2423573 2423572 2026-06-04T07:29:58Z Stashbot 7414 kharlan@deploy1003: kharlan, harroyo-wmf: Continuing with deployment 2423573 wikitext text/x-wiki fs5w7z3zvy3j9mdaseuef50xtax0qzh 2423574 2423573 2026-06-04T07:34:11Z Stashbot 7414 kharlan@deploy1003: Finished scap sync-world: Backport for [[gerrit:1297536|hCaptcha risk scores: VE plugin to collect risk scores for block notices (T426943)]], [[gerrit:1297200|hCaptcha: Render a fresh mobile widget for each captcha attempt (T425929)]], [[gerrit:1297173|hCaptcha: Enable risk-score collection for users blocked by IP blocks (T424629)]] (duration: 08m 56s) 2423574 wikitext text/x-wiki iaxjo0dg7ck69alcf4xaykeaamsz91i 2423575 2423574 2026-06-04T07:39:18Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1255: Migration of db1255.eqiad.wmnet completed 2423575 wikitext text/x-wiki 4uai8dcaaz9tefwakx30s9oarlcv5og 2423576 2423575 2026-06-04T07:39:20Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2423576 wikitext text/x-wiki sxn92h9jxgyyb45jqjrlsul8arv1wae 2423577 2423576 2026-06-04T07:41:40Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.major-upgrade 2423577 wikitext text/x-wiki 2sb6rctrbvb2dclery8dbvsjuv1f7tt 2423578 2423577 2026-06-04T07:41:59Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool db1224: Upgrading db1224.eqiad.wmnet 2423578 wikitext text/x-wiki nuz7c1nhn0q98vrbi76zndpk51xcctc 2423579 2423578 2026-06-04T07:42:20Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1224: Upgrading db1224.eqiad.wmnet 2423579 wikitext text/x-wiki p0qpkxhdeld7nez2lxpisx9vutd7u99 2423580 2423579 2026-06-04T07:43:02Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.reimage for host db1224.eqiad.wmnet with OS trixie 2423580 wikitext text/x-wiki 7zk33vmuxv4vh917f554caiano3f6ox 2423581 2423580 2026-06-04T07:53:48Z Stashbot 7414 marostegui: Install mariadb 10.11.17 on db2249 T427345 2423581 wikitext text/x-wiki fmt82atvgc8y0t4zc71z49qiqltmp8n 2423582 2423581 2026-06-04T08:00:08Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1224.eqiad.wmnet with reason: host reimage 2423582 wikitext text/x-wiki 261atwjceo6b5logmdur4olgib1ue7h 2423583 2423582 2026-06-04T08:02:52Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db2249.codfw.wmnet with reason: upgrade 2423583 wikitext text/x-wiki r0mk7i8y74qw2xroxepqbh59r6p8wlk 2423584 2423583 2026-06-04T08:04:18Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1224.eqiad.wmnet with reason: host reimage 2423584 wikitext text/x-wiki 67joukfpfxrhe358pc1tpgym8go09wq 2423585 2423584 2026-06-04T08:21:01Z Stashbot 7414 daniel@deploy1003: helmfile [staging] START helmfile.d/services/rest-gateway: apply 2423585 wikitext text/x-wiki l57bthn07ksvfcxd66z5hnlpvb1sbi6 2423586 2423585 2026-06-04T08:21:03Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1224.eqiad.wmnet with OS trixie 2423586 wikitext text/x-wiki 8813phz3tjnzneo7ktf521bzvq3a3ko 2423587 2423586 2026-06-04T08:21:41Z Stashbot 7414 daniel@deploy1003: helmfile [staging] DONE helmfile.d/services/rest-gateway: apply 2423587 wikitext text/x-wiki 22ur7lm1k83aqucur9nes4uozvqxuj5 2423588 2423587 2026-06-04T08:24:20Z Stashbot 7414 daniel@deploy1003: helmfile [staging] START helmfile.d/services/rest-gateway: apply 2423588 wikitext text/x-wiki ivx0xu5rsefwqci1l661fs999dh97e0 2423589 2423588 2026-06-04T08:24:33Z Stashbot 7414 daniel@deploy1003: helmfile [staging] DONE helmfile.d/services/rest-gateway: apply 2423589 wikitext text/x-wiki mq9xoty4hoex433qsu0guzemdaf7p0h 2423590 2423589 2026-06-04T08:29:01Z Stashbot 7414 daniel@deploy1003: helmfile [staging] START helmfile.d/services/rest-gateway: apply 2423590 wikitext text/x-wiki 1g3nb788r2vbosq6diio6af8bc1tz0q 2423591 2423590 2026-06-04T08:29:46Z Stashbot 7414 daniel@deploy1003: helmfile [staging] DONE helmfile.d/services/rest-gateway: apply 2423591 wikitext text/x-wiki ajomqqargpdk311qg6plm2omu91k515 2423593 2423591 2026-06-04T08:53:09Z Stashbot 7414 oblivian@cumin1003: START - Cookbook sre.deploy.hiddenparma Hiddenparma deployment to the alerting hosts with reason: "Introduce pluggable authentication - oblivian@cumin1003" 2423593 wikitext text/x-wiki be2lypvalek8wkwk9wqk58k16eouf8t 2423594 2423593 2026-06-04T08:53:11Z Stashbot 7414 oblivian@cumin1003: START - Cookbook sre.deploy.python-code hiddenparma to alert[1002,2002].wikimedia.org with reason: Introduce pluggable authentication - oblivian@cumin1003 2423594 wikitext text/x-wiki 8axahco14jmkpds2x9n3vme657zvs5m 2423595 2423594 2026-06-04T08:53:46Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool db1224: Migration of db1224.eqiad.wmnet completed 2423595 wikitext text/x-wiki 500kkvpgdd2ida12ojebtq0tcwmzov5 2423596 2423595 2026-06-04T08:54:05Z Stashbot 7414 oblivian@cumin1003: END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) hiddenparma to alert[1002,2002].wikimedia.org with reason: Introduce pluggable authentication - oblivian@cumin1003 2423596 wikitext text/x-wiki 3x716tjjflk60q2y5rqifrylm5dq1r4 2423597 2423596 2026-06-04T08:54:07Z Stashbot 7414 oblivian@cumin1003: END (PASS) - Cookbook sre.deploy.hiddenparma (exit_code=0) Hiddenparma deployment to the alerting hosts with reason: "Introduce pluggable authentication - oblivian@cumin1003" 2423597 wikitext text/x-wiki hgi5q2bvz7m2epiwl8l9w4f2ag2drxr 2423602 2423597 2026-06-04T09:25:56Z Stashbot 7414 Dreamy_Jazz: Running `/usr/local/bin/foreachwikiindblist "group0.dblist + group1.dblist - mediamoderation-continuous-scan.dblist" extensions/MediaModeration/maintenance/scanFilesInScanTable.php --use-jobqueue --sleep=1 --poll-sleep=10 --verbose` 2423602 wikitext text/x-wiki nmhz7vffrey2ivc55wollcjdox4iltj 2423603 2423602 2026-06-04T09:26:20Z Stashbot 7414 Dreamy_Jazz: Running `mwscript-k8s extensions/MediaModeration/maintenance/scanFilesInScanTable.php --wiki="commonswiki" --use-jobqueue --poll-sleep=30 --sleep=60 --verbose` 2423603 wikitext text/x-wiki d08k97w6bun069zb84nqdkbc1c21hdj 2423604 2423603 2026-06-04T09:31:43Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.major-upgrade 2423604 wikitext text/x-wiki 54hern9a6tz3ih8r60doit9ho7rvs9a 2423605 2423604 2026-06-04T09:32:06Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool es2057: Upgrading es2057.codfw.wmnet 2423605 wikitext text/x-wiki eocwsna2beu36rh4fpumzj1ismqr41v 2423606 2423605 2026-06-04T09:32:26Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es2057: Upgrading es2057.codfw.wmnet 2423606 wikitext text/x-wiki 0sf7bioxouwr52ft99mdk7u811stcpf 2423607 2423606 2026-06-04T09:33:08Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.reimage for host es2057.codfw.wmnet with OS trixie 2423607 wikitext text/x-wiki 78ixo7u4g07stjoev3ad3347ntk05vi 2423608 2423607 2026-06-04T09:35:35Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/kafka-ui: apply 2423608 wikitext text/x-wiki mokrr8fta33f1fleohoxyyl8qofad9g 2423609 2423608 2026-06-04T09:36:01Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/kafka-ui: apply 2423609 wikitext text/x-wiki cfab2fsssj21wg5j59f9ez3mng7f609 2423610 2423609 2026-06-04T09:37:56Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/dse-k8s-services/kafka-ui: apply 2423610 wikitext text/x-wiki askv1cuu97bs7z9cakqthmyl2ulhnqw 2423611 2423610 2026-06-04T09:38:18Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/dse-k8s-services/kafka-ui: apply 2423611 wikitext text/x-wiki pyy114vnihfjcpxxijnoxw3est65vyo 2423612 2423611 2026-06-04T09:39:17Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1224: Migration of db1224.eqiad.wmnet completed 2423612 wikitext text/x-wiki rasw1i5r07lysa7h7ykqtr71sioi5s7 2423613 2423612 2026-06-04T09:39:19Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2423613 wikitext text/x-wiki fr2jrs7hnkpqqoa4rdanhpjgbup0lih 2423614 2423613 2026-06-04T09:49:35Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on es2057.codfw.wmnet with reason: host reimage 2423614 wikitext text/x-wiki jueipeedx163685ukopxedxl1son059 2423615 2423614 2026-06-04T09:53:50Z Stashbot 7414 ozge@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . 2423615 wikitext text/x-wiki t7ukv2147ko46mn3yuhmxmnzovl4o3q 2423616 2423615 2026-06-04T09:54:07Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es2057.codfw.wmnet with reason: host reimage 2423616 wikitext text/x-wiki 27c9gaidqi25l5ojta2kvxubiaayjz6 2423617 2423616 2026-06-04T09:56:55Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.major-upgrade 2423617 wikitext text/x-wiki 5f6mwjhadj55mbww5mrfzfb9xrkei3d 2423618 2423617 2026-06-04T09:57:15Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool db1179: Upgrading db1179.eqiad.wmnet 2423618 wikitext text/x-wiki 2ivv3i3s7fujtsblceg6ovhsgql2hw5 2423619 2423618 2026-06-04T09:58:12Z Stashbot 7414 jynus: redoing m2 backups after grant change T411111 2423619 wikitext text/x-wiki be6kliph8lob9hd2f39u6h7yxbfhfwo 2423620 2423619 2026-06-04T09:58:26Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1179: Upgrading db1179.eqiad.wmnet 2423620 wikitext text/x-wiki 84tgfbtw3v73zruwbnw1dsmhmy5sdot 2423621 2423620 2026-06-04T09:59:18Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.reimage for host db1179.eqiad.wmnet with OS trixie 2423621 wikitext text/x-wiki 5f9xq1sqr061ewlwbfzb4a3srdc6pdd 2423623 2423621 2026-06-04T10:11:29Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es2057.codfw.wmnet with OS trixie 2423623 wikitext text/x-wiki kj920apm8votz9ybjqczjdqpe0xcis1 2423624 2423623 2026-06-04T10:13:24Z Stashbot 7414 marostegui@cumin1003: END (FAIL) - Cookbook sre.mysql.major-upgrade (exit_code=99) 2423624 wikitext text/x-wiki q60ikmeqm1j4yi41sf4dp42vcwt3t80 2423625 2423624 2026-06-04T10:13:44Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool es2057: repool after upgrade 2423625 wikitext text/x-wiki ctdg537noreepdpkn21ajebfgkz1jk3 2423626 2423625 2026-06-04T10:15:09Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on db1179.eqiad.wmnet with reason: host reimage 2423626 wikitext text/x-wiki gcigb7xojr6b2rdaltqm16pwqfv0su3 2423627 2423626 2026-06-04T10:15:36Z Stashbot 7414 jgiannelos@deploy1003: helmfile [staging] START helmfile.d/services/kartotherian: apply 2423627 wikitext text/x-wiki l8bbt748ru9yyyxjkmxodgc6yqpzry9 2423628 2423627 2026-06-04T10:15:44Z Stashbot 7414 jgiannelos@deploy1003: helmfile [staging] DONE helmfile.d/services/kartotherian: apply 2423628 wikitext text/x-wiki h5ubbry5vjpq9xdthnjdk4isvli45tc 2423629 2423628 2026-06-04T10:15:52Z Stashbot 7414 jgiannelos@deploy1003: helmfile [staging] START helmfile.d/services/tegola-vector-tiles: apply 2423629 wikitext text/x-wiki tuhd6kl902jbi9jjtz1y5xc9ss4buj1 2423630 2423629 2026-06-04T10:16:24Z Stashbot 7414 jgiannelos@deploy1003: helmfile [staging] DONE helmfile.d/services/tegola-vector-tiles: apply 2423630 wikitext text/x-wiki hqudu8wmejdowx41pwqzgqul6n2lpre 2423631 2423630 2026-06-04T10:19:47Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on db1179.eqiad.wmnet with reason: host reimage 2423631 wikitext text/x-wiki 1hbyf0wkr32kb2c50fhy9m2kxgygfge 2423632 2423631 2026-06-04T10:38:04Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1179.eqiad.wmnet with OS trixie 2423632 wikitext text/x-wiki 1d9rma84e3fpvjot28mx3eofzy9b8bq 2423633 2423632 2026-06-04T10:46:44Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool db1179: Migration of db1179.eqiad.wmnet completed 2423633 wikitext text/x-wiki 1avrgznt84i41my0ka5jaxiqnb1suw1 2423635 2423633 2026-06-04T10:55:14Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.dns.netbox 2423635 wikitext text/x-wiki pvi4hr2i42wfh0qlm4ko78t04ky16f0 2423636 2423635 2026-06-04T10:58:11Z Stashbot 7414 cmooney@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2423636 wikitext text/x-wiki k6dme3g3j6l9lenl56yhhwybqa77yge 2423637 2423636 2026-06-04T10:59:09Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool es2057: repool after upgrade 2423637 wikitext text/x-wiki qxvaqxiybackqdxeu4fjuy60t16dpd5 2423638 2423637 2026-06-04T10:59:21Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.major-upgrade 2423638 wikitext text/x-wiki cpsm07z74m7n86u8ajh5tccf78k5y15 2423639 2423638 2026-06-04T10:59:42Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool es2050: Upgrading es2050.codfw.wmnet 2423639 wikitext text/x-wiki 95cvpeuquftdfw58ik16vqgdnz5cg4z 2423640 2423639 2026-06-04T11:00:03Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool es2050: Upgrading es2050.codfw.wmnet 2423640 wikitext text/x-wiki g42mlnwfhjgr9yk0zilukwfpnwdewjw 2423641 2423640 2026-06-04T11:00:50Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.reimage for host es2050.codfw.wmnet with OS trixie 2423641 wikitext text/x-wiki mvrsmxgq29ygskd5rhkornll6v6d61h 2423642 2423641 2026-06-04T11:16:37Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on es2050.codfw.wmnet with reason: host reimage 2423642 wikitext text/x-wiki ma63hyw0yxcq9lmyjl22jashbdlc50y 2423645 2423642 2026-06-04T11:23:43Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on es2050.codfw.wmnet with reason: host reimage 2423645 wikitext text/x-wiki tnwmp66369s5y897z0uslxpjx5l5ziz 2423646 2423645 2026-06-04T11:32:13Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1179: Migration of db1179.eqiad.wmnet completed 2423646 wikitext text/x-wiki 44zgr2so4z9dgplw6qts2bvfa2opn28 2423647 2423646 2026-06-04T11:32:15Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) 2423647 wikitext text/x-wiki sxbgdrfls75yov2kzxs8sbfggjsdtzi 2423649 2423647 2026-06-04T11:37:00Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.major-upgrade 2423649 wikitext text/x-wiki lhucycpmi8yrmk1x0vo7rmyyufw1szz 2423650 2423649 2026-06-04T11:37:21Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.depool depool db1220: Upgrading db1220.eqiad.wmnet 2423650 wikitext text/x-wiki oy5thvezimwrz04zobapufbplb2xc6d 2423651 2423650 2026-06-04T11:40:12Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db1220: Upgrading db1220.eqiad.wmnet 2423651 wikitext text/x-wiki sd6gxqrsuedv32vtynrbl4hcmfztsqw 2423652 2423651 2026-06-04T11:40:48Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host es2050.codfw.wmnet with OS trixie 2423652 wikitext text/x-wiki 3bc9tl0ykdzrczx0eqcaxaw7b60h8xy 2423653 2423652 2026-06-04T11:42:16Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.reimage for host db1220.eqiad.wmnet with OS trixie 2423653 wikitext text/x-wiki h4e24fc9lh8te96gn2xe90srocel534 0 8495 2423377 2422801 2026-06-03T17:19:04Z BCornwall-WMF 31521 /* X-Image-Generator */ Reformat examples to conform to all other sections of the same type; Move "see" to a see template up top 2423377 wikitext text/x-wiki 6zdir14er6djrxjxfe51hdqb2p0q47o 0 11689 2423298 2411844 2026-06-03T15:53:32Z BTullis (WMF) 25295 Added information about 'sudo -E kafka' being a requirement for the most recent version. 2423298 wikitext text/x-wiki aljyyrhhek20rojzdsfpflgmcv73ecm 0 14218 2423654 2408052 2026-06-04T11:45:00Z Jynus 38174 +backup1-* sections 2423654 wikitext text/x-wiki d4xju2c2c0sjm8fwmq81sj617g056x3 0 17290 2423144 2422873 2026-06-03T12:54:58Z Stashbot 7414 James_F: Zuul: Add Rae 5e as a trusted user 2423144 wikitext text/x-wiki rhkeijsvaegzezwgwhejgek5b5pbedi 2423206 2423144 2026-06-03T14:19:48Z Stashbot 7414 jnuche: Updating development images on contint primary for https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/107 2423206 wikitext text/x-wiki pyawt82ovesh1bhpdyvzy4la9ye184d 2423592 2423206 2026-06-04T08:35:43Z Stashbot 7414 hashar: Built Docker images `docker-registry.wikimedia.org/releng/java21:0.1` and `docker-registry.wikimedia.org/releng/maven-java21:0.1` # T412978 2423592 wikitext text/x-wiki 4yhsodynevjhs3v9cdhl14jrkvr2qtk 0 199474 2423655 2367783 2026-06-04T11:54:34Z Jynus 38174 +backup1-* sections 2423655 wikitext text/x-wiki 11r7udmd49fn0mbakpqr5btib4lqyg0 2423656 2423655 2026-06-04T11:55:47Z Jynus 38174 4->7 2423656 wikitext text/x-wiki bwh2igf6qoaosxsj3hp8xsvfxez19tk 2423657 2423656 2026-06-04T11:58:09Z Jynus 38174 /* m2 */ 2423657 wikitext text/x-wiki n7jlufc2w28t2h2msjh853nkr0xbps7 0 441095 2423222 2422986 2026-06-03T14:27:43Z AYounsi (WMF) 10040 CertAlmostExpired 2423222 wikitext text/x-wiki nibzy7an83lkb9dy63tvvimjgttygo7 0 442952 2423229 2423003 2026-06-03T14:36:44Z FNegri-WMF 32595 Add missing value in my column 2423229 wikitext text/x-wiki 6jstgh39zn1ls8x1ke1etcmeqjcpf0z 498 443946 2423400 2421308 2026-06-03T17:56:12Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: deployed fd3d67655e (bump mwoauth2) 2423400 wikitext text/x-wiki hti3wv4u4vc1l5yjsmw9tk52bepi6zd 12 446459 2423323 2403110 2026-06-03T16:44:13Z FNegri-WMF 32595 Remove utf8 workarounds that are no longer required with the current version of MariaDB 2423323 wikitext text/x-wiki 1hpilizvw4x79cj8nsty153t1dgjhu3 0 447352 2423111 2423058 2026-06-03T12:11:07Z Effie Mouzeli (WMF) 12880 2423111 wikitext text/x-wiki slk0cq30akgxvwsiuy6ozu7jxraiex0 0 449160 2423110 2422856 2026-06-03T12:09:15Z Dexbot 30554 Bot: Updating the report 2423110 wikitext text/x-wiki fxzuhcnluy10ekihzma2zvyzbcqukro 2423402 2423110 2026-06-03T17:58:05Z Dexbot 30554 Bot: Updating the report 2423402 wikitext text/x-wiki dkvr2sxd20o2btdzbmfc1q28im9vaoo 2423487 2423402 2026-06-04T00:01:58Z Dexbot 30554 Bot: Updating the report 2423487 wikitext text/x-wiki 3g0rgybd5qt1kqmeeh5o8dsm7juk0hf 2423496 2423487 2026-06-04T00:29:03Z Dexbot 30554 Bot: Updating the report 2423496 wikitext text/x-wiki hx9yuc2j8byg4fnpqk9442r6o1e722g 2423530 2423496 2026-06-04T05:29:43Z Dexbot 30554 Bot: Updating the report 2423530 wikitext text/x-wiki cghcegmyk16q9hr5tky26tt3rtj5ow0 2423540 2423530 2026-06-04T05:50:48Z Dexbot 30554 Bot: Updating the report 2423540 wikitext text/x-wiki cbozuc90t59q6amz4s2u6gzfcc2ve1y 0 451075 2423115 2417233 2026-06-03T12:14:29Z DAdedoyin (WMF) 39150 /* Historical */ 2423115 wikitext text/x-wiki 6hquptfyk3esdp8rcl4twghoxcec854 2423116 2423115 2026-06-03T12:15:09Z DAdedoyin (WMF) 39150 /* Current */ 2423116 wikitext text/x-wiki 8srs4cug9v74sam8hs78njxvovr90bs 116 453906 2423253 2422747 2026-06-03T15:00:48Z Gitlabaccountapprovalbot 37332 @anafibnshahibul was approved. 2423253 wikitext text/x-wiki 28894m9ovye7lo5rk8exbo7e81z7ka5 2 456009 2423601 2239057 2026-06-04T09:22:07Z Dexbot 30554 Bot: Bot: Fixing double redirect to [[CDN/Headers]] 2423601 wikitext text/x-wiki bvki1dzlou6l5fr275efrmbr4dvv228 0 459194 2423286 2423051 2026-06-03T15:42:36Z BryanDavis 1604 [[Template:See also]] for hatnote; lede formatting 2423286 wikitext text/x-wiki c9a78jdz6kg8wu82fx2rq4692l68l6w 498 459244 2423126 2421542 2026-06-03T12:34:05Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/26884839872 (https://github.com/cluebotng/component-configs/commits/cc341cdd381588d285ccbc586ab019ece652d3ce) 2423126 wikitext text/x-wiki iro2nb8cgptmoulv6gbdau1izbz6t81 2423131 2423126 2026-06-03T12:37:11Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/26884858620 (https://github.com/cluebotng/component-configs/commits/1e9d162538309d31e45226e93b81f9d80dae9303) 2423131 wikitext text/x-wiki hade7u3exrkeaq7sg1fq1waenetobs5 498 459255 2423125 2421536 2026-06-03T12:33:53Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/26884858556 (https://github.com/cluebotng/component-configs/commits/1e9d162538309d31e45226e93b81f9d80dae9303) 2423125 wikitext text/x-wiki g4aqnum4vycjdtf6luqt1u11u6cetgz 0 459599 2423599 2369572 2026-06-04T09:22:05Z Dexbot 30554 Bot: Bot: Fixing double redirect to [[Event Platform/Producing events]] 2423599 wikitext text/x-wiki rmz2fbu0t3snw1uk63ufkpe09i4mtah 1 459600 2423600 2369574 2026-06-04T09:22:06Z Dexbot 30554 Bot: Bot: Fixing double redirect to [[Talk:Event Platform/Producing events]] 2423600 wikitext text/x-wiki cszsh3e6n78k8kb8rk0yz9r0e4o2k7e 0 459699 2423118 2422792 2026-06-03T12:17:53Z Stashbot 7414 jgleeson: SmashPig upgraded from 166abfbd to 99233b18 2423118 wikitext text/x-wiki 2bw41m4nao6e8eqlcba30r1jbikv477 2423648 2423118 2026-06-04T11:32:54Z Stashbot 7414 jgleeson: payments-wiki upgraded from 3bc70a73 to aef3d25d 2423648 wikitext text/x-wiki 8si98u905ar0ojyjryh0p5w85vjdilq 0 459706 2423598 2377211 2026-06-04T09:22:04Z Dexbot 30554 Bot: Bot: Fixing double redirect to [[Sitemap access]] 2423598 wikitext text/x-wiki a44nfcjn5gk4zscbgosdh16ydf5t1au 2 460101 2423296 2420645 2026-06-03T15:52:24Z Effie Mouzeli (WMF) 12880 2423296 sanitized-css text/css 7c1aqs6x7lvs1k61bn0fyuilnjjidr4 0 460178 2423295 2420642 2026-06-03T15:50:41Z Effie Mouzeli (WMF) 12880 2423295 wikitext text/x-wiki e9brdwx7nix3958os0wb3zt6m67n29b 2423320 2423295 2026-06-03T16:42:28Z Effie Mouzeli (WMF) 12880 2423320 wikitext text/x-wiki q6i9be0kc01izie8ddr5tf2e2c0xxhw 2423634 2423320 2026-06-04T10:54:39Z Effie Mouzeli (WMF) 12880 scrollbot update 2423634 wikitext text/x-wiki e52v7gv8xldwhyydwjgm2reu1rhw4kt 2423643 2423634 2026-06-04T11:17:09Z Effie Mouzeli (WMF) 12880 2423643 wikitext text/x-wiki ph034vgo5a6rp2qljw96kfdnicfn4kn 0 460233 2423440 2421986 2026-06-03T20:23:07Z MPopov (WMF) 5891 /* Defining a new metric */ Choosing Value of Ratio type metrics 2423440 wikitext text/x-wiki evpd2l2b7e5xsjijeas809ehoog9n1h 2423464 2423440 2026-06-03T22:29:50Z MPopov (WMF) 5891 /* Example: funnel metrics */ 2423464 wikitext text/x-wiki azepwsk9hxi3ve1prnhs7kym5b3vtjp 0 460280 2423281 2423049 2026-06-03T15:40:15Z BryanDavis 1604 BryanDavis moved page [[Portal:Toolforge/Sustainability Scoring Framework Proposal/Initial Assessment]] to [[Portal:Toolforge/Sustainability Scoring Framework Proposal/Initial assessment]]: Sentence case 2423049 wikitext text/x-wiki roniythw6nlw6nwvzil7w3ciylmzn6b 0 460281 2423282 2026-06-03T15:40:15Z BryanDavis 1604 BryanDavis moved page [[Portal:Toolforge/Sustainability Scoring Framework Proposal/Initial Assessment]] to [[Portal:Toolforge/Sustainability Scoring Framework Proposal/Initial assessment]]: Sentence case 2423282 wikitext text/x-wiki mnmpc1ge1sja5uj6lameudj8gd5o7rp 10 460282 2423289 2026-06-03T15:47:31Z Effie Mouzeli (WMF) 12880 Effie Mouzeli (WMF) created the page [[Template:SCROLL/css/styles.css]] using a non-default content model "Sanitized CSS": need it for scroll 2423289 sanitized-css text/css phoiac9h4m842xq45sp7s6u21eteeq1 2423291 2423289 2026-06-03T15:48:57Z Effie Mouzeli (WMF) 12880 2423291 sanitized-css text/css q460p1k5fb7e8ej43k49w2uieffk5yd 2423293 2423291 2026-06-03T15:49:11Z Effie Mouzeli (WMF) 12880 Protected "[[Template:SCROLL/css/styles.css]]" ([Edit=Allow only autoconfirmed users] (indefinite) [Move=Allow only autoconfirmed users] (indefinite)) 2423291 sanitized-css text/css q460p1k5fb7e8ej43k49w2uieffk5yd 2 460284 2423622 2026-06-04T10:10:26Z Just a random guy on the internet 56207 Created page with "html { overscroll-behavior: none; } #column-one { margin-top: .8em; } #sidebar .pBody { border-left: none; }" 2423622 css text/css 7nc35lwjliltrqikcqlf83ee2lslw9e