Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.2 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk Nova Resource:Tools/SAL 498 3086 2414466 2414306 2026-05-18T10:09:06Z Stashbot 7414 fnegri@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component builds-api (T423417) 2414466 wikitext text/x-wiki kyoc8kw24kgb1w5s3nwjphz8sbbu0mf 2414471 2414466 2026-05-18T10:16:09Z Stashbot 7414 fnegri@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api (T423417) 2414471 wikitext text/x-wiki s5zj7fqq8ncv2e7sv2al5przawizzx2 Deployments 0 4108 2414365 2414338 2026-05-18T07:06:20Z ScheduleDeploymentBot 37566 Add [[gerrit:1287288]] to Monday, May 18 UTC morning backport window 2414365 wikitext text/x-wiki lkq6a3ngfrxkro9y3ju8st438h024zt 2414438 2414365 2026-05-18T09:40:42Z ScheduleDeploymentBot 37566 Add [[gerrit:1288487]] to Monday, May 18 UTC afternoon backport window 2414438 wikitext text/x-wiki nak8hp9gihdnn1dgv92wwuz1vu1nd6z 2414493 2414438 2026-05-18T10:39:55Z ScheduleDeploymentBot 37566 Add [[gerrit:1288504]] to Monday, May 18 UTC afternoon backport window 2414493 wikitext text/x-wiki 2nugsq90ogye0bx6qba1wpbigta7lea 2414603 2414493 2026-05-18T11:55:40Z ScheduleDeploymentBot 37566 Add [[gerrit:1288494]] to Monday, May 18 UTC afternoon backport window 2414603 wikitext text/x-wiki 5rnrulf8yt8neo3eea8h9z5ulqmu161 Help talk:Toolforge 13 6411 2414346 2160122 2026-05-17T18:51:10Z Abinalpians11 55681 2414346 wikitext text/x-wiki mnbppvywh2h3nltbrr657jdrtuccjzw 2414358 2414346 2026-05-18T06:49:56Z JJMC89 7474 Reverted edit by [[Special:Contributions/Abinalpians11|Abinalpians11]] ([[User talk:Abinalpians11|talk]]) to last revision by [[User:MABot|MABot]] 2160122 wikitext text/x-wiki st60firinxne5mz69f19p3icyu8d9uu Nova Resource:Toolsbeta/SAL 498 6726 2414401 2413925 2026-05-18T09:07:00Z Stashbot 7414 fnegri@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component builds-api (T423417) 2414401 wikitext text/x-wiki m2bt4gr5nq809pytkly6rgozhdbpxsz 2414414 2414401 2026-05-18T09:11:11Z Stashbot 7414 fnegri@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component builds-api (T423417) 2414414 wikitext text/x-wiki r3lnoui1ds6dt1xzqbqomc7n0si5eqj Server Admin Log 0 7919 2414350 2414305 2026-05-18T05:08:51Z Stashbot 7414 marostegui@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on pc[2014,2024].codfw.wmnet,pc1014.eqiad.wmnet with reason: Maintenance on pc4 2414350 wikitext text/x-wiki g4hf2npeokv30jlzbbn589ph8srti1z 2414351 2414350 2026-05-18T05:12:00Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.parsercache 2414351 wikitext text/x-wiki bqow0i2wjo5uajs2a8qgtc4fvld1oh7 2414352 2414351 2026-05-18T05:12:13Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.parsercache (exit_code=0) 2414352 wikitext text/x-wiki t2242t6arsqac9exnt7ec9f3310165i 2414353 2414352 2026-05-18T05:14:40Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.parsercache 2414353 wikitext text/x-wiki otwwin5h5p761q8ojf5kxgyaide6vkw 2414354 2414353 2026-05-18T05:14:41Z Stashbot 7414 marostegui@cumin1003: END (FAIL) - Cookbook sre.mysql.parsercache (exit_code=99) 2414354 wikitext text/x-wiki 1s46juttxbp5jw4hvjj70huwhkv3rw7 2414355 2414354 2026-05-18T06:33:04Z Stashbot 7414 moritzm: installing Linux 6.12.88 on trixie hosts 2414355 wikitext text/x-wiki 1nkqgk174ddmx1dhb6edul25y1o4dq4 2414356 2414355 2026-05-18T06:44:24Z Stashbot 7414 moritzm: installing openssl bugfix updates from trixie point release 2414356 wikitext text/x-wiki borqfbjuyn660ypstpxm0blg0ullppp 2414357 2414356 2026-05-18T06:49:40Z Stashbot 7414 moritzm: installing glibc bugfix updates from trixie point release 2414357 wikitext text/x-wiki j2l2x193e9fhdkyqsqlwukfe441q0e5 2414360 2414357 2026-05-18T06:54:22Z Stashbot 7414 moritzm: installing Linux 6.1.172 on bookworm hosts 2414360 wikitext text/x-wiki mpom3699kdu8islv9zdz4i4spfh2vvx 2414361 2414360 2026-05-18T06:57:02Z Stashbot 7414 slyngshede@cumin1003: DONE (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Kgraessle out of all services on: 2468 hosts 2414361 wikitext text/x-wiki 5w8q4owcorqa8ns43h0tvk2uo5ale21 2414362 2414361 2026-05-18T06:59:17Z Stashbot 7414 moritzm: installing systemd bugfix updates from trixie point release 2414362 wikitext text/x-wiki i2pf8aptshzzl8duru6ptvp67bkl1rb 2414363 2414362 2026-05-18T07:03:25Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Remove pc2013 from dbctl T426555', diff saved to https://phabricator.wikimedia.org/P92557 and previous config saved to /var/cache/conftool/dbconfig/20260518-070322-marostegui.json 2414363 wikitext text/x-wiki dmbqaozy2gz9qo6g3y5scyela7kok4y 2414364 2414363 2026-05-18T07:04:57Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.hosts.decommission for hosts pc2013.codfw.wmnet 2414364 wikitext text/x-wiki ma48kf1bxpguxv51my7mwd0h09h7fih 2414366 2414364 2026-05-18T07:09:41Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.dns.netbox 2414366 wikitext text/x-wiki 495zhs95x7loamio9mudgn069krqpxw 2414367 2414366 2026-05-18T07:14:28Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: pc2013.codfw.wmnet decommissioned, removing all IPs except the asset tag one - marostegui@cumin1003" 2414367 wikitext text/x-wiki k8tn63q0ihrzg0bs15rvx0s7ye4e8lk 2414368 2414367 2026-05-18T07:14:56Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: pc2013.codfw.wmnet decommissioned, removing all IPs except the asset tag one - marostegui@cumin1003" 2414368 wikitext text/x-wiki ovyf2zhoc48iftst55d557i5lov7kyu 2414369 2414368 2026-05-18T07:14:58Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2414369 wikitext text/x-wiki 100r07bp0s42y77mkj7c6zrlba59rmh 2414370 2414369 2026-05-18T07:15:00Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts pc2013.codfw.wmnet 2414370 wikitext text/x-wiki fs71776s7r54pwtj8w7ud6z8rej6x0k 2414371 2414370 2026-05-18T07:25:51Z Stashbot 7414 godog: clean up space on cloudcumin1001: apt archives and older kernels 2414371 wikitext text/x-wiki 7dti2at1ngii8yk4p5c5dlzhf7u363l 2414372 2414371 2026-05-18T07:35:56Z Stashbot 7414 moritzm: installing openssl bugfix updates from bookworm point release 2414372 wikitext text/x-wiki mkvlmnld10zs3xg0uih85xd2tglmjrg 2414373 2414372 2026-05-18T07:39:10Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host ganeti-test2003.codfw.wmnet 2414373 wikitext text/x-wiki qnb35a404r2upcw7woetgqv8y8uc83y 2414374 2414373 2026-05-18T07:45:04Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti-test2003.codfw.wmnet 2414374 wikitext text/x-wiki a2979agfry14oxolgx4h94wi3m91lk6 2414375 2414374 2026-05-18T07:46:54Z Stashbot 7414 moritzm: installing systemd bugfix updates from bookworm point release 2414375 wikitext text/x-wiki njbxudc8dilg70i3cr7mbo9fze52xti 2414377 2414375 2026-05-18T08:12:12Z Stashbot 7414 moritzm: installing glibc bugfix updates from bookworm point release 2414377 wikitext text/x-wiki lrvyb95t2aoaxnutwqz184ojefolz1m 2414378 2414377 2026-05-18T08:13:37Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host ganeti-test2002.codfw.wmnet 2414378 wikitext text/x-wiki nafnsmx8zuhxfareg9q406n3pqe80d5 2414379 2414378 2026-05-18T08:14:38Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/growthbook-next: apply 2414379 wikitext text/x-wiki eo4dfn3pjlq6sr69vrlnw9yj03jeyes 2414380 2414379 2026-05-18T08:15:38Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/growthboo-next: apply 2414380 wikitext text/x-wiki 05i5yu30f5yl9dhmv3akkoeiybmbaf2 2414381 2414380 2026-05-18T08:19:33Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host ganeti-test2002.codfw.wmnet 2414381 wikitext text/x-wiki s78tgn3qkq81gta2zb00sks8p3oe5cr 2414382 2414381 2026-05-18T08:31:16Z Stashbot 7414 javiermonton@deploy1003: Started scap sync-world: Backport for [[gerrit:1287366|stream: mediawiki.page_html_content_change (T423920)]] 2414382 wikitext text/x-wiki f3b3iq0ke77ussg5sq1y2g06ent2v7k 2414383 2414382 2026-05-18T08:40:57Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.hosts.reimage for host ms-be1082.eqiad.wmnet with OS bullseye 2414383 wikitext text/x-wiki 01vse370fkwpnmdb6dt2223hz4qhkbb 2414384 2414383 2026-05-18T08:41:28Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.hosts.move-vlan for host ms-be1082 2414384 wikitext text/x-wiki bmylaxx7q7gr8lshgrsbjq87i3dua0d 2414385 2414384 2026-05-18T08:44:21Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.dns.netbox 2414385 wikitext text/x-wiki mx00b4upclf3fq9w6qcm971sodhyxvc 2414386 2414385 2026-05-18T08:50:06Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-toolhub-test: apply 2414386 wikitext text/x-wiki 7xw3odfkjlh2fzvxpe4taj618ipusjb 2414387 2414386 2026-05-18T08:50:10Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-toolhub-test: apply 2414387 wikitext text/x-wiki g8hl4toyzv4q3ljr1urxb2fmdvuy56x 2414388 2414387 2026-05-18T08:50:15Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/dse-k8s-services/opensearch-toolhub-test: apply 2414388 wikitext text/x-wiki 0s7rb5uemq6c2m949wgyiauj7arejua 2414389 2414388 2026-05-18T08:50:18Z Stashbot 7414 javiermonton@deploy1003: javiermonton: Backport for [[gerrit:1287366|stream: mediawiki.page_html_content_change (T423920)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2414389 wikitext text/x-wiki 3xjckbtziwcvoptvam1dxn9c1545a3v 2414390 2414389 2026-05-18T08:50:21Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/dse-k8s-services/opensearch-toolhub-test: apply 2414390 wikitext text/x-wiki lizkg9e304fsdshnq7qpnl8pc9zdt2h 2414391 2414390 2026-05-18T08:50:58Z Stashbot 7414 javiermonton@deploy1003: javiermonton: Continuing with deployment 2414391 wikitext text/x-wiki cqmyyi1ms7v5gakdjrgv0huetgz4k7m 2414393 2414391 2026-05-18T08:59:50Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.decommission for hosts db2152.codfw.wmnet 2414393 wikitext text/x-wiki ok3m18iw64dubvljhmben3ppq7yj3qm 2414395 2414393 2026-05-18T09:01:42Z Stashbot 7414 ayounsi@dns1004: START - running authdns-update 2414395 wikitext text/x-wiki o0m54ubgydy1s9bo8tslnsef3da2cf6 2414396 2414395 2026-05-18T09:02:51Z Stashbot 7414 javiermonton@deploy1003: Finished scap sync-world: Backport for [[gerrit:1287366|stream: mediawiki.page_html_content_change (T423920)]] (duration: 31m 35s) 2414396 wikitext text/x-wiki fydw24to035td8ieb0oi9i2g97x5jar 2414397 2414396 2026-05-18T09:03:16Z Stashbot 7414 ayounsi@dns1004: END - running authdns-update 2414397 wikitext text/x-wiki 3ywjru2u1dl9e01dcs7top9mcc4ncxy 2414398 2414397 2026-05-18T09:04:34Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.dns.netbox 2414398 wikitext text/x-wiki 5c4w48l3xoph58uf3atmt8duc8doiax 2414399 2414398 2026-05-18T09:05:50Z Stashbot 7414 jnuche@deploy1003: Installing scap version "4.265.2" for 163 host(s) 2414399 wikitext text/x-wiki jpnjpngolrxjsd40dtm77yb7lpyahnw 2414400 2414399 2026-05-18T09:06:57Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host ms-be1082 - mvernon@cumin2002" 2414400 wikitext text/x-wiki fo8u8up7auqa3uy0bp6psoj6blhqoz2 2414402 2414400 2026-05-18T09:07:32Z Stashbot 7414 mvernon@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host ms-be1082 - mvernon@cumin2002" 2414402 wikitext text/x-wiki k0vdn6i6h3mb37qc7ga23w6kbt5o4yf 2414403 2414402 2026-05-18T09:07:34Z Stashbot 7414 mvernon@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2414403 wikitext text/x-wiki n9ddqo2ontr8mvmjxqvi6j52bism2o1 2414404 2414403 2026-05-18T09:07:36Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.dns.wipe-cache ms-be1082.eqiad.wmnet 52.32.64.10.in-addr.arpa 2.5.0.0.2.3.0.0.4.6.0.0.0.1.0.0.3.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2414404 wikitext text/x-wiki quv27gp3652u7nmw56i9x3p8e2hdqik 2414405 2414404 2026-05-18T09:07:37Z Stashbot 7414 mvernon@cumin2002: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) ms-be1082.eqiad.wmnet 52.32.64.10.in-addr.arpa 2.5.0.0.2.3.0.0.4.6.0.0.0.1.0.0.3.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2414405 wikitext text/x-wiki at3vj3bdpsc0ok78nl5jg3lbo39u2dx 2414406 2414405 2026-05-18T09:07:39Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host ms-be1082 2414406 wikitext text/x-wiki p4vxmk5kj1rb2zwvkh9gpo7rbp1fkbm 2414407 2414406 2026-05-18T09:08:06Z Stashbot 7414 mvernon@cumin2002: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ms-be1082 2414407 wikitext text/x-wiki gd8jaz78o16002icc7e2t6brsffgklh 2414408 2414407 2026-05-18T09:08:07Z Stashbot 7414 mvernon@cumin2002: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host ms-be1082 2414408 wikitext text/x-wiki 8wexad8p3l77hy7bhnhc6al5o9zhq2w 2414409 2414408 2026-05-18T09:08:27Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2152.codfw.wmnet decommissioned, removing all IPs except the asset tag one - cwilliams@cumin1003" 2414409 wikitext text/x-wiki tvp5629qusf5rlf42qng9oz6ubhzn4l 2414410 2414409 2026-05-18T09:08:33Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: db2152.codfw.wmnet decommissioned, removing all IPs except the asset tag one - cwilliams@cumin1003" 2414410 wikitext text/x-wiki ppx25a1c31scauaafjmcbpnjth7e3n9 2414411 2414410 2026-05-18T09:08:35Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2414411 wikitext text/x-wiki g3axuf7yrc1wzu0al29f1w90e0ut48k 2414412 2414411 2026-05-18T09:08:36Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts db2152.codfw.wmnet 2414412 wikitext text/x-wiki 8x6x6tip8nv69ilbf4hpzzdwhixbb89 2414413 2414412 2026-05-18T09:10:19Z Stashbot 7414 jnuche@deploy1003: Installing scap version "4.265.2" for 1 host(s) 2414413 wikitext text/x-wiki qxvfndy7a014de3skkcms5t15kf0i8l 2414415 2414413 2026-05-18T09:11:17Z Stashbot 7414 jnuche@deploy1003: Installation of scap version "4.265.2" completed for 1 hosts 2414415 wikitext text/x-wiki damo8wyeb3s0r0c1kbcizq3s6w9ljqo 2414416 2414415 2026-05-18T09:13:11Z Stashbot 7414 cezmunsta: Removing db2152.codfw.wmnet from zarcillo T424344 2414416 wikitext text/x-wiki 410wkb4siaz9i9qsfkp4u7117vo91kh 2414417 2414416 2026-05-18T09:18:54Z Stashbot 7414 moritzm: installing Java 21 security updates 2414417 wikitext text/x-wiki 1uzi50lswtiddzmugrex6p7683lyykq 2414418 2414417 2026-05-18T09:20:03Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.hosts.reimage for host ms-be1086.eqiad.wmnet with OS bullseye 2414418 wikitext text/x-wiki 70rkos09ubp34sk6nrpyedfkwrvih3y 2414419 2414418 2026-05-18T09:20:35Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.hosts.move-vlan for host ms-be1086 2414419 wikitext text/x-wiki 1lzt2ls015qj8uegyle5c9l1pcmc2ig 2414420 2414419 2026-05-18T09:21:10Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.dns.netbox 2414420 wikitext text/x-wiki 8l7fwqqlinpp0ykmopgug7e29hd4ma0 2414421 2414420 2026-05-18T09:25:07Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host ms-be1086 - mvernon@cumin2002" 2414421 wikitext text/x-wiki ruggcybh9r3gelctoz37l6kott1cutk 2414422 2414421 2026-05-18T09:25:11Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1082.eqiad.wmnet with reason: host reimage 2414422 wikitext text/x-wiki axp0ze2eeerwrc5pgw1mn0khwe6ycln 2414423 2414422 2026-05-18T09:25:13Z Stashbot 7414 mvernon@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host ms-be1086 - mvernon@cumin2002" 2414423 wikitext text/x-wiki iaoqs5rs5je27icgsaurzn5x5jhefcr 2414424 2414423 2026-05-18T09:25:14Z Stashbot 7414 mvernon@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2414424 wikitext text/x-wiki gd06hvtuueu7w6ybn1tmf3pa8slplcc 2414425 2414424 2026-05-18T09:25:16Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.dns.wipe-cache ms-be1086.eqiad.wmnet 18.32.64.10.in-addr.arpa 8.1.0.0.2.3.0.0.4.6.0.0.0.1.0.0.3.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2414425 wikitext text/x-wiki 47z0qdi8xugm1itap3bpoqdfd4tmz4d 2414426 2414425 2026-05-18T09:25:17Z Stashbot 7414 mvernon@cumin2002: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) ms-be1086.eqiad.wmnet 18.32.64.10.in-addr.arpa 8.1.0.0.2.3.0.0.4.6.0.0.0.1.0.0.3.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2414426 wikitext text/x-wiki jqvoz7nx8zkbxozyfb92o3ol1vyyidf 2414427 2414426 2026-05-18T09:25:19Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host ms-be1086 2414427 wikitext text/x-wiki fgv7wk0b6pojnov5nrycyzg64wnb1ey 2414428 2414427 2026-05-18T09:25:40Z Stashbot 7414 mvernon@cumin2002: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ms-be1086 2414428 wikitext text/x-wiki bnav3sdhxlzuqds1x45fi9uib0r4xfm 2414429 2414428 2026-05-18T09:25:42Z Stashbot 7414 mvernon@cumin2002: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host ms-be1086 2414429 wikitext text/x-wiki 2z5qzd7p4sddqyzd5g63dm4z03vznmk 2414430 2414429 2026-05-18T09:28:57Z Stashbot 7414 mvernon@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1082.eqiad.wmnet with reason: host reimage 2414430 wikitext text/x-wiki qzvjve4h0vc55rzy05gg625j43u6859 2414432 2414430 2026-05-18T09:29:51Z Stashbot 7414 cezmunsta: Removing db2152.codfw.wmnet from orchestrator T424344 2414432 wikitext text/x-wiki r31pwkrfc1qs1ivuvhitgucz7d283ds 2414434 2414432 2026-05-18T09:36:05Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host pki-root1002.eqiad.wmnet 2414434 wikitext text/x-wiki ns6egtm4ehw2voqelsncgq0kcznrno4 2414435 2414434 2026-05-18T09:37:46Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1086.eqiad.wmnet with reason: host reimage 2414435 wikitext text/x-wiki 3t5pl5k8hbf38xss4rtwu83umpmr0je 2414436 2414435 2026-05-18T09:37:53Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.reboot-nodes rolling reboot on P{wikikube-worker[2332-2374].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) 2414436 wikitext text/x-wiki 5bp27n2hv5vjtclkmdzlvet40od7cyh 2414437 2414436 2026-05-18T09:38:03Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2332-2336].codfw.wmnet 2414437 wikitext text/x-wiki gz8r3vzl6gi15ucvqkz6rc9ptukabiy 2414439 2414437 2026-05-18T09:41:06Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2332-2336].codfw.wmnet 2414439 wikitext text/x-wiki diqvrozrecfh3fxfz1cr7ve026vq8pw 2414441 2414439 2026-05-18T09:41:55Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host pki-root1002.eqiad.wmnet 2414441 wikitext text/x-wiki tdnntylfc5exrmqulo9gdnsbf5pmug3 2414442 2414441 2026-05-18T09:43:29Z Stashbot 7414 mvernon@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1086.eqiad.wmnet with reason: host reimage 2414442 wikitext text/x-wiki oo8f1h09za6i1vjxcdnautq58w8ud6q 2414443 2414442 2026-05-18T09:46:29Z Stashbot 7414 mvernon@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1082.eqiad.wmnet with OS bullseye 2414443 wikitext text/x-wiki 72pcfmdie53mbo3jlfjpqkl8dpb72bw 2414444 2414443 2026-05-18T09:47:40Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2332-2336].codfw.wmnet 2414444 wikitext text/x-wiki cqnncf5zjm6gm1bojquvwy9u1gcs3gg 2414445 2414444 2026-05-18T09:47:44Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2332-2336].codfw.wmnet 2414445 wikitext text/x-wiki 4fotlq4esuslz8ygijsm3nxncgwp1xd 2414446 2414445 2026-05-18T09:47:56Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2337-2341].codfw.wmnet 2414446 wikitext text/x-wiki g0ghrfjq91dr485qy71ke4actr82ny5 2414447 2414446 2026-05-18T09:50:58Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2337-2341].codfw.wmnet 2414447 wikitext text/x-wiki t3oep2g76kk6mvuhmfswog8xltq30do 2414448 2414447 2026-05-18T09:52:08Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 40 hosts with reason: Primary switchover s4 T426590 2414448 wikitext text/x-wiki 0ee9x95lf1ld0nrzhmwo131ml62pdnp 2414449 2414448 2026-05-18T09:52:23Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Set db2240 with weight 0 T426590', diff saved to https://phabricator.wikimedia.org/P92558 and previous config saved to /var/cache/conftool/dbconfig/20260518-095218-fceratto.json 2414449 wikitext text/x-wiki h7gjy78f93zb5rb584pxx6lygnumo3i 2414451 2414449 2026-05-18T09:57:17Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/test-kitchen-next: apply 2414451 wikitext text/x-wiki 0mxhcfm0qvahve63bk522q7s7mymn9w 2414452 2414451 2026-05-18T09:57:36Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/test-kitchen-next: apply 2414452 wikitext text/x-wiki 8oawp9qqci4v8xeyo4lrst6meryq3ba 2414453 2414452 2026-05-18T09:57:40Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2337-2341].codfw.wmnet 2414453 wikitext text/x-wiki bi4k0lcz35hmx92hsfomo7kfd3rihjj 2414454 2414453 2026-05-18T09:57:44Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2337-2341].codfw.wmnet 2414454 wikitext text/x-wiki ngf6k54lb2jfzdodxxr8ciiskjq4u9b 2414455 2414454 2026-05-18T09:57:56Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2342-2346].codfw.wmnet 2414455 wikitext text/x-wiki 2kbhqd519p6s43renrdgypv75gitlxd 2414456 2414455 2026-05-18T09:59:57Z Stashbot 7414 mvernon@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1086.eqiad.wmnet with OS bullseye 2414456 wikitext text/x-wiki cz9q7rk2ckj4drp94pmf659b7qz4ffp 2414457 2414456 2026-05-18T10:00:44Z Stashbot 7414 federico3: Starting s4 codfw failover from db2179 to db2240 - T426590 2414457 wikitext text/x-wiki ago1yspb7iu3ieqa3swiwje968txdvh 2414458 2414457 2026-05-18T10:00:59Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2342-2346].codfw.wmnet 2414458 wikitext text/x-wiki fp6ja2u4cv717tatuics4ti0ifqv274 2414459 2414458 2026-05-18T10:02:06Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Promote db2240 to s4 primary T426590', diff saved to https://phabricator.wikimedia.org/P92559 and previous config saved to /var/cache/conftool/dbconfig/20260518-100203-fceratto.json 2414459 wikitext text/x-wiki dviexyrajxzghcf8dtstwlixs0k20tb 2414460 2414459 2026-05-18T10:07:13Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Set correct weight T426590', diff saved to https://phabricator.wikimedia.org/P92560 and previous config saved to /var/cache/conftool/dbconfig/20260518-100710-fceratto.json 2414460 wikitext text/x-wiki tdc1gpkre4jiz46tj5qjij92xj39whe 2414461 2414460 2026-05-18T10:07:42Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2342-2346].codfw.wmnet 2414461 wikitext text/x-wiki mx5g3hpg0kdhxuie3p6h9sr2uw8yuxz 2414462 2414461 2026-05-18T10:07:46Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2342-2346].codfw.wmnet 2414462 wikitext text/x-wiki r6bb846nvtx6sjr4b4ulzkudce3gxd8 2414463 2414462 2026-05-18T10:07:58Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2347-2351].codfw.wmnet 2414463 wikitext text/x-wiki hg8p61dinuzr1hyajo1gi09u7jslsxe 2414464 2414463 2026-05-18T10:08:24Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2179.codfw.wmnet with reason: Maintenance 2414464 wikitext text/x-wiki jp48n4xn8cgo79vi07vza5mca9en4sl 2414465 2414464 2026-05-18T10:08:34Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Depooling db2179 (T419635)', diff saved to https://phabricator.wikimedia.org/P92561 and previous config saved to /var/cache/conftool/dbconfig/20260518-100831-fceratto.json 2414465 wikitext text/x-wiki 99u0cwjgv09ssx2xvufh2bvgy2i06ww 2414467 2414465 2026-05-18T10:09:24Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/test-kitchen: apply 2414467 wikitext text/x-wiki q7zw6zsscg5b3zqrwkvu2a3v7glwu1k 2414469 2414467 2026-05-18T10:09:42Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/test-kitchen: apply 2414469 wikitext text/x-wiki 714orkj58trs0xkiegam65edypbspa2 2414470 2414469 2026-05-18T10:11:01Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2347-2351].codfw.wmnet 2414470 wikitext text/x-wiki evmngblyihwji6np5utvutin0w8pb4d 2414472 2414470 2026-05-18T10:17:17Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Add pc2024 to dbctl T418973', diff saved to https://phabricator.wikimedia.org/P92562 and previous config saved to /var/cache/conftool/dbconfig/20260518-101714-marostegui.json 2414472 wikitext text/x-wiki 0vrmih2dmn9jrl9puxs1h8brcajl6bj 2414473 2414472 2026-05-18T10:17:44Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2347-2351].codfw.wmnet 2414473 wikitext text/x-wiki o38jc5gmbkj5xn04yflo6gv4ceizitj 2414474 2414473 2026-05-18T10:17:48Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2347-2351].codfw.wmnet 2414474 wikitext text/x-wiki gi2rqng2xnj9wxbpg4071kjdjz4b6p8 2414475 2414474 2026-05-18T10:17:53Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Add pc2024 to pc4 master T418973', diff saved to https://phabricator.wikimedia.org/P92563 and previous config saved to /var/cache/conftool/dbconfig/20260518-101749-marostegui.json 2414475 wikitext text/x-wiki o4g4i2bhf63r6ecu8co2q9ltr10b6mo 2414476 2414475 2026-05-18T10:18:00Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2352-2356].codfw.wmnet 2414476 wikitext text/x-wiki innfebplr3u2j0je3ajaysh565y9wrc 2414477 2414476 2026-05-18T10:18:20Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.pool pool pc2024: replacing hw 2414477 wikitext text/x-wiki tqukcqq03zqj2wy0vlssfhz9cw5pdg4 2414478 2414477 2026-05-18T10:18:21Z Stashbot 7414 marostegui@cumin1003: START - Cookbook sre.mysql.parsercache 2414478 wikitext text/x-wiki 9inblwkrg8yyti3bf2bqdpwv7g8rfnj 2414479 2414478 2026-05-18T10:18:22Z Stashbot 7414 marostegui@cumin1003: END (FAIL) - Cookbook sre.mysql.parsercache (exit_code=99) 2414479 wikitext text/x-wiki cb66w0ay8aue7yc24xcmbdxan0axpdo 2414480 2414479 2026-05-18T10:18:24Z Stashbot 7414 marostegui@cumin1003: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool pc2024: replacing hw 2414480 wikitext text/x-wiki fnxh3jv5whdaimdf66g4u2x5fup0n26 2414482 2414480 2026-05-18T10:19:18Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Repool pc4', diff saved to https://phabricator.wikimedia.org/P92564 and previous config saved to /var/cache/conftool/dbconfig/20260518-101917-marostegui.json 2414482 wikitext text/x-wiki by6jp37s7os4x51qnvho6asqsai6dps 2414483 2414482 2026-05-18T10:21:02Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2352-2356].codfw.wmnet 2414483 wikitext text/x-wiki 2iznq4ar2eylolcqbyvzegg8a98nwjy 2414484 2414483 2026-05-18T10:27:50Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2352-2356].codfw.wmnet 2414484 wikitext text/x-wiki qif338cse0rx9rndosoa2608y067hd1 2414485 2414484 2026-05-18T10:27:54Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2352-2356].codfw.wmnet 2414485 wikitext text/x-wiki 4g9wd8usnljsibu2erwvvj7909l6wtm 2414486 2414485 2026-05-18T10:27:56Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.reboot-nodes (exit_code=0) rolling reboot on P{wikikube-worker[2332-2374].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) 2414486 wikitext text/x-wiki qckpknc15dyw68ppupswhi4gqwgfp41 2414487 2414486 2026-05-18T10:33:36Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.reboot-nodes rolling reboot on P{wikikube-worker[2001-2331].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) 2414487 wikitext text/x-wiki 6db8ew26paucqc5atcxzrsk5hg4jrbf 2414488 2414487 2026-05-18T10:33:42Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2001-2002,2005].codfw.wmnet 2414488 wikitext text/x-wiki 7ay0vrpdiy1h1xgqnmrpn9rxg8k3btt 2414489 2414488 2026-05-18T10:35:25Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2001-2002,2005].codfw.wmnet 2414489 wikitext text/x-wiki arwz2r91wm0j4yelgno4g9cutac7rb6 2414490 2414489 2026-05-18T10:37:05Z Stashbot 7414 slyngshede@cumin1003: START - Cookbook sre.hosts.reboot-single for host idp-test2005.wikimedia.org 2414490 wikitext text/x-wiki j72o4jac3s9yrhztok7p1igumdq70cv 2414491 2414490 2026-05-18T10:37:19Z Stashbot 7414 slyngshede@cumin1003: END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=99) for host idp-test2005.wikimedia.org 2414491 wikitext text/x-wiki 6m1w0ayv3e5xt45vg02uuo3v1gdzn5k 2414492 2414491 2026-05-18T10:37:34Z Stashbot 7414 slyngshede@cumin1003: START - Cookbook sre.hosts.reboot-single for host idp-test2005.wikimedia.org 2414492 wikitext text/x-wiki 0idodfhyrqns2i30bm6w0qqlf0ehiiz 2414494 2414492 2026-05-18T10:41:23Z Stashbot 7414 slyngshede@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp-test2005.wikimedia.org 2414494 wikitext text/x-wiki 89snvfe0l67he2gf9ksp168bdxmdk1v 2414495 2414494 2026-05-18T10:41:43Z Stashbot 7414 slyngshede@cumin1003: START - Cookbook sre.hosts.reboot-single for host idp-test1005.wikimedia.org 2414495 wikitext text/x-wiki khw5ug5eknz8y9nw137bj106uwqpuue 2414496 2414495 2026-05-18T10:42:41Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2001-2002,2005].codfw.wmnet 2414496 wikitext text/x-wiki 1af2zjphyna8avmz42eswg1l43a87fg 2414497 2414496 2026-05-18T10:42:44Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2001-2002,2005].codfw.wmnet 2414497 wikitext text/x-wiki naaqzxxi90ecjuxkqxj66ypbawwqreu 2414498 2414497 2026-05-18T10:42:52Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2006,2011-2012].codfw.wmnet 2414498 wikitext text/x-wiki c8olyc8z5ut3okwvrgj426dk2q5bp94 2414499 2414498 2026-05-18T10:45:11Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2006,2011-2012].codfw.wmnet 2414499 wikitext text/x-wiki hybs1nm8pfujvf8fln93rx3kllqfl52 2414500 2414499 2026-05-18T10:45:41Z Stashbot 7414 slyngshede@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp-test1005.wikimedia.org 2414500 wikitext text/x-wiki 3jgljf3uvvzpqsru9l2kzp9j0soblt4 2414502 2414500 2026-05-18T10:46:02Z Stashbot 7414 slyngshede@cumin1003: START - Cookbook sre.hosts.reboot-single for host idp2005.wikimedia.org 2414502 wikitext text/x-wiki lm1nnhbci2cwefwe7kvkefejg50g8p3 2414506 2414502 2026-05-18T10:48:27Z Stashbot 7414 slyngshede@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp2005.wikimedia.org 2414506 wikitext text/x-wiki f8o1oo8k968pz2e7yl2ef8apyws4ful 2414507 2414506 2026-05-18T10:50:52Z Stashbot 7414 mvernon@cumin2002: START - Cookbook sre.swift.roll-restart-reboot-swift-ms-proxies rolling reboot on A:swift-fe 2414507 wikitext text/x-wiki jzmms6oetr81ip62257j4vbyb4juyb4 2414508 2414507 2026-05-18T10:51:54Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2006,2011-2012].codfw.wmnet 2414508 wikitext text/x-wiki 4ou8h3nrf7n8s22l2m8w0bpe84qxqbj 2414509 2414508 2026-05-18T10:51:56Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2006,2011-2012].codfw.wmnet 2414509 wikitext text/x-wiki izpy20xvowyw3epyj7j5cjvhyve9n6e 2414510 2414509 2026-05-18T10:52:05Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2013-2015].codfw.wmnet 2414510 wikitext text/x-wiki 6epyn6hti7z8gfsy06ojf5lkj8gjav9 2414511 2414510 2026-05-18T10:53:48Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2013-2015].codfw.wmnet 2414511 wikitext text/x-wiki 2r2try8qys448vr09o5tn978d51a7du 2414512 2414511 2026-05-18T10:54:30Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.reimage for host mc1070.eqiad.wmnet with OS bullseye 2414512 wikitext text/x-wiki sv956uokw4uxsorpmk5xw8kjvplozyh 2414513 2414512 2026-05-18T10:54:45Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.reimage for host mc1071.eqiad.wmnet with OS bullseye 2414513 wikitext text/x-wiki rvl0uyl06rg4zm4m46hadwnuhd3ph81 2414514 2414513 2026-05-18T10:54:59Z Stashbot 7414 slyngshede@dns1004: START - running authdns-update 2414514 wikitext text/x-wiki d5wzq4ewqv6pfe9w6l6uj02vp4x66s8 2414515 2414514 2026-05-18T10:55:19Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.reimage for host mc1072.eqiad.wmnet with OS bullseye 2414515 wikitext text/x-wiki 3sl09b2pzxaoyhvf1vkjtbioe2yu1tl 2414517 2414515 2026-05-18T10:56:33Z Stashbot 7414 slyngshede@dns1004: END - running authdns-update 2414517 wikitext text/x-wiki msanti6w7k9i3ozg9olv17crwzog2xx 2414519 2414517 2026-05-18T11:00:29Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2013-2015].codfw.wmnet 2414519 wikitext text/x-wiki foqlxmojqa20jmsduvhkqhzwypaajin 2414520 2414519 2026-05-18T11:00:31Z Stashbot 7414 slyngshede@cumin1003: START - Cookbook sre.hosts.reboot-single for host idp1005.wikimedia.org 2414520 wikitext text/x-wiki 1p38kb5vgmnjj5nbdfho49ae04zq61a 2414521 2414520 2026-05-18T11:00:33Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2013-2015].codfw.wmnet 2414521 wikitext text/x-wiki 22zcn1tejusntrl1slcyovptwnlw8hk 2414522 2414521 2026-05-18T11:00:41Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2016-2018].codfw.wmnet 2414522 wikitext text/x-wiki 6sfoozvk3fd6vu7bu1v2p9t9ujuz05m 2414523 2414522 2026-05-18T11:02:25Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2016-2018].codfw.wmnet 2414523 wikitext text/x-wiki p45hmd09sbmivt44xayetmjvc25r307 2414524 2414523 2026-05-18T11:04:29Z Stashbot 7414 slyngshede@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idp1005.wikimedia.org 2414524 wikitext text/x-wiki ohdinjhrwbvk8cd4e7n72j0g4cald2a 2414526 2414524 2026-05-18T11:05:11Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host bast5005.wikimedia.org 2414526 wikitext text/x-wiki qsgewi4r2tglcjwelo0r5220m0t88a0 2414527 2414526 2026-05-18T11:05:27Z Stashbot 7414 slyngshede@cumin1003: START - Cookbook sre.hosts.reboot-single for host idm-test1001.wikimedia.org 2414527 wikitext text/x-wiki 7bkvw0qr2e25p2msj37g6n5e0k7zdwq 2414528 2414527 2026-05-18T11:06:18Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on mc1070.eqiad.wmnet with reason: host reimage 2414528 wikitext text/x-wiki b15r5gp7yw4dk0o45cjsif2uf9g7xrl 2414529 2414528 2026-05-18T11:06:31Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on mc1071.eqiad.wmnet with reason: host reimage 2414529 wikitext text/x-wiki 8fhy2eilhpgdn4x9r8606gzwk4597cb 2414530 2414529 2026-05-18T11:06:47Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on mc1072.eqiad.wmnet with reason: host reimage 2414530 wikitext text/x-wiki c7ej6sehqyd5x8zv5i8ym6vu9hc428p 2414531 2414530 2026-05-18T11:09:09Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2016-2018].codfw.wmnet 2414531 wikitext text/x-wiki a5bvq75l14wvt272ggjbrx2fbqv6mlm 2414532 2414531 2026-05-18T11:09:12Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2016-2018].codfw.wmnet 2414532 wikitext text/x-wiki dpg0g5gmbwsx1t2u6kgcs181877rrkg 2414533 2414532 2026-05-18T11:09:21Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2033-2035].codfw.wmnet 2414533 wikitext text/x-wiki 7hcqqkuxsjoh0n11tgbxo9965orvcx5 2414534 2414533 2026-05-18T11:09:25Z Stashbot 7414 slyngshede@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idm-test1001.wikimedia.org 2414534 wikitext text/x-wiki ahornl79ytw23v7un51799ik0p09181 2414535 2414534 2026-05-18T11:09:54Z Stashbot 7414 slyngshede@cumin1003: START - Cookbook sre.hosts.reboot-single for host idm2001.wikimedia.org 2414535 wikitext text/x-wiki oz855yyjo7uaa30q9rtlouyrvws4bhd 2414536 2414535 2026-05-18T11:10:09Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1070.eqiad.wmnet with reason: host reimage 2414536 wikitext text/x-wiki os0mws6b3mregajz51lwsyhzai13nf8 2414537 2414536 2026-05-18T11:11:05Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2033-2035].codfw.wmnet 2414537 wikitext text/x-wiki cacz27bu3wqas9sjrzs6s38lj0430wt 2414540 2414537 2026-05-18T11:14:02Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host bast5005.wikimedia.org 2414540 wikitext text/x-wiki ineu1g6xi5h8q1w3lsvpylwjsf8wj69 2414541 2414540 2026-05-18T11:14:06Z Stashbot 7414 slyngshede@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idm2001.wikimedia.org 2414541 wikitext text/x-wiki qnwnbwbhh4mhdmrccnmzxpq4li65ko2 2414542 2414541 2026-05-18T11:14:19Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1071.eqiad.wmnet with reason: host reimage 2414542 wikitext text/x-wiki ikeq82lhan9en064z25g8i42umdqlvy 2414543 2414542 2026-05-18T11:15:05Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host bast4006.wikimedia.org 2414543 wikitext text/x-wiki hjm0l937li5ct3xpy73lhdeu6cxl4r1 2414545 2414543 2026-05-18T11:17:32Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2033-2035].codfw.wmnet 2414545 wikitext text/x-wiki 148yl8ivsvmr83r3k6xxfd3xem5a7yo 2414546 2414545 2026-05-18T11:17:34Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2033-2035].codfw.wmnet 2414546 wikitext text/x-wiki ex167f5ww96pdhey1wgktaa195oxuub 2414547 2414546 2026-05-18T11:17:43Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2036-2038].codfw.wmnet 2414547 wikitext text/x-wiki mn21v580zzvlrcrg42p3l92z0i7kbr9 2414548 2414547 2026-05-18T11:17:53Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1072.eqiad.wmnet with reason: host reimage 2414548 wikitext text/x-wiki qy14nwzpz3zct7kexqyykfsedfehh9u 2414549 2414548 2026-05-18T11:18:47Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host bast4006.wikimedia.org 2414549 wikitext text/x-wiki agb6z63vabcf595b0wurydyc2z4t6lc 2414551 2414549 2026-05-18T11:19:23Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host failoid2003.codfw.wmnet 2414551 wikitext text/x-wiki a9vv26wq3ul09bi15pni2ncpfv8z39z 2414552 2414551 2026-05-18T11:19:28Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2036-2038].codfw.wmnet 2414552 wikitext text/x-wiki 0w80s3mlktlm41hfyamo8wcyafl2d1k 2414553 2414552 2026-05-18T11:19:52Z Stashbot 7414 slyngshede@dns1004: START - running authdns-update 2414553 wikitext text/x-wiki ttqx1j3f7252mgq21eklnymy39yljkm 2414554 2414553 2026-05-18T11:21:26Z Stashbot 7414 slyngshede@dns1004: END - running authdns-update 2414554 wikitext text/x-wiki 9100xniyvtdssebbsjzkfct4shli2th 2414556 2414554 2026-05-18T11:23:16Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host failoid2003.codfw.wmnet 2414556 wikitext text/x-wiki 0o9ik6511sjmtr17i2a6k1cbtjr8rl6 2414557 2414556 2026-05-18T11:24:00Z Stashbot 7414 slyngshede@cumin1003: START - Cookbook sre.hosts.reboot-single for host idm1001.wikimedia.org 2414557 wikitext text/x-wiki pyqjpfdgm1w6g2wi5768gotwa36nnti 2414558 2414557 2026-05-18T11:24:06Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc1070.eqiad.wmnet with OS bullseye 2414558 wikitext text/x-wiki 87ui7ickjs4juevsvylod0ioljyx7sx 2414561 2414558 2026-05-18T11:26:40Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2036-2038].codfw.wmnet 2414561 wikitext text/x-wiki 76vkxa1mte1gz9gyjel85lwk9n8gw1p 2414562 2414561 2026-05-18T11:26:43Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2036-2038].codfw.wmnet 2414562 wikitext text/x-wiki 90m7o7hqi7wq8bbp0hedz28c4oc4i6d 2414563 2414562 2026-05-18T11:26:55Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2039,2041-2042].codfw.wmnet 2414563 wikitext text/x-wiki rntpj50a4y6c6sr6gm2u97w659chk20 2414566 2414563 2026-05-18T11:27:58Z Stashbot 7414 slyngshede@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host idm1001.wikimedia.org 2414566 wikitext text/x-wiki hkrjpggxeij8e93umcexhi074yzuou1 2414568 2414566 2026-05-18T11:29:14Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2039,2041-2042].codfw.wmnet 2414568 wikitext text/x-wiki m9xpqoqvro9tp5ebd3q64etn1jko3bq 2414570 2414568 2026-05-18T11:30:08Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc1071.eqiad.wmnet with OS bullseye 2414570 wikitext text/x-wiki rc7gjc6hmh8osncthhh34cf9c93dkyd 2414571 2414570 2026-05-18T11:32:54Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host mc1072.eqiad.wmnet with OS bullseye 2414571 wikitext text/x-wiki ie25921hgv3w0yhy3qx2bu6tcz06t6q 2414573 2414571 2026-05-18T11:36:14Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2039,2041-2042].codfw.wmnet 2414573 wikitext text/x-wiki szii05t1kparjgjm3cjmgfrov129e76 2414574 2414573 2026-05-18T11:36:17Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2039,2041-2042].codfw.wmnet 2414574 wikitext text/x-wiki dx2xjxrv6pz2ukd77vruifzlr41nnl9 2414575 2414574 2026-05-18T11:36:27Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2044,2046,2049].codfw.wmnet 2414575 wikitext text/x-wiki nwu6qnj70jenysy7eyiwdo9w2lw89qt 2414576 2414575 2026-05-18T11:38:12Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2044,2046,2049].codfw.wmnet 2414576 wikitext text/x-wiki 7rea5ar4kxa4j1hdu6vuc1t9oukyqng 2414577 2414576 2026-05-18T11:38:38Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.reimage for host mc1072.eqiad.wmnet with OS bookworm 2414577 wikitext text/x-wiki 02rr4xxcsmffjf3tl6glkje6nhm97jj 2414579 2414577 2026-05-18T11:39:24Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.reimage for host mc1071.eqiad.wmnet with OS bookworm 2414579 wikitext text/x-wiki 2p0kmfherlmvpyq40zth3onu8g3yy82 2414580 2414579 2026-05-18T11:39:57Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.reimage for host mc1070.eqiad.wmnet with OS bookworm 2414580 wikitext text/x-wiki jcrojx40o0pw2n3ilxin63e85dgsb9y 2414581 2414580 2026-05-18T11:41:21Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.reimage for host mc1069.eqiad.wmnet with OS bookworm 2414581 wikitext text/x-wiki g6sbjjnuv2773olmwyu7icmlfntw3c9 2414582 2414581 2026-05-18T11:45:07Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host failoid1003.eqiad.wmnet 2414582 wikitext text/x-wiki bvn2sp88h8r1iivez79fam1uldf97ri 2414583 2414582 2026-05-18T11:45:23Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2044,2046,2049].codfw.wmnet 2414583 wikitext text/x-wiki 22soa9nwdo7o3k127dzy4hyqpcxacbn 2414584 2414583 2026-05-18T11:45:26Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2044,2046,2049].codfw.wmnet 2414584 wikitext text/x-wiki lefhl8513ul2g6tqnjqvp6t9l4hg9p2 2414585 2414584 2026-05-18T11:45:34Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2050-2051,2055].codfw.wmnet 2414585 wikitext text/x-wiki jc91wwyhqwy626v9c3wtfqqm2zud2mo 2414586 2414585 2026-05-18T11:46:44Z Stashbot 7414 fceratto@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 23 hosts with reason: Primary switchover s5 T426600 2414586 wikitext text/x-wiki a9afv0w56zmju5c4rhjjfuncq8yxzg3 2414587 2414586 2026-05-18T11:46:55Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Set db2213 with weight 0 T426600', diff saved to https://phabricator.wikimedia.org/P92565 and previous config saved to /var/cache/conftool/dbconfig/20260518-114652-fceratto.json 2414587 wikitext text/x-wiki s4s6pcruonzbn4e4uabfni1o9a5mx3v 2414588 2414587 2026-05-18T11:47:16Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2050-2051,2055].codfw.wmnet 2414588 wikitext text/x-wiki gzgpqip36n0g7aqb7a292b7tsb4lp5t 2414590 2414588 2026-05-18T11:49:02Z Stashbot 7414 jmm@cumin2002: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host failoid1003.eqiad.wmnet 2414590 wikitext text/x-wiki qz53urd0qhpakx7jviiybzg4b0hdfjv 2414591 2414590 2026-05-18T11:50:40Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on mc1072.eqiad.wmnet with reason: host reimage 2414591 wikitext text/x-wiki 1b3g6avn0cq5y24qlgw1puawihkniqu 2414592 2414591 2026-05-18T11:50:54Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on mc1071.eqiad.wmnet with reason: host reimage 2414592 wikitext text/x-wiki 0eizd7jvn18piyvosw4eu3pq75hmhvh 2414593 2414592 2026-05-18T11:51:49Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on mc1070.eqiad.wmnet with reason: host reimage 2414593 wikitext text/x-wiki 3spvf5jse8a6v5284s8i815ebpda75w 2414594 2414593 2026-05-18T11:52:04Z Stashbot 7414 federico3: Starting s5 codfw failover from db2192 to db2213 - T426600 2414594 wikitext text/x-wiki 3jh5r8rd5fh2f4se7qow3dh5bg5nob3 2414595 2414594 2026-05-18T11:53:07Z Stashbot 7414 fceratto@cumin1003: dbctl commit (dc=all): 'Promote db2213 to s5 primary T426600', diff saved to https://phabricator.wikimedia.org/P92566 and previous config saved to /var/cache/conftool/dbconfig/20260518-115304-fceratto.json 2414595 wikitext text/x-wiki hjrwotl2bj2spv1bih3s6ogfyb2n6xt 2414596 2414595 2026-05-18T11:53:11Z Stashbot 7414 jiji@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on mc1069.eqiad.wmnet with reason: host reimage 2414596 wikitext text/x-wiki o9fnlieq090jlrfietows6v1cfoknn2 2414597 2414596 2026-05-18T11:53:43Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2050-2051,2055].codfw.wmnet 2414597 wikitext text/x-wiki curv5k9t3w9yc3yzxx5ymz35tgehf91 2414598 2414597 2026-05-18T11:53:46Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2050-2051,2055].codfw.wmnet 2414598 wikitext text/x-wiki kvj3zscolxffob6tyg8yk8v2qp050ux 2414599 2414598 2026-05-18T11:53:55Z Stashbot 7414 blake@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker[2056-2058].codfw.wmnet 2414599 wikitext text/x-wiki mrkflnc308pxow2x8ktp7nb35jb19ee 2414600 2414599 2026-05-18T11:54:11Z Stashbot 7414 jmm@cumin2002: START - Cookbook sre.hosts.reboot-single for host cumin2003.codfw.wmnet 2414600 wikitext text/x-wiki 4w600crosh5t3sbty1f8xblqibz9bmw 2414601 2414600 2026-05-18T11:54:13Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1072.eqiad.wmnet with reason: host reimage 2414601 wikitext text/x-wiki br8nt0do307mx59av6i6ri7gva3euqa 2414602 2414601 2026-05-18T11:55:39Z Stashbot 7414 blake@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker[2056-2058].codfw.wmnet 2414602 wikitext text/x-wiki at2ts6vqoeb2kv6kyw3yao8kiyfbq5k 2414604 2414602 2026-05-18T11:58:17Z Stashbot 7414 jiji@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mc1070.eqiad.wmnet with reason: host reimage 2414604 wikitext text/x-wiki a05o51hvymqqombkasngef1o2nxenxr Release Engineering/SAL 0 17290 2414431 2414286 2026-05-18T09:29:06Z Stashbot 7414 Lucas_WMDE: ssh integration-castor06.integration.eqiad1.wikimedia.cloud sudo -u jenkins-deploy rm -rf /srv/castor/castor-mw-ext-and-skins/master/mediawiki-node24 # fix failure seen in mediawiki-node24 22260 2414431 wikitext text/x-wiki 09dc9mhxti19xqnr7ugrmbfim25a7y4 Nova Resource:Admin/SAL 498 30942 2414501 2412407 2026-05-18T10:45:58Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/312 2414501 wikitext text/x-wiki 0dybd3k5mworum0ywx4yhfu7ylwtnhm 2414503 2414501 2026-05-18T10:46:05Z Stashbot 7414 taavi@cloudcumin1001: END (FAIL) - Cookbook wmcs.openstack.tofu (exit_code=99) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/312 2414503 wikitext text/x-wiki i6v8pxgga8e56yvxdunebs55m9sa993 2414504 2414503 2026-05-18T10:46:59Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/312 2414504 wikitext text/x-wiki hh7vue58rht4jll4db96jy4ohmm7p3b 2414505 2414504 2026-05-18T10:47:20Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/312 2414505 wikitext text/x-wiki dewrg0e9rjtidbiwt64l2c1iobmczbu MariaDB/Troubleshooting 0 32278 2414538 2401049 2026-05-18T11:13:19Z LSobanski (WMF) 18783 /* Depooling a replica */ 2414538 wikitext text/x-wiki 59yb5q41uonzy70q5iz2owoia8qlv1f 2414539 2414538 2026-05-18T11:13:55Z LSobanski (WMF) 18783 2414539 wikitext text/x-wiki i8gcalg0k6sbhn0dkmmjl7uqlnjrlv8 2414544 2414539 2026-05-18T11:15:16Z LSobanski (WMF) 18783 2414544 wikitext text/x-wiki pv4lszaq6gkb18vhfpf6tc6mnjfmwwm 2414565 2414544 2026-05-18T11:27:48Z LSobanski (WMF) 18783 /* Incident Response */ 2414565 wikitext text/x-wiki 038fc0syqrmw1tweh1n06vggokr6h56 Network monitoring 0 441095 2414376 2407118 2026-05-18T07:58:43Z AYounsi (WMF) 10040 Add placeholders for interface optic power 2414376 wikitext text/x-wiki gok0t29t3r3j7wu5b12gnbdrxihgkgp Help:Toolforge/Python 12 443703 2414348 2379296 2026-05-17T22:56:21Z SSapaty (WMF) 28955 /* Jobs */ typo 2414348 wikitext text/x-wiki d7ev5gj004ifbs1yk6e4t3aune4dg77 MariaDB/Decommissioning a DB Host 0 446795 2414433 2413729 2026-05-18T09:34:45Z CWilliams-WMF 55316 Updated dborch hostname 2414433 wikitext text/x-wiki 8k3vggcyw7fnzntb34k9htlal5iujpe Portal:Toolforge/Admin/Jobs Service 0 448850 2414440 2323254 2026-05-18T09:41:21Z FNegri-WMF 32595 /* Prebuilt image management */ update imadebuilder instance name 2414440 wikitext text/x-wiki kzb8h8legwrytid45f6gka27uxzkbyt Help:Toolforge/Running jobs 12 449113 2414347 2403068 2026-05-17T22:55:11Z SSapaty (WMF) 28955 /* Deleting your jobs */ 2414347 wikitext text/x-wiki atq95y9iu3vjoyhuq2rk0obo0mmbp4m Map of database maintenance 0 449160 2414349 2414332 2026-05-18T00:02:27Z Dexbot 30554 Bot: Updating the report 2414349 wikitext text/x-wiki 7jvv9in40bafzlnpog5fhxcodlz02uo 2414450 2414349 2026-05-18T09:54:32Z Dexbot 30554 Bot: Updating the report 2414450 wikitext text/x-wiki dwizbidlzdnseexrlqep96gaiu988x6 2414468 2414450 2026-05-18T10:09:35Z Dexbot 30554 Bot: Updating the report 2414468 wikitext text/x-wiki 94zqlab1q88rdxr6yzvowwkx0kklf8l 2414481 2414468 2026-05-18T10:18:37Z Dexbot 30554 Bot: Updating the report 2414481 wikitext text/x-wiki 1h3kubbyfcqq94x4tdmhbwlub02z9ti 2414589 2414481 2026-05-18T11:48:48Z Dexbot 30554 Bot: Updating the report 2414589 wikitext text/x-wiki 6kayacpqn8zn90c35gq2o5ik8nuo7tc Help:Toolforge/Running Pywikibot scripts 12 453743 2414359 2369639 2026-05-18T06:53:27Z Meno25 1446 update redirected link 2414359 wikitext text/x-wiki ao1tnwiobkv9li4n8behh0p496514ms Yubikey-SSH-FIDO 0 457955 2414344 2412204 2026-05-17T14:00:48Z Krinkle 44 /* Access to network devices */ 2414344 wikitext text/x-wiki 0jsjfjam3igi4un329wxcc445plz9jl 2414345 2414344 2026-05-17T14:03:33Z Krinkle 44 /* I need to tap my token twice for every connection attempt */ Fix typo an > and 2414345 wikitext text/x-wiki qa0a5qm60kvfnsidq1o84pn30m0xpq3 Nokia Networking/SR Linux Notes 0 459093 2414516 2362423 2026-05-18T10:55:52Z AYounsi (WMF) 10040 Add some SR-Linux limitations 2414516 wikitext text/x-wiki 554i7jlw0uoompj96w4uuckrtksj9pf 2414518 2414516 2026-05-18T10:57:08Z AYounsi (WMF) 10040 /* Limitations */ 2414518 wikitext text/x-wiki a9qvoir4du6go1wy7dbftv4cptj807a 2414525 2414518 2026-05-18T11:04:35Z AYounsi (WMF) 10040 /* Limitations */ 2414525 wikitext text/x-wiki 80w9q0pl4k7d5g6eih1saxkjm8krc7t 2414550 2414525 2026-05-18T11:18:57Z CMooney (WMF) 24288 /* Limitations */ 2414550 wikitext text/x-wiki 1xhtpps3cgkiy79vhzrehmeoarnqng3 2414555 2414550 2026-05-18T11:21:54Z CMooney (WMF) 24288 /* Limitations */ 2414555 wikitext text/x-wiki pj0esjl2buv7l3pvipclc6youldsoov 2414559 2414555 2026-05-18T11:24:53Z CMooney (WMF) 24288 /* Limitations */ 2414559 wikitext text/x-wiki kq0orsvnkz1y8hjxjvhxdxf09oxo2xr 2414560 2414559 2026-05-18T11:26:00Z CMooney (WMF) 24288 /* Limitations */ 2414560 wikitext text/x-wiki d2n576kn7q972bkqgumbjl21ovq10y5 2414564 2414560 2026-05-18T11:27:09Z CMooney (WMF) 24288 /* Limitations */ 2414564 wikitext text/x-wiki 9cggcsco685t19yyayv0ziwmc9gwhwv 2414567 2414564 2026-05-18T11:28:08Z CMooney (WMF) 24288 /* Limitations */ 2414567 wikitext text/x-wiki lgwnbygor7t5yngcmuk18eg37gsevtq 2414572 2414567 2026-05-18T11:35:14Z CMooney (WMF) 24288 /* Limitations */ 2414572 wikitext text/x-wiki 042nf9ygluftv9xdj22hof55p3axyfh 2414578 2414572 2026-05-18T11:38:41Z CMooney (WMF) 24288 /* Feature Requests */ 2414578 wikitext text/x-wiki fka6ja3wmwyhj15mgyf9o1ovg7vqx4e Fundraising/SAL 0 459699 2414569 2414290 2026-05-18T11:29:50Z Stashbot 7414 jgleeson: payments-wiki upgraded from 1a056dc0 to 40a24102 2414569 wikitext text/x-wiki fbqq8zov90s0665s2o64fle4a9tk1n4 User:Effie Mouzeli (WMF)/SCROLL/Template 2 460100 2414392 2414274 2026-05-18T08:55:42Z Effie Mouzeli (WMF) 12880 /* SCROLL: */ 2414392 wikitext text/x-wiki n9ma5ak3f1kp6jo07z2623lslhhmnvc User:Effie Mouzeli (WMF)/SCROLL/Guide 2 460176 2414394 2414247 2026-05-18T09:01:28Z Effie Mouzeli (WMF) 12880 /* SCROLL guide */ 2414394 wikitext text/x-wiki 137uedixv35fdii05m44wi6l7g8ekqk User talk:DarkMatterMan4500 3 460185 2414343 2026-05-17T14:00:10Z DarkMatterMan4500 55674 /* Hello */ new section 2414343 wikitext text/x-wiki q0kg56vdtbtt90sug7mqaxhftiwwfkl