Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.13 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 3086 2443522 2443298 2026-08-03T13:58:12Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component jobs-api 2443522 wikitext text/x-wiki srevg0s69sjhf72jpc1wrn1t60rtl5h 2443526 2443522 2026-08-03T14:14:14Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api 2443526 wikitext text/x-wiki sd158o5hl936spj4w215uvsord30zfz 2443559 2443526 2026-08-03T15:39:53Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.reboot for all NFS workers (T433426) 2443559 wikitext text/x-wiki hzmhfl0mfex5lx4c7y803c33l03gijx 2443600 2443559 2026-08-03T17:06:01Z Stashbot 7414 andrew@cloudcumin1001: END (ERROR) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=97) for all NFS workers (T433426) 2443600 wikitext text/x-wiki m6damwj7584jdpyrtswo2ppcogbmnk5 2443608 2443600 2026-08-03T17:07:21Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-68 (T433426) 2443608 wikitext text/x-wiki spy79inbfoy2d0av8xzzzuba0q6ws4r 2443609 2443608 2026-08-03T17:07:56Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-68 (T433426) 2443609 wikitext text/x-wiki 3wqaku5sf3w9jctoc80r32j190byc2y 2443611 2443609 2026-08-03T17:13:38Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-67,tools-k8s-worker-nfs-66 (T433426) 2443611 wikitext text/x-wiki 1d6tzkx99vb3ii2p4qeg3e3t5mz4lhe 2443612 2443611 2026-08-03T17:13:42Z Stashbot 7414 andrew@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=99) for tools-k8s-worker-nfs-67,tools-k8s-worker-nfs-66 (T433426) 2443612 wikitext text/x-wiki bm53lwwl80cpl43vr6mkuigq1lv0jo6 2443613 2443612 2026-08-03T17:13:48Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-67, tools-k8s-worker-nfs-66 (T433426) 2443613 wikitext text/x-wiki rgisr32s5fd3rkvug2mdg6wvcb07vdl 2443615 2443613 2026-08-03T17:24:11Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-67, tools-k8s-worker-nfs-66 (T433426) 2443615 wikitext text/x-wiki 014z65qn8787gnurgq6u5f3l5ek8ssp 2443617 2443615 2026-08-03T17:25:26Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.reboot for tools-k8s-worker-nfs-65, tools-k8s-worker-nfs-61, tools-k8s-worker-nfs-58, tools-k8s-worker-nfs-57, tools-k8s-worker-nfs-55, tools-k8s-worker-nfs-54, tools-k8s-worker-nfs-53, tools-k8s-worker-nfs-50, tools-k8s-worker-nfs-48, tools-k8s-worker-nfs-47, tools-k8s-worker-nfs-46, tools-k8s-worker-nfs-45, tools-k8s-worker-nfs-44, tools-k8s-worker-nfs 2443617 wikitext text/x-wiki gwzv4pibbwmf9a99wdvv93kk7jpbl5a 2443671 2443617 2026-08-03T20:36:05Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.k8s.reboot (exit_code=0) for tools-k8s-worker-nfs-65, tools-k8s-worker-nfs-61, tools-k8s-worker-nfs-58, tools-k8s-worker-nfs-57, tools-k8s-worker-nfs-55, tools-k8s-worker-nfs-54, tools-k8s-worker-nfs-53, tools-k8s-worker-nfs-50, tools-k8s-worker-nfs-48, tools-k8s-worker-nfs-47, tools-k8s-worker-nfs-46, tools-k8s-worker-nfs-45, tools-k8s-worker-nfs-44, t 2443671 wikitext text/x-wiki 4k025fx9ul8oxdorqoupbns7gzon6re 2443805 2443671 2026-08-04T09:15:12Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-api 2443805 wikitext text/x-wiki qsnyuonsy96988fcz30fuj0lj2kg8p8 2443806 2443805 2026-08-04T09:15:14Z Stashbot 7414 dcaro@cloudcumin1001: END (ERROR) - Cookbook wmcs.toolforge.component.deploy (exit_code=97) for component logs-api 2443806 wikitext text/x-wiki 8ocso56qq213955cx6qe57h96vwd32q 2443817 2443806 2026-08-04T09:34:07Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-api 2443817 wikitext text/x-wiki aya6ngnz7ej26od75c4kmw8u5tnfjx0 2443823 2443817 2026-08-04T09:45:34Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-api 2443823 wikitext text/x-wiki 2ekvxduzowkgzq7xmvxqvdzvi1pwrow 2443833 2443823 2026-08-04T10:05:49Z Stashbot 7414 tlepage@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component jobs-api 2443833 wikitext text/x-wiki b0y6jj2e0mmuqh0rdnwvesfiuap8tnc 2443870 2443833 2026-08-04T10:22:19Z Stashbot 7414 tlepage@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api 2443870 wikitext text/x-wiki p9e6o9oo4ytemo8e0b2p0slohdqa0pb 2443887 2443870 2026-08-04T10:44:32Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component api-gateway 2443887 wikitext text/x-wiki k7pvjkmbv6ldvrzp4uaeynl0xmqr47w 2443893 2443887 2026-08-04T10:49:02Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway 2443893 wikitext text/x-wiki hipesr02j0e556qohexph7vbqosvxm3 2443940 2443893 2026-08-04T11:30:08Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component maintain-kubeusers 2443940 wikitext text/x-wiki 5uw05el0npjei5ch8qcps3v0z8j66w3 2443973 2443940 2026-08-04T11:56:30Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-kubeusers 2443973 wikitext text/x-wiki 7vmgcvtgfl2efyn20vaq62jecscq2bf 0 4108 2443500 2443366 2026-08-03T12:43:57Z ScheduleDeploymentBot 37566 Add [[gerrit:1320149]] to Monday, August 03 UTC afternoon backport window 2443500 wikitext text/x-wiki suyiy2bv2edi9wgxgb14zgthxokfq2j 2443506 2443500 2026-08-03T13:07:55Z ScheduleDeploymentBot 37566 Add [[gerrit:1319903]] to Monday, August 03 UTC late backport window 2443506 wikitext text/x-wiki am0dqq4qavg2p5kdaakziz44f53m828 2443507 2443506 2026-08-03T13:08:07Z ScheduleDeploymentBot 37566 Add [[gerrit:1311041]] to Monday, August 03 UTC late backport window 2443507 wikitext text/x-wiki evl6q955uklq47iwztx6up1kp31gh9t 2443555 2443507 2026-08-03T15:31:16Z ScheduleDeploymentBot 37566 Add [[gerrit:1319868]] to Monday, August 03 UTC late backport window 2443555 wikitext text/x-wiki 4v8yk248ecnxezt0pue2apoopkc15ce 2443587 2443555 2026-08-03T16:48:05Z ScheduleDeploymentBot 37566 Add [[gerrit:1320179]] to Monday, August 03 UTC late backport window 2443587 wikitext text/x-wiki jwm1nw4l1pt7eh5j4sxi2vh9wpq7z0v 2443618 2443587 2026-08-03T17:25:48Z ScheduleDeploymentBot 37566 Add [[gerrit:1320171]] to Monday, August 03 UTC late backport window 2443618 wikitext text/x-wiki 53609meq9p0dq0krfm59mxmav3zz3we 2443619 2443618 2026-08-03T17:27:54Z TheDJ 95 rm categorytree 2443619 wikitext text/x-wiki itcrkl9lo7dbi02ain9fx0xcpdvpqhf 2443620 2443619 2026-08-03T17:28:23Z ScheduleDeploymentBot 37566 Add [[gerrit:1320159]] to Monday, August 03 UTC late backport window 2443620 wikitext text/x-wiki kwbk84sd0ukqc2ic8eghdi2mko1gt4v 2443658 2443620 2026-08-03T19:11:01Z ScheduleDeploymentBot 37566 Add [[gerrit:1320215]] to Monday, August 03 UTC late backport window 2443658 wikitext text/x-wiki o19fpyk72cjhifxxc78wl6n43bybi86 2443661 2443658 2026-08-03T20:01:58Z Krinkle 44 rm already deployed 2443661 wikitext text/x-wiki oij2d7i58g94jwcwgb5yrykjb96luzv 2443698 2443661 2026-08-03T21:57:46Z TheDJ 95 2443698 wikitext text/x-wiki d6d111xuoutg60nx5pu7ifz4wibibay 2443748 2443698 2026-08-04T07:39:47Z TheDJ 95 shift once more, this time no deployers 2443748 wikitext text/x-wiki fo5dix2r90q5h8k5bkkfxndmyl6on23 2443917 2443748 2026-08-04T11:15:14Z ScheduleDeploymentBot 37566 Add [[gerrit:1320757]] to Tuesday, August 04 UTC afternoon backport window 2443917 wikitext text/x-wiki ikc0qxklruvc658azx8e9l958yicyj2 2443928 2443917 2026-08-04T11:22:00Z ScheduleDeploymentBot 37566 Add [[gerrit:1320781]] to Tuesday, August 04 UTC afternoon backport window 2443928 wikitext text/x-wiki jtedqf13xss4zs3swrz8qg21yhofuj7 2443930 2443928 2026-08-04T11:22:11Z ScheduleDeploymentBot 37566 Add [[gerrit:1320782]] to Tuesday, August 04 UTC afternoon backport window 2443930 wikitext text/x-wiki doa91ydtjlxxy61zn7pilo54jmf9xgz 2443931 2443930 2026-08-04T11:22:24Z ScheduleDeploymentBot 37566 Add [[gerrit:1319086]] to Tuesday, August 04 UTC afternoon backport window 2443931 wikitext text/x-wiki ql2b2qfrvluddk85dn0hazagdsdgnf9 0 6479 2443908 2441454 2026-08-04T11:08:01Z Taavi-WMF 41365 /* Pair 1 (rdb1013 and rdb2011) */ tentatively reserve database for cloudidp-dev [[gerrit:1320824]] 2443908 wikitext text/x-wiki povyfhvbuy02eys6st3gdtjeddf34y8 498 6726 2443516 2443392 2026-08-03T13:40:20Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component jobs-api 2443516 wikitext text/x-wiki mt6oam62c43lo1movzak8rlz730pwgo 2443521 2443516 2026-08-03T13:53:14Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api 2443521 wikitext text/x-wiki myal9xhj6aomotzzcxa5vyulat6w88x 2443530 2443521 2026-08-03T14:20:37Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.remove_instance for instance toolsbeta-harbor-1 2443530 wikitext text/x-wiki d6azj1h141l5dp7hyjzn57ygknlfzkg 2443531 2443530 2026-08-03T14:21:24Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance toolsbeta-harbor-1 2443531 wikitext text/x-wiki e4udfylx8tfqupjp2wi8j8ryiitcyfa 2443778 2443531 2026-08-04T08:47:22Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component jobs-api 2443778 wikitext text/x-wiki 6lsnv9syfjrrtwqk0tkhn5edubxfon1 2443779 2443778 2026-08-04T08:47:24Z Stashbot 7414 dcaro@cloudcumin1001: END (ERROR) - Cookbook wmcs.toolforge.component.deploy (exit_code=97) for component jobs-api 2443779 wikitext text/x-wiki hbonu9ys38a4ob8lh9vjjtoy2gs1600 2443780 2443779 2026-08-04T08:47:32Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component jobs-api 2443780 wikitext text/x-wiki mg89eq426b5f5w26hc9yaod8ifkiqtq 2443781 2443780 2026-08-04T08:47:36Z Stashbot 7414 dcaro@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component jobs-api 2443781 wikitext text/x-wiki 6pn69n09b5eruj95apwanh9zfyzchsq 2443791 2443781 2026-08-04T09:02:40Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-api 2443791 wikitext text/x-wiki 4xiqbbyw60g9qt0dxtbs6oseykxcxv0 2443792 2443791 2026-08-04T09:04:16Z Stashbot 7414 dcaro@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component logs-api 2443792 wikitext text/x-wiki 568648je8kkp1w5v1umwny3mcvxw7cn 2443807 2443792 2026-08-04T09:15:36Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-api 2443807 wikitext text/x-wiki rep04aew2gfcdz89hxx2ixpl6k43khd 2443811 2443807 2026-08-04T09:24:13Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-api 2443811 wikitext text/x-wiki h9m5x8hleaux3yhpcyza9y9jeuboija 2443824 2443811 2026-08-04T09:50:38Z Stashbot 7414 tlepage@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component jobs-api 2443824 wikitext text/x-wiki jd2asxw4d8yvlrf7py9jcams0lae7a0 2443825 2443824 2026-08-04T09:51:33Z Stashbot 7414 tlepage@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component jobs-api 2443825 wikitext text/x-wiki rjfcprh5303iwz9k5fl2j9cornr8i7p 2443826 2443825 2026-08-04T09:53:02Z Stashbot 7414 tlepage@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component jobs-api 2443826 wikitext text/x-wiki pmyt8hjj7nrsi8p8vn68zbcgf3gml5t 2443832 2443826 2026-08-04T10:05:13Z Stashbot 7414 tlepage@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api 2443832 wikitext text/x-wiki cwoy0zhdmdbnj2h53qbbi5waledv98k 2443879 2443832 2026-08-04T10:35:34Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component api-gateway 2443879 wikitext text/x-wiki i3vo7b0kfxphj9y6aazsyvosfhwos04 2443884 2443879 2026-08-04T10:39:06Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component api-gateway 2443884 wikitext text/x-wiki cwyw9yb6ppeqmmfy7x6w8uqgxob6vqu 2443894 2443884 2026-08-04T10:51:16Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component maintain-kubeusers 2443894 wikitext text/x-wiki hqxk7i9ftyraetq2tmafdkck1wemoe6 2443907 2443894 2026-08-04T11:07:44Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component maintain-kubeusers 2443907 wikitext text/x-wiki sclqaoz5laae15yff5vuwbcjxaqdx3k 0 7919 2443483 2443482 2026-08-03T12:00:40Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.reimage for host ms-be2087.codfw.wmnet with OS trixie 2443483 wikitext text/x-wiki pgk1b0oiy37dvzc79c3o9i6ly7z4ac8 2443484 2443483 2026-08-03T12:00:42Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.reimage for host ms-be1089.eqiad.wmnet with OS trixie 2443484 wikitext text/x-wiki nckccs7wru2pv1wiv15hpnapue0gi0d 2443485 2443484 2026-08-03T12:03:39Z Stashbot 7414 kamila@deploy1003: Started scap sync-world: rebuild after base image update 2443485 wikitext text/x-wiki 9j82qzr1qiu6ys7mfnl2qmk622q8jmy 2443486 2443485 2026-08-03T12:14:12Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1089.eqiad.wmnet with reason: host reimage 2443486 wikitext text/x-wiki ar58rdz9siprhlla9qsx2xbwm0f73iz 2443487 2443486 2026-08-03T12:14:48Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2087.codfw.wmnet with reason: host reimage 2443487 wikitext text/x-wiki 12xyhvowui953k4pxgj8ikll3290yy1 2443488 2443487 2026-08-03T12:19:26Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1089.eqiad.wmnet with reason: host reimage 2443488 wikitext text/x-wiki 216aqac9vyxsjdrilqfk1pamqb1zhce 2443489 2443488 2026-08-03T12:22:05Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2087.codfw.wmnet with reason: host reimage 2443489 wikitext text/x-wiki 5iqzp1rdk15qelcxe5c7bui7kxoi5at 2443490 2443489 2026-08-03T12:22:50Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-staging-codfw] Ran 'sync' command on namespace 'experimental' for release 'main' . 2443490 wikitext text/x-wiki mdwz7oqhd9j9wowi2c59n8kbgoj4smj 2443491 2443490 2026-08-03T12:28:53Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-staging-codfw] 'sync' command on namespace 'tts-section-generator' for release 'main' . 2443491 wikitext text/x-wiki toy0jetmlriiaoevi1qfu1ln20yrv8a 2443492 2443491 2026-08-03T12:32:57Z Stashbot 7414 kamila@deploy1003: Finished scap sync-world: rebuild after base image update (duration: 30m 26s) 2443492 wikitext text/x-wiki ok14de4971bgae4zj11cpo8ruthudd9 2443493 2443492 2026-08-03T12:34:03Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.multiinstance_reboot for db[2245-2247].codfw.wmnet 2443493 wikitext text/x-wiki 17qipiaoy6htbbsc5q3do3qh27579an 2443494 2443493 2026-08-03T12:34:30Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.depool depool db2245: Rebooting db2245.codfw.wmnet 2443494 wikitext text/x-wiki 2shqybnx3g8uoymyoszkm7hgiyoheff 2443495 2443494 2026-08-03T12:34:39Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2245: Rebooting db2245.codfw.wmnet 2443495 wikitext text/x-wiki 94xspw208b440e85digof3jr84mqgh6 2443496 2443495 2026-08-03T12:37:15Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1089.eqiad.wmnet with OS trixie 2443496 wikitext text/x-wiki orankgvm7w7wbbp7onswdn11hq2eu42 2443497 2443496 2026-08-03T12:40:00Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2087.codfw.wmnet with OS trixie 2443497 wikitext text/x-wiki qb6u9lhi45s9rgyxo9702tvd0wm7d64 2443498 2443497 2026-08-03T12:42:09Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.depool depool db2246: Rebooting db2246.codfw.wmnet 2443498 wikitext text/x-wiki gjs4mlcm5j4sdc1ncafauhxxrxz59k2 2443499 2443498 2026-08-03T12:42:19Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2246: Rebooting db2246.codfw.wmnet 2443499 wikitext text/x-wiki arsmdw0dlnmztkde4whqn9f261o2dr9 2443501 2443499 2026-08-03T12:49:14Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.mysql.depool depool db2247: Rebooting db2247.codfw.wmnet 2443501 wikitext text/x-wiki su5xfgr5yox3tcs0ixyqqv1z8z7m1j1 2443502 2443501 2026-08-03T12:49:23Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.depool (exit_code=0) depool db2247: Rebooting db2247.codfw.wmnet 2443502 wikitext text/x-wiki tgd8mprzfgw8zdmvt54hbrfkt6dbbb3 2443503 2443502 2026-08-03T12:56:06Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.mysql.multiinstance_reboot (exit_code=0) for db[2245-2247].codfw.wmnet 2443503 wikitext text/x-wiki cupwg4olzaj9mefxy8327iv40xc13qa 2443504 2443503 2026-08-03T12:58:43Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.reimage for host ms-be2088.codfw.wmnet with OS trixie 2443504 wikitext text/x-wiki ba689mh12rr9by5uq3duyfclaq59mlp 2443505 2443504 2026-08-03T13:05:58Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.reimage for host ms-be1090.eqiad.wmnet with OS trixie 2443505 wikitext text/x-wiki hfe5cmz54ikkh9mfwb8i1dl1hne7rxh 2443508 2443505 2026-08-03T13:08:19Z Stashbot 7414 aude@deploy1003: Started scap sync-world: Backport for [[gerrit:1320149|Enable Special:ChartWizard on Wikimedia Commons (T433831)]], [[gerrit:1319854|enable CampaignEvents worklists (T429507 T429508)]] 2443508 wikitext text/x-wiki noe7oj8flknx3el68r9bfo950ctatcd 2443509 2443508 2026-08-03T13:12:14Z Stashbot 7414 aude@deploy1003: aude, mhorsey: Backport for [[gerrit:1320149|Enable Special:ChartWizard on Wikimedia Commons (T433831)]], [[gerrit:1319854|enable CampaignEvents worklists (T429507 T429508)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2443509 wikitext text/x-wiki m93id7918tmqmwfi9bhv4onl62gfvbc 2443510 2443509 2026-08-03T13:12:48Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2088.codfw.wmnet with reason: host reimage 2443510 wikitext text/x-wiki j3uq8ipft6vv939brmp8caa2y815q7o 2443511 2443510 2026-08-03T13:16:26Z Stashbot 7414 aude@deploy1003: aude, mhorsey: Continuing with deployment 2443511 wikitext text/x-wiki 84ya6fcmg4jyez0pba0g8otbufltxyr 2443512 2443511 2026-08-03T13:18:35Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2088.codfw.wmnet with reason: host reimage 2443512 wikitext text/x-wiki phn7uhxv7ra10ma2wsgrog41bf6dzjt 2443513 2443512 2026-08-03T13:19:26Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1090.eqiad.wmnet with reason: host reimage 2443513 wikitext text/x-wiki hsiof6ugtiut421xk011nffzkwgar7j 2443514 2443513 2026-08-03T13:22:53Z Stashbot 7414 aude@deploy1003: Finished scap sync-world: Backport for [[gerrit:1320149|Enable Special:ChartWizard on Wikimedia Commons (T433831)]], [[gerrit:1319854|enable CampaignEvents worklists (T429507 T429508)]] (duration: 14m 34s) 2443514 wikitext text/x-wiki ef4piarserd7a2jjjm86if6czi1pz55 2443515 2443514 2026-08-03T13:22:59Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1090.eqiad.wmnet with reason: host reimage 2443515 wikitext text/x-wiki 2lebaddqmqsuc2dtqurv70zdhu9r4pk 2443517 2443515 2026-08-03T13:40:36Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1090.eqiad.wmnet with OS trixie 2443517 wikitext text/x-wiki d0dga8vr00rr3d00bcdvy7wauj5688q 2443518 2443517 2026-08-03T13:40:46Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2088.codfw.wmnet with OS trixie 2443518 wikitext text/x-wiki 8ejfzz6hjd4v2p61jzmnzdbyzfqg2zh 2443520 2443518 2026-08-03T13:50:34Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.reimage for host ms-be2089.codfw.wmnet with OS trixie 2443520 wikitext text/x-wiki rnj8nqejxnb5txet8vqig506rx0zlie 2443523 2443520 2026-08-03T14:09:41Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2089.codfw.wmnet with reason: host reimage 2443523 wikitext text/x-wiki 37hkhl35gn653dbabny2du9ggq84dcy 2443524 2443523 2026-08-03T14:10:44Z Stashbot 7414 ladsgroup@deploy1003: helmfile [staging] START helmfile.d/services/thumbor: apply 2443524 wikitext text/x-wiki ia65d33kietxzcue6rr62l5f6ijeca1 2443525 2443524 2026-08-03T14:10:57Z Stashbot 7414 ladsgroup@deploy1003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2443525 wikitext text/x-wiki l7p63o6hdqlckhbv3wsndpbij3f3t22 2443527 2443525 2026-08-03T14:14:34Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2089.codfw.wmnet with reason: host reimage 2443527 wikitext text/x-wiki 5aa8e12zem6ls34ubnor5k9jmzft4om 2443528 2443527 2026-08-03T14:16:03Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2443528 wikitext text/x-wiki 8v00uhhmghq8kkb4cml2q2apa6b2ahz 2443529 2443528 2026-08-03T14:18:28Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2443529 wikitext text/x-wiki ee8a6wnucugjt3qfj2yr0tk3xg058ct 2443534 2443529 2026-08-03T14:27:27Z Stashbot 7414 ladsgroup@deploy1003: helmfile [eqiad] START helmfile.d/services/thumbor: apply 2443534 wikitext text/x-wiki 1nucvnoxiq0wfdpaum1d0f8mdzsqeb6 2443535 2443534 2026-08-03T14:29:49Z Stashbot 7414 ladsgroup@deploy1003: helmfile [eqiad] DONE helmfile.d/services/thumbor: apply 2443535 wikitext text/x-wiki qk7w3j3udq136thuxt7eq9uomb4qn07 2443536 2443535 2026-08-03T14:33:26Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2089.codfw.wmnet with OS trixie 2443536 wikitext text/x-wiki kjeo22tsq7sr9zjotmfv2pbnawlffdz 2443537 2443536 2026-08-03T14:49:47Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.reimage for host ms-be1091.eqiad.wmnet with OS trixie 2443537 wikitext text/x-wiki 2l2xwmvhtwnyd20e5nqw76kjk7gtwyy 2443542 2443537 2026-08-03T15:03:05Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1091.eqiad.wmnet with reason: host reimage 2443542 wikitext text/x-wiki 1kuibjihvbuwwize0ivkc6ty97qed07 2443543 2443542 2026-08-03T15:07:29Z Stashbot 7414 dancy@deploy1003: Installing scap version "4.277.0" for 3 host(s) 2443543 wikitext text/x-wiki 10cx2vid5lns1t3z5o9h8irpe3ilq35 2443544 2443543 2026-08-03T15:08:18Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1091.eqiad.wmnet with reason: host reimage 2443544 wikitext text/x-wiki 580gugv9fx6di56qwr5wdkh2fskx64s 2443545 2443544 2026-08-03T15:09:25Z Stashbot 7414 dancy@deploy1003: Installation of scap version "4.277.0" completed for 3 hosts 2443545 wikitext text/x-wiki banpfa7wmrbs3y736lobhbcs00b2qiw 2443546 2443545 2026-08-03T15:09:51Z Stashbot 7414 dancy@deploy1003: Started scap sync-world: testing 2443546 wikitext text/x-wiki 0t5zlfuwlwbi78yqm06y8wya29kt9pw 2443547 2443546 2026-08-03T15:12:16Z Stashbot 7414 marostegui@cumin1003: dbctl commit (dc=all): 'Repool db2245, db2246, db2247 and db2248 T433610', diff saved to https://phabricator.wikimedia.org/P95857 and previous config saved to /var/cache/conftool/dbconfig/20260803-151212-marostegui.json 2443547 wikitext text/x-wiki pixi3m2oeh24po4q8lrvnn74f073p62 2443550 2443547 2026-08-03T15:18:30Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.reimage for host ms-be2090.codfw.wmnet with OS trixie 2443550 wikitext text/x-wiki fk1t83r5dk3jl0m1i9tu0vo3f21zref 2443552 2443550 2026-08-03T15:23:41Z Stashbot 7414 dancy@deploy1003: Installing scap version "4.276.1" for 3 host(s) 2443552 wikitext text/x-wiki 8metseua2egbx6j49ey0b9411nao4s6 2443553 2443552 2026-08-03T15:25:27Z Stashbot 7414 dancy@deploy1003: Installation of scap version "4.276.1" completed for 3 hosts 2443553 wikitext text/x-wiki 7l2rlwhkz4i0w2pzrfvfvf1x595b4t0 2443554 2443553 2026-08-03T15:26:22Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1091.eqiad.wmnet with OS trixie 2443554 wikitext text/x-wiki neg8u7286nby5n6j5c9u1baxwlq65oe 2443556 2443554 2026-08-03T15:31:49Z Stashbot 7414 jhathaway@dns1004: START - running authdns-update 2443556 wikitext text/x-wiki l60uhlxlzt0outkeagunsj6dc3rhyzy 2443557 2443556 2026-08-03T15:33:38Z Stashbot 7414 jhathaway@dns1004: END - running authdns-update 2443557 wikitext text/x-wiki 3cqb1t4e175n1ze0hj35mgkxu9az3bv 2443558 2443557 2026-08-03T15:39:39Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2090.codfw.wmnet with reason: host reimage 2443558 wikitext text/x-wiki 728kb635whf4oz673c27x4qxpqaoont 2443560 2443558 2026-08-03T15:43:08Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2090.codfw.wmnet with reason: host reimage 2443560 wikitext text/x-wiki 2nwti6j4y9h2eh8kok7nckbb1scnuwm 2443561 2443560 2026-08-03T15:50:56Z Stashbot 7414 jiji@deploy1003: helmfile [staging] START helmfile.d/services/rest-gateway: apply 2443561 wikitext text/x-wiki ln2jn55rk1t5u8uj3md54jr1pxjiki7 2443562 2443561 2026-08-03T15:51:07Z Stashbot 7414 jiji@deploy1003: helmfile [staging] DONE helmfile.d/services/rest-gateway: apply 2443562 wikitext text/x-wiki ok77jeom40rn4q3yyb88f7mx4hm6xy0 2443563 2443562 2026-08-03T15:51:20Z Stashbot 7414 jiji@deploy1003: helmfile [codfw] START helmfile.d/services/rest-gateway: apply 2443563 wikitext text/x-wiki obpapprkr38oobtl1pkvyf5pe5mtxek 2443564 2443563 2026-08-03T15:51:41Z Stashbot 7414 jiji@deploy1003: helmfile [codfw] DONE helmfile.d/services/rest-gateway: apply 2443564 wikitext text/x-wiki qzfarcvjrrj9t93u7gz2ea7exjyzncz 2443567 2443564 2026-08-03T16:02:51Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2090.codfw.wmnet with OS trixie 2443567 wikitext text/x-wiki tquwd8rgf4s4tcaf9w5dygaxxs19xin 2443568 2443567 2026-08-03T16:03:08Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.reimage for host ms-be1092.eqiad.wmnet with OS trixie 2443568 wikitext text/x-wiki pnai2een0br7fg23zs4xqm4ouxvw6j2 2443569 2443568 2026-08-03T16:14:12Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.reimage for host ms-be2091.codfw.wmnet with OS trixie 2443569 wikitext text/x-wiki g9y4ruh58pwyj92joyu2z9guhxoidf2 2443570 2443569 2026-08-03T16:23:31Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1092.eqiad.wmnet with reason: host reimage 2443570 wikitext text/x-wiki tdd7rafijhxk49vwn83g7xcrj9pahic 2443571 2443570 2026-08-03T16:24:31Z Stashbot 7414 jiji@deploy1003: helmfile [eqiad] START helmfile.d/services/rest-gateway: apply 2443571 wikitext text/x-wiki jtxgszefb8379omkcbp6lmhp4d4vumz 2443572 2443571 2026-08-03T16:24:55Z Stashbot 7414 jiji@deploy1003: helmfile [eqiad] DONE helmfile.d/services/rest-gateway: apply 2443572 wikitext text/x-wiki 47s2h9kgq3b42wva4bxyumk8hlp4otg 2443573 2443572 2026-08-03T16:28:07Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1092.eqiad.wmnet with reason: host reimage 2443573 wikitext text/x-wiki 7w6s4nlccju7gnhyodru1v87pxqutct 2443574 2443573 2026-08-03T16:35:18Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2091.codfw.wmnet with reason: host reimage 2443574 wikitext text/x-wiki 50uughps9bzcmyylpa299e8rro9oto0 2443576 2443574 2026-08-03T16:37:46Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.dns.netbox 2443576 wikitext text/x-wiki rx00hy3o9gvztvsjy6hn9gcnq8rr5ym 2443577 2443576 2026-08-03T16:38:41Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2091.codfw.wmnet with reason: host reimage 2443577 wikitext text/x-wiki 54yb5759c0ybt069ck0uerefwspegf8 2443579 2443577 2026-08-03T16:40:57Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2443579 wikitext text/x-wiki 20qsodn0v3kxqd7fmgu2m85urfhrzdk 2443580 2443579 2026-08-03T16:41:16Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host mc2046 2443580 wikitext text/x-wiki gm14h61sw8qe4n9a5n8jwbuicd3ilyd 2443581 2443580 2026-08-03T16:41:25Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host mc2046 2443581 wikitext text/x-wiki 4ulxlh8zeevuo6zix9ibngrwgwvlt2p 2443582 2443581 2026-08-03T16:43:13Z Stashbot 7414 dzahn@cumin2002: START - Cookbook sre.ganeti.makevm for new host codesearch1001.eqiad.wmnet 2443582 wikitext text/x-wiki 9f9naiqjvobtonbxgp572um8s5gva57 2443583 2443582 2026-08-03T16:43:15Z Stashbot 7414 dzahn@cumin2002: START - Cookbook sre.dns.netbox 2443583 wikitext text/x-wiki f5kp1de29mkayry36uvcu5m6ehm6bqk 2443584 2443583 2026-08-03T16:43:17Z Stashbot 7414 ebernhardson@deploy1003: helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply 2443584 wikitext text/x-wiki cc5pi4187ctwbwj6f7jyms7xej3lz65 2443585 2443584 2026-08-03T16:43:21Z Stashbot 7414 ebernhardson@deploy1003: helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply 2443585 wikitext text/x-wiki i0klikjiw3xlzes0it8it7d80akl1ve 2443586 2443585 2026-08-03T16:46:11Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1092.eqiad.wmnet with OS trixie 2443586 wikitext text/x-wiki a1wb489ame1z164mya7a60mb4r8495l 2443588 2443586 2026-08-03T16:49:06Z Stashbot 7414 ebernhardson@deploy1003: helmfile [codfw] START helmfile.d/services/cirrus-streaming-updater: apply 2443588 wikitext text/x-wiki 7pof1rndkpdcv8emind4rmwswzdcr5z 2443589 2443588 2026-08-03T16:49:13Z Stashbot 7414 ebernhardson@deploy1003: helmfile [codfw] DONE helmfile.d/services/cirrus-streaming-updater: apply 2443589 wikitext text/x-wiki dx1iye8tglh69htwcnff7rannt7t3sb 2443593 2443589 2026-08-03T16:54:29Z Stashbot 7414 ebernhardson@deploy1003: helmfile [staging] START helmfile.d/services/cirrus-streaming-updater: apply 2443593 wikitext text/x-wiki clriv3682l3deh10fkmtsrxr0ch69wb 2443594 2443593 2026-08-03T16:54:33Z Stashbot 7414 ebernhardson@deploy1003: helmfile [staging] DONE helmfile.d/services/cirrus-streaming-updater: apply 2443594 wikitext text/x-wiki fguoywwzk4xw2t78ihozhrdw0yib6fw 2443595 2443594 2026-08-03T16:57:02Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2091.codfw.wmnet with OS trixie 2443595 wikitext text/x-wiki 3mtqxg2sw0ksxwy7thppmlo6dbewng9 2443596 2443595 2026-08-03T16:58:55Z Stashbot 7414 dzahn@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM codesearch1001.eqiad.wmnet - dzahn@cumin2002" 2443596 wikitext text/x-wiki cye3d69nqqrjawpu7sn2kb5er1u85g3 2443597 2443596 2026-08-03T17:04:05Z Stashbot 7414 rzl@deploy1003: helmfile [staging] START helmfile.d/services/changeprop-jobqueue: apply 2443597 wikitext text/x-wiki 4btbx7pdeeg2cdw6bzq9k71qufr8571 2443598 2443597 2026-08-03T17:04:22Z Stashbot 7414 rzl@deploy1003: helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: apply 2443598 wikitext text/x-wiki cyhumr8m8f1mv0yk7yiwjwb689o71yk 2443599 2443598 2026-08-03T17:05:47Z Stashbot 7414 rzl@deploy1003: helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply 2443599 wikitext text/x-wiki rvgam7u69dykq3vxt2lfucbjyw8pe1k 2443601 2443599 2026-08-03T17:06:04Z Stashbot 7414 dzahn@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM codesearch1001.eqiad.wmnet - dzahn@cumin2002" 2443601 wikitext text/x-wiki cojqyrlpb5rv8e6udgn7s33znfcibhd 2443602 2443601 2026-08-03T17:06:06Z Stashbot 7414 dzahn@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2443602 wikitext text/x-wiki 1ic125g5ydtyp0rxshldkvg2i8pejbo 2443603 2443602 2026-08-03T17:06:08Z Stashbot 7414 dzahn@cumin2002: START - Cookbook sre.dns.wipe-cache codesearch1001.eqiad.wmnet on all recursors 2443603 wikitext text/x-wiki 3sgh8ue0od6i7vplwfd6pljp11da5le 2443604 2443603 2026-08-03T17:06:10Z Stashbot 7414 dzahn@cumin2002: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) codesearch1001.eqiad.wmnet on all recursors 2443604 wikitext text/x-wiki pw8u6was0v7q4qwmqma4jhxytavpyny 2443605 2443604 2026-08-03T17:06:37Z Stashbot 7414 dzahn@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM codesearch1001.eqiad.wmnet - dzahn@cumin2002" 2443605 wikitext text/x-wiki 94wk14rg5ag9z0odck2ucj5yo2pzidm 2443606 2443605 2026-08-03T17:06:40Z Stashbot 7414 rzl@deploy1003: helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply 2443606 wikitext text/x-wiki p8c18bonwyanugoims6plcjj3qrvfk2 2443607 2443606 2026-08-03T17:06:43Z Stashbot 7414 dzahn@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM codesearch1001.eqiad.wmnet - dzahn@cumin2002" 2443607 wikitext text/x-wiki sc4pmzbt2jjt6wavier5vmo130po5l2 2443610 2443607 2026-08-03T17:08:45Z Stashbot 7414 dzahn@cumin2002: START - Cookbook sre.hosts.reimage for host codesearch1001.eqiad.wmnet with OS trixie 2443610 wikitext text/x-wiki aa7nqvrmqk01ya97np0kusptvg38ppu 2443614 2443610 2026-08-03T17:17:31Z Stashbot 7414 dzahn@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on codesearch1001.eqiad.wmnet with reason: host reimage 2443614 wikitext text/x-wiki mta2yvv7cyod8lhsizknqz00a4jvr8l 2443616 2443614 2026-08-03T17:24:58Z Stashbot 7414 dzahn@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on codesearch1001.eqiad.wmnet with reason: host reimage 2443616 wikitext text/x-wiki mnrg5fyjonum6ditwpiu22mzf0igr7n 2443621 2443616 2026-08-03T17:37:53Z Stashbot 7414 dzahn@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host codesearch1001.eqiad.wmnet with OS trixie 2443621 wikitext text/x-wiki g2pllfee7u82pbpg01ax88hlnee76oo 2443622 2443621 2026-08-03T17:37:56Z Stashbot 7414 dzahn@cumin2002: END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host codesearch1001.eqiad.wmnet 2443622 wikitext text/x-wiki lavnk1w4pa45lvmlgzechuk8q4jtg99 2443623 2443622 2026-08-03T17:41:45Z Stashbot 7414 dzahn@cumin2002: START - Cookbook sre.ganeti.makevm for new host codesearch2001.codfw.wmnet 2443623 wikitext text/x-wiki 4s7bj3zi0ekrfd7cybe3k4edrgz2t3a 2443624 2443623 2026-08-03T17:41:48Z Stashbot 7414 dzahn@cumin2002: START - Cookbook sre.dns.netbox 2443624 wikitext text/x-wiki t5nnkn0h2os5pixiox7r5euspnxr3lo 2443625 2443624 2026-08-03T17:48:26Z Stashbot 7414 dzahn@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM codesearch2001.codfw.wmnet - dzahn@cumin2002" 2443625 wikitext text/x-wiki 2xisdw1qpno1wmgokxymzgbhqrkyzaf 2443627 2443625 2026-08-03T17:53:28Z Stashbot 7414 dzahn@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add records for VM codesearch2001.codfw.wmnet - dzahn@cumin2002" 2443627 wikitext text/x-wiki kqo882xedavxakecsr8my9tsqk78tun 2443628 2443627 2026-08-03T17:53:31Z Stashbot 7414 dzahn@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2443628 wikitext text/x-wiki hkw4i1b7jx2pw1xw67xzv8lpnj9bn59 2443629 2443628 2026-08-03T17:53:33Z Stashbot 7414 dzahn@cumin2002: START - Cookbook sre.dns.wipe-cache codesearch2001.codfw.wmnet on all recursors 2443629 wikitext text/x-wiki 1u211zk4dj3udp179f1zuloui3iap3m 2443630 2443629 2026-08-03T17:53:35Z Stashbot 7414 dzahn@cumin2002: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) codesearch2001.codfw.wmnet on all recursors 2443630 wikitext text/x-wiki 51b7bb9xr5ep27f8usbcokvisv9r92r 2443631 2443630 2026-08-03T17:54:05Z Stashbot 7414 dzahn@cumin2002: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM codesearch2001.codfw.wmnet - dzahn@cumin2002" 2443631 wikitext text/x-wiki nrue3h3r36aqo1vkp52ln05dm9cp7qm 2443632 2443631 2026-08-03T17:54:11Z Stashbot 7414 dzahn@cumin2002: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.ganeti.makevm: created new VM codesearch2001.codfw.wmnet - dzahn@cumin2002" 2443632 wikitext text/x-wiki hub9gen0g1c9s5pb9zkmbhp49g52glo 2443633 2443632 2026-08-03T17:55:14Z Stashbot 7414 dzahn@cumin2002: START - Cookbook sre.hosts.reimage for host codesearch2001.codfw.wmnet with OS trixie 2443633 wikitext text/x-wiki p0qoll5ebuz3n2ohkmxbap4225t32yb 2443634 2443633 2026-08-03T18:01:17Z Stashbot 7414 rzl@deploy1003: helmfile [staging] START helmfile.d/services/changeprop-jobqueue: apply 2443634 wikitext text/x-wiki a55wnwozxp68h4p52jbjf6xlyij7t2g 2443635 2443634 2026-08-03T18:01:28Z Stashbot 7414 rzl@deploy1003: helmfile [staging] DONE helmfile.d/services/changeprop-jobqueue: apply 2443635 wikitext text/x-wiki gka88zr0giyctkbk8pm0809o7a0b360 2443636 2443635 2026-08-03T18:02:16Z Stashbot 7414 rzl@deploy1003: helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply 2443636 wikitext text/x-wiki pjs6psapuy9g9ao9vzbgg7qu7bvf8yr 2443637 2443636 2026-08-03T18:02:56Z Stashbot 7414 rzl@deploy1003: helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply 2443637 wikitext text/x-wiki 1r52j75br0nwcoqqqab9pe9hn2u2u9u 2443638 2443637 2026-08-03T18:10:59Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host mc2046 2443638 wikitext text/x-wiki 9cqfny6qeeoxtjscsl7rvq77i8mao95 2443639 2443638 2026-08-03T18:11:17Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host mc2046 2443639 wikitext text/x-wiki dq2040htkxoyulrx8ct301u20sgtlcm 2443640 2443639 2026-08-03T18:11:26Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.dns.netbox 2443640 wikitext text/x-wiki nca1puzd7u6zetbkjhksfvlk8xl90hk 2443641 2443640 2026-08-03T18:12:39Z Stashbot 7414 dzahn@cumin2002: START - Cookbook sre.hosts.downtime for 2:00:00 on codesearch2001.codfw.wmnet with reason: host reimage 2443641 wikitext text/x-wiki ffyeq5mvdauh0y10wf8whhucx6i0j2a 2443642 2443641 2026-08-03T18:14:39Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2443642 wikitext text/x-wiki 65t3eec14b8aqk8r1qxuofczwnm9i32 2443643 2443642 2026-08-03T18:14:48Z Stashbot 7414 jhancock@cumin2002: START - Cookbook sre.network.configure-switch-interfaces for host mc2046 2443643 wikitext text/x-wiki 60e6ilz4wmv4893i8fnevd04sn0ivhb 2443644 2443643 2026-08-03T18:18:30Z Stashbot 7414 dzahn@cumin2002: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on codesearch2001.codfw.wmnet with reason: host reimage 2443644 wikitext text/x-wiki 4qdf38htwx6h4ns6k7swdel527s62k2 2443645 2443644 2026-08-03T18:19:59Z Stashbot 7414 jhancock@cumin2002: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host mc2046 2443645 wikitext text/x-wiki rslz7zvr839kci6o860muxm2iuiwy1v 2443646 2443645 2026-08-03T18:27:25Z Stashbot 7414 krinkle@deploy1003: Started scap sync-world: Backport for [[gerrit:1319868|logging: Remove mention of 'fatal' channel that no longer exists (T247113)]] 2443646 wikitext text/x-wiki 3t1o6030qqmx068ph64ctv561vny1tt 2443647 2443646 2026-08-03T18:29:13Z Stashbot 7414 krinkle@deploy1003: krinkle: Backport for [[gerrit:1319868|logging: Remove mention of 'fatal' channel that no longer exists (T247113)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2443647 wikitext text/x-wiki fw1ujjcpkrd4r4r1rek8ps1kqrb2crz 2443648 2443647 2026-08-03T18:33:28Z Stashbot 7414 krinkle@deploy1003: krinkle: Continuing with deployment 2443648 wikitext text/x-wiki 7pcwcac1oqbx8yde17jtboxtopn6ie9 2443649 2443648 2026-08-03T18:34:20Z Stashbot 7414 dzahn@cumin2002: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host codesearch2001.codfw.wmnet with OS trixie 2443649 wikitext text/x-wiki 143p0x7vdi3a160czl9fs3r635c36ez 2443650 2443649 2026-08-03T18:34:22Z Stashbot 7414 dzahn@cumin2002: END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) for new host codesearch2001.codfw.wmnet 2443650 wikitext text/x-wiki jqj8vk1tju36tlqa5wdlh0q2imyr7ct 2443651 2443650 2026-08-03T18:37:37Z Stashbot 7414 krinkle@deploy1003: Finished scap sync-world: Backport for [[gerrit:1319868|logging: Remove mention of 'fatal' channel that no longer exists (T247113)]] (duration: 10m 13s) 2443651 wikitext text/x-wiki sv0wlpzf4sr0vvbpw3aw1ms6aiya6wx 2443652 2443651 2026-08-03T18:48:44Z Stashbot 7414 krinkle@deploy1003: Started scap sync-world: Backport for [[gerrit:1311041|MathML+MathJax rollout to phase 2 (not Wikibooks/Wikisource/Wikipedia) (T271001)]] 2443652 wikitext text/x-wiki 511b1klo1uil1o77w1lh7onhos9vlxw 2443653 2443652 2026-08-03T18:50:31Z Stashbot 7414 krinkle@deploy1003: krinkle: Backport for [[gerrit:1311041|MathML+MathJax rollout to phase 2 (not Wikibooks/Wikisource/Wikipedia) (T271001)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2443653 wikitext text/x-wiki bfrfprm2cwt7judjll76x0htlphxwa2 2443654 2443653 2026-08-03T18:53:06Z Stashbot 7414 jasmine@cumin2002: START - Cookbook sre.kafka.roll-restart-reboot-brokers rolling reboot on A:kafka-main-codfw 2443654 wikitext text/x-wiki ae9fphum605ui9nlyuni7bml5h66os9 2443655 2443654 2026-08-03T18:54:00Z Stashbot 7414 krinkle@deploy1003: krinkle: Continuing with deployment 2443655 wikitext text/x-wiki bmt78c3dyujt8w2zbd0s0685ox61n38 2443656 2443655 2026-08-03T18:58:08Z Stashbot 7414 krinkle@deploy1003: Finished scap sync-world: Backport for [[gerrit:1311041|MathML+MathJax rollout to phase 2 (not Wikibooks/Wikisource/Wikipedia) (T271001)]] (duration: 09m 23s) 2443656 wikitext text/x-wiki 47yerhvo75pcjvnws6e9q5xducqgnlh 2443660 2443656 2026-08-03T19:45:26Z Stashbot 7414 jasmine@cumin2002: END (PASS) - Cookbook sre.kafka.roll-restart-reboot-brokers (exit_code=0) rolling reboot on A:kafka-main-codfw 2443660 wikitext text/x-wiki s4ivam8e9io3z23hgvg5nffm7stfi60 2443664 2443660 2026-08-03T20:07:42Z Stashbot 7414 krinkle@deploy1003: Started scap sync-world: Backport for [[gerrit:1319903|Re-enable wgTrackMediaRequestProvenance on Commons and Wikipedia (T414338)]] 2443664 wikitext text/x-wiki 2f7u488dyk8cj9fhb641pfsh58rufrf 2443666 2443664 2026-08-03T20:09:32Z Stashbot 7414 krinkle@deploy1003: krinkle: Backport for [[gerrit:1319903|Re-enable wgTrackMediaRequestProvenance on Commons and Wikipedia (T414338)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2443666 wikitext text/x-wiki sljk92ri98a9h8fszymip0jkrgc8rqo 2443667 2443666 2026-08-03T20:12:03Z Stashbot 7414 krinkle@deploy1003: krinkle: Continuing with deployment 2443667 wikitext text/x-wiki ojlmzthuvj0m4drxkk5qk5s9b0pt9ap 2443668 2443667 2026-08-03T20:16:09Z Stashbot 7414 krinkle@deploy1003: Finished scap sync-world: Backport for [[gerrit:1319903|Re-enable wgTrackMediaRequestProvenance on Commons and Wikipedia (T414338)]] (duration: 08m 26s) 2443668 wikitext text/x-wiki sc9mxo9g7dz1lggebh3xk94ettn6kfa 2443670 2443668 2026-08-03T20:34:49Z Stashbot 7414 arlolra@deploy1003: Started scap sync-world: Backport for [[gerrit:1320179|Turn on PRV for all namespaces on enwiki (T430194)]] 2443670 wikitext text/x-wiki kfz82uhl07m2uk1x16scbujuca3o35m 2443672 2443670 2026-08-03T20:36:37Z Stashbot 7414 arlolra@deploy1003: arlolra: Backport for [[gerrit:1320179|Turn on PRV for all namespaces on enwiki (T430194)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2443672 wikitext text/x-wiki q79zhq1lyvp78lgs6pagezpfmuqkswo 2443673 2443672 2026-08-03T20:38:20Z Stashbot 7414 arlolra@deploy1003: arlolra: Continuing with deployment 2443673 wikitext text/x-wiki 9kcb7mjowcuvnz9bgghji1wvfvlaico 2443674 2443673 2026-08-03T20:42:26Z Stashbot 7414 arlolra@deploy1003: Finished scap sync-world: Backport for [[gerrit:1320179|Turn on PRV for all namespaces on enwiki (T430194)]] (duration: 07m 36s) 2443674 wikitext text/x-wiki qhi5m6v3ukkd7uc69594qcsfk0wks8o 2443677 2443674 2026-08-03T20:46:08Z Stashbot 7414 cjming@deploy1003: Started scap sync-world: Backport for [[gerrit:1320215|eventLogUtils: Set schema on Test Kitchen instrument before send (T433550)]] 2443677 wikitext text/x-wiki sdx5l7f74clkdqln8nizzjiqjua878r 2443678 2443677 2026-08-03T20:47:55Z Stashbot 7414 cjming@deploy1003: cjming: Backport for [[gerrit:1320215|eventLogUtils: Set schema on Test Kitchen instrument before send (T433550)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2443678 wikitext text/x-wiki 0sq3vxxds213m4e6v417q6acf7a6oso 2443680 2443678 2026-08-03T20:48:17Z Stashbot 7414 cjming@deploy1003: cjming: Continuing with deployment 2443680 wikitext text/x-wiki 8lg658haqhlx0eiq34oau4itv1yfwvr 2443681 2443680 2026-08-03T20:52:40Z Stashbot 7414 cjming@deploy1003: Finished scap sync-world: Backport for [[gerrit:1320215|eventLogUtils: Set schema on Test Kitchen instrument before send (T433550)]] (duration: 06m 23s) 2443681 wikitext text/x-wiki 4zexdy9bpt25nr8mogm1jttopvd3zll 2443682 2443681 2026-08-03T20:56:51Z Stashbot 7414 dancy@deploy1003: Started scap sync-world: Backport for [[gerrit:1315968|wmf-config/logging.php: Adjustments for WMF_MAINTENANCE_OFFLINE (T433104)]] 2443682 wikitext text/x-wiki 6yaidn2m3qvzd5glmayghmvd8ae3381 2443683 2443682 2026-08-03T20:58:37Z Stashbot 7414 dancy@deploy1003: dancy: Backport for [[gerrit:1315968|wmf-config/logging.php: Adjustments for WMF_MAINTENANCE_OFFLINE (T433104)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2443683 wikitext text/x-wiki 94up44ou7n2o3xop1kkp0cnd9bua85h 2443684 2443683 2026-08-03T20:59:07Z Stashbot 7414 dancy@deploy1003: dancy: Continuing with deployment 2443684 wikitext text/x-wiki njpsro5v5xuw1pfn0orhv84z1a9n7i7 2443685 2443684 2026-08-03T21:03:26Z Stashbot 7414 dancy@deploy1003: Finished scap sync-world: Backport for [[gerrit:1315968|wmf-config/logging.php: Adjustments for WMF_MAINTENANCE_OFFLINE (T433104)]] (duration: 06m 34s) 2443685 wikitext text/x-wiki 4j35gtb8fceoznsv7j5a7nraqpg04h9 2443686 2443685 2026-08-03T21:21:13Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.reimage for host search-loader2002.codfw.wmnet with OS trixie 2443686 wikitext text/x-wiki adnu0buajh50gaf10iauvut0hzbo6xz 2443687 2443686 2026-08-03T21:31:04Z Stashbot 7414 dancy@deploy1003: Started scap sync-world: Backport for [[gerrit:1320233|mergeMessageFileList: Suppress "doesn't exist" error when --quiet (T125678 T433104)]] 2443687 wikitext text/x-wiki d1xealxaviodcgxst4xa77j2rc4m0nn 2443689 2443687 2026-08-03T21:32:52Z Stashbot 7414 dancy@deploy1003: dancy: Backport for [[gerrit:1320233|mergeMessageFileList: Suppress "doesn't exist" error when --quiet (T125678 T433104)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2443689 wikitext text/x-wiki 9zgwnhl2bznfbz4j2f66ly6dwzc0x8l 2443690 2443689 2026-08-03T21:33:10Z Stashbot 7414 dancy@deploy1003: dancy: Continuing with deployment 2443690 wikitext text/x-wiki tmhyh7yh2iqcpindyug2j86him8qnmu 2443691 2443690 2026-08-03T21:37:17Z Stashbot 7414 dancy@deploy1003: Finished scap sync-world: Backport for [[gerrit:1320233|mergeMessageFileList: Suppress "doesn't exist" error when --quiet (T125678 T433104)]] (duration: 06m 13s) 2443691 wikitext text/x-wiki j4t4ls1vpg6tp8bmqihe4og0sozofps 2443692 2443691 2026-08-03T21:37:54Z Stashbot 7414 dancy@deploy1003: Installing scap version "4.277.0" for 3 host(s) 2443692 wikitext text/x-wiki pfez0f13fncsap4k5p5qfcredcla9oa 2443693 2443692 2026-08-03T21:39:40Z Stashbot 7414 dancy@deploy1003: Installation of scap version "4.277.0" completed for 3 hosts 2443693 wikitext text/x-wiki 6ruhqb0bs6spvc7veas0ion5932bi55 2443694 2443693 2026-08-03T21:41:52Z Stashbot 7414 dancy@deploy1003: Started scap sync-world: testing 2443694 wikitext text/x-wiki 2rk8neibc6syn1f6poesepsq22sox3j 2443695 2443694 2026-08-03T21:42:23Z Stashbot 7414 dancy@deploy1003: Stopping before sync operations 2443695 wikitext text/x-wiki gkh4ss521g5zvxnen21qhkqxy1x6ns0 2443696 2443695 2026-08-03T21:42:58Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on search-loader2002.codfw.wmnet with reason: host reimage 2443696 wikitext text/x-wiki j5r2wj3qqlxd13okj3qrtf4zizcoiec 2443697 2443696 2026-08-03T21:49:00Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on search-loader2002.codfw.wmnet with reason: host reimage 2443697 wikitext text/x-wiki njkccbn7yisqtpgkq424tqe6eaz5cua 2443700 2443697 2026-08-03T22:08:57Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host search-loader2002.codfw.wmnet with OS trixie 2443700 wikitext text/x-wiki awepzm2xpjwwej6h1j05fz1syn6upa8 2443702 2443700 2026-08-03T22:36:34Z Stashbot 7414 rzl@deploy1003: helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply 2443702 wikitext text/x-wiki ob485bxyrftbwhjurelskab4gp1bv3n 2443703 2443702 2026-08-03T22:36:46Z Stashbot 7414 rzl@deploy1003: helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply 2443703 wikitext text/x-wiki 5t02w9o5hmk2q3ohiekydut65rtj6od 2443704 2443703 2026-08-03T22:56:35Z Stashbot 7414 rzl@deploy1003: helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: sync 2443704 wikitext text/x-wiki hrh2slxvh28lnh7qw1hmroxdcp8df7y 2443705 2443704 2026-08-03T22:56:40Z Stashbot 7414 rzl@deploy1003: helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: sync 2443705 wikitext text/x-wiki 22xkp9i4izofv0flo0eyy894gdv416u 2443706 2443705 2026-08-03T23:17:28Z Stashbot 7414 rzl@deploy1003: helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply 2443706 wikitext text/x-wiki njvugs90jx0qqwurflthlgirc2jasjd 2443707 2443706 2026-08-03T23:18:41Z Stashbot 7414 rzl@deploy1003: helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply 2443707 wikitext text/x-wiki czbinpwcbe90ofzzck8o10jn8ci1d30 2443708 2443707 2026-08-03T23:26:56Z Stashbot 7414 robh@cumin1003: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cp5021.eqsin.wmnet 2443708 wikitext text/x-wiki qadlcndf0ydxu0aukv07wytmj3wq3up 2443709 2443708 2026-08-03T23:27:06Z Stashbot 7414 robh@cumin1003: END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts cp5021.eqsin.wmnet 2443709 wikitext text/x-wiki btt5a24xdp36x98osiac7yuoi73hhfb 2443710 2443709 2026-08-03T23:29:44Z Stashbot 7414 robh@cumin1003: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts cp5021.eqsin.wmnet 2443710 wikitext text/x-wiki h9x7py9qraia86m1je200cvwg00g2oc 2443711 2443710 2026-08-03T23:29:53Z Stashbot 7414 robh@cumin1003: END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts cp5021.eqsin.wmnet 2443711 wikitext text/x-wiki mdo31ezox9431005ba32ui2n34j53xz 2443712 2443711 2026-08-03T23:57:42Z Stashbot 7414 rzl@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-cron: apply 2443712 wikitext text/x-wiki b7homflpsgquaxowtvx4d7ad9vaza57 2443713 2443712 2026-08-03T23:58:07Z Stashbot 7414 rzl@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-cron: apply 2443713 wikitext text/x-wiki cyp3u0m6c55acjgu36dzf2ehbfpdb2i 2443715 2443713 2026-08-04T00:39:36Z Stashbot 7414 cjming@deploy1003: Started scap sync-world: Backport for [[gerrit:1320296|Fix InstrumentConstructiveEdits script (T431493)]] 2443715 wikitext text/x-wiki 0q2cpttc7jpz681byw0r9xxi41oqgfy 2443716 2443715 2026-08-04T00:41:21Z Stashbot 7414 cjming@deploy1003: cjming: Backport for [[gerrit:1320296|Fix InstrumentConstructiveEdits script (T431493)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2443716 wikitext text/x-wiki 9yny41o9ypaxl7txuzlurd0ql9hz6e8 2443717 2443716 2026-08-04T00:41:47Z Stashbot 7414 cjming@deploy1003: cjming: Continuing with deployment 2443717 wikitext text/x-wiki bl6i87ivc34vgeoe0yekc6w8f9hwmde 2443718 2443717 2026-08-04T00:45:56Z Stashbot 7414 cjming@deploy1003: Finished scap sync-world: Backport for [[gerrit:1320296|Fix InstrumentConstructiveEdits script (T431493)]] (duration: 06m 20s) 2443718 wikitext text/x-wiki qarnl9ii74zte8g8kp6jpdl8fmm4chq 2443726 2443718 2026-08-04T02:00:59Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2443726 wikitext text/x-wiki jmtwttklit7vff15bytup9ns6y1h4i1 2443727 2443726 2026-08-04T02:07:29Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 06m 32s) 2443727 wikitext text/x-wiki 77nvafgofbbxw8osn6v28daeyrtaav5 2443731 2443727 2026-08-04T03:05:39Z Stashbot 7414 mwpresync@deploy1003: Started scap sync-world: testwikis to 1.47.0-wmf.14 refs T430833 2443731 wikitext text/x-wiki pg89268a2739b60u21aig9jqoyca23t 2443732 2443731 2026-08-04T03:22:40Z Stashbot 7414 cjming@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/test-kitchen-next: apply 2443732 wikitext text/x-wiki g0syibl4mmzutooo48j5uj0c76td0o7 2443733 2443732 2026-08-04T03:23:05Z Stashbot 7414 cjming@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/test-kitchen-next: apply 2443733 wikitext text/x-wiki rgsp5tcxjk7cqzjhj4702k5gfkcokeb 2443734 2443733 2026-08-04T03:38:37Z Stashbot 7414 mwpresync@deploy1003: Finished scap sync-world: testwikis to 1.47.0-wmf.14 refs T430833 (duration: 32m 57s) 2443734 wikitext text/x-wiki kvdpldz5y173pz5dwpih2aab3z0qt1f 2443735 2443734 2026-08-04T04:02:36Z Stashbot 7414 mwpresync@deploy1003: Pruned MediaWiki: 1.47.0-wmf.11 (duration: 02m 29s) 2443735 wikitext text/x-wiki 1lct6acqnzqkq5yv1szc2tnyigol8ea 2443740 2443735 2026-08-04T06:48:18Z Stashbot 7414 slyngshede@dns1004: START - running authdns-update 2443740 wikitext text/x-wiki n93pk345mu55jb6quaucg9cjjmwng05 2443741 2443740 2026-08-04T06:50:06Z Stashbot 7414 slyngshede@dns1004: END - running authdns-update 2443741 wikitext text/x-wiki g9z5tv18y5ug2lxlus02yovodz0gfuz 2443742 2443741 2026-08-04T07:11:44Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.reimage for host ms-be1093.eqiad.wmnet with OS trixie 2443742 wikitext text/x-wiki 2miaej8v6nek9kwhec0pskfhf0ycwzp 2443743 2443742 2026-08-04T07:12:02Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.reimage for host ms-be2092.codfw.wmnet with OS trixie 2443743 wikitext text/x-wiki l88fgjfiobxe9sys3suwh815bzayy0o 2443744 2443743 2026-08-04T07:29:40Z Stashbot 7414 jynus: running extra backups to test db1265 T433825 2443744 wikitext text/x-wiki e86dw5vq7h9s2huaods852p896vq5ss 2443745 2443744 2026-08-04T07:32:58Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1093.eqiad.wmnet with reason: host reimage 2443745 wikitext text/x-wiki sla2luugde9mtg2yjoyu9bm33a7k8sm 2443746 2443745 2026-08-04T07:33:44Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2092.codfw.wmnet with reason: host reimage 2443746 wikitext text/x-wiki 4inb690j55ny3nmsysm37c3n8um4q8d 2443747 2443746 2026-08-04T07:39:34Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1093.eqiad.wmnet with reason: host reimage 2443747 wikitext text/x-wiki t0zh96zyd772neouso8y4yzp8yn74c7 2443749 2443747 2026-08-04T07:43:35Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2092.codfw.wmnet with reason: host reimage 2443749 wikitext text/x-wiki 7hcjoftdwswlbhyuxfrn055v67u1o2m 2443750 2443749 2026-08-04T07:51:18Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1266.eqiad.wmnet 2443750 wikitext text/x-wiki 4jzpg5ei5d1yovlu3u7qi3qxf4aj0de 2443751 2443750 2026-08-04T07:56:01Z Stashbot 7414 jynus: running extra backups to test db1285 T433826 2443751 wikitext text/x-wiki d9wzvfnoexu1fni80mw6jr2p5rskvk5 2443752 2443751 2026-08-04T07:56:54Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1266.eqiad.wmnet 2443752 wikitext text/x-wiki 7m4agwr80kus7m0gyvcnbfb42g391qm 2443753 2443752 2026-08-04T07:58:06Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1093.eqiad.wmnet with OS trixie 2443753 wikitext text/x-wiki f75uo1g6jmg3om7ll1s553srb09khmn 2443754 2443753 2026-08-04T07:59:03Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1267.eqiad.wmnet 2443754 wikitext text/x-wiki pjm6ps2n97tanhvmg0dp7kxhhy69c0q 2443755 2443754 2026-08-04T08:04:17Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1267.eqiad.wmnet 2443755 wikitext text/x-wiki faslpxp00qjo82q05vjd7rqyfd01nzi 2443756 2443755 2026-08-04T08:04:30Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1268.eqiad.wmnet 2443756 wikitext text/x-wiki h19ymx7nk2wikqblz94ve3y8nbmlfdw 2443757 2443756 2026-08-04T08:06:27Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2092.codfw.wmnet with OS trixie 2443757 wikitext text/x-wiki 5kmbh3bfwrngcxj1dj4rzit2vm60gwo 2443758 2443757 2026-08-04T08:09:45Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1268.eqiad.wmnet 2443758 wikitext text/x-wiki bble9z6c96o9ryjn248ghtcxe44n7my 2443759 2443758 2026-08-04T08:09:58Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1269.eqiad.wmnet 2443759 wikitext text/x-wiki o4wno030hcndjnexabzktnbw06v81er 2443760 2443759 2026-08-04T08:14:44Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.reimage for host ms-be2093.codfw.wmnet with OS trixie 2443760 wikitext text/x-wiki 6avlzmovdo6fdzxndfh7f2gyrfa6nj5 2443761 2443760 2026-08-04T08:15:12Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1269.eqiad.wmnet 2443761 wikitext text/x-wiki okjvbbpwkg3qpg7vyblku95kux1lzi1 2443762 2443761 2026-08-04T08:15:25Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1270.eqiad.wmnet 2443762 wikitext text/x-wiki r5m068nyfk6ztbbgxadb3e81htdp6o5 2443763 2443762 2026-08-04T08:20:44Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1270.eqiad.wmnet 2443763 wikitext text/x-wiki d3z9q2x70vdwyr2tdl4fzk3nyr9fylf 2443764 2443763 2026-08-04T08:20:54Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1271.eqiad.wmnet 2443764 wikitext text/x-wiki 83htxydojl02yrx8di8tspez64wbl2q 2443765 2443764 2026-08-04T08:21:48Z Stashbot 7414 jnuche@deploy1003: rebuilt and synchronized wikiversions files: group0 to 1.47.0-wmf.14 refs T430833 2443765 wikitext text/x-wiki 0lvvjuj6h4uksw5u9z4ky3k0sq3cqvo 2443766 2443765 2026-08-04T08:23:25Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.reimage for host ms-be1094.eqiad.wmnet with OS trixie 2443766 wikitext text/x-wiki ab4psspopm8ccpm8d7geabakw60o7hq 2443767 2443766 2026-08-04T08:26:08Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1271.eqiad.wmnet 2443767 wikitext text/x-wiki mzpq1snt8cetpxoualjc4e14paaowo0 2443768 2443767 2026-08-04T08:28:52Z Stashbot 7414 dcausse@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-semantic-search-test: apply 2443768 wikitext text/x-wiki lxcml9e87fwrtbk5zgkj3gz3qp6bvcx 2443769 2443768 2026-08-04T08:29:05Z Stashbot 7414 dcausse@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search-test: apply 2443769 wikitext text/x-wiki jfdcy5y7getzockv1tkdc45yqmgfb0z 2443770 2443769 2026-08-04T08:34:41Z Stashbot 7414 jgiannelos@deploy1003: helmfile [staging] START helmfile.d/services/mobileapps: apply 2443770 wikitext text/x-wiki 6elqyr99qxcn4yg6uelplcbfrrfgkqr 2443771 2443770 2026-08-04T08:35:01Z Stashbot 7414 jgiannelos@deploy1003: helmfile [staging] DONE helmfile.d/services/mobileapps: apply 2443771 wikitext text/x-wiki q5drrxwh2g0bunlyu5ert062fcr31xn 2443772 2443771 2026-08-04T08:36:14Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2093.codfw.wmnet with reason: host reimage 2443772 wikitext text/x-wiki 032zwipeg6ngaqn9ug53nalvqylidqj 2443773 2443772 2026-08-04T08:38:33Z Stashbot 7414 dcausse@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-semantic-search-test: apply 2443773 wikitext text/x-wiki eg409lcq5nz6kz6j4mzsk00shew39k6 2443774 2443773 2026-08-04T08:38:41Z Stashbot 7414 dcausse@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search-test: apply 2443774 wikitext text/x-wiki 41q646wdzzc0q84stjardbznn4w613q 2443775 2443774 2026-08-04T08:42:38Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2093.codfw.wmnet with reason: host reimage 2443775 wikitext text/x-wiki l55kfrsdgbkj46ykcrssblaj2lpwozt 2443776 2443775 2026-08-04T08:44:21Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1094.eqiad.wmnet with reason: host reimage 2443776 wikitext text/x-wiki rl6xv44psdvv8mi88buav6zg393qjxa 2443777 2443776 2026-08-04T08:45:19Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1272.eqiad.wmnet 2443777 wikitext text/x-wiki en9pmazyn8mt6277t9qhl48x6mz2lh8 2443782 2443777 2026-08-04T08:48:21Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1094.eqiad.wmnet with reason: host reimage 2443782 wikitext text/x-wiki 6pr6bm33bbqy2me69134kmkwwh1cqjq 2443783 2443782 2026-08-04T08:49:49Z Stashbot 7414 dcausse@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/dse-k8s-services/opensearch-semantic-search-test: apply 2443783 wikitext text/x-wiki cyfz2527bimqt1uyx324v8modlwpjky 2443784 2443783 2026-08-04T08:49:59Z Stashbot 7414 dcausse@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search-test: apply 2443784 wikitext text/x-wiki emuge3vvlhklc7js8lijxgct5it2fd0 2443785 2443784 2026-08-04T08:50:33Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1272.eqiad.wmnet 2443785 wikitext text/x-wiki h2971ynmf2x7n0mk8rm8b0g1t0wxebd 2443786 2443785 2026-08-04T08:50:47Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1273.eqiad.wmnet 2443786 wikitext text/x-wiki 7fey92uzctbv9s7fct2rnpq2729523e 2443787 2443786 2026-08-04T08:56:01Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1273.eqiad.wmnet 2443787 wikitext text/x-wiki oanc0x4ksx81ra95gym6q56on91abav 2443788 2443787 2026-08-04T08:56:14Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1274.eqiad.wmnet 2443788 wikitext text/x-wiki ibiioywyrdgp35awj856ucpt7djn4po 2443789 2443788 2026-08-04T09:01:21Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1274.eqiad.wmnet 2443789 wikitext text/x-wiki qf5fclacnjujodetjwehako4ka422j7 2443790 2443789 2026-08-04T09:01:35Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1275.eqiad.wmnet 2443790 wikitext text/x-wiki fqelbzixszkz7ykd4ca7zpe9wvnvebq 2443793 2443790 2026-08-04T09:04:19Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2093.codfw.wmnet with OS trixie 2443793 wikitext text/x-wiki cwbi0drheay5dt6t4sli0g3qrqwz3oo 2443794 2443793 2026-08-04T09:06:37Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1275.eqiad.wmnet 2443794 wikitext text/x-wiki eo88l85dv89l74ik2gcekvlovq942mn 2443795 2443794 2026-08-04T09:06:50Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1276.eqiad.wmnet 2443795 wikitext text/x-wiki 0f5nxyyk0oquwl16os0j7it8kppt9ef 2443796 2443795 2026-08-04T09:08:27Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1094.eqiad.wmnet with OS trixie 2443796 wikitext text/x-wiki e5f0k1j6jk3ix81m10l9js1kxjnm7bc 2443798 2443796 2026-08-04T09:12:04Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1276.eqiad.wmnet 2443798 wikitext text/x-wiki tswkwxykf2pifnrm70m5f0uj3h4r7cs 2443799 2443798 2026-08-04T09:12:16Z Stashbot 7414 dcausse@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-semantic-search-test: apply 2443799 wikitext text/x-wiki 0ndnbfxd1ejg7kh8xjx1usnn1sswyjp 2443800 2443799 2026-08-04T09:12:18Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1277.eqiad.wmnet 2443800 wikitext text/x-wiki 5siovk1qrfzdbb1m5a3bn6xk6zjswl0 2443801 2443800 2026-08-04T09:12:30Z Stashbot 7414 dcausse@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search-test: apply 2443801 wikitext text/x-wiki nthhacqreacjoze4jzzhblq0wk47wm6 2443802 2443801 2026-08-04T09:12:59Z Stashbot 7414 jiji@deploy1003: helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply 2443802 wikitext text/x-wiki 8yjjifanv47yy8yp065gy6mn6z8bh5p 2443803 2443802 2026-08-04T09:13:32Z Stashbot 7414 jiji@deploy1003: helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply 2443803 wikitext text/x-wiki hi6kq8cy7f94gp0hkvheufoh9x6ka9t 2443804 2443803 2026-08-04T09:13:34Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.reimage for host ms-be2094.codfw.wmnet with OS trixie 2443804 wikitext text/x-wiki nng4ayuxwnchxjpk4xyjv8v0iigl8tb 2443808 2443804 2026-08-04T09:17:31Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1277.eqiad.wmnet 2443808 wikitext text/x-wiki bmmlvupre03biep9shdgr4gd0wcivwx 2443809 2443808 2026-08-04T09:20:03Z Stashbot 7414 brouberol@cumin1003: START - Cookbook sre.ganeti.reboot-vm for VM archiva1002.wikimedia.org 2443809 wikitext text/x-wiki fwrru3lqn3zdjc1qsarizpoe5agn7du 2443810 2443809 2026-08-04T09:23:59Z Stashbot 7414 brouberol@cumin1003: END (PASS) - Cookbook sre.ganeti.reboot-vm (exit_code=0) for VM archiva1002.wikimedia.org 2443810 wikitext text/x-wiki 3o5fs0vhhnvqmohdcqk6f1643ddtehz 2443812 2443810 2026-08-04T09:24:28Z Stashbot 7414 dcausse@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/opensearch-semantic-search-test: apply 2443812 wikitext text/x-wiki pscfpe41f6b7u17c6x3bfgbld653qzx 2443813 2443812 2026-08-04T09:24:37Z Stashbot 7414 dcausse@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search-test: apply 2443813 wikitext text/x-wiki j69z700xjs4bdsqdahu8bdhz493hbkf 2443814 2443813 2026-08-04T09:27:11Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.swift.convert-disks for host ms-be1069 2443814 wikitext text/x-wiki 9rfjhp6er7t528j5uhbgnjt2pxl5dtk 2443815 2443814 2026-08-04T09:33:10Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.reimage for host ms-be1095.eqiad.wmnet with OS trixie 2443815 wikitext text/x-wiki 139hlxx0qt1bpmbwlb526yrp74cjtih 2443816 2443815 2026-08-04T09:33:56Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.swift.convert-disks for host ms-be1070 2443816 wikitext text/x-wiki ln5ou3weq55sojc8pzew69pj0ynks3q 2443818 2443816 2026-08-04T09:34:21Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.swift.convert-disks for host ms-be1071 2443818 wikitext text/x-wiki h9mt7uqeq3ui74anm68296thulsbhws 2443819 2443818 2026-08-04T09:34:34Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2094.codfw.wmnet with reason: host reimage 2443819 wikitext text/x-wiki t1duohsq1un8fca4d0mfmv41y9jpanh 2443820 2443819 2026-08-04T09:40:07Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2094.codfw.wmnet with reason: host reimage 2443820 wikitext text/x-wiki tb4vht9tquit617fp5yeilrtkthqnmw 2443821 2443820 2026-08-04T09:44:09Z Stashbot 7414 dcausse@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/dse-k8s-services/opensearch-semantic-search-test: apply 2443821 wikitext text/x-wiki qxuctywz10kj6dl4nkxae74eu14jghh 2443822 2443821 2026-08-04T09:44:24Z Stashbot 7414 dcausse@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/dse-k8s-services/opensearch-semantic-search-test: apply 2443822 wikitext text/x-wiki 56ic2cg0xq95ymrilntxf25vxs4ybbh 2443827 2443822 2026-08-04T09:53:47Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-wikidata: apply 2443827 wikitext text/x-wiki arof89j4tq0lo8ou32rg14exja9t72x 2443828 2443827 2026-08-04T09:53:49Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1095.eqiad.wmnet with reason: host reimage 2443828 wikitext text/x-wiki gugzakn48w4b9qdri2cppc6cgj7dhzt 2443829 2443828 2026-08-04T09:54:15Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-wikidata: apply 2443829 wikitext text/x-wiki 99a0b7paujfdyd79231114cyntvlpt2 2443830 2443829 2026-08-04T09:58:21Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1095.eqiad.wmnet with reason: host reimage 2443830 wikitext text/x-wiki ey5hn0vw4n94ujzyo66eaavev2len4j 2443831 2443830 2026-08-04T10:01:23Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2094.codfw.wmnet with OS trixie 2443831 wikitext text/x-wiki omp4x7nj7tyvxjssb0vsiwtgmn5if3o 2443834 2443831 2026-08-04T10:08:45Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker1139.eqiad.wmnet 2443834 wikitext text/x-wiki lr8otbzhmssp314rmlm2bb7l9t6f2hh 2443835 2443834 2026-08-04T10:08:49Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1139.eqiad.wmnet 2443835 wikitext text/x-wiki dymv838oan6jf03lbl7aaejpjxnarvi 2443836 2443835 2026-08-04T10:09:24Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1139.eqiad.wmnet 2443836 wikitext text/x-wiki blrq1q1p7fbfkj0gqb9tgb8o5lvp6ro 2443837 2443836 2026-08-04T10:10:06Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.hosts.reimage for host wikikube-worker1139.eqiad.wmnet with OS trixie 2443837 wikitext text/x-wiki 9mvi5rx8oibd9h421spw6cjjwcrj4i9 2443838 2443837 2026-08-04T10:10:24Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker1140.eqiad.wmnet 2443838 wikitext text/x-wiki 3x89haq8huvr8haabwcyp7y54yf0vax 2443839 2443838 2026-08-04T10:10:27Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1140.eqiad.wmnet 2443839 wikitext text/x-wiki nehwhvegn444bc4d5jd0decfqtkkqcm 2443840 2443839 2026-08-04T10:10:34Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.hosts.move-vlan for host wikikube-worker1139 2443840 wikitext text/x-wiki hl697oxakc7pgemimjfyg4ua4yaxqc2 2443841 2443840 2026-08-04T10:10:46Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.dns.netbox 2443841 wikitext text/x-wiki i6x23hi0eu6m0vl9n49b1nr5jcsfb6n 2443842 2443841 2026-08-04T10:11:02Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1140.eqiad.wmnet 2443842 wikitext text/x-wiki t5dgklru2fj8ziur7vr99dbbxehk089 2443843 2443842 2026-08-04T10:11:13Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.hosts.reimage for host wikikube-worker1140.eqiad.wmnet with OS trixie 2443843 wikitext text/x-wiki b3ob5h7r6jm87lv7m745mo7v7ztj8cb 2443844 2443843 2026-08-04T10:11:41Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.hosts.move-vlan for host wikikube-worker1140 2443844 wikitext text/x-wiki gl1t5ocymhfrv6vb4yp51rmj8uhqstn 2443845 2443844 2026-08-04T10:12:38Z Stashbot 7414 mvernon@cumin1003: END (FAIL) - Cookbook sre.swift.convert-disks (exit_code=99) for host ms-be1069 2443845 wikitext text/x-wiki 6pqm49pu9zb9hu3hunns6nfhynjjpda 2443846 2443845 2026-08-04T10:13:05Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.reimage for host ms-be1069.eqiad.wmnet with OS trixie 2443846 wikitext text/x-wiki nup1vcsz07b61y75oxyek3vo3smiswc 2443847 2443846 2026-08-04T10:14:10Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.reimage for host ms-be2095.codfw.wmnet with OS trixie 2443847 wikitext text/x-wiki 0imzjn44vmpra5gfwwa5d6kzu2bo3d6 2443848 2443847 2026-08-04T10:15:03Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1139 - jayme@cumin1003" 2443848 wikitext text/x-wiki 12uw9bgt4uf7mytacvclyshlq28qmtx 2443849 2443848 2026-08-04T10:15:47Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.dns.netbox 2443849 wikitext text/x-wiki 1phwedinnvhmgka7ejpp130cdpbsef4 2443850 2443849 2026-08-04T10:15:49Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1139 - jayme@cumin1003" 2443850 wikitext text/x-wiki gjgol63h70lbmzl5jboi8opqnazdv9w 2443851 2443850 2026-08-04T10:15:51Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2443851 wikitext text/x-wiki id2z85hvjvz91ogxt7iw27za2cnl7at 2443852 2443851 2026-08-04T10:15:54Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.dns.wipe-cache wikikube-worker1139.eqiad.wmnet 194.32.64.10.in-addr.arpa 4.9.1.0.2.3.0.0.4.6.0.0.0.1.0.0.3.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2443852 wikitext text/x-wiki eyildvbsix2e3hb1a83peb8kz8nxvrb 2443853 2443852 2026-08-04T10:15:56Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker1139.eqiad.wmnet 194.32.64.10.in-addr.arpa 4.9.1.0.2.3.0.0.4.6.0.0.0.1.0.0.3.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2443853 wikitext text/x-wiki pkqugw2myklf87owplo60teq834a5mv 2443854 2443853 2026-08-04T10:15:58Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1139 2443854 wikitext text/x-wiki ft0k622ndxirjtkx9r1vtz9c6nuih4q 2443855 2443854 2026-08-04T10:17:09Z Stashbot 7414 mvernon@cumin1003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=1) for host ms-be1095.eqiad.wmnet with OS trixie 2443855 wikitext text/x-wiki t3ah0lwb6frq62gkl7fjutwkn9kjti4 2443856 2443855 2026-08-04T10:17:13Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1139 2443856 wikitext text/x-wiki oi5mrtdx6crfzs54q4f0e68p3k6ispg 2443857 2443856 2026-08-04T10:17:15Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1139 2443857 wikitext text/x-wiki 6d2fgyidqkmrihvaxcn1zfxpyhzal5a 2443858 2443857 2026-08-04T10:17:40Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.reimage for host ms-be1095.eqiad.wmnet with OS trixie 2443858 wikitext text/x-wiki fsyoodimda2wcoowbmlb6agvx33hx43 2443859 2443858 2026-08-04T10:20:27Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1095.eqiad.wmnet with reason: host reimage 2443859 wikitext text/x-wiki 7ph49suxlgh7njwu7zlzehetdor2o5y 2443860 2443859 2026-08-04T10:21:10Z Stashbot 7414 mvernon@cumin1003: END (FAIL) - Cookbook sre.swift.convert-disks (exit_code=99) for host ms-be1070 2443860 wikitext text/x-wiki 5pb0h5ct0q74uxlcdhy18ftkwhg6n7o 2443861 2443860 2026-08-04T10:21:35Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.reimage for host ms-be1070.eqiad.wmnet with OS trixie 2443861 wikitext text/x-wiki 21b95dr1bllzrhkeyohhgvm01qumukp 2443862 2443861 2026-08-04T10:21:36Z Stashbot 7414 mvernon@cumin1003: END (FAIL) - Cookbook sre.swift.convert-disks (exit_code=99) for host ms-be1071 2443862 wikitext text/x-wiki 1vyacvriesavdo81ddilqmbb1m73g4h 2443863 2443862 2026-08-04T10:21:46Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1140 - jayme@cumin1003" 2443863 wikitext text/x-wiki 0oc4kyjyt6zr1xo18asmxqx34xvkmlk 2443864 2443863 2026-08-04T10:21:51Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1140 - jayme@cumin1003" 2443864 wikitext text/x-wiki hg2kh6jfvcajr425ejc1co83ewi9ni8 2443865 2443864 2026-08-04T10:21:53Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2443865 wikitext text/x-wiki 57cw0uk5xnzqakslyeauuibk0kuchca 2443866 2443865 2026-08-04T10:21:55Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.dns.wipe-cache wikikube-worker1140.eqiad.wmnet 155.48.64.10.in-addr.arpa 5.5.1.0.8.4.0.0.4.6.0.0.0.1.0.0.7.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2443866 wikitext text/x-wiki 4jlfkr1v18ctslokultm69be1t638s3 2443867 2443866 2026-08-04T10:21:57Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.reimage for host ms-be1071.eqiad.wmnet with OS trixie 2443867 wikitext text/x-wiki n8z16lv6ull5rl3dmw42ixy2bbz9pfx 2443868 2443867 2026-08-04T10:21:59Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker1140.eqiad.wmnet 155.48.64.10.in-addr.arpa 5.5.1.0.8.4.0.0.4.6.0.0.0.1.0.0.7.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2443868 wikitext text/x-wiki 4o3uq0n0ao8q9bhd9fcbn7vrlhhre8m 2443869 2443868 2026-08-04T10:22:01Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1140 2443869 wikitext text/x-wiki 6an8o1tqdqqizxgbvd5ut4098nckvux 2443871 2443869 2026-08-04T10:23:12Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1095.eqiad.wmnet with reason: host reimage 2443871 wikitext text/x-wiki h7f5mqgfbb5rpdwuz6rc6soga04p7wj 2443872 2443871 2026-08-04T10:23:55Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1140 2443872 wikitext text/x-wiki 6uztej3ifrg02spf5ggdiy9zafqu1kg 2443873 2443872 2026-08-04T10:23:57Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1140 2443873 wikitext text/x-wiki l6x902aim64167cc6r4qi1k71p5nbzs 2443874 2443873 2026-08-04T10:30:13Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1069.eqiad.wmnet with reason: host reimage 2443874 wikitext text/x-wiki 2ruhk1zirlm3i5suumkzv0vnh6t74yk 2443875 2443874 2026-08-04T10:33:08Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1139.eqiad.wmnet with reason: host reimage 2443875 wikitext text/x-wiki qbswg2nyx6rorymnyom4cq5ulni7bpm 2443876 2443875 2026-08-04T10:33:20Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2095.codfw.wmnet with reason: host reimage 2443876 wikitext text/x-wiki den8taaox8hxzomppl0dodnd8mxbsmc 2443877 2443876 2026-08-04T10:33:51Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1095.eqiad.wmnet with OS trixie 2443877 wikitext text/x-wiki qky2aany12u9smxqlu9bgcdchaexc04 2443878 2443877 2026-08-04T10:35:27Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1069.eqiad.wmnet with reason: host reimage 2443878 wikitext text/x-wiki 3y1dl518ggko45rsfkh4bcksurepdop 2443880 2443878 2026-08-04T10:37:56Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1140.eqiad.wmnet with reason: host reimage 2443880 wikitext text/x-wiki mes8xrdq5oslbi8gfxtv8lbc0uvdrpp 2443881 2443880 2026-08-04T10:38:04Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1139.eqiad.wmnet with reason: host reimage 2443881 wikitext text/x-wiki dn1oymlqezhlvr87a0w0wp89qk9ovfw 2443882 2443881 2026-08-04T10:38:50Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1070.eqiad.wmnet with reason: host reimage 2443882 wikitext text/x-wiki p2ihdhng6h8vwc97efqxu86rpbgu7d6 2443883 2443882 2026-08-04T10:39:03Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1071.eqiad.wmnet with reason: host reimage 2443883 wikitext text/x-wiki qyi75zig0yymhar872m3q97rmuy4e5k 2443885 2443883 2026-08-04T10:41:34Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1140.eqiad.wmnet with reason: host reimage 2443885 wikitext text/x-wiki 3dlv404mk6zxoglf8fkbjpssa1ryijn 2443886 2443885 2026-08-04T10:41:56Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.reimage for host ms-be1096.eqiad.wmnet with OS trixie 2443886 wikitext text/x-wiki l5nk82493jbyamgand2n2hbzo2uvbtk 2443888 2443886 2026-08-04T10:44:49Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1096.eqiad.wmnet with reason: host reimage 2443888 wikitext text/x-wiki po8wazgxfofgtc3v0pku59nslpr1psr 2443889 2443888 2026-08-04T10:45:14Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1071.eqiad.wmnet with reason: host reimage 2443889 wikitext text/x-wiki 8tonggoev8wlsd5rtkr7rfd8c0frtf0 2443892 2443889 2026-08-04T10:48:24Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1096.eqiad.wmnet with reason: host reimage 2443892 wikitext text/x-wiki nd9pasgq3ecafn6flh2v15yvh276wog 2443895 2443892 2026-08-04T10:52:43Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1070.eqiad.wmnet with reason: host reimage 2443895 wikitext text/x-wiki n5c4pd6zxgk7agf9p0prj2yvwkfvyp3 2443896 2443895 2026-08-04T10:56:28Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2095.codfw.wmnet with reason: host reimage 2443896 wikitext text/x-wiki p5ckwl1bf68hh4s04njorpbz79elpk4 2443897 2443896 2026-08-04T10:56:45Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1069.eqiad.wmnet with OS trixie 2443897 wikitext text/x-wiki tb4xovmv6n6xvzj7z4hia34ij9v2sx1 2443898 2443897 2026-08-04T11:00:08Z Stashbot 7414 jayme@cumin1003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=1) for host wikikube-worker1139.eqiad.wmnet with OS trixie 2443898 wikitext text/x-wiki 5ouxtu4yolzlu97m0mu0yybujzln0gw 2443899 2443898 2026-08-04T11:00:11Z Stashbot 7414 jayme@cumin1003: END (FAIL) - Cookbook sre.k8s.renumber-node (exit_code=99) Renumbering for host wikikube-worker1139.eqiad.wmnet 2443899 wikitext text/x-wiki 3zqxggnt30b0t1920ugnut9oqufhz5o 2443900 2443899 2026-08-04T11:01:30Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1096.eqiad.wmnet with OS trixie 2443900 wikitext text/x-wiki cl96ldpxrpa04dg9vbvzyvcv6jgpchx 2443901 2443900 2026-08-04T11:02:14Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.reimage for host ms-be1097.eqiad.wmnet with OS trixie 2443901 wikitext text/x-wiki 7v6s2yjwxdx637u2xf8f1g1cu8vtux0 2443902 2443901 2026-08-04T11:02:28Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host wikikube-worker1140.eqiad.wmnet with OS trixie 2443902 wikitext text/x-wiki oxn7wawyxepkf5br15wf1mgawz2urct 2443903 2443902 2026-08-04T11:04:38Z Stashbot 7414 mvernon@cumin1003: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host ms-be1097.eqiad.wmnet with OS trixie 2443903 wikitext text/x-wiki nvh5v12r3mkz1qgpy82uapgaj2524ju 2443904 2443903 2026-08-04T11:05:02Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.reimage for host ms-be1097.eqiad.wmnet with OS trixie 2443904 wikitext text/x-wiki sos4yfzsrfh7vmgwqqoqbpdzsd8u9qu 2443905 2443904 2026-08-04T11:06:56Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1071.eqiad.wmnet with OS trixie 2443905 wikitext text/x-wiki jo5l2o5h3o5i99apzw87pit6ot0gpkx 2443909 2443905 2026-08-04T11:10:00Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1278.eqiad.wmnet 2443909 wikitext text/x-wiki bu3c0lmvd8ibcn7r492agw6kdprxzsh 2443910 2443909 2026-08-04T11:13:18Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1140.eqiad.wmnet 2443910 wikitext text/x-wiki ayyb9a8ylkhky5rjunjg52bsjt5b5pi 2443911 2443910 2026-08-04T11:13:21Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1140.eqiad.wmnet 2443911 wikitext text/x-wiki pa21djdqh1o0f87agigxkdyey1oofux 2443912 2443911 2026-08-04T11:13:23Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.k8s.renumber-node (exit_code=0) Renumbering for host wikikube-worker1140.eqiad.wmnet 2443912 wikitext text/x-wiki l6wpljr8wwi4o5vzdpec3jjm2do5k60 2443914 2443912 2026-08-04T11:13:56Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1070.eqiad.wmnet with OS trixie 2443914 wikitext text/x-wiki 45exnk4l4162wga4f2lvjmtgmbvmlqn 2443915 2443914 2026-08-04T11:14:15Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1139.eqiad.wmnet 2443915 wikitext text/x-wiki b3riw0mrhhx62vsfpe9gtjqo5llik3s 2443916 2443915 2026-08-04T11:14:16Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1139.eqiad.wmnet 2443916 wikitext text/x-wiki pfkt3fmeykm7xh26y212pwphhhnzo7o 2443918 2443916 2026-08-04T11:15:16Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1278.eqiad.wmnet 2443918 wikitext text/x-wiki 24xgiuw2fhgxxdx568yez2xi4awcx46 2443919 2443918 2026-08-04T11:15:29Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1279.eqiad.wmnet 2443919 wikitext text/x-wiki rwyoa20aex4cyd60ykelutlntdlvk3q 2443920 2443919 2026-08-04T11:16:25Z Stashbot 7414 mvernon@cumin2003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=1) for host ms-be2095.codfw.wmnet with OS trixie 2443920 wikitext text/x-wiki jkj3xuussd0rj9ct5dksuxibzudvl87 2443921 2443920 2026-08-04T11:16:37Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.k8s.renumber-node Renumbering for host wikikube-worker1141.eqiad.wmnet 2443921 wikitext text/x-wiki 48ao2cyqfw5oxgctl7vfswmf2o9rfk1 2443922 2443921 2026-08-04T11:16:41Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1141.eqiad.wmnet 2443922 wikitext text/x-wiki pf80jlqyuwff1n1ssmsl5hw3k67luci 2443923 2443922 2026-08-04T11:17:17Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1141.eqiad.wmnet 2443923 wikitext text/x-wiki 9wjtqkxu86p6vvchloz2tdoy0mujuwv 2443924 2443923 2026-08-04T11:20:20Z Stashbot 7414 cmooney@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mr1-eqsin with reason: upgrade new Nokia swtiches in eqsin to SR Linux v26 2443924 wikitext text/x-wiki fbrgkigxlwmxns3h9fs02sh8yu75knu 2443925 2443924 2026-08-04T11:20:46Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1279.eqiad.wmnet 2443925 wikitext text/x-wiki 9wuc60qhujlocunigiv6eq0fop67yda 2443926 2443925 2026-08-04T11:20:59Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1280.eqiad.wmnet 2443926 wikitext text/x-wiki m6kmx2s29zg2wndjn9d9wjwtxv6mxkf 2443927 2443926 2026-08-04T11:21:32Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.hosts.reimage for host wikikube-worker1141.eqiad.wmnet with OS trixie 2443927 wikitext text/x-wiki 7gm3rn49cs7f9v61aolqs7h8xbv6tgr 2443929 2443927 2026-08-04T11:22:01Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.hosts.move-vlan for host wikikube-worker1141 2443929 wikitext text/x-wiki t7iwdge5a9z7ang9xqw5is6u19unrdu 2443932 2443929 2026-08-04T11:24:14Z Stashbot 7414 mvernon@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be1097.eqiad.wmnet with reason: host reimage 2443932 wikitext text/x-wiki m2q9qirytog5085dc60rpwf8d4fvves 2443934 2443932 2026-08-04T11:25:13Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.dns.netbox 2443934 wikitext text/x-wiki 3elth1rzqbeh5fl0jyj24yh5sk9l1n8 2443935 2443934 2026-08-04T11:26:34Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1280.eqiad.wmnet 2443935 wikitext text/x-wiki mb8f6fl21ttnawtewjk6vthm5w4k2ic 2443936 2443935 2026-08-04T11:26:47Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1281.eqiad.wmnet 2443936 wikitext text/x-wiki sgubdps9jsvnsrc59emmmlg0zazpyx9 2443937 2443936 2026-08-04T11:26:56Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.reimage for host ms-be2095.codfw.wmnet with OS trixie 2443937 wikitext text/x-wiki ow2cycjznmhyemem9i4up6keq7h7rjr 2443938 2443937 2026-08-04T11:29:28Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be1097.eqiad.wmnet with reason: host reimage 2443938 wikitext text/x-wiki 0bvxdl4v11xqpqc55pndxqjp2q3awt3 2443939 2443938 2026-08-04T11:29:46Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.downtime for 2:00:00 on ms-be2095.codfw.wmnet with reason: host reimage 2443939 wikitext text/x-wiki fonbr2p2pdjet2emlbvm7pz0r1ubgj2 2443941 2443939 2026-08-04T11:32:11Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.network.tls for network device lswtest-d8-eqiad 2443941 wikitext text/x-wiki ai4mioyydt5ynms6z2hr03t7ixki1qv 2443942 2443941 2026-08-04T11:32:18Z Stashbot 7414 cmooney@cumin1003: END (FAIL) - Cookbook sre.network.tls (exit_code=99) for network device lswtest-d8-eqiad 2443942 wikitext text/x-wiki 3coqojb5c4etzhbqojvtl4jlr838vbw 2443943 2443942 2026-08-04T11:32:20Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1281.eqiad.wmnet 2443943 wikitext text/x-wiki k0p3g9kkobniky9rgk424c7h774adqa 2443944 2443943 2026-08-04T11:32:31Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1282.eqiad.wmnet 2443944 wikitext text/x-wiki bihq3f7ehdsgieekqaw8gw01kt9xecu 2443945 2443944 2026-08-04T11:32:33Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1141 - jayme@cumin1003" 2443945 wikitext text/x-wiki hr78n4yjzp95hayxr94lklxjo3fmb5e 2443946 2443945 2026-08-04T11:32:37Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Update records for host wikikube-worker1141 - jayme@cumin1003" 2443946 wikitext text/x-wiki bybp5l29x13uu12y177tc886vnrqncd 2443947 2443946 2026-08-04T11:32:40Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2443947 wikitext text/x-wiki 2lkaqbpvl0t1vecrekdk744clfezred 2443948 2443947 2026-08-04T11:32:42Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.dns.wipe-cache wikikube-worker1141.eqiad.wmnet 156.48.64.10.in-addr.arpa 6.5.1.0.8.4.0.0.4.6.0.0.0.1.0.0.7.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2443948 wikitext text/x-wiki cro2r747nf4k6hvt7c1dcwxdro1ev2c 2443949 2443948 2026-08-04T11:32:44Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) wikikube-worker1141.eqiad.wmnet 156.48.64.10.in-addr.arpa 6.5.1.0.8.4.0.0.4.6.0.0.0.1.0.0.7.0.1.0.1.6.8.0.0.0.0.0.0.2.6.2.ip6.arpa on all recursors 2443949 wikitext text/x-wiki e9dxiwm8lywvcp4qxz5tmry4z3vlclm 2443950 2443949 2026-08-04T11:32:45Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host wikikube-worker1141 2443950 wikitext text/x-wiki 9kz3fi1qblk6gmmxwlq9obn5gf5oyha 2443951 2443950 2026-08-04T11:32:59Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on ms-be2095.codfw.wmnet with reason: host reimage 2443951 wikitext text/x-wiki lv9y1kfqtq821t28vne5hzsgqj8yxxa 2443952 2443951 2026-08-04T11:33:04Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host wikikube-worker1141 2443952 wikitext text/x-wiki kinrqbouhompagqipj9vk9npsvz34xf 2443953 2443952 2026-08-04T11:33:06Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.hosts.move-vlan (exit_code=0) for host wikikube-worker1141 2443953 wikitext text/x-wiki 06dictki3f0g6h1ba0e1qzkjyhdrx9q 2443954 2443953 2026-08-04T11:37:06Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.network.tls for network device lswtest-d8-eqiad 2443954 wikitext text/x-wiki ltdt2tydzx2hank7uekin8tck252yyx 2443955 2443954 2026-08-04T11:37:07Z Stashbot 7414 cmooney@cumin1003: END (FAIL) - Cookbook sre.network.tls (exit_code=99) for network device lswtest-d8-eqiad 2443955 wikitext text/x-wiki 53osbpyfxbz7mhj4ajaxrgfgfqux31w 2443956 2443955 2026-08-04T11:37:43Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1282.eqiad.wmnet 2443956 wikitext text/x-wiki 1aafw2mw1wbhw408klq75cmnnlqidrw 2443957 2443956 2026-08-04T11:37:57Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1283.eqiad.wmnet 2443957 wikitext text/x-wiki 4nzo0j284uvle0aitrqt868fti8pxak 2443958 2443957 2026-08-04T11:39:05Z Stashbot 7414 cmooney@cumin1003: START - Cookbook sre.network.tls for network device lswtest-d8-eqiad 2443958 wikitext text/x-wiki 8zhohp8vpr4s0fp0lvd0nafpvchigm5 2443959 2443958 2026-08-04T11:39:08Z Stashbot 7414 cmooney@cumin1003: END (FAIL) - Cookbook sre.network.tls (exit_code=99) for network device lswtest-d8-eqiad 2443959 wikitext text/x-wiki 76qpxjkmbeqhqbzf7qvkdwc7g94tktr 2443960 2443959 2026-08-04T11:42:44Z Stashbot 7414 klausman@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on ml-serve1015.eqiad.wmnet with reason: Downtime to get full picture of current BIOS settings beyond what Redfish shows 2443960 wikitext text/x-wiki lhtqi8esb2ju15bhj1harzes525zwct 2443961 2443960 2026-08-04T11:43:13Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1283.eqiad.wmnet 2443961 wikitext text/x-wiki mgyfpmfym0f4g5rkh31f4ntt254ork5 2443962 2443961 2026-08-04T11:43:27Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1284.eqiad.wmnet 2443962 wikitext text/x-wiki pmyypd18fgl7400mqhyffe93s1py3ug 2443963 2443962 2026-08-04T11:43:48Z Stashbot 7414 mvernon@cumin2003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be2095.codfw.wmnet with OS trixie 2443963 wikitext text/x-wiki lualdkykkjs0t0zjm93falbdwkf1l6v 2443964 2443963 2026-08-04T11:48:44Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1284.eqiad.wmnet 2443964 wikitext text/x-wiki pgfiauzjrcylpsxae97lgyqi2qdj4i0 2443965 2443964 2026-08-04T11:48:58Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1286.eqiad.wmnet 2443965 wikitext text/x-wiki q56fbq0zn2n7idn5amqy8vdfcuvpuvd 2443967 2443965 2026-08-04T11:49:16Z Stashbot 7414 jayme@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on wikikube-worker1141.eqiad.wmnet with reason: host reimage 2443967 wikitext text/x-wiki 0kl9tvmvo576bgg975fwsqp0kwuvps0 2443968 2443967 2026-08-04T11:51:45Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.reimage for host ms-be2096.codfw.wmnet with OS trixie 2443968 wikitext text/x-wiki 2kh414jpq2a3nkgq1k3cehnb4xty2pz 2443969 2443968 2026-08-04T11:53:43Z Stashbot 7414 jayme@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wikikube-worker1141.eqiad.wmnet with reason: host reimage 2443969 wikitext text/x-wiki lass30p1mnnczt9f9500s7shetgnqds 2443970 2443969 2026-08-04T11:54:15Z Stashbot 7414 cwilliams@cumin1003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host db1286.eqiad.wmnet 2443970 wikitext text/x-wiki jocacbppfnao1o8eqtatyzzeubpod4i 2443971 2443970 2026-08-04T11:54:29Z Stashbot 7414 cwilliams@cumin1003: START - Cookbook sre.hosts.reboot-single for host db1287.eqiad.wmnet 2443971 wikitext text/x-wiki qm07yotzpm379ev10sb6xw3ktos5ril 2443972 2443971 2026-08-04T11:54:48Z Stashbot 7414 mvernon@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ms-be1097.eqiad.wmnet with OS trixie 2443972 wikitext text/x-wiki 8sk8l7npwkqqgxfhlqm4xwwyyyvqo81 0 8495 2443565 2443348 2026-08-03T15:54:12Z BCornwall-WMF 31521 /* X-Analytics */ ce, grammar 2443565 wikitext text/x-wiki k18a6az55rmwvdsd4d0yt8mpy7xqiuv 2443566 2443565 2026-08-03T15:58:39Z BCornwall-WMF 31521 /* X-Analytics */ use gitweb template 2443566 wikitext text/x-wiki bb2paz33ltvulilsa509jzzum0xrnxx 498 15970 2443721 2388720 2026-08-04T01:45:31Z Stashbot 7414 bawolff: Migrated to new instance extdist-07 2443721 wikitext text/x-wiki 2uwhc8udjrsc95ph8u0hw8xy4xrb6ed 0 17290 2443575 2443327 2026-08-03T16:37:04Z Stashbot 7414 James_F: Zuul: Drop REL1_44 testing, EOL, for T428911 2443575 wikitext text/x-wiki cs4okyr2ls9mafgx66xqqzyr8zofvpm 2443578 2443575 2026-08-03T16:40:41Z Stashbot 7414 hashar: gerrit: added Vaughn Walters to integration group until he get added to the ciadmin LDAP group | T433615 2443578 wikitext text/x-wiki 1cwhigtlrjaymoyckze9z2mq7vvrqzl 2443676 2443578 2026-08-03T20:45:35Z Stashbot 7414 dancy: Updating buildkitd to v0.32.1 on gitlab-cloud-runners (staging and production) (T433879) 2443676 wikitext text/x-wiki hu2m7pmm1m615vv00toksgokhic1ysb 498 30942 2443538 2441701 2026-08-03T14:50:08Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (T431374) 2443538 wikitext text/x-wiki 0flx6a78n9dktu5ppd6etdcigpik01e 2443539 2443538 2026-08-03T14:50:13Z Stashbot 7414 andrew@cloudcumin1001: END (ERROR) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=97) (T431374) 2443539 wikitext text/x-wiki 2gi9hmtkzn6g1to9iiilt134l6yh61u 2443540 2443539 2026-08-03T14:50:17Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (T431682) 2443540 wikitext text/x-wiki 7vl75s7pun7srvxx37xpldxaa78aetn 2443541 2443540 2026-08-03T14:50:23Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) (T431682) 2443541 wikitext text/x-wiki qo2jrcwcjvlmvf1nacipkbbqo9n8lgg 2443591 2443541 2026-08-03T16:52:17Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.set_maintenance (T431374) 2443591 wikitext text/x-wiki tqoi5i6dcnljd86usm973xq13g6poc7 2443592 2443591 2026-08-03T16:52:22Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.set_maintenance (exit_code=0) (T431374) 2443592 wikitext text/x-wiki qhgvvytzu6gpgyzkw84qwpjdu2r3d75 2 440766 2443739 2441165 2026-08-04T06:28:40Z Valerio Bozzolan 10109 [[Tool:itwiki]] 2443739 wikitext text/x-wiki ghfy92qol7t7ojp1sa6rxxoi4ygg620 498 443713 2443657 2386679 2026-08-03T19:08:52Z Stashbot 7414 wmbot~valeriobozzolan@tools-bastion-15: Updated deletionbot https://gitlab.wikimedia.org/valeriobozzolan/itwiki-deletions-info-bot/-/commit/999a5e7ac93feec5f1f0f6a640b6e80478935ecf 2443657 wikitext text/x-wiki ez5vs1dr53u2d37muitzxf0rk1ox7fc 2443663 2443657 2026-08-03T20:07:06Z Stashbot 7414 wmbot~valeriobozzolan@tools-bastion-15: deletionbot: testing in production lol 2443663 wikitext text/x-wiki qdrys2zxpzix6fhqsr8jtoishweaaqt 2443797 2443663 2026-08-04T09:09:16Z Stashbot 7414 wmbot~valeriobozzolan@tools-bastion-15: deletionbot: released latest changes - up to commit https://gitlab.wikimedia.org/valeriobozzolan/itwiki-deletions-info-bot/-/commit/9970286a802c47673932856b1163a5c755a32d6b 2443797 wikitext text/x-wiki 3m9jsgyff631ca57wbafr9ckcr3eq1n 498 448635 2443548 2441970 2026-08-03T15:14:08Z Stashbot 7414 andrewbogott: running the migration cookbook for T433426 2443548 wikitext text/x-wiki lyji5jzgv0pqryczvfs1rtspcqzzr44 2443549 2443548 2026-08-03T15:14:16Z Stashbot 7414 andrew@cloudcumin1001: START - Cookbook wmcs.nfs.migrate_service (T433426) 2443549 wikitext text/x-wiki obr3gwi8zzrzknzsgkutzjwewogni7u 2443551 2443549 2026-08-03T15:18:36Z Stashbot 7414 andrew@cloudcumin1001: END (PASS) - Cookbook wmcs.nfs.migrate_service (exit_code=0) (T433426) 2443551 wikitext text/x-wiki bz42gmhkfvgo5r0yqfctqm8ri46qdwb 0 448785 2443720 2442090 2026-08-04T01:45:21Z EMcnaughton (WMF) 6074 Minor updates 2443720 wikitext text/x-wiki 3resgp8xqlx1x1954gb1i1nrxmo8eir 2443724 2443720 2026-08-04T01:49:57Z EMcnaughton (WMF) 6074 2443724 wikitext text/x-wiki rtvk9bg3dkq289aqvnqme5faa2bfwtm 2443725 2443724 2026-08-04T01:52:02Z EMcnaughton (WMF) 6074 /* Reconciliation (Audit framework) */ 2443725 wikitext text/x-wiki liye2utmou3mlujv26tucr6aufmdj3c 2443730 2443725 2026-08-04T02:51:11Z EMcnaughton (WMF) 6074 2443730 wikitext text/x-wiki bhhlyk9f9s6expgpw8eji0wkmxrhs00 2443736 2443730 2026-08-04T04:21:59Z EMcnaughton (WMF) 6074 /* Reconciliation (Audit framework) */ Add what to do 2443736 wikitext text/x-wiki c85pl9aeuv0od527bdgxth1xcn3zu6o 2443737 2443736 2026-08-04T04:39:21Z EMcnaughton (WMF) 6074 /* How to resolve issues */ 2443737 wikitext text/x-wiki kdleyqf08eblfa71bh3q1vix1prwewz 2443738 2443737 2026-08-04T04:49:59Z EMcnaughton (WMF) 6074 /* Resolving Audit issues */ 2443738 wikitext text/x-wiki 8vljw7vdn1n4khla8sgaajvocgitpmk 0 448962 2443532 2443409 2026-08-03T14:24:00Z JWodstrcil (WMF) 24826 add more details about how to update the helm chart 2443532 wikitext text/x-wiki r80qosffcrvkqqyf2hg02phsg61wq74 2443533 2443532 2026-08-03T14:25:32Z JWodstrcil (WMF) 24826 2443533 wikitext text/x-wiki 5jjat2ckp0eo2l0bmcsyjv5zmfwzz95 0 449160 2443714 2443436 2026-08-04T00:00:03Z Dexbot 30554 Bot: Updating the report 2443714 wikitext text/x-wiki 02b6ii11mm984mn7rnvdnund5v88tx6 0 453098 2443590 2093788 2026-08-03T16:52:05Z AStein-WMF 39485 2443590 wikitext text/x-wiki os8pnnxcsd1ylo3jloyozht036fxykt 0 453468 2443519 2443317 2026-08-03T13:41:46Z Matma Rex 562 /* Rotating */ Change "Logstash: mw-client-core-platform-errors dashboard" link to link to the "Last 7 days" too 2443519 wikitext text/x-wiki cfx5ai8le2oz2obxoi47qnrsz3dv81d 0 453707 2443890 2401027 2026-08-04T10:46:05Z MArostegui (WMF) 8620 /* After a few days of uptime */ Changed depool command 2443890 wikitext text/x-wiki ghmw05n01hfrhxcm49gr49byymopom5 2443891 2443890 2026-08-04T10:47:56Z MArostegui (WMF) 8620 /* After a few days of uptime */ Changed repool method 2443891 wikitext text/x-wiki gp774udzqtzx60jp95qga7chp3jhl3p 0 454129 2443688 2426292 2026-08-03T21:31:09Z MPopov (WMF) 5891 2443688 wikitext text/x-wiki tldh0015xw6zozg39r6rsi7s3d3lvk6 0 459044 2443669 2443333 2026-08-03T20:19:30Z BKing (WMF) 29017 /* Replacing master-eligibles */ 2443669 wikitext text/x-wiki 2sak8j0dome83v9m6ubs1ffj51ek0fm 0 459076 2443966 2411278 2026-08-04T11:49:05Z CMooney (WMF) 24288 /* First login */ 2443966 wikitext text/x-wiki ou8x88vvj9sw2xl1x31k0g543ej8l50 0 459517 2443722 2442094 2026-08-04T01:48:03Z EMcnaughton (WMF) 6074 /* Validation */ 2443722 wikitext text/x-wiki mvuzqy1llqty31bi440hq645skh1zd5 2443723 2443722 2026-08-04T01:48:39Z EMcnaughton (WMF) 6074 /* Intacct Journal Generation & Upload */ 2443723 wikitext text/x-wiki 8dov5bakrsz4g7jgm0iuz2356o0542a 2443728 2443723 2026-08-04T02:19:47Z EMcnaughton (WMF) 6074 /* Data Sources */ 2443728 wikitext text/x-wiki jmh64yzb8xa8vj1oko5890mrxpiyrrk 0 459699 2443699 2443038 2026-08-03T22:06:14Z Stashbot 7414 eileen: SmashPig upgraded from 0c2593b5 to c89520d4 2443699 wikitext text/x-wiki 3j89evnsfmx5zj2i0jyzo0ovc0ogt5d 2443701 2443699 2026-08-03T22:27:25Z Stashbot 7414 eileen: civicrm upgraded from 26bd5ab6 to 9c8ee02f 2443701 wikitext text/x-wiki 54vw0n4fokjl8scd18zr5wcet7y3cjc 2443719 2443701 2026-08-04T00:51:46Z Stashbot 7414 eileen: checking attributes 2443719 wikitext text/x-wiki qmr4a1ey4pkjfxbi5mw18fgbd9yitxm 2443729 2443719 2026-08-04T02:35:17Z Stashbot 7414 ejegg: fundraising civicrm upgraded from 9c8ee02f to 8ed3282e 2443729 wikitext text/x-wiki smbpozth6t7bg1hl80b5w8eusm1ervm 2 460230 2443913 2420865 2026-08-04T11:13:31Z SLyngshede-WMF 31501 /* Checking node health and status */ Update test URL to a thumbnail size we accept. 2443913 wikitext text/x-wiki mx51ee84oryebqffllvjdl5ltrj5tz3 0 460366 2443675 2437957 2026-08-03T20:43:08Z AWesterinen-WMF 54189 /* Query Rewrite Patterns */ 2443675 wikitext text/x-wiki cpfuyn77q4a8lpz7i4dfdsydc9q9nra 0 460376 2443626 2437960 2026-08-03T17:53:13Z AWesterinen-WMF 54189 2443626 wikitext text/x-wiki qle8ade1f81rfwl148d0qa8p8b3avif 2443679 2443626 2026-08-03T20:48:07Z AWesterinen-WMF 54189 /* wikibase:isSomeValue() */ 2443679 wikitext text/x-wiki iljymhdusty4qv2qay1lva2nvye0mey 0 460417 2443933 2443404 2026-08-04T11:25:03Z ISarantopoulos-WMF 34784 remove aya-llm info as it is not deployed 2443933 wikitext text/x-wiki 33sbv8hrb1lti6egd8ynssk6dmtj724 2 460515 2443659 2026-08-03T19:40:42Z Ottomata 88 Assisted-By: Claude Opus 4.8 2443659 wikitext text/x-wiki 9upncaq9wau2nkcj4mbexe00on3rmug 2443662 2443659 2026-08-03T20:04:53Z Ottomata 88 2443662 wikitext text/x-wiki 54bs5pnhsllk7up3o5wi8mzjvmpdn6i 2443665 2443662 2026-08-03T20:08:43Z Ottomata 88 2443665 wikitext text/x-wiki t3dhyrzlu16sskrufpketpzfboizfcd 0 460516 2443906 2026-08-04T11:07:01Z Taavi-WMF 41365 Redirected page to [[Portal:Cloud VPS/Admin/Testing deployment]] 2443906 wikitext text/x-wiki mjesyie9qokm1bm5lvvgivbpoyi9sbs