Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.24 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 1436 2467400 2430943 2026-10-13T22:22:18Z Southparkfan 1843 2467400 wikitext text/x-wiki 8xetqpu2z499e8uq8y2n0h08bz2wonb 0 4108 2467232 2466723 2026-10-13T15:56:00Z Aude 39 /* {{Deployment_day|date=2026-10-13}} */ move backport 2467232 wikitext text/x-wiki ewm1qncjq44wynu05pktce238nsjmhx 2467321 2467232 2026-10-13T18:07:54Z ScheduleDeploymentBot 37566 Add [[gerrit:1329640]] to Tuesday, October 13 UTC late backport window 2467321 wikitext text/x-wiki ivl3sos61oq1a1ayl3r9vz464aqywp6 2467322 2467321 2026-10-13T18:07:58Z ScheduleDeploymentBot 37566 Add [[gerrit:1354557]] to Tuesday, October 13 UTC late backport window 2467322 wikitext text/x-wiki 68l1fhrmbl2tbe72mrizl9drgz2sxv1 2467353 2467322 2026-10-13T19:43:48Z ScheduleDeploymentBot 37566 Add [[gerrit:1354868]] to Tuesday, October 13 UTC late backport window 2467353 wikitext text/x-wiki m6h4jcrlwwfag99ongr87bdqj75huwl 2467354 2467353 2026-10-13T19:49:21Z Aude 39 /* {{Deployment_day|date=2026-10-13}} */ fix formatting 2467354 wikitext text/x-wiki 9mmqll3139gu2d6hkweitna43gi4818 2467355 2467354 2026-10-13T19:50:59Z ScheduleDeploymentBot 37566 Add [[gerrit:1354869]] to Tuesday, October 13 UTC late backport window 2467355 wikitext text/x-wiki 548qqxl3s7c2wgxdfojr0ye17kuobaa 2467364 2467355 2026-10-13T19:58:41Z Mmullie (WMF) 291 /* {{Deployment_day|date=2026-10-13}} */ 2467364 wikitext text/x-wiki 9mmqll3139gu2d6hkweitna43gi4818 2467365 2467364 2026-10-13T19:59:01Z ScheduleDeploymentBot 37566 Add [[gerrit:1354869]] to Wednesday, October 14 UTC morning backport window 2467365 wikitext text/x-wiki dwrk4x2ufnr4sk1gfc74dn7l3ma0yd7 2467622 2467365 2026-10-14T07:46:12Z Adam Wight (WMDE) 3064 /* {{Deployment_day|date=2026-10-14}} */ mark deployments as done 2467622 wikitext text/x-wiki b7tgkfycpdj0779mrnixae6ajt8feum 498 5034 2467401 2464797 2026-10-13T22:23:11Z Southparkfan 1843 2467401 wikitext text/x-wiki 441fc63g8p4p0pgi184fxa2q239t27f 0 7919 2466953 2466948 2026-10-13T12:38:50Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.deploy.python-code netbox to netbox2003.codfw.wmnet,netbox1003.eqiad.wmnet with reason: Add netbox-bgp and update wheels on netbox - ayounsi@cumin1004 2466953 wikitext text/x-wiki q3m1whr1jjhrjxrtabtuj9vuf49bv20 2466954 2466953 2026-10-13T12:38:53Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.enable_virtualization rolling provision on D{wikikube-worker[1240-1259].eqiad.wmnet} and (A:wikikube-master-eqiad or A:wikikube-worker-eqiad) 2466954 wikitext text/x-wiki 8atm5sn19jromm2kneyuyj6pqjtax23 2466955 2466954 2026-10-13T12:38:57Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1240.eqiad.wmnet 2466955 wikitext text/x-wiki 2kmob6ef86pww3ecm2a8dw7abog0hxi 2466957 2466955 2026-10-13T12:43:59Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1240.eqiad.wmnet 2466957 wikitext text/x-wiki g4h1hjcv7ysigltfa1wbxxikmcbzjaw 2466958 2466957 2026-10-13T12:44:19Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1240.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2466958 wikitext text/x-wiki 335scw34kwiwhk70yh7yu1k2sgtjran 2466959 2466958 2026-10-13T12:49:00Z Stashbot 7414 hashar@deploy1003: Started scap sync-world: Backport for [[gerrit:1354774|Revert "forms: Fix checkbox and radio misalignment on edit page" (T440971 T437803)]] 2466959 wikitext text/x-wiki 9hk44ej8xucxhkher33zfuf1eacdaec 2466960 2466959 2026-10-13T12:49:03Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) netbox to netbox2003.codfw.wmnet,netbox1003.eqiad.wmnet with reason: Add netbox-bgp and update wheels on netbox - ayounsi@cumin1004 2466960 wikitext text/x-wiki r6lenwkssgeyky9qudar3rftl0mwk8h 2466961 2466960 2026-10-13T12:53:12Z Stashbot 7414 hashar@deploy1003: hashar: Backport for [[gerrit:1354774|Revert "forms: Fix checkbox and radio misalignment on edit page" (T440971 T437803)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2466961 wikitext text/x-wiki 3drje5gi0st4esstlnhh3wcqx399wmc 2466962 2466961 2026-10-13T12:53:50Z Stashbot 7414 hashar@deploy1003: hashar: Continuing with deployment 2466962 wikitext text/x-wiki 6zjww3ozqmjednegqmrkfre6780n3g8 2466963 2466962 2026-10-13T12:54:09Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1240.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2466963 wikitext text/x-wiki kecn5s4sgm7n1ga7tewfydk0hf2nuaa 2466964 2466963 2026-10-13T12:54:27Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1240.eqiad.wmnet 2466964 wikitext text/x-wiki 2aqgc26m2ocgyh2olt9na52eoa7cp70 2466965 2466964 2026-10-13T12:54:29Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1240.eqiad.wmnet 2466965 wikitext text/x-wiki 2x7kd9d6up49unbqejoeeoafdx2zery 2466966 2466965 2026-10-13T12:54:42Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1241.eqiad.wmnet 2466966 wikitext text/x-wiki f32jnl7wnaqonosdc2u5uwbtchiifm9 2466967 2466966 2026-10-13T12:55:15Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1241.eqiad.wmnet 2466967 wikitext text/x-wiki p6fwqpm5sjbylvam5hw7n72001cx1xp 2466968 2466967 2026-10-13T12:55:35Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1241.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2466968 wikitext text/x-wiki 37noojvt1n4gebqhos89f3bl0724qqm 2466969 2466968 2026-10-13T13:00:24Z Stashbot 7414 hashar@deploy1003: Finished scap sync-world: Backport for [[gerrit:1354774|Revert "forms: Fix checkbox and radio misalignment on edit page" (T440971 T437803)]] (duration: 11m 24s) 2466969 wikitext text/x-wiki nc5b0r3y0jay4gdi333lwfx9e546n6w 2466970 2466969 2026-10-13T13:03:16Z Stashbot 7414 ladsgroup@cumin1004: START - Cookbook sre.mysql.pool pool db2191: Maint done 2466970 wikitext text/x-wiki 6kio2gwv6mam4f4w6wgqqw9efftr0ai 2466971 2466970 2026-10-13T13:05:24Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1241.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2466971 wikitext text/x-wiki ji82nghnt1cwas5ztbxh47kepq4mkox 2466972 2466971 2026-10-13T13:05:43Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1241.eqiad.wmnet 2466972 wikitext text/x-wiki rlz1dnw0b2fjkhxfqlr9ombusf8r6kd 2466973 2466972 2026-10-13T13:07:29Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1241.eqiad.wmnet 2466973 wikitext text/x-wiki 5s5rjhn531ddzbpfo4a67amctwpgoyl 2466974 2466973 2026-10-13T13:07:43Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1242.eqiad.wmnet 2466974 wikitext text/x-wiki 63ypjivwcd7yieozayc3y6b1ypnk1lm 2466975 2466974 2026-10-13T13:07:54Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.enable_virtualization rolling provision on D{wikikube-worker[2196-2215].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) 2466975 wikitext text/x-wiki 0rl1say4z8raofpxcn85bretzfu55d3 2466976 2466975 2026-10-13T13:07:57Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2196.codfw.wmnet 2466976 wikitext text/x-wiki 1akj3obuo8ldkdrzuzrh2ycneu8kbc0 2466977 2466976 2026-10-13T13:08:16Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1242.eqiad.wmnet 2466977 wikitext text/x-wiki 2olg8nh5x3xvenir9h3z2mfhnrnpztc 2466978 2466977 2026-10-13T13:08:32Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2196.codfw.wmnet 2466978 wikitext text/x-wiki 7mpind22psplk406xfb2fcw5bsvyku5 2466979 2466978 2026-10-13T13:08:35Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1242.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2466979 wikitext text/x-wiki bshwmc2op8lja0k5comhoj5muf7j765 2466980 2466979 2026-10-13T13:08:52Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2196.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2466980 wikitext text/x-wiki cc7dvn7qvt5qx0icoqsnjm2y18so1l9 2466981 2466980 2026-10-13T13:13:22Z Stashbot 7414 btullis@cumin1004: END (FAIL) - Cookbook sre.ceph.rotate-osd-keys (exit_code=1) rolling rotate_keys on A:cephosd-eqiad 2466981 wikitext text/x-wiki 7j1zyrpoim6iwm10taxpkua2zmyq9el 2466982 2466981 2026-10-13T13:18:13Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2196.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2466982 wikitext text/x-wiki 39jijfc08wrm82f7ky897jcthh53wqq 2466983 2466982 2026-10-13T13:18:27Z Stashbot 7414 jelto@deploy1003: Started scap deploy-service miscweb: test deployment of miscweb using deploy-service and spiderpig - annual report version bump 2466983 wikitext text/x-wiki p7zv6oyylbqog1ogzd73z9v4yp6shuh 2466984 2466983 2026-10-13T13:18:29Z Stashbot 7414 jelto@deploy1003: scap deploy-service miscweb: [STAGING/DEFAULT] staging-eqiad Deploying miscweb 2466984 wikitext text/x-wiki jfxim3i7tdmmlt2u1465u1zt07ya24u 2466985 2466984 2026-10-13T13:18:31Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2196.codfw.wmnet 2466985 wikitext text/x-wiki j9w4f78zo745jgyoylhiig0tufkvpxy 2466986 2466985 2026-10-13T13:18:33Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2196.codfw.wmnet 2466986 wikitext text/x-wiki bnxbwtly9mf2ig5e2hki3tsuhtx5htq 2466987 2466986 2026-10-13T13:18:47Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2197.codfw.wmnet 2466987 wikitext text/x-wiki 9wmidguao3rhvmxhwzlux6obpdyqnyj 2466988 2466987 2026-10-13T13:19:02Z Stashbot 7414 jelto@deploy1003: scap deploy-service miscweb: [PRODUCTION/DEFAULT] codfw Deploying miscweb 2466988 wikitext text/x-wiki 9mxgh07fkahjm25fegwo05wsf3ez2fa 2466989 2466988 2026-10-13T13:19:21Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2197.codfw.wmnet 2466989 wikitext text/x-wiki ryok1jw2jfl6fead2b94j838wopmjxp 2466990 2466989 2026-10-13T13:19:41Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2197.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2466990 wikitext text/x-wiki f14rwh6b9624gnf4k1aq5acne1fwsmo 2466991 2466990 2026-10-13T13:19:47Z Stashbot 7414 jelto@deploy1003: scap deploy-service miscweb: [PRODUCTION/DEFAULT] eqiad Deploying miscweb 2466991 wikitext text/x-wiki 7iua9hbei0s4256haedaafwmrt1vdkn 2466992 2466991 2026-10-13T13:20:06Z Stashbot 7414 jayme@deploy1003: helmfile [eqiad] START helmfile.d/admin 'sync'. 2466992 wikitext text/x-wiki bu40ypfjgjxo9xc5i6po060p74oqq53 2466993 2466992 2026-10-13T13:20:09Z Stashbot 7414 jayme@deploy1003: helmfile [eqiad] DONE helmfile.d/admin 'sync'. 2466993 wikitext text/x-wiki cgtdk6cwj1a5xhtveonggofvg2fg1u5 2466994 2466993 2026-10-13T13:20:19Z Stashbot 7414 jayme@deploy1003: helmfile [codfw] START helmfile.d/admin 'sync'. 2466994 wikitext text/x-wiki mne5ubjiiuqkj6tv1be16w5wsyp5ju9 2466995 2466994 2026-10-13T13:20:21Z Stashbot 7414 jelto@deploy1003: Finished scap deploy-service miscweb: test deployment of miscweb using deploy-service and spiderpig - annual report version bump (duration: 01m 54s) 2466995 wikitext text/x-wiki 02hnyz5ssb60cnzsw0amqijpoylz0a3 2466996 2466995 2026-10-13T13:20:29Z Stashbot 7414 jayme@deploy1003: helmfile [codfw] DONE helmfile.d/admin 'sync'. 2466996 wikitext text/x-wiki az6308ph9h3gupfhlm8vyrw613io7up 2466997 2466996 2026-10-13T13:20:35Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1242.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2466997 wikitext text/x-wiki gy17ctbzyxt5fhpblw29sn4nmj8xfel 2466998 2466997 2026-10-13T13:20:38Z Stashbot 7414 jayme@deploy1003: helmfile [staging-eqiad] START helmfile.d/admin 'sync'. 2466998 wikitext text/x-wiki 1xxy3hayf9817qu7r0tgsvkbmjft7w3 2466999 2466998 2026-10-13T13:20:43Z Stashbot 7414 jayme@deploy1003: helmfile [staging-eqiad] DONE helmfile.d/admin 'sync'. 2466999 wikitext text/x-wiki 2cahmbvcopn7w31uu10y5mciow6jm8f 2467000 2466999 2026-10-13T13:20:52Z Stashbot 7414 jayme@deploy1003: helmfile [staging-codfw] START helmfile.d/admin 'sync'. 2467000 wikitext text/x-wiki 239k2d2ydsgu3h3057g7i6pdo9xyaoz 2467001 2467000 2026-10-13T13:20:54Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1242.eqiad.wmnet 2467001 wikitext text/x-wiki s1ad27lp8npzhwvsptvsvysw2j16688 2467002 2467001 2026-10-13T13:20:55Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1242.eqiad.wmnet 2467002 wikitext text/x-wiki 0sau53o12yqhpvt7sosr14baiscqofr 2467003 2467002 2026-10-13T13:21:04Z Stashbot 7414 jayme@deploy1003: helmfile [staging-codfw] DONE helmfile.d/admin 'sync'. 2467003 wikitext text/x-wiki avkh3gd300olhydxtm27vz2r6tjpadv 2467004 2467003 2026-10-13T13:21:08Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1243.eqiad.wmnet 2467004 wikitext text/x-wiki imzcje6nww38f8so6j1th74pt3ox9tq 2467005 2467004 2026-10-13T13:21:13Z Stashbot 7414 jayme@deploy1003: helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. 2467005 wikitext text/x-wiki 62h005khmna0k364of0aevivxadfhj6 2467006 2467005 2026-10-13T13:21:19Z Stashbot 7414 jayme@deploy1003: helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. 2467006 wikitext text/x-wiki p2dbstwxujh6j68ceet14kkh2uav9ox 2467007 2467006 2026-10-13T13:21:27Z Stashbot 7414 jayme@deploy1003: helmfile [ml-serve-codfw] START helmfile.d/admin 'sync'. 2467007 wikitext text/x-wiki 7obsksbwqj8mipz43pykw7oy6egjy97 2467008 2467007 2026-10-13T13:21:40Z Stashbot 7414 jayme@deploy1003: helmfile [ml-serve-codfw] DONE helmfile.d/admin 'sync'. 2467008 wikitext text/x-wiki 40o34f4yegbtt0uil2p6at4cnzpxsa1 2467009 2467008 2026-10-13T13:21:49Z Stashbot 7414 jayme@deploy1003: helmfile [ml-staging-codfw] START helmfile.d/admin 'sync'. 2467009 wikitext text/x-wiki lcu6i63af9xfkcsh28c7h5yqh9fcab3 2467010 2467009 2026-10-13T13:22:02Z Stashbot 7414 jayme@deploy1003: helmfile [ml-staging-codfw] DONE helmfile.d/admin 'sync'. 2467010 wikitext text/x-wiki 5g3jq7i3ny3byauomtqbfd7ld9s5k85 2467011 2467010 2026-10-13T13:22:12Z Stashbot 7414 jayme@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'sync'. 2467011 wikitext text/x-wiki oa0nnso03cwrsqohhwij1zokx4z1hfc 2467012 2467011 2026-10-13T13:22:16Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1243.eqiad.wmnet 2467012 wikitext text/x-wiki nhouv2v4aoc03k9bz5x1r3gzajxsklu 2467013 2467012 2026-10-13T13:22:18Z Stashbot 7414 jayme@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'sync'. 2467013 wikitext text/x-wiki 6fl0x054ggslm8i477g6pwy63bm6apb 2467014 2467013 2026-10-13T13:22:26Z Stashbot 7414 jayme@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'sync'. 2467014 wikitext text/x-wiki bjk7zzl5zgiry7peyk898vlkp0bzj3t 2467015 2467014 2026-10-13T13:22:35Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1243.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467015 wikitext text/x-wiki rd0l7iyu7mfndqgcxd9uaqioy7fwnkr 2467016 2467015 2026-10-13T13:22:38Z Stashbot 7414 jayme@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'sync'. 2467016 wikitext text/x-wiki gj51ur0ej9gfxw545u2zcjfkaiod493 2467017 2467016 2026-10-13T13:22:46Z Stashbot 7414 jayme@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/admin 'sync'. 2467017 wikitext text/x-wiki 2w8b38f2mtia70az83izhe5fm194na9 2467018 2467017 2026-10-13T13:22:51Z Stashbot 7414 jayme@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/admin 'sync'. 2467018 wikitext text/x-wiki 76pr6bqk5qyzqef2z9vkvm8mui4moon 2467019 2467018 2026-10-13T13:22:59Z Stashbot 7414 jayme@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/admin 'sync'. 2467019 wikitext text/x-wiki qhnjrmnk0lu9ua28kqojlijk37tbdt3 2467020 2467019 2026-10-13T13:23:12Z Stashbot 7414 jayme@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/admin 'sync'. 2467020 wikitext text/x-wiki 9jp6eepwk42q99c1sls0dgh31rwjnpy 2467021 2467020 2026-10-13T13:23:54Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.ceph.rotate-osd-keys rolling rotate_keys on A:cephosd-eqiad 2467021 wikitext text/x-wiki b09kog9gye171okretuk1h58utqzfp7 2467022 2467021 2026-10-13T13:29:03Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2197.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467022 wikitext text/x-wiki qjlbqsy4rg5cj5unlarb2r0ihnbk2gi 2467023 2467022 2026-10-13T13:29:20Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2197.codfw.wmnet 2467023 wikitext text/x-wiki r0fbmjgla6xenkpjumt2spdmkf0id40 2467024 2467023 2026-10-13T13:31:01Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2197.codfw.wmnet 2467024 wikitext text/x-wiki l23608qpj0n331hfk8wvd8b57n1wwre 2467025 2467024 2026-10-13T13:31:14Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2198.codfw.wmnet 2467025 wikitext text/x-wiki 4bvm06f6cusookx3muvgawvr56uab57 2467026 2467025 2026-10-13T13:31:48Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2198.codfw.wmnet 2467026 wikitext text/x-wiki 8tjs075q7hoi1h1rev7tzyz7n9u0k8i 2467027 2467026 2026-10-13T13:32:12Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2198.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467027 wikitext text/x-wiki lluu7mz1eptsmr7hjngsbctt7lqq20u 2467028 2467027 2026-10-13T13:32:56Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1243.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467028 wikitext text/x-wiki hcuxlj990bh1b20c3nyl321f18fwrgl 2467029 2467028 2026-10-13T13:33:14Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1243.eqiad.wmnet 2467029 wikitext text/x-wiki 9bgv7anjh0hitzsmv8970r81xytk7ac 2467030 2467029 2026-10-13T13:34:29Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1243.eqiad.wmnet 2467030 wikitext text/x-wiki la6hpljwrq4fouvo8najbrp8286kucu 2467032 2467030 2026-10-13T13:34:42Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1244.eqiad.wmnet 2467032 wikitext text/x-wiki 5i6hhwvnoz788prm0vwgbd95fxggztr 2467033 2467032 2026-10-13T13:35:15Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1244.eqiad.wmnet 2467033 wikitext text/x-wiki 01j9ebbyt0hg43x9fo2yvaxs5o544fd 2467035 2467033 2026-10-13T13:35:34Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1244.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467035 wikitext text/x-wiki gpvbyhddz2hi8yudpkae3od72v4u68t 2467036 2467035 2026-10-13T13:37:26Z Stashbot 7414 kamila@deploy1003: Started scap deploy-service shellbox: Update image version 2467036 wikitext text/x-wiki gpmd22qnjpz0smwwedjc5szabd3xsmc 2467037 2467036 2026-10-13T13:37:27Z Stashbot 7414 kamila@deploy1003: scap deploy-service shellbox: [STAGING/DEFAULT] staging-eqiad Deploying shellbox, shellbox-constraints, shellbox-media, shellbox-syntaxhighlight, shellbox-timeline, shellbox-video 2467037 wikitext text/x-wiki ad29xc5c3wfysdhh11noiyyhwi7uc7n 2467038 2467037 2026-10-13T13:38:10Z Stashbot 7414 kamila@deploy1003: scap deploy-service shellbox: [PRODUCTION/DEFAULT] codfw Deploying shellbox, shellbox-constraints, shellbox-media, shellbox-syntaxhighlight, shellbox-timeline, shellbox-video 2467038 wikitext text/x-wiki 0jpuxuw1hevcq7l0a0bcbo6hknpn45u 2467039 2467038 2026-10-13T13:41:03Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2198.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467039 wikitext text/x-wiki 01za2lvgawvz9nbyqvrkbk3ex08b9dk 2467040 2467039 2026-10-13T13:41:22Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2198.codfw.wmnet 2467040 wikitext text/x-wiki nry3mxb9bztqfym1o7x4xga36wn6vyp 2467041 2467040 2026-10-13T13:41:24Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2198.codfw.wmnet 2467041 wikitext text/x-wiki 3d57c4ri8bf5pjcfly8y5qq1qye1kaw 2467042 2467041 2026-10-13T13:41:37Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2199.codfw.wmnet 2467042 wikitext text/x-wiki awhci3q192ldikinz16ln0shi6zpjiz 2467043 2467042 2026-10-13T13:42:12Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2199.codfw.wmnet 2467043 wikitext text/x-wiki oh5f93lyamsmrb1hj59qbfs0rh1a7mi 2467044 2467043 2026-10-13T13:42:31Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2199.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467044 wikitext text/x-wiki kaxt3l02rie76e28xd0b0n49prwg8o7 2467045 2467044 2026-10-13T13:45:24Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1244.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467045 wikitext text/x-wiki enzufka3suozbufwngm9pjpie21rh4b 2467046 2467045 2026-10-13T13:45:43Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1244.eqiad.wmnet 2467046 wikitext text/x-wiki qx4435aqcqk32p6megv1heff6mtl5pa 2467047 2467046 2026-10-13T13:45:44Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1244.eqiad.wmnet 2467047 wikitext text/x-wiki mocyny3e9tv8hdcayxmg9xjef7chgjl 2467048 2467047 2026-10-13T13:45:57Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1245.eqiad.wmnet 2467048 wikitext text/x-wiki phqpitpvtqik8563vsrk9h2n82nd96m 2467049 2467048 2026-10-13T13:46:33Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1245.eqiad.wmnet 2467049 wikitext text/x-wiki kiyunrk2izaefgimfj194e76227ybzj 2467050 2467049 2026-10-13T13:46:52Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1245.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467050 wikitext text/x-wiki 53bw9xqr067oepzpfzoaolip5n2kq9v 2467051 2467050 2026-10-13T13:47:14Z Stashbot 7414 kamila@deploy1003: scap deploy-service shellbox: [PRODUCTION/DEFAULT] eqiad Deploying shellbox, shellbox-constraints, shellbox-media, shellbox-syntaxhighlight, shellbox-timeline, shellbox-video 2467051 wikitext text/x-wiki 58krmp92dtfdw0im0r0lnfzbu90kwow 2467052 2467051 2026-10-13T13:48:22Z Stashbot 7414 ladsgroup@cumin1004: END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2191: Maint done 2467052 wikitext text/x-wiki 9cr25na2wuuj6phlatfo2pnw7139u1m 2467053 2467052 2026-10-13T13:49:04Z Stashbot 7414 kamila@deploy1003: Finished scap deploy-service shellbox: Update image version (duration: 11m 37s) 2467053 wikitext text/x-wiki ra5rr2b1d8ziheuughlvmmb7p3djzq3 2467054 2467053 2026-10-13T13:51:24Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2199.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467054 wikitext text/x-wiki h4fzbs8mun9l5rigaac7kjw5gzn70w4 2467055 2467054 2026-10-13T13:51:43Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2199.codfw.wmnet 2467055 wikitext text/x-wiki frax1iv4yt7eqnl41m7w39vvu8t78zo 2467056 2467055 2026-10-13T13:53:45Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2199.codfw.wmnet 2467056 wikitext text/x-wiki 7cqg4rnieztbypl593rcx8kpz23pw61 2467057 2467056 2026-10-13T13:53:59Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2200.codfw.wmnet 2467057 wikitext text/x-wiki j8v9pn7jgfhcx2887vflmxe9t07t804 2467058 2467057 2026-10-13T13:54:32Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2200.codfw.wmnet 2467058 wikitext text/x-wiki fwjmfbyauczwimz1n47d5233rstdl9j 2467059 2467058 2026-10-13T13:54:52Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2200.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467059 wikitext text/x-wiki f0qgjcyi9bb4pxq38ayvfxog9c1l7lv 2467060 2467059 2026-10-13T13:56:43Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1245.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467060 wikitext text/x-wiki o9gjuzodpxurevw2x5vlrvbd4onf45w 2467061 2467060 2026-10-13T13:57:11Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1245.eqiad.wmnet 2467061 wikitext text/x-wiki 8nesu120nar7zgidqpo0ly273osce8v 2467062 2467061 2026-10-13T13:57:13Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1245.eqiad.wmnet 2467062 wikitext text/x-wiki lli153rymwl4sad7m601jwckvdco9j2 2467063 2467062 2026-10-13T13:57:26Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1246.eqiad.wmnet 2467063 wikitext text/x-wiki ikllteri11esgq8do2bkq756ombnhdb 2467064 2467063 2026-10-13T13:57:58Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1246.eqiad.wmnet 2467064 wikitext text/x-wiki l60bg37k5zsftwzuruwdxa0axox43sf 2467065 2467064 2026-10-13T13:58:18Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1246.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467065 wikitext text/x-wiki mpe3b4bhgmueg6qrreri520qt1dfxpc 2467066 2467065 2026-10-13T14:01:26Z Stashbot 7414 btullis@cumin1004: END (FAIL) - Cookbook sre.ceph.rotate-osd-keys (exit_code=1) rolling rotate_keys on A:cephosd-eqiad 2467066 wikitext text/x-wiki j1eaijo0s6jup9ah2k1w93sowj5el0z 2467067 2467066 2026-10-13T14:01:44Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.provision for host sretest2004.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467067 wikitext text/x-wiki bkxwxgn63bn1rt33s97m4i13e72j9f6 2467068 2467067 2026-10-13T14:02:25Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sretest2004.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467068 wikitext text/x-wiki 8sly1plzq90hg39jhi528qgx3c8m43t 2467069 2467068 2026-10-13T14:04:13Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2200.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467069 wikitext text/x-wiki 6cto6y00jl123tfekuawxdjukiaq2v1 2467070 2467069 2026-10-13T14:04:25Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2200.codfw.wmnet 2467070 wikitext text/x-wiki 77mdfbwkjinoqou9cp66dvcaa6b537t 2467071 2467070 2026-10-13T14:04:27Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2200.codfw.wmnet 2467071 wikitext text/x-wiki dnknos1kt7oavyms2nv9pd6bma5zns2 2467072 2467071 2026-10-13T14:04:40Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2201.codfw.wmnet 2467072 wikitext text/x-wiki g6wbhvp1n5wg1a6jh755d0v53qcykso 2467073 2467072 2026-10-13T14:05:14Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2201.codfw.wmnet 2467073 wikitext text/x-wiki 9vb1m8iawsz2k7sky2liqm09d7omoox 2467074 2467073 2026-10-13T14:05:34Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2201.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467074 wikitext text/x-wiki tqfi7ht34o5vbtn66xljtgyd3rocr3y 2467075 2467074 2026-10-13T14:08:08Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1246.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467075 wikitext text/x-wiki ektkyjf3ulv53dpk154cngsjp9ci9jo 2467076 2467075 2026-10-13T14:08:27Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1246.eqiad.wmnet 2467076 wikitext text/x-wiki f42w7rm2ip7sygldwci8ae6tq4bmdj4 2467077 2467076 2026-10-13T14:08:28Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1246.eqiad.wmnet 2467077 wikitext text/x-wiki cct80eqoj3zfmc5b8k5fy65tz1h7w4z 2467078 2467077 2026-10-13T14:08:41Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1247.eqiad.wmnet 2467078 wikitext text/x-wiki 82oyh1l7mlbyelayiru8kikocxnckrl 2467079 2467078 2026-10-13T14:09:14Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1247.eqiad.wmnet 2467079 wikitext text/x-wiki irzxxfrjm3squ847yivg754rm8jf3j1 2467080 2467079 2026-10-13T14:09:34Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1247.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467080 wikitext text/x-wiki kd40mr7u9srh9pr02ynlyf6l9o0xg4i 2467082 2467080 2026-10-13T14:09:58Z Stashbot 7414 kamila@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-syntaxhighlight: apply 2467082 wikitext text/x-wiki 3gn9sr444oqtdcxwur4rbfjzda29i3a 2467083 2467082 2026-10-13T14:10:20Z Stashbot 7414 kamila@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-syntaxhighlight: apply 2467083 wikitext text/x-wiki aiaxz0ykkothrhty2nyj8oj9duxislq 2467084 2467083 2026-10-13T14:10:33Z Stashbot 7414 kamila@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-syntaxhighlight: apply 2467084 wikitext text/x-wiki 5gbni7gs3sji4i3xox2dtiuo2sapmnx 2467085 2467084 2026-10-13T14:11:00Z Stashbot 7414 kamila@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-syntaxhighlight: apply 2467085 wikitext text/x-wiki pug26sn09yhlqvq2j6xmnan340mxyq2 2467086 2467085 2026-10-13T14:14:27Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2201.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467086 wikitext text/x-wiki t4mug4p8gz5c6n9wt8kzxvudz5yt1tw 2467087 2467086 2026-10-13T14:14:36Z Stashbot 7414 kamila@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-syntaxhighlight: apply 2467087 wikitext text/x-wiki 5pmw94voa2vkfhhysbjd79n0vrjjcc5 2467088 2467087 2026-10-13T14:14:45Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2201.codfw.wmnet 2467088 wikitext text/x-wiki bq8hqer2sf5w79lvpzrt39geu55niaa 2467089 2467088 2026-10-13T14:14:59Z Stashbot 7414 kamila@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-syntaxhighlight: apply 2467089 wikitext text/x-wiki 0al44j56wtf05aagjm1yfujvzbg1tzl 2467090 2467089 2026-10-13T14:17:09Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2201.codfw.wmnet 2467090 wikitext text/x-wiki 76ortcvud3ye3jx9tx1b3elr4bg1oz6 2467091 2467090 2026-10-13T14:17:23Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2202.codfw.wmnet 2467091 wikitext text/x-wiki m5xldelm7piwkz0ggv3p5xlsd82m8j8 2467092 2467091 2026-10-13T14:17:56Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2202.codfw.wmnet 2467092 wikitext text/x-wiki i1gjjkaqeh1llll8hp07fgruqlx5qb8 2467093 2467092 2026-10-13T14:18:05Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2202.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467093 wikitext text/x-wiki bld7tcwuepp9v7qtii2jjpkpnfb3own 2467094 2467093 2026-10-13T14:19:24Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1247.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467094 wikitext text/x-wiki 4ez8yub6y2ntat0usjmtuylmsxj67sa 2467095 2467094 2026-10-13T14:19:51Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1247.eqiad.wmnet 2467095 wikitext text/x-wiki 2tuiuog0fk91qxpvaxtnfstqu614rar 2467096 2467095 2026-10-13T14:19:53Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1247.eqiad.wmnet 2467096 wikitext text/x-wiki mr2vqs1vjkffnssucfc7018dekr3hnx 2467097 2467096 2026-10-13T14:20:05Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1248.eqiad.wmnet 2467097 wikitext text/x-wiki jxhx1itwo8os856fnsfhyms5g2odtys 2467098 2467097 2026-10-13T14:20:38Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1248.eqiad.wmnet 2467098 wikitext text/x-wiki 9czl7zc5to6tdcvqvefnxnprp68wg71 2467099 2467098 2026-10-13T14:20:59Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1248.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467099 wikitext text/x-wiki becdy8z2vjb9e1f4p1dioylbq8m5fmp 2467100 2467099 2026-10-13T14:23:33Z Stashbot 7414 hashar@deploy1003: Started deploy [gerrit/gerrit@3cd8cb0]: wm-pcc: switch commands from experimental to new puppet - T414621 2467100 wikitext text/x-wiki 5paevxe0ld9yo95z2epfvd4qzlftvig 2467101 2467100 2026-10-13T14:23:53Z Stashbot 7414 hashar@deploy1003: Finished deploy [gerrit/gerrit@3cd8cb0]: wm-pcc: switch commands from experimental to new puppet - T414621 (duration: 00m 20s) 2467101 wikitext text/x-wiki qzo2lastva8b4ac00lm18tdmxh6jth1 2467102 2467101 2026-10-13T14:26:55Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2202.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467102 wikitext text/x-wiki gp0634y27usw31jqhv2sxb8ktikm4ul 2467103 2467102 2026-10-13T14:27:14Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2202.codfw.wmnet 2467103 wikitext text/x-wiki iy29dsrg7kjdw2omzlslsok6va3g588 2467104 2467103 2026-10-13T14:28:12Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.deploy.python-code netbox to netbox-dev2003.codfw.wmnet with reason: Add PySocks and update wheels on netbox-next - ayounsi@cumin1004 2467104 wikitext text/x-wiki j466n7g7qsjuwqgx3b0hl34dtnf4w2o 2467105 2467104 2026-10-13T14:29:34Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) netbox to netbox-dev2003.codfw.wmnet with reason: Add PySocks and update wheels on netbox-next - ayounsi@cumin1004 2467105 wikitext text/x-wiki 96wnpt9sse3lcic2754iszddoo98yvk 2467106 2467105 2026-10-13T14:29:38Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2202.codfw.wmnet 2467106 wikitext text/x-wiki d7o5l6ts5ei6tvaq4hbg7o3qkb0i8rs 2467107 2467106 2026-10-13T14:29:52Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2203.codfw.wmnet 2467107 wikitext text/x-wiki nxqjl8y3pku2yl5un3upprabsxfeach 2467108 2467107 2026-10-13T14:30:25Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2203.codfw.wmnet 2467108 wikitext text/x-wiki bz37uj5uk5lgsm6usqcj15jk5zvpv6j 2467109 2467108 2026-10-13T14:30:28Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/test-kitchen: apply 2467109 wikitext text/x-wiki f5ct3l8mpjywllnhfbfexzhrtick8sg 2467110 2467109 2026-10-13T14:30:45Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2203.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467110 wikitext text/x-wiki 9695jk8h5ner15raibszsm6p75t9lkh 2467111 2467110 2026-10-13T14:30:49Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1248.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467111 wikitext text/x-wiki dzvvkmwuwwwqtifmj9l2pn5tckheeg5 2467112 2467111 2026-10-13T14:30:54Z Stashbot 7414 sfaci@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/test-kitchen: apply 2467112 wikitext text/x-wiki 2qiewcqqledcd0v87yqxcc5tz3p5jnd 2467113 2467112 2026-10-13T14:31:08Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1248.eqiad.wmnet 2467113 wikitext text/x-wiki pi66dcdg5872cayjgkvdx30abnuoa9c 2467114 2467113 2026-10-13T14:31:59Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2203.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467114 wikitext text/x-wiki mlxg9hgr2h6mw18nfr0bncljgpozob2 2467115 2467114 2026-10-13T14:32:05Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2203.codfw.wmnet 2467115 wikitext text/x-wiki do7393e1r71whmet9z0apflefyy2r4f 2467116 2467115 2026-10-13T14:32:07Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2203.codfw.wmnet 2467116 wikitext text/x-wiki 63k71icd86dceuxk6o509th4c0e77pt 2467117 2467116 2026-10-13T14:32:20Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2204.codfw.wmnet 2467117 wikitext text/x-wiki 5fmqyqtd9jedrffzs15yikgdg4ltjti 2467118 2467117 2026-10-13T14:32:54Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2204.codfw.wmnet 2467118 wikitext text/x-wiki nntkl3055fviy22wfqf3eox0vy76lqd 2467119 2467118 2026-10-13T14:33:06Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1248.eqiad.wmnet 2467119 wikitext text/x-wiki or6in4s2nlb45vmomnhgvh1do9903kw 2467120 2467119 2026-10-13T14:33:13Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2204.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467120 wikitext text/x-wiki pysdgd46mz09vqfej98eu01dvbvq5xl 2467121 2467120 2026-10-13T14:33:19Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox-canary 2467121 wikitext text/x-wiki rze626wqps5mw8mf1zpnvrey11m2ec1 2467122 2467121 2026-10-13T14:33:21Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1249.eqiad.wmnet 2467122 wikitext text/x-wiki d9r6yxzazx4cpz6e858kdetync7mwp4 2467123 2467122 2026-10-13T14:33:34Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox-canary 2467123 wikitext text/x-wiki n0biifrwb1mgm77luingb37zfs32i8d 2467124 2467123 2026-10-13T14:33:52Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1249.eqiad.wmnet 2467124 wikitext text/x-wiki 1a4fab1vifqff06rq4gvz4f3wqo9gpd 2467125 2467124 2026-10-13T14:34:12Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1249.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467125 wikitext text/x-wiki 2gl10jd8120hbvmf9cz0j3u3bv4fhrk 2467126 2467125 2026-10-13T14:37:59Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.netbox.update-extras rolling restart_daemons on A:netbox 2467126 wikitext text/x-wiki 5dqco27gm4p5kdfldm4z6sthzvhrzhx 2467127 2467126 2026-10-13T14:38:26Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.netbox.update-extras (exit_code=0) rolling restart_daemons on A:netbox 2467127 wikitext text/x-wiki 91tkes10lqh3thqm6gdelzx2913599s 2467128 2467127 2026-10-13T14:42:08Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2204.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467128 wikitext text/x-wiki 01aue0su3ruktnyqrz3t6lqgur121mx 2467129 2467128 2026-10-13T14:42:26Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2204.codfw.wmnet 2467129 wikitext text/x-wiki al7i5jfk33m7pwkrogi2phoelr7fk3e 2467131 2467129 2026-10-13T14:43:34Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2204.codfw.wmnet 2467131 wikitext text/x-wiki irosat1qc07tovljzs8bywg8p5esq8l 2467132 2467131 2026-10-13T14:43:47Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2205.codfw.wmnet 2467132 wikitext text/x-wiki 6qm1p8gycwcsuxslji8yhdw5v7148el 2467133 2467132 2026-10-13T14:44:21Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2205.codfw.wmnet 2467133 wikitext text/x-wiki 7b43kbh3rjdffehz5yvn8cvrcvo071r 2467134 2467133 2026-10-13T14:44:33Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1249.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467134 wikitext text/x-wiki o41xziftrf43zpykiniiovkxy1e8ktk 2467135 2467134 2026-10-13T14:44:42Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2205.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467135 wikitext text/x-wiki 6n4a1h1gmbfj2hrpoihn3u1xr6ojugi 2467136 2467135 2026-10-13T14:44:45Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1249.eqiad.wmnet 2467136 wikitext text/x-wiki l9q32o6lr2srbsev215oqdr7jorftan 2467137 2467136 2026-10-13T14:44:47Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1249.eqiad.wmnet 2467137 wikitext text/x-wiki 57ltr8ev8igaatezst7d2j19ffcyfkq 2467138 2467137 2026-10-13T14:45:00Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1250.eqiad.wmnet 2467138 wikitext text/x-wiki kr2vuohwcp6dn3dlnskdwidoicmm7ol 2467139 2467138 2026-10-13T14:45:22Z Stashbot 7414 cdobbins@cumin1004: conftool action : set/pooled=no; selector: name=cp2043.* 2467139 wikitext text/x-wiki s03tjglwg2wabc46tvsklq38afvzh7p 2467140 2467139 2026-10-13T14:45:33Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1250.eqiad.wmnet 2467140 wikitext text/x-wiki glh1rpycstn2w0dkzv9bs6jlfr9purm 2467141 2467140 2026-10-13T14:45:52Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1250.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467141 wikitext text/x-wiki 5pa7nsude7lm9nizsxjayft1d5q3o0p 2467142 2467141 2026-10-13T14:46:08Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hosts.provision for host cp2043.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467142 wikitext text/x-wiki j13ami84x2uxs2r63127lto09k4bwax 2467144 2467142 2026-10-13T14:48:51Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host cp2043.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467144 wikitext text/x-wiki 1mn4t023kofmi3wcbeg2f1hm3t47bu6 2467145 2467144 2026-10-13T14:49:46Z Stashbot 7414 cdobbins@cumin1004: START - Cookbook sre.hosts.reboot-single for host cp2043.codfw.wmnet 2467145 wikitext text/x-wiki arulf30no0bdyla1190wobg4b67zsh5 2467146 2467145 2026-10-13T14:54:03Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2205.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467146 wikitext text/x-wiki 602x01smdul341xl353mqyls44aubn4 2467147 2467146 2026-10-13T14:54:14Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2205.codfw.wmnet 2467147 wikitext text/x-wiki lavf3dgced8tpjhxs5qjh9tqm41v534 2467148 2467147 2026-10-13T14:54:16Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2205.codfw.wmnet 2467148 wikitext text/x-wiki oya7ibzix1kpxk6mjngrhzl6kz6dkbp 2467149 2467148 2026-10-13T14:54:29Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2206.codfw.wmnet 2467149 wikitext text/x-wiki tasnv44mgc6imysa52dwvph2dwbxs5q 2467150 2467149 2026-10-13T14:55:03Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2206.codfw.wmnet 2467150 wikitext text/x-wiki 20gcr2flvz0jhxjycxmf8hkx7g0slg8 2467151 2467150 2026-10-13T14:55:24Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2206.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467151 wikitext text/x-wiki hfxqwe4vkakjypcfzt1jbg3g7mtgc5l 2467152 2467151 2026-10-13T14:55:42Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1250.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467152 wikitext text/x-wiki 07nro9a1qfihn091z3btirro9xoi35s 2467153 2467152 2026-10-13T14:55:53Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1250.eqiad.wmnet 2467153 wikitext text/x-wiki dicu66364a8xxaneelmkd2l25v4zgap 2467154 2467153 2026-10-13T14:55:55Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1250.eqiad.wmnet 2467154 wikitext text/x-wiki k8yr41rbup1s838rti9nelcn9b45p2b 2467155 2467154 2026-10-13T14:56:08Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1251.eqiad.wmnet 2467155 wikitext text/x-wiki as4pzah8nyab0d2ao9pue2wovr83og3 2467156 2467155 2026-10-13T14:56:41Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1251.eqiad.wmnet 2467156 wikitext text/x-wiki 3pqghrs4uloevu0s9atjhewgsv6w0bd 2467157 2467156 2026-10-13T14:57:00Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1251.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467157 wikitext text/x-wiki pjhowmcfz59zgkrk9ar1vjericcliln 2467158 2467157 2026-10-13T14:57:15Z Stashbot 7414 cdobbins@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cp2043.codfw.wmnet 2467158 wikitext text/x-wiki hhre11vkznmnavf1wfl2zatiqg15xq1 2467161 2467158 2026-10-13T15:04:19Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2206.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467161 wikitext text/x-wiki g6r98d2af2oqz6odf7a7wiuknpchahq 2467162 2467161 2026-10-13T15:04:37Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2206.codfw.wmnet 2467162 wikitext text/x-wiki 2bv6ksr4d5rviby9gqio9msqbqf0q4u 2467163 2467162 2026-10-13T15:04:39Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2206.codfw.wmnet 2467163 wikitext text/x-wiki f5uy4i1as8e45w6n44v469ym2t3b0w8 2467164 2467163 2026-10-13T15:04:53Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2207.codfw.wmnet 2467164 wikitext text/x-wiki d3rbnpctdqd8zxa69v79b6nlcotdlll 2467165 2467164 2026-10-13T15:05:27Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2207.codfw.wmnet 2467165 wikitext text/x-wiki 1w31h47nlsmehrcikjsi5x3na5po1aw 2467166 2467165 2026-10-13T15:05:46Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2207.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467166 wikitext text/x-wiki 66vwb1ro2l1wtqxe2cm1gqeckkiv1le 2467167 2467166 2026-10-13T15:06:51Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1251.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467167 wikitext text/x-wiki dj1fut7zcc8u8641b14dqvunqck774m 2467168 2467167 2026-10-13T15:07:04Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1251.eqiad.wmnet 2467168 wikitext text/x-wiki e4a6o4v6j73bgjzxdibwva53ub9e3rt 2467169 2467168 2026-10-13T15:08:51Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1251.eqiad.wmnet 2467169 wikitext text/x-wiki h5r26hat8nu7ms4nhaztwgm1nl67xtj 2467170 2467169 2026-10-13T15:09:05Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1252.eqiad.wmnet 2467170 wikitext text/x-wiki 94foanfu6qwd3lwoythdy47terdyjxs 2467171 2467170 2026-10-13T15:09:38Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1252.eqiad.wmnet 2467171 wikitext text/x-wiki kat81r08m8rzryj8kffyhucqn93bzxb 2467172 2467171 2026-10-13T15:09:57Z Stashbot 7414 jayme@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kafka-main1010.eqiad.wmnet with reason: firmware upgrades 2467172 wikitext text/x-wiki gj4ca6cw6z9xb5emua0bblaxef8zy5b 2467173 2467172 2026-10-13T15:09:59Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1252.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467173 wikitext text/x-wiki fghvewqscg6758odf2n7c42heea5pd4 2467174 2467173 2026-10-13T15:14:40Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2207.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467174 wikitext text/x-wiki sapslhyf7ldv5r5gityfeinr2zbff7b 2467175 2467174 2026-10-13T15:14:58Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2207.codfw.wmnet 2467175 wikitext text/x-wiki kwdqzc723wlhlpiwlip6vit7vqsfegc 2467176 2467175 2026-10-13T15:17:01Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2207.codfw.wmnet 2467176 wikitext text/x-wiki dfq5gc5jp0y9i6y7d9oq38xfx2znbkc 2467177 2467176 2026-10-13T15:17:14Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2208.codfw.wmnet 2467177 wikitext text/x-wiki nno9kps7d2bcp9boqv8snvcyp75kxhz 2467178 2467177 2026-10-13T15:17:49Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2208.codfw.wmnet 2467178 wikitext text/x-wiki 9fla87u44pkgr8fvat7zu67x07bup1f 2467179 2467178 2026-10-13T15:18:12Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2208.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467179 wikitext text/x-wiki m34ir14fn8qtlq3f1cg4sj07v9dove8 2467180 2467179 2026-10-13T15:19:48Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1252.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467180 wikitext text/x-wiki 86f6pqdz2b4tyjywq0be0xf0xhvq2dk 2467181 2467180 2026-10-13T15:20:08Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1252.eqiad.wmnet 2467181 wikitext text/x-wiki p08z4b9tyqhcmthzq0yl16g8ao6hzk0 2467182 2467181 2026-10-13T15:20:09Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1252.eqiad.wmnet 2467182 wikitext text/x-wiki 2fjdosvst3ee7ml73cviebdc3kve2o7 2467183 2467182 2026-10-13T15:20:23Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1253.eqiad.wmnet 2467183 wikitext text/x-wiki d6sbxbyffzfx1vqmj4ejy8k1lmsd8wy 2467184 2467183 2026-10-13T15:20:56Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1253.eqiad.wmnet 2467184 wikitext text/x-wiki svu6nom2kqvod1fw1wpxd3jshaglir3 2467186 2467184 2026-10-13T15:21:15Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1253.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467186 wikitext text/x-wiki inbmnlhgps4b8jdqixy3imuvwcvy4cm 2467187 2467186 2026-10-13T15:22:06Z Stashbot 7414 herron@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-web: apply 2467187 wikitext text/x-wiki 1axfx8oiohi1f5pedd4xqb90w16w0x8 2467188 2467187 2026-10-13T15:22:33Z Stashbot 7414 herron@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-web: apply 2467188 wikitext text/x-wiki 4p2e2my80wl9nd1qn7heq35tdn5safx 2467189 2467188 2026-10-13T15:22:43Z Stashbot 7414 herron@deploy1003: helmfile [codfw] START helmfile.d/services/mw-web: apply 2467189 wikitext text/x-wiki 41m0cnip8zszo7ncc55ncvrfuu60l0p 2467190 2467189 2026-10-13T15:23:14Z Stashbot 7414 herron@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-web: apply 2467190 wikitext text/x-wiki d9pojwsgwjd4cldgofu2q9j0420ffyh 2467192 2467190 2026-10-13T15:27:05Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2208.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467192 wikitext text/x-wiki 7zv3rvnn5ei743k09fpbts0csm4pwlp 2467193 2467192 2026-10-13T15:27:33Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2208.codfw.wmnet 2467193 wikitext text/x-wiki 75gazdmfp4g26a7hsi7y2866h8qw7oa 2467194 2467193 2026-10-13T15:29:25Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2208.codfw.wmnet 2467194 wikitext text/x-wiki i9jjafuxgez6pf6kmgq1u3ihgfktzdh 2467195 2467194 2026-10-13T15:29:39Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2209.codfw.wmnet 2467195 wikitext text/x-wiki 6uxh3f8n89885gzm39p95643h0s94kh 2467196 2467195 2026-10-13T15:30:15Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2209.codfw.wmnet 2467196 wikitext text/x-wiki ryt5z0cj69o2fdaraosok7zduzolmhv 2467197 2467196 2026-10-13T15:30:35Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2209.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467197 wikitext text/x-wiki oatkxq1t3h6nyohg6tvi0uormbatcoe 2467198 2467197 2026-10-13T15:31:05Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1253.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467198 wikitext text/x-wiki gh87y8ad2o9ois7rlogbor376mf90av 2467199 2467198 2026-10-13T15:31:24Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1253.eqiad.wmnet 2467199 wikitext text/x-wiki 45hqmofnmxvzvku1ddnpctwd3hwp9n4 2467200 2467199 2026-10-13T15:33:11Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1253.eqiad.wmnet 2467200 wikitext text/x-wiki s332bhpagnhdnsfq87mfuooikvdl0gn 2467201 2467200 2026-10-13T15:33:24Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1254.eqiad.wmnet 2467201 wikitext text/x-wiki 14i68h6xjdiif9i7yy5ij9zm3r2en2r 2467202 2467201 2026-10-13T15:33:58Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1254.eqiad.wmnet 2467202 wikitext text/x-wiki 08n6vv882f7u6w7wqzmad8m9802slrg 2467203 2467202 2026-10-13T15:34:17Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1254.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467203 wikitext text/x-wiki 6cyzsrgp2fz4xqzf5y4ho6dpofq5h71 2467204 2467203 2026-10-13T15:36:07Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2192.codfw.wmnet 2467204 wikitext text/x-wiki lw7q5rqjguw5qs3nekxx61sszprej9u 2467206 2467204 2026-10-13T15:36:57Z Stashbot 7414 oblivian@cumin1004: END (ERROR) - Cookbook sre.k8s.pool-depool-node (exit_code=97) pool for host wikikube-worker2192.codfw.wmnet 2467206 wikitext text/x-wiki gygn47hxw1osgn7a23mbm55lrhs4357 2467207 2467206 2026-10-13T15:39:58Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2209.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467207 wikitext text/x-wiki pjmh9gtypzv90hyp9nljz9a99luqcc6 2467208 2467207 2026-10-13T15:40:15Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2209.codfw.wmnet 2467208 wikitext text/x-wiki k8rm5dvkgfo6juu4m3og0qlby9t0jkp 2467209 2467208 2026-10-13T15:40:17Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2209.codfw.wmnet 2467209 wikitext text/x-wiki h6h0c9m9xcde4qyn4hbgcd41lamvmtm 2467210 2467209 2026-10-13T15:40:31Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2210.codfw.wmnet 2467210 wikitext text/x-wiki 2g3bscw3h5ngnsdcznn0g04ryyjxcqo 2467213 2467210 2026-10-13T15:41:05Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2210.codfw.wmnet 2467213 wikitext text/x-wiki tbsj368cyd9yhsr4aq2z78mhab09txd 2467214 2467213 2026-10-13T15:41:24Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2210.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467214 wikitext text/x-wiki 362j15anytxx7orzvoo21481lchnyml 2467216 2467214 2026-10-13T15:44:39Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1254.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467216 wikitext text/x-wiki 0uxdcqjcocjm11vbdyxst6g8ct0pdap 2467217 2467216 2026-10-13T15:45:07Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1254.eqiad.wmnet 2467217 wikitext text/x-wiki 28u4b3210yvai7dd1h6xok0fmlx4woy 2467218 2467217 2026-10-13T15:45:19Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1254.eqiad.wmnet 2467218 wikitext text/x-wiki 8lc27yik4gtov9mt6ztdk84torugyda 2467219 2467218 2026-10-13T15:45:32Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1255.eqiad.wmnet 2467219 wikitext text/x-wiki kwuqtvvbz5fztm4rrlmthi9x5naxgie 2467220 2467219 2026-10-13T15:46:06Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1255.eqiad.wmnet 2467220 wikitext text/x-wiki 4aqwe5oh8w6wy93g1nniqzf8mo2xreu 2467221 2467220 2026-10-13T15:46:26Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1255.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467221 wikitext text/x-wiki mqng6l37hs921bo1dp9c1r2a34abxc8 2467222 2467221 2026-10-13T15:49:16Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2210.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467222 wikitext text/x-wiki 6a2tsk2hn1uwe3c1fsft8ffad59jabp 2467223 2467222 2026-10-13T15:49:34Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2210.codfw.wmnet 2467223 wikitext text/x-wiki kjpu6hypwrcixg585zefigq37416m7n 2467225 2467223 2026-10-13T15:50:17Z Stashbot 7414 dancy@deploy1003: Installing scap version "4.297.0" for 158 host(s) 2467225 wikitext text/x-wiki m7k8w60yi4ybz2bb78nzg43jwiidfra 2467227 2467225 2026-10-13T15:51:15Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2210.codfw.wmnet 2467227 wikitext text/x-wiki lkoqjlsv7d86esl9excezfdjvy4n899 2467228 2467227 2026-10-13T15:51:28Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2211.codfw.wmnet 2467228 wikitext text/x-wiki jbay1nqkmh98vnqqkbtlkrslkgkv87q 2467229 2467228 2026-10-13T15:52:02Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2211.codfw.wmnet 2467229 wikitext text/x-wiki snqq2ynhdt4m3bx6kt2auxiihh16j6e 2467230 2467229 2026-10-13T15:52:23Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2211.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467230 wikitext text/x-wiki 6js3rp49x9ab5j9w4tlmt9bx5itzgf0 2467231 2467230 2026-10-13T15:55:11Z Stashbot 7414 dancy@deploy1003: Installation of scap version "4.297.0" completed for 158 hosts 2467231 wikitext text/x-wiki 17iwumvkdoo2l03ykd935ljuxsy6ogz 2467233 2467231 2026-10-13T15:56:16Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1255.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467233 wikitext text/x-wiki h6425gobru5bxs6zrge8jx9sim1czvq 2467234 2467233 2026-10-13T15:56:34Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1255.eqiad.wmnet 2467234 wikitext text/x-wiki bz38kgv2gf5ia94mgm7gm9f5qlyzeov 2467235 2467234 2026-10-13T15:56:36Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1255.eqiad.wmnet 2467235 wikitext text/x-wiki g3tdeouv45d7npej2o030182topyzmq 2467236 2467235 2026-10-13T15:56:49Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1256.eqiad.wmnet 2467236 wikitext text/x-wiki ica8vdvclz5a014nqefpbillkqiktv7 2467237 2467236 2026-10-13T15:57:24Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1256.eqiad.wmnet 2467237 wikitext text/x-wiki 40scqj2pjib7b8h4mkxlcilmjexwjzf 2467238 2467237 2026-10-13T15:57:44Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1256.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467238 wikitext text/x-wiki 99lnmwlaj8kmm76flpg5ku5prfznpd6 2467240 2467238 2026-10-13T16:01:46Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2211.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467240 wikitext text/x-wiki s1ef246hxvk571x7mocc7r5uw3c2dul 2467241 2467240 2026-10-13T16:01:57Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2211.codfw.wmnet 2467241 wikitext text/x-wiki 7k9um7qbgdw8dlgz1yyzlurcljo80u2 2467242 2467241 2026-10-13T16:01:59Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2211.codfw.wmnet 2467242 wikitext text/x-wiki nv4vphy74fssqzkfqmednn19rx1qdsx 2467243 2467242 2026-10-13T16:02:13Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2212.codfw.wmnet 2467243 wikitext text/x-wiki pzc65vdukb8g3c65005b33rzeoitq45 2467244 2467243 2026-10-13T16:02:46Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2212.codfw.wmnet 2467244 wikitext text/x-wiki 91a4uxoguspcnfoccasczsqcwur7dca 2467245 2467244 2026-10-13T16:03:06Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2212.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467245 wikitext text/x-wiki cimrunz3vlw0hpmkqcyvsrjvx9zk9gh 2467246 2467245 2026-10-13T16:07:35Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1256.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467246 wikitext text/x-wiki 5hyz550sx72307730u6wjy717t0z4nv 2467247 2467246 2026-10-13T16:08:00Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1256.eqiad.wmnet 2467247 wikitext text/x-wiki p1gnh61bixdwnoc6bmt65pkqxvzvtjg 2467248 2467247 2026-10-13T16:09:46Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1256.eqiad.wmnet 2467248 wikitext text/x-wiki j6x9mfvuqx2gx8ygwlcy48rdzfyww81 2467249 2467248 2026-10-13T16:10:00Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1257.eqiad.wmnet 2467249 wikitext text/x-wiki lu6equtilqo7z9opnrrunkks349jawm 2467250 2467249 2026-10-13T16:10:36Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1257.eqiad.wmnet 2467250 wikitext text/x-wiki c94e5lb12wh2ohkj231nfws79ylt724 2467251 2467250 2026-10-13T16:10:42Z Stashbot 7414 brett@dns1004: START - running authdns-update 2467251 wikitext text/x-wiki 7ux7wxjb1nultkpngtgohnq6inw7p3s 2467252 2467251 2026-10-13T16:10:56Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1257.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467252 wikitext text/x-wiki aaw5lxa0mp9nqc8wx87m7nur9l16vj3 2467253 2467252 2026-10-13T16:12:05Z Stashbot 7414 jhathaway@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-cron: apply 2467253 wikitext text/x-wiki 9sr7rqo1px4rof2l7nwz9r7ngw23axh 2467254 2467253 2026-10-13T16:12:31Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2212.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467254 wikitext text/x-wiki b7trpnhjqtok024kl0qjffe7c7jzyzg 2467255 2467254 2026-10-13T16:12:48Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2212.codfw.wmnet 2467255 wikitext text/x-wiki 5a130uh15gosloqvfsgka6c7d6ljt0g 2467256 2467255 2026-10-13T16:12:50Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2212.codfw.wmnet 2467256 wikitext text/x-wiki pzvrtx30xi51nqwjr3yqchuq38i2328 2467257 2467256 2026-10-13T16:12:52Z Stashbot 7414 jhathaway@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-cron: apply 2467257 wikitext text/x-wiki f42mycxn13t4z6698zgw1gm9c93mop4 2467258 2467257 2026-10-13T16:12:57Z Stashbot 7414 brett@dns1004: END - running authdns-update 2467258 wikitext text/x-wiki 0v4caz9pjwqk09eewqx61o2p7q4s6tr 2467259 2467258 2026-10-13T16:13:04Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2213.codfw.wmnet 2467259 wikitext text/x-wiki gtrs9gxoomtd77a0wn861srx3cp69ay 2467260 2467259 2026-10-13T16:13:38Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2213.codfw.wmnet 2467260 wikitext text/x-wiki ovpf4s35ecjd5bzmrns4tpp4ggrrc7r 2467261 2467260 2026-10-13T16:13:58Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2213.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467261 wikitext text/x-wiki tiiqaygu5k0qgh8z1sgsy4oklbxhfvp 2467262 2467261 2026-10-13T16:18:19Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.ceph.rotate-osd-keys rolling rotate_keys on P{cephosd1003.eqiad.wmnet} and (A:cephosd-codfw or A:cephosd-eqiad) 2467262 wikitext text/x-wiki 1petzlukybkl3xgw9b4ziqv5er6i09i 2467263 2467262 2026-10-13T16:18:37Z Stashbot 7414 btullis@cumin1004: END (FAIL) - Cookbook sre.ceph.rotate-osd-keys (exit_code=1) rolling rotate_keys on P{cephosd1003.eqiad.wmnet} and (A:cephosd-codfw or A:cephosd-eqiad) 2467263 wikitext text/x-wiki i25p2iiae3q83rp156tewyvifq32fm5 2467264 2467263 2026-10-13T16:19:52Z Stashbot 7414 jhathaway@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-cron: apply 2467264 wikitext text/x-wiki 7p8266cjpk9ast4d0j0uap5m2x7ihxi 2467265 2467264 2026-10-13T16:20:18Z Stashbot 7414 jhathaway@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-cron: apply 2467265 wikitext text/x-wiki 4kl8qizwpff7ln5nsxny3xr03p62622 2467266 2467265 2026-10-13T16:20:45Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1257.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467266 wikitext text/x-wiki a4fiubgs2pjvfoyhiufjhqrnaukwmnj 2467267 2467266 2026-10-13T16:21:03Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1257.eqiad.wmnet 2467267 wikitext text/x-wiki fidxaf4z1pwlrnquo2xlzpzr8naorj9 2467268 2467267 2026-10-13T16:22:51Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1257.eqiad.wmnet 2467268 wikitext text/x-wiki 1tkso4pisem6f17xzkmyo9m5cid67vn 2467269 2467268 2026-10-13T16:23:04Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1258.eqiad.wmnet 2467269 wikitext text/x-wiki bv4is86bv86f4ge5pivaqx5qjlj4ykn 2467270 2467269 2026-10-13T16:23:21Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2213.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467270 wikitext text/x-wiki qnol0ut3g8peyz70bnxfu0ivpg61ir9 2467271 2467270 2026-10-13T16:23:38Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2213.codfw.wmnet 2467271 wikitext text/x-wiki 901dm6y933l7pdc58bvgjtenh7pihck 2467272 2467271 2026-10-13T16:23:40Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1258.eqiad.wmnet 2467272 wikitext text/x-wiki pjprwhx0ddympfraz0piizi1bjgjslg 2467273 2467272 2026-10-13T16:24:00Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1258.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467273 wikitext text/x-wiki biasm2p6e0lwfvtb0yl4ex40lbfa6f6 2467274 2467273 2026-10-13T16:25:30Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2213.codfw.wmnet 2467274 wikitext text/x-wiki skqnvwl7kdml8pc5ikf6k5zarjly860 2467275 2467274 2026-10-13T16:25:44Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2214.codfw.wmnet 2467275 wikitext text/x-wiki k04gpgvz1iphyut08mrssgzjza9xrao 2467276 2467275 2026-10-13T16:26:17Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2214.codfw.wmnet 2467276 wikitext text/x-wiki 4aks726ebounksv3tzzc8ojypugtnd7 2467277 2467276 2026-10-13T16:26:37Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2214.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467277 wikitext text/x-wiki sbu2r3mwzt1nblhqfs5oerhv6w08o6m 2467279 2467277 2026-10-13T16:33:49Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1258.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467279 wikitext text/x-wiki a19fmwou7n56d3nqvin2k6x14m1upul 2467280 2467279 2026-10-13T16:34:07Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1258.eqiad.wmnet 2467280 wikitext text/x-wiki do8s6s1obbxxu9mea5dqrf3a0coad55 2467281 2467280 2026-10-13T16:36:16Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1258.eqiad.wmnet 2467281 wikitext text/x-wiki gdabjtf88xjn22ybih97yk1fjm1gahj 2467282 2467281 2026-10-13T16:36:29Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1259.eqiad.wmnet 2467282 wikitext text/x-wiki oiufow9ismqr18a5q0g4jmmi8nfj10i 2467283 2467282 2026-10-13T16:36:31Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2214.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467283 wikitext text/x-wiki 0avi1u12kqkdil6rwvba3tuh03d1wr1 2467284 2467283 2026-10-13T16:36:48Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2214.codfw.wmnet 2467284 wikitext text/x-wiki ax68z20iggvl95j0019ejfzajgxuarh 2467285 2467284 2026-10-13T16:36:50Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2214.codfw.wmnet 2467285 wikitext text/x-wiki 40so8wq9hrjoc9llnm2i4pyjpycpozu 2467286 2467285 2026-10-13T16:37:02Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1259.eqiad.wmnet 2467286 wikitext text/x-wiki 9x2fw2ansph43w9eso7r8vk5o8j7vjz 2467287 2467286 2026-10-13T16:37:04Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2215.codfw.wmnet 2467287 wikitext text/x-wiki rsl4dybzun9rsc8tjns37pb8x9jf6r8 2467288 2467287 2026-10-13T16:37:21Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1259.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467288 wikitext text/x-wiki sv8rjjv6m1u7on2zlh345hooyeagwvw 2467289 2467288 2026-10-13T16:37:36Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2215.codfw.wmnet 2467289 wikitext text/x-wiki rrpnghhdnv01hzfjegkk92ewyrupm60 2467290 2467289 2026-10-13T16:37:59Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2215.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467290 wikitext text/x-wiki 6ehr5dznphzvy0wrq3x2zgdnwvvnb3c 2467291 2467290 2026-10-13T16:38:51Z Stashbot 7414 cmooney@cumin1004: START - Cookbook sre.network.tls for network device ssw1-a1-eqiad 2467291 wikitext text/x-wiki ld9ow16bm57h674jnc63ndt7i19ygwb 2467292 2467291 2026-10-13T16:39:35Z Stashbot 7414 cmooney@cumin1004: END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device ssw1-a1-eqiad 2467292 wikitext text/x-wiki azv6xjh660hvgvg1khonpb3jmvsejt7 2467293 2467292 2026-10-13T16:47:23Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2215.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467293 wikitext text/x-wiki obb7f45x3nnj3d0px5lmdc52v1m6565 2467294 2467293 2026-10-13T16:47:29Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2215.codfw.wmnet 2467294 wikitext text/x-wiki 3z7kjkg122yyv129eec6t0yoda4srak 2467295 2467294 2026-10-13T16:47:41Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1259.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467295 wikitext text/x-wiki 9kjdvfm85n29igvz8yv9lwc7du32zzd 2467296 2467295 2026-10-13T16:47:59Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1259.eqiad.wmnet 2467296 wikitext text/x-wiki 72ny8zmmghn4obgyr9rkn4zt540sdhz 2467297 2467296 2026-10-13T16:48:00Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1259.eqiad.wmnet 2467297 wikitext text/x-wiki 05toh7wi2uyev220tr3ydjaqzoq0quu 2467298 2467297 2026-10-13T16:48:02Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.enable_virtualization (exit_code=0) rolling provision on D{wikikube-worker[1240-1259].eqiad.wmnet} and (A:wikikube-master-eqiad or A:wikikube-worker-eqiad) 2467298 wikitext text/x-wiki kjwhyqdpdjwht9hk4oxe5y4r4qm8gwq 2467299 2467298 2026-10-13T16:49:09Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2215.codfw.wmnet 2467299 wikitext text/x-wiki 8skw5g0s1gn55vl05itn9kb9hznzz2e 2467300 2467299 2026-10-13T16:49:11Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.enable_virtualization (exit_code=0) rolling provision on D{wikikube-worker[2196-2215].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) 2467300 wikitext text/x-wiki 8asokwpbzgyc83meg0e0ewbnalwm8nj 2467301 2467300 2026-10-13T16:57:04Z Stashbot 7414 jayme@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on kafka-main1010.eqiad.wmnet with reason: firmware upgrade failed 2467301 wikitext text/x-wiki egxik6ho6tdub79h3uhzcc3wflb569g 2467302 2467301 2026-10-13T17:04:11Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.ceph.rotate-osd-keys rolling rotate_keys on P{cephosd1003.eqiad.wmnet} and (A:cephosd-codfw or A:cephosd-eqiad) 2467302 wikitext text/x-wiki kvds7dl474owgg5zrr8bko0ydaxznfy 2467303 2467302 2026-10-13T17:06:49Z Stashbot 7414 elukey@cumin1004: START - Cookbook sre.hosts.provision for host kafka-main1010.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467303 wikitext text/x-wiki m21qtrzwsro5hsfv16c4jnywtr81uah 2467304 2467303 2026-10-13T17:07:27Z Stashbot 7414 elukey@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host kafka-main1010.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467304 wikitext text/x-wiki 41mqq627zgnt0j99bsno5wexpdnia9z 2467307 2467304 2026-10-13T17:14:09Z Stashbot 7414 isaranto@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'llm' for release 'main' . 2467307 wikitext text/x-wiki 0oxujwj71sugmgn30o7vo3yb84nwzyr 2467309 2467307 2026-10-13T17:25:14Z Stashbot 7414 isaranto@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'llm' for release 'main' . 2467309 wikitext text/x-wiki hmkgllfb3tzeawr3ppdcfqsc31zgfni 2467312 2467309 2026-10-13T17:37:56Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.ceph.rotate-osd-keys (exit_code=0) rolling rotate_keys on P{cephosd1003.eqiad.wmnet} and (A:cephosd-codfw or A:cephosd-eqiad) 2467312 wikitext text/x-wiki gjh2l43jhryl5ostgkqjtv8vgq6iny7 2467313 2467312 2026-10-13T17:41:31Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.ceph.rotate-osd-keys rolling rotate_keys on P{cephosd100[4-5].eqiad.wmnet} and (A:cephosd-codfw or A:cephosd-eqiad) 2467313 wikitext text/x-wiki 863kjveefh2ecouyo8dz2fjynypvp90 2467314 2467313 2026-10-13T17:48:27Z Stashbot 7414 jayme@cumin1004: START - Cookbook sre.hosts.reimage for host kafka-main1010.eqiad.wmnet with OS trixie 2467314 wikitext text/x-wiki edu7g1p0ote2m9mlq667g7vyn9z9220 2467317 2467314 2026-10-13T17:56:27Z Stashbot 7414 jayme@cumin1004: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host kafka-main1010.eqiad.wmnet with OS trixie 2467317 wikitext text/x-wiki nuoboglnknjcv9lshdsnb8omaz37210 2467318 2467317 2026-10-13T17:58:29Z Stashbot 7414 jayme@cumin1004: START - Cookbook sre.hosts.reimage for host kafka-main1010.eqiad.wmnet with OS trixie 2467318 wikitext text/x-wiki 1crhi1l2ymdsxxvvmo2iy0l0v87ra6m 2467323 2467318 2026-10-13T18:31:32Z Stashbot 7414 jayme@cumin1004: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['kafka-main1010.eqiad.wmnet'] 2467323 wikitext text/x-wiki 1x0zox2ajceafc3snwwj9rflli562po 2467324 2467323 2026-10-13T18:31:54Z Stashbot 7414 jayme@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['kafka-main1010.eqiad.wmnet'] 2467324 wikitext text/x-wiki jdzfrtgswbqv8fm914p2xsbfra5t277 2467325 2467324 2026-10-13T18:32:07Z Stashbot 7414 jayme@cumin1004: END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['kafka-main1010.eqiad.wmnet'] 2467325 wikitext text/x-wiki gu9uya97rqgf5oxyykkz39xnbqb737g 2467326 2467325 2026-10-13T18:32:17Z Stashbot 7414 jayme@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['kafka-main1010.eqiad.wmnet'] 2467326 wikitext text/x-wiki e3bv5ina9ahswxsago1p2j94wm5uv16 2467328 2467326 2026-10-13T19:00:36Z Stashbot 7414 jayme@cumin1004: END (FAIL) - Cookbook sre.hardware.upgrade-firmware (exit_code=99) upgrade firmware for hosts ['kafka-main1010.eqiad.wmnet'] 2467328 wikitext text/x-wiki ed3gjg0reo61f82bu778c7oq70gxn4g 2467330 2467328 2026-10-13T19:12:29Z Stashbot 7414 maryum: Deployed security fix for T440944 2467330 wikitext text/x-wiki cwzi7vhj11pjb63l77tkirrd1rqobsu 2467331 2467330 2026-10-13T19:13:16Z Stashbot 7414 arlolra@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2467331 wikitext text/x-wiki 411j7ktwxnj9ndfuc6fa46hw25vwzsl 2467332 2467331 2026-10-13T19:13:43Z Stashbot 7414 arlolra@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2467332 wikitext text/x-wiki og1kgs3cbdq6bx4u9x00iqa258sddm0 2467333 2467332 2026-10-13T19:13:49Z Stashbot 7414 arlolra@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2467333 wikitext text/x-wiki nmmqy9xrnqriwk6hw56piakys7v90n2 2467334 2467333 2026-10-13T19:14:24Z Stashbot 7414 arlolra@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2467334 wikitext text/x-wiki t8y928d8ud0uei6nu4oqdvio61hf6xf 2467335 2467334 2026-10-13T19:22:24Z Stashbot 7414 arlolra@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2467335 wikitext text/x-wiki b8xxvh6adz9wh2lbv0tttr4hufhem6p 2467336 2467335 2026-10-13T19:22:26Z Stashbot 7414 maryum: Deployed second security fix for T440944 2467336 wikitext text/x-wiki rsond6vbrfejl0ct988x8u8k7g5upga 2467337 2467336 2026-10-13T19:22:28Z Stashbot 7414 arlolra@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2467337 wikitext text/x-wiki 2uopqs8ce59sqztzkus7vmgqkko32so 2467338 2467337 2026-10-13T19:22:31Z Stashbot 7414 arlolra@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2467338 wikitext text/x-wiki dpekimjzqb7ip38psz6bbrigg08govo 2467339 2467338 2026-10-13T19:22:35Z Stashbot 7414 arlolra@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2467339 wikitext text/x-wiki 0du7lvgiiyhjq7dsvaoynplrjy1o20h 2467340 2467339 2026-10-13T19:26:36Z Stashbot 7414 arlolra@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2467340 wikitext text/x-wiki 9arf8il42hbncz8r0dnmi88s3k5ar7z 2467341 2467340 2026-10-13T19:26:39Z Stashbot 7414 arlolra@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2467341 wikitext text/x-wiki 0u53clpo22xwqyxffa07gs2dft4qjmc 2467342 2467341 2026-10-13T19:26:45Z Stashbot 7414 arlolra@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2467342 wikitext text/x-wiki 23exeprtsmp8qwhaqjif0axir0bil4n 2467343 2467342 2026-10-13T19:26:47Z Stashbot 7414 arlolra@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2467343 wikitext text/x-wiki esbgt4r1efdmavjlov80m5qarwm0vq5 2467344 2467343 2026-10-13T19:27:14Z Stashbot 7414 dbrant@deploy1003: helmfile [staging] START helmfile.d/services/wikifeeds: apply 2467344 wikitext text/x-wiki hv8sr84ldo2ud2942t7shg3789rurj4 2467345 2467344 2026-10-13T19:27:34Z Stashbot 7414 dbrant@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifeeds: apply 2467345 wikitext text/x-wiki io9dalsmn9cfqarroctl7w7aw6rt8ur 2467346 2467345 2026-10-13T19:29:16Z Stashbot 7414 dbrant@deploy1003: helmfile [eqiad] START helmfile.d/services/wikifeeds: apply 2467346 wikitext text/x-wiki e6h23inbgpsi07xcp2ualzh418qyuyb 2467347 2467346 2026-10-13T19:29:43Z Stashbot 7414 dbrant@deploy1003: helmfile [eqiad] DONE helmfile.d/services/wikifeeds: apply 2467347 wikitext text/x-wiki q0vnp4okcwkkjymghmykj4vetfxji61 2467348 2467347 2026-10-13T19:29:52Z Stashbot 7414 dbrant@deploy1003: helmfile [codfw] START helmfile.d/services/wikifeeds: apply 2467348 wikitext text/x-wiki ph5z7i6j7vxqfofg65spb0q81cpps9y 2467349 2467348 2026-10-13T19:30:51Z Stashbot 7414 dbrant@deploy1003: helmfile [codfw] DONE helmfile.d/services/wikifeeds: apply 2467349 wikitext text/x-wiki oqvkasgu3b1k491ud79d0ctv783a4oa 2467350 2467349 2026-10-13T19:32:03Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.hosts.decommission for hosts krb1003.eqiad.wmnet 2467350 wikitext text/x-wiki adfcwve7uevaj7wz7n587vtjy39162u 2467351 2467350 2026-10-13T19:36:00Z Stashbot 7414 jayme@cumin1004: START - Cookbook sre.hosts.reimage for host kafka-main1010.eqiad.wmnet with OS trixie 2467351 wikitext text/x-wiki in7q0fue2i530wt7peqb3ss70h87fn6 2467352 2467351 2026-10-13T19:37:09Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.dns.netbox 2467352 wikitext text/x-wiki 8m4n2qzvxc26l7wbty3okcwxpqpetlv 2467356 2467352 2026-10-13T19:51:19Z Stashbot 7414 jayme@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on kafka-main1010.eqiad.wmnet with reason: host reimage 2467356 wikitext text/x-wiki 5lp70ms32bftqq0he79906x3lrmw8dp 2467357 2467356 2026-10-13T19:54:19Z Stashbot 7414 jayme@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on kafka-main1010.eqiad.wmnet with reason: host reimage 2467357 wikitext text/x-wiki ni1enzdbkb1ajbleucm442bzusx6ux3 2467360 2467357 2026-10-13T19:57:22Z Stashbot 7414 bking@cumin2003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: krb1003.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - bking@cumin2003" 2467360 wikitext text/x-wiki sp9w6g1xzeohopgzohad2992x4feoo1 2467361 2467360 2026-10-13T19:57:44Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: krb1003.eqiad.wmnet decommissioned, removing all IPs except the asset tag one - bking@cumin2003" 2467361 wikitext text/x-wiki fcv7lbnq60fpwrk8wl889lrakm6nv71 2467362 2467361 2026-10-13T19:57:46Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2467362 wikitext text/x-wiki adqy0u1t3rbpdgkprj4g8tsd871k8rg 2467363 2467362 2026-10-13T19:57:47Z Stashbot 7414 bking@cumin2003: END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) for hosts krb1003.eqiad.wmnet 2467363 wikitext text/x-wiki tqppe03wgf9lxjm7os0uqo2cryhk1x3 2467366 2467363 2026-10-13T20:02:28Z Stashbot 7414 kemayo@deploy1003: Started scap sync-world: Backport for [[gerrit:1354868|VisualEditor: Precompute edit suggestion counts on 5% of enwiki (T433024)]] 2467366 wikitext text/x-wiki sz36p7f0i8ynlb4239ozgipdv68sbnw 2467367 2467366 2026-10-13T20:06:56Z Stashbot 7414 kemayo@deploy1003: kemayo: Backport for [[gerrit:1354868|VisualEditor: Precompute edit suggestion counts on 5% of enwiki (T433024)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2467367 wikitext text/x-wiki qhvsd7iwkusnytd40scid0qx3sef6n9 2467368 2467367 2026-10-13T20:07:26Z Stashbot 7414 kemayo@deploy1003: kemayo: Continuing with deployment 2467368 wikitext text/x-wiki 6vis3vaxl1ls9nxquyju608bwszimu0 2467369 2467368 2026-10-13T20:09:37Z Stashbot 7414 jayme@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host kafka-main1010.eqiad.wmnet with OS trixie 2467369 wikitext text/x-wiki fnzkt1nue4e9uyomc9lpqr6w1dsgpru 2467370 2467369 2026-10-13T20:12:18Z Stashbot 7414 brett@cumin2003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on cp2043.codfw.wmnet with reason: virtualization work 2467370 wikitext text/x-wiki mz8s73gwkkvq5k01zlo2cfb2qq2oivx 2467371 2467370 2026-10-13T20:12:56Z Stashbot 7414 kemayo@deploy1003: Finished scap sync-world: Backport for [[gerrit:1354868|VisualEditor: Precompute edit suggestion counts on 5% of enwiki (T433024)]] (duration: 10m 28s) 2467371 wikitext text/x-wiki kj7p934weqlulc7nrrc72v9wl6gpyka 2467372 2467371 2026-10-13T20:17:12Z Stashbot 7414 krinkle@deploy1003: Started scap sync-world: Backport for [[gerrit:1329640|Profiler: Fold excimer line parsing into one method]], [[gerrit:1354557|Enable "TitleBlacklist" log channel (T85428)]] 2467372 wikitext text/x-wiki 91g0m9nj936ro17udr0bc92j78gdznb 2467373 2467372 2026-10-13T20:21:22Z Stashbot 7414 krinkle@deploy1003: krinkle: Backport for [[gerrit:1329640|Profiler: Fold excimer line parsing into one method]], [[gerrit:1354557|Enable "TitleBlacklist" log channel (T85428)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2467373 wikitext text/x-wiki rwzunnhm8trv2dsdeavefz3itxkpp3v 2467374 2467373 2026-10-13T20:23:27Z Stashbot 7414 krinkle@deploy1003: krinkle: Continuing with deployment 2467374 wikitext text/x-wiki 028ir9rxe8o972qku445i75q3g3jvlo 2467375 2467374 2026-10-13T20:28:50Z Stashbot 7414 krinkle@deploy1003: Finished scap sync-world: Backport for [[gerrit:1329640|Profiler: Fold excimer line parsing into one method]], [[gerrit:1354557|Enable "TitleBlacklist" log channel (T85428)]] (duration: 11m 43s) 2467375 wikitext text/x-wiki ghjz0u8yizfqo7yesdukde342fo0qa7 2467376 2467375 2026-10-13T20:30:55Z Stashbot 7414 aude@deploy1003: Started scap sync-world: Backport for [[gerrit:1354489|Load complete rows of cards on Special:ReadingLists (T440308)]] (1.47.0-wmf.23) 2467376 wikitext text/x-wiki b2yq7v49b4oxsdgel0n8qy40lqqd858 2467377 2467376 2026-10-13T20:33:44Z Stashbot 7414 eevans@deploy1003: helmfile [staging] START helmfile.d/services/linked-artifacts: apply 2467377 wikitext text/x-wiki hk16t1xkln6hb8jxio2h67r5ugb3g36 2467378 2467377 2026-10-13T20:34:18Z Stashbot 7414 eevans@deploy1003: helmfile [staging] DONE helmfile.d/services/linked-artifacts: apply 2467378 wikitext text/x-wiki 34r59ydie336yjr75u7zgn4u8n68jns 2467379 2467378 2026-10-13T20:35:08Z Stashbot 7414 aude@deploy1003: aude: Backport for [[gerrit:1354489|Load complete rows of cards on Special:ReadingLists (T440308)]] (1.47.0-wmf.23) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2467379 wikitext text/x-wiki 97a6g9v9lfvlmljf142c2rrophz4dc1 2467380 2467379 2026-10-13T20:37:18Z Stashbot 7414 aude@deploy1003: aude: Continuing with deployment 2467380 wikitext text/x-wiki 99ix1b5elte97uivjzhmr2ntfzumkzx 2467381 2467380 2026-10-13T20:42:42Z Stashbot 7414 aude@deploy1003: Finished scap sync-world: Backport for [[gerrit:1354489|Load complete rows of cards on Special:ReadingLists (T440308)]] (1.47.0-wmf.23) (duration: 11m 47s) 2467381 wikitext text/x-wiki 4g5pan3c7okcfrpu01l55lbeuh0yn0f 2467382 2467381 2026-10-13T21:04:25Z Stashbot 7414 jdlrobson@deploy1003: Started scap sync-world: Backport for [[gerrit:1354020|Hide "maybe later" button for campaign URL (T438251)]] (1.47.0-wmf.23), [[gerrit:1354005|Re-Display success message if user has already consented (T438248)]] (1.47.0-wmf.23) 2467382 wikitext text/x-wiki fgn4k56vf8msrvm1ofy3ajgcvc73tja 2467384 2467382 2026-10-13T21:08:27Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Backport for [[gerrit:1354020|Hide "maybe later" button for campaign URL (T438251)]] (1.47.0-wmf.23), [[gerrit:1354005|Re-Display success message if user has already consented (T438248)]] (1.47.0-wmf.23) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2467384 wikitext text/x-wiki nd2prcu07q44ex28nwvne32t18k8d9y 2467385 2467384 2026-10-13T21:08:29Z Stashbot 7414 mutante: codesearch codesearch10 - systemctl restart hound-search 2467385 wikitext text/x-wiki gqqrbec285duad2fexv2a511byenorx 2467386 2467385 2026-10-13T21:10:34Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Continuing with deployment 2467386 wikitext text/x-wiki an7ctds9o3ez6csj918o732llnfkbpd 2467388 2467386 2026-10-13T21:16:07Z Stashbot 7414 jdlrobson@deploy1003: Finished scap sync-world: Backport for [[gerrit:1354020|Hide "maybe later" button for campaign URL (T438251)]] (1.47.0-wmf.23), [[gerrit:1354005|Re-Display success message if user has already consented (T438248)]] (1.47.0-wmf.23) (duration: 11m 42s) 2467388 wikitext text/x-wiki kuqjnmnwbmc8c3qc9ewfo411qbf9uf9 2467389 2467388 2026-10-13T21:19:12Z Stashbot 7414 derenrich@deploy1003: Started scap sync-world: Backport for [[gerrit:1354852|Swap the preferred-sources experiment string to preferred-sources-ab]] (1.47.0-wmf.24), [[gerrit:1344343|CentralNotice: Exclude the preferred sources experiment from banners (T436692)]] 2467389 wikitext text/x-wiki 2dxgpbzdrpm93p1fhnhnstefammca4t 2467390 2467389 2026-10-13T21:23:40Z Stashbot 7414 derenrich@deploy1003: derenrich, egardner: Backport for [[gerrit:1354852|Swap the preferred-sources experiment string to preferred-sources-ab]] (1.47.0-wmf.24), [[gerrit:1344343|CentralNotice: Exclude the preferred sources experiment from banners (T436692)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2467390 wikitext text/x-wiki rrulgd0q07xqt4guqk3dbbja661r2ys 2467391 2467390 2026-10-13T21:26:37Z Stashbot 7414 derenrich@deploy1003: derenrich, egardner: Continuing with deployment 2467391 wikitext text/x-wiki kb43jfjz8mcajitxfgo046r01khcc3f 2467392 2467391 2026-10-13T21:32:00Z Stashbot 7414 derenrich@deploy1003: Finished scap sync-world: Backport for [[gerrit:1354852|Swap the preferred-sources experiment string to preferred-sources-ab]] (1.47.0-wmf.24), [[gerrit:1344343|CentralNotice: Exclude the preferred sources experiment from banners (T436692)]] (duration: 12m 47s) 2467392 wikitext text/x-wiki 43tt6b25d0y7bpzrcfh7tkvihg6x7pg 2467395 2467392 2026-10-13T21:39:30Z Stashbot 7414 jdlrobson@deploy1003: Started scap sync-world: Backport for [[gerrit:1347658|EditWatchlist: use same view on mobile and desktop (T363032)]] 2467395 wikitext text/x-wiki 3541ljbbosfbd0tl9l1cir1m7xeayzl 2467396 2467395 2026-10-13T21:43:39Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Backport for [[gerrit:1347658|EditWatchlist: use same view on mobile and desktop (T363032)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2467396 wikitext text/x-wiki 5euil97txihueo2wy4ne7h45i29b2gh 2467397 2467396 2026-10-13T21:44:45Z Stashbot 7414 jdlrobson@deploy1003: jdlrobson: Continuing with deployment 2467397 wikitext text/x-wiki 9fttkl7l47zqgb8cpr4oy2bj9sey2du 2467398 2467397 2026-10-13T21:50:07Z Stashbot 7414 jdlrobson@deploy1003: Finished scap sync-world: Backport for [[gerrit:1347658|EditWatchlist: use same view on mobile and desktop (T363032)]] (duration: 10m 37s) 2467398 wikitext text/x-wiki opmexo00zxahnjbwgu7y30x6nl8wwto 2467407 2467398 2026-10-13T22:38:24Z Stashbot 7414 RoanKattouw: Deployed security patches for T440942, T440943, T441027 (at 22:22 UTC, forgot to log earlier) 2467407 wikitext text/x-wiki 9acxzicvz9hv8cf8hqvy9ei7p09g981 2467409 2467407 2026-10-14T00:43:23Z Stashbot 7414 brett@dns1004: START - running authdns-update 2467409 wikitext text/x-wiki psdnr102ah3tk1or5ur6x0i2bsi3hjd 2467410 2467409 2026-10-14T00:45:40Z Stashbot 7414 brett@dns1004: END - running authdns-update 2467410 wikitext text/x-wiki 3mcr6ifob5aryhy290se1kga95x54jj 2467411 2467410 2026-10-14T00:49:00Z Stashbot 7414 dzahn@dns1004: START - running authdns-update 2467411 wikitext text/x-wiki m2awfsbaykvp7hy2p94k565316bus9o 2467412 2467411 2026-10-14T00:51:19Z Stashbot 7414 dzahn@dns1004: END - running authdns-update 2467412 wikitext text/x-wiki c4ba2b8ktd72n1c79wxgrjoq8eze2uz 2467414 2467412 2026-10-14T02:00:24Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2467414 wikitext text/x-wiki tuo3cbnoqrcqnupcyd734kwbztg87mz 2467415 2467414 2026-10-14T02:07:54Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 07m 30s) 2467415 wikitext text/x-wiki 9eyajjzwul02ylgvhoq7qp72o40pk6i 2467416 2467415 2026-10-14T03:53:53Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.enable_virtualization rolling provision on D{wikikube-worker[2088,2203,2242-2243,2248-2260].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) 2467416 wikitext text/x-wiki fqogcc9ier5ei7jdkvon17c1rvgbk6h 2467417 2467416 2026-10-14T03:53:57Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2088.codfw.wmnet 2467417 wikitext text/x-wiki 33rnz7uwnb36n8wspdkrvfb1afg08ew 2467418 2467417 2026-10-14T03:54:14Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.enable_virtualization rolling provision on D{wikikube-worker[1260-1289].eqiad.wmnet} and (A:wikikube-master-eqiad or A:wikikube-worker-eqiad) 2467418 wikitext text/x-wiki 36uw85f9qc1zklaehdcsraiuud1obby 2467419 2467418 2026-10-14T03:54:18Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1260.eqiad.wmnet 2467419 wikitext text/x-wiki 93ye8wxq85f729epbtrw7dg41cwgnd0 2467420 2467419 2026-10-14T03:54:32Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2088.codfw.wmnet 2467420 wikitext text/x-wiki 5fsbki1onzhnoh5o16k45an4211slom 2467421 2467420 2026-10-14T03:54:49Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1260.eqiad.wmnet 2467421 wikitext text/x-wiki 3sdovwrob5trroaqw24h7embi213lpi 2467422 2467421 2026-10-14T03:55:10Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1260.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467422 wikitext text/x-wiki hziikjk3d6phe8hnn8r7gkxbtndxc5b 2467423 2467422 2026-10-14T04:04:00Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1260.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467423 wikitext text/x-wiki qtzjv4srdgigv3k8zvz66mplgf9t9xv 2467424 2467423 2026-10-14T04:04:12Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1260.eqiad.wmnet 2467424 wikitext text/x-wiki 5gr6w7s8r72aqnhakbbhd0kbcamhsuz 2467425 2467424 2026-10-14T04:04:13Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1260.eqiad.wmnet 2467425 wikitext text/x-wiki tsy07ouw01kdhqq8jujd31fv1yuyvva 2467426 2467425 2026-10-14T04:04:26Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1261.eqiad.wmnet 2467426 wikitext text/x-wiki 16jvi2zvj9cjl5fh471ke003u7ynu6x 2467427 2467426 2026-10-14T04:04:58Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1261.eqiad.wmnet 2467427 wikitext text/x-wiki rw0wybp9f6ig26kzlfbhd0cqirxc3x2 2467428 2467427 2026-10-14T04:05:18Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1261.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467428 wikitext text/x-wiki aug4yxdsd72u1ezevk1g9jqjshrz1kg 2467429 2467428 2026-10-14T04:13:40Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1261.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467429 wikitext text/x-wiki 5spm7lyv413jiptmghdf9ndvellbwvi 2467430 2467429 2026-10-14T04:13:52Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1261.eqiad.wmnet 2467430 wikitext text/x-wiki 1pwphuxxbjqp1drm4lb64aym6n42q9p 2467431 2467430 2026-10-14T04:14:14Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1261.eqiad.wmnet 2467431 wikitext text/x-wiki iqbnl9p5bzymkgkduizz2ayx0qag0dk 2467432 2467431 2026-10-14T04:14:27Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1262.eqiad.wmnet 2467432 wikitext text/x-wiki 3g5eopk5cz2q0zbkoljcphvx9lgm11m 2467433 2467432 2026-10-14T04:15:01Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1262.eqiad.wmnet 2467433 wikitext text/x-wiki d6oxp45yks2y6j2bdzfjwtjkls6s1qb 2467434 2467433 2026-10-14T04:15:19Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1262.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467434 wikitext text/x-wiki h0f1g4es185e6jeuj818nr0mg68lyqx 2467435 2467434 2026-10-14T04:24:12Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1262.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467435 wikitext text/x-wiki bywot69w72brvm2xx85w4t3uhqcz0ww 2467436 2467435 2026-10-14T04:24:41Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1262.eqiad.wmnet 2467436 wikitext text/x-wiki cwfxb376juzufffwfu7raa4fsq3fmct 2467437 2467436 2026-10-14T04:24:43Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1262.eqiad.wmnet 2467437 wikitext text/x-wiki nr77e4w1fm2tn7ez6b20bp84vcf8anc 2467438 2467437 2026-10-14T04:24:56Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1263.eqiad.wmnet 2467438 wikitext text/x-wiki jskzvkguhlvunkug4sywcx5o2rp30ce 2467439 2467438 2026-10-14T04:25:31Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1263.eqiad.wmnet 2467439 wikitext text/x-wiki s8furrv91kn6qejv54btkb6orq67e5w 2467440 2467439 2026-10-14T04:25:51Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1263.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467440 wikitext text/x-wiki ptwogq0w2mw2tq2ih3viaufqjfx3lsx 2467441 2467440 2026-10-14T04:34:42Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1263.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467441 wikitext text/x-wiki pdggeh1f5bynnqbemkrfoxo1iwiucwj 2467442 2467441 2026-10-14T04:35:10Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1263.eqiad.wmnet 2467442 wikitext text/x-wiki 6w2hrnwkcli8jhdmlrxnrylrsu77yvu 2467443 2467442 2026-10-14T04:35:12Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1263.eqiad.wmnet 2467443 wikitext text/x-wiki bcfui1mtet5i99m43i461n1fn7jq0ij 2467444 2467443 2026-10-14T04:35:24Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1264.eqiad.wmnet 2467444 wikitext text/x-wiki 4jt78e9gx6c22txawxgiqw582n56tfo 2467445 2467444 2026-10-14T04:36:00Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1264.eqiad.wmnet 2467445 wikitext text/x-wiki 93zckez2y1xaggyre50j0c962mcbwxo 2467446 2467445 2026-10-14T04:36:21Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1264.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467446 wikitext text/x-wiki rq8xwo1oxdkzwymau41vei8oru5h54j 2467447 2467446 2026-10-14T04:44:42Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1264.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467447 wikitext text/x-wiki a69h7hlqvz9i0cg3sos2v17cackpcvp 2467448 2467447 2026-10-14T04:45:10Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1264.eqiad.wmnet 2467448 wikitext text/x-wiki q7se9kcioac62sf3mcgtohs6vyjg2am 2467449 2467448 2026-10-14T04:45:12Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1264.eqiad.wmnet 2467449 wikitext text/x-wiki gl0fuj1fabnhbgox8ur3r3kz7kds224 2467450 2467449 2026-10-14T04:45:25Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1265.eqiad.wmnet 2467450 wikitext text/x-wiki 9luasgpv0sgd7uhfovwfg3cuh3lmtat 2467451 2467450 2026-10-14T04:45:56Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1265.eqiad.wmnet 2467451 wikitext text/x-wiki 9jhrgiiqymad7lv8hp6814ep3dijsfh 2467452 2467451 2026-10-14T04:46:15Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1265.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467452 wikitext text/x-wiki htx79w44aw80sfz99tis01nyk5l26jk 2467453 2467452 2026-10-14T04:54:23Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2088.codfw.wmnet 2467453 wikitext text/x-wiki 7i9x4oobhy2eurgwote235nvz2sx25p 2467454 2467453 2026-10-14T04:54:25Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2088.codfw.wmnet 2467454 wikitext text/x-wiki tucprhuzl9ivu8925uptev3exv5acyi 2467455 2467454 2026-10-14T04:54:36Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1265.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467455 wikitext text/x-wiki qzpj313xfu8cm7k3dufmsqfrxdqr5pi 2467456 2467455 2026-10-14T04:54:38Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2203.codfw.wmnet 2467456 wikitext text/x-wiki 0oof4x0lpl0vc1lg1tsr8stjiujw5ft 2467457 2467456 2026-10-14T04:54:53Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1265.eqiad.wmnet 2467457 wikitext text/x-wiki 4o4tslsu8byxl5hcz6f9uekvavne8u4 2467458 2467457 2026-10-14T04:54:55Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1265.eqiad.wmnet 2467458 wikitext text/x-wiki e6c3j4njp44mk6emm6vtt3078tql1ln 2467459 2467458 2026-10-14T04:55:08Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1266.eqiad.wmnet 2467459 wikitext text/x-wiki 4jsj0batql17mjom3cv1omme4ivmg2t 2467460 2467459 2026-10-14T04:55:13Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2203.codfw.wmnet 2467460 wikitext text/x-wiki neyaqdgnqqioqico6l0wa01k4xaf7cb 2467461 2467460 2026-10-14T04:55:33Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2203.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467461 wikitext text/x-wiki 74014lzkivtgpx26nxeg8272gzgv1ti 2467462 2467461 2026-10-14T04:55:41Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1266.eqiad.wmnet 2467462 wikitext text/x-wiki mejm9epqotujc1ypcl33fteack76hi3 2467463 2467462 2026-10-14T04:56:00Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1266.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467463 wikitext text/x-wiki fgiqueog57i4h54vvswffn68zefmhrq 2467464 2467463 2026-10-14T04:56:47Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2203.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467464 wikitext text/x-wiki c7s6mpowbmnine135n9olppjn2plvtb 2467465 2467464 2026-10-14T04:56:54Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2203.codfw.wmnet 2467465 wikitext text/x-wiki 1v567vmlnwo8q0ia5p1xgn2w3j11eui 2467466 2467465 2026-10-14T04:56:55Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2203.codfw.wmnet 2467466 wikitext text/x-wiki 3s1pafh4u555gqjb8wtnurni3x66wch 2467467 2467466 2026-10-14T04:57:09Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2242.codfw.wmnet 2467467 wikitext text/x-wiki 8apo9wslzpc685yty41p88q4przdh6o 2467468 2467467 2026-10-14T04:57:42Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2242.codfw.wmnet 2467468 wikitext text/x-wiki 8ubrltndy4eoh4c1wzanp0ganzc4ja6 2467469 2467468 2026-10-14T04:58:02Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2242.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467469 wikitext text/x-wiki m5z2tmh8q2jkoybthynpmd5jih9mgty 2467470 2467469 2026-10-14T05:04:21Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1266.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467470 wikitext text/x-wiki d1y7bzciep96k3mu2vkfoa4jjt62xlm 2467471 2467470 2026-10-14T05:04:33Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1266.eqiad.wmnet 2467471 wikitext text/x-wiki 5icqqlul0f53ehmzxpghphk0vdd2xjj 2467472 2467471 2026-10-14T05:04:55Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1266.eqiad.wmnet 2467472 wikitext text/x-wiki 3569f6a2bdkwcatdbue3ya29vrhqhbi 2467473 2467472 2026-10-14T05:05:08Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1267.eqiad.wmnet 2467473 wikitext text/x-wiki guvnsnnqor53qio18pmdmq659v6a5xg 2467474 2467473 2026-10-14T05:05:41Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1267.eqiad.wmnet 2467474 wikitext text/x-wiki 4klgrbqcbkf7xda08gifuyw7rlxmcqt 2467475 2467474 2026-10-14T05:05:51Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2242.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467475 wikitext text/x-wiki p4az1pcq4r4oypjvkzq33exvdqmq5l9 2467476 2467475 2026-10-14T05:06:00Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1267.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467476 wikitext text/x-wiki pud37c3pvw4jztlki9j8m4waxyxcio6 2467477 2467476 2026-10-14T05:06:02Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2242.codfw.wmnet 2467477 wikitext text/x-wiki 5v0586g5wwfn22im2yxxl3yyyoihbh6 2467478 2467477 2026-10-14T05:06:04Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2242.codfw.wmnet 2467478 wikitext text/x-wiki 4ygarbbk29qruxsylwo4iw97rt2gpic 2467479 2467478 2026-10-14T05:06:18Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2243.codfw.wmnet 2467479 wikitext text/x-wiki i2yik8kp8fo34ttwbhgp0pk7c7peko1 2467480 2467479 2026-10-14T05:06:54Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2243.codfw.wmnet 2467480 wikitext text/x-wiki 1b2cul5li4d9xrmdivqinzsfvo8njs7 2467481 2467480 2026-10-14T05:07:03Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2243.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467481 wikitext text/x-wiki 42dat6wozx05lm99veohw607tqejsfg 2467482 2467481 2026-10-14T05:14:52Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1267.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467482 wikitext text/x-wiki 8bm1g89e22557a60yjoo2vafgp256mu 2467483 2467482 2026-10-14T05:14:53Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2243.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467483 wikitext text/x-wiki pqzxkd4fsm2n1iuovm3hao61oh75sid 2467484 2467483 2026-10-14T05:14:58Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2243.codfw.wmnet 2467484 wikitext text/x-wiki tjqz29l12aperly8yf5dbxsytda11pa 2467485 2467484 2026-10-14T05:15:20Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1267.eqiad.wmnet 2467485 wikitext text/x-wiki 6zvxvx7i6exdlhf1pxfek9m54074by8 2467486 2467485 2026-10-14T05:15:21Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1267.eqiad.wmnet 2467486 wikitext text/x-wiki cg6pvl3h74whubtc69dzvlekv3h39fr 2467487 2467486 2026-10-14T05:15:35Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1268.eqiad.wmnet 2467487 wikitext text/x-wiki a1oqfp02gh60odtf4iwhjm547claw9f 2467488 2467487 2026-10-14T05:16:28Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2243.codfw.wmnet 2467488 wikitext text/x-wiki r6e1y4omc1mmgya4w83q0frmjcncvu5 2467489 2467488 2026-10-14T05:16:41Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2248.codfw.wmnet 2467489 wikitext text/x-wiki fo8pdd2o4swze6yigodw1fh75s175vh 2467490 2467489 2026-10-14T05:17:17Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2248.codfw.wmnet 2467490 wikitext text/x-wiki h7hqrbolutp88x18r6of5yitnvw0rnz 2467491 2467490 2026-10-14T05:20:38Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1268.eqiad.wmnet 2467491 wikitext text/x-wiki rizic9ekwwh5tqsjthc9doflaxxeilq 2467492 2467491 2026-10-14T05:20:57Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1268.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467492 wikitext text/x-wiki ex30zwma26hj5e251x7phyio7jkmhol 2467493 2467492 2026-10-14T05:23:58Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2248.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2467493 wikitext text/x-wiki 8j25bmlue05lmgu3922tah7r0yerd9l 2467494 2467493 2026-10-14T05:29:16Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2248.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2467494 wikitext text/x-wiki iuejxuqfwb9lyyuvlguyx3venhm6rgz 2467495 2467494 2026-10-14T05:29:18Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1268.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467495 wikitext text/x-wiki fhuyjpsyy07nln44u96rasdccmez1x2 2467496 2467495 2026-10-14T05:29:22Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2248.codfw.wmnet 2467496 wikitext text/x-wiki gud6mmrahwf9z8bvkwz15luagu4f4my 2467497 2467496 2026-10-14T05:29:24Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2248.codfw.wmnet 2467497 wikitext text/x-wiki ka9r3ed10daljdjaxvj08jfaouj6klb 2467498 2467497 2026-10-14T05:29:36Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1268.eqiad.wmnet 2467498 wikitext text/x-wiki auh07geq8fr9usgktdiy5799ug5ox64 2467499 2467498 2026-10-14T05:29:37Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1268.eqiad.wmnet 2467499 wikitext text/x-wiki bkjhqwa0svvhlsd4q4m8knndv5rco4x 2467500 2467499 2026-10-14T05:29:38Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2249.codfw.wmnet 2467500 wikitext text/x-wiki 0wgm6yekma0gufca08x9c7qdberhimr 2467501 2467500 2026-10-14T05:29:50Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1269.eqiad.wmnet 2467501 wikitext text/x-wiki 8dj6x5p080uiam9q7mxsgva1msfv8e5 2467502 2467501 2026-10-14T05:30:12Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2249.codfw.wmnet 2467502 wikitext text/x-wiki daozriujwe0s74bmpfd02akmj33uvar 2467503 2467502 2026-10-14T05:30:23Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1269.eqiad.wmnet 2467503 wikitext text/x-wiki t3t8whidqd57n48qln58thcfqgbecgg 2467504 2467503 2026-10-14T05:30:43Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1269.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467504 wikitext text/x-wiki nztq9lrreu8ajotlu0ytlvj9xt0x5zv 2467505 2467504 2026-10-14T05:36:39Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.network.peering with action 'email' for AS: 9534 2467505 wikitext text/x-wiki td31lsjrifv4ucwcilluxjic591ylhv 2467506 2467505 2026-10-14T05:37:28Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 9534 2467506 wikitext text/x-wiki 424n7o9cexpip1ha1hp5u47tmjluqwq 2467507 2467506 2026-10-14T05:38:04Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.network.peering with action 'email' for AS: 268937 2467507 wikitext text/x-wiki 9dtj30bt8w3h6h0eqw4ympwpiaer104 2467508 2467507 2026-10-14T05:38:23Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 268937 2467508 wikitext text/x-wiki amcsputa20wakyv7h9wpibdlqyto706 2467509 2467508 2026-10-14T05:38:32Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.network.peering with action 'email' for AS: 8752 2467509 wikitext text/x-wiki 7jv8xubml1x6c8f5n0zgumlohdoillc 2467510 2467509 2026-10-14T05:38:48Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 8752 2467510 wikitext text/x-wiki aok6rp3leusrjf250texbqjky7u6dn4 2467511 2467510 2026-10-14T05:38:51Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.network.peering with action 'email' for AS: 58495 2467511 wikitext text/x-wiki ci7eksov196pt4dc1secr4jvqn2gf8r 2467512 2467511 2026-10-14T05:39:08Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 58495 2467512 wikitext text/x-wiki 5iyd5h5waci2q06l9kx3xx0ylz2unvr 2467513 2467512 2026-10-14T05:39:27Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.network.peering with action 'email' for AS: 30383 2467513 wikitext text/x-wiki lmu0a2pc1tr0m3kmk5fh081kpwc1oqa 2467514 2467513 2026-10-14T05:39:33Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1269.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467514 wikitext text/x-wiki h21jeeuolaghnrg933qlgcl1kxs51ko 2467515 2467514 2026-10-14T05:39:39Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1269.eqiad.wmnet 2467515 wikitext text/x-wiki gznnqfplskir6h83033hdu2km0uzeze 2467516 2467515 2026-10-14T05:39:41Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1269.eqiad.wmnet 2467516 wikitext text/x-wiki 2hodr57p9gpg1nrahttrbd3btve3hev 2467517 2467516 2026-10-14T05:39:55Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 30383 2467517 wikitext text/x-wiki a4ihwrnsec10jvhdirf0d3j8ul1wkth 2467518 2467517 2026-10-14T05:39:56Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1270.eqiad.wmnet 2467518 wikitext text/x-wiki 4kae1j13rvdr6dx4twwzog8docacywl 2467519 2467518 2026-10-14T05:39:58Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.network.peering with action 'email' for AS: 680 2467519 wikitext text/x-wiki 58vnh0c4jhzn24gz5823pbn7fog86zq 2467520 2467519 2026-10-14T05:40:28Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1270.eqiad.wmnet 2467520 wikitext text/x-wiki dj3veskedzkgm8bilhahj7spn8djfgq 2467521 2467520 2026-10-14T05:40:47Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1270.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467521 wikitext text/x-wiki s4zenqvhydmwvrgnmvp43jqdq52321k 2467522 2467521 2026-10-14T05:40:57Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 680 2467522 wikitext text/x-wiki e3o2602d83o1uk41xtv51jv4z50wpqs 2467523 2467522 2026-10-14T05:41:04Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.network.peering with action 'email' for AS: 44034 2467523 wikitext text/x-wiki 93q5rinwz40b08ag4dfkbhlvgvyd8hr 2467524 2467523 2026-10-14T05:41:27Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 44034 2467524 wikitext text/x-wiki 8183iotrpzid19b7cj1gbka4jz3l417 2467525 2467524 2026-10-14T05:41:47Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.network.peering with action 'email' for AS: 262731 2467525 wikitext text/x-wiki 7e7xwoifs6b16szcm1084scpvpidehe 2467526 2467525 2026-10-14T05:42:50Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 262731 2467526 wikitext text/x-wiki nkyw8ppeikqc09xm9dbymixy7q82hy0 2467527 2467526 2026-10-14T05:42:54Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.network.peering with action 'email' for AS: 28126 2467527 wikitext text/x-wiki 0mcywjwtasqizakz0qwcaiky6ew423o 2467528 2467527 2026-10-14T05:43:44Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 28126 2467528 wikitext text/x-wiki gozvtwzyl4h5phq0r0qf2sma1c1fq91 2467529 2467528 2026-10-14T05:44:54Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.network.peering with action 'email' for AS: 30781 2467529 wikitext text/x-wiki 0xyi0l1qxwp5n0i436dc6vl01p6dbfv 2467530 2467529 2026-10-14T05:45:19Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 30781 2467530 wikitext text/x-wiki 32uv8d02i32xlv2l3rb36q415hoollh 2467531 2467530 2026-10-14T05:45:34Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.network.peering with action 'email' for AS: 53209 2467531 wikitext text/x-wiki 5ii7ct3laxs47mbda4zdgifvqfm57yv 2467532 2467531 2026-10-14T05:45:55Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 53209 2467532 wikitext text/x-wiki no5uwvjuf78hcwbn1sa9v6vhpi0arvv 2467533 2467532 2026-10-14T05:45:58Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.network.peering with action 'email' for AS: 150506 2467533 wikitext text/x-wiki 2z6y6k6d10d3aw8ivmf0g4dzomk8x6i 2467534 2467533 2026-10-14T05:46:28Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.network.peering (exit_code=0) with action 'email' for AS: 150506 2467534 wikitext text/x-wiki 3sc0lp4m5shmj9ubvlxsav8icysb30k 2467535 2467534 2026-10-14T05:49:37Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1270.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467535 wikitext text/x-wiki q8qyif0w7722bt85jcnuk4dhl47ldmj 2467536 2467535 2026-10-14T05:49:56Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1270.eqiad.wmnet 2467536 wikitext text/x-wiki h5sr8lw7ma76a7qk9wow98kumwl4ih9 2467537 2467536 2026-10-14T05:49:58Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1270.eqiad.wmnet 2467537 wikitext text/x-wiki t7o98beqwtra0j8qicm3yd7cfvnuu3q 2467538 2467537 2026-10-14T05:50:11Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1271.eqiad.wmnet 2467538 wikitext text/x-wiki pwooeigev43vydmuykwfcerbg0b1pmd 2467539 2467538 2026-10-14T05:50:43Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1271.eqiad.wmnet 2467539 wikitext text/x-wiki eon6o5ym6fv6waedxeuohynlauzfz0k 2467540 2467539 2026-10-14T05:51:02Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1271.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467540 wikitext text/x-wiki rbk2kjuqcv29ul5zdzdsbzx0999468a 2467541 2467540 2026-10-14T05:55:35Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.deploy.python-code netbox to netbox2003.codfw.wmnet,netbox1003.eqiad.wmnet with reason: Add PySocks and update wheels on netbox - ayounsi@cumin1004 2467541 wikitext text/x-wiki 06jqlidgt7ufv5z22kp4s7qo0yewvmd 2467542 2467541 2026-10-14T05:58:50Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) netbox to netbox2003.codfw.wmnet,netbox1003.eqiad.wmnet with reason: Add PySocks and update wheels on netbox - ayounsi@cumin1004 2467542 wikitext text/x-wiki 0w81h0tpjaro8w4zawavzs09bizzpzu 2467543 2467542 2026-10-14T05:59:52Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1271.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467543 wikitext text/x-wiki 60tkyztgnkrda42yqau6b7xsz5h380q 2467544 2467543 2026-10-14T06:00:21Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1271.eqiad.wmnet 2467544 wikitext text/x-wiki i83kptlvjx35jqe671laxmcezo0gval 2467545 2467544 2026-10-14T06:00:22Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1271.eqiad.wmnet 2467545 wikitext text/x-wiki hry9zav27zg6ohv3nq2bbaj0eclztg8 2467546 2467545 2026-10-14T06:00:35Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1272.eqiad.wmnet 2467546 wikitext text/x-wiki e20bap8u5ytcsyioge1c46vmc8nb6wk 2467547 2467546 2026-10-14T06:01:07Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1272.eqiad.wmnet 2467547 wikitext text/x-wiki ezmc0xd5tfq9q72xyn7fn23y66quipn 2467548 2467547 2026-10-14T06:01:26Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1272.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467548 wikitext text/x-wiki l8ke6vrp5m2kid7jddqqcd274u117b5 2467549 2467548 2026-10-14T06:10:17Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1272.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467549 wikitext text/x-wiki g295lel3h93zj6rxlm43d3qfaz0e0g3 2467550 2467549 2026-10-14T06:10:35Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1272.eqiad.wmnet 2467550 wikitext text/x-wiki odm8oacxs0m6p5fehwy1w5n3ay3zsd1 2467551 2467550 2026-10-14T06:10:37Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1272.eqiad.wmnet 2467551 wikitext text/x-wiki tt2poy2sruxz8x5dbqw9m6ledly43lo 2467552 2467551 2026-10-14T06:10:49Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1273.eqiad.wmnet 2467552 wikitext text/x-wiki egk0z6pq4fsuajp1d4zdgija0sfeba0 2467553 2467552 2026-10-14T06:12:01Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1273.eqiad.wmnet 2467553 wikitext text/x-wiki hlyxqk4vvzh3j55blvveum3o1i3knid 2467554 2467553 2026-10-14T06:12:20Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1273.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467554 wikitext text/x-wiki jxeyiimm8khsu0csrblufm4mx5arxiz 2467555 2467554 2026-10-14T06:22:11Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1273.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467555 wikitext text/x-wiki qp8pxnbosuxk1gyr2l6dn8g1e6gi9fh 2467556 2467555 2026-10-14T06:22:40Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1273.eqiad.wmnet 2467556 wikitext text/x-wiki qzgceaff9gdkvgxxqrn5jh9qlnvhnl6 2467557 2467556 2026-10-14T06:22:41Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1273.eqiad.wmnet 2467557 wikitext text/x-wiki 06rbqcbwenqv7phl09ddy5usjsz5glf 2467558 2467557 2026-10-14T06:22:55Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1274.eqiad.wmnet 2467558 wikitext text/x-wiki 03otfp4dondgggcj4psc4gpvqilpngq 2467559 2467558 2026-10-14T06:23:30Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1274.eqiad.wmnet 2467559 wikitext text/x-wiki 8bz2yek0gfle6b6s4nfrb9deytwz98e 2467560 2467559 2026-10-14T06:23:50Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1274.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467560 wikitext text/x-wiki n207rkai169szbkr4fw8pfzyhivo2uh 2467561 2467560 2026-10-14T06:32:39Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1274.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467561 wikitext text/x-wiki 9uuq2ug9mx8yj4wencrntzt21cieerx 2467562 2467561 2026-10-14T06:32:51Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1274.eqiad.wmnet 2467562 wikitext text/x-wiki q7k1x497hsxewhwz0o56ozssvxjq98k 2467563 2467562 2026-10-14T06:32:52Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1274.eqiad.wmnet 2467563 wikitext text/x-wiki 89owjbf0ak8v95s0l25zc2vunbu6qhd 2467564 2467563 2026-10-14T06:33:06Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1275.eqiad.wmnet 2467564 wikitext text/x-wiki tgbjz0xl5gwf8gncnf3wfh6gwqx8ypk 2467565 2467564 2026-10-14T06:33:35Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.deploy.python-code netbox to netbox-dev2003.codfw.wmnet with reason: Force redis 6.2.0 to fix regression - ayounsi@cumin1004 2467565 wikitext text/x-wiki g7hzkd3al8611ecnc5ri03lpz8y44ef 2467566 2467565 2026-10-14T06:33:38Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1275.eqiad.wmnet 2467566 wikitext text/x-wiki 6dxyquduzo5vgtul93xl4kttwjnqbia 2467567 2467566 2026-10-14T06:33:59Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1275.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467567 wikitext text/x-wiki n3bgc4m3diufw1rvbdp9c1v7olhihps 2467568 2467567 2026-10-14T06:34:52Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) netbox to netbox-dev2003.codfw.wmnet with reason: Force redis 6.2.0 to fix regression - ayounsi@cumin1004 2467568 wikitext text/x-wiki l1r0vu8vb05seqaak2jkkz1narkvfvx 2467569 2467568 2026-10-14T06:42:20Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1275.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467569 wikitext text/x-wiki 9yafkihmn80jjy15644ef7swa0q4llp 2467570 2467569 2026-10-14T06:42:31Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1275.eqiad.wmnet 2467570 wikitext text/x-wiki niohogy0vwofvacuxrckjwif62d8pra 2467571 2467570 2026-10-14T06:42:32Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1275.eqiad.wmnet 2467571 wikitext text/x-wiki aggpsrctig7433mobfabnat06149udc 2467572 2467571 2026-10-14T06:42:46Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1276.eqiad.wmnet 2467572 wikitext text/x-wiki oa1iyjfh1e3s4yjibpqaodf812eex9s 2467573 2467572 2026-10-14T06:43:17Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1276.eqiad.wmnet 2467573 wikitext text/x-wiki 96xrscl8sl8imijg1nb05qcjx34frbr 2467574 2467573 2026-10-14T06:43:37Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1276.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467574 wikitext text/x-wiki g2wtboimthz206llqa7aqafbaaktx4b 2467575 2467574 2026-10-14T06:53:29Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1276.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467575 wikitext text/x-wiki 72gq82uty9ru0jjk1skc845frny82gx 2467576 2467575 2026-10-14T06:53:48Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1276.eqiad.wmnet 2467576 wikitext text/x-wiki 3qrbw0e3mcoc9xin5llnlsobkndo7qj 2467579 2467576 2026-10-14T06:55:34Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1276.eqiad.wmnet 2467579 wikitext text/x-wiki q9yp674d19edv97wpjgtwd41a7cus9w 2467580 2467579 2026-10-14T06:55:48Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1277.eqiad.wmnet 2467580 wikitext text/x-wiki oy4h193dgr00r72xhuowuf12q10oz74 2467582 2467580 2026-10-14T06:56:21Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1277.eqiad.wmnet 2467582 wikitext text/x-wiki r17hrodh6te6wnf2zjnkgl9gjpgdjpg 2467583 2467582 2026-10-14T06:56:41Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1277.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467583 wikitext text/x-wiki 8ginbzzdm1ugqqqjvhxgr9g4jimjanu 2467585 2467583 2026-10-14T07:02:38Z Stashbot 7414 wmde-fisch@deploy1003: Started scap sync-world: Backport for [[gerrit:1353180|Enable sub-references on enwiki (T440243)]] 2467585 wikitext text/x-wiki lvbw5rspl0vuewvty7k0r2e3avhkjj6 2467586 2467585 2026-10-14T07:07:19Z Stashbot 7414 wmde-fisch@deploy1003: wmde-fisch: Backport for [[gerrit:1353180|Enable sub-references on enwiki (T440243)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2467586 wikitext text/x-wiki ckj5fmj8bm1o1vcvxc8390xlz4r6zj3 2467587 2467586 2026-10-14T07:08:02Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1277.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467587 wikitext text/x-wiki owhrnmf24pb4l98pzyn6nvfdwwo1kre 2467588 2467587 2026-10-14T07:08:30Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1277.eqiad.wmnet 2467588 wikitext text/x-wiki qrpwaxjoc0c8y1shtcg69oluklbqiao 2467589 2467588 2026-10-14T07:10:13Z Stashbot 7414 wmde-fisch@deploy1003: wmde-fisch: Continuing with deployment 2467589 wikitext text/x-wiki acm5vhjtlaiqxx68kupestd4lnqvn5n 2467590 2467589 2026-10-14T07:10:38Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1277.eqiad.wmnet 2467590 wikitext text/x-wiki o41ola2uemahxnvkncz4b7l5wfstit1 2467591 2467590 2026-10-14T07:10:52Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1278.eqiad.wmnet 2467591 wikitext text/x-wiki gk7u60ubui5mcykxt7qu7q3fdkoq39j 2467592 2467591 2026-10-14T07:11:24Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1278.eqiad.wmnet 2467592 wikitext text/x-wiki hpwab2r8j4bu1w3k4jf5xpoww4h8cuc 2467593 2467592 2026-10-14T07:11:44Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1278.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467593 wikitext text/x-wiki ach0xrgp7h843j3w2pnw26b6qcn604u 2467594 2467593 2026-10-14T07:15:49Z Stashbot 7414 wmde-fisch@deploy1003: Finished scap sync-world: Backport for [[gerrit:1353180|Enable sub-references on enwiki (T440243)]] (duration: 13m 11s) 2467594 wikitext text/x-wiki 4no9bk69at9vba4o62nqmth1itux0mv 2467595 2467594 2026-10-14T07:20:04Z Stashbot 7414 mlitn@deploy1003: Started scap sync-world: Backport for [[gerrit:1354869|Refactor API stuff (T440847)]] (1.47.0-wmf.24) 2467595 wikitext text/x-wiki 5nm8yew8z28uq60xkppbudwh9zt0id8 2467596 2467595 2026-10-14T07:21:35Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1278.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467596 wikitext text/x-wiki t99w2k2msbdo2mtuoyva8homsz4ovbw 2467597 2467596 2026-10-14T07:21:53Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1278.eqiad.wmnet 2467597 wikitext text/x-wiki af2xuj5a1gvlx4c2s7clroy51orofp0 2467598 2467597 2026-10-14T07:23:29Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1278.eqiad.wmnet 2467598 wikitext text/x-wiki osmvpp5kfnlxj3shz6mip46569tk6vg 2467599 2467598 2026-10-14T07:23:44Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1279.eqiad.wmnet 2467599 wikitext text/x-wiki n2tq65qrrfdiddi2z5oj9oygc7nmcwt 2467600 2467599 2026-10-14T07:24:15Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1279.eqiad.wmnet 2467600 wikitext text/x-wiki c0y3pcmxi1dkm0go3n6ar00arnquj7f 2467601 2467600 2026-10-14T07:24:18Z Stashbot 7414 mlitn@deploy1003: mlitn: Backport for [[gerrit:1354869|Refactor API stuff (T440847)]] (1.47.0-wmf.24) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2467601 wikitext text/x-wiki 1k48hdb3uxl3ghqarlohgnwx8n3iph6 2467602 2467601 2026-10-14T07:24:35Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1279.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467602 wikitext text/x-wiki 84gdgd1avqhl81n8cf7ay5x0rd9an8j 2467603 2467602 2026-10-14T07:24:45Z Stashbot 7414 mlitn@deploy1003: mlitn: Continuing with deployment 2467603 wikitext text/x-wiki qao4vuwa8uhem1118p4xmih57o6ckvx 2467604 2467603 2026-10-14T07:30:08Z Stashbot 7414 mlitn@deploy1003: Finished scap sync-world: Backport for [[gerrit:1354869|Refactor API stuff (T440847)]] (1.47.0-wmf.24) (duration: 10m 06s) 2467604 wikitext text/x-wiki ort8r406i18mvetx9bu0h9x56n8eo9w 2467605 2467604 2026-10-14T07:32:30Z Stashbot 7414 awight@deploy1003: Started scap sync-world: Backport for [[gerrit:1352724|Suppress language link notifications by default (T437577)]] 2467605 wikitext text/x-wiki ffoxz8ll5cd61vgwb9jpevy0j23ipsj 2467606 2467605 2026-10-14T07:33:57Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1279.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467606 wikitext text/x-wiki 13baifwpyf2w5a587xuducvp8j6ngqx 2467607 2467606 2026-10-14T07:34:15Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1279.eqiad.wmnet 2467607 wikitext text/x-wiki h41gex4nvw2n0ztt2k7aid8ma1hk651 2467608 2467607 2026-10-14T07:36:34Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1279.eqiad.wmnet 2467608 wikitext text/x-wiki 932udalyzulajp29kzmwvjaz9teicbk 2467609 2467608 2026-10-14T07:36:40Z Stashbot 7414 awight@deploy1003: awight, seanleong-wmde: Backport for [[gerrit:1352724|Suppress language link notifications by default (T437577)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2467609 wikitext text/x-wiki m8lmandvk45y27vu99qrt0zuetkayo6 2467610 2467609 2026-10-14T07:36:48Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1280.eqiad.wmnet 2467610 wikitext text/x-wiki gzzx3aq92bdudnw2zyac8kqevgnac0l 2467611 2467610 2026-10-14T07:37:21Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1280.eqiad.wmnet 2467611 wikitext text/x-wiki 0y5onicz8dbxmxbwd5l39scfuuyz75q 2467612 2467611 2026-10-14T07:37:41Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1280.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467612 wikitext text/x-wiki n5rczver9kge5gck7jiusxbwrn4odyb 2467613 2467612 2026-10-14T07:38:26Z Stashbot 7414 awight@deploy1003: awight, seanleong-wmde: Continuing with deployment 2467613 wikitext text/x-wiki ad8nny4qdkhjismt4curplj1gs0wncx 2467614 2467613 2026-10-14T07:38:49Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2249.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2467614 wikitext text/x-wiki l1uuz8r59038ii3lfgvf3fipnokkjsw 2467615 2467614 2026-10-14T07:41:53Z Stashbot 7414 ayounsi@cumin1004: START - Cookbook sre.deploy.python-code netbox to netbox2003.codfw.wmnet,netbox1003.eqiad.wmnet with reason: Force redis 6.2.0 to fix regression - ayounsi@cumin1004 2467615 wikitext text/x-wiki sw4e4crwizsdz04hxven4br09ngqmm7 2467616 2467615 2026-10-14T07:43:44Z Stashbot 7414 awight@deploy1003: Finished scap sync-world: Backport for [[gerrit:1352724|Suppress language link notifications by default (T437577)]] (duration: 11m 14s) 2467616 wikitext text/x-wiki kocpbmnkn8e9kyosvs7vjxgyne9navm 2467617 2467616 2026-10-14T07:43:54Z Stashbot 7414 awight: UTC morning deployment complete 2467617 wikitext text/x-wiki dzfrd7dwbilupiajshr44s555pno75z 2467618 2467617 2026-10-14T07:44:10Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2249.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2467618 wikitext text/x-wiki sd1cujg4n6g6owo239qcvmfvx4w5m69 2467619 2467618 2026-10-14T07:44:28Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2249.codfw.wmnet 2467619 wikitext text/x-wiki iou9eawlr86t5is9iuxs8fjgji015j0 2467620 2467619 2026-10-14T07:45:35Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2249.codfw.wmnet 2467620 wikitext text/x-wiki jx2lw2e8ewy3vida1r8kbew9mgqla73 2467621 2467620 2026-10-14T07:45:49Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2250.codfw.wmnet 2467621 wikitext text/x-wiki 8sbbf7iy4fiyuxhlv0tnquvu8v6l8u0 2467623 2467621 2026-10-14T07:46:24Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2250.codfw.wmnet 2467623 wikitext text/x-wiki cqzg5sa48lepz9sqpdeyblkchu44074 2467624 2467623 2026-10-14T07:47:14Z Stashbot 7414 ayounsi@cumin1004: END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) netbox to netbox2003.codfw.wmnet,netbox1003.eqiad.wmnet with reason: Force redis 6.2.0 to fix regression - ayounsi@cumin1004 2467624 wikitext text/x-wiki braoaq9y6yzynq1iy74mx34yr5z90vc 2467625 2467624 2026-10-14T07:47:30Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1280.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467625 wikitext text/x-wiki 5fhp4bh3l9s0dronjqmf0lxytelgd7l 2467626 2467625 2026-10-14T07:47:45Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1280.eqiad.wmnet 2467626 wikitext text/x-wiki ddk18jlhp407zbjywq026y4id3qh2hy 2467627 2467626 2026-10-14T07:50:15Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1280.eqiad.wmnet 2467627 wikitext text/x-wiki s903rg1mxfv0bvjnvleq6niqshv51bm 2467628 2467627 2026-10-14T07:50:28Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1281.eqiad.wmnet 2467628 wikitext text/x-wiki neqcroo1jqabd4y2cudr8pz21ltg4b0 2467629 2467628 2026-10-14T07:51:00Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1281.eqiad.wmnet 2467629 wikitext text/x-wiki os4c0us6trzsp86ka1f767a4g7t6nym 2467630 2467629 2026-10-14T07:51:20Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1281.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467630 wikitext text/x-wiki s98o7isfu52xx3rxqcyip90ia3qq2ij 2467631 2467630 2026-10-14T08:01:10Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1281.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467631 wikitext text/x-wiki edyvzk1tcq8fvra9y3v7r3ua0rk538f 2467632 2467631 2026-10-14T08:01:22Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1281.eqiad.wmnet 2467632 wikitext text/x-wiki 9s14wxkeowtwbs9iecchdsxlh94u2al 2467633 2467632 2026-10-14T08:01:48Z Stashbot 7414 arnaudb@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on gerrit2002.wikimedia.org with reason: testing 2467633 wikitext text/x-wiki 5yzy59fr2fh8t99o02udo2oiofu9ttu 2467634 2467633 2026-10-14T08:03:31Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1281.eqiad.wmnet 2467634 wikitext text/x-wiki fpyxc26tadtj0ih7hi0ocsvnjjsf9e7 2467635 2467634 2026-10-14T08:03:44Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1282.eqiad.wmnet 2467635 wikitext text/x-wiki e6p2h661oeswk3qbxx9qrjle6tu37ld 2467636 2467635 2026-10-14T08:04:15Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1282.eqiad.wmnet 2467636 wikitext text/x-wiki jw2vxqtjzrc5sq5nt5qoyftqre1w5bu 2467638 2467636 2026-10-14T08:04:36Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1282.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467638 wikitext text/x-wiki nfqh9krx2c7zo077tmqkdw3tvie1bne 2467640 2467638 2026-10-14T08:10:06Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2250.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2467640 wikitext text/x-wiki mvksxeg8ici4210gs7xkznsfhuswm3x 2467641 2467640 2026-10-14T08:14:26Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1282.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467641 wikitext text/x-wiki h6tuzeg4r0ja83n8e7k2hthozlqkk6c 2467642 2467641 2026-10-14T08:14:45Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1282.eqiad.wmnet 2467642 wikitext text/x-wiki 3dt7xq80cd8rlfn6kbhd4dzahu2s7uu 2467643 2467642 2026-10-14T08:14:57Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1282.eqiad.wmnet 2467643 wikitext text/x-wiki 1xoc55bxyg1146zc2xt25dmdyrs0mog 2467644 2467643 2026-10-14T08:15:11Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1283.eqiad.wmnet 2467644 wikitext text/x-wiki ns2ttdhsuwmakd9fhkonrv6nwxr8ong 2467645 2467644 2026-10-14T08:15:24Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2250.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2467645 wikitext text/x-wiki 32m1p9u81eyncb48r3o7evq964nyxso 2467646 2467645 2026-10-14T08:15:42Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2250.codfw.wmnet 2467646 wikitext text/x-wiki eu0mdgzmhcedet53icmczgmtnmgo820 2467647 2467646 2026-10-14T08:15:43Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1283.eqiad.wmnet 2467647 wikitext text/x-wiki 4uxy0r0jjpegpivvt461120qpprg7ua 2467649 2467647 2026-10-14T08:16:01Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1283.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467649 wikitext text/x-wiki iib0hknsqgrsi9urqskobmrm17uckfq 2467650 2467649 2026-10-14T08:16:17Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2250.codfw.wmnet 2467650 wikitext text/x-wiki 6llg8nfzg0rsbl8janhx2ow4r3ie2y1 2467651 2467650 2026-10-14T08:16:31Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2251.codfw.wmnet 2467651 wikitext text/x-wiki lxvgnxpe7qqikbxgv79y06bgd3005dl 2467652 2467651 2026-10-14T08:17:05Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2251.codfw.wmnet 2467652 wikitext text/x-wiki 0qbbkduzv0lkay0upl2wc6cg7wfslek 2467653 2467652 2026-10-14T08:22:16Z Stashbot 7414 arnaudb: gerrit2002: point the spare Gerrit at ldap-ro-test.codfw and restart it - T440888 2467653 wikitext text/x-wiki h5u2czp39wwjwh8enf4vo3se9h0bxqs 2467654 2467653 2026-10-14T08:23:57Z Stashbot 7414 arnaudb@cumin1004: START - Cookbook sre.gerrit.restart-gerrit Restarting Gerrit on gerrit2002 2467654 wikitext text/x-wiki 9j7wros2jlsp3q4bqkcpx7rw5vllfry 2467655 2467654 2026-10-14T08:25:07Z Stashbot 7414 arnaudb@cumin1004: END (PASS) - Cookbook sre.gerrit.restart-gerrit (exit_code=0) Restarting Gerrit on gerrit2002 2467655 wikitext text/x-wiki 9auyr4ifle0ixvgy5hhskyeh6ke3cts 2467656 2467655 2026-10-14T08:25:51Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1283.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467656 wikitext text/x-wiki fuqod8kfa398vkgo5eh4un2jmihryov 2467658 2467656 2026-10-14T08:26:19Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1283.eqiad.wmnet 2467658 wikitext text/x-wiki 3rksavg3hivn7qsyucc2b4le5xvond3 2467659 2467658 2026-10-14T08:26:21Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1283.eqiad.wmnet 2467659 wikitext text/x-wiki ob6wz3nglws6xobr60yxdba9ymzuti3 2467660 2467659 2026-10-14T08:26:33Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1284.eqiad.wmnet 2467660 wikitext text/x-wiki hh7esiqwxexek1yftc4599xqppscw25 2467661 2467660 2026-10-14T08:27:06Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1284.eqiad.wmnet 2467661 wikitext text/x-wiki ltar3cxs6ge9mviykc724cdkyyv5b78 2467663 2467661 2026-10-14T08:27:25Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1284.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467663 wikitext text/x-wiki arlp43chjrmseg3c8twahoc24yeisi3 2467664 2467663 2026-10-14T08:28:48Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2251.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2467664 wikitext text/x-wiki cdwszxazgulkft9t1n0955jxitzvbbm 2467666 2467664 2026-10-14T08:30:38Z Stashbot 7414 arnaudb@cumin1004: START - Cookbook sre.gerrit.restart-gerrit Restarting Gerrit on gerrit2002 2467666 wikitext text/x-wiki inxyxy0wmybxla970koq4dlopfsemrt 2467667 2467666 2026-10-14T08:31:58Z Stashbot 7414 arnaudb@cumin1004: END (PASS) - Cookbook sre.gerrit.restart-gerrit (exit_code=0) Restarting Gerrit on gerrit2002 2467667 wikitext text/x-wiki lgbqyvnvc44egmt188xq9tbg6md6ar3 2467668 2467667 2026-10-14T08:32:38Z Stashbot 7414 arnaudb: gerrit2002: the spare Gerrit is back on ldap-ro.codfw, restarted - T440888 2467668 wikitext text/x-wiki oxz07pn931jexalejw0sz4trgco5uvm 2467669 2467668 2026-10-14T08:34:07Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2251.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2467669 wikitext text/x-wiki bcyg0zhcd5wxv60mx6hgh6vqzbil22a 2467670 2467669 2026-10-14T08:34:13Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2251.codfw.wmnet 2467670 wikitext text/x-wiki 1wmp5y86y0535i9h1k5n74j5gy41969 2467671 2467670 2026-10-14T08:35:20Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2251.codfw.wmnet 2467671 wikitext text/x-wiki 2td1aje073andlotzvvpo4ww0iewxxn 2467672 2467671 2026-10-14T08:35:34Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2252.codfw.wmnet 2467672 wikitext text/x-wiki ljhxop4b7yg5fq265sbs5o8wq1o8xlw 2467673 2467672 2026-10-14T08:36:09Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2252.codfw.wmnet 2467673 wikitext text/x-wiki hseqfd6pwhzk8kjdv6mbq13vvbqacis 2467674 2467673 2026-10-14T08:37:15Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1284.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467674 wikitext text/x-wiki 9dah40ti8occcqqdht16h703hp3pvfu 2467675 2467674 2026-10-14T08:37:34Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1284.eqiad.wmnet 2467675 wikitext text/x-wiki k4w90me5jh98djh3uzxff5vjn24osud 2467676 2467675 2026-10-14T08:37:36Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1284.eqiad.wmnet 2467676 wikitext text/x-wiki e4c4mnv03k487juv9093o64n03kkh2o 2467677 2467676 2026-10-14T08:37:49Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1285.eqiad.wmnet 2467677 wikitext text/x-wiki jtlu74gzm4973g9cjmury7611dl2xe8 2467678 2467677 2026-10-14T08:38:57Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1285.eqiad.wmnet 2467678 wikitext text/x-wiki 0aqaqos1u5lhwale81gwbhhl1vibgkh 2467679 2467678 2026-10-14T08:39:16Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1285.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467679 wikitext text/x-wiki tcraqftujpnf6y12hlaobusz57rhogy 2467680 2467679 2026-10-14T08:40:58Z Stashbot 7414 cgoubert@deploy1003: helmfile [staging] START helmfile.d/services/lac-lambdas: apply 2467680 wikitext text/x-wiki 6slczz1edenksitjrt6b8h1up0lqvaj 2467681 2467680 2026-10-14T08:41:10Z Stashbot 7414 cgoubert@deploy1003: helmfile [staging] DONE helmfile.d/services/lac-lambdas: apply 2467681 wikitext text/x-wiki rovod8thipyhhla96p5wggocmo26ezn 2467682 2467681 2026-10-14T08:49:36Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1285.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467682 wikitext text/x-wiki lczxosoewsoia3e8ovhuxc032t1rz4x 2467683 2467682 2026-10-14T08:49:55Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1285.eqiad.wmnet 2467683 wikitext text/x-wiki 0z7hkuzvrxfbf53r25na7e1796jjd2p 2467684 2467683 2026-10-14T08:51:21Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1285.eqiad.wmnet 2467684 wikitext text/x-wiki efniropdgnttb01mfvvcwdiq3zplrf9 2467685 2467684 2026-10-14T08:51:34Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1286.eqiad.wmnet 2467685 wikitext text/x-wiki mrfary7pf2n0owny19ixbdn7sxsvcsu 2467686 2467685 2026-10-14T08:52:07Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1286.eqiad.wmnet 2467686 wikitext text/x-wiki l082wguwm7jcewdx0n63pdzbo73d4i6 2467687 2467686 2026-10-14T08:52:27Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1286.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467687 wikitext text/x-wiki 1vwnudqvle8ukei8no8zxnxmysojz5h 2467688 2467687 2026-10-14T08:58:54Z Stashbot 7414 arnaudb@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on gerrit[1003,2002-2003].wikimedia.org with reason: Hashar unblocking mediawiki train 2467688 wikitext text/x-wiki g03n0fy13kv4zq3y2x3tp5dcrkwhf7s 2467689 2467688 2026-10-14T09:02:18Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1286.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467689 wikitext text/x-wiki kxig1p9r5gqwg27x1kftdx2rxfyleqo 2467690 2467689 2026-10-14T09:02:37Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1286.eqiad.wmnet 2467690 wikitext text/x-wiki muyeqri3hzp440gcs2oekzk1pml9unr 2467691 2467690 2026-10-14T09:04:24Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1286.eqiad.wmnet 2467691 wikitext text/x-wiki jarq4vfo8mekr05keem4x1hht9kssm8 2467692 2467691 2026-10-14T09:04:37Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1287.eqiad.wmnet 2467692 wikitext text/x-wiki buj6810izp5bl4gq7h3cdo9npodfzku 2467693 2467692 2026-10-14T09:05:09Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1287.eqiad.wmnet 2467693 wikitext text/x-wiki p7jyohd3le6rzj939p368acswit0e1x 2467694 2467693 2026-10-14T09:05:28Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1287.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467694 wikitext text/x-wiki el2ip1m8heodkxbsc77eo4kemb103tw 2467695 2467694 2026-10-14T09:15:50Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1287.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467695 wikitext text/x-wiki r4vgpyl90c6860kjh5ruslk1trmwu4m 2467696 2467695 2026-10-14T09:16:02Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1287.eqiad.wmnet 2467696 wikitext text/x-wiki i79o788w6em9clcummqst4indii2736 2467697 2467696 2026-10-14T09:17:17Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1287.eqiad.wmnet 2467697 wikitext text/x-wiki fslnb187b6rkyyjbd359is1cucfuios 2467698 2467697 2026-10-14T09:17:31Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1288.eqiad.wmnet 2467698 wikitext text/x-wiki ousd8zxmi10xxze7nszlyzsl90ng85l 2467699 2467698 2026-10-14T09:18:04Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1288.eqiad.wmnet 2467699 wikitext text/x-wiki jaatbpq67nxk07p8q7a5lwk1mwrda31 2467700 2467699 2026-10-14T09:18:23Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1288.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467700 wikitext text/x-wiki 9yfihwejqmwkyvhnst6usz5yzl9b08z 2467702 2467700 2026-10-14T09:20:07Z Stashbot 7414 hashar@deploy1003: Started deploy [gerrit/gerrit@0b12955]: Gerrit to 3.10.9-79-g5500b68896 and update plugins - T437620 2467702 wikitext text/x-wiki mk1vvxvm02ya191n77b4s6c2633lp87 2467703 2467702 2026-10-14T09:20:21Z Stashbot 7414 hashar@deploy1003: Finished deploy [gerrit/gerrit@0b12955]: Gerrit to 3.10.9-79-g5500b68896 and update plugins - T437620 (duration: 00m 14s) 2467703 wikitext text/x-wiki j3hi6unsowlhg1mc2chn51ny611z22v 2467705 2467703 2026-10-14T09:28:15Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1288.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467705 wikitext text/x-wiki gujwjkm4oba9dycp2lj3100flsx6yh9 2467706 2467705 2026-10-14T09:28:34Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1288.eqiad.wmnet 2467706 wikitext text/x-wiki 6kx28a8eazpdd14hax2229wod13jjzd 2467707 2467706 2026-10-14T09:28:46Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1288.eqiad.wmnet 2467707 wikitext text/x-wiki hchzti2ztgpvopa1pdr97h8v4blshh1 2467708 2467707 2026-10-14T09:29:00Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1289.eqiad.wmnet 2467708 wikitext text/x-wiki r0ybnxneidyf82r1s2vdpi2z6nwvstm 2467709 2467708 2026-10-14T09:29:33Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1289.eqiad.wmnet 2467709 wikitext text/x-wiki pucfchggw4treiirv4t3emwhg44yy2e 2467710 2467709 2026-10-14T09:29:53Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1289.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467710 wikitext text/x-wiki 7szl6rmcuyo6xtl4sgdgahi6f4x2mf0 2467712 2467710 2026-10-14T09:35:58Z Stashbot 7414 hashar@deploy1003: Started deploy [gerrit/gerrit@0d40a02]: Expand Gerrit built-in plugins - T437620 2467712 wikitext text/x-wiki dey14w3le4q7o7fgg4trqqbfxji5ecw 2467713 2467712 2026-10-14T09:36:12Z Stashbot 7414 hashar@deploy1003: Finished deploy [gerrit/gerrit@0d40a02]: Expand Gerrit built-in plugins - T437620 (duration: 00m 13s) 2467713 wikitext text/x-wiki 303mexh9vrdyv5gnwwkkh73jbyw9ypl 2467714 2467713 2026-10-14T09:40:14Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1289.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467714 wikitext text/x-wiki o40yg2hbj41os3782uhk331kgzizs45 2467715 2467714 2026-10-14T09:40:33Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1289.eqiad.wmnet 2467715 wikitext text/x-wiki laadst4k9aspbyz3vfbuzj02rz9rx4p 2467716 2467715 2026-10-14T09:40:53Z Stashbot 7414 hashar@deploy1003: Started deploy [gerrit/gerrit@0d40a02]: Gerrit to 3.10.9-79-g5500b68896 and update plugins - T437620 2467716 wikitext text/x-wiki nz8eh5yuzk2pc8hlxnhyx6xbwdnyjkj 2467717 2467716 2026-10-14T09:41:10Z Stashbot 7414 hashar@deploy1003: Finished deploy [gerrit/gerrit@0d40a02]: Gerrit to 3.10.9-79-g5500b68896 and update plugins - T437620 (duration: 00m 16s) 2467717 wikitext text/x-wiki etwmy6swpruyv3yp8mwvyvvi35esxo4 2467718 2467717 2026-10-14T09:41:58Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1289.eqiad.wmnet 2467718 wikitext text/x-wiki b7haa33pxxebusn279jx5oznx7pfy3y 2467719 2467718 2026-10-14T09:42:00Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.enable_virtualization (exit_code=0) rolling provision on D{wikikube-worker[1260-1289].eqiad.wmnet} and (A:wikikube-master-eqiad or A:wikikube-worker-eqiad) 2467719 wikitext text/x-wiki 7g9uolsqsvu6150swrv11ozkcz3voud 2467720 2467719 2026-10-14T09:42:30Z Stashbot 7414 hashar: Upgrading Gerrit on gerrit-replica.wikimedia.org (gerrit2003) 2467720 wikitext text/x-wiki pc63fqxjsvk35hw6j70qfnz58yyqnob 2467721 2467720 2026-10-14T09:47:28Z Stashbot 7414 arnaudb@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:20:00 on gerrit[1003,2003].wikimedia.org with reason: Hashar unblocking mediawiki train 2467721 wikitext text/x-wiki lbu8q6xbax2a4wq2vcdqphonjuvwzrr 2467722 2467721 2026-10-14T09:47:57Z Stashbot 7414 arnaudb@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on gerrit[1003,2003].wikimedia.org with reason: Hashar unblocking mediawiki train 2467722 wikitext text/x-wiki i12ob2j2jusr2km84imhygjz46euvu1 2467725 2467722 2026-10-14T10:06:11Z Stashbot 7414 claime: Starting work on T440896 - Lowering TTLs 2467725 wikitext text/x-wiki 68dcbscs83h2a5y5w44ermuw5rbuq7l 2467726 2467725 2026-10-14T10:07:26Z Stashbot 7414 hashar: Upgrading Gerrit on gerrit.wikimedia.org (gerrit1003) 2467726 wikitext text/x-wiki 205brrmqjjx16jcup7s5v8w31pc26sh 2467727 2467726 2026-10-14T10:07:42Z Stashbot 7414 hashar@deploy1003: Started deploy [gerrit/gerrit@0d40a02]: Gerrit to 3.10.9-79-g5500b68896 and update plugins - T437620 2467727 wikitext text/x-wiki oklfvywja2mlio4zrfl0x2ve6cy0esy 2467728 2467727 2026-10-14T10:07:55Z Stashbot 7414 hashar@deploy1003: Finished deploy [gerrit/gerrit@0d40a02]: Gerrit to 3.10.9-79-g5500b68896 and update plugins - T437620 (duration: 00m 12s) 2467728 wikitext text/x-wiki l5fgkr08fb7684cqzstn6txk6gozkaz 2467729 2467728 2026-10-14T10:13:12Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2252.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2467729 wikitext text/x-wiki 2zo7d7frnasqymz31uinqcilxwrn50m 2467730 2467729 2026-10-14T10:18:29Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2252.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2467730 wikitext text/x-wiki qofl58o66vlejf5alexvsuhrergpaga 2467731 2467730 2026-10-14T10:18:36Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2252.codfw.wmnet 2467731 wikitext text/x-wiki arfy98tr9e8oqzc7uj9rofbltttb9nt 2467732 2467731 2026-10-14T10:18:37Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2252.codfw.wmnet 2467732 wikitext text/x-wiki gd8nyjgywm6n78jtg3t9gufrph6j0oo 2467733 2467732 2026-10-14T10:18:51Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2253.codfw.wmnet 2467733 wikitext text/x-wiki or3rydm7wtj6njexwt9ilwaq9lnfhft 2467734 2467733 2026-10-14T10:19:26Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2253.codfw.wmnet 2467734 wikitext text/x-wiki nlsqmh5wsgua1a47u6qri9i8qjkiv3l 2467735 2467734 2026-10-14T10:22:35Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.discovery.service-route depool mw-web-ro in eqiad: maintenance 2467735 wikitext text/x-wiki 4il31e5rwjdxhjdisiiolqp6ga4uybj 2467736 2467735 2026-10-14T10:23:33Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.discovery.service-route (exit_code=0) depool mw-web-ro in eqiad: maintenance 2467736 wikitext text/x-wiki jn9fkerclh7olbimhmrszjm46w1ein6 2467737 2467736 2026-10-14T10:23:53Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.discovery.service-route depool mw-api-ext-ro in eqiad: maintenance 2467737 wikitext text/x-wiki skopg10amcpvrjifs07aa17tmp1mi7u 2467738 2467737 2026-10-14T10:24:46Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.discovery.service-route (exit_code=0) depool mw-api-ext-ro in eqiad: maintenance 2467738 wikitext text/x-wiki oln6rmshdb5gvu1ij6c8q04m24m5e2v 2467739 2467738 2026-10-14T10:25:16Z Stashbot 7414 cgoubert@cumin2003: START - Cookbook sre.discovery.service-route depool mw-api-int-ro in eqiad: maintenance 2467739 wikitext text/x-wiki 7evt840okc2dpnsm4b0daxi7ywl2nn4 2467740 2467739 2026-10-14T10:26:13Z Stashbot 7414 cgoubert@cumin2003: END (PASS) - Cookbook sre.discovery.service-route (exit_code=0) depool mw-api-int-ro in eqiad: maintenance 2467740 wikitext text/x-wiki td5xc1jmtps8od1yc4yu5gewy5ul7ne 2467741 2467740 2026-10-14T10:30:24Z Stashbot 7414 claime: Curves crossed, all read traffic is served by codfw - T440896 2467741 wikitext text/x-wiki pz9snr9yszsu8cww3pkbewt4rr5wvkf 2467742 2467741 2026-10-14T10:32:01Z Stashbot 7414 claime: Giving memcache a little bit to warm up, p50 latency is up 50% accross the board - T440896 2467742 wikitext text/x-wiki 4rx0q01z1ghyx7k7j0gjz2v71tlu15b 2467743 2467742 2026-10-14T10:37:06Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.enable_virtualization rolling provision on D{wikikube-worker[1291-1300].eqiad.wmnet} and (A:wikikube-master-eqiad or A:wikikube-worker-eqiad) 2467743 wikitext text/x-wiki 1uus22lndbyn566q6d7gbxibllbfhne 2467744 2467743 2026-10-14T10:37:11Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1291.eqiad.wmnet 2467744 wikitext text/x-wiki k6kgrt4crbp61ra1azdj9oozfklzhmj 2467745 2467744 2026-10-14T10:37:16Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2253.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2467745 wikitext text/x-wiki 15ub7q6hz4s40y8e0i8f6ycttcqxxur 2467746 2467745 2026-10-14T10:37:42Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1291.eqiad.wmnet 2467746 wikitext text/x-wiki bwqut9kzqvnfyuzdvqhafv6y5z2dpz7 2467747 2467746 2026-10-14T10:38:02Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1291.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467747 wikitext text/x-wiki d0w4i7slep1f5b2zq1tvk4pphrlvdur 2467748 2467747 2026-10-14T10:42:35Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2253.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2467748 wikitext text/x-wiki buonwnts4g0oxg6m8uo9y69bqjvnw37 2467749 2467748 2026-10-14T10:42:41Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2253.codfw.wmnet 2467749 wikitext text/x-wiki q1xmqexml89x6fnsvzvzint01hwn8y5 2467750 2467749 2026-10-14T10:43:27Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2253.codfw.wmnet 2467750 wikitext text/x-wiki cp7qq348u6p1xatt4zs2ba3ss0aowse 2467751 2467750 2026-10-14T10:43:42Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2254.codfw.wmnet 2467751 wikitext text/x-wiki 049eph24994ia77berbkbvyi1amziry 2467752 2467751 2026-10-14T10:44:03Z Stashbot 7414 claime: Repooling eqiad before disabling memcached extstore in codfw - T440896 2467752 wikitext text/x-wiki fr0pcx8ievdhn1i6j7gz7p1bzs7uxt7 2467753 2467752 2026-10-14T10:44:16Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2254.codfw.wmnet 2467753 wikitext text/x-wiki 05o4q6vu56nkx4bd8psxn0ojfl6sxdx 2467754 2467753 2026-10-14T10:45:49Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2254.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2467754 wikitext text/x-wiki 0yf80k9he0c7kkus6wwo8evl2lp639i 2467755 2467754 2026-10-14T10:47:53Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1291.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467755 wikitext text/x-wiki 3m8gin2omk96r14vsife3rzbl3yyblr 2467756 2467755 2026-10-14T10:48:21Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1291.eqiad.wmnet 2467756 wikitext text/x-wiki 74rh6owgzux7ienf70i1jzqnthb8wxl 2467757 2467756 2026-10-14T10:48:23Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1291.eqiad.wmnet 2467757 wikitext text/x-wiki deftdb0fgw9vy8jxv2z0qplnr8c3o29 2467758 2467757 2026-10-14T10:48:36Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1292.eqiad.wmnet 2467758 wikitext text/x-wiki s36u2qunfvy970m7oibim5tpz234jhz 2467759 2467758 2026-10-14T10:49:08Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1292.eqiad.wmnet 2467759 wikitext text/x-wiki i3fzt46joioc8nkewi2wpblzkvtzwcx 2467760 2467759 2026-10-14T10:49:28Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1292.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467760 wikitext text/x-wiki 97gngfm8zfu9z88qp5cwdszhptheoqt 2467761 2467760 2026-10-14T10:51:08Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2254.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2467761 wikitext text/x-wiki ttfu65yzqh709jm6h5rgly8smc9wnxh 2467762 2467761 2026-10-14T10:51:14Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2254.codfw.wmnet 2467762 wikitext text/x-wiki ggoead87xgjfq55r69lfuf7vsnqo1k2 2467763 2467762 2026-10-14T10:51:38Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2254.codfw.wmnet 2467763 wikitext text/x-wiki 67hx33oupasj8dsu9jsl8gfbi4to7kk 2467764 2467763 2026-10-14T10:51:51Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2255.codfw.wmnet 2467764 wikitext text/x-wiki jadn0kv8qyshx8haky6lu60ikfgudqr 2467765 2467764 2026-10-14T10:52:15Z Stashbot 7414 claime: disabling memcached extstore in codfw - T440896 2467765 wikitext text/x-wiki j8zjffjz1cznqf4282axqckdsmyn567 2467766 2467765 2026-10-14T10:52:26Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2255.codfw.wmnet 2467766 wikitext text/x-wiki 0rx2sml2eiq5bkvypwcn2pbfq2j7sy9 2467767 2467766 2026-10-14T10:54:29Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker2255.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2467767 wikitext text/x-wiki 5bswax95cge4y70haqul7cdnd5bqcwj 2467768 2467767 2026-10-14T10:59:18Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1292.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467768 wikitext text/x-wiki 696eovdjph0lqiy1jsf62ggxlv4dyyv 2467769 2467768 2026-10-14T10:59:32Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1292.eqiad.wmnet 2467769 wikitext text/x-wiki 07behpw8x5ylsdpme93cy0p56w2vq88 2467770 2467769 2026-10-14T10:59:48Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2255.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART 2467770 wikitext text/x-wiki p4x0uivzw6ccjdrm27gvtvq7kswio61 2467771 2467770 2026-10-14T10:59:53Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2255.codfw.wmnet 2467771 wikitext text/x-wiki 8bde79wcjanzni7l5oycpmwd45ghszb 2467772 2467771 2026-10-14T10:59:55Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2255.codfw.wmnet 2467772 wikitext text/x-wiki khe79zngfi9jrjqom7nw3bi3r3ywwai 2467773 2467772 2026-10-14T11:00:09Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2256.codfw.wmnet 2467773 wikitext text/x-wiki m6ul9w9bcwpq4w5cw9qaut3nvc8dpjk 2467774 2467773 2026-10-14T11:00:43Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2256.codfw.wmnet 2467774 wikitext text/x-wiki 6be20630ikjtyxoo963i8gsi311mjsk 2467775 2467774 2026-10-14T11:01:18Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1292.eqiad.wmnet 2467775 wikitext text/x-wiki j5fqgyhphs76ggqxnovz3jehzl9hghc 2467776 2467775 2026-10-14T11:01:33Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1293.eqiad.wmnet 2467776 wikitext text/x-wiki afi7bwh2j2h00578qu03fupz8y0e5aw 2467777 2467776 2026-10-14T11:02:05Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1293.eqiad.wmnet 2467777 wikitext text/x-wiki mr177cfozs10ry4fv5pnmcm7xaxvw5a 2467778 2467777 2026-10-14T11:02:13Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1293.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467778 wikitext text/x-wiki m757mdr355pj3xrcisih18m7fza96w8 2467779 2467778 2026-10-14T11:12:02Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1293.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467779 wikitext text/x-wiki 3k9gvp36u53wwiv2zs2k0ys0t6pclkt 2467780 2467779 2026-10-14T11:12:29Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1293.eqiad.wmnet 2467780 wikitext text/x-wiki aritc06ez27l3lvglv6kdev3wbf5cjb 2467781 2467780 2026-10-14T11:14:06Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1293.eqiad.wmnet 2467781 wikitext text/x-wiki 920ukysy5vx7m790x47v1fe2rtu6xyp 2467782 2467781 2026-10-14T11:14:19Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1294.eqiad.wmnet 2467782 wikitext text/x-wiki ak2k2112dyokdjc6rzf2s02qmmx1qp9 2467783 2467782 2026-10-14T11:14:53Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1294.eqiad.wmnet 2467783 wikitext text/x-wiki 7owjs41wp5ug2d6d7b6v3olfnn4ul7b 2467784 2467783 2026-10-14T11:15:12Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1294.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467784 wikitext text/x-wiki pclihhsyz077cyy4vzbuk5f4gi919j1 2467785 2467784 2026-10-14T11:25:03Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1294.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467785 wikitext text/x-wiki t7wmg98mtn1ll94sgjfdiy52ah65d68 2467786 2467785 2026-10-14T11:25:23Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1294.eqiad.wmnet 2467786 wikitext text/x-wiki 7gt4n9iukb1yujrogrhxpgm9697sqcy 2467787 2467786 2026-10-14T11:25:24Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1294.eqiad.wmnet 2467787 wikitext text/x-wiki rss8zh4sf6xwi0zc8vlwqgu2gj24b32 2467788 2467787 2026-10-14T11:25:38Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1295.eqiad.wmnet 2467788 wikitext text/x-wiki 4wzvziqh6m9r4akwk36k9kysqn5tn05 2467789 2467788 2026-10-14T11:26:09Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1295.eqiad.wmnet 2467789 wikitext text/x-wiki 9edu5om5jhovrds2qukv1eitt88irm6 2467790 2467789 2026-10-14T11:26:29Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1295.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467790 wikitext text/x-wiki 9rr5f7z4vlkznyc4dz3npta3vwhrh97 2467792 2467790 2026-10-14T11:36:20Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1295.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467792 wikitext text/x-wiki swhv5rzp8d3349islu823imysl6goc8 2467793 2467792 2026-10-14T11:36:32Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1295.eqiad.wmnet 2467793 wikitext text/x-wiki 0d8g3mqvglda4kjuhpruc20rz479x3i 2467794 2467793 2026-10-14T11:36:33Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1295.eqiad.wmnet 2467794 wikitext text/x-wiki j4ha9td5u50dfjnh1n95buinbiy2b2u 2467795 2467794 2026-10-14T11:36:47Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1296.eqiad.wmnet 2467795 wikitext text/x-wiki c9m3e3wjy5zg5t5qtv7jb481jwncakg 2467796 2467795 2026-10-14T11:37:19Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1296.eqiad.wmnet 2467796 wikitext text/x-wiki 7xihjpewc42mdkmtlsh3w9b8dms4w80 2467797 2467796 2026-10-14T11:37:38Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1296.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467797 wikitext text/x-wiki exqtwrcrdtdhzgnqgr5nq2mo8kne9ih 2467798 2467797 2026-10-14T11:43:03Z Stashbot 7414 isaranto@deploy1003: helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'experimental' for release 'main' . 2467798 wikitext text/x-wiki 595h8xcgo2j1y5tnt4l4jd66tvif2zv 2467799 2467798 2026-10-14T11:44:21Z Stashbot 7414 klausman@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 10 days, 0:00:00 on ml-serve1015.eqiad.wmnet with reason: Downtime for more BIOS setup rummaging 2467799 wikitext text/x-wiki iqqjnhypj1ld6r1r0rxfdnu8wvxeq2s 2467800 2467799 2026-10-14T11:47:29Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker1296.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467800 wikitext text/x-wiki 9s8mjdkxl7xzmwqap6jm7j94uu85dt4 2467801 2467800 2026-10-14T11:47:33Z Stashbot 7414 btullis@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/admin 'apply'. 2467801 wikitext text/x-wiki g50upqtbso142opsonl8lfzd7mevcg5 2467802 2467801 2026-10-14T11:47:48Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker1296.eqiad.wmnet 2467802 wikitext text/x-wiki qwbfp7tmkdl7316yznal9zxehcu9f3n 2467803 2467802 2026-10-14T11:49:24Z Stashbot 7414 btullis@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2467803 wikitext text/x-wiki tw7svyxi3h9weqdzt9a6hxkddo17mh8 2467804 2467803 2026-10-14T11:50:06Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker1296.eqiad.wmnet 2467804 wikitext text/x-wiki n7fn2ja8tao2c7z9pv801beg2tlx3kt 2467805 2467804 2026-10-14T11:50:20Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker1297.eqiad.wmnet 2467805 wikitext text/x-wiki szn5yqntfbkt15a81lmhgu396ltvw0o 2467806 2467805 2026-10-14T11:50:52Z Stashbot 7414 oblivian@cumin1004: END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker1297.eqiad.wmnet 2467806 wikitext text/x-wiki ib3rkvzrv3u8or4fi9d41azuaqi1yqs 2467807 2467806 2026-10-14T11:51:12Z Stashbot 7414 oblivian@cumin1004: START - Cookbook sre.hosts.provision for host wikikube-worker1297.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2467807 wikitext text/x-wiki 7amudn9t7rierhem2b3gekegysh9das 2467808 2467807 2026-10-14T11:51:59Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2467808 wikitext text/x-wiki 2snmoanys631qk80auafalowiosp3dr 2467809 2467808 2026-10-14T11:57:44Z Stashbot 7414 btullis@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2467809 wikitext text/x-wiki nmf9ejb7pal53rsf1g704j3qksefkf2 0 9393 2467403 2465709 2026-10-13T22:24:19Z Southparkfan 1843 2467403 wikitext text/x-wiki rgptb8dsvgmhenmogzqq2hn6zfh0o20 0 17290 2467383 2466699 2026-10-13T21:08:00Z Stashbot 7414 Southparkfan: Starting Beta Cluster deployment server switchover - T435393 2467383 wikitext text/x-wiki sq2say4rwgld9hygehqxk164n46vf02 2467399 2467383 2026-10-13T22:05:56Z Stashbot 7414 Southparkfan: Finished Beta Cluster deployment server switchover, deployment-deploy06 is now the active deployment server - T435393 2467399 wikitext text/x-wiki kzkexctjryz97e5m7vkl9mek4itgzzr 0 26464 2467402 2375816 2026-10-13T22:24:18Z Southparkfan 1843 2467402 wikitext text/x-wiki au592kh8ff3z6lnqf82ryx5ynh7vv8j 498 30942 2467584 2464028 2026-10-14T06:57:11Z Stashbot 7414 godog: export perf counters from cloudceph - T440686 2467584 wikitext text/x-wiki dwocfhz4slaiavydodeedm2az2pm2q6 0 441012 2467581 2443332 2026-10-14T06:55:49Z Filippo Giunchedi 2939 /* Improvements */ icinga to alertmanager transition is completed for wmcs 2467581 wikitext text/x-wiki l1jzpg9boakv29qthla6351piotvskv 0 441753 2467278 2456493 2026-10-13T16:27:39Z FNegri-WMF 32595 /* Physical database server layer */ Update list of clouddb hosts 2467278 wikitext text/x-wiki cla48pmx6xodnfg1sxv6ykd118l65n6 0 442908 2467130 2221342 2026-10-13T14:42:42Z DCaro (WMF) 18271 /* Database */ 2467130 wikitext text/x-wiki ph4robinc2xxy2k86nlmaqbrg0efhfh 2467224 2467130 2026-10-13T15:49:55Z FNegri-WMF 32595 /* Database */ Add more information about credentials for wiki replicas and toolsdb 2467224 wikitext text/x-wiki 5mm710f4gpkgr2gjdgplj9mdqk14k5n 2467226 2467224 2026-10-13T15:50:27Z FNegri-WMF 32595 /* Database */ Add link to [[Trove]] 2467226 wikitext text/x-wiki qw1zmyeoaza5hnlinj1sihvplu0987v 0 443227 2467404 2401102 2026-10-13T22:24:56Z Southparkfan 1843 2467404 wikitext text/x-wiki clkqrzjew8tvpxcjxra8nx49lo90q97 2467406 2467404 2026-10-13T22:35:46Z Southparkfan 1843 2467406 wikitext text/x-wiki sos5lyxqvbur3bhxo4kcloab97q39z9 0 443307 2467413 2461888 2026-10-14T01:08:59Z BCornwall-WMF 31521 /* Atomic rollout */ mention staging_time 2467413 wikitext text/x-wiki b0opgogtn0ldbkms5kylqecce690xax 0 443657 2466956 2449199 2026-10-13T12:41:20Z Mahmoud Abdelsattar (WMDE) 46833 correcting the "unpack" command 2466956 wikitext text/x-wiki obr03i3mharrqy1he96k79bwhs0f72d 0 445989 2466951 2466438 2026-10-13T12:31:15Z DKertesz-WMF 59186 2466951 wikitext text/x-wiki 5l173ppc0d30odica6r3ox14uv0zh6n 2466952 2466951 2026-10-13T12:38:44Z DKertesz-WMF 59186 points at the right documentation for pooling and de-pooling 2466952 wikitext text/x-wiki fc7fjbf939tcgooaqoofw1n9f0r978k 0 446037 2467637 2462077 2026-10-14T08:04:22Z MLechvien-WMF 49197 Moving over some post-incident actions to the dedicated page 2467637 wikitext text/x-wiki 6ofzjk7q5ppwbpn205fp0bjcm3dsxpk 0 446528 2467791 1878908 2026-10-14T11:35:29Z Protolyte 55939 /* */ Fixed double redirect 2467791 wikitext text/x-wiki 7mh6uxu1c4u7yk7o8ny8kpb5kel5uc5 0 447718 2467704 2466432 2026-10-14T09:24:37Z Hashar 32 /* Deployment */ update gerrit user and path 2467704 wikitext text/x-wiki h1v8ii4ruzx90truwxwsoi00zgvqkud 2467711 2467704 2026-10-14T09:33:24Z Hashar 32 /* Plugins */ add step to extract built-in plugins 2467711 wikitext text/x-wiki a41mvo57ac7dnby249udovrrjiw9hxn 0 449160 2467408 2466944 2026-10-14T00:02:27Z Dexbot 30554 Bot: Updating the report 2467408 wikitext text/x-wiki ejofbrid16fpn0i7vw9rzwbhirb7plt 0 455782 2467657 2450497 2026-10-14T08:25:55Z Phuedx (WMF) 47850 Add agent_geo_ip_country contextual attribute and update code references 2467657 wikitext text/x-wiki c9jyj9jdybbga2mpk59gnzb1vx1447a 0 455783 2467662 2365686 2026-10-14T08:27:21Z Phuedx (WMF) 47850 Add agent_geo_ip_country contextual attribute and update code references 2467662 wikitext text/x-wiki hadgfwk9nx5ork7cv4sdq8t5uat3g2a 0 456526 2467305 2466934 2026-10-13T17:10:07Z Tgr (WMF) 39134 /* Logs from kubernetes */ add --tail=-1 to avoid only showing the first 10 lines 2467305 wikitext text/x-wiki 0xezqzbvuke04hsf6w5ec4vrbe9ymhs 3 457262 2467191 2269941 2026-10-13T15:24:17Z StrikerBot 8475 Welcome to Toolforge! 2467191 wikitext text/x-wiki e5209bg6g43rqyana2fiqw2su4vct2v 0 458819 2467665 2401075 2026-10-14T08:29:30Z OKarakaya-WMF 40765 typo 2467665 wikitext text/x-wiki ervus73r08afzc3xwrhll22s27nnae8 0 459699 2467143 2466932 2026-10-13T14:48:01Z Stashbot 7414 larssandergreen: civicrm upgraded from 02ccc9c7 to 69a87c76 2467143 wikitext text/x-wiki 57t0cy8u1cuzw91tkudks9tt95a7pbx 2467306 2467143 2026-10-13T17:13:36Z Stashbot 7414 ejegg: disabled recurring charge jobs for gr4vy API credential swap 2467306 wikitext text/x-wiki lk8nn2nje5wosxoatke239k4vjr4ojx 2467316 2467306 2026-10-13T17:51:12Z Stashbot 7414 ejegg: re-enabled recurring charge jobs 2467316 wikitext text/x-wiki hxr1u9grx13t0i7gw8zeg175e9z0s61 2467319 2467316 2026-10-13T18:02:33Z Stashbot 7414 eileen: civicrm upgraded from 69a87c76 to 39b86907 2467319 wikitext text/x-wiki 1089i3gr5gxvtg2na0ymizceiku1tyg 2467320 2467319 2026-10-13T18:05:11Z Stashbot 7414 larssandergreen: tools upgraded from c7be1099 to b8dac67c 2467320 wikitext text/x-wiki dqs3z8prniv5eeg9025bwwpqjdtyd51 2467358 2467320 2026-10-13T19:54:39Z Stashbot 7414 larssandergreen: civicrm upgraded from 39b86907 to 76651592 2467358 wikitext text/x-wiki abg9qklgkhxwh6haar280dhdvschesz 2467359 2467358 2026-10-13T19:55:39Z Stashbot 7414 larssandergreen: tools upgraded from b8dac67c to ccc34c76 2467359 wikitext text/x-wiki l65hyhbu6sncs5lmtlyyeazxlyrw9ke 0 460351 2467405 2435557 2026-10-13T22:34:00Z Southparkfan 1843 2467405 wikitext text/x-wiki iyw531t6sno06i8uo5bdfwm8g5h3zmu 0 460556 2467211 2450162 2026-10-13T15:40:34Z Atsuko-WMF 54082 /* What is changing */ RestExternalTaskSensor 2467211 wikitext text/x-wiki ervx4x7bztj345lwgbjasssrzhtc0od 2467212 2467211 2026-10-13T15:40:52Z Atsuko-WMF 54082 /* Why */ version 2467212 wikitext text/x-wiki pvcjfh5spiyzpfgnqq1nuxj9racvaw7 2467215 2467212 2026-10-13T15:42:19Z Atsuko-WMF 54082 /* RestExternalTaskSensor is incompatible across versions */ 2467215 wikitext text/x-wiki noq0rro8ihalqeu9jdo8nilpqhbng7o 2467239 2467215 2026-10-13T15:58:51Z Atsuko-WMF 54082 /* What is changing */ lead 2467239 wikitext text/x-wiki gipkaqbjwremu1ekfcswrwndgnu9x6q 0 460602 2467205 2462511 2026-10-13T15:36:39Z TBurmeister (WMF) 27417 Remove outdated template 2467205 wikitext text/x-wiki a74ii2n84o3fsulj1j59jbjm6t34es5 0 460746 2467639 2463424 2026-10-14T08:09:16Z MLechvien-WMF 49197 Porting over some follow-up actions for the Incident Coordinator 2467639 wikitext text/x-wiki lgzyfn0fivyqfm3h16vrk8bhoy6whpg 1 460805 2467034 2466715 2026-10-13T13:35:32Z GGoncalves-WMF 42848 /* Pages articles dumps status */ Reply 2467034 wikitext text/x-wiki 7bzylk2e2uu3tco2385ajwo04n4yvfv 2467081 2467034 2026-10-13T14:09:41Z Bamyers99 2099 /* Pages articles dumps status */ Reply 2467081 wikitext text/x-wiki 1y7mptr8i7x7ikk06olg18kj1vxbck7 2467308 2467081 2026-10-13T17:23:49Z GGoncalves-WMF 42848 /* Pages articles dumps status */ Reply 2467308 wikitext text/x-wiki cy0zu3drkkxvgbgv1olrdoeajs0ctjh 2467387 2467308 2026-10-13T21:12:11Z This, that and the other 921 /* Add to FAQ? */ new section 2467387 wikitext text/x-wiki 4009rc8r985y4vxvivfzeqzc09j65ty 1 460806 2467159 2466295 2026-10-13T14:59:40Z Neil Shah-Quinn (WMF) 36601 /* Removal Of Page Content */ Reply 2467159 wikitext text/x-wiki n1xv5qjzo7ob8ixsxo1843ojjm1pmrw 2467160 2467159 2026-10-13T14:59:56Z Neil Shah-Quinn (WMF) 36601 2467160 wikitext text/x-wiki 9h1tpnc9u9dt6hlrt7kqryw4jixca6r 2467393 2467160 2026-10-13T21:37:05Z Beedell.RokeJulianLockhart 26989 /* Removal Of Page Content */ Reply 2467393 wikitext text/x-wiki 7mcb4ljg9nh345g1pam6knevb2hy454 2467394 2467393 2026-10-13T21:39:22Z Neil Shah-Quinn (WMF) 36601 /* Removal Of Page Content */ Reply 2467394 wikitext text/x-wiki 9ntial5dwv8eg3i4or3eui8zsozf3q3 0 460814 2466950 2466949 2026-10-13T12:08:41Z OKarakaya-WMF 40765 adds plots 2466950 wikitext text/x-wiki 09c7m35ylwmp9xaygph1ftrku5glyej 2467031 2466950 2026-10-13T13:34:31Z OKarakaya-WMF 40765 updates todos 2467031 wikitext text/x-wiki 8qqd1bzshlljf3s47viyk1bps9kmdgb 2467648 2467031 2026-10-14T08:15:55Z OKarakaya-WMF 40765 clean up first part 2467648 wikitext text/x-wiki lwgf3h4wa9tctmsjn1p773uzpayqcp8 2467701 2467648 2026-10-14T09:20:06Z OKarakaya-WMF 40765 clean up 2467701 wikitext text/x-wiki 8bo08jfxdtomc1rvn0tqfqjgzswl68b 3 460815 2467185 2026-10-13T15:21:00Z StrikerBot 8475 Welcome to Toolforge! 2467185 wikitext text/x-wiki rabpv0wa1hj6wrcd0qdur7c1trlu86a 0 460816 2467310 2026-10-13T17:28:54Z JGleeson (WMF) 11337 Add Vendor accounts matrix 2467310 wikitext text/x-wiki eru7qrkt5158ciwgzp90f5wppwxe1q0 2467311 2467310 2026-10-13T17:37:51Z JGleeson (WMF) 11337 Add greg 2467311 wikitext text/x-wiki fmevbiby6slxtevfh4rt35jbqkjungz 2467315 2467311 2026-10-13T17:48:54Z JGleeson (WMF) 11337 Add FRUP for jgleeson 2467315 wikitext text/x-wiki dhz660rl7tcyu0lc7udnyjv6g3hqshe 2467327 2467315 2026-10-13T18:56:43Z DMiranda-WMF 56177 2467327 wikitext text/x-wiki 9zkmjy3cgt2rjflgefkd7fbpphj48zq 2467329 2467327 2026-10-13T19:02:02Z JGleeson (WMF) 11337 Redirect to collab 2467329 wikitext text/x-wiki 5mxwb7iobjkeg4elhlgry3ktzgcjmvq 3 460817 2467577 2026-10-14T06:54:00Z StrikerBot 8475 Welcome to Toolforge! 2467577 wikitext text/x-wiki h3moplsxt9j9f1v1h859prro11tgzq9 3 460818 2467578 2026-10-14T06:54:29Z StrikerBot 8475 Welcome to Toolforge! 2467578 wikitext text/x-wiki i6ww9ywb4ib6r3u5wwyptdtaqczdlhs