Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.47.0-wmf.19 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk 498 3086 2457231 2456745 2026-09-14T22:42:52Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2457231 wikitext text/x-wiki entbxbqzj5uqek34z925v1ycx3u6soy 2457232 2457231 2026-09-14T22:48:09Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api 2457232 wikitext text/x-wiki nftoupbvl50gb4v9t4prdry1efrst8b 2457347 2457232 2026-09-15T08:35:33Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-cli 2457347 wikitext text/x-wiki huk62cwqk10kb13ezrnutximn4s0ug0 2457348 2457347 2026-09-15T08:36:10Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-cli 2457348 wikitext text/x-wiki godw0ieoxq0hhggfy30g5xezv0jdog8 0 4106 2457338 48738 2026-09-15T08:32:11Z MABot 10804 Bot: Fixing double redirect from [[PoolCounter]] to [[SRE/Service Operations/Documentation/Reboots#PoolCounter]] 2457338 wikitext text/x-wiki 34ap67ima50xjtk6lrkz9slx962zsnd 0 4108 2456938 2456918 2026-09-14T12:23:12Z ScheduleDeploymentBot 37566 Add [[gerrit:1334946]] to Monday, September 14 UTC afternoon backport window 2456938 wikitext text/x-wiki cl8vo2e8wrdz2aj8enkr3niynpgottx 2457030 2456938 2026-09-14T13:54:46Z ScheduleDeploymentBot 37566 Add [[gerrit:1339811]] to Monday, September 14 UTC late backport window 2457030 wikitext text/x-wiki r2h8fvroymuc113ykwfr5yo544kldz0 2457047 2457030 2026-09-14T14:38:28Z ScheduleDeploymentBot 37566 Add [[gerrit:1338274]] to Monday, September 14 UTC late backport window 2457047 wikitext text/x-wiki n1n83tjgkppmg8v5gmhpr5mhs6x0w4p 2457058 2457047 2026-09-14T15:20:59Z ScheduleDeploymentBot 37566 Add [[gerrit:1340505]] to Tuesday, September 15 UTC afternoon backport window 2457058 wikitext text/x-wiki 8tswdj9grmzaj3ggqtnhfkotpqlce9b 2457105 2457058 2026-09-14T17:03:02Z ScheduleDeploymentBot 37566 Add [[gerrit:1339741]] to Monday, September 14 UTC late backport window 2457105 wikitext text/x-wiki hb7tz0d3xejfgwoahv95goqvdx9gz5j 2457112 2457105 2026-09-14T17:09:23Z ScheduleDeploymentBot 37566 Add [[gerrit:1341274]] to Tuesday, September 15 UTC morning backport window 2457112 wikitext text/x-wiki du7clatdlypm8uhda1ut93962nytnn5 2457114 2457112 2026-09-14T17:09:38Z ScheduleDeploymentBot 37566 Add [[gerrit:1341242]] to Tuesday, September 15 UTC morning backport window 2457114 wikitext text/x-wiki 00azo0z3npvf7ox1od51osh9xignkz6 2457120 2457114 2026-09-14T17:41:20Z ScheduleDeploymentBot 37566 Add [[gerrit:1341278]] to Monday, September 14 UTC late backport window 2457120 wikitext text/x-wiki ra57nt51lh6fefvaborh9ejmng8u7me 2457121 2457120 2026-09-14T17:46:25Z ScheduleDeploymentBot 37566 Add [[gerrit:1338999]] to Monday, September 14 UTC late backport window 2457121 wikitext text/x-wiki 32qg2r94umecyrzxi57g7657l9guk6m 2457123 2457121 2026-09-14T17:54:29Z ScheduleDeploymentBot 37566 Add [[gerrit:1340004]] to Monday, September 14 UTC late backport window 2457123 wikitext text/x-wiki d9znp1ab32una1gxwys1qv67a7xtthp 2457198 2457123 2026-09-14T20:30:11Z Jdforrester (WMF) 468 /* {{Deployment_day|date=2026-09-14}} */ Two done, one skipped (for now?). 2457198 wikitext text/x-wiki rqe82804kpyyc90g6qv17hvs5xjtyqv 2457245 2457198 2026-09-15T00:33:23Z ScheduleDeploymentBot 37566 Add [[gerrit:1334946]] to Tuesday, September 15 UTC afternoon backport window 2457245 wikitext text/x-wiki bd5v2ax24mtsru8ur4d2dmdfna9pu18 2457301 2457245 2026-09-15T06:37:29Z ScheduleDeploymentBot 37566 Add [[gerrit:1341254]] to Tuesday, September 15 UTC morning backport window 2457301 wikitext text/x-wiki 83jtp6tgyccome86s2b0ar71x3yt00p 498 6726 2457075 2456743 2026-09-14T15:35:16Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-cli 2457075 wikitext text/x-wiki 7h198uqqog2ivdlqsji733mtryuf6jr 2457077 2457075 2026-09-14T15:35:47Z Stashbot 7414 dcaro@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component logs-cli 2457077 wikitext text/x-wiki og4w5uy254gpbdl8bujyjlt2lit0bzd 2457082 2457077 2026-09-14T15:41:08Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-cli 2457082 wikitext text/x-wiki k1celey8tj4prtvu7abwdmkh6hi34uf 2457083 2457082 2026-09-14T15:41:09Z Stashbot 7414 dcaro@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component logs-cli 2457083 wikitext text/x-wiki r2l8ibi3vyjfn3gqmzb93enof3us5rs 2457217 2457083 2026-09-14T22:20:36Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2457217 wikitext text/x-wiki bkfqbkc4w3ziaqr643g5vor5o9lrgqp 2457218 2457217 2026-09-14T22:20:37Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component components-api 2457218 wikitext text/x-wiki ancrx51e1ifv6eezltwygd3i0yhh50d 2457219 2457218 2026-09-14T22:20:55Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2457219 wikitext text/x-wiki encrgyu7bqaffzhbld65enrlz2i7mmu 2457220 2457219 2026-09-14T22:21:02Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component components-api 2457220 wikitext text/x-wiki 3ck56vfc7qv69v6v0s0afjav3dl6tt5 2457223 2457220 2026-09-14T22:25:57Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2457223 wikitext text/x-wiki t69d9a7zxtdxe0wfy47s043zjs4bygt 2457224 2457223 2026-09-14T22:26:02Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (FAIL) - Cookbook wmcs.toolforge.component.deploy (exit_code=99) for component components-api 2457224 wikitext text/x-wiki 1tit4qu9eva6ck95q3vse33hxnc8paz 2457225 2457224 2026-09-14T22:30:51Z Stashbot 7414 raymond-ndibe@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component components-api 2457225 wikitext text/x-wiki s1ac7rhwzzdv7evottxj2ssimk6a680 2457227 2457225 2026-09-14T22:35:32Z Stashbot 7414 raymond-ndibe@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component components-api 2457227 wikitext text/x-wiki jbo2qxoni98c5h1rxmq97mvjwb6ekzt 2457345 2457227 2026-09-15T08:34:54Z Stashbot 7414 dcaro@cloudcumin1001: START - Cookbook wmcs.toolforge.component.deploy for component logs-cli 2457345 wikitext text/x-wiki 97ehkherb6367243oozgel2yzs690c5 2457346 2457345 2026-09-15T08:35:24Z Stashbot 7414 dcaro@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component logs-cli 2457346 wikitext text/x-wiki 8ofq48zi4jt3nutzxhekj7a2fdxymk4 0 7919 2456936 2456934 2026-09-14T12:14:42Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/analytics-test: apply 2456936 wikitext text/x-wiki leyca3brakezf9i18zhdmnjfaupwkio 2456937 2456936 2026-09-14T12:14:48Z Stashbot 7414 brouberol@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/analytics-test: apply 2456937 wikitext text/x-wiki mzm6tcj8ysbs5y1ic8k8w1r605xmlrd 2456953 2456937 2026-09-14T12:30:29Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/aux-k8s-services/etherpad: apply 2456953 wikitext text/x-wiki 35ho8gna6ubp1hzqdnltdai0yfxvd9o 2456954 2456953 2026-09-14T12:34:16Z Stashbot 7414 _joe_: adding gvisor labels to all wikikube clusters nodes 2456954 wikitext text/x-wiki ovivjd6jcqtqaisjlzhp2vl3g6zqfbo 2456955 2456954 2026-09-14T12:36:49Z Stashbot 7414 marostegui@cumin1004: conftool action : set/pooled=yes; selector: name=clouddb1025.eqiad.wmnet,service=x4 2456955 wikitext text/x-wiki nuuxmr2syir0i8tmdfle5pmwfdxwzzh 2456956 2456955 2026-09-14T12:37:30Z Stashbot 7414 dbrant@deploy1003: helmfile [staging] START helmfile.d/services/wikifeeds: apply 2456956 wikitext text/x-wiki 8i8eto2pfjso6vvbic0jpjlyslivjbo 2456957 2456956 2026-09-14T12:37:49Z Stashbot 7414 dbrant@deploy1003: helmfile [staging] DONE helmfile.d/services/wikifeeds: apply 2456957 wikitext text/x-wiki 4efdgimpidp5x81x9l18u34ylakey0c 2456958 2456957 2026-09-14T12:39:17Z Stashbot 7414 dbrant@deploy1003: helmfile [eqiad] START helmfile.d/services/wikifeeds: apply 2456958 wikitext text/x-wiki rr3roy9901ksjw924460komg802t8qq 2456959 2456958 2026-09-14T12:39:45Z Stashbot 7414 dbrant@deploy1003: helmfile [eqiad] DONE helmfile.d/services/wikifeeds: apply 2456959 wikitext text/x-wiki 0j2xynq9ffz2r9ensxdpkyuhgm67vl7 2456960 2456959 2026-09-14T12:39:56Z Stashbot 7414 dbrant@deploy1003: helmfile [codfw] START helmfile.d/services/wikifeeds: apply 2456960 wikitext text/x-wiki 8bhzkuh48giquaql85et2waqtodgqxo 2456961 2456960 2026-09-14T12:40:19Z Stashbot 7414 oblivian@deploy1003: helmfile [staging-codfw] START helmfile.d/admin 'apply'. 2456961 wikitext text/x-wiki 4pi1rdno17i8rxl3jzq2kzhe4ubwscg 2456962 2456961 2026-09-14T12:40:24Z Stashbot 7414 dbrant@deploy1003: helmfile [codfw] DONE helmfile.d/services/wikifeeds: apply 2456962 wikitext text/x-wiki mkimz18pp9nju2a4kp8ms92vltayf1e 2456963 2456962 2026-09-14T12:40:35Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/aux-k8s-services/etherpad: apply 2456963 wikitext text/x-wiki ai24vzkj8wfhppamgelwco2qts8mpwn 2456964 2456963 2026-09-14T12:42:27Z Stashbot 7414 oblivian@deploy1003: helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. 2456964 wikitext text/x-wiki 3vo9d2qr0svxxjk8lsbn8apv1hj0w4s 2456965 2456964 2026-09-14T12:44:17Z Stashbot 7414 ladsgroup@deploy1003: helmfile [staging] START helmfile.d/services/thumbor: apply 2456965 wikitext text/x-wiki 29a7sqe3jpqlduaxileb81a9v6tz2pe 2456966 2456965 2026-09-14T12:44:35Z Stashbot 7414 ladsgroup@deploy1003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2456966 wikitext text/x-wiki 3wdj4jjt0nvuvgtb12aa7gsreq5uxmt 2456967 2456966 2026-09-14T12:47:54Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/aux-k8s-services/etherpad: apply 2456967 wikitext text/x-wiki 3b5451tr13rfxl81flbg3wqh6f5c5xq 2456968 2456967 2026-09-14T12:48:06Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] START helmfile.d/services/thumbor: apply 2456968 wikitext text/x-wiki rqg3yfg24c1wnmxidrqldeakx4lyldh 2456969 2456968 2026-09-14T12:49:36Z Stashbot 7414 ladsgroup@deploy1003: helmfile [codfw] DONE helmfile.d/services/thumbor: apply 2456969 wikitext text/x-wiki fyfseah79gcfdx9zq3rdonltu9lym7x 2456971 2456969 2026-09-14T12:52:22Z Stashbot 7414 ladsgroup@deploy1003: helmfile [eqiad] START helmfile.d/services/thumbor: apply 2456971 wikitext text/x-wiki e1g919bv6z3k5zr9ydbyqmylgik0v51 2456972 2456971 2026-09-14T12:54:22Z Stashbot 7414 ladsgroup@deploy1003: helmfile [eqiad] DONE helmfile.d/services/thumbor: apply 2456972 wikitext text/x-wiki 6gj9ca9oshst890ryaze678qhzjednf 2456973 2456972 2026-09-14T12:58:06Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/aux-k8s-services/etherpad: apply 2456973 wikitext text/x-wiki rsgaqve3ebu3qm58p05g6fs3l6vbwm8 2456974 2456973 2026-09-14T12:58:57Z Stashbot 7414 moritzm: update Trixie installer image to 13.7 T437715 2456974 wikitext text/x-wiki awjwldh85bhdyzhxx72f5hiykwflls5 2456975 2456974 2026-09-14T13:04:15Z Stashbot 7414 jmm@dns1004: START - running authdns-update 2456975 wikitext text/x-wiki 8un9t642tem86310iskkz6l02lboq0t 2456976 2456975 2026-09-14T13:06:29Z Stashbot 7414 jmm@dns1004: END - running authdns-update 2456976 wikitext text/x-wiki fd1hgg37cfp0d695bpbbptjstd2n37p 2456977 2456976 2026-09-14T13:09:15Z Stashbot 7414 sukhe: sudo cumin "A:cp-text" "disable-puppet 'merging CR 1338134'" 2456977 wikitext text/x-wiki me3jzyzf04bvpbuxxtgv032iakp23wg 2456978 2456977 2026-09-14T13:14:10Z Stashbot 7414 moritzm: installing Bird security updates 2456978 wikitext text/x-wiki 8witu7lxg27c1jg0qfobjhffovogcep 2456979 2456978 2026-09-14T13:17:33Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.hosts.reboot-single for host cumin1003.eqiad.wmnet 2456979 wikitext text/x-wiki mi72ycle29tkkk6mreeoa174x3136iv 2456981 2456979 2026-09-14T13:19:10Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/aux-k8s-services/etherpad: apply 2456981 wikitext text/x-wiki byacxur4taize7x2ofx09ffvt9boe47 2456982 2456981 2026-09-14T13:20:57Z Stashbot 7414 sukhe: sudo cumin -b11 "A:cp-text" "run-puppet-agent --enable 'merging CR 1338134'"T425441 2456982 wikitext text/x-wiki l4tmnxnxhdl7ntxlaorznlormrjp2na 2456983 2456982 2026-09-14T13:21:00Z Stashbot 7414 sukhe: sudo cumin -b11 "A:cp-text" "run-puppet-agent --enable 'merging CR 1338134'" T425441 2456983 wikitext text/x-wiki fetpqzgqeok42d10au0o164gpk7h3u8 2456984 2456983 2026-09-14T13:23:14Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host cumin1003.eqiad.wmnet 2456984 wikitext text/x-wiki 0jmacvchgje4uiebn4pou4cva8yvbyw 2456985 2456984 2026-09-14T13:29:16Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/aux-k8s-services/etherpad: apply 2456985 wikitext text/x-wiki ietgm27937p9fn2v2umib2z9k4jda8n 2456986 2456985 2026-09-14T13:32:04Z Stashbot 7414 oblivian@deploy1003: helmfile [eqiad] START helmfile.d/admin 'apply'. 2456986 wikitext text/x-wiki dr1hctlw7o0mor9wv6opu513tmnjtrt 2456987 2456986 2026-09-14T13:32:09Z Stashbot 7414 oblivian@deploy1003: helmfile [eqiad] DONE helmfile.d/admin 'apply'. 2456987 wikitext text/x-wiki sxj0yxdqtqv1llrd102uax7q1qbnvat 2456988 2456987 2026-09-14T13:32:17Z Stashbot 7414 oblivian@deploy1003: helmfile [codfw] START helmfile.d/admin 'apply'. 2456988 wikitext text/x-wiki eber0drozlu990a229n381f2qsvueet 2456989 2456988 2026-09-14T13:32:28Z Stashbot 7414 oblivian@deploy1003: helmfile [codfw] DONE helmfile.d/admin 'apply'. 2456989 wikitext text/x-wiki 2veib67dvxzhstbcspq113tq52o33kp 2456990 2456989 2026-09-14T13:32:38Z Stashbot 7414 oblivian@deploy1003: helmfile [staging-eqiad] START helmfile.d/admin 'apply'. 2456990 wikitext text/x-wiki ez5wsqjy1mzvisyxhc9poaixh2zvbmx 2456991 2456990 2026-09-14T13:32:44Z Stashbot 7414 oblivian@deploy1003: helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. 2456991 wikitext text/x-wiki eqf89cmcxn9w5sf7gsu8deu8hif5lrt 2456992 2456991 2026-09-14T13:32:54Z Stashbot 7414 oblivian@deploy1003: helmfile [staging-codfw] START helmfile.d/admin 'apply'. 2456992 wikitext text/x-wiki orq1boviaztrdpjunqdwcytfyq7equf 2456993 2456992 2026-09-14T13:33:08Z Stashbot 7414 oblivian@deploy1003: helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. 2456993 wikitext text/x-wiki cz1gt28md4x24x4rpj7f1cy5xfrj4hv 2456994 2456993 2026-09-14T13:33:16Z Stashbot 7414 oblivian@deploy1003: helmfile [ml-serve-eqiad] START helmfile.d/admin 'apply'. 2456994 wikitext text/x-wiki jfssz3r52l7nnrfrwips97hj80dbw1i 2456995 2456994 2026-09-14T13:33:23Z Stashbot 7414 oblivian@deploy1003: helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'apply'. 2456995 wikitext text/x-wiki fie8prdkeb21x9lhh3yaygsvfjcnu4u 2456996 2456995 2026-09-14T13:33:31Z Stashbot 7414 oblivian@deploy1003: helmfile [ml-serve-codfw] START helmfile.d/admin 'apply'. 2456996 wikitext text/x-wiki eb3cymrujgcmf3g59f1b5tej5vqwtjv 2456997 2456996 2026-09-14T13:33:47Z Stashbot 7414 oblivian@deploy1003: helmfile [ml-serve-codfw] DONE helmfile.d/admin 'apply'. 2456997 wikitext text/x-wiki n3qixlkhl9zkzli6iziom8145thip97 2456998 2456997 2026-09-14T13:33:55Z Stashbot 7414 oblivian@deploy1003: helmfile [ml-staging-codfw] START helmfile.d/admin 'apply'. 2456998 wikitext text/x-wiki 1i5o2gfo966esk423j333vbyum1b75z 2456999 2456998 2026-09-14T13:34:10Z Stashbot 7414 oblivian@deploy1003: helmfile [ml-staging-codfw] DONE helmfile.d/admin 'apply'. 2456999 wikitext text/x-wiki fasd96nnrl3z2lig3zm1t670hvg35ht 2457000 2456999 2026-09-14T13:34:19Z Stashbot 7414 oblivian@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. 2457000 wikitext text/x-wiki cuijbc3cr1k1d78ou8571yqs65y5h2x 2457001 2457000 2026-09-14T13:34:28Z Stashbot 7414 oblivian@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2457001 wikitext text/x-wiki 160ai1y8ivw82btgllbuwqmukcsvnrd 2457002 2457001 2026-09-14T13:34:36Z Stashbot 7414 oblivian@deploy1003: helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. 2457002 wikitext text/x-wiki 2ez2rz3u77u3h6uk8ipoqdeq7q2zeta 2457003 2457002 2026-09-14T13:34:50Z Stashbot 7414 oblivian@deploy1003: helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. 2457003 wikitext text/x-wiki 7exoklsekuj9mwx3cde2rsvgbhwkeqv 2457004 2457003 2026-09-14T13:34:54Z Stashbot 7414 jayme@deploy1003: helmfile [staging-eqiad] START helmfile.d/admin 'apply'. 2457004 wikitext text/x-wiki kksk43dkf68yl8f1afi958e4c47le4n 2457005 2457004 2026-09-14T13:34:58Z Stashbot 7414 oblivian@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/admin 'apply'. 2457005 wikitext text/x-wiki 97jwjoh9ie7i1t9maburiqvlh9pxhcs 2457006 2457005 2026-09-14T13:35:04Z Stashbot 7414 oblivian@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/admin 'apply'. 2457006 wikitext text/x-wiki 6r299b0da6myisgdamnwmh8378ij6kh 2457007 2457006 2026-09-14T13:35:15Z Stashbot 7414 oblivian@deploy1003: helmfile [aux-k8s-codfw] START helmfile.d/admin 'apply'. 2457007 wikitext text/x-wiki k1pfliptcmtlcurh1zckldtf7m9oalu 2457008 2457007 2026-09-14T13:35:16Z Stashbot 7414 jayme@deploy1003: helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. 2457008 wikitext text/x-wiki 6glubtm0smyhmv6j0uhsseonpkn8reg 2457009 2457008 2026-09-14T13:35:25Z Stashbot 7414 oblivian@deploy1003: helmfile [aux-k8s-codfw] DONE helmfile.d/admin 'apply'. 2457009 wikitext text/x-wiki 34b6op6ygx67fpe36bujngu7h30n322 2457010 2457009 2026-09-14T13:36:28Z Stashbot 7414 jayme@deploy1003: helmfile [codfw] START helmfile.d/admin 'apply'. 2457010 wikitext text/x-wiki 8ntflj1mifz3vfu98dxjosb8o9s1rfj 2457011 2457010 2026-09-14T13:36:54Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/aux-k8s-services/etherpad: apply 2457011 wikitext text/x-wiki 52gav7efxotxi1321ihw583prqvmpu8 2457012 2457011 2026-09-14T13:37:00Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/aux-k8s-services/etherpad: apply 2457012 wikitext text/x-wiki 8j36cj832lhnqla9gkyd0txd0ugh5bv 2457013 2457012 2026-09-14T13:37:57Z Stashbot 7414 jayme@deploy1003: helmfile [codfw] DONE helmfile.d/admin 'apply'. 2457013 wikitext text/x-wiki 0v9yxk7n9vb2b3ke50nuy924srx9dst 2457014 2457013 2026-09-14T13:38:13Z Stashbot 7414 jayme@deploy1003: helmfile [eqiad] START helmfile.d/admin 'apply'. 2457014 wikitext text/x-wiki 2g597iivdq0bfoexyvb6zjro5hzz5f5 2457015 2457014 2026-09-14T13:38:26Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/aux-k8s-services/etherpad: apply 2457015 wikitext text/x-wiki gbilkpuioefd87h61hqhux8z4o2oc20 2457016 2457015 2026-09-14T13:38:27Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/aux-k8s-services/etherpad: apply 2457016 wikitext text/x-wiki a8kjwlfl59hs2jckbc8doens40zhb7a 2457017 2457016 2026-09-14T13:38:34Z Stashbot 7414 jayme@deploy1003: helmfile [eqiad] DONE helmfile.d/admin 'apply'. 2457017 wikitext text/x-wiki pg8jjosmk6oh27fea1ab77jurt6hf3w 2457018 2457017 2026-09-14T13:39:03Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-staging-codfw] 'sync' command on namespace 'tts-section-generator' for release 'main' . 2457018 wikitext text/x-wiki lzw3lfszcc1pbvt1504ycrnjvuvzp8c 2457019 2457018 2026-09-14T13:39:21Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/aux-k8s-services/etherpad: apply 2457019 wikitext text/x-wiki m240xyd660esb4f99n2rozh9yhir55f 2457020 2457019 2026-09-14T13:39:22Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/aux-k8s-services/etherpad: apply 2457020 wikitext text/x-wiki g89a4uzj09syffcjfza5k4al9n505to 2457021 2457020 2026-09-14T13:40:01Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/aux-k8s-services/etherpad: apply 2457021 wikitext text/x-wiki 3rj0faq51mgyc8vk86blf7ke4hg7pe3 2457022 2457021 2026-09-14T13:40:07Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/aux-k8s-services/etherpad: apply 2457022 wikitext text/x-wiki py3j1pqhvh8pnlex27vgas35kv3zy6f 2457023 2457022 2026-09-14T13:40:43Z Stashbot 7414 eevans@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on sessionstore1004.eqiad.wmnet with reason: Firmware upgrades — T437516 2457023 wikitext text/x-wiki 0rtux0a6eafcu992cbuk1zjpx8kw9j2 2457024 2457023 2026-09-14T13:40:59Z Stashbot 7414 eevans@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts sessionstore1004.eqiad.wmnet 2457024 wikitext text/x-wiki f5cvi32s56dlkjjhxeu295n3vk5taz5 2457025 2457024 2026-09-14T13:42:48Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/aux-k8s-services/etherpad: apply 2457025 wikitext text/x-wiki oc5wyhmenueghi6yt4f1revr1332kov 2457026 2457025 2026-09-14T13:43:47Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-serve-eqiad] 'sync' command on namespace 'tts-section-generator' for release 'main' . 2457026 wikitext text/x-wiki 0qm5bxd0tgje73rgvbppyed3ui2cjxk 2457027 2457026 2026-09-14T13:44:57Z Stashbot 7414 kevinbazira@deploy1003: helmfile [ml-serve-codfw] 'sync' command on namespace 'tts-section-generator' for release 'main' . 2457027 wikitext text/x-wiki 8plj0bpp8bnhaim7lbzrwxpl3i3qoq4 2457028 2457027 2026-09-14T13:52:53Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/aux-k8s-services/etherpad: apply 2457028 wikitext text/x-wiki fi2zyedz7qeno00llojmyxp5vj8f33a 2457029 2457028 2026-09-14T13:54:21Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/aux-k8s-services/etherpad: apply 2457029 wikitext text/x-wiki h3nq5wa9pni9hit1milez5s8ylcaoo2 2457031 2457029 2026-09-14T13:56:26Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/aux-k8s-services/etherpad: apply 2457031 wikitext text/x-wiki omjv0ehcuz0hvu59kzza84f1ge3wp9v 2457032 2457031 2026-09-14T14:00:15Z Stashbot 7414 javiermonton@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich: apply 2457032 wikitext text/x-wiki hofc4mfgz7se71z697ht3tg5eyfl4zk 2457033 2457032 2026-09-14T14:00:24Z Stashbot 7414 javiermonton@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/mw-page-html-content-change-enrich: apply 2457033 wikitext text/x-wiki 657v5t79rcdizpkmbnymuug14hxq78l 2457034 2457033 2026-09-14T14:00:55Z Stashbot 7414 eevans@cumin1004: START - Cookbook sre.hosts.reboot-single for host sessionstore1004.eqiad.wmnet 2457034 wikitext text/x-wiki k55wklsogiim6ejvzoy51ty7d4jgaif 2457035 2457034 2026-09-14T14:05:17Z Stashbot 7414 moritzm: kick off a rebuild of base images on build2004 2457035 wikitext text/x-wiki 97y5umj9fb0ofmywbuny9d3jviw4jid 2457036 2457035 2026-09-14T14:05:32Z Stashbot 7414 moritzm: kick off a rebuild of base images on build2004 2457036 wikitext text/x-wiki qjlrooqbty8t3nucjx9ehirt9otyrpa 2457037 2457036 2026-09-14T14:13:01Z Stashbot 7414 eevans@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sessionstore1004.eqiad.wmnet 2457037 wikitext text/x-wiki 0jmxiz8jn1vaxf2cd1fw4kle404pli9 2457038 2457037 2026-09-14T14:13:02Z Stashbot 7414 eevans@cumin1004: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts sessionstore1004.eqiad.wmnet 2457038 wikitext text/x-wiki mq5csinglhx6kng0n4nqu0s6znrj7g0 2457039 2457038 2026-09-14T14:13:35Z Stashbot 7414 eevans@cumin1004: START - Cookbook sre.hosts.provision for host sessionstore1004.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2457039 wikitext text/x-wiki b1ru1z223v0dpglyyn2hebzltj9hlru 2457040 2457039 2026-09-14T14:14:13Z Stashbot 7414 eevans@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sessionstore1004.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2457040 wikitext text/x-wiki 4uj23ivsj5qjq3szzefzqz57813x8do 2457041 2457040 2026-09-14T14:15:41Z Stashbot 7414 eevans@cumin1004: START - Cookbook sre.hosts.reimage for host sessionstore1004.eqiad.wmnet with OS bookworm 2457041 wikitext text/x-wiki hzwozisg4kenaffeiftzljdhyaiv57y 2457044 2457041 2026-09-14T14:30:56Z Stashbot 7414 marostegui@dns1004: START - running authdns-update 2457044 wikitext text/x-wiki 8r3bi4go8agw3oqz5b1pntt2ei75oqg 2457045 2457044 2026-09-14T14:32:55Z Stashbot 7414 eevans@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on sessionstore1004.eqiad.wmnet with reason: host reimage 2457045 wikitext text/x-wiki ca9bp1glm1gkh6r5wqytwxiiq1e61sf 2457046 2457045 2026-09-14T14:33:09Z Stashbot 7414 marostegui@dns1004: END - running authdns-update 2457046 wikitext text/x-wiki nu18j04mnioo0h1yuah1v2e1vssdm26 2457048 2457046 2026-09-14T14:38:33Z Stashbot 7414 eevans@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sessionstore1004.eqiad.wmnet with reason: host reimage 2457048 wikitext text/x-wiki f7ddn8mme1rsse8ozgvqslgrmqvgye1 2457049 2457048 2026-09-14T14:59:16Z Stashbot 7414 eevans@cumin1004: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sessionstore1004.eqiad.wmnet with OS bookworm 2457049 wikitext text/x-wiki 7y5lkr7r6ojjs5fxuyhgxq9vjxu99gl 2457051 2457049 2026-09-14T15:06:39Z Stashbot 7414 eevans@cumin1004: START - Cookbook sre.hosts.reboot-single for host sessionstore1004.eqiad.wmnet 2457051 wikitext text/x-wiki azrwx4ooptp988dof5n75ppuivqy1ar 2457052 2457051 2026-09-14T15:13:17Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Started scap sync-world: Backport for [[gerrit:1338902|afwiki: Create Draft and Draft talk namespaces (T437576)]] 2457052 wikitext text/x-wiki 5sx3r7l5kcuvmkrs3zx4kyr9pnp4oqa 2457053 2457052 2026-09-14T15:13:40Z Stashbot 7414 eevans@cumin1004: END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host sessionstore1004.eqiad.wmnet 2457053 wikitext text/x-wiki crpw3m9rfpu7ps4sdw7aeqfrylffdls 2457054 2457053 2026-09-14T15:17:32Z Stashbot 7414 eevans@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on sessionstore1005.eqiad.wmnet with reason: Firmware upgrades — T437516 2457054 wikitext text/x-wiki fbt7csugpiu584ou9f8gplvf8bxa4w6 2457055 2457054 2026-09-14T15:17:35Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: lucaswerkmeister-wmde, tryvix1509: Backport for [[gerrit:1338902|afwiki: Create Draft and Draft talk namespaces (T437576)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2457055 wikitext text/x-wiki dy3o2u4dho3qrhas6qeti03zy58k8qf 2457056 2457055 2026-09-14T15:17:45Z Stashbot 7414 eevans@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts sessionstore1005.eqiad.wmnet 2457056 wikitext text/x-wiki dked2zxk7wyvl704fej8qs6tp4vn0xb 2457057 2457056 2026-09-14T15:20:55Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2457057 wikitext text/x-wiki cuiyxc0avdct7dv6o5188mfis1m2nmi 2457059 2457057 2026-09-14T15:21:20Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply 2457059 wikitext text/x-wiki stxeph8vlr59zd3lsuqiqd8zrc7mcg7 2457060 2457059 2026-09-14T15:21:53Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: lucaswerkmeister-wmde, tryvix1509: Continuing with deployment 2457060 wikitext text/x-wiki ppum631lsbciwdfksnvufi4qvrj72up 2457062 2457060 2026-09-14T15:22:37Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2457062 wikitext text/x-wiki gr9vpyxlzdo777mnwogbmabtbk2tud4 2457063 2457062 2026-09-14T15:23:19Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-analytics-test: apply 2457063 wikitext text/x-wiki gvzcdh7gxdn74nj6cvdcq74qpmeqrob 2457064 2457063 2026-09-14T15:24:27Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-experiment-platform: apply 2457064 wikitext text/x-wiki p0uqpxe1yg743ahj6o0y6bhb83t97wc 2457065 2457064 2026-09-14T15:24:59Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-experiment-platform: apply 2457065 wikitext text/x-wiki c5n40visxej5468glwvg70riuqfp5wa 2457066 2457065 2026-09-14T15:25:06Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-sre: apply 2457066 wikitext text/x-wiki eadgg5fbbfxr6p11hb116t43ykkp9uz 2457067 2457066 2026-09-14T15:25:38Z Stashbot 7414 atsuko@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-sre: apply 2457067 wikitext text/x-wiki oj3lqagm8yw8249h83z209nhpefntvb 2457068 2457067 2026-09-14T15:29:02Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Finished scap sync-world: Backport for [[gerrit:1338902|afwiki: Create Draft and Draft talk namespaces (T437576)]] (duration: 15m 44s) 2457068 wikitext text/x-wiki k61ayoz6hmgyn0encaiypcy1g1rufyn 2457069 2457068 2026-09-14T15:29:48Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: mwscript-k8s job started: namespaceDupes afwiki --fix # T437576 2457069 wikitext text/x-wiki h5py225ivat8e3v5ru921326rt33n0o 2457070 2457069 2026-09-14T15:32:28Z Stashbot 7414 eevans@cumin1004: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts sessionstore1005.eqiad.wmnet 2457070 wikitext text/x-wiki 1utmxqb6tv6qt7th56alm7crlvh6fq0 2457071 2457070 2026-09-14T15:33:39Z Stashbot 7414 eevans@cumin1004: START - Cookbook sre.hosts.provision for host sessionstore1005.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2457071 wikitext text/x-wiki tv6sn9fry187t6jahyswi770tablg4c 2457072 2457071 2026-09-14T15:33:48Z Stashbot 7414 elukey@dns1004: START - running authdns-update 2457072 wikitext text/x-wiki 92p1uw1md7882g2sv1x6pdsrbmwvgh4 2457073 2457072 2026-09-14T15:34:17Z Stashbot 7414 eevans@cumin1004: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sessionstore1005.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2457073 wikitext text/x-wiki m12hi2fxatxfzztecaas4aiiey6176m 2457074 2457073 2026-09-14T15:35:01Z Stashbot 7414 joal@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: apply 2457074 wikitext text/x-wiki lll4k7kgea2atr5rzztfvl19ucy7zju 2457076 2457074 2026-09-14T15:35:36Z Stashbot 7414 moritzm: installing shadow security updates 2457076 wikitext text/x-wiki tkphguo1hg5fnhyn40rrfjthlh3b5om 2457078 2457076 2026-09-14T15:35:58Z Stashbot 7414 joal@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: apply 2457078 wikitext text/x-wiki 3u0lbesxpci2hlxqdrrwe2p2ovlcl9b 2457079 2457078 2026-09-14T15:36:01Z Stashbot 7414 eevans@cumin1004: START - Cookbook sre.hosts.reimage for host sessionstore1005.eqiad.wmnet with OS bookworm 2457079 wikitext text/x-wiki n1d3b2vlsh9zl86pcpnjeeft6d6w1jh 2457080 2457079 2026-09-14T15:36:05Z Stashbot 7414 elukey@dns1004: END - running authdns-update 2457080 wikitext text/x-wiki eu6s1jhl9fogea8rwisuihh41hzotfr 2457081 2457080 2026-09-14T15:39:29Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Started scap sync-world: Backport for [[gerrit:1335401|Adjust extendedconfirmed calculation to first edit on viwiki (T437006)]], [[gerrit:1340505|core-Namespaces: Add AW and AWT alias for its talk in abstractwiki (T437772)]] 2457081 wikitext text/x-wiki b5vwnr8jj26rbsf4org21pjzwm70lrm 2457085 2457081 2026-09-14T15:43:33Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: bunnypranav, lucaswerkmeister-wmde, tryvix1509: Backport for [[gerrit:1335401|Adjust extendedconfirmed calculation to first edit on viwiki (T437006)]], [[gerrit:1340505|core-Namespaces: Add AW and AWT alias for its talk in abstractwiki (T437772)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2457085 wikitext text/x-wiki j6fgbp4ag6gbjr1f5fpou5dq7c9bzod 2457086 2457085 2026-09-14T15:45:22Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: bunnypranav, lucaswerkmeister-wmde, tryvix1509: Continuing with deployment 2457086 wikitext text/x-wiki aod26fdxf2ftymogjmicr2gkgdb9plx 2457087 2457086 2026-09-14T15:47:33Z Stashbot 7414 eevans@cumin1004: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host sessionstore1005.eqiad.wmnet with OS bookworm 2457087 wikitext text/x-wiki pd0rsnh0ohnfyuoajxix9gtj0d2bide 2457088 2457087 2026-09-14T15:48:16Z Stashbot 7414 eevans@cumin1004: START - Cookbook sre.hosts.reimage for host sessionstore1005.eqiad.wmnet with OS bookworm 2457088 wikitext text/x-wiki 78ws9thy3917knqhhznz4s3l8714ujh 2457089 2457088 2026-09-14T15:49:51Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: Finished scap sync-world: Backport for [[gerrit:1335401|Adjust extendedconfirmed calculation to first edit on viwiki (T437006)]], [[gerrit:1340505|core-Namespaces: Add AW and AWT alias for its talk in abstractwiki (T437772)]] (duration: 10m 23s) 2457089 wikitext text/x-wiki q78nax7n4oa2za6x4gnrvilqqso1fi7 2457090 2457089 2026-09-14T15:50:12Z Stashbot 7414 lucaswerkmeister-wmde@deploy1003: mwscript-k8s job started: namespaceDupes abstractwiki --fix # T437772 2457090 wikitext text/x-wiki o01qntqpkqa0d9u8pu8d4ptisdsnrmi 2457091 2457090 2026-09-14T15:53:34Z Stashbot 7414 Lucas_WMDE: UTC afternoon backport+config window belatedly done 2457091 wikitext text/x-wiki 84x92oonlkkm8ztixcf4nwj1byw7g0s 2457092 2457091 2026-09-14T16:05:28Z Stashbot 7414 Amir1: drop non-links tables from db2247 (T437278) 2457092 wikitext text/x-wiki mn0crrq45kz78z6ss20uovbcfiabq0t 2457093 2457092 2026-09-14T16:07:22Z Stashbot 7414 Amir1: drop links tables from db2240 (T437278) 2457093 wikitext text/x-wiki 2g36qrzjmwkhha16x3zr18pijn45wwa 2457094 2457093 2026-09-14T16:09:34Z Stashbot 7414 Amir1: drop links tables from db1252 (T437278) 2457094 wikitext text/x-wiki ea6xqtmvent0krfhi93ru9mu5wtjldf 2457099 2457094 2026-09-14T16:44:36Z Stashbot 7414 tgr@deploy1003: Started scap sync-world: Backport for [[gerrit:1330446|CommonSettings: Use a restrictive, eval-free CSP for auth.wikimedia.org (T419684)]] 2457099 wikitext text/x-wiki hslo1zzpo9b0j1emjt7otohipj1oqdk 2457100 2457099 2026-09-14T16:49:06Z Stashbot 7414 tgr@deploy1003: arendpieter, tgr: Backport for [[gerrit:1330446|CommonSettings: Use a restrictive, eval-free CSP for auth.wikimedia.org (T419684)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2457100 wikitext text/x-wiki fy21h6t60kf9cmdjwbd73a0nliqa2e0 2457101 2457100 2026-09-14T16:51:56Z Stashbot 7414 eevans@cumin1004: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host sessionstore1005.eqiad.wmnet with OS bookworm 2457101 wikitext text/x-wiki 9hh1h5mznb0ksjlbjtvl878opbw1bgb 2457102 2457101 2026-09-14T16:52:12Z Stashbot 7414 eevans@cumin1004: START - Cookbook sre.hosts.reimage for host sessionstore1005.eqiad.wmnet with OS bookworm 2457102 wikitext text/x-wiki lka3z5uuhhbtmzmhcpufkxowcxon5p6 2457104 2457102 2026-09-14T17:00:36Z Stashbot 7414 tgr@deploy1003: arendpieter, tgr: Rolling back deployment 2457104 wikitext text/x-wiki hg5vbs1y2cjqn7bdqekhcgmica789rk 2457111 2457104 2026-09-14T17:07:56Z Stashbot 7414 tgr@deploy1003: Finished scap sync-world: Backport for [[gerrit:1330446|CommonSettings: Use a restrictive, eval-free CSP for auth.wikimedia.org (T419684)]] (duration: 23m 19s) 2457111 wikitext text/x-wiki 9hih5xuq1wfy704u5n3edf9reske4v3 2457122 2457111 2026-09-14T17:48:09Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.provision for host sessionstore1005.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2457122 wikitext text/x-wiki spmpg0mzjnbryubtyh0h0d2pz5md80w 2457126 2457122 2026-09-14T18:01:22Z Stashbot 7414 jclark@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host sessionstore1005.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2457126 wikitext text/x-wiki cxpi6nd9wix5mn7c6lacy1dm0ghrzyu 2457132 2457126 2026-09-14T18:05:13Z Stashbot 7414 samtar@deploy1003: Started scap sync-world: Backport for [[gerrit:1337611|extension-list: Add ModeratorToolkit (T431000)]] 2457132 wikitext text/x-wiki duzpfcwdv0bo0d80tl9w7lhy21qo6qo 2457134 2457132 2026-09-14T18:06:01Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.reimage for host sessionstore1005.eqiad.wmnet with OS bookworm 2457134 wikitext text/x-wiki mfr0ayxqsgmfb149ezv78vpzie5bc8a 2457136 2457134 2026-09-14T18:09:18Z Stashbot 7414 samtar@deploy1003: samtar: Backport for [[gerrit:1337611|extension-list: Add ModeratorToolkit (T431000)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2457136 wikitext text/x-wiki 0puzoildufed47mr3w01bnm25eo82zu 2457137 2457136 2026-09-14T18:10:09Z Stashbot 7414 samtar@deploy1003: samtar: Continuing with deployment 2457137 wikitext text/x-wiki aheze27qsml866y9v2i1fhppt3mqjpt 2457138 2457137 2026-09-14T18:14:48Z Stashbot 7414 samtar@deploy1003: Finished scap sync-world: Backport for [[gerrit:1337611|extension-list: Add ModeratorToolkit (T431000)]] (duration: 09m 34s) 2457138 wikitext text/x-wiki 0ibiw04tt2r8dqgdutyrel2z3yujb5t 2457140 2457138 2026-09-14T18:17:51Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.provision for host sessionstore1005.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2457140 wikitext text/x-wiki k0sr3ekrazg2fs65undkv4i3k2x29dn 2457144 2457140 2026-09-14T18:25:26Z Stashbot 7414 root@cumin2003: START - Cookbook sre.network.tls for network device lsw1-d2-eqiad 2457144 wikitext text/x-wiki ea3eskeii82rcfdiso7x5utpb9gyxv9 2457145 2457144 2026-09-14T18:25:27Z Stashbot 7414 root@cumin2003: END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-d2-eqiad 2457145 wikitext text/x-wiki quxz6qnmmwlhtzhwiiaabjbi62vttv9 2457146 2457145 2026-09-14T18:25:48Z Stashbot 7414 brett@cumin2003: START - Cookbook sre.network.tls for network device lsw1-d4-eqiad 2457146 wikitext text/x-wiki o09yikxw93ecdz2zc5en4oowzwjmg13 2457147 2457146 2026-09-14T18:25:50Z Stashbot 7414 brett@cumin2003: END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-d4-eqiad 2457147 wikitext text/x-wiki 0dg938q7w09fn3skqfpeanqxntgujwh 2457148 2457147 2026-09-14T18:26:06Z Stashbot 7414 brett@cumin2003: START - Cookbook sre.network.tls for network device ssw1-d8-eqiad 2457148 wikitext text/x-wiki n7zgr06v6w4ii826785s49xdm4jame0 2457149 2457148 2026-09-14T18:26:08Z Stashbot 7414 brett@cumin2003: END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device ssw1-d8-eqiad 2457149 wikitext text/x-wiki rwcicmwnfjeykcuz58hds6ujopcehnu 2457150 2457149 2026-09-14T18:26:13Z Stashbot 7414 brett@cumin2003: START - Cookbook sre.network.tls for network device lsw1-d6-eqiad 2457150 wikitext text/x-wiki pk80o3yvftaoi7ox8smaz53b4hl8d9s 2457151 2457150 2026-09-14T18:26:14Z Stashbot 7414 brett@cumin2003: END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-d6-eqiad 2457151 wikitext text/x-wiki 81dhztz3v3e3e0csinms9eieql211bq 2457159 2457151 2026-09-14T18:49:59Z Stashbot 7414 eevans@cumin1004: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sessionstore1005.eqiad.wmnet with OS bookworm 2457159 wikitext text/x-wiki tkhpkydi4czxrxgca6p0nguvqlo6ibc 2457160 2457159 2026-09-14T18:50:06Z Stashbot 7414 jclark@cumin1003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sessionstore1005.eqiad.wmnet with OS bookworm 2457160 wikitext text/x-wiki 5u975lkrt7hmuawnssmz3zg7kq8e3gw 2457161 2457160 2026-09-14T18:50:21Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.reimage for host sessionstore1005.eqiad.wmnet with OS bookworm 2457161 wikitext text/x-wiki 42xnfr7z4hzt4prv1x01y9h90y50ijt 2457163 2457161 2026-09-14T18:53:12Z Stashbot 7414 jclark@cumin1003: END (FAIL) - Cookbook sre.hosts.provision (exit_code=99) for host sessionstore1005.mgmt.eqiad.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL 2457163 wikitext text/x-wiki ti082a8qsj7qc9ypikjwre0zli8zkom 2457167 2457163 2026-09-14T19:04:37Z Stashbot 7414 musikanimal@deploy1003: Started scap sync-world: Backport for [[gerrit:1341273|[CodeMirror] enable for new users (enwiki), new VE integration (global) (T288161 T432558)]] 2457167 wikitext text/x-wiki 2dr2t9anml7rtwsshjn0p2wqvz580o7 2457168 2457167 2026-09-14T19:22:19Z Stashbot 7414 musikanimal@deploy1003: musikanimal: Backport for [[gerrit:1341273|[CodeMirror] enable for new users (enwiki), new VE integration (global) (T288161 T432558)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2457168 wikitext text/x-wiki 1ffuyodnh5o8e6hdxb9cvujxqmhjckj 2457169 2457168 2026-09-14T19:26:02Z Stashbot 7414 musikanimal@deploy1003: musikanimal: Continuing with deployment 2457169 wikitext text/x-wiki 54h2tg5b3y37weshi17gwssx00un2sc 2457171 2457169 2026-09-14T19:38:29Z Stashbot 7414 musikanimal@deploy1003: Finished scap sync-world: Backport for [[gerrit:1341273|[CodeMirror] enable for new users (enwiki), new VE integration (global) (T288161 T432558)]] (duration: 33m 51s) 2457171 wikitext text/x-wiki 19yotdeyxplzwh77uit8uzpo7q98q7e 2457175 2457171 2026-09-14T19:54:34Z Stashbot 7414 eevans@cumin1004: START - Cookbook sre.hosts.reimage for host sessionstore1005.eqiad.wmnet with OS bookworm 2457175 wikitext text/x-wiki dmvf3hh9lqbf7w7q79h4vn8eqwdwizd 2457177 2457175 2026-09-14T19:55:19Z Stashbot 7414 dzahn@dns1005: START - running authdns-update 2457177 wikitext text/x-wiki pmmxwbpk0wu3dmy7ujqrfsmf0uztyj5 2457178 2457177 2026-09-14T19:55:20Z Stashbot 7414 eevans@cumin1004: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host sessionstore1005.eqiad.wmnet with OS bookworm 2457178 wikitext text/x-wiki e6arhlr533gcccsejeclrg33ky5ssfd 2457179 2457178 2026-09-14T19:57:37Z Stashbot 7414 dzahn@dns1005: END - running authdns-update 2457179 wikitext text/x-wiki fq5i4as6fd9b1eczfuowl7t16cigtwy 2457180 2457179 2026-09-14T19:58:16Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.dns.netbox 2457180 wikitext text/x-wiki n9jb919mp563jqtmw2hmolx31ompu9n 2457181 2457180 2026-09-14T19:59:10Z Stashbot 7414 eevans@cumin1004: START - Cookbook sre.hosts.reimage for host sessionstore1005.eqiad.wmnet with OS bookworm 2457181 wikitext text/x-wiki c73ws6cehcbfclasyb9r1p8exu0b30r 2457182 2457181 2026-09-14T20:02:04Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [ms-be1098] - vriley@cumin1003" 2457182 wikitext text/x-wiki 8p7bk47tnfk0x4tkgkqf43gfqsodlv0 2457183 2457182 2026-09-14T20:02:08Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: update mgmt [ms-be1098] - vriley@cumin1003" 2457183 wikitext text/x-wiki 66952ts4xrwzokvq2aj5kgdz1m5cn09 2457184 2457183 2026-09-14T20:02:10Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2457184 wikitext text/x-wiki ifig9ps9rfyo39qyu54u193bqj5ybiq 2457185 2457184 2026-09-14T20:02:33Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.network.configure-switch-interfaces for host ms-be1098 2457185 wikitext text/x-wiki rx9d81fmct4555sfgjuw1k1gca4796g 2457186 2457185 2026-09-14T20:03:04Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host ms-be1098 2457186 wikitext text/x-wiki av3007eilhw7wy2s021jli2gm2k29iy 2457187 2457186 2026-09-14T20:04:26Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.provision for host ms-be1098.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2457187 wikitext text/x-wiki efslqn49rng8ovb8m9z6y4hyi2xzxdm 2457188 2457187 2026-09-14T20:06:57Z Stashbot 7414 jforrester@deploy1003: Started scap sync-world: Backport for [[gerrit:1339811|wmf-config: Register content/v2-beta REST module as disabled (T432798)]], [[gerrit:1338274|wikifunctions: Move abstract fragments to mainstash (T432849)]] 2457188 wikitext text/x-wiki 364c1d5kziw0k4bqvclf5f7q5n30vd0 2457190 2457188 2026-09-14T20:08:08Z Stashbot 7414 vriley@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be1098.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2457190 wikitext text/x-wiki 33of5kzh26ltcreius5ptg0omhz4jd4 2457191 2457190 2026-09-14T20:09:15Z Stashbot 7414 vriley@cumin1003: START - Cookbook sre.hosts.reimage for host ms-be1098.eqiad.wmnet with OS bullseye 2457191 wikitext text/x-wiki i3na9b8a55wd4plj8oa65lia73g36sx 2457192 2457191 2026-09-14T20:24:22Z Stashbot 7414 jforrester@deploy1003: jforrester, aghirelli: Backport for [[gerrit:1339811|wmf-config: Register content/v2-beta REST module as disabled (T432798)]], [[gerrit:1338274|wikifunctions: Move abstract fragments to mainstash (T432849)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2457192 wikitext text/x-wiki f74akh3fits5mwljgm6hcxcqo8vnkvv 2457193 2457192 2026-09-14T20:25:20Z Stashbot 7414 jforrester@deploy1003: jforrester, aghirelli: Continuing with deployment 2457193 wikitext text/x-wiki 8j22jpkrc16hnhaffrg744b0k5tc3r5 2457194 2457193 2026-09-14T20:27:17Z Stashbot 7414 ssastry@deploy1003: helmfile [eqiad] START helmfile.d/services/mw-parsoid: apply 2457194 wikitext text/x-wiki ek084fgi8xv8a6xx9f6wuvcpm8hibn8 2457195 2457194 2026-09-14T20:27:52Z Stashbot 7414 ssastry@deploy1003: helmfile [eqiad] DONE helmfile.d/services/mw-parsoid: apply 2457195 wikitext text/x-wiki s34uzfbs67y3jkev8r17q1vz7kposlj 2457196 2457195 2026-09-14T20:27:53Z Stashbot 7414 ssastry@deploy1003: helmfile [codfw] START helmfile.d/services/mw-parsoid: apply 2457196 wikitext text/x-wiki fisptf9mdhnetj3ceqgvchnrov4fedz 2457197 2457196 2026-09-14T20:28:31Z Stashbot 7414 ssastry@deploy1003: helmfile [codfw] DONE helmfile.d/services/mw-parsoid: apply 2457197 wikitext text/x-wiki ju469zp35v5jub8fzg4rbt2gcut8n48 2457199 2457197 2026-09-14T20:32:16Z Stashbot 7414 jforrester@deploy1003: Finished scap sync-world: Backport for [[gerrit:1339811|wmf-config: Register content/v2-beta REST module as disabled (T432798)]], [[gerrit:1338274|wikifunctions: Move abstract fragments to mainstash (T432849)]] (duration: 25m 21s) 2457199 wikitext text/x-wiki 7pm6ijy0u7z024epe0da46y1qrkv6dv 2457200 2457199 2026-09-14T20:35:00Z Stashbot 7414 aude@deploy1003: Started scap sync-world: Backport for [[gerrit:1341278|[A11y] Add list semantics to ReadingList page (T435864 T434923)]] 2457200 wikitext text/x-wiki f82j5wpqewo1hwuvv9dnyea831pju8k 2457201 2457200 2026-09-14T20:39:15Z Stashbot 7414 aude@deploy1003: aude, jdlrobson: Backport for [[gerrit:1341278|[A11y] Add list semantics to ReadingList page (T435864 T434923)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2457201 wikitext text/x-wiki 56mdl12iubhslz5tz21t80nkgp1p30x 2457204 2457201 2026-09-14T20:43:19Z Stashbot 7414 aude@deploy1003: aude, jdlrobson: Continuing with deployment 2457204 wikitext text/x-wiki 5mu0e6bjugvyb3j2tsaanh9oat6xb2e 2457205 2457204 2026-09-14T20:47:49Z Stashbot 7414 aude@deploy1003: Finished scap sync-world: Backport for [[gerrit:1341278|[A11y] Add list semantics to ReadingList page (T435864 T434923)]] (duration: 12m 49s) 2457205 wikitext text/x-wiki 1noovr3fvnmbievuwinxcg01htxkbnz 2457206 2457205 2026-09-14T20:54:37Z Stashbot 7414 aude@deploy1003: Started scap sync-world: Backport for [[gerrit:1338999|Enable ReadingLists for all logged-in users on English Wikipedia (T434923)]], [[gerrit:1340004|Enable Reading Recommendations experiment on test wiki (T437665)]] 2457206 wikitext text/x-wiki 0zsdlbc2hjk20s1nimpptclmpvpi5gq 2457207 2457206 2026-09-14T20:58:37Z Stashbot 7414 aude@deploy1003: aude, jdlrobson: Backport for [[gerrit:1338999|Enable ReadingLists for all logged-in users on English Wikipedia (T434923)]], [[gerrit:1340004|Enable Reading Recommendations experiment on test wiki (T437665)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2457207 wikitext text/x-wiki e3ceycsr7yvasxgahl4hcn5xtx6wo0e 2457208 2457207 2026-09-14T21:00:57Z Stashbot 7414 aude@deploy1003: aude, jdlrobson: Continuing with deployment 2457208 wikitext text/x-wiki tnpjhyert92rytjvhwcsj7hawdcenr6 2457209 2457208 2026-09-14T21:05:41Z Stashbot 7414 aude@deploy1003: Finished scap sync-world: Backport for [[gerrit:1338999|Enable ReadingLists for all logged-in users on English Wikipedia (T434923)]], [[gerrit:1340004|Enable Reading Recommendations experiment on test wiki (T437665)]] (duration: 11m 03s) 2457209 wikitext text/x-wiki r4qomcz6ag1wdtpg9trlmv3xcg42c77 2457210 2457209 2026-09-14T21:26:32Z Stashbot 7414 eevans@cumin1004: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sessionstore1005.eqiad.wmnet with OS bookworm 2457210 wikitext text/x-wiki lcioydytbgs3wnxhxb1m3kclnlmg329 2457211 2457210 2026-09-14T21:26:47Z Stashbot 7414 eevans@cumin1004: START - Cookbook sre.hosts.reimage for host sessionstore1005.eqiad.wmnet with OS bookworm 2457211 wikitext text/x-wiki 69kdy6t99k3r39k7ivzlw7h05kon6uf 2457212 2457211 2026-09-14T21:29:03Z Stashbot 7414 sbassett: Deployed security fix for T434372 2457212 wikitext text/x-wiki g5nqfq2tknxqh8lpuoouqy5b51vrc9r 2457213 2457212 2026-09-14T21:29:26Z Stashbot 7414 vriley@cumin1003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ms-be1098.eqiad.wmnet with OS bullseye 2457213 wikitext text/x-wiki amauhhnxg77n6ocpe733u1m3ah0izy7 2457214 2457213 2026-09-14T21:43:03Z Stashbot 7414 sbassett: Deployed security fix for T435623 2457214 wikitext text/x-wiki blbhqcd033stl6v4tfgurz5nm9hy21w 2457221 2457214 2026-09-14T22:22:17Z Stashbot 7414 eevans@cumin1004: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sessionstore1005.eqiad.wmnet with OS bookworm 2457221 wikitext text/x-wiki j4ophkc6kxd9m6yp7vu1w6ext1flla3 2457222 2457221 2026-09-14T22:22:33Z Stashbot 7414 eevans@cumin1004: START - Cookbook sre.hosts.reimage for host sessionstore1005.eqiad.wmnet with OS bookworm 2457222 wikitext text/x-wiki c17bqk2s2i78sc0zlwiabcgpecrig7d 2457226 2457222 2026-09-14T22:31:45Z Stashbot 7414 kemayo@deploy1003: Started scap sync-world: Backport for [[gerrit:1341385|VisualEditor: don't register settings tool in wikitextCommandRegistry (T437810)]] 2457226 wikitext text/x-wiki pgds8nf36ohxztqdq7tfo6ny6cynord 2457228 2457226 2026-09-14T22:36:10Z Stashbot 7414 kemayo@deploy1003: kemayo: Backport for [[gerrit:1341385|VisualEditor: don't register settings tool in wikitextCommandRegistry (T437810)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2457228 wikitext text/x-wiki 3w4603st3woi1ifss90fx37fjhn1kvt 2457229 2457228 2026-09-14T22:36:35Z Stashbot 7414 kemayo@deploy1003: kemayo: Continuing with deployment 2457229 wikitext text/x-wiki tm05ftbe62c0wsk4vcfgufz63uwdsfy 2457230 2457229 2026-09-14T22:41:08Z Stashbot 7414 kemayo@deploy1003: Finished scap sync-world: Backport for [[gerrit:1341385|VisualEditor: don't register settings tool in wikitextCommandRegistry (T437810)]] (duration: 09m 22s) 2457230 wikitext text/x-wiki kvosjyd61l1afaxxdkm58twf79t9wj9 2457233 2457230 2026-09-14T23:01:53Z Stashbot 7414 eevans@cumin1004: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sessionstore1005.eqiad.wmnet with OS bookworm 2457233 wikitext text/x-wiki 3quf439xwdsu4at534yk8gr550jpkdz 2457234 2457233 2026-09-14T23:13:49Z Stashbot 7414 tstarling@deploy1003: Started scap sync-world: Backport for [[gerrit:1324966|Enable Produnto on pilot wikis (T421436)]] 2457234 wikitext text/x-wiki a9us6vgynaso0fwc4bt6de42dmbkfg3 2457235 2457234 2026-09-14T23:17:50Z Stashbot 7414 tstarling@deploy1003: tstarling: Backport for [[gerrit:1324966|Enable Produnto on pilot wikis (T421436)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2457235 wikitext text/x-wiki i7nkoc5sk6s5yu21wvn2fuwwb6hgzwq 2457236 2457235 2026-09-14T23:22:17Z Stashbot 7414 tstarling@deploy1003: tstarling: Continuing with deployment 2457236 wikitext text/x-wiki q15yqjj5wxvtif07ht2d9awi1qgotds 2457237 2457236 2026-09-14T23:26:48Z Stashbot 7414 tstarling@deploy1003: Finished scap sync-world: Backport for [[gerrit:1324966|Enable Produnto on pilot wikis (T421436)]] (duration: 12m 59s) 2457237 wikitext text/x-wiki 0e2lsca5tpygcl26ueuftelrteg5ira 2457238 2457237 2026-09-14T23:41:38Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.reimage for host sessionstore1005.eqiad.wmnet with OS bookworm 2457238 wikitext text/x-wiki e16hy1u4hsxgqn4giupmpl9zvt2kf7z 2457241 2457238 2026-09-15T00:07:03Z Stashbot 7414 jclark@cumin1003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host sessionstore1005.eqiad.wmnet with OS bookworm 2457241 wikitext text/x-wiki lbgsntpedu8ziq8xefkpz6flsd8sco8 2457242 2457241 2026-09-15T00:17:37Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.reimage for host sessionstore1005.eqiad.wmnet with OS bookworm 2457242 wikitext text/x-wiki rzqnfgshlw29ixlu405yhorc8kn52uy 2457243 2457242 2026-09-15T00:19:45Z Stashbot 7414 jclark@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on sessionstore1005.eqiad.wmnet with reason: host reimage 2457243 wikitext text/x-wiki 1pu4kk56cxt5av30hla2v7uupa65dwi 2457244 2457243 2026-09-15T00:23:38Z Stashbot 7414 jclark@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on sessionstore1005.eqiad.wmnet with reason: host reimage 2457244 wikitext text/x-wiki 6k36cpjmm7bb8w0ew1n2vyexvvkv4mk 2457246 2457244 2026-09-15T00:43:43Z Stashbot 7414 jclark@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host sessionstore1005.eqiad.wmnet with OS bookworm 2457246 wikitext text/x-wiki lghp8aghxvy1bbkp02dl0cqtkq9mx8m 2457249 2457246 2026-09-15T02:01:17Z Stashbot 7414 mwpresync@deploy1003: Started scap build-images: Publishing wmf/next image 2457249 wikitext text/x-wiki tr9092nkxzqxoyzxvndyb186ozu5rkw 2457250 2457249 2026-09-15T02:08:39Z Stashbot 7414 mwpresync@deploy1003: Finished scap build-images: Publishing wmf/next image (duration: 07m 22s) 2457250 wikitext text/x-wiki i0y6mirq6zswlapd8ghsejjfi7xvo86 2457254 2457250 2026-09-15T03:03:19Z Stashbot 7414 mwpresync@deploy1003: Started scap sync-world: testwikis to 1.47.0-wmf.20 refs T430839 2457254 wikitext text/x-wiki kmcum1q4ho9fh9qb0drk0shlo9g7q8m 2457255 2457254 2026-09-15T03:06:00Z Stashbot 7414 mwpresync@deploy1003: sync-world failed: <CalledProcessError> Command 'sudo -u mwbuilder /srv/mwbuilder/release/make-container-image/build-images.py --http-proxy http://webproxy:8080 --https-proxy http://webproxy:8080 /srv/mediawiki-staging/scap/image-build --staging-dir /srv/mediawiki-staging --mediawiki-versions 1.47.0-wmf.19,1.47.0-wmf.20,next --multiversion-image-basename docker-registry.discovery.wmnet/restricted 2457255 wikitext text/x-wiki og2ww2vdaps50rwf8iyt6pzl8ow0zc4 2457257 2457255 2026-09-15T04:07:12Z Stashbot 7414 mwpresync@deploy1003: Pruned MediaWiki: 1.47.0-wmf.17 (duration: 07m 10s) 2457257 wikitext text/x-wiki rxbsoegv5tgetvs1tbntaq5rodp59cf 2457258 2457257 2026-09-15T05:06:47Z Stashbot 7414 oblivian@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-timeline: apply 2457258 wikitext text/x-wiki ko5zvyijimyt6gur7gnpsj7eus4j5j6 2457259 2457258 2026-09-15T05:06:52Z Stashbot 7414 oblivian@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-timeline: apply 2457259 wikitext text/x-wiki 6i07re0531u6lasmd5h5vbyvta16lwv 2457260 2457259 2026-09-15T05:06:53Z Stashbot 7414 oblivian@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-timeline: apply 2457260 wikitext text/x-wiki 6vsada54vqo03zocsp15vhc7ejkr0dz 2457261 2457260 2026-09-15T05:06:59Z Stashbot 7414 oblivian@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: apply 2457261 wikitext text/x-wiki huxx44n9c2qiloyvl0gcjk9e7pychnl 2457262 2457261 2026-09-15T05:07:00Z Stashbot 7414 oblivian@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-timeline: apply 2457262 wikitext text/x-wiki ocl43iptcd13l3vh8hl9jghr9t1lo4m 2457263 2457262 2026-09-15T05:07:04Z Stashbot 7414 oblivian@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-timeline: apply 2457263 wikitext text/x-wiki c7bq5g1kfb9s3oplth23p2n7cr8nets 2457264 2457263 2026-09-15T05:07:47Z Stashbot 7414 oblivian@deploy1003: helmfile [staging] START helmfile.d/services/shellbox: apply 2457264 wikitext text/x-wiki kw3ninks9ybalwh0ilby8xngu4185x7 2457265 2457264 2026-09-15T05:07:52Z Stashbot 7414 oblivian@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox: apply 2457265 wikitext text/x-wiki an34hd3zm3ob20ee6r9syuwswxkgfyg 2457266 2457265 2026-09-15T05:07:53Z Stashbot 7414 oblivian@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox: apply 2457266 wikitext text/x-wiki dd5giriuhini0nj8gneh67hzvps2vyu 2457267 2457266 2026-09-15T05:07:59Z Stashbot 7414 oblivian@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox: apply 2457267 wikitext text/x-wiki d9las4g68xk9aum4m53loiswb87ppfk 2457268 2457267 2026-09-15T05:08:01Z Stashbot 7414 oblivian@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox: apply 2457268 wikitext text/x-wiki ke9t0a3j6lhepybhmn9qfjzgyp3y63t 2457269 2457268 2026-09-15T05:08:04Z Stashbot 7414 oblivian@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox: apply 2457269 wikitext text/x-wiki mz8rdvcylaa8e5pyod0tuauwqfcg3we 2457270 2457269 2026-09-15T05:09:49Z Stashbot 7414 oblivian@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-constraints: apply 2457270 wikitext text/x-wiki 5bmk8jh6dwj0dumanzuy29150lft0i2 2457271 2457270 2026-09-15T05:09:53Z Stashbot 7414 oblivian@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-constraints: apply 2457271 wikitext text/x-wiki 4ft22iyj8lbujlemn3gs40mf0rqflmn 2457272 2457271 2026-09-15T05:09:54Z Stashbot 7414 oblivian@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-constraints: apply 2457272 wikitext text/x-wiki quk4sqd6djr4b31skovmla5bwjoy3pn 2457273 2457272 2026-09-15T05:10:00Z Stashbot 7414 oblivian@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-constraints: apply 2457273 wikitext text/x-wiki 170vu8hy733ipxjc1wvli86zhjvre6l 2457274 2457273 2026-09-15T05:10:02Z Stashbot 7414 oblivian@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-constraints: apply 2457274 wikitext text/x-wiki hf97jt301y2dh8f4g4d4ea5o89dg5i8 2457275 2457274 2026-09-15T05:10:05Z Stashbot 7414 oblivian@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-constraints: apply 2457275 wikitext text/x-wiki aiksr7xfyi0e4lkgsyco287al95hyul 2457276 2457275 2026-09-15T05:10:06Z Stashbot 7414 oblivian@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-media: apply 2457276 wikitext text/x-wiki krjepqlayr7hxr0fkpahljset48r7ks 2457277 2457276 2026-09-15T05:10:10Z Stashbot 7414 oblivian@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-media: apply 2457277 wikitext text/x-wiki epr0kow924utk9a4bjog0ucf8mxf236 2457278 2457277 2026-09-15T05:10:12Z Stashbot 7414 oblivian@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-media: apply 2457278 wikitext text/x-wiki 3drss54zj4910ytyng82cdbmxgakp7r 2457279 2457278 2026-09-15T05:10:18Z Stashbot 7414 oblivian@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-media: apply 2457279 wikitext text/x-wiki j157hlczoxzlel6ibvpa0sycr427sd0 2457280 2457279 2026-09-15T05:10:19Z Stashbot 7414 oblivian@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-media: apply 2457280 wikitext text/x-wiki kp0e3ifjpkz4v6s11fizwdylyns7aeo 2457281 2457280 2026-09-15T05:10:23Z Stashbot 7414 oblivian@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-media: apply 2457281 wikitext text/x-wiki tvjffqy5vz21ura1gyq0ig2v8ui2c9k 2457282 2457281 2026-09-15T05:10:24Z Stashbot 7414 oblivian@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-syntaxhighlight: apply 2457282 wikitext text/x-wiki b5550eee1dni90aeojgmst1n5265k7o 2457283 2457282 2026-09-15T05:10:28Z Stashbot 7414 oblivian@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-syntaxhighlight: apply 2457283 wikitext text/x-wiki r9fjxoe8ycfadwukexajtxi17ivzjz8 2457284 2457283 2026-09-15T05:10:29Z Stashbot 7414 oblivian@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-syntaxhighlight: apply 2457284 wikitext text/x-wiki g84pbu8cls20jto3qap8ors8rm2t3lg 2457285 2457284 2026-09-15T05:10:36Z Stashbot 7414 oblivian@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-syntaxhighlight: apply 2457285 wikitext text/x-wiki ehkwajgeruojnqdh5ar0770qcp1p9rw 2457286 2457285 2026-09-15T05:10:37Z Stashbot 7414 oblivian@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-syntaxhighlight: apply 2457286 wikitext text/x-wiki o6pp2c29xddlk9z6nagy2swz4r3am1f 2457287 2457286 2026-09-15T05:10:40Z Stashbot 7414 oblivian@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-syntaxhighlight: apply 2457287 wikitext text/x-wiki qssz6c8e90ou1mz20x2vjn9e528l3kx 2457288 2457287 2026-09-15T05:10:42Z Stashbot 7414 oblivian@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-video: apply 2457288 wikitext text/x-wiki jatggudl3e5u738olb4rjjga5b9ibkn 2457289 2457288 2026-09-15T05:10:47Z Stashbot 7414 oblivian@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-video: apply 2457289 wikitext text/x-wiki 47hhxmbjonqzbhrt1h5darplswcosvf 2457290 2457289 2026-09-15T05:10:48Z Stashbot 7414 oblivian@deploy1003: helmfile [codfw] START helmfile.d/services/shellbox-video: apply 2457290 wikitext text/x-wiki dfqqh375d8vvxz532potcsun90vl9ax 2457291 2457290 2026-09-15T05:10:53Z Stashbot 7414 oblivian@deploy1003: helmfile [codfw] DONE helmfile.d/services/shellbox-video: apply 2457291 wikitext text/x-wiki mklcwdjrwalzr7tkxalo9t4al6dp392 2457292 2457291 2026-09-15T05:10:54Z Stashbot 7414 oblivian@deploy1003: helmfile [eqiad] START helmfile.d/services/shellbox-video: apply 2457292 wikitext text/x-wiki l0ddz1qoz1itwtuaxlxq6m7jtsxaud2 2457293 2457292 2026-09-15T05:10:58Z Stashbot 7414 oblivian@deploy1003: helmfile [eqiad] DONE helmfile.d/services/shellbox-video: apply 2457293 wikitext text/x-wiki fziwsha1scx9ganpi6md7xcwefe7c0m 2457295 2457293 2026-09-15T05:28:01Z Stashbot 7414 oblivian@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-timeline: apply 2457295 wikitext text/x-wiki jse5upcerfaqijwrsas4mgvu3lqxdgk 2457296 2457295 2026-09-15T05:38:06Z Stashbot 7414 oblivian@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-timeline: apply 2457296 wikitext text/x-wiki 9ijhizd0s1f26tcc283opg7uqgqz2te 2457297 2457296 2026-09-15T05:47:35Z Stashbot 7414 oblivian@deploy1003: helmfile [staging-eqiad] START helmfile.d/admin 'apply'. 2457297 wikitext text/x-wiki 2klfna3nu2u307hep2n74sut8jrexne 2457298 2457297 2026-09-15T05:48:40Z Stashbot 7414 oblivian@deploy1003: helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. 2457298 wikitext text/x-wiki 7eun5mnlx8vrgh20dt4lkzr99k1ehdl 2457299 2457298 2026-09-15T05:49:16Z Stashbot 7414 oblivian@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-timeline: apply 2457299 wikitext text/x-wiki o9k2v0quhekj31n6xny0snua628qfat 2457300 2457299 2026-09-15T05:59:23Z Stashbot 7414 oblivian@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-timeline: apply 2457300 wikitext text/x-wiki sb39jn3toqd0528gnmqfjokve7ozoqy 2457304 2457300 2026-09-15T06:51:05Z Stashbot 7414 moritzm: pruned obsolete Bullseye image python3-build-bullseye from the docker registry T416452 2457304 wikitext text/x-wiki khnp3i3cr7v5gkb819pnlygtuqkh3gj 2457307 2457304 2026-09-15T07:06:43Z Stashbot 7414 moritzm: pruned obsolete Bullseye image python3-devel from the docker registry T416452 2457307 wikitext text/x-wiki npgufcsn9nfyh3r33zqut7anifrc0kd 2457308 2457307 2026-09-15T07:11:35Z Stashbot 7414 stran@deploy1003: Started scap sync-world: Backport for [[gerrit:1341274|SI: Implement "queue view" functionality (T437183)]], [[gerrit:1341242|SuggestedInvestigations: Add and enable 'sockpuppets' queue view (T437183)]], [[gerrit:1341254|Add wmf-specific Special:SuggestedInvestigations messages (T437183)]] 2457308 wikitext text/x-wiki 7lerxh3flasz93woc98nwqfbdwzamxe 2457309 2457308 2026-09-15T07:18:04Z Stashbot 7414 oblivian@deploy1003: helmfile [staging] START helmfile.d/services/shellbox-timeline: apply 2457309 wikitext text/x-wiki fryq1vrw8dkun6vwl9mz6typ6ketnn5 2457310 2457309 2026-09-15T07:18:21Z Stashbot 7414 oblivian@deploy1003: helmfile [staging] DONE helmfile.d/services/shellbox-timeline: apply 2457310 wikitext text/x-wiki s29kay7adi5cr6ispbyuda08l65kvhf 2457314 2457310 2026-09-15T07:31:22Z Stashbot 7414 stran@deploy1003: stran: Backport for [[gerrit:1341274|SI: Implement "queue view" functionality (T437183)]], [[gerrit:1341242|SuggestedInvestigations: Add and enable 'sockpuppets' queue view (T437183)]], [[gerrit:1341254|Add wmf-specific Special:SuggestedInvestigations messages (T437183)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2457314 wikitext text/x-wiki rtsccdawxxafha805zvozcvpd2nk0vi 2457315 2457314 2026-09-15T07:54:37Z Stashbot 7414 stran@deploy1003: stran: Continuing with deployment 2457315 wikitext text/x-wiki aym8mfxthoenyprzazmigbk7ursquyd 2457317 2457315 2026-09-15T08:07:01Z Stashbot 7414 stran@deploy1003: Finished scap sync-world: Backport for [[gerrit:1341274|SI: Implement "queue view" functionality (T437183)]], [[gerrit:1341242|SuggestedInvestigations: Add and enable 'sockpuppets' queue view (T437183)]], [[gerrit:1341254|Add wmf-specific Special:SuggestedInvestigations messages (T437183)]] (duration: 55m 27s) 2457317 wikitext text/x-wiki tdmt93khm7ciplfbik09sevm54p1c37 2457318 2457317 2026-09-15T08:13:26Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti3005.esams.wmnet 2457318 wikitext text/x-wiki e8shtew96s3q2i1rl81b7vl4s1nutwy 2457319 2457318 2026-09-15T08:14:40Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti3005.esams.wmnet 2457319 wikitext text/x-wiki 2gxvnorucvi1f55ja19v7trz3pa8t9b 2457320 2457319 2026-09-15T08:15:46Z Stashbot 7414 dpogorzelski@dns1004: START - running authdns-update 2457320 wikitext text/x-wiki 1kinf0u7jmu4ugqcnbp01dhmt0jsio5 2457321 2457320 2026-09-15T08:18:03Z Stashbot 7414 dpogorzelski@dns1004: END - running authdns-update 2457321 wikitext text/x-wiki pifqs7uy9giy0m9j1eblyomgunzr7j7 2457322 2457321 2026-09-15T08:18:55Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.reimage for host ms-be1098.eqiad.wmnet with OS trixie 2457322 wikitext text/x-wiki ki1rg0c3lnsy9k3qcvifxvgnpsc7r8x 2457325 2457322 2026-09-15T08:25:50Z Stashbot 7414 XioNoX: asw1-b3-magru - Disable logging and file logging for BRCM_PKT - T437984 2457325 wikitext text/x-wiki 0cao6fr4gfcaju2q50rahlkk1pbbnt6 2457326 2457325 2026-09-15T08:26:12Z Stashbot 7414 slyngshede@puppetserver1001: conftool action : set/pooled=no; selector: name=cp7010.magru.wmnet 2457326 wikitext text/x-wiki 4ncxwwg8qjom4tb7ml3kzaud6lz7hl7 2457327 2457326 2026-09-15T08:26:18Z Stashbot 7414 mvernon@cumin2003: END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host ms-be1098.eqiad.wmnet with OS trixie 2457327 wikitext text/x-wiki asza2h25xkbxr2ei1vwb4nnydlkdtll 2457344 2457327 2026-09-15T08:33:09Z Stashbot 7414 slyngshede@cumin1003: START - Cookbook sre.hosts.reimage for host cp7010.magru.wmnet with OS trixie 2457344 wikitext text/x-wiki m4i8qbrmjw6q69gvayro04he14ujppv 2457350 2457344 2026-09-15T08:47:35Z Stashbot 7414 jnuche@deploy1003: Started scap sync-world: Backport for [[gerrit:1341698|RestSandbox: Pass JsonLocalizer instead of ResponseFactory to ModuleManager (T437982)]] 2457350 wikitext text/x-wiki muqm6gguelx1rsdpmc9tgvf4fagh9mi 2457352 2457350 2026-09-15T08:49:44Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/liftwing-studio: sync 2457352 wikitext text/x-wiki 6e56q6scowxhq6xvh1dk6kr1ukvt0ur 2457353 2457352 2026-09-15T08:49:47Z Stashbot 7414 dpogorzelski@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/liftwing-studio: sync 2457353 wikitext text/x-wiki bgwz4a0fw48lkco09gl88h8yj8eqiy0 2457355 2457353 2026-09-15T08:52:20Z Stashbot 7414 jnuche@deploy1003: jnuche: Backport for [[gerrit:1341698|RestSandbox: Pass JsonLocalizer instead of ResponseFactory to ModuleManager (T437982)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2457355 wikitext text/x-wiki f8txuyeeuit36h62jyog6me7i0b6xiv 2457356 2457355 2026-09-15T08:53:02Z Stashbot 7414 jnuche@deploy1003: jnuche: Continuing with deployment 2457356 wikitext text/x-wiki 1fuxgdnbxgaqye535a5gye30en9qt26 2457357 2457356 2026-09-15T08:55:47Z Stashbot 7414 jmm@cumin2003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on install3004.wikimedia.org with reason: switch reboot 2457357 wikitext text/x-wiki on3g0erlgc35zaoliynkfaidrer0t7f 2457358 2457357 2026-09-15T08:55:52Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2197.codfw.wmnet with reason: cloning db2201 2457358 wikitext text/x-wiki fhcqyz7cq2sfsf8ehhw1v452agfyshx 2457359 2457358 2026-09-15T08:59:38Z Stashbot 7414 jnuche@deploy1003: Finished scap sync-world: Backport for [[gerrit:1341698|RestSandbox: Pass JsonLocalizer instead of ResponseFactory to ModuleManager (T437982)]] (duration: 12m 03s) 2457359 wikitext text/x-wiki bw7o75g63u1zv52tya8e4ho6if6ijdo 2457360 2457359 2026-09-15T09:00:16Z Stashbot 7414 slyngshede@cumin1003: START - Cookbook sre.hosts.downtime for 2:00:00 on cp7010.magru.wmnet with reason: host reimage 2457360 wikitext text/x-wiki i29gjilicesknvn56ey2fxh1zo99ocq 2457361 2457360 2026-09-15T09:01:00Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.dns.admin DNS admin: depool esams [reason: switches reboot, T437984] 2457361 wikitext text/x-wiki ax46d0fpmv8vqvjzdtj12qryezhrpdz 2457362 2457361 2026-09-15T09:01:03Z Stashbot 7414 ayounsi@cumin1003: END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: depool esams [reason: switches reboot, T437984] 2457362 wikitext text/x-wiki k7a3n24ecwhcypijkhk2nkinjcpbods 2457364 2457362 2026-09-15T09:04:00Z Stashbot 7414 slyngshede@cumin1003: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cp7010.magru.wmnet with reason: host reimage 2457364 wikitext text/x-wiki 46hru9ul2prq8b8i59qz9wdrhfysgfh 2457365 2457364 2026-09-15T09:04:26Z Stashbot 7414 ayounsi@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on 12 hosts with reason: Switch maintenance 2457365 wikitext text/x-wiki jnhvsps4zmh27nml1ndxl6ymhrx2vr8 2457366 2457365 2026-09-15T09:05:33Z Stashbot 7414 ayounsi@cumin1003: DONE (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on asw1-by27-esams IPv6,asw1-by27-esams.mgmt,asw1-by-27-esams with reason: Switch maintenance 2457366 wikitext text/x-wiki 1k06g8gfc1ti06x837q4vjhjuzisk8w 2457367 2457366 2026-09-15T09:06:07Z Stashbot 7414 ayounsi@cumin1003: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on asw1-by27-esams,asw1-by27-esams IPv6,asw1-by27-esams.mgmt with reason: Switch maintenance 2457367 wikitext text/x-wiki anld50yrl38g5gkbgmx8kql0rz6k7ph 2457372 2457367 2026-09-15T09:10:11Z Stashbot 7414 elukey@cumin1003: START - Cookbook sre.hosts.provision for host ms-be1098.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2457372 wikitext text/x-wiki ds4jktm5uwrs0rbxmffpp8ofatn0214 2457373 2457372 2026-09-15T09:15:17Z Stashbot 7414 jnuche@deploy1003: rebuilt and synchronized wikiversions files: group0 to 1.47.0-wmf.20 refs T430839 2457373 wikitext text/x-wiki 71ep4kn4estifams4mccjp2hc7rpze8 2457374 2457373 2026-09-15T09:22:08Z Stashbot 7414 elukey@cumin1003: END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host ms-be1098.mgmt.eqiad.wmnet with chassis set policy FORCE_RESTART and with Dell SCP reboot policy FORCED 2457374 wikitext text/x-wiki 8x1zavd4zs64ymn35bgnrigdis6v84f 2457375 2457374 2026-09-15T09:23:54Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.reimage for host ms-be1098.eqiad.wmnet with OS trixie 2457375 wikitext text/x-wiki 0857pwdf0eh0ec8fl12i9cuvvklncvb 2457376 2457375 2026-09-15T09:24:20Z Stashbot 7414 mvernon@cumin2003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ms-be1098.eqiad.wmnet with OS trixie 2457376 wikitext text/x-wiki 3ws8snbvwr5izq67oed1suqn72bpo8e 2457377 2457376 2026-09-15T09:24:38Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.network.depool-rack with action 'depool' for esams rack BY27 2457377 wikitext text/x-wiki pq5ct1wzwifh8hfjcd6ht738e7pftaf 2457378 2457377 2026-09-15T09:26:57Z Stashbot 7414 ayounsi@cumin1003: END (FAIL) - Cookbook sre.network.depool-rack (exit_code=99) with action 'depool' for esams rack BY27 2457378 wikitext text/x-wiki 5i0m117r9dv82k7vlf3u3kb0x1xtpha 2457379 2457378 2026-09-15T09:28:44Z Stashbot 7414 slyngshede@cumin1003: END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cp7010.magru.wmnet with OS trixie 2457379 wikitext text/x-wiki sc0ecohstge0zrjovpvs8dfmg0pflin 2457380 2457379 2026-09-15T09:30:12Z Stashbot 7414 mvernon@cumin2003: START - Cookbook sre.hosts.reimage for host ms-be1098.eqiad.wmnet with OS trixie 2457380 wikitext text/x-wiki lgelwf067fede2rje7cbjidysgawlcy 2457381 2457380 2026-09-15T09:31:26Z Stashbot 7414 XioNoX: asw1-by27-esams> request system reboot - T437984 2457381 wikitext text/x-wiki fsgnbcwv67jvdpnc1g3l7hp4266pqrc 2457383 2457381 2026-09-15T09:39:49Z Stashbot 7414 ayounsi@cumin1003: START - Cookbook sre.dns.admin DNS admin: pool esams [reason: switches reboot, T437984] 2457383 wikitext text/x-wiki mgkdm1hrzrys85f8camsfdwtflz7iz4 2457384 2457383 2026-09-15T09:39:52Z Stashbot 7414 ayounsi@cumin1003: END (PASS) - Cookbook sre.dns.admin (exit_code=0) DNS admin: pool esams [reason: switches reboot, T437984] 2457384 wikitext text/x-wiki 67meoqhr92k7e71q5if1hvgv0z33t3p 2457388 2457384 2026-09-15T10:05:17Z Stashbot 7414 joal@deploy1003: helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/turnilo: apply 2457388 wikitext text/x-wiki 4nls2bqbo17k6h6yzlrqbnu7djri0qt 2457389 2457388 2026-09-15T10:05:48Z Stashbot 7414 joal@deploy1003: helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/turnilo: apply 2457389 wikitext text/x-wiki d2wyc19h6ex7sccsq41jnchfxtsp0kg 2457390 2457389 2026-09-15T10:07:04Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/aux-k8s-services/etherpad: apply 2457390 wikitext text/x-wiki b62816kj55zoiyy5r5f0w6l3w5w0611 2457391 2457390 2026-09-15T10:08:08Z Stashbot 7414 moritzm: increased DRBD replication speed in Ganeti/esams T428878 2457391 wikitext text/x-wiki r9684a7h8i86ufwprvm116ukp4l53dv 2457392 2457391 2026-09-15T10:09:16Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/aux-k8s-services/etherpad: apply 2457392 wikitext text/x-wiki b4oyd0m18bv9d4s9az5qi83v3kd09fz 2457393 2457392 2026-09-15T10:10:43Z Stashbot 7414 hashar@deploy1003: Started deploy [integration/docroot@5cf09c8]: build: Updating npm dependencies 2457393 wikitext text/x-wiki hdmng453atplcy27un52bql34fxyf6a 2457394 2457393 2026-09-15T10:10:57Z Stashbot 7414 hashar@deploy1003: Finished deploy [integration/docroot@5cf09c8]: build: Updating npm dependencies (duration: 00m 13s) 2457394 wikitext text/x-wiki lqqn3tiprwhnwiuhpl6pxa5nm5875jc 2457395 2457394 2026-09-15T10:20:42Z Stashbot 7414 moritzm: increased DRBD replication speed in Ganeti/magru T428878 2457395 wikitext text/x-wiki 0124bhs2pjb0qbe1j6d45gwu4wqjit0 2457396 2457395 2026-09-15T10:22:00Z Stashbot 7414 moritzm: failover Ganeti master in magru to ganeti7001 2457396 wikitext text/x-wiki e5vocynjjg4ebxd1yoz1q75fubcnlhy 2457397 2457396 2026-09-15T10:30:56Z Stashbot 7414 mvernon@cumin2003: END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host ms-be1098.eqiad.wmnet with OS trixie 2457397 wikitext text/x-wiki m71aj3i1mf8vuy6tcffv4zul52pvrxv 2457398 2457397 2026-09-15T10:33:49Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] START helmfile.d/aux-k8s-services/etherpad: apply 2457398 wikitext text/x-wiki b19hujxhz4lhqxpiik5r4hg3n7fh0ez 2457399 2457398 2026-09-15T10:34:16Z Stashbot 7414 jelto@deploy1003: helmfile [aux-k8s-eqiad] DONE helmfile.d/aux-k8s-services/etherpad: apply 2457399 wikitext text/x-wiki 5ou14mol6s79bmqpvf51qco11p2jome 2457402 2457399 2026-09-15T10:51:47Z Stashbot 7414 slyngshede@puppetserver1001: conftool action : set/pooled=yes; selector: name=cp7010.magru.wmnet 2457402 wikitext text/x-wiki mtg2qcvgwixux3srbd30uo2y437aa7n 2457403 2457402 2026-09-15T11:04:49Z Stashbot 7414 slyngshede@cumin1003: START - Cookbook sre.loadbalancer.upgrade restart P{lvs7001.magru.wmnet} and A:liberica 2457403 wikitext text/x-wiki 8zufbohog6skmzt6a8ysdmcd7wm0wpv 2457404 2457403 2026-09-15T11:05:04Z Stashbot 7414 slyngshede@cumin1003: START - Cookbook sre.loadbalancer.admin depooling P{lvs7001.magru.wmnet} and A:liberica 2457404 wikitext text/x-wiki 0a5p7mzyabzb8ntf4pnd2e65hnmnrqf 2457405 2457404 2026-09-15T11:05:16Z Stashbot 7414 slyngshede@cumin1003: END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) depooling P{lvs7001.magru.wmnet} and A:liberica 2457405 wikitext text/x-wiki kidwwuokuvcfbuu98xmzr3muxjmcx74 2457406 2457405 2026-09-15T11:05:29Z Stashbot 7414 slyngshede@cumin1003: START - Cookbook sre.loadbalancer.admin pooling P{lvs7001.magru.wmnet} and A:liberica 2457406 wikitext text/x-wiki 6ord0xox3t6slqkbh4q58zkyu13wjzn 2457407 2457406 2026-09-15T11:05:51Z Stashbot 7414 slyngshede@cumin1003: END (PASS) - Cookbook sre.loadbalancer.admin (exit_code=0) pooling P{lvs7001.magru.wmnet} and A:liberica 2457407 wikitext text/x-wiki csr71kwt7n6xicsjd3snoz9g5fr9b2m 2457408 2457407 2026-09-15T11:05:53Z Stashbot 7414 slyngshede@cumin1003: END (PASS) - Cookbook sre.loadbalancer.upgrade (exit_code=0) restart P{lvs7001.magru.wmnet} and A:liberica 2457408 wikitext text/x-wiki cgsqsechyisogvnp9qe7o34jxe51u29 2457409 2457408 2026-09-15T11:17:38Z Stashbot 7414 jmm@cumin2003: START - Cookbook sre.ganeti.drain-node for draining ganeti node ganeti7004.magru.wmnet 2457409 wikitext text/x-wiki 4djjx6alq89ezl45pms8wg1vzd6ecj7 2457410 2457409 2026-09-15T11:18:44Z Stashbot 7414 jmm@cumin2003: END (PASS) - Cookbook sre.ganeti.drain-node (exit_code=0) for draining ganeti node ganeti7004.magru.wmnet 2457410 wikitext text/x-wiki drxmfe3dja62smdtuzebirobtxeon7h 2457412 2457410 2026-09-15T11:33:40Z Stashbot 7414 marostegui@cumin1004: DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2250.codfw.wmnet with reason: cloning db2201 2457412 wikitext text/x-wiki hto6ff1sh8y45ynuguwhkw7c4qtkmk6 2457415 2457412 2026-09-15T11:56:18Z Stashbot 7414 ladsgroup@deploy1003: helmfile [staging] START helmfile.d/services/thumbor: apply 2457415 wikitext text/x-wiki 6srjsab4vnmptqkwx6u4qvg2pa0puya 2457416 2457415 2026-09-15T11:56:26Z Stashbot 7414 ladsgroup@deploy1003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2457416 wikitext text/x-wiki 6k1zve7itnklxsksjg9cos97tc5s3w7 498 9925 2457173 2456825 2026-09-14T19:49:18Z Stashbot 7414 Southparkfan: switch Beta Cluster to PHP 8.5 - T435393 2457173 wikitext text/x-wiki fdqwzjxtpuxx4iy468lep44nehx2hdz 0 17290 2457117 2456824 2026-09-14T17:18:12Z Stashbot 7414 taavi: relaoding zuul to deploy https://gerrit.wikimedia.org/r/1337606 2457117 wikitext text/x-wiki eca4dlbg1p8qfozh1zeiaajtm077dd9 2457172 2457117 2026-09-14T19:49:16Z Stashbot 7414 Southparkfan: switch Beta Cluster to PHP 8.5 - T435393 2457172 wikitext text/x-wiki c7pzkbxzqet7eb7ooxvr5ol5m57rino 2457174 2457172 2026-09-14T19:51:01Z Stashbot 7414 James_F: Zuul: [mediawiki/extensions/MobileApp] Add VisualEditor phan dep, for T437736 2457174 wikitext text/x-wiki 1m9p8c60fsy5zg7megsyf7s11i7b2pg 2457294 2457174 2026-09-15T05:19:02Z Stashbot 7414 phedenskog: devel-stats upgraded datasette-dashboards from 0.7.1 to 0.8.0 for releng-data.wmcloud.org 2457294 wikitext text/x-wiki jyhig3yx1y0vfck962qr38pgqkx00hr 2457386 2457294 2026-09-15T10:00:59Z Stashbot 7414 hashar: Updating node based Jenkins jobs for https://gerrit.wikimedia.org/r/c/integration/config/+/1341713 | update npm jobs to drop debug logs from cache # T437376 T426741 2457386 wikitext text/x-wiki gzwg7ififms9ytepvk88wfp8akdx9ba 2457400 2457386 2026-09-15T10:38:34Z Stashbot 7414 Lucas_WMDE: ssh integration-castor06.integration.eqiad1.wikimedia.cloud sudo -u jenkins-deploy rm -rf /srv/castor/castor-mw-ext-and-skins/master/quibble-vendor-mysql-php83-selenium/Cypress/ # corrupt Cypress cache? T438002 2457400 wikitext text/x-wiki 9p87xalafazd195atzwxk13lppmq7mx 0 22777 2457387 2449878 2026-09-15T10:04:14Z MMuhlenhoff (WMF) 5268 /* Configure a static KVM machine type */ Add section to raise the DRBD replication speed 2457387 wikitext text/x-wiki tpcco346fokzw1a08k60an6hxo4oskj 498 30942 2456939 2456417 2026-09-14T12:23:22Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (T435921) 2456939 wikitext text/x-wiki 9y5o8r6ccz30rlfb97hm1wqxil6n250 2456940 2456939 2026-09-14T12:23:27Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) (T435921) 2456940 wikitext text/x-wiki 1dsv465rxcpys6xfjrcnvszd2k5zhsy 2456941 2456940 2026-09-14T12:23:32Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (T435921) 2456941 wikitext text/x-wiki 7g4lo14dfk1zob36d1w2ot13ttj4ip2 2456942 2456941 2026-09-14T12:23:37Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) (T435921) 2456942 wikitext text/x-wiki ipwzhkwtg2pp8jneurpn3mu8b3oyuzm 2456943 2456942 2026-09-14T12:23:41Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (T435921) 2456943 wikitext text/x-wiki 6crg9jplv0iuicyf47ob52oxpmvcy4h 2456944 2456943 2026-09-14T12:23:46Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) (T435921) 2456944 wikitext text/x-wiki nn9e5c5v8wsm4yp4gxhso1rd6b0quwm 2456945 2456944 2026-09-14T12:23:51Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (T435921) 2456945 wikitext text/x-wiki dtcfwsu5bsihw3nxzzipj6vlu05hom5 2456946 2456945 2026-09-14T12:24:00Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) (T435921) 2456946 wikitext text/x-wiki rf6wmsw0ocucg2cyfamx3j2aii917i0 2456947 2456946 2026-09-14T12:24:05Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (T435921) 2456947 wikitext text/x-wiki q9fcjm340uxr8n3trgedrt349ad5phs 2456948 2456947 2026-09-14T12:24:09Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) (T435921) 2456948 wikitext text/x-wiki i6csbhl1dfal0xhtk6xfowo4c6ugps9 2456949 2456948 2026-09-14T12:24:16Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (T435921) 2456949 wikitext text/x-wiki nbb7vg7ig3ina23sfz0jyzfjbz0mgpq 2456950 2456949 2026-09-14T12:24:20Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) (T435921) 2456950 wikitext text/x-wiki bsurvefd2qym2sgjbuy6hidg1vymtvm 2456951 2456950 2026-09-14T12:24:24Z Stashbot 7414 filippo@cloudcumin1001: START - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (T435923) 2456951 wikitext text/x-wiki tiym1jmrri5btghel4f30urb0zaa4uz 2456952 2456951 2026-09-14T12:24:30Z Stashbot 7414 filippo@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.cloudvirt.unset_maintenance (exit_code=0) (T435923) 2456952 wikitext text/x-wiki hcnqxgbce2brsdfumgrh3zy3g3jbpw8 2457124 2456952 2026-09-14T17:59:48Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.openstack.tofu running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/353 2457124 wikitext text/x-wiki k8gb48wnfr62no07jdbrhynyqf9ids3 2457125 2457124 2026-09-14T18:00:10Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan for https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/353 2457125 wikitext text/x-wiki f8zpl7sxrgdbjhbw2t5639o2zr0577r 2457127 2457125 2026-09-14T18:01:29Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.openstack.tofu running tofu plan+apply for main branch 2457127 wikitext text/x-wiki c5sil0awn88xqawg518otpwnyc2i6fh 2457128 2457127 2026-09-14T18:03:16Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.openstack.tofu (exit_code=0) running tofu plan+apply for main branch 2457128 wikitext text/x-wiki nx1t0rwefms2apzj1kvj4wqwhx1rwip 498 443261 2457129 2453001 2026-09-14T18:03:55Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.etcd.add_cluster_node 2457129 wikitext text/x-wiki 0z396urijbdn2wz8agvyy1htwfz7i8h 2457130 2457129 2026-09-14T18:04:05Z Stashbot 7414 taavi@cloudcumin1001: END (FAIL) - Cookbook wmcs.etcd.add_cluster_node (exit_code=99) 2457130 wikitext text/x-wiki s3py52p7mdf88q24fj1rty8e7vo3njd 2457131 2457130 2026-09-14T18:05:11Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.etcd.add_cluster_node 2457131 wikitext text/x-wiki 92rftthvh5n31alwblvwglmei5r8pdv 2457133 2457131 2026-09-14T18:05:18Z Stashbot 7414 taavi@cloudcumin1001: END (FAIL) - Cookbook wmcs.etcd.add_cluster_node (exit_code=99) 2457133 wikitext text/x-wiki nwo8gitkey24wv4ryzzo9noncmak4k0 2457135 2457133 2026-09-14T18:08:43Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.etcd.add_cluster_node 2457135 wikitext text/x-wiki s8h66qxsfzcbyyn5i20ppd4q9wyh4hz 2457139 2457135 2026-09-14T18:15:21Z Stashbot 7414 taavi@cloudcumin1001: END (FAIL) - Cookbook wmcs.etcd.add_cluster_node (exit_code=99) 2457139 wikitext text/x-wiki r3afd18wjt58swq56cfn1fwq0ycff86 2457141 2457139 2026-09-14T18:19:06Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.remove_instance for instance cloudinfra-etcd-1 2457141 wikitext text/x-wiki qgtcg5f28kdw05qdth1b3my29twxehr 2457142 2457141 2026-09-14T18:19:23Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance cloudinfra-etcd-1 2457142 wikitext text/x-wiki 6aao20s0mbsunlsgju8ydxq3pshsfer 2457143 2457142 2026-09-14T18:22:31Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.etcd.add_cluster_node 2457143 wikitext text/x-wiki 5dy9vn38gqh0ucyc2ees9joqay76sfa 2457152 2457143 2026-09-14T18:31:36Z Stashbot 7414 taavi@cloudcumin1001: END (FAIL) - Cookbook wmcs.etcd.add_cluster_node (exit_code=99) 2457152 wikitext text/x-wiki l7ptjsaio1kiel6078h2nl3qku7ejio 2457153 2457152 2026-09-14T18:32:10Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.remove_instance for instance cloudinfra-etcd-1 2457153 wikitext text/x-wiki s82ijp2uevjv3icrs8va92e09zwibkg 2457154 2457153 2026-09-14T18:32:33Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance cloudinfra-etcd-1 2457154 wikitext text/x-wiki o88teltdmd5dev67j73a18xsgwi23pn 2457155 2457154 2026-09-14T18:36:59Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.etcd.add_cluster_node 2457155 wikitext text/x-wiki c32ljorefvj3u3cea9xx4j4kyr1u2a3 2457156 2457155 2026-09-14T18:45:02Z Stashbot 7414 taavi@cloudcumin1001: END (FAIL) - Cookbook wmcs.etcd.add_cluster_node (exit_code=99) 2457156 wikitext text/x-wiki rwq32a71fqn1c697iaj3e5qolt9jsr1 2457157 2457156 2026-09-14T18:46:00Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.vps.remove_instance for instance cloudinfra-etcd-1 2457157 wikitext text/x-wiki 1qbq03ouwkmh07d5ovv95vk4ti5xkur 2457158 2457157 2026-09-14T18:46:53Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance cloudinfra-etcd-1 2457158 wikitext text/x-wiki bolvzjf2qp1336x6pbmangso8og14mf 2457162 2457158 2026-09-14T18:50:38Z Stashbot 7414 taavi@cloudcumin1001: START - Cookbook wmcs.etcd.add_cluster_node 2457162 wikitext text/x-wiki cernnwxiynmthwy4b6pr0zp1g6gqhj0 2457165 2457162 2026-09-14T18:59:00Z Stashbot 7414 taavi@cloudcumin1001: END (PASS) - Cookbook wmcs.etcd.add_cluster_node (exit_code=0) 2457165 wikitext text/x-wiki beve0gnxhz78n0mj7vl42hvzq6b5hrz 0 445760 2457164 2441504 2026-09-14T18:56:54Z Southparkfan 1843 2457164 wikitext text/x-wiki 4fgpfo5r1uyoqkzj6r77puqft8i8ryy 2457166 2457164 2026-09-14T18:59:34Z Southparkfan 1843 2457166 wikitext text/x-wiki 62j44mywx92nz1qxkklm9fgogindkxs 0 447313 2457050 2352437 2026-09-14T15:02:31Z SSingh (WMF) 13928 add Liberica 2457050 wikitext text/x-wiki 5bjq23glt06ldoy44tiyz861del6wyr 2457098 2457050 2026-09-14T16:38:08Z BCornwall-WMF 31521 /* What we own */ rm extra row 2457098 wikitext text/x-wiki 2am40vsww1guc02jlurpb5fxu1dy0z5 0 449160 2457239 2456839 2026-09-15T00:02:29Z Dexbot 30554 Bot: Updating the report 2457239 wikitext text/x-wiki hwwohv23qbj9aauz5u4ee2mit9cn2rm 0 449344 2457061 2439758 2026-09-14T15:22:32Z FFurnari-WMF 36523 2457061 wikitext text/x-wiki kkqg99rqmquqt2tnvr1b8um54cslgfb 2457095 2457061 2026-09-14T16:30:06Z BCornwall-WMF 31521 Convert tutorials to a see template 2457095 wikitext text/x-wiki 9qnwr83vl47z729hsmd44wvjvuocnyx 2457096 2457095 2026-09-14T16:32:55Z BCornwall-WMF 31521 Convert notice templates to see/note templates 2457096 wikitext text/x-wiki s2prxxm9bybuym35shkx3y0ho0sufzj 2457097 2457096 2026-09-14T16:33:51Z BCornwall-WMF 31521 /* get pattern */ ce 2457097 wikitext text/x-wiki n5kx7xlhahycqzt43fh2y5mhfhoqiwi 2 450698 2457113 2268597 2026-09-14T17:09:24Z BCornwall-WMF 31521 2457113 wikitext text/x-wiki 0r546ydwr3uel42u7h1tvoctvxekvyb 2 451143 2457107 2023529 2026-09-14T17:07:22Z BCornwall-WMF 31521 BCornwall-WMF moved page [[Style guidelines]] to [[User:BCornwall-WMF/Style guidelines]] 2023529 wikitext text/x-wiki 9apgnpd8fp7lvujztvy5oodogcl5n2v 3 451145 2457109 2005453 2026-09-14T17:07:23Z BCornwall-WMF 31521 BCornwall-WMF moved page [[Talk:Style guidelines]] to [[User talk:BCornwall-WMF/Style guidelines]] 2005453 wikitext text/x-wiki 25305dxtnkil6k1ly18vjhvu6uo1rkw 0 452002 2457328 2198379 2026-09-15T08:30:31Z MABot 10804 Bot: Fixing double redirect from [[Data Platform/Systems/Dealing with data loss alarms]] to [[Data Platform/Systems/Dealing with webrequest data loss]] 2457328 wikitext text/x-wiki 5bb25q04mazubwqwunu9hab67p1cm6s 116 453426 2456980 2454931 2026-09-14T13:18:16Z Phabbanbot 37210 Anna_Jegeus_WMSE was disabled by Sebastian_Berlin-WMSE 2456980 wikitext text/x-wiki k0e6hrk6f6hwxi1uasrd36fryp4jm40 0 454364 2457240 2429930 2026-09-15T00:05:14Z BCornwall-WMF 31521 /* Healthcheck Forwarder */ link to enwiki ip in ip article 2457240 wikitext text/x-wiki c20qby05nbzgz7ujk6curqa5180nzb8 0 454773 2457329 2194034 2026-09-15T08:30:41Z MABot 10804 Bot: Fixing double redirect from [[Data Platform/Systems/Dealing with data loss alarms]] to [[Data Platform/Systems/Dealing with webrequest data loss]] 2457329 wikitext text/x-wiki 5bb25q04mazubwqwunu9hab67p1cm6s 2 455433 2457215 2211471 2026-09-14T22:19:53Z Mfield 51590 Mfield moved page [[User:Wheatley2]] to [[User:Madéquis]]: Automatically moved page while renaming the user "[[Special:CentralAuth/Wheatley2|Wheatley2]]" to "[[Special:CentralAuth/Madéquis|Madéquis]]" 2211471 wikitext text/x-wiki 5bdgp81fd4q86nzsxrjafk3yakykq0j 2 455874 2457343 2232826 2026-09-15T08:33:04Z MABot 10804 Bot: Redirect to a deleted or non-existent page 2457343 wikitext text/x-wiki o09j28q6w9dkf4zzrlgk9i9nhg7m0yu 498 455898 2457411 2372388 2026-09-15T11:26:40Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: deployed c391026b03 (Codex 2.7.0, other package updates, thumb.wikimedia.org in CSP) 2457411 wikitext text/x-wiki k47uicxnhqbmkefjdcnpwt0x5gy8j7j 2457413 2457411 2026-09-15T11:36:26Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: deployed eb4af443a3 (add unsafe-eval to CSP, needed now for some reason – new @vue/repl version?) 2457413 wikitext text/x-wiki 4ay0dhovc63q4gmm6rpxknsin8oda2b 2 458322 2457340 2273831 2026-09-15T08:32:31Z MABot 10804 Bot: Fixing double redirect from [[User:AWesterinen/Blazegraph Features and Capabilities]] to [[Wikidata Query Service/Migration/Blazegraph Features and Capabilities]] 2457340 wikitext text/x-wiki 4dphzf2m7ba8wzabmhqmlgnocnvs6nu 3 458333 2457342 2273853 2026-09-15T08:32:51Z MABot 10804 Bot: Fixing double redirect from [[User talk:AWesterinen/Blazegraph Features and Capabilities]] to [[Talk:Wikidata Query Service/Migration/Blazegraph Features and Capabilities]] 2457342 wikitext text/x-wiki i3ldmnixmvx0j0hzpg9pletuptr8n7y 2 458827 2457341 2361545 2026-09-15T08:32:41Z MABot 10804 Bot: Fixing double redirect from [[Test Kitchen/Measuring clickthrough rates]] to [[Test Kitchen/Archive/Measuring clickthrough rates]] 2457341 wikitext text/x-wiki aht128xmgvyfei675libpls47s8q94v 0 458828 2457332 2361188 2026-09-15T08:31:11Z MABot 10804 Bot: Fixing double redirect from [[Test Kitchen/Measuring clickthrough rates]] to [[Test Kitchen/Archive/Measuring clickthrough rates]] 2457332 wikitext text/x-wiki aht128xmgvyfei675libpls47s8q94v 0 458909 2457334 2361446 2026-09-15T08:31:31Z MABot 10804 Bot: Fixing double redirect from [[Test Kitchen/Automated analysis of experiments]] to [[Test Kitchen/Archive/Automated analysis of experiments]] 2457334 wikitext text/x-wiki iw5oshcf9tddzuqg135vvhhvg9gn50i 0 458910 2457335 2361447 2026-09-15T08:31:41Z MABot 10804 Bot: Fixing double redirect from [[Test Kitchen/Automated analysis of experiments/Prepared metrics]] to [[Test Kitchen/Archive/Automated analysis of experiments/Prepared metrics]] 2457335 wikitext text/x-wiki ea3149809diewh4m0ft0plt8xxtgcr2 0 458980 2457336 2361517 2026-09-15T08:31:51Z MABot 10804 Bot: Fixing double redirect from [[Test Kitchen/Measuring clickthrough rates]] to [[Test Kitchen/Archive/Measuring clickthrough rates]] 2457336 wikitext text/x-wiki aht128xmgvyfei675libpls47s8q94v 0 458982 2457337 2361519 2026-09-15T08:32:00Z MABot 10804 Bot: Fixing double redirect from [[Test Kitchen/Measuring clickthrough rates]] to [[Test Kitchen/Archive/Measuring clickthrough rates]] 2457337 wikitext text/x-wiki aht128xmgvyfei675libpls47s8q94v 0 459041 2456970 2449218 2026-09-14T12:51:09Z KSoučková-WMF 35993 /* Post-rollout */ add cleaning up old images 2456970 wikitext text/x-wiki j3jhkkjfe306tovroc22302r0r8rax9 0 459290 2457382 2456782 2026-09-15T09:34:22Z JAllemandou (WMF) 37709 Update for 2026-09-15 train and previous 2457382 wikitext text/x-wiki 3k2bu4rlz553gv4tewfqyz5k1905ted 0 459407 2457330 2361020 2026-09-15T08:30:51Z MABot 10804 Bot: Fixing double redirect from [[Test Kitchen/Automated analysis of experiments]] to [[Test Kitchen/Archive/Automated analysis of experiments]] 2457330 wikitext text/x-wiki iw5oshcf9tddzuqg135vvhhvg9gn50i 0 459409 2457331 2361024 2026-09-15T08:31:01Z MABot 10804 Bot: Fixing double redirect from [[Test Kitchen/Automated analysis of experiments/Prepared metrics]] to [[Test Kitchen/Archive/Automated analysis of experiments/Prepared metrics]] 2457331 wikitext text/x-wiki ea3149809diewh4m0ft0plt8xxtgcr2 0 459488 2457333 2361187 2026-09-15T08:31:21Z MABot 10804 Bot: Fixing double redirect from [[Test Kitchen/Measuring clickthrough rates]] to [[Test Kitchen/Archive/Measuring clickthrough rates]] 2457333 wikitext text/x-wiki aht128xmgvyfei675libpls47s8q94v 0 459489 2457339 2361189 2026-09-15T08:32:21Z MABot 10804 Bot: Fixing double redirect from [[Test Kitchen/Measuring clickthrough rates]] to [[Test Kitchen/Archive/Measuring clickthrough rates]] 2457339 wikitext text/x-wiki aht128xmgvyfei675libpls47s8q94v 0 459699 2457170 2456698 2026-09-14T19:29:21Z Stashbot 7414 ejegg: standalone (IPN listener) SmashPig upgraded from 1fe49a1d to b4182208 2457170 wikitext text/x-wiki h6ha4t4qrzvaqpht4ab448cw9p5m5au 2457251 2457170 2026-09-15T02:37:05Z Stashbot 7414 ejegg: disabled donations queue consumer for civi update 2457251 wikitext text/x-wiki 2yp8b1rxu60if7af99dz778go1rpjjz 2457252 2457251 2026-09-15T02:38:58Z Stashbot 7414 ejegg: civicrm upgraded from 9436540f to ab17ae45 2457252 wikitext text/x-wiki nx7bvvcu6p2oro76f3mj6eegsepxwuy 2457256 2457252 2026-09-15T03:35:43Z Stashbot 7414 ejegg: restarted donations queue consumer 2457256 wikitext text/x-wiki 6p8mcsy421z7lg4wkouwlfmsmx6dvdm 0 460191 2457354 2428991 2026-09-15T08:49:48Z AKlapper (WMF) 421 a11y: Mark decorative icons as such per https://www.w3.org/WAI/tutorials/images/decorative/ (try a screenreader software) 2457354 wikitext text/x-wiki 6vqiz8ztjuaam93lwtx8uceum4ia6vi 2457363 2457354 2026-09-15T09:01:39Z MLechvien-WMF 49197 2457363 wikitext text/x-wiki n2shnrp4kxor17kw3herqyi4rtnjo1h 2457368 2457363 2026-09-15T09:06:55Z AKlapper (WMF) 421 Do not (ab)use HTML tables for layout purposes (non-tabular data). Use a flex layout to wrap items on smaller screens (and output less confusing noise in screenreader software) 2457368 wikitext text/x-wiki qp0iteaf3z5t55dzc8p27s86nhgkgwx 2457370 2457368 2026-09-15T09:08:23Z AKlapper (WMF) 421 2457370 wikitext text/x-wiki s6ub3edpdz7wdtkq07jsqnmzo4ccd9e 0 460192 2457369 2439732 2026-09-15T09:07:16Z MLechvien-WMF 49197 Added link to Phab form to create the Epic 2457369 wikitext text/x-wiki i3c47y8l4wldk8so33r36e8dlteg6d6 2457371 2457369 2026-09-15T09:09:00Z MLechvien-WMF 49197 2457371 wikitext text/x-wiki 6a45915b8eiwfjjd66ps1f6bopwd4yk 0 460366 2457118 2456502 2026-09-14T17:20:13Z TBurmeister (WMF) 27417 Move BFS section and add links to examples subpage throughout 2457118 wikitext text/x-wiki rp4kuxla4srjvgde2hko1leigvid3dq 0 460417 2457401 2456449 2026-09-15T10:42:42Z Kevin Bazira 14737 /* Capabilities & Limitations */ tool-calling is now supported 2457401 wikitext text/x-wiki 4aqql31phb0uorkxyvczicdp1je34rn 2457414 2457401 2026-09-15T11:37:32Z Kevin Bazira 14737 add tool calling documentation 2457414 wikitext text/x-wiki evyyv7bxvp5sxp91zz0whb3su6fpwco 0 460424 2457084 2456529 2026-09-14T15:41:47Z RCoccioli (WMF) 7416 Mark 1.6 as Done (pinged Data Persistence about it) 2457084 wikitext text/x-wiki 6d0xumdw0j66kgexlf59o2tuxwi5pjt 2457385 2457084 2026-09-15T09:41:38Z RCoccioli (WMF) 7416 Add sign-offs and date, add category 2457385 wikitext text/x-wiki jnhydr9xsrimgy2osqiea3q6y7olric 0 460582 2457176 2454901 2026-09-14T19:54:41Z TBurmeister (WMF) 27417 Revise to use active voice, add formatting, and remove implementation details covered in Query Rewriter Tool markdown 2457176 wikitext text/x-wiki 1f5ts9sab0g9o412x3y4i474jeit1td 2 460586 2457302 2455943 2026-09-15T06:45:35Z SSapaty (WMF) 28955 2457302 wikitext text/x-wiki aplyld9k0rqu8ds9e4f4x5inqjlf4ef 2457303 2457302 2026-09-15T06:46:40Z SSapaty (WMF) 28955 2457303 wikitext text/x-wiki ax7n5cpdxiq3uc030ml5j5e4boishp1 0 460602 2457106 2456804 2026-09-14T17:06:30Z TBurmeister (WMF) 27417 Cleanup headings and formatting 2457106 wikitext text/x-wiki o97o6x3pd9pm89ta5exga0pbn1deqow 2457247 2457106 2026-09-15T01:00:21Z AWesterinen-WMF 54189 /* GAS maxIterations compared to pathSearch maxDepth */ 2457247 wikitext text/x-wiki 38ltpftwsq56l0p7xep0n2ffgcf44td 2457248 2457247 2026-09-15T01:24:55Z AWesterinen-WMF 54189 /* Overview */ 2457248 wikitext text/x-wiki f3ik2grygkzy2w1sxpzp3tqrpgexr3q 1 460617 2457115 2456926 2026-09-14T17:12:10Z BCornwall-WMF 31521 /* When do we need code review? */ Reply 2457115 wikitext text/x-wiki dqjs0upyyy4c085704vbfb5kqd4rpez 2457116 2457115 2026-09-14T17:14:08Z BCornwall-WMF 31521 /* Write a clear commit message */ Reply 2457116 wikitext text/x-wiki pbaz4f419kmlgkr2a7nijdjus4pkgkb 2457119 2457116 2026-09-14T17:22:03Z BCornwall-WMF 31521 /* Can we change how we do +1/+2 while we're at it? */ new section 2457119 wikitext text/x-wiki mqfniecnm9i9d5mx8dwqk32zvjh9tqm 1 460631 2457189 2454880 2026-09-14T20:07:03Z TBurmeister (WMF) 27417 /* Thoughts about splitting this page into one page for each Blazegraph service/function? */ new section 2457189 wikitext text/x-wiki 89ybuumovp84cjgebq6e0z96pi5lxyb 0 460646 2457202 2456037 2026-09-14T20:42:04Z BKing (WMF) 29017 2457202 wikitext text/x-wiki i6c164lociuw54q29h2i4lujc1pe82e 2457203 2457202 2026-09-14T20:42:32Z BKing (WMF) 29017 2457203 wikitext text/x-wiki 4lpso6ulpa40kg12sjjjdnbwqf8x3w2 0 460661 2457042 2026-09-14T14:21:21Z Martin Urbanec (WMF) 37730 Redirected page to [[Data Gateway]] 2457042 wikitext text/x-wiki 88qwgv7m3yt9eoshi8g42r755ndnuhp 1 460663 2457103 2026-09-14T16:52:48Z BCornwall-WMF 31521 /* General requestctl usage should go in the code repo, not in a wiki */ new section 2457103 wikitext text/x-wiki iffq0pqo5h57gzt4pj2dvc9fd5j5wk2 0 460664 2457108 2026-09-14T17:07:23Z BCornwall-WMF 31521 BCornwall-WMF moved page [[Style guidelines]] to [[User:BCornwall-WMF/Style guidelines]] 2457108 wikitext text/x-wiki 9mds30v9uixwqmrf7psm5kmb4t37bot 1 460665 2457110 2026-09-14T17:07:23Z BCornwall-WMF 31521 BCornwall-WMF moved page [[Talk:Style guidelines]] to [[User talk:BCornwall-WMF/Style guidelines]] 2457110 wikitext text/x-wiki t06amnz6mwj1siawqph8l0cc9i67ywe 2 460666 2457216 2026-09-14T22:19:53Z Mfield 51590 Mfield moved page [[User:Wheatley2]] to [[User:Madéquis]]: Automatically moved page while renaming the user "[[Special:CentralAuth/Wheatley2|Wheatley2]]" to "[[Special:CentralAuth/Madéquis|Madéquis]]" 2457216 wikitext text/x-wiki hvxfnzwgrn3wttgnu1vyrk7f5dkdcor 0 460667 2457253 2026-09-15T02:47:49Z AWesterinen-WMF 54189 Created page with "This page provides query examples to illustrate and explain how Blazegraph label service requests can be rewritten to execute on the new QLever backend/using standard SPARQL 1.1 syntax. For background and additional explanations, see the main page: [[Wikidata Query Service/Migration/Rewrite of Label Service]]. __TOC__ == Overview == The examples exercise outputting an entity's label, description, and/or aliases, honoring a language priority list with fallback. There..." 2457253 wikitext text/x-wiki 6xqklhk3yw0e7afguq82cxbssdgnlzh 2 460668 2457305 2026-09-15T06:53:22Z SSapaty (WMF) 28955 Draft of Python equivalent of my first PHP tool 2457305 wikitext text/x-wiki p5viqcx4txt9x3fwqm2upred3k8xhm2 2457306 2457305 2026-09-15T06:58:10Z SSapaty (WMF) 28955 Add categories 2457306 wikitext text/x-wiki pdxfxnowpz36uptr3u0vzpeiqcclem9 2457311 2457306 2026-09-15T07:19:56Z SSapaty (WMF) 28955 update repo url 2457311 wikitext text/x-wiki d7litptfm62en05eledmv1pdimxlaxv 2457312 2457311 2026-09-15T07:22:09Z SSapaty (WMF) 28955 /* Step 1: Create a new tool account */ fix repo url 2457312 wikitext text/x-wiki jfasmwtecqqd17yddqfz46ild635qw2 12 460669 2457313 2026-09-15T07:29:14Z SSapaty (WMF) 28955 Python version of my first PHP tool 2457313 wikitext text/x-wiki jfasmwtecqqd17yddqfz46ild635qw2 2457316 2457313 2026-09-15T08:05:16Z SSapaty (WMF) 28955 /* Connecting to the replicas */ code formatting 2457316 wikitext text/x-wiki tv8hwvgd5tusahdbefdgyck9rjno325 2457323 2457316 2026-09-15T08:22:38Z SSapaty (WMF) 28955 /* How to create a basic Python Flask webservice */ 2457323 wikitext text/x-wiki 65s54v6fex9p6w5xtral1nfoqaj1bbz 2457324 2457323 2026-09-15T08:22:56Z SSapaty (WMF) 28955 /* Connecting to the replicas */ 2457324 wikitext text/x-wiki cd2cbl0k8ckxthv2us68gzvxqxn3u5t 2457349 2457324 2026-09-15T08:46:30Z SSapaty (WMF) 28955 /* Connecting to the replicas */ code formatting 2457349 wikitext text/x-wiki h7wgkqk76v6hzdiqcbd7bcxo0pvbmym 2457351 2457349 2026-09-15T08:48:53Z SSapaty (WMF) 28955 /* Troubleshooting */ 2457351 wikitext text/x-wiki 8yvh5t7drqa37enc4m9a5s552wyoc2e