Wikitech labswiki https://wikitech.wikimedia.org/wiki/Main_Page MediaWiki 1.48.0-wmf.3 first-letter Media Special Talk User User talk Wikitech Wikitech talk File File talk MediaWiki MediaWiki talk Template Template talk Help Help talk Category Category talk Obsolete Obsolete talk OfficeIT OfficeIT talk Tool Tool talk Nova Resource Nova Resource Talk Heira Heira Talk TimedText TimedText talk Module Module talk Nova Resource:Tools/SAL 498 3086 2479141 2478279 2026-11-09T11:42:25Z Stashbot 7414 tlepage@cloudcumin1001: START - Cookbook wmcs.toolforge.k8s.image.copy_to_registry for image docker-registry.svc.toolforge.org/nginx:1.30.6 (T440736) 2479141 wikitext text/x-wiki 0xynucihrw5apa7grv1sixzuoh5zwyk 2479142 2479141 2026-11-09T11:42:49Z Stashbot 7414 tlepage@cloudcumin1001: END (PASS) - Cookbook wmcs.toolforge.k8s.image.copy_to_registry (exit_code=0) for image docker-registry.svc.toolforge.org/nginx:1.30.6 (T440736) 2479142 wikitext text/x-wiki 92265v8sk74i2ozyieqswrz5sh1vvuz Deployments 0 4108 2479023 2479015 2026-11-08T12:59:00Z ScheduleDeploymentBot 37566 Add [[gerrit:1367552]] to Monday, November 09 UTC morning backport window 2479023 wikitext text/x-wiki apbxuhqa4hlqi6ohe6ghlhd2yb8isbc 2479024 2479023 2026-11-08T13:07:29Z ScheduleDeploymentBot 37566 Add [[gerrit:1367544]] to Monday, November 09 UTC morning backport window 2479024 wikitext text/x-wiki s87tl729erza0o5c9yyotfpu39w75p5 2479066 2479024 2026-11-08T21:10:01Z TCipriani (WMF) 4895 /* Week of November 09 */ brennen as backup 2479066 wikitext text/x-wiki h64u7tod2yc5vwkoyl99zzs52juew8b 2479067 2479066 2026-11-08T21:11:20Z TCipriani (WMF) 4895 /* Week of November 16 */ jnuche as backuip 2479067 wikitext text/x-wiki g1bfsfu8a99zhv9z21hf0k29chxpt7u 2479097 2479067 2026-11-09T10:24:10Z ScheduleDeploymentBot 37566 Add [[gerrit:1354558]] to Monday, November 09 UTC afternoon backport window 2479097 wikitext text/x-wiki 47dd30yo6hfy0kk4k6acl47tqsj2dyj 2479098 2479097 2026-11-09T10:25:43Z ScheduleDeploymentBot 37566 Add [[gerrit:1367752]] to Monday, November 09 UTC afternoon backport window 2479098 wikitext text/x-wiki daua3eec4jmjzmn66spinol1235quis 2479132 2479098 2026-11-09T11:26:47Z ScheduleDeploymentBot 37566 Add [[gerrit:1367786]] to Monday, November 09 UTC afternoon backport window 2479132 wikitext text/x-wiki r4ncbk2vv29jpyy5jtusjyfxmuuu5zs Server Admin Log 0 7919 2479018 2479014 2026-11-08T12:00:07Z Stashbot 7414 root@deploy2003: helmfile [staging] START helmfile.d/services/shellbox: sync 2479018 wikitext text/x-wiki amgnxshlavzqu9qw5hw233tvmfj9xny 2479019 2479018 2026-11-08T12:00:17Z Stashbot 7414 root@deploy2003: helmfile [staging] DONE helmfile.d/services/shellbox: sync 2479019 wikitext text/x-wiki gz7p3xjdan82o44dutpw9gr157e4qgu 2479020 2479019 2026-11-08T12:00:22Z Stashbot 7414 root@deploy2003: helmfile [codfw] START helmfile.d/services/shellbox-timeline: sync 2479020 wikitext text/x-wiki d1cpzk36mlfksogw19odm8astf986mt 2479021 2479020 2026-11-08T12:00:29Z Stashbot 7414 root@deploy2003: helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: sync 2479021 wikitext text/x-wiki 1cqwla0wkj38orjlzcqd30f73ww0ejl 2479070 2479021 2026-11-09T00:00:07Z Stashbot 7414 root@deploy2003: helmfile [staging] START helmfile.d/services/shellbox: sync 2479070 wikitext text/x-wiki hv3l63zz7t52zc4y77dm28laezw0nyu 2479071 2479070 2026-11-09T00:00:17Z Stashbot 7414 root@deploy2003: helmfile [staging] DONE helmfile.d/services/shellbox: sync 2479071 wikitext text/x-wiki kfldwaet67hdal5c391j37pxi6yf174 2479072 2479071 2026-11-09T00:00:22Z Stashbot 7414 root@deploy2003: helmfile [staging] START helmfile.d/services/shellbox-timeline: sync 2479072 wikitext text/x-wiki 81bsdlri5xa1tjtrz8how8ngx9vbdev 2479073 2479072 2026-11-09T00:00:32Z Stashbot 7414 root@deploy2003: helmfile [staging] DONE helmfile.d/services/shellbox-timeline: sync 2479073 wikitext text/x-wiki 1c6qofwlb9y2b9q52opijmud2kzisl2 2479074 2479073 2026-11-09T00:00:35Z Stashbot 7414 root@deploy2003: helmfile [codfw] START helmfile.d/services/shellbox-timeline: sync 2479074 wikitext text/x-wiki 96nidy71zsekrkljfr3dtnd51zybp8c 2479075 2479074 2026-11-09T00:00:42Z Stashbot 7414 root@deploy2003: helmfile [codfw] DONE helmfile.d/services/shellbox-timeline: sync 2479075 wikitext text/x-wiki glrhmu5hhats3120mmfekz1cfcfysw7 2479078 2479075 2026-11-09T02:00:20Z Stashbot 7414 mwpresync@deploy2003: Started scap build-images: Publishing wmf/next image 2479078 wikitext text/x-wiki g0dzjaa2bfkc1r22wz517jqucmdvh5z 2479079 2479078 2026-11-09T02:08:21Z Stashbot 7414 mwpresync@deploy2003: Finished scap build-images: Publishing wmf/next image (duration: 08m 01s) 2479079 wikitext text/x-wiki plqlnzxwxxw2poj14qd9oxq3zcecapl 2479084 2479079 2026-11-09T08:02:59Z Stashbot 7414 mlitn@deploy2003: Started scap sync-world: Backport for [[gerrit:1367552|Squashed diff to master]] (1.48.0-wmf.3) 2479084 wikitext text/x-wiki 5gh1u5klsnomi8gbjzir3kxn24hw2xi 2479085 2479084 2026-11-09T08:23:45Z Stashbot 7414 mlitn@deploy2003: mlitn: Backport for [[gerrit:1367552|Squashed diff to master]] (1.48.0-wmf.3) synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2479085 wikitext text/x-wiki ha3pbf99x1hm3r9jmv51277v3znxgj2 2479086 2479085 2026-11-09T08:24:21Z Stashbot 7414 mlitn@deploy2003: mlitn: Continuing with deployment 2479086 wikitext text/x-wiki e9appdo2p6qpgm4hiw9i4chpuea90s0 2479087 2479086 2026-11-09T08:39:36Z Stashbot 7414 mlitn@deploy2003: Finished scap sync-world: Backport for [[gerrit:1367552|Squashed diff to master]] (1.48.0-wmf.3) (duration: 36m 37s) 2479087 wikitext text/x-wiki 5tpmx8r1ji6n6yl8oy215gtc6f4on4f 2479088 2479087 2026-11-09T08:41:30Z Stashbot 7414 mlitn@deploy2003: Started scap sync-world: Backport for [[gerrit:1367544|Enable {{USERLANGUAGE}} on bdwikimedia (T444031)]] 2479088 wikitext text/x-wiki a9xm5gfhpa1jm84cv8wfqd0ods74eil 2479089 2479088 2026-11-09T09:10:06Z Stashbot 7414 jgiannelos@deploy2003: helmfile [staging] START helmfile.d/services/thumbor: apply 2479089 wikitext text/x-wiki t76w9txb67pb593jn2qf2839wi0foia 2479090 2479089 2026-11-09T09:10:22Z Stashbot 7414 jgiannelos@deploy2003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2479090 wikitext text/x-wiki ojjhq5xbwf5gzlq3g2jow612nncteer 2479091 2479090 2026-11-09T09:19:59Z Stashbot 7414 jgiannelos@deploy2003: helmfile [staging] START helmfile.d/services/thumbor: apply 2479091 wikitext text/x-wiki pb4mau6amti9r8ivjj27ymjzds1z3ya 2479092 2479091 2026-11-09T09:20:17Z Stashbot 7414 jgiannelos@deploy2003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2479092 wikitext text/x-wiki hckmgvn7jnhwntart4m081bgpbbs6ih 2479093 2479092 2026-11-09T09:21:51Z Stashbot 7414 jgiannelos@deploy2003: helmfile [staging] START helmfile.d/services/thumbor: apply 2479093 wikitext text/x-wiki nv2poo8b6ve8v03e871xqof06efq4g4 2479094 2479093 2026-11-09T09:21:56Z Stashbot 7414 jgiannelos@deploy2003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2479094 wikitext text/x-wiki 7ba975mp1gfpf71qiflavjoxfgbg35i 2479095 2479094 2026-11-09T10:00:50Z Stashbot 7414 jgiannelos@deploy2003: helmfile [staging] START helmfile.d/services/thumbor: apply 2479095 wikitext text/x-wiki cdit4bv1efgf1is3rmss18t9isbsuzn 2479096 2479095 2026-11-09T10:01:02Z Stashbot 7414 jgiannelos@deploy2003: helmfile [staging] DONE helmfile.d/services/thumbor: apply 2479096 wikitext text/x-wiki qigixa7ti9rsb7myccynvkmegwwq4yi 2479099 2479096 2026-11-09T10:25:59Z Stashbot 7414 tchanders@deploy2003: Started scap sync-world: Backport for [[gerrit:1367749|Take Special:AbuseReview vandalism queue out of alpha on frwiki (T443815)]] 2479099 wikitext text/x-wiki 7l0croy7s11y23ir6jgn43nzl1rk0zs 2479100 2479099 2026-11-09T10:32:17Z Stashbot 7414 tchanders@deploy2003: tchanders: Backport for [[gerrit:1367749|Take Special:AbuseReview vandalism queue out of alpha on frwiki (T443815)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2479100 wikitext text/x-wiki 5l3k2dpw9w5jton30osivq11i6vbkg9 2479101 2479100 2026-11-09T10:33:45Z Stashbot 7414 tchanders@deploy2003: tchanders: Continuing with deployment 2479101 wikitext text/x-wiki p1u362igjthe7bdisauzjn60gjhu8vw 2479102 2479101 2026-11-09T10:41:29Z Stashbot 7414 tchanders@deploy2003: Finished scap sync-world: Backport for [[gerrit:1367749|Take Special:AbuseReview vandalism queue out of alpha on frwiki (T443815)]] (duration: 15m 29s) 2479102 wikitext text/x-wiki p8qvrsqnp31smi8io6u2dgmpwpacurv 2479103 2479102 2026-11-09T10:42:48Z Stashbot 7414 Tchanders: Updated WikimediaAntiAbuse AbuseReview private code 2479103 wikitext text/x-wiki 4ejb83tjwktyykth86ddl43sippxayb 2479104 2479103 2026-11-09T10:47:00Z Stashbot 7414 urbanecm@deploy2003: Started scap sync-world: Backport for [[gerrit:1363328|GrowthExperiments: Remove settings that nothing reads (T443648)]] 2479104 wikitext text/x-wiki nrd5f36lizqjs8tqdd0g3yvdlp2qzux 2479105 2479104 2026-11-09T10:53:20Z Stashbot 7414 urbanecm@deploy2003: urbanecm: Backport for [[gerrit:1363328|GrowthExperiments: Remove settings that nothing reads (T443648)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. 2479105 wikitext text/x-wiki 6h39s9fhsjt0zoz3k1za8ll10y0b2fv 2479106 2479105 2026-11-09T10:53:57Z Stashbot 7414 urbanecm@deploy2003: urbanecm: Continuing with deployment 2479106 wikitext text/x-wiki 546dhatphflmhc6bfzfyisq3hhgal9p 2479107 2479106 2026-11-09T10:58:38Z Stashbot 7414 btullis@cumin1004: conftool action : set/pooled=inactive; selector: name=dse-k8s-wdqs-test1001.eqiad.wmnet 2479107 wikitext text/x-wiki rfcd52rwbv37b6yypbocvdbn08trksn 2479108 2479107 2026-11-09T10:58:48Z Stashbot 7414 btullis@cumin1004: conftool action : set/pooled=inactive; selector: name=dse-k8s-wdqs-test2001.codfw.wmnet 2479108 wikitext text/x-wiki 9yyq3s7au3azufyqcra5vtn4bglrkow 2479109 2479108 2026-11-09T10:59:54Z Stashbot 7414 urbanecm@deploy2003: Finished scap sync-world: Backport for [[gerrit:1363328|GrowthExperiments: Remove settings that nothing reads (T443648)]] (duration: 12m 54s) 2479109 wikitext text/x-wiki 1mhxr4sfdjnvlvx7uegiggehoecug04 2479110 2479109 2026-11-09T11:10:12Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.rename from dse-k8s-wdqs-test1001 to dse-k8s-worker1049 2479110 wikitext text/x-wiki r21lsuqvd5qysbema9pbshe317xbvbs 2479111 2479110 2026-11-09T11:10:23Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.rename from dse-k8s-wdqs-test2001 to dse-k8s-worker2012 2479111 wikitext text/x-wiki jaqr3acrfid0if2fu5z9n3rfwdvauy1 2479112 2479111 2026-11-09T11:10:24Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.dns.netbox 2479112 wikitext text/x-wiki 8f4c6yjqtyx83eva6f5u7okpveopd0q 2479113 2479112 2026-11-09T11:16:15Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.dns.netbox 2479113 wikitext text/x-wiki ks82r8rd6wmaaenyuj449jbmykm56at 2479114 2479113 2026-11-09T11:21:10Z Stashbot 7414 btullis@cumin1004: END (FAIL) - Cookbook sre.dns.netbox (exit_code=99) 2479114 wikitext text/x-wiki jjadjslyd1swwkg8tm59305cjcitluv 2479115 2479114 2026-11-09T11:21:35Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.dns.netbox 2479115 wikitext text/x-wiki 4ey5cqiheofsy0j6rbg3s4voz71dndf 2479116 2479115 2026-11-09T11:22:21Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming dse-k8s-wdqs-test1001 to dse-k8s-worker1049 - btullis@cumin1004" 2479116 wikitext text/x-wiki 7uks9xd5l6whw9d3gco7rkb3tw9cq88 2479117 2479116 2026-11-09T11:24:27Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming dse-k8s-wdqs-test1001 to dse-k8s-worker1049 - btullis@cumin1004" 2479117 wikitext text/x-wiki o127ujqmro3w5irqzo7gowwiqbvquzg 2479118 2479117 2026-11-09T11:24:29Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2479118 wikitext text/x-wiki hfgnfhnrg1e72nkzn56q9z6o5a1mfgd 2479119 2479118 2026-11-09T11:24:30Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.dns.wipe-cache dse-k8s-worker1049 on all recursors 2479119 wikitext text/x-wiki iveokn92msnwi0nvuyw2lwt4bxrpepf 2479120 2479119 2026-11-09T11:24:31Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) dse-k8s-worker1049 on all recursors 2479120 wikitext text/x-wiki bhkwgxmmjowfuhjkm4mnqko4xjitxjh 2479121 2479120 2026-11-09T11:24:32Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.network.configure-switch-interfaces for host dse-k8s-worker1049 2479121 wikitext text/x-wiki 5cpnkxm7843m5314v6y5rejsm15yn8q 2479122 2479121 2026-11-09T11:24:56Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dse-k8s-worker1049 2479122 wikitext text/x-wiki b01xvc2mnr3bjo7w8kegub54vr9lmfa 2479123 2479122 2026-11-09T11:25:30Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming dse-k8s-wdqs-test2001 to dse-k8s-worker2012 - btullis@cumin1004" 2479123 wikitext text/x-wiki 6n1mlbjray1rior3eiq8y2xvwsu6pn7 2479124 2479123 2026-11-09T11:25:33Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from dse-k8s-wdqs-test1001 to dse-k8s-worker1049 2479124 wikitext text/x-wiki b83b6293u2bh40mek213iqaefdb3qr4 2479125 2479124 2026-11-09T11:25:34Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Renaming dse-k8s-wdqs-test2001 to dse-k8s-worker2012 - btullis@cumin1004" 2479125 wikitext text/x-wiki g4cqtd94jjs28x917m58jezdsko5set 2479126 2479125 2026-11-09T11:25:35Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.dns.netbox (exit_code=0) 2479126 wikitext text/x-wiki mvpsbejqf4zz5ueecruknj4fjjjoxo9 2479127 2479126 2026-11-09T11:25:36Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.dns.wipe-cache dse-k8s-worker2012 on all recursors 2479127 wikitext text/x-wiki keo0yjwd5738ny6ksq1s862bmtp6iwa 2479128 2479127 2026-11-09T11:25:37Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.dns.wipe-cache (exit_code=0) dse-k8s-worker2012 on all recursors 2479128 wikitext text/x-wiki kjvmk6b92wcv1jpoq9125xahbdpdb40 2479129 2479128 2026-11-09T11:25:39Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.network.configure-switch-interfaces for host dse-k8s-worker2012 2479129 wikitext text/x-wiki 5n1lnncgc6pv79jtcwfizgdeeznx43p 2479130 2479129 2026-11-09T11:26:24Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.network.configure-switch-interfaces (exit_code=0) for host dse-k8s-worker2012 2479130 wikitext text/x-wiki 85f5h46ogc3u7cb7a3cchymbvxrnhud 2479131 2479130 2026-11-09T11:26:33Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hardware.upgrade-firmware upgrade firmware for hosts ['dse-k8s-worker1049.eqiad.wmnet'] 2479131 wikitext text/x-wiki 1aptwaqmhhh83o52i75s0fnymq8umst 2479133 2479131 2026-11-09T11:27:00Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.rename (exit_code=0) from dse-k8s-wdqs-test2001 to dse-k8s-worker2012 2479133 wikitext text/x-wiki 513b0v4t0zj9yqnndlr0to8f6m6v755 2479134 2479133 2026-11-09T11:30:58Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reimage for host dse-k8s-worker2012.codfw.wmnet with OS bookworm 2479134 wikitext text/x-wiki f4pg6kgcee81pru63ua4u7kttikkrzx 2479135 2479134 2026-11-09T11:31:07Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.dhcp for host dse-k8s-worker2012.codfw.wmnet (push config only) 2479135 wikitext text/x-wiki 5acmq6dnb1n9xp2m73rn9fg2s4njd8u 2479136 2479135 2026-11-09T11:31:12Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host dse-k8s-worker2012.codfw.wmnet (push config only) 2479136 wikitext text/x-wiki n76jkcr4ctqjydnsbjv2775g5hh03e2 2479137 2479136 2026-11-09T11:33:45Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hardware.upgrade-firmware (exit_code=0) upgrade firmware for hosts ['dse-k8s-worker1049.eqiad.wmnet'] 2479137 wikitext text/x-wiki 7q47w7m7866wwat5yf1u6sc91ws5xcm 2479138 2479137 2026-11-09T11:34:40Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.reimage for host dse-k8s-worker1049.eqiad.wmnet with OS bookworm 2479138 wikitext text/x-wiki o98wvq2idqkcysnofen0v1jo7xwj7q9 2479139 2479138 2026-11-09T11:34:48Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.dhcp for host dse-k8s-worker1049.eqiad.wmnet (push config only) 2479139 wikitext text/x-wiki 3wi3cu7pch78l1e5xzu4am9cj7xy3ll 2479140 2479139 2026-11-09T11:34:52Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host dse-k8s-worker1049.eqiad.wmnet (push config only) 2479140 wikitext text/x-wiki l0sewpot900rckvyew82qvxq0gxib2l 2479143 2479140 2026-11-09T11:45:59Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.dhcp for host dse-k8s-worker2012.codfw.wmnet (remove config only) 2479143 wikitext text/x-wiki a72buqdr5djt71ooha5d4bjmiy996yd 2479144 2479143 2026-11-09T11:46:05Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host dse-k8s-worker2012.codfw.wmnet (remove config only) 2479144 wikitext text/x-wiki qahearfbpkjlvft9q5jlc9cg2gwp5gi 2479145 2479144 2026-11-09T11:48:38Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on dse-k8s-worker2012.codfw.wmnet with reason: host reimage 2479145 wikitext text/x-wiki t5wuc9qxxohmuosr6fpiyajw6v56thd 2479146 2479145 2026-11-09T11:52:36Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.dhcp for host dse-k8s-worker1049.eqiad.wmnet (remove config only) 2479146 wikitext text/x-wiki 67afbtwsua9u0ll3na5j4xf0rffdc6p 2479147 2479146 2026-11-09T11:52:40Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.dhcp (exit_code=0) for host dse-k8s-worker1049.eqiad.wmnet (remove config only) 2479147 wikitext text/x-wiki ryrhkpvk0ndqquykmdde8n5fzg1bg7q 2479148 2479147 2026-11-09T11:54:00Z Stashbot 7414 btullis@cumin1004: END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on dse-k8s-worker2012.codfw.wmnet with reason: host reimage 2479148 wikitext text/x-wiki 3ymec3owqzm89su79oluxgd2uw6yp2v 2479149 2479148 2026-11-09T11:55:01Z Stashbot 7414 btullis@cumin1004: START - Cookbook sre.hosts.downtime for 2:00:00 on dse-k8s-worker1049.eqiad.wmnet with reason: host reimage 2479149 wikitext text/x-wiki pr1ad2leocowwdrdfwde2fr53bmkwep Release Engineering/SAL 0 17290 2479059 2478933 2026-11-08T16:24:04Z Stashbot 7414 Southparkfan: Delete deployment-echostore02 in Horizon - T436479 2479059 wikitext text/x-wiki 9aikw1etfarak7ogg6jndn9g0rghos1 2479062 2479059 2026-11-08T19:46:42Z Stashbot 7414 Southparkfan: Switch DNS RRs for etcd to deployment-etcd06, decommission deployment-etcd02 and deployment-etcd05 - T436473 2479062 wikitext text/x-wiki q348nebivo6azbozj1tkgpc9oorg5rd Help talk:Toolforge/Toolforge standards committee 13 311299 2479028 2479004 2026-11-08T13:38:13Z Ameisenigel 16760 /* Nominations */ + 2479028 wikitext text/x-wiki 5hud0bzjsh1zlip03ydw563qojap0fq Nova Resource:Tools.cluebotng/SAL 498 443628 2479034 2478999 2026-11-08T13:59:36Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42487482275 (https://github.com/cluebotng/component-configs/commits/9dc5d5efa17f56825669f145bfabd6eb84c81180) 2479034 wikitext text/x-wiki 8xvjtatpxjoiaku1fwabenfe79fooiy 2479046 2479034 2026-11-08T14:05:19Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42487535788 (https://github.com/cluebotng/component-configs/commits/036cdff1b35f023142582fcbc7eed1095df13f08) 2479046 wikitext text/x-wiki l617intzxl3pfal88j2egmo4uhyn1a2 2479052 2479046 2026-11-08T14:10:17Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42487576379 (https://github.com/cluebotng/component-configs/commits/e851b03c8a8f5c65affe9e1655fbb7905114d0f0) 2479052 wikitext text/x-wiki l4ofl7hq94ixtcyt3t529bdaols66jn Nova Resource:Tools.krinklebot/SAL 498 443681 2479077 2256363 2026-11-09T00:40:24Z Stashbot 7414 AntiComposite: toolforge jobs load ~/src/fileprotectionsync/jobs.yaml # bot has not edited for a day, and there's no CronJob anymore 2479077 wikitext text/x-wiki hfewzayp0iasbtk0ejio69ce9ms2wio Nova Resource:Tools.wd-image-positions/SAL 498 443947 2479025 2478972 2026-11-08T13:30:50Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: toolforge envvars create TOOL_OAUTH__CLIENT_ID ff1428e010c8f94f8f17d0d5e61c0c80 2479025 wikitext text/x-wiki g0hkfbydfhil6qar6a99e6h3v9cr7ak 2479026 2479025 2026-11-08T13:31:01Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: toolforge envvars create TOOL_OAUTH__CLIENT_SECRET 2479026 wikitext text/x-wiki kok9t6lp7y1mmn16volnajiia86ea1p 2479027 2479026 2026-11-08T13:34:06Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: deployed d9fab34: Migrate to OAuth 2 using mwoauth2 2479027 wikitext text/x-wiki m3jwbn9eajgq2xyfg2k28hph843eyaj 2479029 2479027 2026-11-08T13:41:21Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: toolforge envvars delete --yes-im-sure TOOL_OAUTH__CONSUMER_KEY 2479029 wikitext text/x-wiki j1vubu492clqtac55zqrk4b8dusv9z8 2479030 2479029 2026-11-08T13:41:26Z Stashbot 7414 wmbot~lucaswerkmeister@tools-bastion-15: toolforge envvars delete --yes-im-sure TOOL_OAUTH__CONSUMER_SECRET 2479030 wikitext text/x-wiki trapflpcvw0rd1a6dvaparerl7sux8y Nova Resource:Tools.integraality/SAL 498 443949 2479068 2478963 2026-11-08T21:15:01Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy 7535d56 (Sort groupings by (-count, key) for stable tie-breaking in wikitext table) for T328534 2479068 wikitext text/x-wiki pewvrgrwktk0c38p9015u6z8vtqhpm7 2479069 2479068 2026-11-08T21:15:03Z Stashbot 7414 wmbot~jeanfred@tools-bastion-15: Deploy ced35fb (Skip year name cell when parsing count in ReportParser) for T438317 2479069 wikitext text/x-wiki 6jqh8vp0ssdcwi36zgyt29rqij3900d Nova Resource:Tools.cluebot3/SAL 498 446211 2479031 2479016 2026-11-08T13:59:28Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42487487035 (https://github.com/cluebotng/component-configs/commits/626a79604f6624870ee9b519d9ab5ba4a75a9d9c) 2479031 wikitext text/x-wiki 1cyz0nsswogr6me23b1c2w0dc4lt7o2 2479040 2479031 2026-11-08T14:02:33Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42487541046 (https://github.com/cluebotng/component-configs/commits/e2bb466346d7884db14f89067638f5906d0fe96d) 2479040 wikitext text/x-wiki l650xa1hwwtz6l4rwx7cltw8q2u74rt 2479048 2479040 2026-11-08T14:05:25Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42487576377 (https://github.com/cluebotng/component-configs/commits/e851b03c8a8f5c65affe9e1655fbb7905114d0f0) 2479048 wikitext text/x-wiki ird86659fq477gv516yfuet353ejioj Map of database maintenance 0 449160 2479076 2479012 2026-11-09T00:01:23Z Dexbot 30554 Bot: Updating the report 2479076 wikitext text/x-wiki gr1vu2sq1x1fkecdspt99jf4f5vzjc8 Nova Resource:Tools.cluebotng-review/SAL 498 452890 2479032 2479002 2026-11-08T13:59:29Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42487482308 (https://github.com/cluebotng/component-configs/commits/9dc5d5efa17f56825669f145bfabd6eb84c81180) 2479032 wikitext text/x-wiki ctjelid8715jb9t0zhqfe2ovseva2in 2479047 2479032 2026-11-08T14:05:21Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42487535872 (https://github.com/cluebotng/component-configs/commits/036cdff1b35f023142582fcbc7eed1095df13f08) 2479047 wikitext text/x-wiki nfy6sxr0ejjoq1ltup4hpcgcrab5281 2479053 2479047 2026-11-08T14:11:03Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42487576388 (https://github.com/cluebotng/component-configs/commits/e851b03c8a8f5c65affe9e1655fbb7905114d0f0) 2479053 wikitext text/x-wiki ge8xhnd3b7lhhtwwybaqlbby8om1iem 2479057 2479053 2026-11-08T15:59:54Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42487576388 (https://github.com/cluebotng/component-configs/commits/e851b03c8a8f5c65affe9e1655fbb7905114d0f0) 2479057 wikitext text/x-wiki id1gzmjy2fc4vo7xg6ixho5nsugeys8 Nova Resource:Tools.cluebotng-staging/SAL 498 458787 2479038 2478997 2026-11-08T14:02:29Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42487482230 (https://github.com/cluebotng/component-configs/commits/9dc5d5efa17f56825669f145bfabd6eb84c81180) 2479038 wikitext text/x-wiki r33qbova7zqxsfqcvtqop3p4zw96w08 2479049 2479038 2026-11-08T14:05:59Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42487576386 (https://github.com/cluebotng/component-configs/commits/e851b03c8a8f5c65affe9e1655fbb7905114d0f0) 2479049 wikitext text/x-wiki r75xze37s0zami22f5uk9ivs5bdg49x Nova Resource:Tools.cluebotng-monitoring/SAL 498 459243 2479043 2479001 2026-11-08T14:03:33Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42487477066 (https://github.com/cluebotng/component-configs/commits/02ed68cf95c253eadeba979b345d248dfb9477f7) 2479043 wikitext text/x-wiki 4ck72kmrvahnle1zrlbymqf2jfuzx1z 2479051 2479043 2026-11-08T14:09:12Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42487576456 (https://github.com/cluebotng/component-configs/commits/e851b03c8a8f5c65affe9e1655fbb7905114d0f0) 2479051 wikitext text/x-wiki cset5sl4d74ivr10ptavfmhlptvds45 Nova Resource:Tools.cluebotng-trainer/SAL 498 459244 2479022 2479017 2026-11-08T12:58:56Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42373423759 (https://github.com/cluebotng/component-configs/commits/0bc0cef490c8c2afb008ff906644dc7fb977bdb6) 2479022 wikitext text/x-wiki bpi3i6ph5l5uie6m2q4etwir9k3igk4 2479039 2479022 2026-11-08T14:02:30Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42487486913 (https://github.com/cluebotng/component-configs/commits/626a79604f6624870ee9b519d9ab5ba4a75a9d9c) 2479039 wikitext text/x-wiki ki0w2wzalmhzihh975mi4fcn3teb2ho 2479042 2479039 2026-11-08T14:03:19Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42487576357 (https://github.com/cluebotng/component-configs/commits/e851b03c8a8f5c65affe9e1655fbb7905114d0f0) 2479042 wikitext text/x-wiki nql9h046g5vbk2tbtgepocsmg3kl0bn 2479060 2479042 2026-11-08T17:27:50Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42504935665 (https://github.com/cluebotng/component-configs/commits/e7413dba8702990176d7157963daf69127d894fc) 2479060 wikitext text/x-wiki ca3d2plum8wawhwyldpc7jh66jckmll 2479061 2479060 2026-11-08T17:29:46Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42505001795 (https://github.com/cluebotng/component-configs/commits/3d315d295fbd9ddb713c5f5abe3e6e921e02f904) 2479061 wikitext text/x-wiki n31ajilsmihx9148vx0bzdlga25shy6 Nova Resource:Tools.cluebotng-editsets/SAL 498 459255 2479036 2478996 2026-11-08T14:01:26Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42487486987 (https://github.com/cluebotng/component-configs/commits/626a79604f6624870ee9b519d9ab5ba4a75a9d9c) 2479036 wikitext text/x-wiki n2l2s58fac11tnozsshfox9n940amjs 2479045 2479036 2026-11-08T14:05:06Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42487576438 (https://github.com/cluebotng/component-configs/commits/e851b03c8a8f5c65affe9e1655fbb7905114d0f0) 2479045 wikitext text/x-wiki 6f3b6xi9pkkhnlho63o1epagndyxjyw Nova Resource:Tools.cluebot-syncer/SAL 498 459263 2479033 2478992 2026-11-08T13:59:31Z Stashbot 7414 wm-bot2: Deployment failed: https://github.com/cluebotng/component-configs/actions/runs/42487486901 (https://github.com/cluebotng/component-configs/commits/626a79604f6624870ee9b519d9ab5ba4a75a9d9c) 2479033 wikitext text/x-wiki s4uw6izfssnfaep5y4usf3sy8os1teo 2479041 2479033 2026-11-08T14:03:07Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42487569287 (https://github.com/cluebotng/component-configs/commits/1a8ef68cdb6e06e915b1d61d24c3f2defcf942d2) 2479041 wikitext text/x-wiki 4wj3p1sa04ntpdu98tw3k1x8kchbxpm 2479050 2479041 2026-11-08T14:06:34Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42487576409 (https://github.com/cluebotng/component-configs/commits/e851b03c8a8f5c65affe9e1655fbb7905114d0f0) 2479050 wikitext text/x-wiki gu1gwoqvap5hrgxvj6k8kabgb8f370s Nova Resource:Tools.toolforge-functional-runner/SAL 498 459362 2479035 2478986 2026-11-08T14:01:24Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42487486795 (https://github.com/cluebotng/component-configs/commits/626a79604f6624870ee9b519d9ab5ba4a75a9d9c) 2479035 wikitext text/x-wiki l4qa5ymjqgdam3ufvlxdyhdet1svyqa Fundraising/Data and flow/Intacct 0 459517 2479063 2475611 2026-11-08T20:48:22Z EMcnaughton (WMF) 6074 /* Audit Process Documentation for Intacct / Sage */ 2479063 wikitext text/x-wiki s3ufsu0id0d7qxn2qj9yohqonhi3z1g 2479080 2479063 2026-11-09T02:52:48Z EMcnaughton (WMF) 6074 /* Audit Process Documentation for Intacct / Sage */ 2479080 wikitext text/x-wiki p72vloqrge8qlac7nguu78uyeyyzi67 SLO/mediawiki.page change.v1 0 460608 2479083 2478896 2026-11-09T08:01:56Z APizzata-WMF 47941 freshness 2479083 wikitext text/x-wiki me8uxo0j6xb8d3qyb2p0pqgj7uh2mad Talk:Hardware-backed SSH keys 1 460908 2479054 2475550 2026-11-08T14:36:19Z Tgr (WMF) 39134 /* Multiple keys */ new section 2479054 wikitext text/x-wiki oie64nr4wu3q854s279d9kl7cszvxpk 2479055 2479054 2026-11-08T14:40:04Z Tgr (WMF) 39134 /* Fingerprint check */ new section 2479055 wikitext text/x-wiki gdqfalosq8os47068q0bcul6eotbklr 2479056 2479055 2026-11-08T15:41:43Z Matma Rex 562 /* Multiple keys */ Reply 2479056 wikitext text/x-wiki cmvx0feybacjoccbiligiy20m6w5zey 2479058 2479056 2026-11-08T16:21:25Z Tgr (WMF) 39134 /* Multiple keys */ Reply 2479058 wikitext text/x-wiki f8vv229tvfgq49vwpfgyw8yfmmaqbno Nova Resource:Tools.cluebot-documentation/SAL 498 460945 2479037 2478990 2026-11-08T14:01:29Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42487486856 (https://github.com/cluebotng/component-configs/commits/626a79604f6624870ee9b519d9ab5ba4a75a9d9c) 2479037 wikitext text/x-wiki lh3v6c8vola6acseidzpq5xs8ta2gi9 2479044 2479037 2026-11-08T14:04:31Z Stashbot 7414 wm-bot2: Deployment completed: https://github.com/cluebotng/component-configs/actions/runs/42487576505 (https://github.com/cluebotng/component-configs/commits/e851b03c8a8f5c65affe9e1655fbb7905114d0f0) 2479044 wikitext text/x-wiki kltabn9ur2vh6r20ydu6otsiwrqo30a Fundraising/Data and flow/Intacct-api 0 460953 2479064 2026-11-08T20:49:50Z EMcnaughton (WMF) 6074 Created page with " Check if the instance is live / credentials work wmf-cv api4 FinanceIntegration.ping isEndowment=0 isStaging=1 (isEndowment defaults to 0/false and isStaging defaults to 1/True)" 2479064 wikitext text/x-wiki mmi8xta6lodj61h46n94yad8pv4wujj 2479065 2479064 2026-11-08T20:51:51Z EMcnaughton (WMF) 6074 2479065 wikitext text/x-wiki 3m5sc4z23ygltqhwh74i8eev2a1uw1a 2479081 2479065 2026-11-09T02:54:06Z EMcnaughton (WMF) 6074 2479081 wikitext text/x-wiki pqi2pypddk4dl4b602h4ff2b6hi75uu 2479082 2479081 2026-11-09T06:06:25Z EMcnaughton (WMF) 6074 2479082 wikitext text/x-wiki 6p1d0i4p914um68dalxlms6hvxyhej5