In-reply-to » We also rented a cabin for 5 days, and did a lot of things..

@stigatle@yarn.stigatle.no It looks like your some kind of problem with the reverse proxy in front of yarnd? 🤔I ’m seeing this error: incomplete chunked encoding error(s)

Image

I don’t know anything about this though, tbh I’ve never seen this before myself 🤔”

⤋ Read More
In-reply-to » @bender Thank you :) Yeah I've been silent for a while, been so much work and other things to focus on, but now I have vacation, so I missed this place, and wanted to bring it up to speed here as well :)

@stigatle@yarn.stigatle.no I’m doing okay 👌 Busy with work as you can imagine, and still tinkering of course whenever I can spare a moment or two! 😅

⤋ Read More
In-reply-to » Hack of the day: running watch -n 60 rm -rf /tmp/yarn-avatar-* in a tmux because all of a sudden, without warning, yarnd started throwing hundreds of gigabytes of files with names like yarn-avatar-62582554 into /tmp, which filled up the entire disk and started crashing other services.

For example this one that got fixed this year:

commit 4304ec7ea3c5df95e0ed82bfa292c9330e342f61
Author: James Mills <james@mills.io>
Date:   Mon Jan 24 00:10:33 2022 +0000

    Fix bug in DownloadImage() leaking termporary files for external avatar downloads (#746)

⤋ Read More
In-reply-to » Hack of the day: running watch -n 60 rm -rf /tmp/yarn-avatar-* in a tmux because all of a sudden, without warning, yarnd started throwing hundreds of gigabytes of files with names like yarn-avatar-62582554 into /tmp, which filled up the entire disk and started crashing other services.

I also think you may be running a version that had a bug and lacked cleanup of those temp files

⤋ Read More
In-reply-to » Hack of the day: running watch -n 60 rm -rf /tmp/yarn-avatar-* in a tmux because all of a sudden, without warning, yarnd started throwing hundreds of gigabytes of files with names like yarn-avatar-62582554 into /tmp, which filled up the entire disk and started crashing other services.

At work right now so will have more concrete details in a few hours from now

⤋ Read More
In-reply-to » Hack of the day: running watch -n 60 rm -rf /tmp/yarn-avatar-* in a tmux because all of a sudden, without warning, yarnd started throwing hundreds of gigabytes of files with names like yarn-avatar-62582554 into /tmp, which filled up the entire disk and started crashing other services.

@abucci I will have a look but I suspect it has something to do with the open nature of the external endpoint. I closed this loophole recently due to other reasons myself.

⤋ Read More
In-reply-to » Hack of the day: running watch -n 60 rm -rf /tmp/yarn-avatar-* in a tmux because all of a sudden, without warning, yarnd started throwing hundreds of gigabytes of files with names like yarn-avatar-62582554 into /tmp, which filled up the entire disk and started crashing other services.

@prologic@twtxt.net Sure, but why would this start happening all of a sudden today? Nothing like this has happened before. Is this a known bug?

⤋ Read More
In-reply-to » Hack of the day: running watch -n 60 rm -rf /tmp/yarn-avatar-* in a tmux because all of a sudden, without warning, yarnd started throwing hundreds of gigabytes of files with names like yarn-avatar-62582554 into /tmp, which filled up the entire disk and started crashing other services.

@abucci Please update!

⤋ Read More
In-reply-to » Hack of the day: running watch -n 60 rm -rf /tmp/yarn-avatar-* in a tmux because all of a sudden, without warning, yarnd started throwing hundreds of gigabytes of files with names like yarn-avatar-62582554 into /tmp, which filled up the entire disk and started crashing other services.

https://anthony.buc.ci/info has the deets!

⤋ Read More
In-reply-to » Hack of the day: running watch -n 60 rm -rf /tmp/yarn-avatar-* in a tmux because all of a sudden, without warning, yarnd started throwing hundreds of gigabytes of files with names like yarn-avatar-62582554 into /tmp, which filled up the entire disk and started crashing other services.

@prologic@twtxt.net 0.15.1, looks like.

⤋ Read More
In-reply-to » Hack of the day: running watch -n 60 rm -rf /tmp/yarn-avatar-* in a tmux because all of a sudden, without warning, yarnd started throwing hundreds of gigabytes of files with names like yarn-avatar-62582554 into /tmp, which filled up the entire disk and started crashing other services.

@abucci What revision are you running?

⤋ Read More
In-reply-to » Hack of the day: running watch -n 60 rm -rf /tmp/yarn-avatar-* in a tmux because all of a sudden, without warning, yarnd started throwing hundreds of gigabytes of files with names like yarn-avatar-62582554 into /tmp, which filled up the entire disk and started crashing other services.

@abucci Wer that’s a bug!

⤋ Read More
In-reply-to » Hack of the day: running watch -n 60 rm -rf /tmp/yarn-avatar-* in a tmux because all of a sudden, without warning, yarnd started throwing hundreds of gigabytes of files with names like yarn-avatar-62582554 into /tmp, which filled up the entire disk and started crashing other services.

@bender@twtxt.net I hope so too. I’ve never seen anything like this before. Whatever it is, it’s strange.

⤋ Read More
In-reply-to » Hack of the day: running watch -n 60 rm -rf /tmp/yarn-avatar-* in a tmux because all of a sudden, without warning, yarnd started throwing hundreds of gigabytes of files with names like yarn-avatar-62582554 into /tmp, which filled up the entire disk and started crashing other services.

@abucci@anthony.buc.ci that’s so weird! I wonder what in the world is causing it. Hopefully @prologic@twtxt.net has an insight.

⤋ Read More

Hack of the day: running watch -n 60 rm -rf /tmp/yarn-avatar-* in a tmux because all of a sudden, without warning, yarnd started throwing hundreds of gigabytes of files with names like yarn-avatar-62582554 into /tmp, which filled up the entire disk and started crashing other services.

⤋ Read More
In-reply-to » @abucci Oh hey! 👋

This is completely insane!

abucci@buc:/tmp$ du -sh /tmp/yarnd-avatar-*
564M    /tmp/yarnd-avatar-3024946878
7.2G    /tmp/yarnd-avatar-3122347915
11G     /tmp/yarnd-avatar-3533381443
445M    /tmp/yarnd-avatar-441914658

I’m going to have to shut down my server soon. This looks like some kind of DDoS. Whether intentional or not it’s filling up the disk at an unsustainable rate.

⤋ Read More
In-reply-to » @abucci Oh hey! 👋

There are also a bunch of log messages scrolling by. I’ve never seen this much activity in the log:

Jul 25 01:37:39 buc.ci yarnd[829]: [yarnd] 2024/07/25 01:37:39 (149.71.56.69) "GET /external?nick=lovetocode999&uri=https://pagez.co.uk/services/your-own-100-fully-owned-online-vi>
Jul 25 01:37:39 buc.ci yarnd[829]: [yarnd] 2024/07/25 01:37:39 (162.211.155.2) "GET /twt/112135496802692324 HTTP/1.1" 400 12 826.65µs
Jul 25 01:37:40 buc.ci yarnd[829]: [yarnd] 2024/07/25 01:37:40 (51.222.253.14) "GET /conv/muttriq HTTP/1.1" 200 36881 20.448309ms
Jul 25 01:37:40 buc.ci yarnd[829]: [yarnd] 2024/07/25 01:37:40 (162.211.155.2) "GET /twt/112730114943543514 HTTP/1.1" 400 12 663.493µs
Jul 25 01:37:40 buc.ci yarnd[829]: [yarnd] 2024/07/25 01:37:40 (27.75.213.253) "GET /external?nick=lovetocode999&uri=http%3A%2F%2Falfarah.jo%2FHome%2FChangeCulture%3FlangCode%3Den>
Jul 25 01:37:40 buc.ci yarnd[829]: time="2024-07-25T01:37:40Z" level=error msg="http://bynet.com.br/log_envio.asp?cod=335&email=%21%2AEMAIL%2A%21&url=https%3A%2F%2Fwww.almanacar.c>
Jul 25 01:37:40 buc.ci yarnd[829]: [yarnd] 2024/07/25 01:37:40 (162.211.155.2) "GET /twt/111674756400660911 HTTP/1.1" 400 12 545.106µs
Jul 25 01:37:40 buc.ci yarnd[829]: time="2024-07-25T01:37:40Z" level=warning msg="feed FetchFeedRequest: @<lovetocode999 http://alfarah.jo/Home/ChangeCulture?langCode=en&returnUrl>
Jul 25 01:37:41 buc.ci yarnd[829]: [yarnd] 2024/07/25 01:37:41 (162.211.155.2) "GET /twt/112507964696096567 HTTP/1.1" 400 12 838.946µs

Something really weird is going on?

⤋ Read More
In-reply-to » @abucci Oh hey! 👋

I deleted them all right before I sent my previous message, and already, a few minutes later, there are two more:

abucci@buc:~$ du -sh /tmp/yarnd-avatar-3*
1.8G    /tmp/yarnd-avatar-3122347915
2.4G    /tmp/yarnd-avatar-3533381443

What is this?

⤋ Read More
In-reply-to » @abucci Oh hey! 👋

@prologic@twtxt.net This is weird, but today, out of nowhere, yarnd filled up the disk on the VPS where I run it. It’s never done anything like this before and I have no idea why it would start. But it threw almost 700 Gbytes of data into /tmp in files like this:

yarnd-avatar-1087570772  yarnd-avatar-1599127133  yarnd-avatar-2042956376  yarnd-avatar-2562946212  yarnd-avatar-3274766535  yarnd-avatar-3931929859  yarnd-avatar-553201529
yarnd-avatar-1089125452  yarnd-avatar-1606826819  yarnd-avatar-2089122560  yarnd-avatar-2611944556  yarnd-avatar-3310922372  yarnd-avatar-3938996661  yarnd-avatar-556240195
yarnd-avatar-1101228867  yarnd-avatar-1618755765  yarnd-avatar-2104107259  yarnd-avatar-2641384948  yarnd-avatar-3326285269  yarnd-avatar-3939402047  yarnd-avatar-559344463
yarnd-avatar-1112165824  yarnd-avatar-1650827505  yarnd-avatar-2142824779  yarnd-avatar-2680659340  yarnd-avatar-3340682113  yarnd-avatar-3998621883  yarnd-avatar-570292705
yarnd-avatar-1119886894  yarnd-avatar-1656673647  yarnd-avatar-2160786463  yarnd-avatar-271923479   yarnd-avatar-3374584613  yarnd-avatar-4005102536  yarnd-avatar-595490106
yarnd-avatar-1131417623  yarnd-avatar-1685698239  yarnd-avatar-2165405940  yarnd-avatar-2793562275  yarnd-avatar-3380606954  yarnd-avatar-4016872095  yarnd-avatar-679251850
yarnd-avatar-1160959085  yarnd-avatar-1746759128  yarnd-avatar-2171489899  yarnd-avatar-2842068287  yarnd-avatar-3416352997  yarnd-avatar-4110048378  yarnd-avatar-679950970
yarnd-avatar-1231649265  yarnd-avatar-1752278279  yarnd-avatar-2251317422  yarnd-avatar-2843868670  yarnd-avatar-3468636088  yarnd-avatar-4116552474  yarnd-avatar-737874628

164 files. Some are empty, some are 7 or even 10 Gbyte.

Any idea what would cause that? And why now, after running yarnd for so long with nothing like this happening?

⤋ Read More
In-reply-to » @bender Thank you :) Yeah I've been silent for a while, been so much work and other things to focus on, but now I have vacation, so I missed this place, and wanted to bring it up to speed here as well :)

@bender@twtxt.net haha yeah :) I agree, but it’s always nice to check back on here as well and catch up a bit and see what’s new :)

⤋ Read More
In-reply-to » We went to a new dog park today (1.5hr drive), booked the biggest of 3 parks for 2 hours, we had a really nice time there :) us and kids + dog had a blast :) Media Media Media Media

@bender@twtxt.net Thank you :) Yeah I’ve been silent for a while, been so much work and other things to focus on, but now I have vacation, so I missed this place, and wanted to bring it up to speed here as well :)

⤋ Read More
In-reply-to » The “Matrix Experiment”, i.e. running a Matrix server for our family, has failed completely and miserably. People don’t accept it. They attribute unrelated things to it, like “I can’t send messages to you, I don’t reach you! It doesn’t work!” Yes, you do, I get those messages, I just don’t reply quickly enough because I’m at work or simply doing something else.

Related to this.

“Some users experienced message delivery delays beginning last night that primarily impacted linked devices like Signal Desktop. We just deployed a fix. Affected users might see failed delivery notices while Signal automatically catches up. We apologize for the inconvenience!”

Source: Signal Fediverse account

⤋ Read More
In-reply-to » We also went to Lunde locks, lot’s of history here. There are 6 of these locks, this is the biggest one.

Emilia was so excited about this, and this woman brought her pony so that they could go for a stroll along the river in the forest.

Image

⤋ Read More
In-reply-to » We also went to Lunde locks, lot’s of history here. There are 6 of these locks, this is the biggest one.

And seljordsvannet, with the famous sea serpent. The image is taken from the observation tower they put up (17m high wooden tower).

Image

⤋ Read More

We also rented a cabin for 5 days, and did a lot of things..

We visited Heddal stave church from 13th century, was really nice. Never been inside it until yesterday. Such a great building. Amazing to sit there and think about all the people who had been there since it was built.

Image


Image

⤋ Read More
In-reply-to » Some bad code just broke a billion Windows machines - YouTube -- This is a really good accurate and comical take on what happened with this whole Crowdstrike global fuck up.

i imagine this is the agreement that the lower plebs are stuck in. Larger enterprise accounts wont fall under these agreements. When I worked a hospital we would get agreements like this with contracts and the legal would line out things like this add new language and send them back.

⤋ Read More
In-reply-to » Are we over Crowdstrike yet? 🤔🤣 Have We forgotten about it? 😅

@prologic@twtxt.net well…

“And for that, we send our heartfelt thanks and apologies for the inconvenience,” the email read, according to a screenshot shared by the source. The same email was also posted on X by someone else. “To express our gratitude, your next cup of coffee or late night snack is on us!”

Source: Techcrunch

With apology offers like these, who would remember? 🤣

⤋ Read More
In-reply-to » Wayland wants to make every frame perfect. I wish web devs had the same goal. Instead, we’re stuck with this:

@lyse@lyse.isobeef.org I guess it’s all about “absolute” performance. Everything is just fast enough for you to get stuff done – no matter the underlying machine. LibreOffice today on my modern machine takes the same time to start up as StarOffice (its ancestor) on my retro machine. And working with it feels the same, everything is just as fast (or slow).

Browsing the web today feels similar to 25 years ago. Even all this wobbling that my link above demonstrates already existed back then (in a way), but it was caused by images loading so slowly. Then, for a brief moment, some browser (I don’t remember which one) had this brilliant feature of trying to keep the current scrolling position stable while the page was still loading. That was great. 😃 This feature then got lost again, probably because it’s too hard to do with JavaScript changing the DOM all the time. So now we’re back to the way it was before.

Corporations should give devs the slowest and oldest machines that they have. 😏 Not only would this be more sustainable, it would also force them to optimize better.

⤋ Read More
In-reply-to » Wayland wants to make every frame perfect. I wish web devs had the same goal. Instead, we’re stuck with this:

@movq@www.uninformativ.de It’s fascinating how people always find ways to completely waste all gained resource improvements and speedups and beyond, so every new and more powerful computer actually feels like a big step backwards. :-( The web shit is particularly terrible.

⤋ Read More
In-reply-to » Some bad code just broke a billion Windows machines - YouTube -- This is a really good accurate and comical take on what happened with this whole Crowdstrike global fuck up.

@prologic@twtxt.net I reckon, it’s just so that they can say: “Oh, whoopsy daisy. Too bad that you fell for our trap. Sorry, it’s entirely your own fault. Go away, leave us alone.”

The bullet point 8.6 continues right away (I forgot the ellipsis in my initial quote, excuse me):

[…] Customer agrees that it is Customer’s responsibility to ensure safe use of an Offering and the CrowdStrike Tools in such applications and installations. CROWDSTRIKE DOES NOT WARRANT ANY THIRD PARTY PRODUCTS OR SERVICES.

And in the one before that:

8.5 No Guarantee. CUSTOMER ACKNOWLEDGES, UNDERSTANDS, AND AGREES THAT CROWDSTRIKE DOES NOT GUARANTEE OR WARRANT THAT IT WILL FIND, LOCATE, OR DISCOVER ALL OF CUSTOMER’S OR ITS AFFILIATES’ SYSTEM THREATS, VULNERABILITIES, MALWARE, AND MALICIOUS SOFTWARE, AND CUSTOMER AND ITS AFFILIATES WILL NOT HOLD CROWDSTRIKE RESPONSIBLE THEREFOR.

In other words: “Just give us your money and hope for the best. It might work. Maybe.” Nope, of course it doesn’t.

⤋ Read More