Zum Inhalt der Seite gehen


Honestly, we are currently out of ideas on how to restore access to Codeberg.org.

We are fighting with extreme traffic and high load for several hours now, we have done the typical procedure to identify and block misbehaving AI crawlers.

However, we are currently having a hard time figuring out details about the ongoing high traffic situation.

Als Antwort auf Codeberg.org

🥲

Well, I will keep my development offline and upload it when its okay, just hope you get to fix it, if any help just ask it, O don't have much knowledge but I do have will 😀

Als Antwort auf Codeberg.org

hi, I appreciate you guys, your initiative and your effort in this. I'm not bothered with a bit of downtime as I can work offline. Good luck on your issues. I doubt I have useful knowledge in this area that you don't or I would've tried to help.
Als Antwort auf Codeberg.org

Depending on your hosting arrangements, the ISP might have a better view of the actual sources of the traffic, and may be able to find a signature to suppress that traffic at their network edge.
Dieser Beitrag wurde bearbeitet. (4 Tage her)
Als Antwort auf Codeberg.org

We were not able to identify the actor who is causing the high load on our systems. We have made the hard decision to temporarily shut off access to a certain project to keep Codeberg available for everyone else.

As soon as we allow web access to a certain project, our system resources are used up within seconds.

Als Antwort auf Codeberg.org

Maybe somebody is abusing Codeberg for hosting stuff used in an app/website (happened to Wikimedia before)?
Als Antwort auf Codeberg.org

fascinating. I hope this is a benign accidental ddos and not a malign one that’s *aiming* to reduce access to said project. Best of luck on this
Als Antwort auf Codeberg.org

i had somewhat similar situation this week on my forgejo instance and the only idea I had was to

  1. Make one of my public repos private (it did help, but just a little)
  2. Block whole Facebook and Google ASNs

But this solution is suboptimal in your case, as you care about indexing

Als Antwort auf Codeberg.org

I do not know the exact architecture that you have setup in Codeberg and you may have set it up already, but what about reverse proxies that introduce rate limiting based on a window (e.g. haproxy.com/blog/four-examples… ). You will need to check which software makes most sense to you here. That could address the scenario you have that a specific repository is affected.

Of course, all this does not address all possibly sources of Ddos attacks.

Als Antwort auf Codeberg.org

i will clean empty projects, that i haven't used yet, i just was too lazy todo that /tbh :ablobcatwink:
Dieser Beitrag wurde bearbeitet. (3 Tage her)
Als Antwort auf Codeberg.org

maybe related? mapstodon.space/@beacondb/1135…


someone's firefox is making bursts of up to 50 requests every 5 seconds. logs show 185k requests in a 12 hour period. that's like half of all requests the server has received over the past week - in 12 hours!! from a single client!! cannot make this up

if you happen to be in poland and use linux with beacondb configured, could you double check if you're running firefox v132? any chance the digits in your ipv4 address add up to 235? if so, something is very wrong lmao please reach out 🙏


Als Antwort auf Codeberg.org

Thank you for your hard work for us, your community members. I hope you will find out what exactly happened here!
Als Antwort auf Codeberg.org

good luck dealing with this. Can you say which repo was being requested so much?
Als Antwort auf Codeberg.org

thanks! that does sound like it could have been part of some poorly designed automated software update process?
Als Antwort auf Ed Summers

@edsu Unlikely. It was massive and distributed, and hammering so much that our systems went down as quickly as within one second of re-allowing the access. It calmed down now, though.

It seemed to be mostly related to some web operations, so we still think it was crawling and only hammering this massive repo by coincidence.

Als Antwort auf Codeberg.org

Fastly have a free program to support open source projects which may mitigate traffic spikes like this by shielding the traffic from your servers.

I can make the introduction if you’re interested and help get you set up.

Als Antwort auf Codeberg.org

Can you share some more insights about what we are dealing with?

Like, how much traffic for example

Unbekannter Ursprungsbeitrag

Codeberg.org
@otto Appreciated. ~n
Als Antwort auf Codeberg.org

I hope you can resolve and mitigate the root cause. Stay strong, and remember that we are a community, and you have our support.
💪💪💪♥️♥️♥️
Als Antwort auf Codeberg.org

the recent pattern of frequent attacks on neutral non-profit sites providing services for public benefit is disgusting, be it accidental or not.
Als Antwort auf Codeberg.org

do you want an introduction to the Amazon people at Fastly ? They can probably help you for free through their Fast Forward program, and have tools to fight this

Diese Webseite verwendet Cookies. Durch die weitere Benutzung der Webseite stimmst du dieser Verwendung zu. https://inne.city/tos