poVoq

Anubis doesn’t really do anything if the bot knows about it and doesn’t send the bits Anubis looks for. There are a few other heuristics that you can enable in the Anubis config, but it is a principal issue with how Anubis works. The general idea is that if a bot doesn’t send the things Anubis looks for, then it should be possible to distinguish it from regular browsers by that, but then you are back at a manual whack a mole game and given the extensive use of residential proxies these days it is very much a losing battle.

Anubis recently added a honeypot with automatic IP logging though that might help in combination with fail2ban. But in the end if scraper bot authors are already circumventing Anubis intentionally, it is probably also only a temporary respite.

You realize why it is so hard to keep public git forges online these days, right?

The rage baiting left-liberals? Yeah, I suppose 😏

Thanks. The selection of texts makes it clear that he has slowly moved from being a serious journalist to a pundit that publishes mostly opinion pieces that cater to conservative and latently racist audience and are likely also attempts at rage baiting left-liberals. Basically an opportunist exploiting the “also show the other side” bias of liberal media like the Spiegel and I would not be overly surprised if his next move is to support the far-right (the AfD is very open to opportunists with migration history or LG(BT), like Alice Weidel).

Yeah, those gigabyte sized access logs is something we have seen for weeks.

Anubis has also gotten largely ineffective, and yesterday I had some time to sample some of the access log IPs and it is clear that this is a coordinated scraping attack from the Huawei ASN that additionally employs residential proxies mostly in Pakistan, Vietnam and Brazil.

I don’t really have a good idea how to deal with it, but it is a complete PITA.

Ist halt ne wirklich dumme Verkürzung der Tatsachen, und wenn man sich so die Mehrheit der Kommentare in deutschsprachigen Onlinezeitungen anschaut dann könnte man auch denken die AfD hat 90% Zustimmung.

Ich vermute mal der mastodon.world Moderator hatte keine Ahnung wer dieser Typ ist (ich hatte auch noch nie von dem gehöhrt), aber hat dauernd (vermutlich nicht ganz unbegründete) Beschwerden wegen Islamophobie bekommen.

Edit: ups, sorry, I mistook this for a German speaking com.

It’s just a really stupid oversimplification of the facts, and if you look at the majority of the comments in German-language online newspapers, you might even think the AfD has a 90% approval rating.

I’m guessing the mastodon.world moderator had no idea who this guy is (I never heard of him either), but kept receiving complaints (presumably not entirely unfounded) about Islamophobia.

Apparently not:

We have a no-AI contributions policy. This is because, generally speaking, LLMs generate code that, while may work, is poorly organised and difficult to maintain.