On 2026-01-24, ivy86 <ivy86@disroot.org> wrote:
> On Fri, 23 Jan 2026 23:34:37 +0100
> Страхиња Радић <sr@strahinja.org> wrote:
>
>> Дана 26/01/23 11:44AM, Adam Van Ymeren написа:
>> > I followed a link from undeadly.org and got redirected to the aptly
>> > named theannoyingsite.com
>> >
>> > Suffice to say this is pretty annoying, and in my opinion hurts the
>> > credibility of the project and of sites like undeadly.org that try
>> > to link to interesting things.
>> >
>> > This appears to be intentional based upon whether some stale ipk=
>> > param is in the url.
>>
>> It also happens when the browser doesn't supply the referrer header.
>>
>> https://marc.info/?t=176402576800001&r=1&w=2
>> https://marc.info/?l=openbsd-misc&m=176406809623993&w=2
>> https://marc.info/?l=openbsd-misc&m=176408086402658&w=2
>>
>> tl;dr: It's an anti-spam/anti-scraping measure.
>>
>
> Some scrapers, like Wget's recursive mode, send out referers by
> default, making this ineffective.
wget's recursive mode follows robots.txt (unless patched; there's
no cli option) so it won't be fetching from cvsweb anyway.
--
Please keep replies on the mailing list.
No comments:
Post a Comment