RA2lover@burggit.moe to

Technology News@burggit.moeEnglish · 4 months ago

Investigating Reddit's robots.txt Cloaking Strategy

0

1

Investigating Reddit's robots.txt Cloaking Strategy

RA2lover@burggit.moe to

Technology News@burggit.moeEnglish · 4 months ago

0

Investigating Reddit's robots.txt Cloaking Strategy | Merj

Introduction We recently noticed a post on X by @pandraus regarding Reddit’s robots.txt file. On 25 June 2024, u/traceroo announced...

You must log in or register to comment.

Chat

Technology News@burggit.moe

technology@burggit.moe

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@burggit.moe

News about technology including science, engineering, companies, and gaming. Please post links to articles (preferably not paywalled).

Must be relatively recent articles.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

1 user / day
1 user / week
1 user / month
4 users / 6 months
1 local subscriber
105 subscribers
63 Posts
20 Comments
Modlog

mods:
whaleway@burggit.moe