Kid@sh.itjust.worksM to

Cybersecurity@sh.itjust.worksEnglish · 4 months ago

Perplexity is using stealth, undeclared crawlers to evade website no-crawl directives

blog.cloudflare.com

1

1

Perplexity is using stealth, undeclared crawlers to evade website no-crawl directives

blog.cloudflare.com

Kid@sh.itjust.worksM to

Cybersecurity@sh.itjust.worksEnglish · 4 months ago

1

Perplexity is repeatedly modifying their user agent and changing IPs and ASNs to hide their crawling activity, in direct conflict with explicit no-crawl preferences expressed by websites.

Chat

MTK@lemmy.world
link
fedilink
English
arrow-up
1·
3 months ago
Booo! Go back to being perplexed or something!

Cybersecurity@sh.itjust.works

cybersecurity@sh.itjust.works

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !cybersecurity@sh.itjust.works

c/cybersecurity is a community centered on the cybersecurity and information security profession. You can come here to discuss news, post something interesting, or just chat with others.

THE RULES

Instance Rules

Be respectful. Everyone should feel welcome here.
No bigotry - including racism, sexism, ableism, homophobia, transphobia, or xenophobia.
No Ads / Spamming.
No pornography.

Community Rules

Idk, keep it semi-professional?
Nothing illegal. We’re all ethical here.
Rules will be added/redefined as necessary.

If you ask someone to hack your “friends” socials you’re just going to get banned so don’t do that.

Learn about hacking

Pico Capture the flag

Other security-related communities !databreaches@lemmy.zip !netsec@lemmy.world !securitynews@infosec.pub !cybersecurity@infosec.pub !pulse_of_truth@infosec.pub

Notable mention to !cybersecuritymemes@lemmy.world

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

107 users / day
395 users / week
1.33K users / month
2.6K users / 6 months
1 local subscriber
8.65K subscribers
604 Posts
649 Comments
Modlog