I could see them maybe using a custom version of Deepseek for that second tier. Could be a boon for them if the inference costs are a lot lower.

More accurately, it traps any web crawler, including regular search engines and benign projects like the Internet Archive. This should not be used without an allowlist for known trusted crawlers at least.

Updated, thanks.