using robots.txt for evil
2025-08-13 17:20:52.914577+02 by Dan Lyke 0 comments
Cal Matters: Data companies found hiding mandatory privacy pages
But among the state’s most recent database of nearly 500 data brokers, Colin and Tomas found that 35 companies had code that hid their deletion instructions from showing up in Google searches.