Table: Summary of AI user agents studied and the companies associated with them (IMAGE)

University of California - San Diego

Table: Summary of AI user agents studied and the companies associated with them

Caption

Summary of AI user agents studied and the companies associated with them. Researchers note whether companies publish the IP addresses they use when crawling with a particular user agent, whether their documentation claims to respect robots.txt, and whether they respect robots.txt in practice. 

Credit

University of California San Diego

Usage Restrictions

Please credit

License

Original content

Disclaimer: AAAS and EurekAlert! are not responsible for the accuracy of news releases posted to EurekAlert! by contributing institutions or for the use of any information through the EurekAlert system.