Fair Use Policy
BotBrowser is a content extraction tool designed to help LLM agents consume web content efficiently. We are committed to responsible and ethical use of the web.
What BotBrowser Does
BotBrowser fetches publicly available web pages and extracts their main content into clean, token-efficient markdown. This is functionally identical to what web browsers, search engines, RSS readers, and read-it-later apps do every day.
- BotBrowser only accesses publicly available pages.
- BotBrowser does not bypass authentication, login walls, or paywalls.
- BotBrowser does not circumvent CAPTCHAs or other bot-detection mechanisms.
- BotBrowser does not store or redistribute the content it extracts.
Copyright and Content Ownership
Copyright of web content belongs to its original authors and publishers. BotBrowser extracts content for processing and analysis purposes, which is generally considered fair use under US law. However:
- Extracting content for personal or business analysis is permitted.
- Summarizing and processing content for LLM agent consumption is permitted.
- Republishing, reselling, or mass-redistributing extracted content as your own is not permitted and may violate copyright law.
- Users are solely responsible for how they use the data they extract.
Terms of Service Compliance
BotBrowser respects the terms of service of the websites it accesses. We encourage all users to review and comply with the terms of service of the websites they extract content from.
BotBrowser honors robots.txt directives and identifies itself via its User-Agent string when making requests.
User Responsibility
BotBrowser is a tool. Like any tool, it can be used responsibly or irresponsibly. By using BotBrowser, you agree that:
- You are responsible for ensuring your use complies with all applicable laws and regulations.
- You will not use BotBrowser to access content you are not authorized to access.
- You will not use BotBrowser in a way that disrupts or overloads target websites.
- BotBrowser and its maintainers are not responsible for how users choose to use the extracted data.
Rate Limiting and Respectful Access
BotBrowser includes built-in rate limiting to prevent abuse and ensure respectful access to websites. Our hosted service enforces daily request limits per API key to prevent excessive load on target websites.
Legal Basis
In the United States, accessing and extracting publicly available web content has been upheld as lawful. In hiQ Labs v. LinkedIn (2022), the Ninth Circuit Court of Appeals ruled that scraping publicly accessible data does not violate the Computer Fraud and Abuse Act (CFAA). BotBrowser operates within this legal framework by only accessing publicly available content.
Contact
If you are a website owner and have concerns about BotBrowser accessing your content, or if you have questions about this policy, please contact us at hello@thebotbrowser.com.
Last updated: February 2026