WebPageAPI bot User-Agent: Mozilla/5.0 (compatible; WebPageAPI/1.0; +https://web-page-api.fly.dev/bot) This bot fetches single public web pages when a user of the Web Page API asks for a link preview or a Markdown copy of that page. It does not crawl or follow links. Markdown requests honour robots.txt for the token "WebPageAPI" (e.g. "User-agent: WebPageAPI" then "Disallow: /"). Link previews read only the page's public head metadata, like chat-app link unfurlers do. Contact: see the API listing on RapidAPI.