AiNDREA-Pulse crawler

AiNDREA-Pulse is the crawler behind AiNDREA Pulse, a fashion market intelligence service run by AiNDREA. It reads public store catalogues and product sitemaps to track which products exist and how they are priced.

• It names itself in every request: Mozilla/5.0 (compatible; AiNDREA-Pulse/1.0; +mailto:tech@aindrea.ai)
• It signs every request with Web Bot Auth, with Signature-Agent: "https://crawler.aindrea.ai". The public key is at /.well-known/http-message-signatures-directory.
• It obeys robots.txt, using the product token AiNDREA-Pulse.
• It reads at about one request a second, and backs off when a site asks it to wait. It never tries another way in.
• It does not log in, buy, add to carts or read anything behind a login.

To limit or block it, use robots.txt with User-agent: AiNDREA-Pulse, or verify the signature and decide. Questions or requests: tech@aindrea.ai.