WebAtlasNewsBot
WebAtlasNewsBot is the feed reader behind MevaSearch News. It reads public RSS and Atom feeds and shows headlines with a link back to the original article.
How to recognise it
Every request carries this User-Agent:
WebAtlasNewsBot/3.0 (+https://news.mevasearch.com/bot)How it behaves
- It requests feed URLs listed in our source list. Only when a feed entry has no image does it open that one article page, once, to read its preview image (og:image). It does not follow links or crawl your site.
- Each feed is requested at most about every 20 minutes, with no more than 8 parallel connections in total.
- It sends If-None-Match and If-Modified-Since headers, so an unchanged feed costs you a single 304 response.
- After errors it backs off exponentially, up to 6 hours between attempts.
- It stores the headline, a short excerpt, the link and a preview image address. Full articles are never copied.
Opting out
To have your feed removed, or to change how often it is read, contact the WebOrbiton Team through mevasearch.com. Error responses such as HTTP 403 or 410 slow the bot down to one request every 6 hours.