Articles on: Settings

Bots blocking

By having this option active our application checks if the store is visited by a bot and is not running for this session. In other words if a bot visits the storefront and this option is checked, then the page will load and the app will not work at all.

In our app, we perform bot detection by matching user agents against a predefined list. This ensures that we can accurately identify if a visit comes from a bot or a legitimate user.

How to enable bots blocking

Bots Blocking can be enabled from the Banner Settings of our application.

Bots

Below is the list of bots that our detection function currently checks for:

Google-related Bots: Googlebot, Googlebot-Mobile, Googlebot-Image, Google favicon, Mediapartners-Google
Bing and Yahoo: bingbot, Yahoo! Slurp, msnbot
**Common Crawlers and Libraries: **wget, curl, Python-urllib, Java, Commons-HttpClient, httpunit, nutch, phpcrawl
Social Media Bots: Facebookexternalhit, Twitterbot, Facebot, vkshare, Pinterest, Tumblr
Yandex: yandexbot, yandex
Popular Crawlers: AhrefsBot, SemrushBot, MJ12bot, DuckDuckBot, Baiduspider, Exabot, SeznamBot, Sogou, BLEXBot
Archival and Monitoring Bots: archive.org_bot, memorybot, changedetection, Wayback Machine (ia_archiver), Pingability, Monitoring
Commercial and SEO Bots: Lipperhey SEO Service, linkdex, Rogerbot, Ltx71, Sistrix Crawler, MegaIndex, GrapeshotCrawler
GDPR-related Crawlers: Pandectes
General Bots: spider, bot, crawler
Other Notable Bots: Coccoc, IntegroMedb, Toplistbot, Seokicks-robot, Integromedb, Proximic, Applebot, CrystalSemanticsBot, BnLAR, OrangeBot, Qwantify, Qwantify, Adidxbot, dotbot, Ezooms, xovibot, WinHttpRequest

This list is constantly updated to ensure our detection mechanism keeps up with the evolving bot landscape.

If you have any questions or suggestions regarding this feature, feel free to reach out to our support team.

Updated on: 17/02/2025

Was this article helpful?

Thank you!