Connect your AIStart free
Konecto Discovery

KonectoBot

KonectoBot is the web crawler behind Konecto Discovery, a what's-on guide for London that links every listing back to the organiser's own booking page. This page tells you what it does, how to recognise it and how to stop it.

Last updated 14 October 2026.

How to recognise it

The user-agent is:

KonectoBot/1.0 (+https://konec.to/bot)

It never pretends to be a browser and it identifies itself on every request. Requests come from Cloudflare's network, which does not give us a fixed list of addresses, so please verify by user-agent. If you see something using our name that behaves differently, tell us at bot@konec.to.

What it fetches

Only public pages that describe public events: titles, dates, times, venue, price range, a short description, an image link where the source permits, and the link back to the booking page. It prefers official APIs and event feeds (iCal, RSS, JSON) and reads schema.org Event data on pages. It does not log in, fill forms, read ticket or booking pages, or collect data about attendees.

How it behaves

  • It reads robots.txt before fetching from a host, caches it for up to 24 hours and obeys it. If robots.txt cannot be fetched or returns an access error, it treats the whole host as off limits.
  • It obeys Crawl-delay and keeps to a gentle pace of one request at a time per host, with a minimum gap of several seconds.
  • It skips pages marked noindex or sent with X-Robots-Tag, and sites whose terms prohibit automated access.
  • It stops and backs off on 429 and 5xx responses. If you answer 403, it does not try again by another route.
  • Listings are refreshed at most daily and removed once the event has passed.

How to block it

Add this to your robots.txt:

User-agent: KonectoBot
Disallow: /

User-agent: KonectoDiscoveryBot, the name an earlier version of this page gave, is still read the same way. You can block only some paths with normal Disallow lines. Changes are picked up within 24 hours.

How to get listed, or removed

The best way to be listed accurately is to publish an event feed or schema.org Event data and tell us at bot@konec.to. To have a listing removed or corrected, see Takedown and removal requests: we act within 24 hours.

Contact

bot@konec.to for the crawler, takedown@konec.to for removals.