Skip to main content

HUMAN IS THE KEY

Your content. Your rules. Your data.

GDPR-native · EU data residency · Works on any site

HumanKey

Know Your AI Traffic

AI traffic analytics, measured on your own site.

See AI crawlers, other bots and people among the visits measured on your site.

No sign-up · public data of the site only · result within 15 seconds

HumanKey is a service for businesses and for people acting for a business.

Not sure yet? Get a free 7-day AI crawler report for your site →

HumanKey detects and classifies AI crawlers and other bots among the visits measured on your website, and shows how many of those visits HumanKey classified as human.

If you create your account with Google, the e-mail address and name of your Google account become those of your HumanKey account — see the Privacy Policy.

Check your site

See what your site gives search engines and AI crawlers: robots.txt, your homepage and a few more pages. Every finding with its source and the date we read it. No score, no sign-up. How it works →

What the check reads, in this order

  1. robots.txt
    • File and its size
    • Search engines
    • AI crawlers named
    • Sitemap line
    • Crawl-delay line
    • Content-Signal line
  2. Homepage HTML
    • Title, description, link preview
    • Structured data and site name
    • Headings
    • Text without scripts
    • Address and canonical link
    • Indexing and content use
  3. llms.txt and sitemap
    • llms.txt file
    • Sitemap
    • Where the canonical link leads
  4. More of your pages

    A few more pages of your site

HumanKey recognises 90+ AI crawlers and other bots by name, among them: See the full list →

  • AI2Bot
  • Amazonbot
  • Amzn-User
  • Anchor Browser
  • Claude-SearchBot
  • Claude-User
  • Claude-Web
  • ClaudeBot
  • Applebot
  • Brightbot
  • Bytespider
  • TikTokSpider
  • TerraCotta
  • cohere-ai
  • CCBot
  • DeepSeekBot
  • Diffbot
  • DuckAssistBot
  • ExaSearchBot
  • Google-Agent
  • Google-CloudVertexBot
  • Google-NotebookLM
  • Google-Read-Aloud
  • PanguBot
  • ImagesiftBot
  • KeenableBot
  • Manus-User
  • FacebookBot
  • Meta-ExternalAgent
  • meta-webindexer
  • MistralAI-User
  • MistralBot
  • Novellum
  • ChatGPT-User
  • GPTBot
  • OAI-SearchBot
  • Perplexity-User
  • PerplexityBot
  • ProRataInc
  • Reflectionbot
  • SofyaBot
  • TimpiBot
  • VelenPublicWebCrawler
  • Webzio-Extended
  • YouBot
  • GrokBot
  • AhrefsBot
  • AhrefsSiteAudit
  • Amzn-SearchBot
  • Arquivo-web-crawler
  • Baiduspider
  • BitSightBot
  • DataForSeoBot
  • DuckDuckBot
  • AdsBot-Google
  • Google-InspectionTool
  • GoogleOther
  • GoogleOther-Image
  • GoogleOther-Video
  • Googlebot
  • Googlebot-Image
  • Googlebot-News
  • Googlebot-Video
  • Storebot-Google
  • PetalBot
  • HubSpot Crawler
  • KagiBot
  • LinkedInBot
  • MJ12Bot
  • Bingbot
  • MojeekBot
  • ICC-Crawler
  • Yeti
  • OAI-AdsBot
  • 360Spider
  • Qwantify
  • SEBot-WA
  • SeekportBot
  • SemrushBot
  • SeznamBot
  • YisouSpider
  • Slackbot
  • SogouSpider
  • ABEvalBot
  • ShapBot
  • UptimeRobot
  • VocationsBot
  • Twitterbot
  • YandexAccessibilityBot
  • YandexBot
  • YandexRenderResourcesBot
Privacy & Security

Built for Trust

Everything in this section applies to every plan, including Free.

EU Data Residency

Database and application servers in the EU (Frankfurt, Amsterdam). Encryption at rest and in transit.

Hashed IPs, No Cookies

In stored traffic data, IP addresses are kept only in pseudonymised form (a keyed hash). We place no cookies on your visitors.

Published DPIA

Our Data Protection Impact Assessment is publicly available. Full transparency on data processing.

Read more →

Data Processing Agreement (GDPR Art. 28)

DPA on every plan, as an annex to the Terms. Read it online or download the PDF.

Read more →

Automated Data Lifecycle

Data automatically deleted per your retention schedule. No manual intervention. Right to erasure built-in.

Sub-Processor Registry

Public registry of every third-party service processing data on your behalf, with EU status.

Read more →

Transparent use of AI

Every place we use a large language model is listed publicly. An automated review checks our AI features against 33 criteria — latest score 89/100, 15 Nov 2026. Our own review, not an independent audit.

Read more →
How Your Website Wins with HumanKey

Two ways to put your traffic data to work.

See What AI Reads on Your Site

See which AI crawlers appear among the visits measured on your site, which pages they request most, and how often.

Learn more

See How Much of Your Traffic Is Human

See how many visits measured on your site HumanKey counts as people and how many as bots.

Learn more
Quick Setup

How it works

  1. See what AI crawlers read

    Run the free check of your site. Then add one line of JavaScript to see AI crawlers and people among the visits it measures.

    View documentation →
  2. Fix what is missing

    Generate robots.txt rules and an llms.txt file in HumanKey. Paid plans add structured data and one package for your IT person.

    See all features →
  3. Check it in measured visits

    Watch the numbers after your changes: AI crawlers among your measured visits and, on paid plans, people sent by AI assistants.

    Sign in for live demo →
Built for Every EU Website

What HumanKey includes

  • Attract

    Check what AI crawlers read on your homepage. Generate robots.txt rules and an llms.txt file for them.

  • Block

    Choose which AI crawlers to allow or block. HumanKey writes the robots.txt rules; you publish them for crawlers that follow the file.

  • Measure

    Count AI crawlers, other bots and people among your measured visits. On paid plans, see which AI assistants send people to you.

Click any card to learn more.

AI crawler analytics

See which AI systems appear among the visits measured on your site — 90+ AI crawlers and other bots recognised by name, among them OAI-SearchBot, DuckAssistBot, Applebot and Googlebot, each shown with its company and purpose.

Learn more

Manage AI Crawlers

Choose which AI crawlers to allow, monitor, or block — 90+ bots classified across 6 tiers with smart recommendations based on your traffic.

Learn more

robots.txt & llms.txt

Audit your robots.txt against our recommendations (Business+) and generate llms.txt on every plan — all from one dashboard.

Learn more

Bot Detection

See which visits are real people and which are AI crawlers, scrapers, and other automated traffic — behavioral analytics, datacenter detection, and heuristic analysis.

Learn more

GDPR-Native

In traffic data, IPs kept only as hashes. No cookies on your visitors, no cross-site tracking. EU data residency. Built for GDPR compliance from day one — not bolted on.

Learn more

Works on Any Site

Paste 1 line of JS to add HumanKey to any site, including WordPress — live in under a minute. No developer required.

Learn more

AI-Powered Support

Built-in AI assistant answers your questions about traffic, GDPR, integration, and billing — instantly, in any language.

Learn more

Bot Log

Detailed exports of every bot visit for Business+ sites — bot name, company and purpose, confidence and match type, country + network (ASN) attribution. Downloadable as CSV or NDJSON.

Learn more

Heatmaps (Beta)

Privacy-first click and scroll heatmaps for Business+ sites. See where real humans (and bots) interact with your pages — no cookies on your visitors and no cross-site tracking.

Learn more
FAQ

Frequently Asked Questions

Everything you need to know about HumanKey — AI analytics, bot classification, GDPR information, and setup.

AI Crawler Analytics shows which AI crawlers and other bots it recognises among the visits measured on your website. It recognises 90+ bots by name, among them OAI-SearchBot (OpenAI), DuckAssistBot (DuckDuckGo), Applebot (Apple) and Googlebot (Google). You see who crawls, which pages they target, and how often. Use Smart Bot Config (Pro and up) to manage crawlers with AI-powered recommendations, and audit your robots.txt against recommended rules (Business and up).

AI Magnet checks what your homepage shows AI crawlers, generates your robots.txt and llms.txt files and lets you set crawler rules. robots.txt states your preferences; compliance is up to each crawler. HumanKey itself does not block any request.

We track 90+ AI crawlers and other bots, including OAI-SearchBot (OpenAI), DuckAssistBot (DuckDuckGo), Applebot (Apple) and Googlebot (Google). Our bot taxonomy grows as new AI systems appear — AI-powered Bot Research surfaces new crawlers, which we review and add.

HumanKey doesn't rely on a single signal. Every visit is scored by HumanKey's proprietary detection engine into a confidence-graded verdict — not a binary yes/no — so edge cases are flagged as lower-confidence rather than silently misclassified. Pro and higher plans add behavioral evidence for your review. A machine-learning model also scores sessions with interaction. The score is not shown until the model passes a test on sessions where we know who is a person and who is a bot. The verdict itself is computed the same way on every plan. Classification needs no names, e-mail addresses, accounts or cookies, and it does not try to establish who a visitor is.

Those tools measure how people use your site — sessions, clicks and conversions. HumanKey shows the AI crawlers and other bots among the visits measured on your site, and how many of those visits it classified as human. HumanKey adds what they are not built to show: AI crawlers and other bots by name, and — on paid plans — which AI assistants send people to you.

Show all questions (18)

In stored traffic data, IP addresses are kept only in pseudonymised form (a keyed hash). We place no cookies on your visitors, build no cross-site or persistent visitor profile and store traffic data in the EU (Frankfurt and Amsterdam). As an account holder you can use these GDPR rights in the dashboard: access (Art. 15), erasure (Art. 17) and portability (Art. 20). Our DPIA, Transfer Impact Assessment (TIA) and DORA mapping are public — start at /legal/dpia. The Data Processing Agreement (GDPR Art. 28) is an annex to the Terms of Service on every plan and is accepted with them.

IP addresses are pseudonymised (a keyed hash) before they are written to our traffic database — a visitor's original IP is not kept there. For bot detection we read a limited set of device and browser characteristics during the visit; they are evaluated for the human-or-bot decision and are not written to our database. We also store interaction measurements for each visit — pointer movement, typing rhythm, scrolling and click positions — and delete them together with the visit. We place no cookies on your visitors, use no advertising identifiers, and build no cross-site or persistent visitor profile.

Traffic data is stored in the EU — database in Frankfurt, application servers in Amsterdam. Some of our sub-processors are established in the United States. Where personal data is transferred to them, the transfer relies on standard contractual clauses (Art. 46(2)(c) GDPR); what each provider receives and the transfer mechanism for each are listed in our sub-processor list, and the transfers are assessed in our published transfer impact assessment.

Deleting your account deletes your sites, visit data, API keys and analytics from the service when you confirm; copies in backups expire on the database provider's backup cycle. Records the law requires us to keep (for example refund records for tax purposes) are kept only as long as the law requires. You can export a full copy of your data first from Dashboard → Settings → Privacy. Full detail at /privacy.

Yes. Among the visits measured on your site, HumanKey records which AI crawler requested which page and when. On Business and higher you can export these records as CSV and keep them for 90 to 365 days, depending on the plan. HumanKey measures and records. It does not negotiate, broker or price access to your content.

You can add HumanKey to any WordPress site with our 1-line JS snippet: paste it into your site header via your theme settings or a headers and footers helper plugin. Step-by-step guide: Docs → WordPress.

Add one line of JavaScript to your site's <head> section. It works with any platform — Shopify, Webflow, Squarespace, custom HTML, React, Next.js, or any framework that allows custom HTML injection.

No. The snippet loads asynchronously (async attribute), runs after your page has loaded and does not block rendering.

Yes. On Pro and up, Smart Bot Config lets you classify AI crawlers and, for each one, choose allow or block, with AI-powered auto-recommendations based on your traffic patterns; HumanKey writes the robots.txt rule and you publish it for crawlers that follow the file. The robots.txt Audit — a full diff against recommended rules — is available on Business and up.

The robots.txt Audit compares your current robots.txt file against HumanKey's recommended rules for all detected AI crawlers and shows a full diff view of exactly what to add, remove, or change. The Audit is a Business and Enterprise feature. On every plan, HumanKey builds robots.txt lines from your crawler settings and an llms.txt file from your description; Pro adds suggestions for AI crawler rules, each with a reason. That is file generation, not the diff audit.

Traffic Trends shows how your human, bot, and unknown traffic evolves over time using automated daily aggregations. Compare periods to spot changes, see which bots dominate your traffic, and track trend shifts. Available on Pro (30-day), Business (90-day), and Enterprise (365-day) plans. Find it at Dashboard → Traffic → Benchmarks.

Free: 1,000 checks/month, 1 site, AI crawler report + AI crawler check — no charge. Pro ($49/month): 100,000 checks/month, 3 sites, full AI analytics dashboard. Business ($149/month): 1,000,000 checks/month, 10 sites, data export, webhooks, team accounts, and priority support.

On Business and Enterprise plans, owners can invite collaborators by email through the Team page in the dashboard. The invitee receives a link, opens a preview showing the inviter's name, when one is set, and which role they're being offered (Admin, Analyst, or Read-only), and explicitly clicks Accept to join. Invitations expire after 7 days. The inviter is notified if the invitation is declined. Once accepted, the new member appears on the Team page with their role and can switch into the team's context to access the workspace.

Still have questions?

Our team typically responds within a few hours.

Knowledge Hub

Latest from Our Blog

Articles on AI traffic, robots.txt and GDPR for website owners.

Start Today — Free

Know Your AI Traffic.
Attract. Block. Measure.

14-day free trial. No credit card required. GDPR-native. Setup in under 5 minutes.