Free homepage check: see what AI crawlers read on your site
HumanKey reads a site's robots.txt, homepage HTML, llms.txt and sitemap and shows what it found, with sources. No score, no sign-up.
HUMAN IS THE KEY
Your content. Your rules. Your data.
HumanKey
AI traffic analytics, measured on your own site.
See AI crawlers, other bots and people among the visits measured on your site.
HumanKey is a service for businesses and for people acting for a business.
Not sure yet? Get a free 7-day AI crawler report for your site →
HumanKey detects and classifies AI crawlers and other bots among the visits measured on your website, and shows how many of those visits HumanKey classified as human.
If you create your account with Google, the e-mail address and name of your Google account become those of your HumanKey account — see the Privacy Policy.
See what your site gives search engines and AI crawlers: robots.txt, your homepage and a few more pages. Every finding with its source and the date we read it. No score, no sign-up. How it works →
What the check reads, in this order
A few more pages of your site
HumanKey recognises 90+ AI crawlers and other bots by name, among them: See the full list →
Everything in this section applies to every plan, including Free.
Database and application servers in the EU (Frankfurt, Amsterdam). Encryption at rest and in transit.
In stored traffic data, IP addresses are kept only in pseudonymised form (a keyed hash). We place no cookies on your visitors.
Our Data Protection Impact Assessment is publicly available. Full transparency on data processing.
Read more →DPA on every plan, as an annex to the Terms. Read it online or download the PDF.
Read more →Data automatically deleted per your retention schedule. No manual intervention. Right to erasure built-in.
Public registry of every third-party service processing data on your behalf, with EU status.
Read more →Every place we use a large language model is listed publicly. An automated review checks our AI features against 33 criteria — latest score 89/100, 15 Nov 2026. Our own review, not an independent audit.
Read more →See which AI crawlers appear among the visits measured on your site, which pages they request most, and how often.
See how many visits measured on your site HumanKey counts as people and how many as bots.
Run the free check of your site. Then add one line of JavaScript to see AI crawlers and people among the visits it measures.
View documentation →Generate robots.txt rules and an llms.txt file in HumanKey. Paid plans add structured data and one package for your IT person.
See all features →Watch the numbers after your changes: AI crawlers among your measured visits and, on paid plans, people sent by AI assistants.
Sign in for live demo →Check what AI crawlers read on your homepage. Generate robots.txt rules and an llms.txt file for them.
Choose which AI crawlers to allow or block. HumanKey writes the robots.txt rules; you publish them for crawlers that follow the file.
Count AI crawlers, other bots and people among your measured visits. On paid plans, see which AI assistants send people to you.
Click any card to learn more.
See which AI systems appear among the visits measured on your site — 90+ AI crawlers and other bots recognised by name, among them OAI-SearchBot, DuckAssistBot, Applebot and Googlebot, each shown with its company and purpose.
Choose which AI crawlers to allow, monitor, or block — 90+ bots classified across 6 tiers with smart recommendations based on your traffic.
Audit your robots.txt against our recommendations (Business+) and generate llms.txt on every plan — all from one dashboard.
See which visits are real people and which are AI crawlers, scrapers, and other automated traffic — behavioral analytics, datacenter detection, and heuristic analysis.
In traffic data, IPs kept only as hashes. No cookies on your visitors, no cross-site tracking. EU data residency. Built for GDPR compliance from day one — not bolted on.
Paste 1 line of JS to add HumanKey to any site, including WordPress — live in under a minute. No developer required.
Built-in AI assistant answers your questions about traffic, GDPR, integration, and billing — instantly, in any language.
Detailed exports of every bot visit for Business+ sites — bot name, company and purpose, confidence and match type, country + network (ASN) attribution. Downloadable as CSV or NDJSON.
Privacy-first click and scroll heatmaps for Business+ sites. See where real humans (and bots) interact with your pages — no cookies on your visitors and no cross-site tracking.
Everything you need to know about HumanKey — AI analytics, bot classification, GDPR information, and setup.
AI Crawler Analytics shows which AI crawlers and other bots it recognises among the visits measured on your website. It recognises 90+ bots by name, among them OAI-SearchBot (OpenAI), DuckAssistBot (DuckDuckGo), Applebot (Apple) and Googlebot (Google). You see who crawls, which pages they target, and how often. Use Smart Bot Config (Pro and up) to manage crawlers with AI-powered recommendations, and audit your robots.txt against recommended rules (Business and up).
AI Magnet checks what your homepage shows AI crawlers, generates your robots.txt and llms.txt files and lets you set crawler rules. robots.txt states your preferences; compliance is up to each crawler. HumanKey itself does not block any request.
We track 90+ AI crawlers and other bots, including OAI-SearchBot (OpenAI), DuckAssistBot (DuckDuckGo), Applebot (Apple) and Googlebot (Google). Our bot taxonomy grows as new AI systems appear — AI-powered Bot Research surfaces new crawlers, which we review and add.
HumanKey doesn't rely on a single signal. Every visit is scored by HumanKey's proprietary detection engine into a confidence-graded verdict — not a binary yes/no — so edge cases are flagged as lower-confidence rather than silently misclassified. Pro and higher plans add behavioral evidence for your review. A machine-learning model also scores sessions with interaction. The score is not shown until the model passes a test on sessions where we know who is a person and who is a bot. The verdict itself is computed the same way on every plan. Classification needs no names, e-mail addresses, accounts or cookies, and it does not try to establish who a visitor is.
Those tools measure how people use your site — sessions, clicks and conversions. HumanKey shows the AI crawlers and other bots among the visits measured on your site, and how many of those visits it classified as human. HumanKey adds what they are not built to show: AI crawlers and other bots by name, and — on paid plans — which AI assistants send people to you.
In stored traffic data, IP addresses are kept only in pseudonymised form (a keyed hash). We place no cookies on your visitors, build no cross-site or persistent visitor profile and store traffic data in the EU (Frankfurt and Amsterdam). As an account holder you can use these GDPR rights in the dashboard: access (Art. 15), erasure (Art. 17) and portability (Art. 20). Our DPIA, Transfer Impact Assessment (TIA) and DORA mapping are public — start at /legal/dpia. The Data Processing Agreement (GDPR Art. 28) is an annex to the Terms of Service on every plan and is accepted with them.
IP addresses are pseudonymised (a keyed hash) before they are written to our traffic database — a visitor's original IP is not kept there. For bot detection we read a limited set of device and browser characteristics during the visit; they are evaluated for the human-or-bot decision and are not written to our database. We also store interaction measurements for each visit — pointer movement, typing rhythm, scrolling and click positions — and delete them together with the visit. We place no cookies on your visitors, use no advertising identifiers, and build no cross-site or persistent visitor profile.
Traffic data is stored in the EU — database in Frankfurt, application servers in Amsterdam. Some of our sub-processors are established in the United States. Where personal data is transferred to them, the transfer relies on standard contractual clauses (Art. 46(2)(c) GDPR); what each provider receives and the transfer mechanism for each are listed in our sub-processor list, and the transfers are assessed in our published transfer impact assessment.
Deleting your account deletes your sites, visit data, API keys and analytics from the service when you confirm; copies in backups expire on the database provider's backup cycle. Records the law requires us to keep (for example refund records for tax purposes) are kept only as long as the law requires. You can export a full copy of your data first from Dashboard → Settings → Privacy. Full detail at /privacy.
Yes. Among the visits measured on your site, HumanKey records which AI crawler requested which page and when. On Business and higher you can export these records as CSV and keep them for 90 to 365 days, depending on the plan. HumanKey measures and records. It does not negotiate, broker or price access to your content.
You can add HumanKey to any WordPress site with our 1-line JS snippet: paste it into your site header via your theme settings or a headers and footers helper plugin. Step-by-step guide: Docs → WordPress.
Add one line of JavaScript to your site's <head> section. It works with any platform — Shopify, Webflow, Squarespace, custom HTML, React, Next.js, or any framework that allows custom HTML injection.
No. The snippet loads asynchronously (async attribute), runs after your page has loaded and does not block rendering.
Yes. On Pro and up, Smart Bot Config lets you classify AI crawlers and, for each one, choose allow or block, with AI-powered auto-recommendations based on your traffic patterns; HumanKey writes the robots.txt rule and you publish it for crawlers that follow the file. The robots.txt Audit — a full diff against recommended rules — is available on Business and up.
The robots.txt Audit compares your current robots.txt file against HumanKey's recommended rules for all detected AI crawlers and shows a full diff view of exactly what to add, remove, or change. The Audit is a Business and Enterprise feature. On every plan, HumanKey builds robots.txt lines from your crawler settings and an llms.txt file from your description; Pro adds suggestions for AI crawler rules, each with a reason. That is file generation, not the diff audit.
Traffic Trends shows how your human, bot, and unknown traffic evolves over time using automated daily aggregations. Compare periods to spot changes, see which bots dominate your traffic, and track trend shifts. Available on Pro (30-day), Business (90-day), and Enterprise (365-day) plans. Find it at Dashboard → Traffic → Benchmarks.
Free: 1,000 checks/month, 1 site, AI crawler report + AI crawler check — no charge. Pro ($49/month): 100,000 checks/month, 3 sites, full AI analytics dashboard. Business ($149/month): 1,000,000 checks/month, 10 sites, data export, webhooks, team accounts, and priority support.
On Business and Enterprise plans, owners can invite collaborators by email through the Team page in the dashboard. The invitee receives a link, opens a preview showing the inviter's name, when one is set, and which role they're being offered (Admin, Analyst, or Read-only), and explicitly clicks Accept to join. Invitations expire after 7 days. The inviter is notified if the invitation is declined. Once accepted, the new member appears on the Team page with their role and can switch into the team's context to access the workspace.
Articles on AI traffic, robots.txt and GDPR for website owners.
HumanKey reads a site's robots.txt, homepage HTML, llms.txt and sitemap and shows what it found, with sources. No score, no sign-up.
HumanKey now builds the lines to add to your robots.txt from your settings. Copy them, download them, or send them to the person who runs your site.
Many automated visits to a website never introduce themselves. Here is how we now describe them in plain words — by kind, never by guesswork about who sent them.
14-day free trial. No credit card required. GDPR-native. Setup in under 5 minutes.