Your robots.txt recommendation should name every AI crawler — not just the ones you have already seen
A crawler-control recommendation that only lists the bots already in your logs is incomplete by design. Here is why we recommend an explicit rule for every AI crawler we track — including the ones that have not visited yet.