The One Setting That Might Be Blocking AI From Finding Your Business

A few weeks ago, I ran an AI visibility audit for a well-established childcare centre in Australia. Multiple locations, strong reputation, great Google reviews, professional website. By every normal measure, this business should have been showing up everywhere.

Their AI visibility score was 31 out of 100.

That's not terrible. But for a business with their reputation and online presence, it was way too low. Something was off.

So I dug into their website. And buried in a file that most business owners have never heard of — called robots.txt — I found the problem.

Their website was telling every major AI crawler to go away.

Not some of them. All of them. ChatGPT's crawler, Google's AI crawler, every bot that feeds the platforms people are increasingly using to find local businesses. The digital equivalent of locking your front door and wondering why nobody's coming in.

The business owner had no idea. Their web developer probably added it years ago as a default security setting. It's not something that shows up in a normal website audit. It doesn't affect Google search rankings. It doesn't break anything visible. It just quietly makes you invisible to the fastest-growing discovery channel in the world.

One file. A few lines of code. And it was undoing thousands of dollars worth of marketing.

Here's the thing that makes this worth writing about: this isn't unusual. In roughly a third of the audits I've run, I find technical settings that are actively working against the business — and the owner has no idea. It's not always robots.txt. Sometimes it's a caching plugin that serves blank pages to bots. Sometimes it's a firewall that blocks automated requests. Sometimes the website simply doesn't have the structured content that AI platforms need to understand what the business does.

The fix for the robots.txt issue? About five minutes. The fix for everything else it was masking — the missing FAQ content, the unstructured service descriptions, the review data sitting on Google but not on the website — that's the real work. But none of that work matters if the front door is locked.

If you've ever wondered whether AI platforms like ChatGPT or Google's AI actually know your business exists, there's a decent chance something technical is quietly keeping them out. And it's probably not something you'd ever think to check.

That's what audits are for.