All guides
Claude Code · Easy

Claude Code SEO: llms.txt, Schema.org and robots.txt

Claude Code runs in your terminal and reads your whole project before it makes changes. It detects your framework, finds the right files, and adds Schema.org, robots.txt and llms.txt to them.

How Claude Code works on your project

Claude Code reads your project files and usually finds the right places itself: the Next.js router type, the public directory, the layout. Check the result before you publish.

What we'll add:
  • Organization Schema — AI can read what your business does
  • FAQ Schema — the questions and answers on your page, in a form AI can read
  • robots.txt — allow GPTBot, ClaudeBot, PerplexityBot
  • Specifics and freshness — prices, facts and update dates on the page itself; markup does not replace them
  • llms.txt — a short summary of the site for AI agents; no proven effect on AI answers
0

Generate your fix files first

  1. Go to causabi.com
  2. Enter your site URL and run the check
  3. After you get the files pack, download the ZIP: it contains Schema.org, FAQ Schema, llms.txt and robots.txt
1

Install Claude Code (if not already installed)

Terminal
npm install -g @anthropic-ai/claude-code

Then run claude in your project directory and sign in with your Anthropic account.

2

Paste the GEO optimization prompt

Open Claude Code in your project root and send this message. Replace the placeholders with your actual content from Causabi.

Claude Code Prompt
I need to add Schema.org markup and files for AI crawlers to this site, so they can read the business facts. Please do all of the following: 1. Add Organization Schema JSON-LD to the <head> of every page: [PASTE YOUR ORGANIZATION SCHEMA FROM CAUSABI] 2. Add FAQ Schema JSON-LD to the homepage <head> only: [PASTE YOUR FAQ SCHEMA FROM CAUSABI] 3. Create or update the robots.txt file to allow AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended). 4. Create an llms.txt file with this content: [PASTE YOUR LLMS.TXT CONTENT FROM CAUSABI] Use the correct approach for this project's framework. Make sure all files end up in the right locations.
What happens next

Claude Code will read your project, identify the framework (Next.js, Vite, Astro, etc.), and make all the necessary file edits. It will show you exactly what it's changing before applying. For Next.js, that is usually app/layout.tsx (App Router) or pages/_document.tsx (Pages Router).

3

Deploy and verify

  1. Deploy your changes (Claude Code can also help with this)
  2. Check your-site.com/robots.txt and your-site.com/llms.txt
  3. Go to causabi.com → run a new check. An AI score of 70 or more is Good
  4. Validate Schema: validator.schema.org

Bonus: Automate with the MCP server

If you want Claude Code to automatically generate and apply files for AI crawlers in any project, install the Causabi MCP server:

claude mcp add geo-optimizer -- npx -y geo-optimizer-mcp

Then tell Claude Code: "Use the geo-optimizer MCP to check this site and prepare files for AI crawlers." It does the steps for you.

Check your own site right here

Enter your domain — we’ll show your AI score and the biggest thing keeping ChatGPT and other AI engines from reading your site.

Updated:

Check your site and preview the files for free

The check and a preview of the files are free. The files pack is $19 once per site (included in paid plans): Schema.org, FAQ Schema, llms.txt, and robots.txt tailored to your specific site, ready for Claude Code to apply.

Check my site
CursorCodexv0
Claude Code SEO — llms.txt, Schema.org and robots.txt