All guides
Cursor · Easy

Cursor and llms.txt: add Schema.org and robots.txt

Cursor is an AI code editor. You can ask it to add Schema.org, robots.txt and llms.txt to a project in a single prompt. It works with Next.js, React, Vite and static sites.

What we'll add:
  • Organization Schema — AI can read what your business does
  • FAQ Schema — the questions and answers on your page, in a form AI can read
  • robots.txt — allow GPTBot, ClaudeBot, PerplexityBot
  • Specifics and freshness — prices, facts and update dates on the page itself; markup does not replace them
  • llms.txt — a short summary of the site for AI agents; no proven effect on AI answers
0

Generate your fix files first

  1. Go to causabi.com
  2. Enter your site URL and run the check
  3. After you get the files pack, download or copy the Schema.org, FAQ Schema, llms.txt, and robots.txt
1

Add Schema.org — paste this prompt in Cursor Chat

Open Cursor, press Cmd+L (Ctrl+L on Windows) to open Chat, and paste this prompt. Replace the placeholders with your actual content from Causabi.

Cursor Chat Prompt
Add these JSON-LD scripts to the <head> of every page. In the root layout (layout.tsx, _document.tsx, or index.html), add: <script type="application/ld+json"> [PASTE YOUR ORGANIZATION SCHEMA FROM CAUSABI] </script> On the homepage only, also add: <script type="application/ld+json"> [PASTE YOUR FAQ SCHEMA FROM CAUSABI] </script> This is so AI crawlers can read the business facts.
Framework notes
  • Next.js App Router: add to app/layout.tsx inside <head>
  • Next.js Pages: add to pages/_document.tsx
  • Vite/React: add to index.html <head>
  • Astro: add to your base layout .astro file
2

Update robots.txt

Cursor Chat Prompt
Create or update public/robots.txt with this content to allow AI crawlers: User-agent: * Allow: / User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: /
3

Add llms.txt

Cursor Chat Prompt
Create public/llms.txt with this content. llms.txt is a short summary of the site for AI agents: [PASTE YOUR LLMS.TXT CONTENT FROM CAUSABI]
4

Deploy and verify

  1. Deploy your changes (push to Vercel, Netlify, etc.)
  2. Check your-site.com/robots.txt and your-site.com/llms.txt in browser
  3. Go to causabi.com → run a new check. An AI score of 70 or more is Good
  4. Validate Schema: validator.schema.org

Check your own site right here

Enter your domain — we’ll show your AI score and the biggest thing keeping ChatGPT and other AI engines from reading your site.

Updated:

Check your site and preview the files for free

The check and a preview of the files are free. The files pack is $19 once per site (included in paid plans): Schema.org, FAQ Schema, llms.txt, and robots.txt tailored to your specific site, ready to paste into Cursor.

Check my site
Claude Codev0Bolt
Cursor and llms.txt: add Schema.org and robots.txt