Glossary
Short definitions of the terms used across Unvibe and AI search.
AI crawler
A program that fetches web pages for an AI company, either to train models or to answer questions with fresh information. Most AI crawlers read the raw HTML and don't run JavaScript.
GPTBot, OAI-SearchBot and ChatGPT-User
OpenAI's crawlers. GPTBot collects pages for training, OAI-SearchBot indexes pages for ChatGPT search, and ChatGPT-User fetches a page when a ChatGPT user asks about it.
ClaudeBot
Anthropic's crawler for Claude. Anthropic also uses Claude-User and Claude-SearchBot for fetching and search.
PerplexityBot
Perplexity's crawler for its answer engine. Perplexity-User fetches pages when a user asks.
Google-Extended
A robots.txt token that controls whether Google may use a site's content for its AI models. It is separate from Googlebot, which crawls for Google Search.
GEO (generative engine optimization)
Making a website easy for AI assistants and AI search to read, understand, quote and recommend. Also called AI SEO, LLM SEO or AI search optimization.
AEO (answer engine optimization)
Structuring content so that answer engines, such as AI assistants and featured snippets, can use it as a direct answer.
AI visibility
How often and how prominently AI assistants recommend a product when people ask about its category. Unvibe measures it with the AI visibility score.
Client-side rendering
The browser builds the page with JavaScript after it loads. AI crawlers that don't run JavaScript see little or none of the text.
Server-side rendering, static generation and pre-rendering
Ways to put the page's text into the HTML before it reaches the browser, so crawlers can read it without running JavaScript.
robots.txt
A file at the root of a website that tells crawlers which paths they may fetch. Rules can target specific crawlers, such as User-agent: GPTBot.
Sitemap
An XML file that lists a site's public pages so crawlers can find them. Its location is usually listed in robots.txt.
JSON-LD and structured data
A block of machine-readable data in a page, using the schema.org vocabulary, that states facts such as "this is a software application that costs $5.99 a month".
llms.txt
A Markdown file at the root of a site that gives AI tools a short summary of the site and links to its most useful pages. Some sites also publish llms-full.txt with the full content in one file.
Open Graph
Meta tags (og:title, og:description, og:image) that control how a page looks when shared as a link.
MCP (Model Context Protocol)
An open protocol that lets AI assistants and coding agents use external tools and data. Unvibe's MCP server lets coding agents read and apply fixes.
Vibe coding
Building software mainly by describing it to AI tools such as Lovable, Bolt, v0, Replit, Cursor or Claude Code, rather than writing the code by hand.