Optimize Your Website for the AI Era: Audit and Verify Your llms.txt Files Instantly!
Is your website ready for AI-driven search engines, chatbots, and agents? Modern AI crawlers utilize the proposed /llms.txt standard to quickly discover and digest the key documentation, products, articles, and details of your website without wasting valuable context window tokens.
LLMs.txt Compliance Inspector is a developer tool that audits your website’s llms.txt and llms-full.txt files for strict compliance with search crawler rules, format guidelines, and architectural templates. With a single click, it runs a deep audit, grades your compliance, and displays findings inside an interactive dashboard overlay.
Key Features:
- Dynamic Site Archetype Detection Different websites need different structured feeds. The Inspector automatically analyzes your site structure, metadata, links, and scripting elements to determine your website type and apply tailored auditing rules. Alternatively, you can override the auto-detection to test any of the following archetypes:
- Shopify Storefront: Validates collections and products routes, buying guide formats, sitemap index locations, and verifies the presence of required Shipping and Returns/Refunds policies.
- WooCommerce Storefront: Ensures standard product categories, individual WooCommerce product routes, store policies, and WooCommerce-compatible sitemap structures are present.
- SaaS / Web App: Audits platform feature overviews, pricing models, developer documentation/API references, live system uptime status links, SLAs, and technical support pathways.
- News and Blog Portal: Scans for editorial sections, writer profile routes, RSS/Atom feeds, and checks for critical journalistic declarations (Fact-Checking, Corrections, and Ethics and Standards).
- Corporate Website: Evaluates executive leadership/governance links, ESG commitments, secure trust portfolios, careers portals, and general corporate profiles.
- Personal Portfolio: Inspects biography details, list of skills/tools, featured projects, professional history, downloadable Resume/CV paths, and active contact methods (Email, GitHub, LinkedIn).
- Educational Portal: Validates course departments, class catalog lists, tuition structures, student privacy declarations (FERPA), and academic integrity honor codes.
- Universal / General: Provides a robust baseline check for any blog, site, or custom application.
- Core Compliance Check Suite The engine performs exhaustive validation rules covering structure, syntax, and servers:
- H1 Header and Title Placement: Confirms top-level identifier headers exist and are positioned optimally at the start of the file for parser engines.
- Description Blockquote: Assures a concise, top-level blockquote is available to supply chatbots with a high-level summary.
- Absolute URL Validator: Crawlers need absolute addresses. The Inspector flags any relative links and directs you to convert them.
- Placeholder Finder: Prevents template errors by checking for unreplaced boilerplate strings (such as yourstore.com or [Store Name]).
- HTML Markup and Script Block Guard: Guarantees standard, lightweight Markdown by flagging inline tags or scripting layout components.
- Context Limit Guard: Keeps your llms.txt file highly readable for AI agents by warning you if your file exceeds 500 lines (prompting you to move details to llms-full.txt).
- Companion File Checker: Checks for the presence of a linked llms-full.txt for deep indexing.
- Server Configuration and Header Inspector A compliant text file must be served correctly. The tool checks your hosting settings:
- HTTP Content-Type Header: Validates that the file is served as text/plain rather than text/html to prevent soft-404 indexing failures.
- CORS Header Detector: Flags missing Access-Control-Allow-Origin headers, ensuring third-party browser plugins and client-side scrapers can access your feed.
- Dashboard and Exports
- Live HUD Overlay: View a detailed audit score (0 to 100%) and letter grades (A+ to F) on top of your page.
- Actionable Warning Cards: Expand audit violations to see exact line numbers, snippets, and recommendations to fix them.
- Copy Report: Generate a clean, structured Markdown report of all findings to copy directly to your clipboard.
- Generate PDF Audits: Export a professionally formatted compliance PDF layout using your browser’s print engine.
How to Use It:
- Navigate to the website you want to inspect.
- Click the LLMs.txt Compliance Inspector extension icon.
- The HUD will slide in from the right:
- If /llms.txt is found, the inspector will display your score, detected archetype, and detailed checklist findings.
- If the file is missing, the dashboard will warn you and prompt you to set it up.
- Expand any audit card with a yellow/red indicator to read detailed troubleshooting steps.
- Click Copy Report or Generate PDF to share your findings.
Privacy and Permissions: This extension runs entirely inside your browser. It reads the /llms.txt file from the host domain on-demand. No data is sent to external servers. Permissions requested:
- activeTab: To examine /llms.txt on the active site when you click the extension.
- scripting: To inject the inspector UI overlay safely onto the active page.
Technical Specifications:
- Version: 1.0.0
- Manifest Version: 3 (Chrome Extension Best Practices)
- Design Language: Custom Glassmorphism HUD (Dark mode, Outfit/Inter typography, dynamic transitions)
Privacy Policy
We respect your privacy and are committed to protecting any personal information you share with us through this website. This section explains what data we may collect, how we use it, and how we keep it secure.
Information We Collect
We may collect basic personal information when you contact us, submit a form, request a service, or communicate with us directly. This may include your name, email address, phone number, company name, and any details you choose to provide in your message.
We may also collect non-personal technical data, such as browser type, device information, IP address, visited pages, referral sources, and general website usage data. This helps us understand how visitors use the website and improve the user experience.
How We Use Your Information
We use the information you provide to respond to inquiries, deliver requested services, improve our website, communicate with you, and maintain the security and performance of our platform.
We do not sell, rent, or trade your personal information to third parties.
Cookies and Tracking
This website may use cookies and analytics tools to understand visitor behavior, measure website performance, and improve content. You can disable cookies through your browser settings, but some parts of the website may not function properly without them.
Data Protection
We take reasonable technical and organizational measures to protect your personal information from unauthorized access, loss, misuse, or disclosure. However, no online transmission or storage system can be guaranteed as completely secure.
Third-Party Services
Our website may contain links to third-party websites or use third-party tools, such as analytics, contact forms, payment systems, or embedded content. We are not responsible for the privacy practices or content of external websites and recommend reviewing their privacy policies separately.
Your Rights
You may request access to, correction of, or deletion of your personal information by contacting us directly. You may also ask us to stop using your data for communication purposes at any time.
Contact Us
If you have any questions about this Privacy Policy or how your information is handled, please contact us through the contact details provided on this website.