Title: WEO LLMS &amp; AI Crawler Guide
Author: Md Atiar Rahman Ovi
Published: <strong>12. Januar 2026</strong>
Last modified: 12. Januar 2026

---

Search plugins

![](https://ps.w.org/weo-llms-ai-crawler-guide/assets/banner-772x250.jpg?rev=3437868)

![](https://ps.w.org/weo-llms-ai-crawler-guide/assets/icon-256x256.jpg?rev=3437880)

# WEO LLMS & AI Crawler Guide

 By [Md Atiar Rahman Ovi](https://profiles.wordpress.org/webexpertovi/)

[Download](https://downloads.wordpress.org/plugin/weo-llms-ai-crawler-guide.1.6.0.zip)

 * [Details](https://de-ch.wordpress.org/plugins/weo-llms-ai-crawler-guide/#description)
 * [Reviews](https://de-ch.wordpress.org/plugins/weo-llms-ai-crawler-guide/#reviews)
 *  [Installation](https://de-ch.wordpress.org/plugins/weo-llms-ai-crawler-guide/#installation)
 * [Development](https://de-ch.wordpress.org/plugins/weo-llms-ai-crawler-guide/#developers)

 [Support](https://wordpress.org/support/plugin/weo-llms-ai-crawler-guide/)

## Description

**Prepare your WordPress site for the AI Search Era.**

As search engines evolve into Answer Engines (like ChatGPT Search, Perplexity, and
Google Gemini), they rely less on HTML and more on structured, raw text data. The`
llms.txt` standard is the new «robots.txt» for AI—a file specifically designed to
tell Large Language Models (LLMs) what your site is about and where to find your
best content.

**WEO LLMS & AI Crawler Guide** automatically generates a perfect, dynamic `llms.
txt` file for your site. It creates a categorized «Resume» of your website that 
helps AI bots understand your structure instantly.

### 🚀 Key Features

 * **Categorized Content Output:** Automatically groups your content by type (e.
   g., `## Post`, `## Page`, `## Products`) so AI understands your site structure.
 * **Automated Sitemap Detection:** Automatically detects and lists your `sitemap.
   xml` at the top of the file for deeper crawling.
 * **Markdown Optimization:** Converts your content titles, links, and excerpts 
   into clean Markdown (`- [Title](Link) - Excerpt`) optimized for LLM token limits.
 * **Robots.txt Integration:** Automatically adds a link to your `llms.txt` inside
   your site’s `robots.txt` file so crawlers can find it.
 * **Custom Control:** Choose exactly which Post Types (Pages, Posts, Products, 
   Custom Types) to include.
 * **Custom Intro/Outro:** Add specific instructions for AI bots (e.g., «This site
   is the authority on Technical SEO…»).
 * **Performance Caching:** Built-in caching ensures the file loads instantly without
   slowing down your server.

### 💡 Why do you need this?

If you want your content to appear in AI answers (ChatGPT, Claude, Perplexity), 
you need to make it easy for them to read. A standard HTML page is full of noise(
menus, sidebars, popups). An `llms.txt` file provides a clean, noise-free map of
your content.

This plugin handles the technical heavy lifting, ensuring your site is «AI Ready»
in seconds.

## Installation

 1. Upload the plugin files to the `/wp-content/plugins/weo-llms-ai-crawler-guide` 
    directory, or install the plugin through the WordPress plugins screen directly.
 2. Activate the plugin through the ‚Plugins‘ screen in WordPress.
 3. Go to the **WEO LLMS Guide** menu in your dashboard.
 4. Configure your Introduction, select your Content Sources, and click Save.
 5. Your file will be live at `yourdomain.com/llms.txt`.

## FAQ

### What is llms.txt?

It is a proposed standard for providing information to Large Language Models (LLMs)
in a concise, Markdown-based format. It acts like a «resume» or «map» for AI bots.

### Does this effect my SEO?

It is designed to help «AI SEO» (Optimization for Answer Engines). It does not negatively
impact traditional Google Search SEO. It simply provides an alternative, easier 
path for bots to consume your content.

### Can I hide specific post types?

Yes. In the plugin settings, you can uncheck any post type (like «Media» or private
custom types) to exclude them from the file.

### How often does the cache update?

The file is cached for 24 hours to ensure performance. You can manually purge the
cache from the dashboard at any time.

## Reviews

![](https://secure.gravatar.com/avatar/4f1ac4dccbec9136164df8e2234fdd42948365c95e51c6ebb3ce3ef824939e6c?
s=60&d=retro&r=g)

### 󠀁[Plug and play](https://wordpress.org/support/topic/plug-and-play-32/)󠁿

 [Mrinal Haque](https://profiles.wordpress.org/mrinal013/) 13. Januar 2026

Awesome. Just install the plugin and it start crawling.

![](https://secure.gravatar.com/avatar/d6913d80e412d43a45475bde3dbe6f7ec98db78da2204cfce6b6240989968c1d?
s=60&d=retro&r=g)

### 󠀁[A must-have for modern SEO!](https://wordpress.org/support/topic/a-must-have-for-modern-seo/)󠁿

 [toufiq11](https://profiles.wordpress.org/toufiq11/) 12. Januar 2026

Game changer for modern SEO. Takes seconds to set up. Super simple way to get your
site Al-ready. Highly recommend!

 [ Read all 4 reviews ](https://wordpress.org/support/plugin/weo-llms-ai-crawler-guide/reviews/)

## Contributors & Developers

“WEO LLMS & AI Crawler Guide” is open source software. The following people have
contributed to this plugin.

Contributors

 *   [ Md Atiar Rahman Ovi ](https://profiles.wordpress.org/webexpertovi/)

[Translate “WEO LLMS & AI Crawler Guide” into your language.](https://translate.wordpress.org/projects/wp-plugins/weo-llms-ai-crawler-guide)

### Interested in development?

[Browse the code](https://plugins.trac.wordpress.org/browser/weo-llms-ai-crawler-guide/),
check out the [SVN repository](https://plugins.svn.wordpress.org/weo-llms-ai-crawler-guide/),
or subscribe to the [development log](https://plugins.trac.wordpress.org/log/weo-llms-ai-crawler-guide/)
by [RSS](https://plugins.trac.wordpress.org/log/weo-llms-ai-crawler-guide/?limit=100&mode=stop_on_copy&format=rss).

## Changelog

#### 1.6.0

 * **New:** Restructured output to categorize content by Post Type (e.g., `## Post`,`##
   Page`).
 * **New:** Added automated `sitemap.xml` detection section.
 * **Fix:** Updated CSS loading method to comply with WordPress.org standards (removed
   inline styles).
 * **Fix:** Updated Contributor information.

#### 1.5.0

 * Added CSS asset separation.
 * Improved admin UI styling.

#### 1.4.0

 * Initial Release.

## Meta

 *  Version **1.6.0**
 *  Last updated **9 Monaten ago**
 *  Active installations **Fewer than 10**
 *  WordPress version ** 6.0 or higher **
 *  Tested up to **6.9.9**
 *  PHP version ** 7.4 or higher **
 *  Language
 * [English (US)](https://wordpress.org/plugins/weo-llms-ai-crawler-guide/)
 * Tags
 * [AI](https://de-ch.wordpress.org/plugins/tags/ai/)[ChatGPT](https://de-ch.wordpress.org/plugins/tags/chatgpt/)
   [crawler](https://de-ch.wordpress.org/plugins/tags/crawler/)[llms](https://de-ch.wordpress.org/plugins/tags/llms/)
   [seo](https://de-ch.wordpress.org/plugins/tags/seo/)
 *  [Advanced View](https://de-ch.wordpress.org/plugins/weo-llms-ai-crawler-guide/advanced/)

## Ratings

 5 von 5 Sternen.

 *  [  2 5-Sterne-Rezensionen     ](https://wordpress.org/support/plugin/weo-llms-ai-crawler-guide/reviews/?filter=5)
 *  [  0 4-Sterne-Rezensionen     ](https://wordpress.org/support/plugin/weo-llms-ai-crawler-guide/reviews/?filter=4)
 *  [  0 3-Sterne-Rezensionen     ](https://wordpress.org/support/plugin/weo-llms-ai-crawler-guide/reviews/?filter=3)
 *  [  0 2-Sterne-Rezensionen     ](https://wordpress.org/support/plugin/weo-llms-ai-crawler-guide/reviews/?filter=2)
 *  [  0 1-Sterne-Rezensionen     ](https://wordpress.org/support/plugin/weo-llms-ai-crawler-guide/reviews/?filter=1)

[Your review](https://wordpress.org/support/plugin/weo-llms-ai-crawler-guide/reviews/#new-post)

[See all reviews](https://wordpress.org/support/plugin/weo-llms-ai-crawler-guide/reviews/)

## Contributors

 *   [ Md Atiar Rahman Ovi ](https://profiles.wordpress.org/webexpertovi/)

## Support

Got something to say? Need help?

 [View support forum](https://wordpress.org/support/plugin/weo-llms-ai-crawler-guide/)

## Donate

Would you like to support the advancement of this plugin?

 [ Donate to this plugin ](https://webexpertovi.gumroad.com/coffee)