Skip to content

StottRobotsHandler.md

Latest commit

 

History

History
100 lines (98 loc) · 6.52 KB

StottRobotsHandler.md

File metadata and controls

100 lines (98 loc) · 6.52 KB
Raw
layout optiaddons
title Stott Robots Handler
description Content relating to the Stott Robots Handler Add-on for Optimizely CMS 12 & 13.
permalink /article/list/stott-robots-handler
category Stott Robots Handler
nugetdownloads 339,000+
optidownloads 159,000+
currentversion 7.0.0
gitRepositoryLabel PaaS Repository
gitRepository https://github.com/GeekInTheNorth/Stott.Optimizely.RobotsHandler

Stott Robots Handler is an Add-on for Optimizely CMS that allows a CMS Administrator to manage robots.txt content, llms.txt content and environment robots meta tag and header overrides without requiring a code deployment. This Add-on is free to use and is covered by an MIT License. If you wish to support the ongoing development of this Add-on, then please feel free to buy me a coffee.

Key Features

🤖 Robots.txt Management

  • User Friendly Interface: Manage robots.txt content across your whole CMS without a code deployment.
  • Per Application & Host: Define distinct robots.txt content by application (site in CMS 12) and by specific host.
  • Smart Resolution: Requests to /robots.txt are matched to the correct application by domain, returning sensible default content when none has been configured.

📄 LLMS.txt Management

  • Familiar Interface: Manage Markdown llms.txt content in the same interface used for robots.txt, with a larger editor suited to longer files.
  • Per Application & Host: Configure llms.txt by application (site in CMS 12) and specific host, or as an application-wide default.
  • Served on Demand: Content is served on /llms.txt only when defined — matching a specific host first, then an application default, otherwise returning a 404.

🔒 Environment Robots

  • Protect Lower Environments: Override robots meta tags and response headers at an environment level to keep integration and preproduction environments out of search engines.
  • Global Configuration: Applied across the whole instance, independent of any application or host configuration.

🛠️ Optimizely Opal Tools

  • Conversational Management: Create and modify robots.txt and llms.txt content directly from Optimizely Opal's chat interface.
  • Bearer Token Management: Issue multiple tokens, each with its own Read or Write scope for robots.txt and llms.txt.
  • Self-Describing: A built-in discovery endpoint registers the available tools with Opal.
  • Instruction Friendly: Pair the tools with Opal Instructions to generate rich llms.txt content tailored to your site.

✨ Additional Features

  • Headless Support: APIs allow robots.txt and llms.txt content to be served and managed within headless solutions.
  • No Code Deployment: All content is managed by CMS administrators with no need for a code deployment.
  • Opti Id Ready: Configurable for use with Optimizely Opti Id.
  • CMS 12 & 13: Supports both Optimizely CMS 12 (Sites) and CMS 13 (Applications).
  • Free & Open Source: Released under the MIT licence.