Early Access
robots
Provides search engines with directives for indexing and following links on your webpage. It plays a crucial role in SEO strategy by helping control crawler access and behavior.
Parameters
<meta name="robots" content="index" />
<meta name="robots" content="noindex" />
<meta name="robots" content="follow" />
<meta name="robots" content="nofollow" />
<meta name="robots" content="noarchive" />
<meta name="robots" content="nosnippet" />
<meta name="robots" content="notranslate" />
<meta name="robots" content="noimageindex" />
<meta name="robots" content="unavailable_after" />
Code Examples
<meta name="robots" content="index, follow" />
Recommendations
- Combine Directives StrategicallyUse combinations wisely, like "noindex, follow" to prevent a page from being indexed while still passing on link equity to other pages.
- Specify Unavailable AfterUse "unavailable_after" for time-sensitive content to automatically remove pages from the index after a certain date, rather than manually demarcating outdated content.
Related Documentation
Related Meta Tags
author
Specifies the name of the author of the document or webpage. This is used by search engines to understand authorship information, which can influence search rankings and visibility.
<meta name="author" content="Jane Doe">
charset
Defines the character encoding standard for the HTML document. Character encoding is essential for rendering text correctly in browsers.
<meta charset="charset" content="UTF-8">
Used for verifying ownership of a website within Google Search Console, a crucial step for accessing detailed reporting and configuring how Google interacts with your site.
<meta name="google-site-verification" content="your_verification_code">
description
Provides a brief and concise summary of a web page’s content. This summary is often used by search engines to display snippet previews in search results, influencing click-through rates.
<meta name="description" content="Learn how to bake delicious, moist cupcakes with our easy-to-follow guide. Featuring tips and tricks for beginners.">
This meta tag is utilized to specify how Google should interact with your site. Primarily, it's used to enable or disable Google's site translation feature on a per-page basis.
<meta name="google" content="notranslate">
Community