Build a Robots Meta Tag for a Launch Preview
Admin ·
Choose the page-level request for a launch preview before writing the tag. Each setting is an instruction about indexing, following links or displaying previews. Your site’s existing tags and headers can also contribute instructions.
Build the noindex tag for an HTML preview page
Select Load example and Build tag. The scope is robots and the content attribute reads noindex, follow, max-snippet:50. The snippet value is an independent request for use if a version of the page is eligible to appear in Google results.
For a preview you intend to keep outside Google results, check that noindex appears in the saved content. Verify the setting again when the page becomes eligible for launch.
Generate a noindex response header for a PDF
Select the Noindex header preset and then Build header. The result is a single line reading X-Robots-Tag: noindex. In a server or CDN configuration that separates the field name from the value, use X-Robots-Tag as the name and noindex as the value.
Apply the header to the PDF response. Reopen that response and check its final URL, status and headers. Keep the PDF crawlable while the search engine reads the new instruction.
For a separate time-limited example, change Indexing to Omit and enter 2027-02-17T16:30:00+01:00 in Unavailable after. Build again. The response header reads X-Robots-Tag: unavailable_after:2027-02-17T15:30:00Z. Check the UTC time against the scheduled cutoff.
Google Search Central, robots meta and preview directivesGoogle Search Central, block search indexing with noindex
Add a snippet restriction and review the overlap
Enable Hide snippets and build again. The tag now contains nosnippet and max-snippet:50. The builder reports overlapping instructions and the summary shows that Google is asked to show no text snippet. Clear the Snippet limit field to leave a single snippet request.
For the numeric snippet field, 0 has the same Google effect as nosnippet, while -1 asks for no explicit cap. A blank field omits the directive.
Verify the saved markup and the intended scope
Download the HTML tag and open it in Meta Robots Tag Tester. Check the quoted name and content and make sure the intended crawler profile sees the directive. Add the tag to the page head alongside the existing templates.
Choose a crawler-specific scope only when the destination recognizes that tag name and directive. For example, Bing documents noarchive and nocache behavior, while Google Search no longer uses them.
Google Search Central, robots meta and preview directivesBing policy for NOARCHIVE and NOCACHE
Common questions
How do I check a crawler-specific header?
Download the line and look for the crawler token before its directives, such as googlebot: noindex. Inspect the actual response and review the receiving crawler’s documentation for its supported scope.
Why must the page be crawlable for a noindex tag to work?
The crawler has to fetch the response to read the directive. Review its access rules and actual response when verifying deployment.