Meta tags are a great way for webmasters to provide search engines with information about their sites. Meta tags can be used to provide information to all sorts of clients, and each system processes only the meta tags they understand and ignores the rest. Meta tags are added to the
<head> section of your HTML page and generally look like this:
<!DOCTYPE html> <html> <head> <meta charset="utf-8"> <meta name="Description" CONTENT="Author: A.N. Author, Illustrator: P. Picture, Category: Books, Price: £9.24, Length: 784 pages"> <meta name="google-site-verification" content="+nxGUDJ4QpAZ5l9Bsjdi102tLVC21AIh5d1Nl23908vVuFHs34="/> <title>Example Books - high-quality used books for children</title> <meta name="robots" content="noindex,nofollow">
These meta tags control the behavior of search engine crawling and indexing.
<meta name="robots"> tag applies to all search engines, while the
<meta name="googlebot"> tag is specific to Google.
The default values are
"index, follow" and do not need to be specified. We understand the following values (when specifying multiple values, separate them with a comma):
index- Allow the page to be indexed.
follow- Follow any links in the page as part of crawling.
noindex- Prevents the page from being indexed.
nofollow- Don't follow links from this page as part of crawling.
nosnippet- Don't show a text snippet or video preview from being shown in the search results. For video, a static image will be shown instead, if possible. Example:
<meta name="robots" content="nosnippet">
noarchive- Don't show a Cached link for a page in search results.
unavailable_after:[date]- Lets you specify the exact time and date you want to stop crawling and indexing of this page.
noimageindex- Don't show the page as the referring page for an image in Google Image search results.
none- Equivalent to
all- [Default] Equivalent to
You can also specify this information in the header of your pages using the "X-Robots-Tag" HTTP header directive. This is particularly useful if you wish to limit indexing of non-HTML files like graphics or other kinds of documents.
more info support google