The robot's eye is different from the user

This is due to the fact that some sites can serve different content depending on the user or the robot.

For example, an online store for a user may be given different content depending on the region of residence.

The method of black search engine optimization - called "cloaking" The term comes from the English word to cloak - to mask, hide, hide - Sites that give different content to users and search engine robots.

Such sites Yandex and Google are classified as low-quality sites and have announced severe penalties for cloaking, from pessimization to banning.

A striking example of cloaking can serve as directories of links that hide direct links from robots, but show them to a simple user who cannot understand why his link is not visible in search engines.

Please note that cloaking does not include displaying various content of a web resource if the user views it as authorized (via login and password). Also not related to cloaking is the viewing of dynamic pages with different URL variables, such as URL = user and URL = bot.

View HTML page code

Our online webmaster tool allows you to view HTML code through the eyes of the Googlebot crawler and Yandex crawler.
HTTP USER AGENT list:
User - I'm Mozilla / 5.0 (Windows NT 6.1; WOW64) AppleWebKit / 537.36 (KHTML, like Gecko) Chrome / 91.0.4472.135 YaBrowser / 21.6.2.854 Yowser / 2.5 Safari / 537.36

APIs-Google - Google PIs-Google robot (+ https: //developers.google.com/webmasters/APIs-Google.html)

Adsense - Google Mediapartners-Google Robot

AdsBot Mobile Web Android - Google Mozilla / 5.0 robot (Linux; Android 5.0; SM-G920A) AppleWebKit (KHTML, like Gecko) Chrome Mobile Safari (compatible; AdsBot-Google-Mobile; + http: //www.google.com/ mobile / adsbot.html)

AdsBot Mobile Web - Google Robot Mozilla / 5.0 (iPhone; CPU iPhone OS 9_1 like Mac OS X) AppleWebKit / 601.1.46 (KHTML, like Gecko) Version / 9.0 Mobile / 13B143 Safari / 601.1 (compatible; AdsBot-Google-Mobile; + http: //www.google.com/mobile/adsbot.html)

AdsBot-Google (+ http: //www.google.com/adsbot.html) AdsBot - Google robot)

Googlebot Images - Googlebot Googlebot-Image / 1.0

Googlebot News - Google robot Googlebot-News

Googlebot Video - Google robot Googlebot-Video / 1.0

Googlebot - Google robot Mozilla / 5.0 (compatible; Googlebot / 2.1; + http: //www.google.com/bot.html)

Mobile Adsense - Google Robot (compatible; Mediapartners-Google / 2.1; + http: //www.google.com/bot.html)

Mobile Apps Android - Google AdsBot-Google-Mobile-Apps robot

Viewing the html page of the site

This tool will show the html code of the page with code syntax highlighting. Viewing html documents will now be visually readable.

The html document viewer is based on receiving data using a PHP script.

Viewing the html page of a site is the first step in learning how to program web documents using HTML markup, CSS and JS.

^ Top