ABCDEFGHIJKLMNOPQRSTUVWXYZ
1
PageSectionItemBefore ChangeAfter ChangeLearningGeneral Topic
2
60,1The Purpose of Search Quality RatingYour ratings will be used to evaluate search engine quality around the world. Good search engines give results that are helpful for people in their specific language and locale.

It is important that you are familiar with and comfortable using a search engine. We encourage you to be an expert in Google search! For example, experiment with using operators (e.g., quotes or a dash) in your searches or try using Google’s advanced search option.
As a Search Quality Rater, you will help evaluate search engine quality around the world. Good search engines give results that are helpful for people in their specific l anguage and locale.

Your ratings will not directly affect how a particular webpage, website, or result appears in Google Search, nor will they cause specific webpages, websites, or results to move up or down on the search results page. Instead, your ratings will be used to measure how well search engine algorithms are performing for a broad range of searches.

As part of your role in the search quality rating program, it is important that you are familiar with and comfortable using a search engine. We encourage you to be an expert in search! For example, experiment with using operators (e.g., quotes or a dash) in your searches or try using advanced search options.		Google emphasizes that "Quality Raters" do not impact on the rankingsSEO
3
70,6The Role of Examples in these GuidelinesThe examples in these guidelines are very important. Please view each one and keep in mind the following notes:

● Webpages and websites change rapidly, so we use images or "snapshots" of webpages in most of our examples.
● The information in the examples was accurate at the time it was added, but content and websites may change
over time.
● Some examples show pages on desktop and some show pages on mobile devices.		The examples throughout these guidelines are very important to illustrate how the concepts defined in each section should be applied in rating tasks. Please view each example and keep the following in mind:

● Webpages and websites change rapidly, so we use images or "snapshots" of webpages in most of our examples.
● The i nformation in the examples was accurate at the time it was added, but content and websites may change
over time.
● Some examples show pages on desktop and some show pages on mobile devices.		Google emphasizes the importance of understand and follow the examples
4
437.4.2Malicious PagesUse the Lowest rating if you suspect a page is malicious, even if you’re not able to completely confirm that the page is harmful. Please exercise caution and practice good Internet safety skills.If you do click on a link and encounter a malware warning from your browser or antivirus software (example), please do not continue to that page. You can assume that the page is malicious for the purpose of rating and use Lowest.

Note that not all warnings your browser may display are related to malware (e.g., other types of browser warnings include certificate acceptance requests, content filtering warnings, etc.). If you are unsure or hesitant to continue to the page for any reason, you can release the task.

Use the Lowest rating if you suspect a page is malicious, even i f you’re notable to completely confirm that the page is harmful. Please exercise caution and practice good Internet safety skills.		This task involves SEO projects to take maximum care of their security and to periodically check that there are no such warningsSecurity
5
7812.8.2Special Content Result Block ExamplesSpecial Content Result Blocks are designed to show content directly to users on the search results page. From working calculators to playable videos to interactive weather information, these results help users immediately get information or content, and may not require additional “clicks” or page loads.

Because mobile phones can be difficult to use, SCRBs can help mobile phone users accomplish their tasks very quickly, especially for certain Know Simple , Visit-in-Person , and Do queries.		Special Content Result Blocks (SCRBs) appear in the search results page, along with Web Search Result Blocks. They are frequently, but not always, the first result on the search results page.

Special Content Result Blocks are designed to show content directly to users on the search results page. From working calculators to playable videos to interactive weather information, these results help users immediately get information or content. Some SCRBs may also have links to landing pages.		The direct responses from Google that usually do not generate clicks in the SERPs, but this change leaves the door open for them to exist, is it a sign that they are going to implement special click results?SERPs
6
8613,1
Rating Result Blocks: Block Content and Landing Pages
In addition, think about whether a user would click on the link(s) if available, in order to satisfy their user need.Some Special Content Result Blocks may have links to landing pages. In these cases, think about whether a user would click on the link in order to satisfy their user need.Before the change, it is asked to analyse if the user would like to click, after the change it is stated that special results can have links and it should be studied if the click can satisfy the user's needSERPs
7
8613,1
Rating Result Blocks: Block Content and Landing Pages
n/aNote: The guidance in this section specifically applies to Needs Met ratings. For Special Content Result Blocks that have landing pages, you may or may not also be asked to provide Page Quality ratings. In these cases, your Page Quality rating should always be based on the landing page. Please refer to Section 14.0 for more about the relationship between Needs Met and Page Quality ratings.-
8
11413,6Fails to Meet (FailsM)Fails to Meet should be used for the following types of Lowest Page Quality results:

● Results that harm users (e.g., malicious download pages, "phishing" pages or websites, etc.).		Fails to Meet should be used for the following types of Lowest Page Quality results:

● Results that harm users (e.g., malicious download pages, "phishing" pages or websites, etc.).

Note that if you encounter a malware warning or untrustworthy site warning from your browser (example) , you can assume for rating purposes that the page is malicious without continuing to the page.		This task involves SEO projects to take maximum care of their security and to periodically check that there are no such warningsSecurity
9
13215.4.2
Needs Met Rating for Foreign Language Results
If the video is someone talking about the song, band, film, or event, the result probably cannot be understood or enjoyed and should be assigned a FailsM rating and the Foreign Language flag.If the video is someone talking about the song, band, film, or event, the result probably cannot be understood or enjoyed and should be assigned a FailsM rating and the Foreign Language flag.

Note: If you are unable to evaluate the Page Quality rating of a Foreign Language result, you do not need to assign a Page Quality rating and can leave the slider at N /A.		Presenting content in another language can be negative for user satisfactionInternational
10
13415.5.1Using the Did Not Load FlagAdditionally, use the Did Not Load flag for

● Malware warnings, such as “Warning – visiting this web site may harm your computer!”
● Pages that solicit certificate acceptance requests.		You should not use the Did Not Load flag for:

● Malware warnings, such as “Warning – visiting this site may harm your computer!” (example) .
● Pages that have removed or expired MC (e.g., expired classified l isting, removed social media post, products or services unavailable).
● Pages that are inaccessible because you need a subscription to view the MC.		-
11
13415.5.2
Needs Met Rating for Did Not Load Results
All result blocks must be given a Needs Met rating. If the landing page truly doesn’t load, assign the Did Not Load flag and rate the page FailsM . True Did Not Load pages are useless.

Sometimes the page partially loads or has an error message. Give Needs Met ratings based on how helpful the result is
for the query. Error messages can be customized by the webmaster and are part of a well-functioning website. Sometimes these pages are helpful for the query.		All result blocks must be given a Needs Met rating. If the l anding page truly doesn’t load, assign the Did Not Load flag and rate the page FailsM. True Did Not Load p ages are useless.

Sometimes the page partially loads or has an error message. Give Needs Met ratings based on how helpful the result is
for the query. Error messages can be customized by the webmaster and are part of a well-functioning website. Sometimes these pages are helpful for the query.

Note: If you are unable to evaluate the Page Quality rating of a Did Not Load result, you do not need to assign a Page Quality rating and can l eave the slider at N /A.		-
12
13515.5.2Query: [boys pink snow shoes]The MC has an error message, but the LP has a lot of SC.
However, the page has no information about boys pink snow shoes and is unhelpful for the query.
Do not assign the Did Not Load flag.		Needs Met: The MC has an error message, but the LP has a l ot of SC. However, the page has no information about boys pink snow shoes and is unhelpful for the query.

Page Quality: This LP is on a well-known, reputable merchant website. Despite the error message, this page does a nice job of explaining the issue and providing a search box, including helpful search tips and customer service i nformation.

Do not assign the Did Not Load flag.		It is important to inform the user as much as possible when using our internal search engine and we do not offer results to theur searchInternal Search / UX
13
13515.5.2Query: [bible passages]In spite of the customized “No results found” message on the LP, it has links to all passages in the bible, organized by book. It would be very helpful for most users.

Do not assign the Did Not Load flag.		Needs Met: In spite of the customized “No results found” message on the LP, i t has links to all passages i n the Bible, organized by book. It would be very helpful for most users.

Page Quality: This page is a well-known, reputable reference website. In addition to links to all passages in the Bible, this error page provides a search box as well as a suggestion explaining how to refine searches.

Do not assign the Did Not Load flag.		It is important to offer alternatives to the user when using our internal search engine and we do not have relevant content for your searchInternal Search / UX
14
13515.5.2Query: [broadway tickets]n/aClicking on this result block leads to a malware warning. You can assume that the page is malicious without continuing to the page. As discussed in Sections 7.4.2 and 13.6, you should assign a FailsM Needs Met rating and Lowest Page Quality rating.

Do not assign the Did Not Load flag.		This task involves SEO projects to take maximum care of their security and to periodically check that there are no such warningsSecurity
15
13515.5.2Query: [paranormal activity]n/aThis page cannot be reached because the site's server IP address was not found. There is no MC, SC, or Ads on the page.

This result merits a FailsM Needs Met rating, and no Page Quality rating is required.

Assign the Did Not Load flag.		It is important that SEO projects are available and accessibleAccesibility
16
16524
Rating Dictionary and Encyclopedia Results for Different Queries
n/aWhen assigning Needs Met ratings for dictionary and encyclopedia results, careful attention must be paid to the user intent. Like all results, the helpfulness of dictionary and encyclopedia results depend on the query and user intent.

Dictionary and encyclopedia results may be topically relevant for many searches, but often these results are not helpful for common words that most people in your rating locale already understand. Reserve high Needs Met ratings for dictionary and encyclopedia results when the user intent for the query is likely "what is it" or "what does it mean" and the result is helpful for users seeking that type of information.

Important: Think very carefully about the helpfulness of dictionary and encyclopedia results for ordinary words and common items. If few users would benefit from a dictionary or encyclopedia result for a common word, a Slightly Meets rating may be appropriate. If very few or no users would benefit, then Fails to Meet is appropriate.		Specify user satisfaction for dictionary or encyclopedia results, limiting to words containing "what it is" or "what it means", and not only to generic consultation. The future impact for this type of site is obviousSEO
17
175Appendix 2: Guideline Change Logn/aThis guideline is updated regularly to remain relevant over time. Changes from the past two years (October 2018 - October 2020) aresummarized below.-
18
175Appendix 2: Guideline Change Logn/aAdded note to clarify that ratings do not directly impact order of search results

● Emphasized ' The Role of Examples in these Guidelines' as an independent section in the introduction

● Added clarification that Special Content Result Blocks may have links to l anding pages; added illustrative example

● Updated guidance on how to rate pages with malware warnings and when to assign the Did Not Load flag; added illustrative examples

● Changed the order of Rating Flags section and Relationship between Page Quality and Needs Met section for clarity

● Added ' Rating Dictionary and Encyclopedia Results for Different Queries' : Emphasizes the importance of understanding the user intent and query for Needs Met rating; added illustrative examples

● Minor changes throughout (updated examples and explanations for consistency; simplified language regarding raters representing people in their locale; fixed typos; etc.)		The main topics affected: SEO, security, ux, accesibility
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100