Quality Rater or a Search Engine Evaluator is an Assessor, Rater or Evaluator is an independent contractor that provides feedback and critical insights for search engine companies like Google and Microsoft Bing. As Google and Microsoft Big are constantly evolving their search engine algorithm to meet the changing needs of people they need human insight. Basically an Assessor, Rater or Evaluator help the companies like Google and Microsoft to train their algorithms by giving quality feedback. As these roles are from companies like Google and Microsoft they are long term and well paying. However you can’t directly work from them. These roles are provided through vendor companies.
Here is what Google say about its Rater ( from Official Google Website )
How our Quality Raters make Search results better
At Google, we’re always working on ways we can improve your Search experience.
We constantly experiment with ideas to improve the results you see. One of the ways we evaluate those experiments is by getting feedback from third-party Search Quality Raters. Quality Raters are spread out all over the world and are highly trained using our extensive guidelines. Their feedback helps us understand which changes make Search more useful.
Raters also help us categorize information to improve our systems. For example, we might ask what language a page is written in or what’s important on a page.
We use responses from Raters to evaluate changes, but they don’t directly impact how our search results are ranked.
Learn more about how Search works and our Search Quality Rater tests.
Who is suitable for this work?
We are looking for dynamic people who are have strong communication skills and use the Internet daily. You should also be flexible, reliable and have the ability to interpret and follow established guidelines. You will need to have the flexibility and freedom to work from your own home, working your own hours. Hours for this opportunity are up to 20 hours per week depending on task availability.
What are the main requirements for the opportunity?
- You must be living in Country Of your residence for the last 3 consecutive years
- You must have familiarity with current and historical business, media, sport, news, social media and cultural affairs in Country Of your residence
- Fluency in English and Tamil (Any secondary Language if available)
- Access to and use of a broadband internet connection and associated computer and software to perform the work, all provided at your own expense
- Experience in use of web browsers to navigate and interact with a variety of content
- Access to and use of an Android (version 4.1 or higher) or IOS Smartphone (version 8 or higher) to complete tasks
- A Barcode Scanner application must be installed on your smartphone to complete certain tasks
- Active daily user of Gmail and other forms of Social Media
The Role Will Involve
- Reading and applying written guidelines on how to evaluate and rate the tasks
- Please note it is possible you will receive guidelines for multiple task types over the course of the program
- Research using online tools to determine the relevance and accuracy of the task information
- Applying local knowledge to evaluate relevance of the task information in your market
- Completing tasks in the web-based evaluation tool
- Hours for this role are a minimum of 10 up to 20 hours per week depending on task availability
- This is a freelance, independent contractor position.
So key highlight is you don’t need any special qualification. You need to be good in English, know how to use search engine like google. Will be residing in country of your residence for last 3 years. This is a freelance contractor position, you are not part time or full time employee of the company. You can work maximum of 20 hours per week and minimum of 10 hours you should work, if work is available.
Vendor Website/ Companies of Google
Lionbridge and Appen Connect are the vendor companies of Google for its Quality Rater job.
Lionbridge calls this position as a Personalized Internet Assessor. Position is open 2 or 3 times a year.
Lionbridge recently collaborated with Telus International. Based in Ireland is having its corporate office in USA. 20+ years old Lionbridge is one of the best crowdsourcing platforms which help brands building deeper relationship with their customers with the help of its over 1 million crowd workers. Lionbridge is 100% legitimate website which has paid a lot of money to remote workers all around the world and was recognized as best large employers by Forbes in 2019. The company operates in more than 75 countries and works for several prestigious companies including Google. Flexjobs has awarded Lionbridge as #1 Company in 2021 for remote jobs. There are uncountable positive reviews about Lionbridge on internet. The company has been around for a long time and provides real jobs.
At any point of tine you can work on single role for the Lionbridge. And you cannot work for similar position for another company. My first preference will be to Lionbridge when long term reliable and highly paying remote job is concerned.
Appen is definitely a legitimate crowdsourcing company established in 1996 in Australia. It has more than 1 million registered independent contractors/workers from all around the world. It works for prestigious clients like Google, Microsoft, amazon, IBM etc. Appen with an experience of 20+ years is working in 75+ countries.
The beauty of Appen is the variety of tasks it offers. Do you have iphone and can take great photos? You will get a lot of projects. Are you good at web research? Appen really needs you. You can write down what a person in an audio file is saying, you will get a project on transcription Appen have many exciting work from home jobs ranging from doing a simple survey to complex projects only very few people can do.
Here are some types of tasks you can expect from Appen as a contributor
- Search Media Evaluation – relevance events
- Text annotation – Identifying sentiments in text, classifying documents
- Social Media Evaluation – identifying emotion a post contains
- Translation Services – Translating languages
- Testing – like user interface testing
- Content Moderation – reviewing user generated content
- Transcription Services – Converting audio into text
- Survey and Data Collection
- Linguistic Specialties – like Text to Speech, Phonetics, Pronunciation, Annotation, etc.
- Speech Evaluation
- Image Annotation – classifying images, object detection etc
- Video Annotation – object detection, video relevance for a query
- Sensor Data Annotation i.e., LiDAR, Radar, etc.
Here is how you can you start with Appen
Log into your Appen(connect) account. Click on All projects from main menu. You have an option to see projects you are qualified for, or you are not qualified for or all projects. You can get a list of project according to skills you possess by choosing a type of project from top right drop down menu like if you are good at web research then you can select web research and click Go. Apart from it, every project listing will have all the important details mentioned along with like hourly rate, goal of the project, no. of tasks available, hours you need to work in a week, instructions how to complete the project, what is expected from you, qualification contributor needs etc. Accuracy matters a lot on every micro-jobs platform so make sure you only choose projects you are capable of completing.
Some projects can be started right away without passing a qualification test but then there will be many projects you will need to qualify to get it assigned to you. Once you have chosen a suitable project that matches your skills, click on green button that says Qualify. You will be redirected to project description page or qualification exam they ask some questions to make sure you are the right candidate for project.
Apply for as many as projects you can think you can successfully compete to increase your chance of getting selected for a project. By clicking on the active processes on the top of the page, you can check status of all your applications.
Good thing is you can simultaneously work for more than one project. However as like Lionbridge here also you cannot work for similar project for another company. That is to say you cannot work as Internet Assessor for Lionbridge and Appen simultaneously. Bur you can work as Internet Assessor for Lionbridge and Ads Assessor for Appen simultaneously. Or you can work on Internet Assessor, Ads Assessor or any other project of from Appen simultaneously.
Important thing here is Appen Don’t term the roles as Internet Assessor, Maps Analyst or Ads Assessor. Instead they have named the project like Project Yukon for Internet Assessor, Project Shasta for Maps Analyst, Project Arrow for Google Ads Assessor and Project Nile for Facebook Ads Evaluation. Appen is real slow in processing your application. Sometimes it takes months to proceed your application further.
Pay rate for Appen is less as compared to Lionbridge so it should be your second preference.
I have applied and cleared Internet Assessor role exam for Lionbridge (same role is named as Rater for USA applicant) in mid of April 2020. Before applying I gathered as much information as possible from Reddit, Quora and Glassdoor. Found that people are working on this position for years and making a decent income. Many people have failed to clear the exam. Many have stated that the exam is the real hurdle for the job. It is true that for all the above role mentioned exam of Internet Assessor Role (Rater) exam is hard. But not impossible to clear. You really need to give attention to detail and spare 30 to 35 hours span over 7 days to clear the exam. You can find more details on exam here How I Passed Internet Assessor Exam.
The exam is conducted in 3 parts. Part 1 is theoretical and Part 2 and part 3 are practical. Again each part is divided in 7 sections and each section is having 1 hour to complete. Once you start any section you need to finish it in 1 hour and if you want you can take a break by clicking on “Submit and Stop” button after answering all the questions in that section. So in all I have 21 hours of exam ahead. This is the longest exam for any of the role. But if you clear it one will get a long term contact position to work for biggest search engine i.e. Google.
How Much Can I Earn?
Around $6 per hour for Africa and Asia, $13 per hour for USA, $16 per hour for European countries. Which is a decent income in Asian and African region or close to white collar job there. And for USA and European countries it is a good side income. Yes it is possible to earn online. I have earned it for 1 Year and still earning it. Hope this will give you the first-hand experience and belief that you can also earn that much income online with little motivation, hard work and common sense. You don’t need any special skill apart from able to know how to surf on the Internet. You need to have motivation, ready for hard work and common sense. Any person all over the globe with these basic skill earn money on Internet while working from home.
Lionbridge pay by direct payment transfer. Amount will be credited by invoice + 30 days. That is to say your January month payment you will receive between 10th -15th of March. Even if you leave the program you will be receiving all the dues on expected dates.
Payment method for Appen Connect is Payoneer. Amount will be credited by invoice + 15 days. That is to say your January month payment you will receive between 15th – 20th of Feb. Even if you leave the program you will be receiving all the dues on expected dates.
To join Payoneer if you go through my referral link I and You both will earn USD 25. When you receive at least $100 in payments in your Payoneer account, bonus will get redeemed.
If you don’t signup using referral link you will not receive USD 25 Bonus.
Click on my referral link and join Payoneer to Earn USD 25 Sign Up Bonus instantly.
Referral Link : Apply For Payoneer ( You will Earn $25 Bonus Instantly)
Direct Link : Apply For Payoneer ( You will not earn Bonus )