About Sama

Sama is the global leader in ethical data annotation and model evaluation solutions for computer vision, generative AI and other major applications of artificial intelligence. Our solutions minimize the risk of model failure and lower the total cost of ownership through an enterprise ready ML-powered platform, actionable data insights uncovered by proprietary algorithms, and a highly skilled on-staff team of over 5,000 data experts. 25% of Fortune 50 companies, including GM, Ford, Microsoft and Google, trust Sama to help deliver industry-leading ML models.

Responsibilities:

• Review and audit labeled datasets for both text and image-based content to ensure accuracy, consistency, and adherence to guidelines.
• Document and share feedback with the individual labelers
• Identify trends and insights in quality performance, and effectively mitigate quality performance issues.
• Communicate quality trends and insights to the customer. Calibrate with the customer on instructions and edge cases.
• Evaluate responses generated by AI, verifying correctness, clarity, relevance, and alignment with task instructions.
• Apply knowledge of the Consumer Packaged Goods domain to accurately classify and/or describe products.
• Collaborate with cross-functional teams to update labeling workflows and improve quality.
• Monitor performance metrics (e.g., accuracy rates, inter-rater agreement) and contribute to continuous improvement initiatives.
• Generate responses with intentional but realistic grammar, spelling, and structural errors.
• Calibration sessions to align QA standards across teams and help train new reviewers or analysts.
• Adapt quickly to evolving guidelines, new task types, and AI model updates in a fast-paced, iterative environment.
• Ensure that documentation is up to date.

Qualifications:

• English as a second language - minimum C1 English proficiency required.
• C2 level of Italian
• Ability to follow linguistic and situational writing prompts.
• Excellent written communication and coordination skills
• 2 years working experience in a corporate/ business environment.
• Prior experience in at least one of the following:
  • Linguistic QA
  • Data annotation for NLP/AI projects
  • ESL/EFL teaching, editing, or copyediting
• Keen eye for detail -spotting subtle grammar and structure issues others miss.
• Comfortable reviewing and providing feedback on structured data.
• Ability to give actionable and constructive feedback to annotators.
• Experience with creating and tracking timelines, milestones, and status reports is a plus.

• Review and audit labeled datasets for both text and image-based content to ensure accuracy, consistency, and adherence to guidelines.
• Document and share feedback with the individual labelers
• Identify trends and insights in quality performance, and effectively mitigate quality performance issues.
• Communicate quality trends and insights to the customer. Calibrate with the customer on instructions and edge cases.
• Evaluate responses generated by AI, verifying correctness, clarity, relevance, and alignment with task instructions.
• Apply knowledge of the Consumer Packaged Goods domain to accurately classify and/or describe products.
• Collaborate with cross-functional teams to update labeling workflows and improve quality.
• Monitor performance metrics (e.g., accuracy rates, inter-rater agreement) and contribute to continuous improvement initiatives.
• Generate responses with intentional but realistic grammar, spelling, and structural errors.
• Calibration sessions to align QA standards across teams and help train new reviewers or analysts.
• Adapt quickly to evolving guidelines, new task types, and AI model updates in a fast-paced, iterative environment.
• Ensure that documentation is up to date.

• English as a second language - minimum C1 English proficiency required.
• C2 level of Italian
• Ability to follow linguistic and situational writing prompts.
• Excellent written communication and coordination skills
• Keen eye for detail -spotting subtle grammar and structure issues others miss.
• Comfortable reviewing and providing feedback on structured data.
• Ability to give actionable and constructive feedback to annotators.

• English as a second language - minimum C1 English proficiency required.
• C2 level of Italian
• Ability to follow linguistic and situational writing prompts.
• Excellent written communication and coordination skills
• 2 years working experience in a corporate/ business environment.
• Prior experience in at least one of the following: Linguistic QA, Data annotation for NLP/AI projects, ESL/EFL teaching, editing, or copyediting
• Keen eye for detail -spotting subtle grammar and structure issues others miss.
• Comfortable reviewing and providing feedback on structured data.
• Ability to give actionable and constructive feedback to annotators.
• Experience with creating and tracking timelines, milestones, and status reports is a plus.