About OpenTrain

OpenTrain AI is hiring contractors for meaningful work in AI training and data labeling. OpenTrain helps people start and build careers in this fast-growing field, where human judgment shapes how advanced AI systems understand and respond to people.

Create a free OpenTrain account to build your profile and apply in minutes.

About AI Quality Evaluation

AI quality analysts are part of the human side of artificial intelligence. They test model behavior, assess responses, and provide structured feedback that helps improve generative AI systems. This work is remote and can offer flexible opportunities for people with strong language, analytical, or subject-matter skills.

• Evaluate real model interactions rather than writing production code
• Help improve the accuracy, relevance, and usefulness of generative AI
• Use careful reasoning to identify subtle quality issues

The Role

OpenTrain AI is recruiting a Spanish AI Quality Analyst to evaluate personalized interactions for Google Gemini. This contractor role focuses on assessing AI model performance in Spanish, not coding or engineering.

The engagement lasts 3 months and pays $15 per hour. Full-time availability in your local time zone is required, with at least 4 hours per day and up to 40 hours per week. Your schedule must include a 4-hour overlap with Pacific Standard Time.

• Role: Spanish AI Quality Analyst
• Focus: Gemini personalization quality evaluation
• Engagement: Contractor and part-time
• Duration: 3 months
• Pay: $15 per hour
• Availability: 20 or more hours per week, with up to 40 hours available
• Schedule: At least 4 hours per day and a 4-hour PST overlap

What You'll Do

You will create realistic, multi-turn conversations that require the AI to use personal information and experiences. You will then assess how well the model handles personalization and compare competing responses using clear, evidence-based reasoning.

Evaluation work requires strict data hygiene. You must delete evaluation conversations as part of the process.

• Design and execute conversational prompts lasting 1 to 5 turns
• Create prompts that require the AI to use personal information and experiences
• Evaluate responses for grounding issues, integration quality, and overall helpfulness
• Stack-rank two model responses side by side
• Write clear rationales that reference specific conversation turns
• Delete evaluation conversations to maintain data hygiene

Requirements

You should be professionally proficient in reading and writing Spanish and comfortable analyzing nuanced conversational responses. A BS or BA degree, or equivalent experience, is required in policy, law, ethics, linguistics, journalism, computer science, or a related analytical field.

Experience in data annotation, AI quality evaluation, or content moderation is strongly preferred. Familiarity with personalization concepts, including incorrect personalization, poor inferences, and forced connections, is helpful.

• Professional Spanish proficiency in reading and writing
• BS or BA degree, or equivalent experience, in a related analytical field
• Exceptional analytical thinking and creative prompt engineering skills
• Meticulous attention to detail when comparing model responses
• Excellent written communication for structured evaluation rationales
• Experience with data annotation, AI quality evaluation, or content moderation preferred
• Ability to design multi-turn prompts and evaluate AI personalization quality
• Constructive feedback and detailed annotation experience helpful
• Desktop or laptop with a good internet connection

Who Should Apply

This opportunity is suited to Spanish-speaking professionals with strong written communication and an analytical mindset. It may be a good fit if you enjoy testing conversational AI, spotting subtle differences in responses, and explaining your conclusions with specific evidence.

Entry-level candidates may apply when they can demonstrate the required language ability, careful reasoning, and prompt-design skills. Previous annotation, AI evaluation, or moderation experience can strengthen your application.

• Spanish-language professionals who enjoy detailed written analysis
• Candidates interested in generative AI and model quality
• People who can commit to the required daily schedule and PST overlap
• Applicants comfortable working independently in a remote contractor role

How to Apply Through OpenTrain

OpenTrain is where people discover and build careers in AI training and data labeling. Create a free profile, highlight your Spanish proficiency and relevant evaluation experience, and apply to this contractor opportunity in minutes.

• Create your free OpenTrain account
• Add your language skills, analytical background, and relevant experience
• Confirm your availability, equipment, and internet connection
• Apply for the Spanish AI Quality Analyst opportunity