French - Business Analyst P0 Evals
Most applications go out cold — see where you stand first. No sign-up to start.
Don't just apply. Show up ready.
Olive works from this exact posting — no sign-up to start.
At a glance
Requirements
Credentials this posting asks for.
Job overview
Careerflow is hiring a French - Business Analyst P0 Evals. As a Business Account Rater, you will evaluate the quality of AI-generated responses for professional users, focusing on how effectively the system leverages business email history for personalized and helpful responses. This role requires strong analytical thinking, attention to detail, and objective evaluation of AI outputs.
Key focus areas include Evaluate AI-generated responses based on professional email history and business account activity, Assess whether responses are relevant, accurate, helpful, and appropriately personalized, and Identify issues related to incorrect personalization, unsupported assumptions, or irrelevant recommendations.
Successful candidates bring Must Reside Outside United States, Active Google Workspace Corporate Gmail Account Required, and Gmail Display Language Set To Target Language. Important skills include Google Workspace, Corporate Gmail, French, Exceptional Analytical Thinking, Attention To Detail, and Communication. Preferred (not required): German, Japanese, Korean, and AI Evaluation.
Skills & qualifications
Skills
Qualifications
Full job description
Role Overview:
As a Business Account Rater, you will participate in a personalization evaluation project focused on assessing the quality of AI-generated responses for professional users. Using your primary Google Workspace (Corporate Gmail) account, you will evaluate how effectively the system leverages business email history to deliver relevant, personalized, and helpful responses. This role requires strong analytical thinking, attention to detail, and the ability to evaluate AI outputs objectively.
Key Qualifications
-
Language Proficiency: Native-level proficiency in one of the following languages: German (DE) Japanese (JP) Korean (KO) French (FR)
-
Location: Must currently reside outside the United States.
-
Business Account: Must have an active Google Workspace (Corporate Gmail) account that is regularly used for professional communication. (Mandatory requirement)
-
Gmail Language: Gmail display language must be set to the target project language.
-
Inbox Language: The majority of emails in the inbox should be in the target language. (Mandatory requirement)
-
Email History: Must have a well-established business inbox with approximately 1,000+ emails and regular account activity.
-
Consent: Willing to use your primary business account for the evaluation and complete the required consent process.
-
Exceptional Analytical Thinking: Ability to evaluate nuanced AI responses and identify strengths and weaknesses in personalization quality.
-
Attention to Detail: Strong ability to review AI-generated responses and identify subtle issues or inconsistencies.
-
Communication: Excellent written communication skills for providing clear and structured evaluation feedback.
-
Independence: Self-motivated and able to work independently in a remote environment.
-
Technical Setup: Desktop or laptop with a reliable internet connection.
Description:
In this role, you will be part of a team responsible for evaluating the quality of personalized AI interactions for business users. Your day-to-day responsibilities will include:
-
Evaluating AI-generated responses based on your professional email history and business account activity.
-
Assessing whether responses are relevant, accurate, helpful, and appropriately personalized.
-
Identifying issues related to incorrect personalization, unsupported assumptions, or irrelevant recommendations.
-
Comparing multiple AI responses and determining which provides the better overall user experience.
-
Providing clear, detailed, and well-reasoned evaluation feedback to support model improvements.
-
Following project guidelines to ensure consistent, accurate, and high-quality evaluations.
-
Maintaining data privacy and adhering to all project confidentiality requirements throughout the evaluation process.
Education & Experience
-
Bachelor's degree or equivalent practical experience in any field.
-
Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical role is preferred but not required.
Consent:
Must be willing to use their primary personal account and sign the Required Consent form. https://docs.google.com/document/d/11f-amqVpTvY3BWaELqgSFvuzx_R3PD4DieFgHFoVlus/edit?tab=t.0
Availability:
Full-time, at least 4 hours per day and up to 40 hours per week with 4 hours of overlap with PST.
Location:
Greenlit (except USA)
Contract duration:
16 weeks
You've read the whole posting — now see how you match it.