About this role
Our client is seeking an experienced AI Evaluator with a strong software background to join their team on a contract basis. In this remote role, you will be responsible for evaluating AI-generated artifacts against specific quality rubrics tailored to various domains. Your expertise will help ensure the accuracy, aesthetics, and presentation of AI outputs meet high standards.
Key Responsibilities:
- Evaluate AI-generated content for factual accuracy, aesthetic quality, and presentation effectiveness.
- Develop and refine domain-specific quality rubrics to assess AI outputs.
- Collaborate with technical teams to provide feedback and insights on AI performance.
- Identify and document errors or inconsistencies in AI-generated artifacts.
- Stay updated on the latest AI technologies and methodologies to enhance evaluation processes.
Required Skills & Qualifications:
- Proven experience in software evaluation or quality assurance, particularly in AI or data-driven environments.
- Strong analytical skills with attention to detail.
- Familiarity with AI technologies and their applications in various domains.
- Excellent communication skills to convey findings and recommendations clearly.
- Ability to work independently and manage time effectively in a remote setting.
Experience:
- Minimum of 5-8 years of relevant experience in software evaluation, AI, or a related field.
What we offer:
- Opportunity to work with leading AI research labs and innovative projects.
- Flexible remote working environment.
- Collaborative and dynamic team culture.
This role is managed by AI-First Talent on behalf of our client. Your application is reviewed directly by our talent team.