About this role
Our client is seeking a Systems Engineer - AI Model Evaluator to join their dynamic team. This role involves working with cutting-edge AI technologies to evaluate and enhance engineering tasks through advanced coding agents.
Key Responsibilities:
- Utilize frontier AI coding agents to complete and assess complex engineering tasks.
- Review and analyze model-generated code and architecture for effectiveness and efficiency.
- Collaborate with cross-functional teams to refine AI models and improve performance.
- Develop and implement evaluation metrics to ensure high-quality outputs from AI systems.
- Troubleshoot and resolve issues related to AI-generated solutions.
Required Skills & Qualifications:
- Proven experience in systems engineering, with a focus on AI technologies.
- Strong programming skills in languages such as Python, Java, or C++.
- Familiarity with AI frameworks and tools, including TensorFlow, PyTorch, or similar.
- Excellent analytical and problem-solving abilities.
- Ability to work independently in a remote environment.
Experience:
- Minimum of 5-8 years in systems engineering or a related field, with a focus on AI model evaluation.
What we offer:
- Opportunity to work with leading AI research labs and innovative technologies.
- Flexible remote working environment.
- Collaborative and creative team culture.
This role is managed by AI-First Talent on behalf of our client. Your application is reviewed directly by our talent team.