AI Observability Consultant

We are hiring an AI Observability Consultant to support a high-priority initiative focused on enterprise-wide AI model monitoring, driven by evolving regulatory requirements. This role will lead vendor evaluations and execute a proof of concept (POC) to help inform long-term observability strategy and implementation.

Key Responsibilities

Design and manage proof of concept (POC) efforts for AI observability tools
Evaluate and compare vendor solutions to determine best fit for enterprise needs
Lead the development of ML evaluation and monitoring strategies
Communicate findings and technical concepts clearly to both technical and non-technical audiences
Develop reports and presentations to inform strategic decisions

Qualifications

3+ years of experience in data science or machine learning engineering (not a pure software engineering background)
Hands-on experience designing or implementing ML evaluation or monitoring systems
Familiarity with GenAI concepts, including basic understanding of GenAI evaluation frameworks and metrics — required
Solid coding skills (e.g., Python, SQL), strong analytical thinking, and ability to translate insights into action
Familiarity with tools such as Arize, Fiddler, TruEra, or Robust Intelligence is a plus
Deep understanding of the AI/ML lifecycle, model performance metrics, and deployment best practices
Excellent communication and stakeholder management skills

Additional Information

The role can be fulfilled remotely. The ideal candidate is a self-starter who can work independently, manage technical stakeholders, and deliver strategic recommendations in a fast-paced environment.