Senior AI/ML Engineering Specialist, Responsible AI

Position Summary

The Senior AI/ML Engineer, Responsible AI operates as the enterprise’s hands-on “mechanic” for AI governance, the engineer who gets under the hood of production models and AI solutions to diagnose, remediate, and certify them against responsible AI standards. This role works across business units, embedding into project teams to evaluate models for fairness, explainability, robustness, and compliance, then engineers the fixes needed to bring solutions up to enterprise quality.

Think of it as a technical quality inspector with a wrench: you don’t just flag problems, you fix them or build the tooling so teams can fix them at scale.

Key Responsibilities

• Conduct hands-on responsible AI assessments of models and AI solutions across the enterprise, evaluating bias, fairness, explainability, data quality, and robustness against established standards.
• Engineer remediation solutions when models fail governance checks, rebalancing training data, implementing fairness constraints, adding explainability layers, hardening against adversarial inputs, or restructuring feature pipelines.
• Build, maintain, and extend the enterprise Responsible AI toolkit: reusable libraries, automated testing harnesses, scanning pipelines, and validation APIs that integrate into the Enterprise MLOps Platform.
• Partner with Enterprise/BU Data Science and ML Engineering teams as an embedded responsible AI SME during model development, providing real-time guidance and code-level support.
• Create and maintain model cards, datasheets, and technical documentation for governed models, ensuring traceability from training data through production inference.
• Investigate production incidents related to model behavior (bias events, unexpected outputs, safety failures) and perform root cause analysis with actionable engineering fixes.
• Contribute to the enterprise’s red-teaming and adversarial testing program for generative and agentic AI systems.
• Automate compliance evidence collection for internal audit, external regulators, and customer-facing AI transparency requirements.

Minimum Qualifications

• Degree or equivalent and typically requires 7+ years of relevant experience.

Critical Experience/Skills

• 5+ years in ML Engineering, MLOps, or Applied ML with at least 2 years of direct experience in model evaluation, fairness testing, or AI quality assurance.
• Strong Python proficiency with production experience in scikit-learn, PyTorch or Tensor Flow, and at least two responsible AI toolkits (Fairlearn, AIF360, Evidently AI, SHAP, LIME, Guardrails AI).
• Hands-on experience with MLOps platforms (Azure ML, Databricks, Sage Maker, or Vertex AI) including pipeline orchestration, model registry, and monitoring.
• Demonstrated ability to diagnose and remediate model bias, data quality, or robustness issues in production system, not just detect them.
• Experience building automated testing and validation frameworks for ML models (CI/CD integration, automated test suites, monitoring dashboards).
• Working knowledge of responsible AI regulations and frameworks (NIST AI RMF, EU AI Act categories) sufficient to translate policy into code.
• Bachelor’s degree in Computer Science, AI/ML, Statistics, or related field; Master’s preferred.

Preferred Experience / Skills

• Experience with LLM evaluation and safety testing (prompt injection detection, hallucination measurement, toxicity scoring, RLHF/RLAIF concepts).
• Familiarity with agentic AI frameworks (Lang Chain, Lang Graph) and the governance challenges of tool-using agents.
• Healthcare, pharmaceutical, or financial services domain experience where model governance has direct regulatory implications.
• Experience with data lineage and provenance tooling (Azure Purview, or similar).

Compensation

We are proud to offer a competitive compensation package at McKesson as part of our Total Rewards. This is determined by several factors, including performance, experience and skills, equity, regular job market evaluations, and geographical markets. The pay range shown below is aligned with McKesson's pay philosophy, and pay will always be compliant with any applicable regulations. In addition to base pay, other compensation, such as an annual bonus…