Skip to content
mimi

COE - Data Scientist in QE

Qualitest Group

Remote · US Full-time $150k – $160k/yr 3w ago

About the role

About

Are you interested in working with the World’s leading AI-powered Quality Engineering Company? Ready to advance your career, team up with global thought leaders across industries and make a difference every day? Join us at Qualitest!

We are looking for a Data Scientist in Test to join our growing team in the United States.

Location: US Remote (w/travel)

Top 3 Must Haves

  • Proficiency in Python, SQL, and testing frameworks (e.g., PyTest, unittest).
  • Experience with machine learning libraries (e.g., scikit-learn, TensorFlow, XGBoost).
  • Strong understanding of statistical testing, model validation, and data integrity principles.

Key Responsibilities

  • Develop and maintain automated testing frameworks for data pipelines and machine learning models.
  • Design and execute test cases to validate statistical models, algorithms, and data transformations.
  • Monitor data quality, detect anomalies, and ensure consistency across datasets.
  • Collaborate with data scientists, engineers, and QA teams to define test strategies and acceptance criteria.
  • Perform exploratory data analysis to uncover hidden issues in data or model behavior.
  • Leverage real‑world data and build synthetic datasets to simulate edge cases, stress‑test models, ensure unbiased predictions, and verify data security.
  • Coordinate with end users to run human‑in‑the‑loop and A/B tests.
  • Document test results, bugs, and performance metrics to support continuous improvement.

Required Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Data Science, Statistics, or a related field.
  • 3+ years of experience in data science and AI/ML testing.
  • Proficiency in Python, SQL, and testing frameworks (e.g., PyTest, unittest).
  • Experience with machine learning libraries (e.g., scikit-learn, TensorFlow, XGBoost).
  • Strong understanding of statistical testing, model validation, and data integrity principles.
  • Familiarity with CI/CD pipelines and version control (e.g., Git, Jenkins).

Preferred Skills

  • Experience using Oracle AI Data Platform / Oracle Cloud Infrastructure (OCI) including Medallion architecture.
  • Strong mastery of SQL.
  • Knowledge of MLOps and model monitoring tools.
  • Familiarity with Azure DevOps (ADO) for test management.
  • Excellent communication and documentation skills.

Benefits

Why QualiTest?

  • Diversity & Inclusion: Over 40% women and around 120 nationalities; a culture that celebrates differences.
  • Global Opportunities: Internal rotation and international mobility to grow your career.
  • Career Progression: Rapid company growth (tripled employee base since 2021, now >8,000 engineers).
  • Flexible Culture: Casual environment with employee events, amenities, and games at Employee Centers.
  • 401(k) Matching: Accelerate your savings with company match.
  • Healthcare Benefits: Competitive plans with HSA matching if you participate.
  • Learning & Development: QCraft platform – 50,000+ courses, 300+ virtual labs, mentorship, leadership programs, professional tribes, sponsored certifications, and more.
  • Corporate Wellness: Gym membership paid; earn additional vacation time for gym attendance.
  • Referral Bonuses: Client Referral and Employee Referral programs.
  • Recognition: Qudos platform for bonuses and spot awards.
  • Employee Perks: Discounts on travel, electronics, car insurance, and more.
  • Competitive Pay: Salary range $150,000 – $160,000.

Additional Information

Requirements

  • Proficiency in Python, SQL, and testing frameworks (e.g., PyTest, unittest).
  • Experience with machine learning libraries (e.g., scikit-learn, TensorFlow, XGBoost).
  • Strong understanding of statistical testing, model validation, and data integrity principles.
  • Familiarity with CI/CD pipelines and version control (e.g., Git, Jenkins).

Responsibilities

  • Develop and maintain automated testing frameworks for data pipelines and machine learning models.
  • Design and execute test cases to validate statistical models, algorithms, and data transformations.
  • Monitor data quality, detect anomalies, and ensure consistency across datasets.
  • Collaborate with data scientists, engineers, and QA teams to define test strategies and acceptance criteria.
  • Perform exploratory data analysis to uncover hidden issues in data or model behavior.
  • Leverage real world data and build synthetic datasets to simulate edge cases, stress-test models, ensure unbiased predictions, and verify data security
  • Coordinate with end users to run human in the loop and A/B tests
  • Document test results, bugs, and performance metrics to support continuous improvement

Benefits

401k planHSA matchinghealthcare benefitsGym membershipClient Referral ProgramEmployee Referral ProgramQudos platform awardsEmployee Perks discounts

Skills

AWS LambdaCI/CDDockerGitJenkinsMLOpsOracle Cloud InfrastructureOracle AI Data PlatformPythonPyTestSQLTensorFlowunittestXGBoostscikit-learn

Don't send a generic resume

Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.

Get started free