Skip to content
mimi

COE - Data Scientist in QE

Qualitest Group

Remote · Canada Full-time $150k – $160k/yr 3w ago

About the role

About

Are you interested in working with the World’s leading AI-powered Quality Engineering Company? Ready to advance your career, team up with global thought leaders across industries and make a difference every day? Join us at Qualitest!

We are looking for a Data Scientist in Test to join our growing team in United States.

Location

US Remote (w/travel)

Top 3 Must Haves

  • Proficiency in Python, SQL, and testing frameworks (e.g., PyTest, unittest).
  • Experience with machine learning libraries (e.g., scikit-learn, TensorFlow, XGBoost).
  • Strong understanding of statistical testing, model validation, and data integrity principles.

Key Responsibilities

  • Develop and maintain automated testing frameworks for data pipelines and machine learning models.
  • Design and execute test cases to validate statistical models, algorithms, and data transformations.
  • Monitor data quality, detect anomalies, and ensure consistency across datasets.
  • Collaborate with data scientists, engineers, and QA teams to define test strategies and acceptance criteria.
  • Perform exploratory data analysis to uncover hidden issues in data or model behavior.
  • Leverage real world data and build synthetic datasets to simulate edge cases, stress-test models, ensure unbiased predictions, and verify data security.
  • Coordinate with end users to run human in the loop and A/B tests.
  • Document test results, bugs, and performance metrics to support continuous improvement.

Required Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Data Science, Statistics, or a related field.
  • 3+ years of experience in data science and AI/ML testing.
  • Proficiency in Python, SQL, and testing frameworks (e.g., PyTest, unittest).
  • Experience with machine learning libraries (e.g., scikit-learn, TensorFlow, XGBoost).
  • Strong understanding of statistical testing, model validation, and data integrity principles.
  • Familiarity with CI/CD pipelines and version control (e.g., Git, Jenkins).

Preferred Skills

  • Experience using Oracle AI Data Platform / Oracle Cloud Infrastructure (OCI) including Medallion architecture.
  • Strong mastery of SQL.
  • Knowledge of MLOps and model monitoring tools.
  • Familiarity with Azure Dev Ops (ADO) for test management.
  • Excellent communication and documentation skills.

Benefits

Why QualiTest?

  • Be a part of a company who strives to support for diversity and inclusion in the workplace – we are one, we are many at Qualitest. Celebrate culture, share knowledge with engineers from around the globe, and inspire each other through our differences. We have more than 40% women and around 120 different nationalities.
  • Local and global opportunities – we offer you internal rotation and international mobility opportunities to grow your career.
  • Clear view of your career and progression with the company – Qualitest is growing massively (since 2021 – tripled our employees base – we now have more than 8,000 engineers) and giving you the opportunity to grow with us.
  • Work hard and play harder with our flexible and casual culture. Take a break from work and join an employee event, or enjoy the amenities and games provided from one of our Employees Centers.
  • Save your earnings and prepare for your future by enrolling in our 401k plan where Qualitest will match your contributions accelerating your savings plan.
  • Take care of health with enrollment into one of our competitive healthcare benefits. Qualitest will match towards your HSA if you choose to participate.
  • Never stop experimenting and learning with QCraft – our Learning & Development platform: 50,000+ courses, 300+ virtual labs, mentorship and leadership programs, professional tribes, sponsored certifications, and much more.
  • Stay active and get rewarded with our Corporate Wellness Program. We pay your Gym membership and giving you opportunities to Earn additional vacation times for attendance the gym!
  • Earn bonuses via our Client Referral and Employee Referral Program’s. Refer and earn – tap your network for net‑worth.
  • We recognize our employees work via our Qudos platform - You can earn bonuses and spot awards by celebrating your and your peers’ achievements.
  • Planning a vacation? Looking for car insurance? Get access to Qualitest Employee Perks for discounts on anything from travel to electronics. With so many offerings the savings are endless!
  • A Competitive pay, the salary range for the role is $150,000 - $160,000.

Additional Information

  • Intrigued to find more about us?
  • Visit our website at https://www.qualitestgroup.com/
  • If you like what you have read, send us your resume and let’s start talking!

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Data Science, Statistics, or a related field.
  • 3+ years of experience in data science and AI/ML testing
  • Proficiency in Python, SQL, and testing frameworks (e.g., PyTest, unittest).
  • Experience with machine learning libraries (e.g., scikit-learn, TensorFlow, XGBoost).
  • Strong understanding of statistical testing, model validation, and data integrity principles.
  • Familiarity with CI/CD pipelines and version control (e.g., Git, Jenkins).

Responsibilities

  • Develop and maintain automated testing frameworks for data pipelines and machine learning models.
  • Design and execute test cases to validate statistical models, algorithms, and data transformations.
  • Monitor data quality, detect anomalies, and ensure consistency across datasets.
  • Collaborate with data scientists, engineers, and QA teams to define test strategies and acceptance criteria.
  • Perform exploratory data analysis to uncover hidden issues in data or model behavior.
  • Leverage real world data and build synthetic datasets to simulate edge cases, stress-test models, ensure unbiased predictions, and verify data security
  • Coordinate with end users to run human in the loop and A/B tests
  • Document test results, bugs, and performance metrics to support continuous improvement

Benefits

401k planHSA matchinghealthcare benefitsGym membershipClient Referral ProgramEmployee Referral Programbonusesspot awardsdiscounts

Skills

CI/CDGitJenkinsMLOpsOracle Cloud InfrastructureOracle AI Data PlatformPythonSQLTensorFlowXGBoostAzure Dev OpsPyTestunittestscikit-learn

Don't send a generic resume

Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.

Get started free