Skip to content
mimi

Specialist, Data Engineer (Hybrid - Rahway, NJ)

Merck

Rahway · Hybrid Full-time Mid Level $79k – $125k/yr 5d ago

About the role

Job Summary

We are seeking an experienced AI/ML Engineer with strong expertise in prompt engineering and practical experience applying large language models (LLMs) in production. You will design and refine prompts and agent workflows, evaluate and experiment with different LLMs and model architectures, and integrate AI outputs into applications to improve usability. Responsibilities include developing data pipelines (including API ingestion and AWS Redshift), building and deploying inference stacks and managed services, and implementing API-driven automation and integrations. You will also establish model evaluation practices using human-eval frameworks and both code and NLP metrics, and apply RAG, agentic AI, and MCP concepts to deliver scalable, reliable AI solutions. Experience with Power BI and Power Automate for data visualization and workflow automation is required.

Required / Preferred Skills

  • Minimum of 3 years of relevant experience.
  • Experience with Prompt Engineering.
  • Understanding of the RAG, Agentic AI and MCP concepts.
  • Experience with API driven automation and integration.
  • Experience with Python programming.

Minimum / Preferred Education Requirements

  • High School Diploma or GED required.

Additional Tags

MSJR
#eligibleforerp

Required Skills

  • Adaptability
  • Adaptability
  • Analytical Thinking
  • Applied Engineering
  • Cloud Automation
  • Computer Engineering
  • Cyber Threat Hunting
  • Cyber Threat Intelligence
  • Data Engineering
  • Data Loss Prevention (DLP)
  • Data Pipelines
  • Data Warehouse Development
  • Detail-Oriented
  • Digital Forensics
  • Incident Response Management
  • Insider Threat Mitigation
  • Language Models
  • Large Language Models (LLMs)
  • Log Analysis
  • Malware Analysis
  • Managed Services
  • Microsoft Power Business Intelligence (BI)
  • Pipeline Development
  • Project Engineering
  • Prompt Engineering {+ 9 more}

Preferred Skills

(none listed)

Application Links

  • Current Employees apply [HERE]
  • Current Contingent Workers apply [HERE]

Eligibility

US and Puerto Rico Residents Only:
Our company is committed to inclusion, ensuring that candidates can engage in a hiring process that exhibits their true capabilities. Please click here if you need an accommodation during the application or hiring process.

Equal Employment Opportunity

As an Equal Employment Opportunity Employer, we provide equal opportunities to all employees and applicants for employment and prohibit discrimination on the basis of race, color, age, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability status, or other applicable legally protected characteristics. As a federal contractor, we comply with all affirmative action requirements for protected veterans and individuals with disabilities. For more information about personal rights under the U.S. Equal Opportunity Employment laws, visit:

  • EEOC Know Your Rights
  • EEOC GINA Supplement

We are proud to be a company that embraces the value of bringing together talented and committed people with diverse experiences, perspectives, skills and backgrounds. The fastest way to breakthrough innovation is when people with diverse ideas, broad experiences, backgrounds, and skills come together in an inclusive environment. We encourage our colleagues to respectfully challenge one another’s thinking and approach problems collectively.

Learn more about your rights, including under California, Colorado and other US State Acts.

Work Model

U.S. Hybrid Work Model
Effective September 5, 2023, employees in office‑based positions in the U.S. will be working a Hybrid work consisting of three total days on‑site per week, Monday – Thursday, although the specific days may vary by site or organization, with Friday designated as a remote‑working day, unless business critical tasks require an on‑site presence. This Hybrid work model does not apply to, and daily in‑person attendance is required for, field‑based positions; facility‑based, manufacturing‑based, or research‑based positions where the work to be performed is located at a Company site; positions covered by a collective‑bargaining agreement (unless the agreement provides for hybrid work); or any other position for which the Company has determined the job requirements cannot be reasonably met working remotely. Please note, this Hybrid work model guidance also does not apply to roles that have been designated as “remote”.

Compensation

  • Salary Range: $79,200.00 – $124,700.00
    This is the lowest to highest salary we in good faith believe we would pay for this role at the time of this posting. An employee’s position within the salary range will be based on several factors including, but not limited to relevant education, qualifications, certifications, experience, skills, geographic location, government requirements, and business or organizational needs.
  • The successful candidate will be eligible for annual bonus and long‑term incentive, if applicable.

Benefits

We offer a comprehensive package of benefits. Available benefits include medical, dental, vision healthcare and other insurance benefits (for employee and family), retirement benefits, including 401(k), paid holidays, vacation, and compassionate and sick days. More information about benefits is available at https://jobs.merck.com/us/en/compensation-and-benefits.

Application Process

You can apply for this role through https://jobs.merck.com/us/en (or via the Workday Jobs Hub if you are a current employee). The application deadline for this position is stated on this posting.

  • San Francisco Residents Only: We will consider qualified applicants with arrest and conviction records for employment in compliance with the San Francisco Fair Chance Ordinance.
  • Los Angeles Residents Only: We will consider for employment all qualified applicants, including those with criminal histories, in a manner consistent with the requirements of applicable state and local laws, including the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance.

Search Firm Representatives

Merck & Co., Inc., Rahway, NJ, USA, also known as Merck Sharp & Dohme LLC, Rahway, NJ, USA, does not accept unsolicited assistance from search firms for employment opportunities. All CVs / resumes submitted by search firms to any employee at our company without a valid written search agreement in place for this position will be deemed the sole property of our company. No fee will be paid in the event a candidate is hired by our company as a result of an agency referral where no pre‑existing agreement is in place. Where agency agreements are in place, introductions are position specific. Please, no phone calls or emails.

Job Details

  • Employee Status: Regular
  • Relocation: No relocation
  • VISA Sponsorship: No
  • Travel Requirements: No Travel Required
  • Flexible Work Arrangements: Hybrid
  • Shift: Not Indicated
  • Valid Driving License: No
  • Hazardous Material(s): N/A

Posting Information

  • Job Posting End Date: 04/5/2026
    • A job posting is effective until 11:59:59 PM on the day BEFORE the listed job posting end date. Please ensure you apply to a job posting no later than the day BEFORE the job posting end date.

  • Requisition ID: R390759

Requirements

  • Experience with Prompt Engineering.
  • Understanding of the RAG, Agentic AI and MCP concepts.
  • Experience with API driven automation and integration.
  • Experience with Python programming.
  • Experience with Power BI and Power Automate for data visualization and workflow automation is required.

Responsibilities

  • Design and refine prompts and agent workflows.
  • Evaluate and experiment with different LLMs and model architectures.
  • Integrate AI outputs into applications to improve usability.
  • Develop data pipelines (including API ingestion and AWS Redshift).
  • Build and deploy inference stacks and managed services.
  • Implement API-driven automation and integrations.
  • Establish model evaluation practices using human-eval frameworks and both code and NLP metrics.
  • Apply RAG, agentic AI, and MCP concepts to deliver scalable, reliable AI solutions.

Benefits

medical insurancedental insurancevision insuranceother insurance benefitsretirement benefits401(k)paid holidaysvacationcompassionate dayssick days

Skills

AWS RedshiftAPI ingestionAPI integrationAPI automationAgentic AICloud AutomationData EngineeringData PipelinesData Warehouse DevelopmentInference stacksLarge Language Models (LLMs)Managed servicesMicrosoft Power BIMicrosoft Power AutomateMCP conceptsNLP metricsPipeline DevelopmentPower BIPower AutomatePrompt EngineeringPythonRAG

Don't send a generic resume

Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.

Get started free