Skip to content
mimi

Data Engineer – AI Platform

RedBeard Solutions

New York · On-site Full-time Mid Level 1mo ago

About the role

Position Summary

We are hiring a skilled Data Engineer to contribute to the development of a sophisticated AI-powered platform that supports advanced, data-driven solutions. This role offers the opportunity to work on cutting-edge initiatives involving generative AI, large-scale data systems, and cloud-native architectures.

You will partner with a multidisciplinary team of engineers, data scientists, and product stakeholders to design and implement scalable data infrastructure. The primary focus will be enabling platform capabilities tailored for government and defense-related environments.

Key Responsibilities

  • Design and build robust data ingestion and processing pipelines to support AI and GenAI applications
  • Develop and maintain high-quality Python-based data workflows, including testing and validation
  • Collaborate with cross-functional teams including software engineers, data scientists, and UI/UX designers
  • Implement and enhance CI/CD pipelines (including GitHub Actions) to streamline deployment and integration processes
  • Work across multi-cloud environments (AWS primarily; exposure to Azure and GCP is beneficial)
  • Utilize containerization technologies (Docker) to support scalable and portable deployments
  • Contribute to the development and optimization of data systems used by generative AI applications
  • Ensure performance, reliability, and scalability of data pipelines through monitoring and diagnostics

What You’ll Experience

  • Opportunity to work on high-impact AI platform initiatives
  • A fast-paced, performance-driven environment with strong technical mentorship
  • Continuous learning through structured development programs and real-world problem solving
  • A collaborative culture that values innovation, ownership, and diverse perspectives
  • Exposure to globally distributed teams and modern engineering practices
  • Competitive compensation along with a comprehensive benefits package

Required Qualifications

  • U.S. Citizenship is required
  • Prior experience supporting defense or government environments, including handling classified or sensitive data
  • Active Secret clearance required (Top Secret or higher preferred)
  • 5+ years of experience in data engineering, with a strong focus on cloud-based solutions

Technical Skills & Expertise

  • Strong proficiency in Python for data engineering and pipeline development
  • Hands-on experience with AWS-based data engineering (experience with Azure or GCP is a plus)
  • Deep understanding of data modeling, data ingestion frameworks, and pipeline architecture
  • Experience working with knowledge graphs, particularly using Neo4j, and familiarity with relational databases
  • Expertise in writing clean, maintainable, and testable code, including automation and error handling best practices
  • Practical experience with Docker and containerized workflows
  • Strong background in data pipeline performance tuning, monitoring, and troubleshooting
  • Excellent analytical and problem-solving capabilities
  • Effective communication skills and ability to collaborate within cross-functional teams

Skills

AWSAzureCI/CDDockerGCPGitHub ActionsNeo4jPythondata ingestiondata modelingdata pipeline architecturedata pipeline performance tuningrelational databases

Don't send a generic resume

Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.

Get started free