RS
Data Engineer – AI Platform
RedBeard Solutions
New York · On-site Full-time Mid Level 1mo ago
About the role
Position Summary
We are hiring a skilled Data Engineer to contribute to the development of a sophisticated AI-powered platform that supports advanced, data-driven solutions. This role offers the opportunity to work on cutting-edge initiatives involving generative AI, large-scale data systems, and cloud-native architectures.
You will partner with a multidisciplinary team of engineers, data scientists, and product stakeholders to design and implement scalable data infrastructure. The primary focus will be enabling platform capabilities tailored for government and defense-related environments.
Key Responsibilities
- Design and build robust data ingestion and processing pipelines to support AI and GenAI applications
- Develop and maintain high-quality Python-based data workflows, including testing and validation
- Collaborate with cross-functional teams including software engineers, data scientists, and UI/UX designers
- Implement and enhance CI/CD pipelines (including GitHub Actions) to streamline deployment and integration processes
- Work across multi-cloud environments (AWS primarily; exposure to Azure and GCP is beneficial)
- Utilize containerization technologies (Docker) to support scalable and portable deployments
- Contribute to the development and optimization of data systems used by generative AI applications
- Ensure performance, reliability, and scalability of data pipelines through monitoring and diagnostics
What You’ll Experience
- Opportunity to work on high-impact AI platform initiatives
- A fast-paced, performance-driven environment with strong technical mentorship
- Continuous learning through structured development programs and real-world problem solving
- A collaborative culture that values innovation, ownership, and diverse perspectives
- Exposure to globally distributed teams and modern engineering practices
- Competitive compensation along with a comprehensive benefits package
Required Qualifications
- U.S. Citizenship is required
- Prior experience supporting defense or government environments, including handling classified or sensitive data
- Active Secret clearance required (Top Secret or higher preferred)
- 5+ years of experience in data engineering, with a strong focus on cloud-based solutions
Technical Skills & Expertise
- Strong proficiency in Python for data engineering and pipeline development
- Hands-on experience with AWS-based data engineering (experience with Azure or GCP is a plus)
- Deep understanding of data modeling, data ingestion frameworks, and pipeline architecture
- Experience working with knowledge graphs, particularly using Neo4j, and familiarity with relational databases
- Expertise in writing clean, maintainable, and testable code, including automation and error handling best practices
- Practical experience with Docker and containerized workflows
- Strong background in data pipeline performance tuning, monitoring, and troubleshooting
- Excellent analytical and problem-solving capabilities
- Effective communication skills and ability to collaborate within cross-functional teams
Skills
AWSAzureCI/CDDockerGCPGitHub ActionsNeo4jPythondata ingestiondata modelingdata pipeline architecturedata pipeline performance tuningrelational databases
Don't send a generic resume
Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.
Get started free