Data Engineer

Requirements

• Must be certified DoD IAT II or higher
• Security Clearance-Current active TS/SCI eligible
• At least 14 years of experience in one of the following: Software development/engineering, data engineering, database engineering, etc. (+4 additional years relevant experience can substitute for a BS degree)
• Experience with Unit and Integration testing.
• Fluency with data extraction, custom translation development, and loading including data prep and labeling to enable data analytics.
• Familiarity with various log formats such as JSON, XML, and others.
• Experience with data flow, management, and storage solutions (i.e. Kafka, NiFi, and AWS S3 and SQS solutions)
• Ability to decompose technical problems and troubleshoot both system and dataflow issues.
• Willingness to do a programming challenge during the interview process.
• Experience with Zoom/Teams/Meet style team meetings
• Prior experience in cyber/network security operations.
• Familiarity with Agile environments.
• Good communication skills.
• Developed documentation and training in areas of expertise.
• Amazon S3, SQS/SNS Admin experience
• Apache Airflow Workloads via UI or CLI a plus
• Experience with Mage AI a plus
• Kubernetes, Docker

Responsibilities

• Work with big data systems and complex structured and unstructured data sets.
• Support government data acquisition, analysis, and sharing efforts.
• Focus on software infrastructure for big data scaled ingestion, including understanding and ingesting new data sources, modifying existing data sources, implementing testing, establishing monitoring, and troubleshooting.
• Lead the department in achieving strategic goals, ensuring data integrity, and fostering a collaborative and innovative work