Data Engineer

Job Description: Mission Essential is seeking a Data Engineer to join a cutting-edge initiative in support of the U.S. Department of Defense (DoD) in Germany. This role plays a vital part in delivering critical engineering and technical support services, with a strong emphasis on leveraging advanced data science and engineering solutions to drive mission success. Responsibilities include, but are not limited to, the following: • Design ETL Processes: • Extract, transform, and load (ETL) data from various sources including but not limited to DoD Advana and Army Vantage, into data warehouses or data lakes. • Ensure data is cleaned, normalized, and enriched during transformation. • Build Data Pipelines: • Configure automated workflows to move data between systems using tools like Apache Airflow, AWS Glue, or Azure Data Factory. • Optimize pipelines for scalability and reliability. • Implement Real-Time Data Processing • Implement streaming data pipelines using tools like Apache Kafka, Apache Flink, or Spark Streaming. • Process and analyze data in real-time for applications like fraud detection or IoT analytics. • Manage Data Storage: • Design Databases • Design and implement relational databases (e.g., MySQL, PostgreSQL) or NoSQL databases (e.g., MongoDB, Cassandra) based on project requirements. • Ensure efficient schema design and indexing for performance. • Warehouse Data: • Build and maintain data warehouses using platforms like Snowflake, Amazon Redshift, or Google BigQuery. • Optimize storage and query performance for analytical workloads. • Support the Management of Data Lakes/Integrate within existing organizational policies. • Understand and interpret policies to better support the command with regards to integrating products into existing data lakes to ensure long-term sustainability. • Integrate Data • Connect Data Sources • Integrate data from APIs, databases, flat files, and third-party systems. • Handle diverse data formats like JSON, XML, CSV, and Parquet. • Migrate Data • Move data between systems during upgrades or transitions (e.g., moving from on-premises to cloud). • Configure APIs • Configure APIs to expose data for consumption by other systems or applications. • Manage Data Quality and Governance at the 21st TSC level in accordance with USAEUR-AF policies and guidance • Validate Data • Implement checks to ensure data accuracy, completeness, and consistency. • Identify and resolve data anomalies or errors. • Manage Metadata • Document data lineage, definitions, and transformations to ensure transparency and traceability. • Implement and manage Compliance and Security measures • Ensure data systems comply with regulations like GDPR, HIPAA, or CCPA. • Implement security measures such as encryption, access control, and auditing. • Work with internal teams within the Group to rectify or otherwise mitigate data quality issues in analyses and tool configuration being performed within the Group. • Work with PEOs and PMs of Systems of Record that provide feed the multiple data platforms to understand and correct data issues REQUIREMENTS Minimum Qualifications: • Eighteen (18) years of recent specialized experience • Major IT Certification AND fourteen (14) years of recent specialized experience • Associate’s degree in computer science, information management, or related discipline AND fourteen (14) years of recent specialized experience • Bachelor’s degree in computer science, information management, or related discipline AND ten (10) years of recent specialized experience • Master’s degree in computer science, information management, or related discipline AND seven (7) years of recent specialized experience IA Technical Level II certification or higher: • CCNA Security • CompTIA CySA+ • Global Industrial Cyber Security Professional (GICSP) • GIAC Security Essentials (GSEC) • CompTIA Security+ CE • EC-Council Certified Network Defense (CND) • (ISC)² Certified System Security Practitioner (SSCP)

#J-18808-Ljbffr

Salary: EUR 45000 - 65000 per year