CI
Data Engineer - - CHADC5779480
Compunnel Inc.
Portland · On-site Full-time Senior Today
About the role
Job Title
Senior Data Engineer (AWS, Distributed Data Systems)
Location
Westbrook, Maine
Minimum Qualifications
- Hands-on experience building production data systems or data services
- Hands-on experience with AWS for building applications (Lambda, S3, API Gateway, IAM)
- Solid proficiency in Python (and ideally Scala)
- Demonstrated ability to debug and reason about distributed data systems (streaming pipelines, Spark on EMR/Glue, APIs, queues, storage layers)
- Practical experience with infrastructure-as-code (Terraform or CloudFormation)
- Bachelor's degree in computer science, Information Technology, or equivalent experience
Preferred Qualifications
- 5+ years of experience developing highly reliable and fault-tolerant data systems in operational environments
- 3+ years of experience in AWS cloud services supporting streaming and distributed compute, including Lambda, Glue, Kinesis, EMR, S3, SNS, SQS, and DynamoDB
- Experience building and maintaining REST APIs
- Experience working with infrastructure-as-code (Terraform, CloudFormation)
- Experience with CI/CD pipelines, automated testing, or building testable data services
- Knowledge of a variety of database systems, including relational, document, and key-value pair
- Experience with Snowflake as a downstream analytical/warehouse target (Airflow DAGs, COPY statements, SQL ingestion patterns)
- Experience working with semi-structured event data (JSON/XML) and evolving schemas
Requirements
- Hands-on experience building production data systems or data services
- Hands-on experience with AWS for building applications (Lambda, S3, API Gateway, IAM)
- Solid proficiency in Python
- Demonstrated ability to debug and reason about distributed data systems (streaming pipelines, Spark on EMR/Glue, APIs, queues, storage layers)
- Practical experience with infrastructure-as-code (Terraform or CloudFormation)
Skills
API GatewayAWSCloudFormationDynamoDBEMRIAMJSONKinesisLambdaPythonREST APIsS3ScalaSnowflakeSNSSQSSparkSQLTerraformXML
Don't send a generic resume
Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.
Get started free