Skip to content
mimi

Data Engineer - - CHADC5779480

Compunnel Inc.

Portland · On-site Full-time Senior Today

About the role

Job Title

Senior Data Engineer (AWS, Distributed Data Systems)

Location

Westbrook, Maine

Minimum Qualifications

  • Hands-on experience building production data systems or data services
  • Hands-on experience with AWS for building applications (Lambda, S3, API Gateway, IAM)
  • Solid proficiency in Python (and ideally Scala)
  • Demonstrated ability to debug and reason about distributed data systems (streaming pipelines, Spark on EMR/Glue, APIs, queues, storage layers)
  • Practical experience with infrastructure-as-code (Terraform or CloudFormation)
  • Bachelor's degree in computer science, Information Technology, or equivalent experience

Preferred Qualifications

  • 5+ years of experience developing highly reliable and fault-tolerant data systems in operational environments
  • 3+ years of experience in AWS cloud services supporting streaming and distributed compute, including Lambda, Glue, Kinesis, EMR, S3, SNS, SQS, and DynamoDB
  • Experience building and maintaining REST APIs
  • Experience working with infrastructure-as-code (Terraform, CloudFormation)
  • Experience with CI/CD pipelines, automated testing, or building testable data services
  • Knowledge of a variety of database systems, including relational, document, and key-value pair
  • Experience with Snowflake as a downstream analytical/warehouse target (Airflow DAGs, COPY statements, SQL ingestion patterns)
  • Experience working with semi-structured event data (JSON/XML) and evolving schemas

Requirements

  • Hands-on experience building production data systems or data services
  • Hands-on experience with AWS for building applications (Lambda, S3, API Gateway, IAM)
  • Solid proficiency in Python
  • Demonstrated ability to debug and reason about distributed data systems (streaming pipelines, Spark on EMR/Glue, APIs, queues, storage layers)
  • Practical experience with infrastructure-as-code (Terraform or CloudFormation)

Skills

API GatewayAWSCloudFormationDynamoDBEMRIAMJSONKinesisLambdaPythonREST APIsS3ScalaSnowflakeSNSSQSSparkSQLTerraformXML

Don't send a generic resume

Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.

Get started free