E
Data Engineer
eSimplicity
Columbia · flexible Full-time Senior $113k – $128k/yr 1mo ago
About the role
About Us
- eSimplicity is a modern digital services company partnering with government agencies to improve lives and protect well-being of Americans.
- Engineers, designers, and strategists create intuitive products and services for federal agencies.
Responsibilities
- Develop, expand, and optimize data and data pipeline architecture.
- Optimize data flow and collection for cross functional teams.
- Support software developers, database architects, data analysts, and data scientists on data initiatives.
- Create and maintain data pipelines and ETL processes; build PoCs with Redshift Spectrum, Databricks, AWS EMR, SageMaker.
- Implement large dataset engineering including data augmentation, quality analysis, analytics, profiling, algorithms, and data maturity models.
- Operate large-scale data processing pipelines and resolve related issues.
- Assemble large, complex data sets meeting business requirements.
- Identify and implement process improvements for scalability, data delivery, and automation.
- Build infrastructure for data extraction, transformation, and loading using AWS and SQL.
- Build analytical tools for actionable business insights.
- Collaborate with stakeholders on data-related technical issues.
- Write unit and integration tests for data processing code.
- Work with DevOps on CI, CD, and IaC.
- Translate specs into code and design documents.
- Perform code reviews and improve code quality.
- Perform other duties as assigned.
Requirements
- Must pass public trust clearance through U.S. Federal Government; requires U.S. citizenship or specific residency and visa conditions.
- Minimum 8 years experience as Data Engineer or software developer; at least 4 years with Python, Java, and cloud technologies.
- Bachelor’s degree in Computer Science, Information Systems, Engineering, Business, or related field required; or 10 years general IT experience with 8 years specialized experience in lieu of degree.
- Expert in building and optimizing data pipelines and systems.
- Self-sufficient supporting multiple teams and products.
- Experienced in designing scalable data architecture and services including API, metadata, and data catalog.
- Experienced in data governance for batch and stream ingestion.
- Skilled in root cause analysis and working with unstructured datasets.
- Proficient with big data tools (Spark, Hadoop), relational databases (MySQL, Postgres), workflow tools (Apache Airflow, AWS Step Function), AWS services (Redshift, RDS, EMR, EC2), stream-processing (Spark-Streaming, Storm), and languages (Scala, Java, Python).
- Flexible and adaptable to changing priorities.
- Experience with Agile and test-driven development.
- Familiar with GitHub and Atlassian Jira/Confluence.
- Excellent English communication skills.
Desired Qualifications
- Federal Government contracting experience.
- Certifications: Databricks, Google Certified Professional-Data-Engineer, IBM Certified Data Engineer – Big Data, CCP Data Engineer for Cloudera.
- Experience with CMS or Health Care Industry.
- Experience with healthcare quality data including Medicaid, CHIP provider data, beneficiary data, claims data, and quality measure data.
Working Environment
- Remote work environment operating within Eastern time zone.
- Expected hours 9:00 AM to 5:00 PM Eastern unless directed otherwise.
- Occasional travel for training and project meetings, less than 5% per year.
Benefits
- Highly competitive salaries.
- Full healthcare benefits.
Equal Employment Opportunity
- eSimplicity is an equal opportunity employer. All qualified applicants will receive consideration without regard to race, religion, color, national origin, gender, age, veteran status, sexual orientation, gender identity, or disability status.
Skills
Apache AirflowAWS EC2AWS EMRAWS RedshiftAWS RDSAWS SageMakerAWS Step FunctionDatabricksHadoopJavaJiraMySQLPostgreSQLPythonScalaSparkSpark-StreamingStorm
Don't send a generic resume
Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.
Get started free