Software Developer / Data Engineer

About the job Software Developer/Data Engineer

Software Developer/Data Engineer - 12 Month Contract Educational Qualifications • BSc Computer Science / BEng Professional Qualifications • AWS Professional Certification Years of Experience • 4 to 8 years of Data Engineering or Software Development experience working on Data-Driven ecosystems Skills / Requirements • 4 to 8 years of Data Engineering or Software Development experience working on Data-Driven ecosystems • Required to code complex transformations using loader specifications provided by the BA • Experience working with Big Data sets and solving data-related challenges • Ability to automate ingestion by building ingestion pipelines using AWS Lambda or Glue • Proficiency in coding languages: PySpark, Python, SQL • Hands-on experience with AWS services, including S3, Athena, Lambda Functions, GLUE, EC2 • AWS experience and AWS certification required • Experience in data modeling and data architecture design Key Responsibilities • Implement scalable data pipelines and architectures using PySpark, Python, SQL • Build distributed data pipelines and compute tiers operating on AWS Lambda and Glue • Serve as a technical resource for team members and mentor junior engineers • Collaborate with the team to deliver high-quality solutions that meet business requirements • Ensure code is well-designed, maintainable, and follows best practices and standards • Play a key role in shaping engineering practices by working in a scrum team to ensure sprint deliverables are met • Utilize project development tools such as JIRA, Confluence, and GIT • Assist DEVOPS Engineer in automation and CI/CD practices • Evaluate and recommend new technologies to improve performance, scalability, and reliability of software systems.