M28 - Data Engineer

Аналитика рынка

Стек

Бесплатно. Вход по почте.

Откликнуться

Загрузите резюме — мы свяжем вас с работодателем напрямую через нашу базу.

Описание

Role Overview We are seeking an experienced Data Engineer to design, build, and deploy a scalable and reliable data lakehouse platform on AWS. The role will focus on developing end-to-end data pipelines, establishing robust data quality frameworks, and delivering production-ready solutions that form the foundation of the organisation's data infrastructure. Key Responsibilities Design, develop, and maintain scalable ETL/ELT data pipelines using AWS services such as Glue, Step Functions, Lambda, and S3. Architect and implement data lakehouse solutions using Apache Iceberg, S3 Tables, or similar open table formats. Implement lakehouse capabilities including schema evolution, partition evolution, and ACID transactions. Optimise data pipelines and storage solutions for performance, scalability, reliability, and cost efficiency. Define and implement automated data quality validation frameworks to ensure data accuracy, completeness, and consistency. Establish data quality metrics, monitoring, and alerting mechanisms across the data platform. Implement and maintain data governance standards and ensure compliance with relevant policies and requirements. Develop production-quality code and deploy solutions on AWS cloud infrastructure. Implement CI/CD practices to support automated, repeatable, and reliable deployments. Use infrastructure-as-code tools such as Terraform or CloudFormation to provision and manage cloud infrastructure. Work closely with cross-functional teams to design and

Полное описание, компания и ссылка на вакансию — после входа. Войти

Контакты работодателя (email/phone/telegram) скрыты из публичного превью — отправьте резюме, чтобы мы связали вас напрямую.