Data Engineer (Azure, Databrick)

Market insights

Stack

Apply

Upload your CV — we will connect you with the employer directly through our pool.

Description

Key Responsibilities Data Management & Transformation Design, develop and maintain data pipelines that extract data from business applications, databases and external systems. Implement data quality checks and validation processes to ensure data accuracy, consistency and completeness. Perform data cleansing, aggregation, filtering, transformation and enrichment. Establish and maintain governance frameworks for data and algorithms used in analytics, automated decision-making and analytical applications. Develop and maintain logical and physical data models, including data structures, relationships and constraints. Ensure data solutions comply with security, governance and organisational best practices. Data Platform Optimisation & Automation Develop and maintain CI/CD pipelines for data deployments and cloud resource provisioning. Optimise data pipelines and processing workflows for performance, scalability and efficiency. Optimise data models and algorithms for data quality, security, governance, performance and scalability. Monitor data warehouse and ETL platform capacity, including capacity planning and forecasting. Monitor and tune data platforms, troubleshoot performance bottlenecks and implement optimisation techniques such as caching and indexing. Monitor platform resource and credit consumption and perform regular housekeeping activities. Support the deployment, integration and maintenance of AI/ML solutions within the data platform. Collaboration & Business Enablement

Employer contacts (email/phone/telegram) are hidden from the public preview — send your CV, and we will connect you directly.