Lead Data Engineer (Teradata/Hadoop)

Market insights

Stack

Apply

Upload your CV — we will connect you with the employer directly through our pool.

Description

Company Overview OPTIMUM SOLUTIONS (SINGAPORE) PTE LTD is a Singapore-headquartered IT outsourcing firm specializing in software engineering, application development, and IT infrastructure management. Since 1997, it has grown into a leading provider of digital transformation services. Job Summary We are seeking a Senior Data Engineer with expertise in enterprise data platforms and banking domains to lead the design and development of scalable data pipelines across Teradata, Hadoop/Cloudera, and cloud ecosystems while mentoring engineering talent and driving technical excellence. Responsibilities Lead the architecture and implementation of scalable batch, streaming, and API-based data pipelines to support large-scale data delivery and historical data processing frameworks. Design and implement Slowly Changing Dimension (SCD) and Change Data Capture (CDC) mechanisms to maintain accurate and up-to-date data products. Develop semantic-layer data products that enhance data accessibility and usability for business stakeholders. Optimise complex SQL queries, Spark workloads, partition strategies, and storage frameworks to improve performance for large-volume data processing in regulated enterprise banking environments. Implement infrastructure-as-code using Terraform to automate provisioning and management of cloud and on-premises resources. Establish automated Continuous Integration/Continuous Deployment (CI/CD) pipelines and containerized deployment workflows to ensure reliable an

Employer contacts (email/phone/telegram) are hidden from the public preview — send your CV, and we will connect you directly.