Opis
Senior Software Engineer- (Data Engineering, AWS & MLOPs) Core skills: AWS, Snowflake, data ingestion, data transformation, SQL, MLOps and Python Location: Pune, India (Work from home) Role Overview We are seeking a Senior Data Engineer to design, build and operate scalable data pipelines and analytical solutions using AWS and Snowflake. This role will integrate data from enterprise applications, APIs, databases and files, transforming it into reliable datasets for analytics, reporting and AI/ML use cases. The ideal candidate combines strong engineering skills with experience delivering secure, reliable and cost-effective data platforms in production.
You will be responsible for: Design and maintain batch and incremental data ingestion pipelines from APIs, relational databases, SaaS applications and file sources. Build AWS ingestion solutions using services such as Amazon S3, AWS Glue, Lambda, IAM and Step Functions. Develop Snowflake data models and transformation pipelines using SQL, Python, dbt or equivalent tools.
Implement Bronze, Silver and Gold layers within a medallion architecture, with clear data contracts and lineage. Process structured and semi-structured data, including JSON, CSV and Parquet. Implement change data capture, incremental loading, deduplication, schema evolution and historical data management.
Integrate datasets across systems using consistent business keys, reference mappings and transformation rules. Build data quality checks, reconciliation contro
Pełny opis, firma i link do aplikacji — po zalogowaniu.
Zaloguj sięKontakty pracodawcy (e-mail/telefon/Telegram) są ukryte w publicznym podglądzie.
Wyślij CV — a pracodawcy będą mogli napisać do Ciebie sami.