Описание
Our client, one of Asia-Pacific’s leading organizations is looking for: Data Engineer
Responsibilities
Perform data extraction, cleaning, transformation, and flow. Web scraping may be also a part of the work scope in data extraction. Design, build, launch and maintain efficient and reliable large-scale batch and real-time data pipelines with data processing frameworks Collaborate with Project Manager, Visualisation Developer, Data Scientist, UX Designers and Data Analyst to build scalable data-driven products Work in an Agile Environment that practices Continuous Integration and Delivery Support and advise best practices in data management standards, policies and procedures Work closely with fellow developers through pair programming and code review process
Requirements
Interest in being the bridge between engineering and analytics Knowledge about system design, data structure and algorithms Familiar with data modelling, data access, and data storage infrastructure like Data Mart, Data Lake, and Data Warehouse Proficient in general data cleaning and transformation (e.g. SQL, pandas, R, etc) Familiar with rest API and web requests/protocols in general Proficient with processing data from open-standard file format or data interchange format (e.g. XML, JSON) Good in building ETL pipeline (eg.
Talend Data Integration, Informatica PowerCenter, IBM DataStage, SAS Data Integration) Good in database design and various databases (e.g. MS SQL Server, Oracle RDBMS, IBM DB2, Postgres e
Полное описание, компания и ссылка на вакансию — после входа.
ВойтиКонтакты работодателя (email/phone/telegram) скрыты из публичного превью —
отправьте резюме, чтобы мы связали вас напрямую.