KEY RESPONSIBILITIES...● Build and operationalize cloud-based platform components● Develop production-quality data ingestion pipelines with automated quality checks using GCP andAstronomer● Assess existing systems architecture and recommend technical improvements● Develop Python-based automation to support product development and data analytics● Resolving technical problems as they arise● Research and propose emerging technologies and platform
KEY RESPONSIBILITIES...● Build and operationalize cloud-based platform components● Develop production-quality data ingestion pipelines with automated quality checks using GCP andAstronomer● Assess existing systems architecture and recommend technical improvements● Develop Python-based automation to support product development and data analytics● Resolving technical problems as they arise● Research and propose emerging technologies and platform
Should have a minimum 2+ years in Data Engineering, Data Analytics platform. Should have strong hands-on design and engineering background in AWS, across a wide range ofAWS services with the ability to demonstrate working on large engagements. Should be involved in Requirements Gathering and transforming them to into Functionally andtechnical design. Maintain and optimize the data infrastructure required for accurate extraction, transformation,
Should have a minimum 2+ years in Data Engineering, Data Analytics platform. Should have strong hands-on design and engineering background in AWS, across a wide range ofAWS services with the ability to demonstrate working on large engagements. Should be involved in Requirements Gathering and transforming them to into Functionally andtechnical design. Maintain and optimize the data infrastructure required for accurate extraction, transformation,
Collaborate with Product teams ensuring that raw data is cleansed and transformedand useable by downstream consumers (ML Engineers, BI analytics) Expect level PL-SQL Assist and advise on the re-development and modernisation of end-to-end ETLpipelines and introduce new technologies where appropriate in a real-time streamingenvironment dealing with very large data volumes Working with AWS cloud infrastructure (specifically SQS, SNS, Redshift,OpenSearch,
Collaborate with Product teams ensuring that raw data is cleansed and transformedand useable by downstream consumers (ML Engineers, BI analytics) Expect level PL-SQL Assist and advise on the re-development and modernisation of end-to-end ETLpipelines and introduce new technologies where appropriate in a real-time streamingenvironment dealing with very large data volumes Working with AWS cloud infrastructure (specifically SQS, SNS, Redshift,OpenSearch,