data engineer in bengaluru / bangalore

posted
contact
randstad india
position type
permanent
apply now

posted
location
bengaluru / bangalore
function
Information Technology
position type
permanent
experience
10
reference number
65173
contact
randstad india

job description

data engineer in bengaluru / bangalore

Data Engineer

 

Job Responsibilities

 

You will be responsible for developing, maintaining, and testing data solutions with a wide variety of data platforms on Google Cloud. You will work with Data Architects and Business Analysts for ELT/ETL implementations. You will responsible for maintaining LLD and other technical documents

Mandatory Skills

  • Total relevant work experience of 5-10 years.
  • Strong experience with GCP cloud services
  • Experience in building ELT/ETL processes using DataProc (Python and Pyspark) & Dataflow – Apache Beam using Java(for streaming)
  • Experience working with Google BigQuery
  • Building ETL orchestration using Cloud Composer
  • Strong understanding of Data Ingestion, Data processing, Orchestration, Parallelization, Transformation and ETL fundamentals
  • Sound knowledge of data analysis using any SQL tools
  • Knowledge on Big Data technologies
  • Designs develop, automates, and support complex applications to extract, transform, and load data
  • Should have knowledge of error handling and Performance tuning for Data pipelines

 

skills

ETL, GCp, data engineer, ELT, Google cloud, Data Engineering, Google BigQuery

qualification

Any