data engineer lead in hyderabad

posted
contact
randstad india
position type
permanent
apply now

posted
location
hyderabad, telangana
function
Information Technology
position type
permanent
experience
8-14
reference number
60394
contact
randstad india

job description

data engineer lead in hyderabad

Responsibilities

 
  • Gather and process raw data at scale. 

  • Defining data retention policies. 

  • Work closely with our data science team (ad hoc analysis of the data). 

  • Acquire data from primary or secondary sources and maintain databases/systems. 

  • Create data sets and tables to store data. Work on data Analysis, modeling and architecture.

  • Make and test database schema changes when needed. 

  • Identify user needs to create and administer the data lake. 

  • Ingest and move data between databases that includes relational and no-SQL databases like Oracle, SQL Server, MongoDB, Elastic Search, Google Bigquery etc.

  • Implement security measures by encrypting sensitive data

  • Build and Modify ETL jobs to improve performance and efficiency

  • Work closely with the team members in the US to understand requirements; guide the team through implementation.

  • Experience with integration of data from multiple data sources utilizing ETL tools (Talend,Informatica, PDI, Kapow etc.)

 

Qualifications:

  • B.Tech or B.E degree in computer science or related technical fields

  • 8+ years of experience with database systems (Oracle, SQL Server, MySQL, Google BigQuery, MongoDB, ElasticSearch etc.)

  • 6+ years of experience with distributed computing principles, Programming Language (Python, Java, C, etc.)

  • 6+ years experience with Big Data (Hadoop, Horton Works, etc.) and NoSQL databases, such as (Hbase, Spark, Hive, Cloudera etc)

skills

Python, AWS, GCp, Hadoop, BigData, Database

qualification

Any