data engineering lead in kolkata

posted
contact
randstad india
position type
permanent
apply now

posted
location
kolkata, west bengal
function
Information Technology
position type
permanent
experience
5
reference number
63443
contact
randstad india

job description

data engineering lead in kolkata

The person should be able to:
 Understand business needs and objectives of our clients from various sectors such as FMCG,
E-commerce, FinTech, Manufacturing etc.
 Organize and drive successful completion of projects through effective management of
analyst and effective collaboration with client stakeholders.
 Liaise with clients to fully understand data content and context.
 Make impact through recommendations towards the best data science approach / technology /
algorithm to be used for any given problem statement at hand.
 Design and develop complete solution stack for scalable, available, secure data infrastructure.
 Build end-to-end automated data engineering pipelines and ETL/ELT on cloud.
 Use microservice architecture to design and develop RESTful APIs catering to Big data / ML
/ external consumption.
 Make impact through recommendations towards the best technology stack to be used for any
given problem statement at hand.
 Communicate various aspects of project to internal/external stakeholders.
 Lead and develop a team of data engineers, while leveraging expertise from data science
team.
 Proactively participate in business development activities to ensure constant flow of new
projects. Mandatory:
o Proven experience in a hands-on Data Engineering Lead / Manager role with at least
4-5 years of total data engineering experience.
o Solid experience in end-to-end ETL/ELT, Data Lake on cloud, data unification &
harmonization, data cleansing, data enrichment, data wrangling and reporting, within
a given business context.
o Working experience with cloud technologies is a must. Experience with Azure Data
Factory, Databricks, Function App, Logic App etc. within Azure ecosystem will be
highly preferred.
o Experience in Python and SQL is a must.
o Ability to think independently and take ownership. Ability to lead and drive the best
out of the people.
o Ability to understand business needs and objectives of our clients, with good
communication skills.
o Excellent analytical skills with a passion for solving problems using data.
o Experience in Big Data processing technologies such as Spark.

skills

Python, SQL, Azure, ETL, data engineer

qualification

Any