data engineer in bengaluru / bangalore

posted
contact
randstad india
position type
permanent
apply now

posted
location
bengaluru / bangalore
function
Information Technology
position type
permanent
experience
5-10
reference number
58981
contact
randstad india

job description

data engineer in bengaluru / bangalore

Nature of Role: Individual Contributor Total Indicative Experience: 5-10 YearsIndicativeEducation: Bachelors or equivalent degree mandatory,Masters/PHD or equivalent degree preferred.Degrees in computer science or statistics or mathematics preferredRoles & Responsibilities: • Data Engineering and Technical Delivery o Preparedata for analysis using Presto SQL or domain specific tool (example: Omniturefor Digital), visualizing the data and executing to specifications o WebScraping using Python to get basic datasets from popular websites (e.g.:LinkedIn) as required, Parsing JSON objects to get the data in tabular formato Good knowledge of databases/SQL, relevant tools like R or Python, Omniture(if digital) o Experience with frameworks like PySpark to handle large data oShows drive to increase the breadth & depth of tools and system o creatingData schemas, building the pipelines, collecting data and moving it intostorage. o Preparing the data as part of ETL or ELT processes. o Stich thedata together with scripting languages and often work with DBA's to constructdata stores or data models. o Ensure data is available for ready to use anduse framework and microservices to serve up the data o Design, build andoptimize applications' containerization and orchestration with Docker andKubernetes • Stakeholder Engagement o Grasp requirements on call and deliverto specification; Present to Senior Management & Leadership o Present findingsto team lead/managers and to external stakeholders o Drive stakeholderengagements by driving complex analytical projects including bottoms-upprojects o Develop executive presentations with guidance • Skills: o Expertuser of Python & Presto SQL o Working experience on, Hadoop eco system, Hive,Kubernetes o Usage of various machine learning or statistical libraries,frameworks like PySpark

skills

data engineer, Kubernets

qualification

B.E/B.Tech