big data engineer in bangalore

posted
contact
randstad india
position type
permanent
apply now

posted
location
bangalore, karnataka
function
Information Technology
position type
permanent
experience
4-6
reference number
59935
contact
randstad india

job description

big data engineer in bangalore

Job Title: Big Data Engineer
Required Technical Skillset:
● Concepts of Data Warehousing and OLAP Reporting
● NoSQL Concepts
● Hadoop(Hive, HBase, MapReduce)
● MongoDB\Cassandra
● Spark
● Kafka
● Java\Scala
● Python
● SQL
● DevOps
● J2EE\XML
Desired Competencies:
Hands on experience in building ETL pipelines using Hadoop complemented with
MongoDB\Cassandra. Hands-on experience in Spark and Kafka. Linux scripting. Should be able
to understand and implement Rest APIs/Microservices. J2EE and related technologies
Good to have :
Capability to setup the Big Data environment from scratch. Hands-on on Scala.
Expectations from the Role :
1. Building ETL pipelines for various business application as per requirements for
analytics or reporting
2. Formulating data cleansing procedures
3. Strong ability to work with unstructured data and streaming
4. Excellent communication skills and ability to manage multiple, diverse stakeholders
across business areas and leadership levels
5. Working with data scientists and Machine learning engineers and helping them in
building an efficient pipeline for AI\ML features. Designing schema\Keyspace for data
storage and efficient retrievals
6. Performance tuning of ETLs and their optimized scheduling
7. In case , if required should be able to get into infrastructure details of Big Data setup and
its components to optimize or to fix a fault

skills

NOSQL, "Big Data Developer"

qualification

B.E/B.Tech