10 jobs found for Big data in Bangalore, Karnataka

JOB DESCRIPTION The Data Engineer’s primary role is to write Spark pipelines to ETL data within our data platform running on AWS. Working within a very dynamic team, this role must help elevate the team’s quality. The Data Engineer will work closely with Data Analysts, Data Scientists, and business and technical teams to deliver secure, reliable, fault-tolerant, scalable, quality, and efficient outcomes.  KEY RESPONSIBILITIES Develop a scalable and resilie

Requirements: • Master’s degree in computer science, engineering, statistics, economics or equivalent with relevant 7 years of work experience• Proven ability to use modeling, optimization, machine learning or text classification algorithms• Possess a background in database design, ETL processes (SSIS) and SQL analysis (SSAS) to assist the Analytics team in formalizing their internal data flows and related reporting processes• Data virtualization, analytic

Experience designing highly large scale and distributed systems4 years of enterprise software development or application engineering with recent coding experience in two or more of the following languages: Java, JavaScript, C/C , C#, Swift, Node.js, Python, Go, or Ruby, or SolidityRequired understanding and expertise in event streaming technologies (Ex: Kafka)Good experience in microservices architectural frameworksKnowledge in technologies such as java, s

2-4years Skills Required: - Experience in Azure DevOps Engineer or similar DevOps engineering role. Experience in managing infrastructure in Azure & deploying and managing CI/CD pipelines. Strong expertise in troubleshooting complex CI/CD pipelines. Problem-solving, critical thinking, and communication skills. Experience in Kubernetes, Docker, or any container orchestration framework. Experience in Azure full stack, Azure DevOps, containerization, Ia

• Proficient in design and development of Data pipelines/ Integrations jobs• Experience in Informatica Power Centre• Experience in constructing logical and physical data modelling to build the Data Warehouse /Data Lake• Good Experience in handling the SQL, Index, Partitioning, distribution etc.,• Extensive experience in ETL methodology for performing Data Profiling, Data Migration,Extraction Transformation and Loading using ETL tools• Good knowledge on dat

Qualifications:•          Bachelor’s Degree.•          8+ years of experience in information technology with 5+ years working with data.•          Strong communication skills: ability to be well-organized, clear, and concise in conversations and written communications with development team members, business analysts, and project management.•          Experience in Cloud Architecture with Big data tools and machine learning preferred.•          Advanced dim

About Client: Our client is into a privately help American food corporation offering a range of farmer services and risk management solution. Position:This position will partner closely with members of the The client Data Platform team to bring Data and Analytics products and solutions to The client’s businesses and set the path for how, when and where digital technology will shape the technology solution and its appropriate use. Keys to the success of thi

Skills Required: - • Experience in Azure DevOps Engineer or similar DevOps engineering role. • Experience in managing infrastructure in Azure & deploying and managing CI/CD pipelines. • Strong expertise in troubleshooting complex CI/CD pipelines. • Problem-solving, critical thinking, and communication skills. • Experience in Kubernetes, Docker, or any container orchestration framework. • Experience in Azure full stack, Azure DevOps, containerization, IaC,

DATA ScienceYear of Exp : 5 to 8 yrsAbility to structure business problems into proper methodical analysis frameworksCan identify, develop and implement the appropriate statistical techniques, algorithms and data miningGood exposure to exploratory analysis and knack of deriving business insights & value. Comfortable with exploring large data setsExpert level knowledge in Natural Language Processing, Information Extraction and Text Mining algorithms.Strong

ACCOUNTABILITIESCreate machine learning predictive and prescriptive models (supervised and unsupervised)Understand project requirements and then guide junior team members to plan, deploy, and maintain models and applicationsUtilize cutting-edge data science techniques to build, train and optimize various predictive models based on technical specificationsData engineering and manipulation of large data setsLead, design, plan, and execute programming approac