Summary of the Role:
This role will design, develop, and maintain the data processing platform on Azure. The purpose of the data platform is to integrate data across the organization to empower and provide business partners, vendors, and customers with actionable insights. The right candidate will implement best practices using expertise in Azure Data Services to build a scalable, secure, and governed platform.
Responsibilities / Accountabilities:
·Develop pipelines in Synapse that ingest data from a growing number of data sources.
·Implement data quality checks and validation processes to ensure accuracy, consistency, and integrity.
·Identify, design, and integrate process improvements: automate manual processes, timely data delivery, and re-designing for future use cases.
·Monitor pipeline operations, tasks, resource utilization, and failures.
·Support HA, DR, Backup, and retention policies on all data platforms Ensure compliance with IT General Controls, provide needed information in support of audits and to substantiate process and controls compliance.
·Produce documentation for data models, transformations, business rules, and lessons learned that allows other staff members to understand the ingestion process and maintain and troubleshoot it
·Understand technical requirement of project and execute in data platform
Requirements (education, experience, competencies and specific job requirements):
·7 years of IT experience in Data and Analytics, data integration or data ingestion.
·3+ years of experience in Azure Cloud Services (PaaS & IaaS), Azure Data Factory, Azure Synapse Analytics, Azure Analysis Service, Application Insights, Azure Monitoring, Azure Data Lake.
Education / Certification:
- Bachelor's degree in computer science.
- Certifications considered a plus, especially those focused on data and analytics
Experience and Skills:
·Collaborations across Data intelligence cross functional team
·Good experience in tracking and logging end to end software application build using Azure Dev Ops.
·Having Data warehousing experience in Business Intelligence Technologies and Database with Extensive Knowledge in Data analysis, TSQL queries, ETL and ELT process, Reporting services using (Power BI).
·Design Enterprise level data warehouse solutions
·Have good experience designing cloud-based solutions in Azure by creating Azure SQL database, setting up Elastic pool jobs and designing tabular models in Azure analysis services.
·Have extensive experience in creating pipeline jobs, schedule triggers using Azure data factory.
·Proven ability in performance Tuning, Query Optimization
·Involved in full life cycle of software design process of projects including prototyping, proof of concepts, design interface implementation, testing and maintenance.
·Good experience in maintaining version control using Azure Dev Ops.
·Knowledge of SAP source system and BW is a plus.
·Emotional intelligence, flexible work style, and excellent diplomatic skills across all levels of an organization
·Proven oral and written communication skills with a high degree of comfort with varying types of audiences.
·Experience designing and delivering complex solutions on time and with expected quality.