Data Engineer II
Experimentation Track - Bengaluru
The Job
We are looking for a Data Engineer to join our team and help us to improve the platform that supports one of the best experimentation tools in the world.
The selected candidate will work side by side with other data engineers and site reliability engineers to improve the reliability, scalability, maintenance and operations of all the data products that are part of the experimentation tool at Booking.com.
Day to day work includes but is not limited to: maintenance and operations of data pipelines and products that handles data at big scale; the development of capabilities for monitoring, alerting, testing and troubleshooting of the data ecosystem of the experiment platform; and the delivery of data products that produce metrics for experimentation at scale. The selected candidate will collaborate with colleagues in Amsterdam to achieve results the right way. This will include engineering managers, product managers, engineers and data scientists.
Key Responsibilities and Duties
Take ownership of multiple data pipelines and products and provide innovative solutions to reduce the operational workload required to maintain them
Rapidly developing next-generation scalable, flexible, and high-performance data pipelines.
Contribute to the development of data platform capabilities such as testing, monitoring, debugging and alerting to improve the development environment of data products
Solve issues with data and data pipelines, prioritizing based on customer impact.
End-to-end ownership of data quality in complex datasets and data pipelines.
Experiment with new tools and technologies, driving innovative engineering solutions to meet business requirements regarding performance, scaling, and data quality.
Provide self-organizing tools that help the analytics community discover data, assess quality, explore usage, and find peers with relevant expertise.
Serve as the main point of contact for technical and business stakeholders regarding data engineering issues, such as pipeline failures and data quality concerns
The job requirements
Minimum 5 years of hands-on experience in data engineering as a Data Engineer or as a Software Engineer developing data pipelines and products.
Bachelor's degree in Computer Science, Computer or Electrical Engineering, Mathematics, or a related field or 5 years of progressively responsible experience in the specialty as equivalent
Solid experience in at least one programming language. We use Java and Python
Experience building production data pipelines in the cloud, setting up data-lakes and server-less solutions
Hands-on experience with schema design and data modeling
Experience designing systems E2E and knowledge of basic concepts (lb, db, caching, NoSQL, etc)
Knowledge of Flink, CDC, Kafka, Airflow, Spark, Snowflake, DBT or equivalent tools
Practical experience building data platform capabilities like testing, alerting, monitoring, debugging, security
Experience working with big data.
Experience working with teams located in different timezones is a plus
Experience with experimentation, statistics and A/B testing is a plus
