As a Lead Data Engineer, you will shape the future of online car markets, leading complex data projects, organizing teams, and designing new data solutions while working closely with engineers and management in a collaborative environment.
About the project:
Our customer is the European online car market with over 30 million monthly users, with a market presence in 18 countries. The company is now merging with a similar company in Canada and needs support on this way. As a Lead Data Engineer, you will play a pivotal role in shaping the future of online car markets and enhancing the user experience for millions of car buyers and sellers.
Requirements:
- 8+ years of experience in software engineering
- English - Upper-Intermediate+
- Proven experience leading complex data projects, organizing teams, and architecting and designing new solutions
- Extensive expertise in AWS services, especially Glue, Athena
- Proficiency in Python, PySpark, GCP
- SQL, Airflow, data streaming frameworks (Kafka or Firehose)
- Experience in building and maintaining data pipelines
- Experience in building data platforms, not just using them
- Proficiency in data modeling techniques and best practices
Responsibilities:
- Simplify existing tools, make them more modular, work with technical debt
- Propose improvements, be actively involved in team discussions and decision-making, drive initiatives
- Work closely with a team of Senior Engineers, Product Manager and Engineering Manager
We offer:
- Flexible working format - remote, office-based or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other location-specific benefits
Top Skills
Pyspark
Python
SQL
Similar Jobs
The Data Engineer will architect and lead the transition from on-premises batch architecture to a cloud-based streaming data platform, focusing on data warehousing, ETL pipelines, and data governance. The role involves collaboration with cross-functional teams and fostering a culture of technical excellence.
As a Data Engineer at Vaayu, you will transform customer data into standardized formats, contribute to improving transformation pipelines, and assist the team with customer data inquiries. Your role will be crucial in supporting the mission of reducing environmental impact through effective data handling.
.png)
Be an Early Applicant
The Principal Data Engineer will build data foundations for an AI-powered architecture design product, creating optimized data systems and robust data pipelines that support rapid experimentation and decision-making processes, and collaborating with cross-functional teams to meet data needs.
What you need to know about the Bristol Tech Scene
Along with Gloucester, Swindon and Bath, Bristol is part of the "Silicon Gorge" tech hub, a region in the U.K. renowned for its high-tech and research-driven industries, with a particular emphasis on sustainability and reducing environmental impact. As the European Green Capital, Bristol is home to 25,000 cleantech companies, including Baker Hughes and unicorn Ovo Energy. The city has committed to achieving net-zero emissions within the next decade.
