Connecting to LinkedIn...

Lead Data Engineer - Technologist

Job Title: Lead Data Engineer - Technologist
Contract Type: Permanent
Location: London, England
Salary: £85000 - £100000 per annum + bonus + benefits
REF: BB/14177/E/KS/101019_1570704673
Contact Name: Data Team
Contact Email:
Job Published: 12 months ago

Job Description

Lead Data Engineer (Python Scala ETL Luigi Airflow Oozie Spark).

Would you like to work with complex Big Data technologies and take a lead role whilst enjoying perks such as flexible working opportunities, casual dress code and early finish on Fridays?

You could be joining a global software house that produce a high-performance, data-intensive backend software that allows the advertising sector to intelligently target ads and bid for ad space via an extremely complex data centric platform.

As a Lead Data Engineer you will be responsible for the evolution of the data platform, developing the architecture and maintaining the data platform backlog.

The systems generate vast amounts data, approximately 350GB per hour, distributed over many servers. You'll be solving complex technical challenges and finding new ways to use the data to improve the product and deliver more value.

*Strong experience of solving complex, large scale data challenges
*Strong Python (PySpark) and / or Scala coding skills for data intensive systems
*Hands-on implementation and architectural familiarity with streaming data, relational and non-relational databases, orchestration frameworks (e.g. Luigi, Airflow or Oozie) and distributed processing technologies (e.g. Spark)
*Familiar with cloud based services - AWS, GCP
*Good working knowledge of Linux
*Collaborative team member, keen to learn and share knowledge with others

As a Lead Data Engineer you will earn a competitive salary (to £100k) plus bonus and benefits.

Apply now or call to find out more about this Lead Data Engineer (Python Scala ETL Luigi Airflow Oozie Spark) opportunity.