Connecting to LinkedIn...

Lead Data Engineer - Python Cloud Data Streaming

Job Title: Lead Data Engineer - Python Cloud Data Streaming
Contract Type: Permanent
Location: London, England
Salary: £90000 - £130000 per annum + bonus + benefits
REF: BB/14318/D/KS/20120_1579516495
Contact Name: Data Team
Contact Email:
Job Published: about 1 year ago

Job Description

Lead Data Engineer (Python Cloud Data Streaming / Data Processing). Would you like to work on complex and interesting systems at a technology focussed FinTech where you can make an impact, take ownership and continue to learn? You could be joining a global business with excess of 2,500 institutional clients operating in over 60 global markets with a daily trading volume of $500B.

As a Lead Data Engineer you will collaborate with the US team as the sole Data Engineer in the UK office; you'll be responsible for building and running a new data platform working with Data Scientists in London to build revenue generating services and products from the vast amount of data generated and stored. You will design and build data ingest pipelines to collect data from all parts of the company and from 3rd parties.

The company is technology driven; you will be able to evaluate new tools and technologies and introduce these as appropriate. The current stack includes: BigQuery, Presto, Snowflake, Spark, Cloud (AWS, GCP, Joyent, OpenStack), Kafka, Pulsar, Storm, Kinesis within a DevOps environment.

You will be working in a professional yet informal atmosphere in impressive, City based offices with breakout areas and a range of onsite facilities; you'll get to visit your US colleagues around twice a year with an initial two week period to get up to speed.

*Advanced Data Engineering experience
*Good knowledge of scalable data processing engines (e.g. BigQuery, Presto, Snowflake, Spark)
*Good knowledge of at least one Cloud platform (e.g. AWS, GCP, Joyent, OpenStack)
*Strong Python coding skills with exposure to numerical Python (e.g. NumPy, Pandas, Jupyter)
*Advocate of automation / DevOps
*Experience with data streaming / processing technologies (e.g. Kafka, Pulsar, Storm, Kinesis)
*Collaborative with excellent communication skills

As a Lead Data Engineer you will earn a competitive salary (to £130k) plus bonus and benefits.

Apply now or call to find out more about this Lead Data Engineer (Python Cloud Data Streaming / Data Processing) opportunity.