London, England, £90000 - £130000 per annum + bonus + benefits
Job Type: Permanent
Managed by: Data Team
Lead Data Engineer (Python Cloud Data Streaming / Data Processing). Would you like to work on complex and interesting systems at a technology focussed FinTech where you can make an impact, take ownership and continue to learn? You could be joining a global business with excess of 2,500 institutional clients operating in over 60 global markets with a daily trading volume of $500B.
As a Lead Data Engineer you will collaborate with the US team as the sole Data Engineer in the UK office; you'll be responsible for building and running a new data platform working with Data Scientists in London to build revenue generating services and products from the vast amount of data generated and stored. You will design and build data ingest pipelines to collect data from all parts of the company and from 3rd parties.
The company is technology driven; you will be able to evaluate new tools and technologies and introduce these as appropriate. The current stack includes: BigQuery, Presto, Snowflake, Spark, Cloud (AWS, GCP, Joyent, OpenStack), Kafka, Pulsar, Storm, Kinesis within a DevOps environment.
You will be working in a professional yet informal atmosphere in impressive, City based offices with breakout areas and a range of onsite facilities; you'll get to visit your US colleagues around twice a year with an initial two week period to get up to speed.
*Advanced Data Engineering experience
*Good knowledge of scalable data processing engines (e.g. BigQuery, Presto, Snowflake, Spark)
*Good knowledge of at least one Cloud platform (e.g. AWS, GCP, Joyent, OpenStack)
*Strong Python coding skills with exposure to numerical Python (e.g. NumPy, Pandas, Jupyter)
*Advocate of automation / DevOps
*Experience with data streaming / processing technologies (e.g. Kafka, Pulsar, Storm, Kinesis)
*Collaborative with excellent communication skills
As a Lead Data Engineer you will earn a competitive salary (to £130k) plus bonus and benefits.
Apply now or call to find out more about this Lead Data Engineer (Python Cloud Data Streaming / Data Processing) opportunity.