Connecting to LinkedIn...

Big Data Engineer Python Scala

Posted 20 days ago

London, England, £75000 - £90000 per annum + bonus + benefits

Job Type: Permanent

Managed by: Data Team

Big Data Engineer (Python Scala ETL Cloud). Would you like to work with complex Big Data technologies within a supportive Agile team environment with flexible working opportunities, casual dress code and early finish on Fridays?

You could be working on a high-performance, data-intensive backend software that allows the advertising sector to intelligently target ads. As a Big Data Engineer you will be responsible for the evolution of the data platform, developing the architecture and maintaining the data platform backlog. The systems generate vast amounts data, approximately 350GB per hour, distributed over many servers. You'll be solving complex technical challenges and finding new ways to use the data to improve the product and deliver more value.

Requirements:

*Strong experience of solving complex, large scale data challenges
*Strong Python (PySpark) and / or Scala coding skills for data intensive systems
*Hands-on implementation and architectural familiarity with streaming data, relational and non-relational databases, orchestration frameworks (e.g. Luigi, Airflow or Oozie) and distributed processing technologies (e.g. Spark)
*Familiar with cloud based services - AWS, GCP
*Good working knowledge of Linux
*Collaborative team member, keen to learn and share knowledge with others

As a Big Data Engineer you will earn a competitive salary (to £90k) plus bonus and benefits.

Apply now or call to find out more about this Big Data Engineer (Python Scala ETL Cloud) opportunity.

REF: BB/14177/C/KS/241019_1571902981

Integrity, Commitment, Quality and Endeavour

"As a software developer working in financial services looking for a role outside the sector... Oliver took this vague request and ran with it, producing specs for roles.... that were exactly what I was looking for... Oliver's and Client Server's cross-sector networks made this move possible, and it's a very unique aspect to their offering."

Stephen - Senior Developer

W1siziisijiwmtuvmdgvmtivmtavndmvmzmvmje1lzguanbnil0swyjwiiwidgh1bwiilci4mhg4mfx1mdazzsjdxq


"Nick (and Client Server in general) are quite different from other recruiters I have dealt with. He takes the time to understand where you are and what you want next so that he can find the right job rather than just any job. The communication throughout the process was perfectly pitched and I'm very happy with the end result."

Julian - Senior Developer​

W1siziisijiwmtuvmdgvmtivmtavndyvmzqvmjqylzkuanbnil0swyjwiiwidgh1bwiilci4mhg4mfx1mdazzsjdxq


"I have worked with Client Server before to my satisfaction. They provide a very professional approach, excellent communication and an overall exceptional service in recruitment... David represents those values extremely well... I had no questions unanswered. He has organised the process with flawless precision. I would always recommend him."

Marton - Head of Development​

W1siziisijiwmtuvmdgvmtivmtavndevmzgvnjgylzcuanbnil0swyjwiiwidgh1bwiilci4mhg4mfx1mdazzsjdxq