Big Data Developer Python Scala ETL
|Job Title:||Big Data Developer Python Scala ETL|
|Salary:||£75000 - £90000 per annum + bonus + benefits|
|Contact Name:||Data Team|
|Job Published:||about 2 months ago|
Global software house that produce a high-performance, data-intensive backend software that allows the advertising sector to intelligently target ads, is seeking a Big Data Developer.
As a Big Data Developer you will be responsible for the evolution of the data platform, developing the architecture and maintaining the data platform backlog. The systems generate vast amounts data, approximately 350GB per hour, distributed over many servers. You'll be solving complex technical challenges and finding new ways to use the data to improve the product and deliver more value.
A typical day could involve coding in Python or Scala; you'll design, build and manage large batch / streaming data processing products (e.g. Spark, Storm); design, build and maintain ETL pipelines; partnering with Data Scientists and other engineers to implement and optimise complex Machine Learning algorithms and help to support / mentor more junior Data Developers / Engineers in a collaborative environment.
*Strong experience of solving complex, large scale data challenges
*Strong Python and / or Scala coding skills for data intensive systems
*Hands-on implementation and architectural familiarity with streaming data, relational and non-relational databases, orchestration frameworks (e.g. Luigi, Airflow or Oozie) and distributed processing technologies (e.g. Spark)
*Familiar with cloud based services - AWS, GCP
*Good working knowledge of Linux
*Collaborative team member, keen to learn and share knowledge with others
As a Big Data Developer you will earn a competitive salary (to £90k) plus bonus and benefits.
Apply now or call for a confidential discussion about this Big Data Developer opportunity.
Sorry, this job post it's no longer available
Data Warehouse Developer ETL T-SQL
Salary: £45000 - £50000 per annum + benefits
Data Warehouse Developer SQL Python
Salary: £500 - £650 per day
Big Data Developer - Finance Software
Salary: £80000 - £95000 per annum + benefits
Big Data Engineer HBase Phoenix
Salary: £600 - £700 per day
Senior Big Data Engineer - FinTech
Salary: £85000 - £100000 per annum + benefits