Job Description
As a Big Data Engineer you will collaborate with a small team responsible for delivery of the platforms' data and analytics service supporting Machine Learning. You will be building ETL pipelines to integrate their platform with clients MDM applications. You'll be working with Spark, Hive, Flink, AWS, RDS, Apache Airflow and containerised applications using Kubernetes and Docker.
Based in modern, open plan offices in Victoria or Canary Wharf with all the latest kit; you can enjoy a well-stocked kitchen / canteen area and a highly motivated team atmosphere with flexible working opportunities.
Requirements:
*Indepth knowledge of Spark, Hive and ideally familiar with Flink
*Experience of working with AWS, RDS, Apache Airflow
*Experience of building ETL pipelines
*Good knowledge of containerised application development and container orchestration systems such as Kubernetes and Docker
*Collaborative with good communication skills
Apply now or call to find out more about this contract Data Engineer opportunity.
Job Role: Big Data Engineer (Spark Hive AWS ETL Airflow); Location: London; Rate: £550 to £650 p/day; Term: 6 months; Start: Immediate
