Job Description
As a Data Engineer you will collaborate with a small team responsible for delivery of the platforms' data and analytics service supporting Machine Learning. You will be building ETL pipelines to integrate their platform with clients MDM applications. You'll be working with Spark, Hive, Flink, AWS, RDS, Apache Airflow and containerised applications using Kubernetes and Docker.
Based in modern, open plan offices in Victoria or Canary Wharf with all the latest kit; you can enjoy a well-stocked kitchen / canteen area and a highly motivated team atmosphere with flexible working opportunities.
Requirements:
*Indepth knowledge of Spark, Hive and ideally familiar with Flink
*Experience of working with AWS, RDS, Apache Airflow
*Experience of building ETL pipelines
*Good knowledge of containerised application development and container orchestration systems such as Kubernetes and Docker
*Collaborative with good communication skills
Apply now or call to find out more about this contract Data Engineer opportunity.
Job Role: Data Engineer (ETL Spark Hive AWS Airflow); Location: Data Engineer (ETL Spark Hive AWS Airflow); Rate: £550 to £650 p/day; Term: 6 months; Start: Immediate
