Job Description
As a Database Developer you will be working with large, messy datasets, transforming them into useable, structured, maintainable resources and carrying out data assessment on new data from a variety of sources (including cargo ships across the globe). You'll design and implement ETL data pipelines for receiving and transforming data and be responsible for variable re-structuring, pre-processing and transformation across a wide range of data sources and databases. You'll be working with Big Data tools and technologies (e.g. Spark, NiFi, Airflow) to effectively manage the data ingest process and be responsible for validation and monitoring of various aspects of Data Quality.
You'll be based in modern offices in South East London with Nintendo and casual dress code; easily commutable to mainline stations.
Requirements:
*Strong Python coding ability
*Experience of building ETL Data Pipelines
*Experience with at least one Cloud based platform (AWS, Azure, Google Cloud Platform)
*Data processing experience using Apache Spark, Hive / Pig or similar tools
*Good knowledge of Linux OS, command line and bash scripting
*Collaborative with good communication skills
As a Database Developer you will earn a competitive salary (to £70k) plus benefits including employee share scheme, 25 days holiday, generous pension contribution, training and development budget, Friday tech talks and more.
Apply now or call to find out more about this Database Developer (Python ETL Cloud) opportunity.
