Online since 1999 | 6,144 IT Jobs Live NOW

Data Engineer Python ETL Cloud

Premium Job From Client Server
Recruiter: Client Server
Listed on: 2nd January
Location: SE1 9RS
Salary/Rate: £60000 - £70000
Type: Permanent

This job has now expired please search on the home page to find live IT Jobs.

Data Engineer (Python ETL Cloud). Would you like to work on complex and interesting systems that provide daily challenges; collaborate with a friendly and upbeat team and improve your skills whilst enjoying a good work / life balance? You could be joining a scale-up InsureTech software house, advancing your career and enjoying perks such as flexible working and a relaxed environment.
As a Data Engineer you will be working with large, messy datasets, transforming them into useable, structured, maintainable resources and carrying out data assessment on new data from a variety of sources (including cargo ships across the globe). You'll design and implement ETL data pipelines for receiving and transforming data and be responsible for variable re-structuring, pre-processing and transformation across a wide range of data sources and databases. You'll be working with Big Data tools and technologies (e.g. Spark, NiFi, Airflow) to effectively manage the data ingest process and be responsible for validation and monitoring of various aspects of Data Quality.
You'll be based in modern offices in South East London with Nintendo and casual dress code; easily commutable to mainline stations.
Requirements:

Strong Python coding ability
Experience of building ETL Data Pipelines
Experience with at least one Cloud based platform (AWS, Azure, Google Cloud Platform)
Data processing experience using Apache Spark, Hive / Pig or similar tools
Good knowledge of Linux OS, command line and bash scripting
Collaborative with good communication skills

As a Data Engineer you will earn a competitive salary (to £70k) plus benefits including employee share scheme, 25 days holiday, generous pension contribution, training and development budget, Friday tech talks and more.
Apply now or call to find out more about this Data Engineer opportunity.