AWS Data Engineer


Premium Job From Nigel Frank International

Recruiter

Nigel Frank International

Listed on

10th January 2022

Location

City Of London

Salary/Rate

£400 - £500

Type

Contract

Start Date

ASAP

This job has now expired please search on the home page to find live IT Jobs.

Good Afternoon, I am currently working with a large consultancy of mine who have projects kick starting this month. This is a great chance to be working on a long term project for a well-established government organisation. Role - AWS Data EngineerRate - £400-£475 (Outside IR35)Contract Length - 6 months (view to extend) (Long term project)Location - RemoteStart Date - ASAPInterview Stages - 2End Client - Large Government organisation The CompanyMy client is a specialist Data and Digital Transformation consultancy focused on supporting their clients in successfully delivering on their digital transformation programmes. The aim is to ensure they deliver value from their client's data using innovative approaches that improve their data capabilities, analytics and data governance. The RoleMy client is working for high-profile clients, analysing their existing processes, identifying and implementing opportunities to optimise these processes, and developing solutions to deliver service improvements to them. Key Responsibilities:Collaborate with a multidisciplinary team to provide data business solutions, including publishing data and sharing data through file processes and APIs;Monitor and audit data quality and processes, including key performance indicators;Support live services;Support data consumers from different backgrounds: Engineers, Data Scientists, Business representatives;Munging large data sets from multiple sources, including audit data captured from digital services;Creating and productionising Jupyter notebooks;Identify, evaluate and implement external services and tools to support data processing, validation and cleansing;Summarising and enriching data sets for convenient use by consumers;Set up, maintain and improve automated data processes;Identify, evaluate and implement external services and tools to support data processing, validation and cleansing;Monitor and audit data quality and processes, including key performance indicators. Essential Requirements:Extensive experience working on relevant data engineering projectsExtensive AWS suite experienceExperience productionising ETLsComfortable working in data analysis environmentsWorking in a Lean, Agile environmentQuantitative and statistical skillsAnalytical skillsKnowledge and experience of:AWS SuitePythonScalaSQL Desirable skills / Nice to haves (Not Essential) Machine learning (ML) engineering experience, MLOpsExperience in data visualisationDevOps experienceTest-driven development (TDD)Knowledge and experience of:AirflowPrestoSparkDeequJupyter NotebooksEMRParquet formatHudi or other structural transaction layer frameworksScikit Learn / Spark MLlibTerraformIf this role sounds of any interest please contact me and send me your updated CV, from there we can discuss the role in more detail together. Kind RegardsOllie

You are currently using an outdated browser.

Please consider using a modern browser such as one listed below: