Data Engineer


Premium Job From Nigel Frank International

Recruiter

Nigel Frank International

Listed on

11th October 2021

Location

Leeds

Salary/Rate

£60000 - £70000

Type

Permanent

Start Date

ASAP

This job has now expired please search on the home page to find live IT Jobs.

AWS Data EngineerLeeds/Remote£60,000 - £70,000 DOEReporting to: Chief Analytics Officer This role arises from rapid business growth. My client's multi-tenanted, SaaS and mobile applications provide transaction processing for operational data from all customers' business and resource location minute-by-minute. Data is comprehensive, user extensible and includes customers' prospects, customers, customer correspondence, pricing, sales opportunities, orders, jobs, risk assessments, job worksheets, engineers/drivers, vehicles, stock and equipment, locations, and financial transactions. This role enables data to be assembled in a Data Lake in AWS so that business insights are available for customers and the company from exploring this data.

Role & ResponsibilitiesDesign, build, maintain, test and deploy data pipelines and architectures in AWS;Ensure the scalability of the data engineering architecture to meet future business demand;Extract, transform and load data from multiple source systems such as SQL Server, MongoDB, Flat Files etc;Performance tuning of data pipelines;Ensures customers' and companies personally identifiable information (PII) and any other sensitive data is secured within the BigChange Data Lake and Data Warehouse systems;Provide advice and support to other colleagues on system functionality;Be aware of the latest releases of relevant technologies;Manages, documents and improves data engineering processes and system records;Actively attends and contributes in Agile sprint ceremonies/meetings.

Skills & Qualifications3+ years' experience in a similar data engineering role i.e. building data pipelines for either a Data Warehouse and/or a Data Lake2+ years' experience using Python2+ years' experience of using AWS cloud computing services1+ years' experience using Linux or UnixStrong experience using SQL for querying data in any relational databaseWrites clear and concise technical documentation including run-books, play-books, specifications, software component designs and test cases with due regard for the knowledge and skill levels of the target readersApproachable and friendly to developers, support staff, business colleagues and customers, a trusted source of technical advice to others in the companyAgile development approach with due regard for configuration management, specification/documentation, review and testing.Technically strong, with recent hands-on experienceAn ability to advise senior stakeholders, work comfortably without definition and apply a progressive technical approach to any problem

You are currently using an outdated browser.

Please consider using a modern browser such as one listed below: