Online since 1999 | 12,862 IT Jobs Live NOW

Data Engineer

Premium Job From Nigel Frank International
Recruiter: Nigel Frank International
Listed on: 11th October
Location: Leeds
Salary/Rate: £60,000 - £70,000
Type: Permanent
Start Date: ASAP

This job has now expired please search on the home page to find live IT Jobs.

AWS Data Engineer


£60,000 - £70,000 DOE

Reporting to: Chief Analytics Officer

This role arises from rapid business growth. My client's multi-tenanted, SaaS and mobile applications provide transaction processing for operational data from all customers' business and resource location minute-by-minute. Data is comprehensive, user extensible and includes customers' prospects, customers, customer correspondence, pricing, sales opportunities, orders, jobs, risk assessments, job worksheets, engineers/drivers, vehicles, stock and equipment, locations, and financial transactions. This role enables data to be assembled in a Data Lake in AWS so that business insights are available for customers and the company from exploring this data.

Role & Responsibilities

  • Design, build, maintain, test and deploy data pipelines and architectures in AWS;
  • Ensure the scalability of the data engineering architecture to meet future business demand;
  • Extract, transform and load data from multiple source systems such as SQL Server, MongoDB, Flat Files etc;
  • Performance tuning of data pipelines;
  • Ensures customers' and companies personally identifiable information (PII) and any other sensitive data is secured within the BigChange Data Lake and Data Warehouse systems;
  • Provide advice and support to other colleagues on system functionality;
  • Be aware of the latest releases of relevant technologies;
  • Manages, documents and improves data engineering processes and system records;
  • Actively attends and contributes in Agile sprint ceremonies/meetings.

Skills & Qualifications

  • 3+ years' experience in a similar data engineering role i.e. building data pipelines for either a Data Warehouse and/or a Data Lake
  • 2+ years' experience using Python
  • 2+ years' experience of using AWS cloud computing services
  • 1+ years' experience using Linux or Unix
  • Strong experience using SQL for querying data in any relational database
  • Writes clear and concise technical documentation including run-books, play-books, specifications, software component designs and test cases with due regard for the knowledge and skill levels of the target readers
  • Approachable and friendly to developers, support staff, business colleagues and customers, a trusted source of technical advice to others in the company
  • Agile development approach with due regard for configuration management, specification/documentation, review and testing.
  • Technically strong, with recent hands-on experience
  • An ability to advise senior stakeholders, work comfortably without definition and apply a progressive technical approach to any problem