Senior Data Engineer

This job has now expired please search on the home page to find live IT Jobs.

Data Engineer - Remote - up to £90K The role:

Work with customers to translate requirements into technical designs and follow this through to delivery of the solution. You will be able to design highly available, complex data platforms, and mentor others to be able to do so.Advise customers on modern approaches to data engineering and the best approach to solve their unique problems.Establish yourself as a trusted advisor and reliable point of contact for customers.Understand customer data structures and transformation requirements to build suitable solutions on Google Cloud Platform.Design, plan and build highly available, global and cloud native data platforms.Take the lead on technical projects, i.e be the technical point of escalation for more junior Engineers and engage regularly with the customer during the delivery of the solution.Develop internal tooling and improve processes for the wider team and business.Create engaging technical content to promote CTS and Google Cloud products and services (e.g. case studies and thought pieces). What we're looking for:

Extensive commercial experience in the area of data engineering or machine learning.Confident communicator both written and verbally.Extensive hands-on experience with at least one major cloud provider (GCP, AWS, Azure), including the use of their data related components to build solutions.Experience designing and building large data architectures.Strong experience building ETL / ELT pipelines, Data Lakes and Data Warehouses.Significant experience in using languages like Python, R and SQL as well as Google database services like Firestore, Cloud SQL, Big Query or equivalents from other Cloud Providers.Experienced in using unit testing and CI / CD.Ability to think in abstract terms about application structures and strong understanding of security integration implications on this structure.A solid grounding working with common data modelling techniques and SQL (e.g. MS SQL, Oracle, PostgreSQL, MySQL).Working knowledge of data governance principles (e.g. data profiling, data cataloguing, managing access controls, etc.)A good understanding of some of the following:Hadoop / Spark | Apache Airflow | Apache Beam | Relational database technologies (Microsoft SQL, Oracle or PostgreSQL) | Teradata | Tensorflow | Analytical tools (Looker, Tableau, Qlik, Data Studio)