Senior Data Engineer

This job has now expired please search on the home page to find live IT Jobs.

Data Engineer - Fully Remote - Up to £90K Are you passionate about data? Would you be excited about building cloud first data platforms, potentially processing and storing terabytes of data, enabling businesses to make better decisions? Are you a quick learner and into working with cutting-edge technologies? If so, let's talk!I am looking for an experienced Data Engineer to design, implement and maintain modern cloud data platforms at scale utilising both Google Cloud Platform and open source services. This is an opportunity to work with a world leader in data and machine learning technologies.You'll work alongside a great GCP Engineering team (Data Engineers, Platform Engineers, Cloud Architects, Software Engineers), taking full ownership of your tasks and responsibilities, with opportunities to do back-end, front-end and infrastructure development.If you have an interest in working on innovative projects with cutting edge technology using Google Cloud Platform, this job could be a great opportunity for you.*Please Note: Previous experience with GCP is not a prerequisite; experience of other public cloud providers (AWS or Azure) would be sufficient. What you'll do:Work with customers to translate requirements into technical designs and follow this through to delivery of the solution. You will be able to design highly available, complex data platforms, and mentor others to be able to do so.Advise customers on modern approaches to data engineering and the best approach to solve their unique problems.Establish yourself as a trusted advisor and reliable point of contact for customers.Understand customer data structures and transformation requirements to build suitable solutions on Google Cloud Platform.Design, plan and build highly available, global and cloud native data platforms.Take the lead on technical projects, i.e be the technical point of escalation for more junior Engineers and engage regularly with the customer during the delivery of the solution.Develop internal tooling and improve processes for the wider team and business.Create engaging technical content to promote CTS and Google Cloud products and services (e.g. case studies and thought pieces).

Key Skills:

Extensive commercial experience in the area of data engineering or machine learning.Confident communicator both written and verbally.Extensive hands-on experience with at least one major cloud provider (GCP, AWS, Azure), including the use of their data related components to build solutions.Experience designing and building large data architectures.Strong experience building ETL / ELT pipelines, Data Lakes and Data Warehouses.Significant experience in using languages like Python, R and SQL as well as Google database services like Firestore, Cloud SQL, Big Query or equivalents from other Cloud Providers.Experienced in using unit testing and CI / CD.Ability to think in abstract terms about application structures and strong understanding of security integration implications on this structure.A solid grounding working with common data modelling techniques and SQL (e.g. MS SQL, Oracle, PostgreSQL, MySQL).Working knowledge of data governance principles (e.g. data profiling, data cataloguing, managing access controls, etc.).A good understanding of some of the following:Hadoop / Spark | Apache Airflow | Apache Beam | Relational database technologies (Microsoft SQL, Oracle or PostgreSQL) | Teradata | Tensorflow | Analytical tools (Looker, Tableau, Qlik, Data Studio)

Desirable Skills:

Experience with or knowledge of Google Cloud Platform (e.g. Pub/Sub, Dataflow, BigQuery, Firestore, etc.).Experience with or knowledge of AWS (e.g. Athena, EMR, Glue, Redshift, Kinesis, etc) or Azure (e.g. Synapse, Databricks, Data Factory, Event Hub, etc.).Exposure to real time data ingestion / streaming data sources.Experience in or knowledge of working in an agile project based environment.Bachelor or Masters degree in Computer Science, Data Science or equivalent education.

Location:

This role could also be remote based in the UK or Netherlands, with occasional travel to the office and customer sites (post-Covid). There are offices in Central Manchester and Utrecht, and shared office spaces in Central London.

What you'll get:

In addition to the competitive salary, you'll get private health insurance and company contributed pensions as standard.We have a multitude of other benefits, including a market leading parental leave policies, health & wellbeing initiatives and access to a discounts and rewards programme (including discounted gym membership)You'll be invited to the bi-annual international company 'kick off' conferences, which are a great chance to meet your colleagues that you don't see everyday.