Data Engineer

This job has now expired please search on the home page to find live IT Jobs.

If you enjoy working with the latest developments in data engineering and want to deliver work that protects consumers and makes a real impact on society, then you will be interested in this exciting opportunity to join the expanding Data, Technology and Analytics (DaTA) unit at the Competition and Markets Authority (CMA).

The CMA is a world-leading competition authority at the forefront of tackling pressing public policy questions, including the regulation of the biggest data and technology markets.

As a Data Engineer in the DaTA unit, you will be part of a small sub-team which is critical in designing and managing our analytical infrastructure and supporting the delivery of our most technically challenging projects. You will be given time and support for study and development and will be expected to spend much of your time in hands-on technical work. However, you will also be expected to make architectural and product-level decisions in some instances and should feel comfortable engaging with internal stakeholders to make sure that we are building the right things.  

You will be working across all levels of the tech stack, but with a focus on backend, infrastructure, orchestration, and data. You may be working on orchestrating a pipeline to handle and run machine learning models on millions of incoming documents or discussing with the Data Scientists how to handle model and data versioning in the same situation. You could be leading on a project and making architectural design decisions or engaging with other teams to make sure we have understood their needs correctly. You might be using Spark libraries for probabilistic data linkage across large datasets or working on containerising the Spark environment for doing that linkage as part of a regular ingestion job. All of these, and many other things, are happening in a modern tech stack, mostly in AWS, based around JupyterHub, Docker and serverless Python.

A master's degree in a quantitative or computer science subject or equivalent experience gained working in data engineering, data science or development in the public cloud is essential. Equally important is experience of writing code, including Python, to work with large and messy datasets, ideally using cloud services such as AWS, Azure or Google Cloud. You will also need a proven interest in learning about and understanding the latest methods and technologies within data science and engineering.

This is an opportunity to join a dynamic, supportive team working across a range of interesting technologies. We are looking for potential as much as experience, so if the above sounds exciting but daunting please do still apply.

In return the CMA is a hugely rewarding, diverse and stimulating place to work - an opportunity to work for the public good and to stretch and develop yourself in doing so. All CMA staff enjoy generous benefits, including an excellent pension scheme, at least 25 days leave (increasing to 30 over five years), and generous maternity/paternity leave provision. You can also take advantage of interest-free season ticket loans, a cycle to work scheme, childcare vouchers, and favourable consideration of flexible working.

To find out more about this opportunity and about working for the CMA, please click on the APPLY button.

Closing date for applications: 11:55 pm on 20 June 2022.

The CMA are an accredited Disability Confident Employer, and we are an equal opportunities employer, welcoming suitably qualified applicants from all backgrounds.

We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles.