Online since 1999 | 10,260 IT Jobs Live NOW

Senior Data Engineer

Premium Job From Gazprom Energy
Recruiter: Gazprom Energy
Listed on: 16th December 2021
Location: Manchester
Salary Notes: Competitive
Type: Permanent

This job has now expired please search on the home page to find live IT Jobs.

ABOUT US

Our History

We began our journey as an ambitious, independent gas supplier in the North West of England, Pennine Natural Gas. Since joining the Gazprom Group in 2006 and beginning our transformation as Gazprom Energy we have gone from strength to strength, always reaching for better, to become one of the leading B2B gas suppliers in the UK and expanding into France and Netherlands. We now supply gas, power and environmental products to thousands of business customers across Europe.

Manchester is home to our European headquarters and our locations are united by our ethos: making customers happy, doing the basics brilliantly and finding new ways to go above and beyond their expectations.

Our Future 

The energy world is ever changing, driven by forces of decarbonisation, competition, digitalisation and shifting customer expectations. Our strategy equips us to expertly seize the opportunities present in these big advancements.

We are growing in Electricity, in Green and in Gas. We're strengthening our foundations - placing data and technology at the heart of our business model.  Gazprom Energy is a place where you can be yourself. We are friendly, enthusiastic and purposeful. We encourage everyone to have a learning mindset, challenge respectfully, have a bias for action and to make evidence-based decisions.  You can expect to receive a valuable mix of challenge and support for your role, your wellbeing and ambitions.

Since 2012 we have been accredited with the Investors in People Gold standard and Ecovardis Silver accreditation this year. We pride ourselves in providing an inclusive home for a diverse group of highly talented individuals.

ROLE OBJECTIVES

The Data Engineering team spends most of its time building/maintaining a Python infrastructure which is used throughout the COD/Risk departments. A key focus of the team is building/maintaining Python models for the Forecasting department. The production of demand forecasts is relatively complex and includes management/transformation of large datasets and machine learning

The Senior Data Engineer will mainly spend their time doing project work, such as re-building specific steps/modules ; around 20% of their time will be around maintaining the existing codebase, ensuring that the code has run successfully (resolving when there has been an error), and supporting reasonable requests from the business for example an ad-hoc forecast or providing data.

The Senior role indicates that the Engineer will take ownership for the design and implementation of projects, and will support junior Engineers in gaining familiarity/competence with the codebase. The Senior also indicates a higher expectation for technical competence/delivery than the Data Engineer role.

 

DUTIES & RESPONSIBILITIES

Around 80% of your time is expected to be spent on project work. Project accountabilities include:

  • Working with your team/manager/external stakeholders to identify & prioritize projects. In the next 18 months your projects are likely to be focused on re-building the infrastructure for the Forecasting models. For example, you build a "global issuer" or help us to use a cloud-based platform to fit our machine-learning models
  • Project planning, and design. You will normally be expected to complete a simple design/methodology document, and a simple timeline as part of the project
  • Implement/complete the project, including testing. Keep your team/manager updated about progress, particularly if there are delays/issues
  • Support junior engineers where appropriate

Day-to-day BAU/maintenance includes:

  • Checking that all the forecasts/reports have run as expected. Investigate/resolve where there are errors
  • Supporting wider team/python userbase in deploying code, reviewing new code/pull requests
  • Infrastructure upgrades such as migrating our hard drive, upgrading/replacing in-house servers, and upgrading Python (e.g. 3.6 -> 3.8)
  • Managing/maintaining our Data Access pipelines, adding new data sources from APIs / new file flows where relevant
  • Managing/maintain the tools used for the monitoring and analysis of internal data sets and automated processes
  • Supporting the Data Scientists in their research, and to implement new machine-learning models
  • Liaise with stakeholders in the wider business to help improve data quality, advise on data strategy

and understand existing processes

  • To be aware of and comply with all company policies and procedures, including but not limited to the Gazprom Energy Data Protection policy, Equal Opportunities policy, and the Email and Internet Acceptable Usage Policy, in addition to Fire and Health and Safety Regulations.
  • The role holder may also be required to carry out any other duties within the scope and purpose of this role as requested by their line manager and in line with business needs.

 

You will be using Python and GIT

 

SKILLS & COMPETENCIES

Skills

  • Strong programming in Python
  • Application design & analysis
  • Codebase management, including GIT and documentation
  • Strong maths, with intermediate understanding of regression/clustering

Desirable: Expertise/experience of machine-learning, and working with data scientists

 

Competencies

  • Organization
  • Defining goals
  • Training/coaching/developing team
  • Communication (with engineers, with business users)
  • Motivating people
  • Work ethic, attention to detail

 

EXPERIENCE

  • Ability to work well within a team of Data Engineers while also being able to take on individual responsibilities where required.
  • Eagerness to learn newly emerging technologies and methodologies.
  • Knowledge of a Data Engineer's key roles and responsibilities and how they fit within a wider team of developers.
  • Ability to write clear process documentation for their own work for the purposes of sharing knowledge within the team.

 

EDUCATION

  • Educated to degree level or equivalent qualification in either Computer Science, Software Engineering or relevant STEM field