Senior Data Engineer
Recruiter
Intec Select
Listed on
11th May 2022
Location
London
Salary/Rate
£600 - £700
Type
Contract
Start Date
2022-05-11 00:00:00
This job has now expired please search on the home page to find live IT Jobs.
*Outside Contract* AWS Data Engineer - £600 - £700 PD - 12 Months - Oil & Gas - Fully RemoteOverview:
A FTSE100 Oil & Gas organisation are looking for an experienced AWS Data Engineer to join one of their growing teams in London on a fully remote basis.
Role & Responsibilities:
Drive the vision for modern data platform to deliver well architected and engineered data and analytics products leveraging AWS cloud tech stack and third party products.
Collaborate with multiple internal and external teams to align appropriate integration of functions to meet goals, and identify necessary enhancements needed to deploy new products.
Architect, Design and publish multiple integrations (acquisition and ingestion) and data transformation patterns and serve data as a centralized capability for use/re-use across the product family.
Publish standardized approach and methodology tailored to business needs for varying stages of data lifecycle management.
Develop standards for coding, testing, debugging, and implementation to build production-grade solutions.
Define the processes that need in place for operational excellence and high system reliability.
Provide in-depth exploration with interpretive thinking to define issues and develop innovative solutions.
Manage one or more Applications Development teams in an effort to accomplish established goals.
Adopt and enhance quality gates implementation across projects to ensure projects deliver in-line with the overall strategic Architecture blueprint.
Liaise with managing internal & external data providers, and risk associated with it.
Role Requirements:
Strong hands-on experience architecting Big Data integration and data transformation design patterns solutions leveraging AWS tech stack and third party products.
Very strong hands on development skills with Python.
Expertise with at least one distributed data processing framework e.g. Spark (Core, Streaming, SQL), Storm, Flink etc.
Knowledge of the pros and cons of various database technologies like Relational, NoSQL, MPP, Columnar databases.
Experience in designing solutions across a diverse range of data sources and handling structured, semi-structured, and unstructured datasets including spatial and sensor data.
Working knowledge of DevOps capabilities to support deliver data capabilities, driven by code versioning, CI/CD processes implementation, release management leveraging AWS DevOps stack.
Working practitioner with AGILE development, SCRUM and Application Lifecycle Management to deliver at a rapid pace.
Rate & Duration:
£700 Outside.
12 Months
*Outside Contract* AWS Data Engineer - £600 - £700 PD - 12 Months - Oil & Gas - Fully Remote
