AWS Cloud Data Architect / AWS Data Engineer, London, Hybrid


Premium Job From Nigel Frank International

Recruiter

Nigel Frank International

Listed on

28th May 2022

Location

London

Salary/Rate

£80000 - £130000

Type

Permanent

Start Date

ASAP

This job has now expired please search on the home page to find live IT Jobs.

AWS Cloud Data Architect / AWS Data Engineer, London, up to £130,000 - Remote/Hybrid - Spark, Data Bricks, Data Lakes, Big Data Solutions, Lambda, Terraform, AWSMy client is looking for a talented and motivated AWS Data Architect/AWS Data Engineer who has good experience in owning and developing big data solutions and data lake projects.You will be required to handle day to day conversations with the implementation partner, and be a senior AWS Technical resource, to carry out the design phase and then the implementation - understanding the pitfalls, getting into the nuts and bolts, Lambda, systems, and entire process end to end. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's data lake initiatives, as they provide increasing numbers of services to consumers across multiple digital channels.You will be driving improvements in the current design, processes & implementation to improve operational management, scalability, and extensibility.Essentials Skills/Requirements· 5+ years of work experience with ETL, Data Modeling, and Data Architecture.

· Expert-level skills in writing and optimizing SQL.

· Experience with Big Data technologies such as Hadoop/Hive/Spark.

· Solid Linux skills.

· Experience operating very large data warehouses or data lakes.

· Expertise in ETL optimization, designing, coding, and tuning big data processes using Apache Spark or similar technologies.

· Experience with building data pipelines and applications to stream and process datasets at low latencies.

· Show efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data.

· Sound knowledge of distributed systems and data architecture (lambda)- design and implement batch and stream data processing pipelines, knows how to optimize the distribution, partitioning, and MPP of high-level data structures.

· Knowledge of Engineering and Operational Excellence using standard methodologies.

Salary: Up to £130,000+ package Location: London (3 days in the office per week)If you are interested and meet the above requirements please apply immediately.

You are currently using an outdated browser.

Please consider using a modern browser such as one listed below: