|Recruiter:||Nigel Frank International|
|Listed on:||28th May|
|Salary/Rate:||£80,000 - £130,000|
AWS Cloud Data Architect / AWS Data Engineer, London, up to £130,000 - Remote/Hybrid - Spark, Data Bricks, Data Lakes, Big Data Solutions, Lambda, Terraform, AWS
My client is looking for a talented and motivated AWS Data Architect/AWS Data Engineer who has good experience in owning and developing big data solutions and data lake projects.
You will be required to handle day to day conversations with the implementation partner, and be a senior AWS Technical resource, to carry out the design phase and then the implementation - understanding the pitfalls, getting into the nuts and bolts, Lambda, systems, and entire process end to end.
You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's data lake initiatives, as they provide increasing numbers of services to consumers across multiple digital channels.
You will be driving improvements in the current design, processes & implementation to improve operational management, scalability, and extensibility.
· 5+ years of work experience with ETL, Data Modeling, and Data Architecture. · Expert-level skills in writing and optimizing SQL. · Experience with Big Data technologies such as Hadoop/Hive/Spark. · Solid Linux skills. · Experience operating very large data warehouses or data lakes.
· Expertise in ETL optimization, designing, coding, and tuning big data processes using Apache Spark or similar technologies. · Experience with building data pipelines and applications to stream and process datasets at low latencies. · Show efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data. · Sound knowledge of distributed systems and data architecture (lambda)- design and implement batch and stream data processing pipelines, knows how to optimize the distribution, partitioning, and MPP of high-level data structures. · Knowledge of Engineering and Operational Excellence using standard methodologies.
Salary: Up to £130,000+ package
Location: London (3 days in the office per week)
If you are interested and meet the above requirements please apply immediately.
Contact Name: Shary Malik
Reference: TJ/3086/SM 298384_1653728421
Job ID: 3096263