Data Engineer
Recruiter
SidTech
Listed on
25th March 2021
Location
London
Salary/Rate
£500 - £500
Type
Contract
Start Date
2021-03-25 00:00:00
This job has now expired please search on the home page to find live IT Jobs.
Job Title:Data EngineerInside IR35 Location:London Job Purpose and primary objectives: The candidate will work in an agile way integrated with the Cloud Data Engineering project like deve loping AWS Data lake, developing AWS Glue ETL jobs, data quality automation developing AWS EMR data processing services. we will be developing an end-end event-driven serverless data pipeline. Key responsibilities (please specify if the position is an individual one or part of a team): Cloud Data Engineer proficient in Python programming, and ideally with experience implementing Python data processing applications, and with Software engineering skills required with CI/CD (Jenkins, N
exus, etc.) required to be part of the Data Engineering function for the bank. AWS Cloud Big data
services experience like ( AWS MSK, S3, AWS GLUE, AWS EMR, AWS Data Lake formation. AWS EKS& Lambda) The candidate will perform the following functions as part of the Data Engineering team: -
1. Software development with python with AWS boto3, aws S3, aws glue , EMR and develop Scala program for data ingestion and data processing,
2. Create data pipelines to process AWS big data sets sitting in the aws S3 , HDFS. - Be able to help with the mapping and analysis of customer and financial data.Key Skills/Knowledge: ? Cloud Data Engineer proficient in Python programming, and ideally with experience implementing Pytho ? n data processing applications, and with Software engineering skills required with CI/CD (Jenkins, N ? exus, etc.) required to be part of the Data Engineering function for the bank. AWS Cloud Big data ? services experience like ( AWS MSK, S3, AWS GLUE, AWS EMR, AWS Data Lake formation. AWS EKS& Lambda) Experience required: - Intermediate Python and SQL knowledge - Hands-on experience architecting and implementing the data analytics solutions in Amazon aws cloud - Strong communication skills - Background Working with Agile development methodologies (E.g., SAFe) - Certification aws - Associate level or above. aws data/analytics specialty Certification preferred Duration of the Assignment:1 Year
