Senior Data Engineer (London)


Premium Job From Nigel Frank International

Recruiter

Nigel Frank International

Listed on

9th November 2022

Location

London

Salary/Rate

£60000 - £85000

Type

Permanent

Start Date

ASAP

This job has now expired please search on the home page to find live IT Jobs.

Data Engineer Hybrid, London Based I am working with one of the largest telecommunication companies in Europe, turning over roughly £400,000 per year. Looking for Data engineers to work on greenfield projects working with big data and working on end-to-end solutions projects.I am looking for an experienced data engineer responsible for the design, development, and maintenance of applications. You will be working alongside other engineers and developers working on different layers of the infrastructure. Therefore, a commitment to collaborative problem-solving, sophisticated design, and the creation of quality products are essential.Ideal Skill setDataLakesPySparkSQLAzure/AWSPythonDatabricksAgile Role & ResponsibilitiesCollaborate with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines so that data is shared effectively across various business systems.Build ETL/ELT and Ingestion pipelines and design optimal data storage and analytics solutions using cloud and on-perm technologies.Ensure the design, code and procedural aspects of the solution are production ready, in terms of operational, security and compliance standards.Participate in day-to-day project and product delivery status meetings, and provide technical support for faster resolution of issues.Skills and ExperienceDemonstrable design & development experience and experience with big data technologies like Spark/Flink and KafkaProficient in Python, PySpark, or Java/Scala.

Hands-on experience with some of the following technologies:Azure/AWS - Data Lake ProjectsSQLETL/ELTDatabricksSpring/Guice or any other DI framework,RESTful Web Services.Proficient in querying and manipulating data from various DB (relational and big data).Experience of writing effective and maintainable unit and integration tests for ingestion pipelines.Experience of using static analysis and code quality tools and building CI/CD pipelines. Jefferson Frank is the Amazon Web Services (AWS) recruiter of choice. We work with organizations worldwide to find and deliver the best AWS professionals on the planet. Backed by private equity firm TPG Growth, we have a proven track record servicing the AWS recruitment market and, to date, have worked with over 30,000 organizations globally.

You are currently using an outdated browser.

Please consider using a modern browser such as one listed below: