Data Engineer (Python,Hadoop)

This job has now expired please search on the home page to find live IT Jobs.

Data Engineer (Python, Hadoop)

Leeds

£35K - £50K

My client, a market leading consultancy are looking to grow their Big Data team and are looking for a Data Engineer to join their offices in Leeds. They are considering a wide range of candidates from mid-level to Senior and offer great rates of pay and excellent benefits.

THE ROLE;

You will act as the subject matter expert and go-to person within the software engineering team for Python development, Spark and the Hadoop ecosystem. You will have excellent coding skills, extensive experience in building big data environments, coupled with automated deployment and environment management practices. You will be comfortable working within a variety of client requirements, across a range of industries and help them meet their goals using your technical experience, implementation and communication skills. You'll be well versed in Agile and happy to lead standups, retrospectives, design and planning sessions.

Although not essential, you might be interested in team leadership and will relish the opportunity and challenge of building your own team within the business's Software Engineering Practice.

PROFILE

The ideal candidate will have a good mix of the following key skills;

*Hands on experience developing data solutions that use leading Hadoop distributions and big data technologies including:

*Data Storage: HDFS, HBase, Elastic, Mongo DB, Redis

*Data Processing, Analysis and Integration skills such as: Spark, Storm, Map Reduce, Tez, Kafka, StreamSets

*Search such as: Solr, Elastic Search

*Data Architecture: System design, data model design, backup/recovery strategies

*Experience in the productionisation of high availability data pipelines - ingestion, processing and performance tuning

*Strong programming skills in languages such as Python and R

*Experience with cloud-computing infrastructure such as Microsoft Azure and Amazon Web Services

*Experience with Hadoop platform security and governance

*Substantial professional experience working in a senior role within an engineering or project environment

*Experience with object-oriented design, coding and testing patterns as well as experience in engineering (commercial and open source) software platforms and large-scale data infrastructures

*Substantial knowledge and application of a broad range of skills including software, systems and enterprise architecture, software and hardware engineering, interface protocols

*Strong individual contributor and team player in a professional environment

The following skills are considered highly desirable but not essential:

*Experience in automated application and infrastructure deployment using tools such as ansible and puppet

*Have performed in a role that involves technical team management and/or mentoring of team members.

You must also have excellent communication, verbal and writing skills as well as eligibility to work in the UK

If you feel you have the necessary skills and experience and would be interested in discussing further, please send you most up to date and suitable Word CV to; [email protected]

Spring Technology is acting as an Employment Business in relation to this vacancy.

Spring Technology is an Equal Opportunities employer; we welcome applicants from all backgrounds.