Data Engineer

This job has now expired please search on the home page to find live IT Jobs.

DATA ENGINEER:

The role will involve working across a mix of traditional RDBMS, Big Data and new open source platforms with a range of tools and technologies. We're looking for a mix of technical generalists and data specialists. For us it's more about the person and the character than the role. We need people that will get excited about taking us to the next stage of our evolution helping us with their specific skills and experience but learning new ones along the way.

This is a hands-on position, you'll be working closely with Data Scientists to help maintain and grow a highly scalable, secure and performant data platform solution. To ensure continued access, understanding of our data in a available, accurate, trusted and timely manner.

You will play an active role in leveraging the wider "data lake" to maximise the reach and quality of our fraud detection activities. You will be responsible for providing support to the data and insights platform to help drive its decision-making using a mixture of well-known and emerging tools

Key Responsibilities

As Data engineer, your skills will include:

* Analytics, modelling or software development experience including coding/software development skills

* Experience of Python, Java.

* Experience in using a data warehouse with good working knowledge of SQL is also preferred

* SQL skills and knowledge of RDBMS technologies

* Experience in Big Data Engineering environments

* Experience working in an Agile Scrum environment.

* Experience in debugging and solving problems which occur in production Big Data environment.

* An understanding of and experience of applying machine learning methods and Big Data technologies.

* Familiarity with Hadoop

* Programming and data engineering skills

* Knowledge of the key numerical, analytical and machine learning libraries

* Knowledge of Apache Spark (essential), Hadoop.

* Java development working with solutions using Hadoop framework that includes the following tools, Spark, Kafka and HDFS.

* Excellent written, verbal, and documentation skills required.

* Strong Analytical skills, decisive and team player