Big Data Engineer

This job has now expired please search on the home page to find live IT Jobs.

I am current looking for a Big Data Engineer to join one of the largest data science companies in the Pharma and life sciences industries.

You will be working in a team of highly talented Engineers and Data Scientists. Your main responsibility will be to write highly performant and scalable code that will run on top of our Big Data platform (Spark/Hive/Impala/Hadoop). In addition, you will be working closely with the Data Science team to support them in the ETL process (including the cohorts building efforts).

A typical day might include:

* Working in a cross-functional team - alongside talented Engineers and Data Scientists

* Building scalable and high-performant code

* Mentoring less experienced colleagues within the team

* Implementing ETL and Feature Extractions pipelines

* Monitoring cluster (Spark/Hadoop) performance

* Working in an Agile Environment

* Refactoring and moving our current libraries and scripts to Scala/Java

* Enforcing coding standards and best practices

* Working in a geographically dispersed team

* Working in an environment with a significant number of unknowns - both technically and functionally.

Ideal experience:

* BSc or MSc in Computer Science or related field

* Strong analytical and problem-solving skills with personal interest in subjects such as math/statistics, machine learning and AI

* Solid knowledge of data structures and algorithms

* Experience working in an Agile environment using Test Driven Development (TDD) and Continuous Integration (CI)

* Experience refactoring code with scale and production in mind.

Our ideal candidate: Tech Skills

* Proficient in Scala, Java and SQL

* Strong experience with Apache Spark, Hive/Impala and HDFS

* Familiar with Python, Unix/Linux, Git, Jenkins, JUnit and ScalaTest

* Experience with integration of data from multiple data sources

* Experience with NoSQL databases, such as HBase, Cassandra, MongoDB

* Experience with any of the following distributions of Hadoop - Cloudera/MapR/Hortonworks.

This is a fantastic opportunity to join world-renowned company; in return, they can offer you a competitive salary and a great benefits package including £5,000 car allowance and 15% bonus.

If you would like to find out more regarding this fantastic opportunity, please get in touch ASAP!

To find out more about Computer Futures please visit www.computerfutures.com

Computer Futures, a trading division of SThree Partnership LLP is acting as an Employment Agency in relation to this vacancy | Registered office | 1st Floor, 75 King William Street, London, EC4N 7BE, United Kingdom | Partnership Number | OC387148 England and Wales