Hadoop Developer

This job has now expired please search on the home page to find live IT Jobs.

Hadoop Developer

Manchester

£32,816-£40,322Our client based in Manchester are searching for a Hadoop developer for a 23 month Fixed Term Contract.The organisation is investing heavily in a new Data Lake capability to underpin its needs for Analytics and Operational Reporting. Their aim is to provide users across the Organisation with a modern, scalable and future proofed platform to support the Organisations strategic goals across all areas of the business.The successful candidate will work within the team building (and eventually supporting) a new strategic Hadoop big data solution for the organisation. They are looking for someone who wants to take the knowledge they have already gained in this area and grasp the opportunity help the organisation extend its Data Lake capability, taking on design and development responsibilities.Essential role requirements:

* Experience of working with Data Lake technologies, ideally a mixture of Hadoop components including Sqoop, Hive, Spark and Impala.

* Experience in modelling data for the purposes of analytics including the definition star schemas (Kimball methodology).

* Experience in the use of graphical ETL tools. Ideally this would be with Talend, although experience of similar tools such as Informatica would be considered.

* Experience of writing SQL and performing SQL performance tuning

* Experience of producing design documentation and specificationsDesirable:

* Experience in one of more of Java, Python, R and Scala, ideally within the context of Spark and Spark MlLib

* An understanding of how to architect and maintain Hadoop clusters with knowledge of Cloudera Manager

* Experience of working in a dev/ops environment and experience of agile frameworks such as Scrum

* Experience of data modelling toolsets such as Sparx EA

* Exposure to, or experience to, data mining and machine learning.

* Exposure to Oracle Warehouse Builder and PL/SQL