Big Data Developer (Hadoop) - Java - SQL - Agile/Scrum - Security Cleared

This job has now expired please search on the home page to find live IT Jobs.

Big Data Developer (Hadoop) required for a leading global security company with offices in London. Mu client has an immediate opportunity for an experienced big data engineer/ developer in building data pipelines and processing high volumes of data. Successful candidates will work within exciting and prominent programmes and be asked to support the team in Scrum/Agile development. Engineers will perform design of mission critical products, whilst supporting the pursuit of new business.

You will hold the following key responsibilities:

** Will design, develop, test and integrate quality software

** Has experience of building Hadoop data pipelines in production environments

** Has a strong understanding of data structures and algorithms relevant to processing high volumes of data

** Has an understanding of data governance, security and audit requirements

Key Criteria Required:

Experience in software development using:

** Java and use of object oriented design

** Spark (Batch & Streaming)

** SQL

** HDFS

** Soir

** Scala

** Experience or knowledge of Agile / Scrum methodologies

** Applicants must be able to hold and maintain UK Government clearances

We would also love it if you have:

** Knowledge or experience various open source products, for example: Apache Foundation products

Experience with:

** NiFi

** Python

** Lucene index/ query strategies

Production experience of:

** NLP/ Image processing

** Hbase

** Kafka

** Experience of using Atlassian Jira/ IBM RTC suite, or similar product lifecycle software packages

**Experience of UK Government working practices

Candidates must hold an active DV security clearance/

Please note your CV will not be submitted for this or any other role without your prior approval.

SQ Computer Personnel Limited acts as both an Employment Agency and Employment Business.