Big Data Developer (SC / DV Cleared)

This job has now expired please search on the home page to find live IT Jobs.

Big Data Developer (SC / DV Cleared), Hadoop, Design Document, data modelling, Map Reduce, Java, Python, Micro services, Elasticsearch, ETL, JSM, Git, Jenkins, Bash Scripting, JSON, XML, Relational, Schema, Data Transformation, Amazon, AWS, SOAP, REST, Linux, data access, data integration, data visualisation, text mining, data discovery, statistical methods, database design, implementation, TOGAF, EASE, Big Data, SC CLearance, SC Cleared, DV Clearance, DV Cleared, Kafka, Apache Nifi, Big Data, Hadoop, HBase, Graph Database Big Data Developer to support the Government's transformation to a Common Data Platform

Our Central Government client based in London are recruiting for an SC or DV Cleared Big Data Developer.

The specialist will be required to work in the data migration team to identify source data requirements, assess data quality, map and specify the required transformations from the source to the target data, validate and perform trial data migration in production, cleanse data, and conduct a post implementation review of the data migration.

Key Skills / Experience

* Have demonstrable experience of successfully designing and implementing data migration, data transformation, data quality, modelling, testing and post production reviews.

* Have demonstrable experience of mapping source and target data models, identify gaps, data cleansing, schema modelling (Relational/XML/JSON).

* Have demonstrable experience of successfully delivering digital solutions that collect and manage personal and/or sensitive information with appropriate controls and protection.

* Have demonstrable hands-on experience of Kafka, Apache Nifi, Big Data, Hadoop, HBase, Graph Database, Map Reduce, Java, Python, Micro services, Elasticsearch, Git, Jenkins, Bash Scripting and Linux

* Experience in delivering big data solutions using a leading Hadoop distributions like Hortonworks, Cloudera.

* Experience in working Agile methodologies, TDD (Test Driven Development) and (CI & CD) Continuous Integration and Continuous Delivery.

* Experience in designing and building API with SOAP and REST.

* Experience in data encryption at rest and in transit.

* Have demonstrable experience of successfully and collaboratively working, coaching and sharing knowledge with Public Sector client teams, particularly those with limited agile development experience.

* Have demonstrable experience of successfully design, implementation and migration of relational databases to Big data based data stores utilising Amazon AWS.

* Have demonstrable hands-on experience using ETL, JMS, SAM.

* Have existing, valid DV or SC Clearance.