CDAP Plugin / Open Source / Developer

This job has now expired please search on the home page to find live IT Jobs.

My client is currently recruiting for a CDAP plugin developer on a permanent or 6-12 month contract basis in London.

The ideal candidate is an experienced data pipeline builder (using CDAP Studio UI or CDAP CLI developer tools) and CDAP plugin developer. You will be part of a high octane, multi- disciplinary team working on Data Acquisition, Ingestion, Transformation, Curation etc.

Responsibilities:

-Design and Develop data pipelines and plugins using CDAP (Cask Data Application Platform).

-Work closely with other scrum team members to deliver the product/feature within the agreed KPIs.

-Create Batch/Real time Data Pipelines and automate using Orchestration tools like Oozie, TWS, etc.

Essential Skills:

-Hands on experience with CDAP (Cask Data Application Platform) with local/distributed deployment (on premise and/or Cloud deployments)

-Deep working knowledge in use of open source tools such as: Hive, Sqoop, Spark, MapReduce, Pig, Kafka, Hbase etc.

-Hands on coding experience with SQL & Linux Bash/Shell Scriptin

-Strong coding experience with Java, Scala/Python

-Experience with Hortonworks HDP (Hadoop Data Platform) distribution

-Experience with Design/Development of Data Governance, Metadata management, Pseudonymisation and Data Lineage tools like Atlas, Colibra, Protegrity etc

-Experience Designing/Developing ETL/streaming processes using Spark with Scala or Python

-Experience with REST APIs

-Experience with TDD and BDD frameworks

-Experience with DevOps tools for CI/CD

If this position is of interest please send a copy of you latest cv

Spring acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers. The Spring Group UK is an Equal Opportunities Employer.

By applying for this role your details will be submitted to Spring. Our Candidate Privacy Information Statement explains how we will use your information - please copy and paste the following link in to your browser: www.spring.com/candidate-privacy-information-statement