Big Data / Data Hub Platform Manager, Hive, Hadoop MapR - Investment Banking


Premium Job From Adlam Consulting

Recruiter

Adlam Consulting

Listed on

4th July 2021

Location

London

Salary/Rate

£600 - £700

Salary Notes

Day Rate

Type

Contract

Start Date

ASAP

This job has now expired please search on the home page to find live IT Jobs.

Big Data / Data Hub Platform Manager, Hive, Hadoop MapR - Investment Banking

Big Data / Data Hub Platform Manager with Hive Drill, HBase, HDFS Hadoop MapR -, the primary focus of the role is to manage the MapR (Hadoop) infrastructure of the CIB Big Data platform.  The role will involve working closely with the other Data SSC Solution Architects and development teams onshore and offshore to configure and manage the platform.

Essential 

Knowledge of Big Data technologies (Hive, Drill, HBase, HDFS ...) and Hadoop distributions, in particular MapR

Conception of a data warehouse and the different layers to integrate and distribute the data.

Linux OS knowledge

Knowledge of security and authentication topics on Big Data technologies

Management of Hadoop cluster, with all included services

Ability to solve any ongoing issues with operating the cluster

 

Big Data Platform Management

Platform infrastructure design

Platform configuration and performance tuning for use cases

Monitoring of platform health

Planning capacity increase

Reporting on platform health, capacity and usage

 

 

Skills & Competencies

Strong solution architecture experience in delivery of IT projects

Strong data analytics / big data solution architecture experience in delivery of large systems

12+ years' experience in  IT, at least 6 with BI and data systems

Deep technical knowledge of data analytics technologies

Deep technical knowledge of Big Data / Hadoop technologies, especially MapR

Experience working with ETL technologies

Knowledge of data management tools, e.g. Ab Initio, Callibra

§  Experience working in onshore/offshore delivery centres, including interaction with geographically distributed clients

Encourage continuous improvement, innovation and creativity

Facilitate problem solving & collaboration

Ability to discover and analyse problems, and present solutions in a clear and concise manner

Excellent oral and written communication skills with the ability to effectively present to target audience

 

 Highly Desirable 

Experience with Spark development optional. 

Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming.  

Experience with NoSQL databases, such as HBase, Cassandra, MongoDB. 

Experience with various messaging systems, such as Kafka.

 Nice to have 

Experience working with ETL technologies using Ab Initio  

 

Adlam Consulting operates as an Employment Agency & an Employment Business Applicants must be eligible to work in the specified location

You are currently using an outdated browser.

Please consider using a modern browser such as one listed below: