Big Data / Data Hub Platform Manager, Hive, Hadoop MapR - Investment Banking
Recruiter
Listed on
Location
Salary/Rate
Salary Notes
Type
Start Date
This job has now expired please search on the home page to find live IT Jobs.
Big Data / Data Hub Platform Manager, Hive, Hadoop MapR - Investment Banking
Big Data / Data Hub Platform Manager with Hive Drill, HBase, HDFS Hadoop MapR -, the primary focus of the role is to manage the MapR (Hadoop) infrastructure of the CIB Big Data platform. The role will involve working closely with the other Data SSC Solution Architects and development teams onshore and offshore to configure and manage the platform.
Essential
Knowledge of Big Data technologies (Hive, Drill, HBase, HDFS ...) and Hadoop distributions, in particular MapR
Conception of a data warehouse and the different layers to integrate and distribute the data.
Linux OS knowledge
Knowledge of security and authentication topics on Big Data technologies
Management of Hadoop cluster, with all included services
Ability to solve any ongoing issues with operating the cluster
Big Data Platform Management
Platform infrastructure design
Platform configuration and performance tuning for use cases
Monitoring of platform health
Planning capacity increase
Reporting on platform health, capacity and usage
Skills & Competencies
Strong solution architecture experience in delivery of IT projects
Strong data analytics / big data solution architecture experience in delivery of large systems
12+ years' experience in IT, at least 6 with BI and data systems
Deep technical knowledge of data analytics technologies
Deep technical knowledge of Big Data / Hadoop technologies, especially MapR
Experience working with ETL technologies
Knowledge of data management tools, e.g. Ab Initio, Callibra
§ Experience working in onshore/offshore delivery centres, including interaction with geographically distributed clients
Encourage continuous improvement, innovation and creativity
Facilitate problem solving & collaboration
Ability to discover and analyse problems, and present solutions in a clear and concise manner
Excellent oral and written communication skills with the ability to effectively present to target audience
Highly Desirable
Experience with Spark development optional.
Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming.
Experience with NoSQL databases, such as HBase, Cassandra, MongoDB.
Experience with various messaging systems, such as Kafka.
Nice to have
Experience working with ETL technologies using Ab Initio
Adlam Consulting operates as an Employment Agency & an Employment Business Applicants must be eligible to work in the specified location