Online since 1999 | 10,829 IT Jobs Live NOW

Hadoop infrastructure Big data Architect - MapReduce - Investment Bank

Premium Job From Adlam Consulting
Recruiter: Adlam Consulting
Listed on: 8th January
Location: London
Salary/Rate: £500 - £700
Salary Notes: per day
Type: Contract
Start Date: ASAP

This job has now expired please search on the home page to find live IT Jobs.

Hadoop infrastructure Big data Architect - MapReduce - Investment Bank

Hadoop Infrastructure Architect is required  whose primary focus will be to manage the MapR (Hadoop) infrastructure of the Investment banks Big Data platform within the production support environment .  The hands- on architect will have experience infrastructure architecture experience in delivery of IT projects.

Essential

Hands on role - strong data analytics / big data Infrastructure architecture experience in delivery of large systems. Knowledge of Hadoop and ideally MapR - but MapR can be learnt on the job. Many years' experience in IT and with BI and data systems. Technical knowledge of data analytics technologies. Knowledge of Big Data technologies (Hive, Drill, HBase, HDFS Cloudera...) and Hadoop distributions, in particular MapR. Linux OS knowledge. Knowledge of security and authentication topics on Big Data technologies. Management of Hadoop cluster, with all included services. Ability to solve any ongoing issues with operating the cluster. Experience working with ETL technologies. Knowledge of data management tools, e.g. Ab Initio, Callibra. Experience working in onshore/offshore delivery centres, including interaction with geographically distributed clients. Role is a new role to join a small team to review and manage the existing infrastructure the industrialise it so that it is used extensively across the bank in London and internationally. 

Highly Desirable: Experience with Spark development optional.  Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming.  Experience with NoSQL databases, such as HBase, Cassandra, MongoDB. Experience with various messaging systems, such as Kafka. 

Role:

The role will involve working closely with the other Data Solution Architects and development teams onshore and offshore to configure and manage the platform.

Key responsibilities include: 

Big Data Platform Management

  • Platform infrastructure design
  • Platform configuration and performance tuning for use cases
  • Monitoring of platform health
  • Planning capacity increase
  • Reporting on platform health, capacity and usage

Applicants must be eligible to work in the specified location

Adlam Consulting operates as an Employment Agency & an Employment Business