Lead Platform Engineer (Outside IR35)

This job has now expired please search on the home page to find live IT Jobs.

Lead Platform Engineer

Outside IR35

Fully Remote

Requirement for a Principle Engineer, to take ownership of the ongoing management of the Managed Detection & Response Platform capability and aid in the development of MDR Engineers. It is envisaged this role is required for a Fixed Term of 1 year, subject to internally developing other Engineers to be able to take over. It is possible that this role will subsequently become a permanent requirement.

A principle technical role, reporting to the UK&I Digital Security Head of Platform Management

* Manage FCAPS scenarios in production environment

* Track and manage platform tickets to meet SLA requirements.

* Monitor and manage cluster capacity based on customer count, events per second Perform Hadoop administration tasks

* Guide platform engineers to fix day-to-day Operational issues.

* Setup and manage HDP Platform, handling all Hadoop environment builds, performance tuning and ongoing monitoring.

* Develop scripts/ tools to automate platform maintenance activities

* Work with sustenance engineering on emergency fixes

* Debug day to day job issues in Hadoop platform and provide solutions.

* Perform software release management tasks

* Health monitoring of multiple HDP clusters using centralized dashboards, for Hadoop services, overall server health, custom applications running on the cluster

* Troubleshoot Log collection and ingestion via Apache NiFi to our MDR platform from various network devices (like Firewall, Switches, Router, Proxy, IPS, WAF, Etc..), servers, and Cloud resources.

* Coordinate with Network, Infrastructure, and other organizations as required

* Perform root cause analysis on failed components and implements corrective measures

* Configuration of high level and low level HDP parameters to fine tune performance of the cluster

* Manage escalations on FCAPS issues

There is a requirement to provide occasional on-call support as part of a support rota, out of business hours.

Skills we can't do without:

* Experience in design and operationalizing FCAPS (Fault, Configuration, Availability, Performance, Security) for Hadoop clusters

* Experience in design of automated Hadoop installation

* Deep Expertise in managing Hadoop ecosystem components in large production clusters.

* Expertise in HDP platform/Cloudera

* Application Deployment using JAVA & Python APIs

* Good Scripting knowledge in Bash, Python, Anaconda, Ansible

* Knowledge of Automation/ DevOps Tools Github, Jenkins, Docker, Kubernetes

* Data Ingestion, Data Access & Data storage using Hadoop Big Data tools like HBase, Flume, Kafka, Nifi, ElasticSearch

* Good hands-on experience of Linux, its commands and scripting are a must.

* General operational excellence. This includes good troubleshooting skills, understanding of system's capacity and bottlenecks, memory management, performance tuning and optimization for Linux and Hadoop.

* Configuration management and deployment exposure in Open source environment.

* Knowledge of Kerberos and Apache Ranger for configuring security

* Excellent communication skills.

* Critical thinker and good problem-solver.

* Ability to work independently with a strong attention to detail

Other requirements/preferences:

* Exposure and experience of Azure administration

* Knowledge of Core Java.

* Ability to work well in a global team environment

* Able to manage time and prioritise workload

* UK Security Clearance or eligibility and willingness to obtain security clearance to SC level as required by specific projects

* Ability to achieve Office of Nuclear Regulation clearance (currently requires UK Born Citizen/UK National)

LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, LA International welcome applications from all sections of the community and from people with diverse experience and backgrounds.

Award Winning LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period.