Platform Engineer

This job has now expired please search on the home page to find live IT Jobs.

Platform Engineer

Outside IR35

Remote

Requirement for a Senior Engineer, to provide ongoing management of the Managed Detection & Response Platform capability and aid in the development of MDR Engineers. It is envisaged this role is required for a Fixed Term of 1 year, subject to internally developing other Engineers to be able to take over. It is possible that this role will subsequently become a permanent requirement.

A principle technical role, reporting to the UK&I Digital Security Head of Platform Management

* Setup and manage HDP Platform, handling all Hadoop environment builds, performance tuning and ongoing monitoring.

* Develop scripts/ tools to automate platform maintenance activities

* Work with sustenance engineering on emergency fixes

* Debug day to day job issues in Hadoop platform and provide solutions.

* Perform software release management tasks

* Health monitoring of multiple HDP clusters using centralized dashboards, for Hadoop services, overall server health, custom applications running on the cluster

* Troubleshoot Log collection and ingestion via Apache NiFi to our MDR platform from various network devices (like Firewall, Switches, Router, Proxy, IPS, WAF, Etc..), servers, and Cloud resources.

* Coordinate with Network, Infrastructure, and other organizations as required

* Make changes to parsers for enabling use cases

* Perform root cause analysis on failed components and implements corrective measures

* Configuration of high level and low level HDP parameters to fine tune performance of the cluster

* Manage escalations on FCAPS issues

There is a requirement to provide occasional on-call support as part of a support rota, out of business hours. This will attract extra pay on a retention and call out basis, and is additional to base reward package.

'Skills we can't do without:

* Deep Expertise in managing Hadoop ecosystem components in large production clusters.

* Expertise in HDP platform/ Cloudera

* Application Deployment using JAVA & Python APIs

* Good Scripting knowledge in Bash, Python, Anaconda, Ansible

* Knowledge on Automation/ DevOps Tools Github, Jenkins, Docker, Kubernetes

* Data Ingestion, Data Access & Data storage using Hadoop Big Data tools like HBase, Flume, Kafka, Nifi, ElasticSearch

* Exposure to Azure administration is preferred

* Good hands-on experience of Linux, its commands and scripting are a must.

* General operational excellence. This includes good troubleshooting skills, understanding of system's capacity and bottlenecks, memory management, performance tuning and optimization for Linux and Hadoop.

* Configuration management and deployment exposure in Open source environment.

* Knowledge of Kerberos and Apache Ranger for configuring security

* Excellent communication skills.

* Critical thinker and good problem-solver.

* Ability to work independently with a strong attention to detail

* Ability to work well in a global team environment

Other requirements/preferences:

* Exposure and experience of Azure administration

* Knowledge of Core Java.

* Ability to work well in a global team environment

* Able to manage time and prioritise workload

* UK Security Clearance or eligibility and willingness to obtain security clearance to SC level as required by specific projects

* Ability to achieve Office of Nuclear Regulation clearance (currently requires UK Born Citizen/UK National)

LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, LA International welcome applications from all sections of the community and from people with diverse experience and backgrounds.

Award Winning LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period.