Big Data DevOps Engineer - Hadoop/Spark/Linux
Recruiter
Evolution Recruitment Solutions Ltd
Listed on
15th October 2019
Location
Reading
Type
Permanent
This job has now expired please search on the home page to find live IT Jobs.
Do you want to work in a technically challenging environment and work with the latest technology?Would you like to work on products and services that help to keep the country safe?
We are looking to recruit a skilled engineer with experience in 3 key areas - Big Data, DevOps and Security. You do not need to be an expert in all 3 areas but some understanding and interest is required.
Please note that you will need to be eligible for DV clearance for this role.
The role holder will assist in the continuous evolution of our Cyber Security Platform - to ensure it stays ahead of the relentless innovation of the client's cyber adversaries. You will work alongside both internal teams and the client's own staff providing their analytical skills to evolve cyber security use cases and provide in-depth technical assistance for the components of the platform.
Skills and Knowledge:
Experience of working in a complex technical development and integration environment.
Previous experience supporting production big data platforms such as Hadoop and Spark.
Knowledge leveraging Hadoop skills to find innovative approaches to problems.
Security and cyber telemetry, log feeds and intelligence platforms.
Network structure and security.
Linux system administration and Linux system troubleshooting.
Using scripting to automate various processes.
Prototype development using either: Scala, Java, Python or R for streaming and batch ETL workloads.
Extensive knowledge of the Elastic stack, including Elasticsearch, Logstash and Kibana.
Knowledge of configuration management tools (Puppet, Ansible)
Key Responsibilities:
To innovate and develop the Cyber Security Platform.
Maintain knowledge and awareness of current threat trends and security technologies.
Keep up to date on the latest trends and technology in security and cyber telemetry, log feeds and intelligence platforms.
Current trends in data handling techniques including life cycle and security maintenance.
Continue to develop your knowledge in Hadoop and Elasticsearch ecosystems and related emerging technologies.
Carry out design, development, integration and testing of cyber security platforms and services.
Upskill team members in the domain of big data platforms and development.
If you are keen to discuss further please contact Dave Macpherson at Evolution Recruitment Solutions.
