Senior DevOps Engineer - Big Data

This job has now expired please search on the home page to find live IT Jobs.

Senior DevOps Engineer, Microservices, Azure, Cloudbreak, Hadoop, HortonworksMy leading client is looking for a Senior DevOps Engineer you will be responsible for the configuration and on-going management of the cloud PaaS/IaaS, working with Big Data platforms such as Hortonworks based on Hadoop clusters configured on cloud data centres such as those of Azure/AWS. You will ensure availability of the platform to services teams and their service users. You will also carry out continuous improvements to platforms, including system development, processes design and automation and diagnostics improvements. Assurance of platform security, privacy and resilience will be your greatest concern.You will support and maintain the service infrastructure with appropriate security and privacy controls and meets users' needs, Business solutions comply with privacy and security requirements, Work in an agile way and collaborating with colleagues. You will have a strong background in Agile software engineering practices such as CI/CT/CD. You must have experience with architecture/engineering of cloud based distribution systems (such as Azure)Technical skillsExperience of Microservices Architecture and APIsStrong knowledge of Azure and its offerings and the Hadoop ecosystem using Hortonworks (preferred) or ClouderaCloudbreak, Hive, Ambari, Sqoop, Oozie, SPARK, Atlas, Ranger, HBase, HDFS, YARN and ELKHands on experience connecting cloud infrastructure to on-prem networksVPNs, tunnelling, AD connectors, routing o Knowledge of network protocols such as TCP, UDP, HTTP/HTTPS, SSL/TLS, and API'sAuthentication technologies. i.e. LDAP, OAuth, 2FA, SAML, and SSO via KerberosBash, Python, Java or RubyExperienced with security controls o VPNs, encryption & key/certificate management, endpoint protection, virtual firewalls/ACLs/NSGs, setting up bastion nodes, etcBackground in distributed systems o databases, security, networking & load balancing, monitoring, scripting, automationA deep understanding of distributed system design and dependency managementOperational expertise o troubleshooting skills, understanding of system capacity/bottlenecks, basics of memory, CPU, OS, storage, and networksA strong grasp of protective monitoring tools, approach and implementationLinux system administration (configuration, installs, automation, and monitoring)Experience automating infrastructure and software delivery to productionIf this role sounds of interest please send me cv for consideration.