Data Engineer

This job has now expired please search on the home page to find live IT Jobs.

Role: Data EngineerRate: £600/dayLocation: PortsmouthDuration: 3 Month Initial ContractPotential candidates must hold, or be willing to undergo SC Clearance RoleThe role day to day will be to design, implement, manage, and administer Babcock's Analytic platforms and services. The goal is to deliver an open, secure, robust, scalable, reliable and high-performance solution.You will work closely with the data, network, application and analytic teams to make sure that all the big data applications are highly available and performing as expected. Experience with capacity planning and estimating the requirements for lowering or increasing the capacity of Hadoop based platforms will be helpful.Represent the Information & Insight team at meetings with internal infrastructure colleagues as well as external suppliers/vendors.Ensure that appropriate audit and security controls exist for data hosted and served from the platformsWork with the Data Sourcing teams to ensure data is loaded, maintained and available from the data platforms to meet the required availability, security and performance requirements asked.Maintain an awareness of emerging tools, skills, techniques and technologies, and where appropriate make recommendations relating to their timely introduction for competitive advantage.EducationA bachelor's or master's degree in, computer science, information management or related field, or equivalent work experience.ExperienceIdeally 5 or more years' experience in designing, running and troubleshooting Hadoop based analytic platforms however for a development candidate then working knowledge of these platforms is sufficient.Preferably 3 or more years' experience in supporting Microsoft SQL 2016 or above Data & BI platforms.Experience in working on implementing and supporting data platforms within secure, regulated industriesPreferably 3 or more years of experience in information-intensive industries or digitally advanced enterprisesKnowledge/SkillsExcellent interpersonal skills; able to work across teams to influence and effect change to achieve common goals.Either detailed knowledge of (full role) or familiarity with (development role) some of the following data related platforms or technology: Expertise in at least one commercial distribution of Hadoop.Experience or knowledge in the Splunk toolsetBatch and streaming job frameworks (such as Spark, Storm).NoSQL databases (e.g HBase, Cassandra, MongoDB).Middleware and messaging systems (e.g. Kafka, RabbitMQ, FTL, Ultra Messaging).Scripting (e.g. R, Python, Perl).Automation via the use of configuration management (such as Puppet or Chef) and orchestration tools (such as Ansible).