Big Data Engineer Consultant

This job has now expired please search on the home page to find live IT Jobs.

Who They Are:

You will be working for one of the biggest consultants within the digital revolution. Do you want to be part of a company that is leading the digital revolution? You will be working for a company that is driving these exciting changes across 40 industries in more than 120 countries.

What responsibilities will you have?

* Work with client teams to design and implement modern,scalable data pipelines and architecturesleveragingHadoop,NoSQL, Apache open source and emerging technologies, covering:

* On-premise and cloud-based deployment patterns

* Streaming, micro-batching and right-time use cases

* Agile and DevOps techniques and implementation approaches

* Provide innovative data engineering design and deployment approaches that leverage innovations in in-memory processing, agile delivery, automation, storage architectures etc. to design modern data pipelines at speed and scale

* Working closely with technology partners, Technology Labs and Innovation centers to incubate emerging technologies and build prototypes/demos to enhance our data engineering codebases and frameworks

* Mentor and up skill other data engineers

* Mandatory skills:

* Processing frameworks & programming tools: Spark (Scala/Python/Java), Kafka, Flink

* Hadoop platforms & distributions: Cloudera, Hortonworks, MapR, EMR

* Agile and DevOps delivery practices: familiarity with agile and DevOps delivery and deployment methodologies, experience with continuous integration, automated code reviews and regression testing using tools such as Atlassian Jira, Confluence, Cloudbees Jenkins, Selenium Grid, SonarQube and Docker

* Data modelling & data pipeline design: iterative data pipeline development from raw, curated, integrated to published data, with fit for use data modelling on Hadoop and NoSQL platforms

* Client facing skills: solid experience working in client facing / consulting environments, to be able to build trusted relationships with client stakeholders and act as a trusted adviser.

* Ideally, you'll also have:

* Cloud platforms: Developing data engineering pipelines on AWS, Azure, GCP, including with Cloud platform PaaS components; Databricks

* NoSQL: HBase, Cassandra, MongoDB, CouchDB, Memcached, DynamoDB, Druid, BigTable

* Design skills: data product design thinking, features definition, prototyping, usability testing and data visualisation literacy

* Machine Learning tools, interfaces & Libraries: R, R-Studio, Spark R, sparklyr, MLlib, H2O etc.

To find out more about Computer Futures please visit www.computerfutures.com

Computer Futures, a trading division of SThree Partnership LLP is acting as an Employment Agency in relation to this vacancy | Registered office | 1st Floor, 75 King William Street, London, EC4N 7BE, United Kingdom | Partnership Number | OC387148 England and Wales