Data Engineer


Premium Job From TXODDS (UK) Limited

Recruiter

TXODDS (UK) Limited

Listed on

1st February 2018

Location

London

Salary/Rate

na

Salary Notes

na

Type

Permanent

This job has now expired please search on the home page to find live IT Jobs.

Data Engineer

We are looking for an experienced Data Engineer to work on collecting, storing, processing, and analysing our huge sets of data.

Alongside the on-going maintenance of our existing data storage systems, you’ll be developing and implementing upgrades and enhancements to the data and the supporting systems architecture.

We require a candidate who genuinely cares about data, in particular, about its security, safety, availability, quality and consistency.

The candidate should be able to have good time management skills, track their tasks in JIRA, be dependable and reliable in their job, and be a good communicator.

Responsibilities

- Consolidating, securing and optimising our existing data storage solutions, including data designs and architectures.

- Monitoring performance and determining suitable application / infrastructure enhancements.

- Working with operations to ensure the 24/7 availability of data services.

- Designing and developing resources and frameworks as required by application and business demand.

Required Skills.

- Expert / DBA level skills with a variety of RDMS including MySQL, Postgres, MSSQL, Oracle etc.

- Experience of managing Hadoop cluster(s) and associated services.

- Experience with building stream-processing systems.

- Strong and low-level Linux (Centos) skills.

- Experience working with configuration management systems such as Puppet and Ansible.

Bonus Skills

- Experience with the Cloudera service stack, in particular, Impala, Sqoop and Oozie.

- Knowledge of public cloud ( AWS, Azure, GCP) technologies and capabilities.

- Experience with NoSQL databases, such as Cassandra or MongoDB.

- Knowledge of various ETL techniques and frameworks, such as Flume.

- Experience with various messaging systems, such as Kafka, ActiveMQ or RabbitMQ.

You are currently using an outdated browser.

Please consider using a modern browser such as one listed below: