Data Engineer

This job has now expired please search on the home page to find live IT Jobs.

Data Engineer

Remote role with flexible working arrangements!

If building data pipelines in a fast moving company with the latest technology stack sounds good to you then read on!

I am working with a London-based startup providing real-time analytics & insurance pricing for commercial fleet drivers. Their core platform utilises streaming telematic data and adjusts insurance pricing in real time reacting to driver's usage, behaviour, environment and needs.

What kind of things will you be responsible for?

* Building data pipelines for IoT data

* Creation of reusable data models

* Building streaming frameworks that deliver real-time insights that positively impact the

products we offer through the use of Complex Event Detection

* Design of batch analytics frameworks

* Release testing and productionising new components

What skills will you need?

* Multiple years coding in Scala preferably; Java, Python and Go good to have

* Streaming frameworks such as Kafka or SQS

* Processing frameworks such as Spark or Flink

* Deep understanding and knowledge of data modelling (RDBMS, serialisation protocols and

NoSQL)

* Distributed architectures and micro-services

* DevOps and CI/CD tooling, such as Jenkins, Maven or Gradle, Git, Ansible

* Strong automation mindset and a passion for root cause analysis

* Expertise in performance tuning and service monitoring

A great candidate would have experience with:

* AWS infrastructure & tooling

* Docker/Kubernetes as a user

* Modern data warehousing (Hive, Kylin or Presto)

* Elasticsearch and PrometheusSoft Skills:

* Good communicator

* An eagerness to learn

* Good explainer: can make the complex simple

What will you get in return?

* Competitive salary

* You will participate in our options scheme and will benefit from being an early joiner

* Work from the London office, from home or from anywhere!

* Very flexible and generous vacation policy

* A cutting edge technical environment to tune your skills

Don't tick all the boxes? Don't worry about it, I still want to hear from you if you think you're the right person for the job!