Online since 1999 | 5,102 IT Jobs Live NOW

Data Engineer

Premium Job From MagicLab
Recruiter: MagicLab
Listed on: 28th January
Location: London
Salary/Rate: Competitive + Benefits
Salary Notes: Competitive + Benefits
Type: Permanent
Start Date: ASAP

This job has now expired please search on the home page to find live IT Jobs.

Data Engineer
London
Badoo is looking for an exceptional Data Engineer to join our quirky data team. We're solving interesting problems using cutting-edge tools - working on an in-house analytics platform which captures tens of billions of events a day from more than a hundred various data sources; then aggregates, processes and stores them in Hadoop and Exasol using Spark and Presto. Data is then consumed from reports and visualisations on our React based portal using D3.
KEY ACCOUNTABILITIES

Contribute to all parts of our data platform (from metadata definition framework through data pipelines to the visualisation interface)
Write unit tests and perform code reviews
Explore and experiment with new tools, libraries and technologies to improve and simplify our solution
Take ownership of certain parts of the project
Maintain a vision of the product and its place within the company; create prototypes to showcase the vision
Support existing users of the platform, explain new features to them and help new joiners to get started

REQUIRED SKILLS AND KNOWLEDGE

Ability to understand business requirements and goals
Ability to write easily understandable and maintainable code in many languages
Interest in data analysis and visualisation
Primary programming skill is Python as a language of most of the data pipeline processing code
Java (Hadoop/Spark) as a secondary language
Understanding of various SQL and NoSQL systems (Redis, CouchDB, Postgres, MySQL, Redshift etc), their strengths and weaknesses
Good level of Unix skills and bash scripting

DESIRABLE

Most of Badoo itself is written in PHP so some familiarity with the language would definitely be useful
Client-side development with Javascript (React/Flow)
Demonstrable experience in projects related to data and metadata
Side projects or open source contributions
Polyglot experience in general

Why MagicLab?
We are proud to be the largest dating network in the world, with over 500 million users across 190 countries. Online dating has more than doubled in the last decade, and it is estimated that the global online dating market could be worth $12 billion next year. We continually innovate so that we can provide the best technology and user experience for people to meet because we believe that happiness is better shared.