Data Engineer


Premium Job From MagicLab

Recruiter

MagicLab

Listed on

28th January 2020

Location

London

Salary/Rate

Competitive + Benefits

Salary Notes

Competitive + Benefits

Type

Permanent

Start Date

ASAP

This job has now expired please search on the home page to find live IT Jobs.

Data Engineer
London Badoo is looking for an exceptional Data Engineer to join our quirky data team. We're solving interesting problems using cutting-edge tools - working on an in-house analytics platform which captures tens of billions of events a day from more than a hundred various data sources; then aggregates, processes and stores them in Hadoop and Exasol using Spark and Presto. Data is then consumed from reports and visualisations on our React based portal using D3. KEY ACCOUNTABILITIES Contribute to all parts of our data platform (from metadata definition framework through data pipelines to the visualisation interface) Write unit tests and perform code reviews Explore and experiment with new tools, libraries and technologies to improve and simplify our solution Take ownership of certain parts of the project Maintain a vision of the product and its place within the company; create prototypes to showcase the vision Support existing users of the platform, explain new features to them and help new joiners to get started REQUIRED SKILLS AND KNOWLEDGE Ability to understand business requirements and goals Ability to write easily understandable and maintainable code in many languages Interest in data analysis and visualisation Primary programming skill is Python as a language of most of the data pipeline processing code Java (Hadoop/Spark) as a secondary language Understanding of various SQL and NoSQL systems (Redis, CouchDB, Postgres, MySQL, Redshift etc), their strengths and weaknesses Good level of Unix skills and bash scripting DESIRABLE Most of Badoo itself is written in PHP so some familiarity with the language would definitely be useful Client-side development with Javascript (React/Flow) Demonstrable experience in projects related to data and metadata Side projects or open source contributions Polyglot experience in general Why MagicLab? We are proud to be the largest dating network in the world, with over 500 million users across 190 countries. Online dating has more than doubled in the last decade, and it is estimated that the global online dating market could be worth $12 billion next year. We continually innovate so that we can provide the best technology and user experience for people to meet because we believe that happiness is better shared.

You are currently using an outdated browser.

Please consider using a modern browser such as one listed below: