Online since 1999 | 11,279 IT Jobs Live NOW

Data Engineer

Premium Job From MagicLab
Recruiter: MagicLab
Listed on: 28th January
Location: London
Salary Notes: Competitive + Benefits
Type: Permanent
Start Date: ASAP

Data Engineer
London

Badoo is looking for an exceptional Data Engineer to join our quirky data team. We're solving interesting problems using cutting-edge tools - working on an in-house analytics platform which captures tens of billions of events a day from more than a hundred various data sources; then aggregates, processes and stores them in Hadoop and Exasol using Spark and Presto. Data is then consumed from reports and visualisations on our React based portal using D3.

KEY ACCOUNTABILITIES

  • Contribute to all parts of our data platform (from metadata definition framework through data pipelines to the visualisation interface)
  • Write unit tests and perform code reviews
  • Explore and experiment with new tools, libraries and technologies to improve and simplify our solution
  • Take ownership of certain parts of the project
  • Maintain a vision of the product and its place within the company; create prototypes to showcase the vision
  • Support existing users of the platform, explain new features to them and help new joiners to get started

REQUIRED SKILLS AND KNOWLEDGE

  • Ability to understand business requirements and goals
  • Ability to write easily understandable and maintainable code in many languages
  • Interest in data analysis and visualisation
  • Primary programming skill is Python as a language of most of the data pipeline processing code
  • Java (Hadoop/Spark) as a secondary language
  • Understanding of various SQL and NoSQL systems (Redis, CouchDB, Postgres, MySQL, Redshift etc), their strengths and weaknesses
  • Good level of Unix skills and bash scripting

DESIRABLE

  • Most of Badoo itself is written in PHP so some familiarity with the language would definitely be useful
  • Client-side development with Javascript (React/Flow)
  • Demonstrable experience in projects related to data and metadata
  • Side projects or open source contributions
  • Polyglot experience in general

Why MagicLab?

We are proud to be the largest dating network in the world, with over 500 million users across 190 countries. Online dating has more than doubled in the last decade, and it is estimated that the global online dating market could be worth $12 billion next year. We continually innovate so that we can provide the best technology and user experience for people to meet because we believe that happiness is better shared.

Contact Name: MagicLab
Reference: TJ/1728/30070f9c
Job ID: 2788528



Browse all skill types