Data Engineer
Recruiter
MagicLab
Listed on
28th January 2020
Location
London
Salary/Rate
Competitive + Benefits
Salary Notes
Competitive + Benefits
Type
Permanent
Start Date
ASAP
This job has now expired please search on the home page to find live IT Jobs.
Data EngineerLondon Badoo is looking for an exceptional Data Engineer to join our quirky data team. We're solving interesting problems using cutting-edge tools - working on an in-house analytics platform which captures tens of billions of events a day from more than a hundred various data sources; then aggregates, processes and stores them in Hadoop and Exasol using Spark and Presto. Data is then consumed from reports and visualisations on our React based portal using D3. KEY ACCOUNTABILITIES Contribute to all parts of our data platform (from metadata definition framework through data pipelines to the visualisation interface) Write unit tests and perform code reviews Explore and experiment with new tools, libraries and technologies to improve and simplify our solution Take ownership of certain parts of the project Maintain a vision of the product and its place within the company; create prototypes to showcase the vision Support existing users of the platform, explain new features to them and help new joiners to get started REQUIRED SKILLS AND KNOWLEDGE Ability to understand business requirements and goals Ability to write easily understandable and maintainable code in many languages Interest in data analysis and visualisation Primary programming skill is Python as a language of most of the data pipeline processing code Java (Hadoop/Spark) as a secondary language Understanding of various SQL and NoSQL systems (Redis, CouchDB, Postgres, MySQL, Redshift etc), their strengths and weaknesses Good level of Unix skills and bash scripting DESIRABLE Most of Badoo itself is written in PHP so some familiarity with the language would definitely be useful Client-side development with Javascript (React/Flow) Demonstrable experience in projects related to data and metadata Side projects or open source contributions Polyglot experience in general Why MagicLab? We are proud to be the largest dating network in the world, with over 500 million users across 190 countries. Online dating has more than doubled in the last decade, and it is estimated that the global online dating market could be worth $12 billion next year. We continually innovate so that we can provide the best technology and user experience for people to meet because we believe that happiness is better shared.