Senior Data Engineer - Python, Hadoop, AWS
Recruiter
Evolution Recruitment Solutions Ltd
Listed on
17th February 2020
Location
London
Type
Permanent
This job has now expired please search on the home page to find live IT Jobs.
Are you a skilled Data Engineer who has helped deploy production ready Big Data or Cloud systems?Can you implement technologies optimised for access patterns, with focus on how consumers use the platform?
Are you interested in building on your existing Big Data or Cloud ingestion experience ?
If so, this could be the perfect role for you! I am looking for a number of Data Engineers for an award winning consultancy company in London. In this role you will help to deploy data pipelines and processes in a production-safe manner, using the latest technologies.
They need an excellent data specialist with strong knowledge of Data Development, ETL, Data Warehousing and dealing with large sets of structured, semi-structured and unstructured data. You need to be able to ingest Real Time data from various sources and design new data platforms as well.
This is an autonomous role that will run alongside the existing Big Data, Data Science and Cloud teams. It will allow you the chance to really shape the Data Engineering proposition whilst being an integral part of the growth.
You will ideally have some or most of these skills...Python/Scala/JavaSpark (both batch and stream processing)Hadoop ecosystem exposure (YARN, HDFS, HBase, custom MapReduce jobs, Hive/Impala)At least one distributed NoSQL storage (HBase, Cassandra)Understanding of cluster resource management tools (YARN, Mesos)Stream processing tools like Kafka, StormCloud architecture (i.e. AWS Kinesis, Data Pipeline, EMR, Glue, Redshift, Athena)General SQL skillsELK stack (desirable)If you are interested in finding out more then please get in touch with Chris Mayers at Evolution Recruitment Solutions.
