GCP Big Data Engineer - London based - 3 Month Contract
Recruiter
Evolution Recruitment Solutions Ltd
Listed on
6th February 2019
Location
London
Salary/Rate
Upto £85000
Type
Contract
This job has now expired please search on the home page to find live IT Jobs.
We currently require the services of a Big Data Engineer to work for a well respected client based in London.Key skills required:
• Expert level experience in designing, building and managing applications to process large amounts of data in a Hadoop ecosystem;
• Strong GCP experience
• Extensive experience with performance tuning applications on Hadoop and configuring Hadoop systems to maximise performance;
• Experience building systems to perform real-time data processing using Spark Streaming and Kafka, or similar technologies;
• Experience with common SDLC, including SCM, build tools, unit testing, TDD/BDD, continuous delivery and agile practises
• Experience working in large-scale multi tenancy Hadoop environments;
Must have technical / professional qualifications:
• Expert level experience with Hadoop ecosystem (Spark, Hive/Impala, HBase, Yarn); desirable experience with Cloudera distribution;
• Strong software development experience in Scala and Python programing languages; other functional languages desirable;
• Experience with Unix-based systems, including bash programming
• Experience with columnar data formats
• Experience with other distributed technologies such as Cassandra, Solr/ElasticSearch, Flink, Flume would also be desirable
