Big Data Consultant Engineer - Advanced Analytics
Recruiter
SidTech
Listed on
16th July 2019
Location
London
Type
Permanent
Start Date
2019-07-15
This job has now expired please search on the home page to find live IT Jobs.
Big Data Consultant Engineer - Advanced Analytics London To £80K plus extensive benefits package Position Description: Would you like to be part of a growing company with the scale and strength to give your career a boost in Consulting? We provide high value business and IT consulting services to clients across multiple industries and as we grow we’re recruiting for a talented Big Data Engineer to join our innovative Advanced Analytics team helping tasked with creating and managing Big Data infrastructure and tools, typically designing and building big data pipelines and platforms. This opportunity is based primarily in London, with a degree of mobility as required across customer sites. Your future duties and responsibilities: We have an exciting opening for a Big Data Consultant to work on the collecting, storing, processing, and analysing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. The Big Data Engineer will also be responsible for integrating them with the architecture used across the business. This is a lead consultant position for a qualified Big Data expert to build ETL/ELT best practices in a big data environment, featuring big data pipelines, real time streaming using Kafka and leveraging high levels of proficiency across distributed computing principles. The Consultant will be able to select and integrate any Big Data tools and frameworks required to provide requested capabilities, implementing ETL/ELT process, working closely with Cloud big data architecture (AWS, Azure) and be an SME in relation to knowledge of big data tools/platforms, data management tools and necessary infrastructure changes. This represents an exciting opportunity to help build our UK Advanced Analytics Capability as it takes flight out of our growing Emerging Technology practice. Required qualifications to be successful in this role: The successful candidate will offer a demonstrate track record in building scalable big data solutions with a view to act as a hands-on Architect/Lead, with core knowledge across a variety of tools and platforms (e.g. Hadoop, Talend, Snowflake, Pentaho, Power BI, Tableau, Informatica), an appreciation of data management tools (Collibra, Alation) and memory frameworks (NoSQL, Mongodb, Marklogic, Cassandra, Neo4j, Memsql). The Big Data consultant will manage Hadoop, with all included services, be familiar with building stream-processing systems (using solutions such as Storm or Spark-Streaming), demonstrate good knowledge of Big Data querying tools (Pig, Hive, and Impala) and be familiar with Spark, integration of data from multiple data sources and the various messaging systems (Kafka or RabbitMQ). Other tools of interest would include big data machine learning toolkits (Mahout, SparkML, or H2O), an understanding of Lambda Architecture, Cloudera/MapR/Hortonworks, AWS, Azure big data stacks, CI/CD using Docker and Kubernetes, Spark/Scala/Java/Python programming languages, Elastic, Redis, etc. Suffice to say we are also looking for well-developed interpersonal skills - confident, clear, concise - with a passion for latest business innovations and their application to clients’ challenges. You will need to be ambitious, keen to learn & develop at pace, and we will provide you the support and training to help achieve this. Build your career with us: It is an extraordinary time to be in business. As digital transformation continues to accelerate, we are at the centre of this change - supporting our clients’ digital journeys and offering our professionals exciting career opportunities. Our success comes from the talent and commitment of our professionals. As one team, we share the challenges and rewards that come from growing our company, which reinforces our culture of ownership. All of our professionals benefit from the value we collectively create. Be part of building one of the largest independent technology and business services firms in the world. Big Data Consultant Engineer - Advanced Analytics
