Big Data Engineer - NoSQL

This job has now expired please search on the home page to find live IT Jobs.

Big Data Engineer - NoSQL to be based in London on an initial 3 Month contract. Experienced Big Data Engineer with extensive experience working with NoSQL. You will collaborate with the Data Science & Engineering teams to share best practice for building data pipelines across all locations of our Client LabsJob Title - Big Data Engineer - NoSQLLocation - LondonRate - Market Rates per dayDuration - 3 Months initial Are you passionate about collaborating around technical data challenges to creatively solve complex problems? Come join us!Our client provides a unique opportunity to work in a global company with a huge amount of high quality data. You will be: Building agile data pipelines to support prototypes and MVPsWorking with large, diverse data sets using big data and public cloud technologiesDefining and implementing data engineering best practice across all Lab locationsCreating modern data infrastructure to support research, data-science and machine-learning projects.Researching new data engineering approaches to handle alternative dataDeveloping and broadening your skills through mentoring and collaboration with experienced professionals As a member of our diverse London team of data and research scientists, engineers and UX/UI designers you will be part of our global network of like-minded colleagues in our sister labs in Singapore, San Francisco and New York. Data is the infrastructure that our Lab runs on. Our client has the worlds largest repository of curated data. From petabtyes of tick-by-tick market data to the worlds largest collection of financial documents, our content fuels the financial markets allowing investors to make decisions and financial institutions to reduce risk and even fight financial crime. Requirements Collaborate with the Data Science & Engineering teams to share best practice for building data pipelines across all locations of our Client LabsProvide expertise on development of data models and data wranglersCreate and maintain optimal data pipeline architectureManage internal stakeholders to obtain access and meet requirements for data security.Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using AWS, GCP, Azure and open source technologies.Build analytics tools that monitor the data pipelines to ensure resiliency and cost efficiency.Create data tools for analytics and data scientist team members to easily access, experiment and productionise our innovation and research projects. Qualifications for Data Engineer Bachelor degree required in Computer Science, Technology, or similar field.3 - 5 years' of work experience that includes working with NoSQL systems.Experience supporting and working with cross-functional teams in a dynamic environment.Experience building and optimizing data pipelines, architectures and data sets.Experience creating data profiling, cleansing and data management servicesBuild processes supporting data transformation, data structures, metadata, dependency and workload management.Working knowledge of message queuing, stream processing, and highly scalable big data stores.Strong project management and organizational skills.Interest in Machine Learning & Analytics Operations Desirable Technical RequirementsExperience with relational SQL and NoSQL databases, including DynamoDB, Redis, Postgres, Neo4J and Cassandra.Experience with AWS cloud services: S3, EC2, EMR, RDS, Redshift, AthenaExperience with object-oriented/object function scripting languages: Python, Java, Go C++, Scala, Gremlin etcExperience with big data tools: Spark, Kafka, Hadoop.Experience/working with ETL patterns and tools. Candidates should submit CVs in the first instance. Mike Tripp 0161 924 3631