Senior Data Engineer


Premium Job From Nigel Frank International

Recruiter

Nigel Frank International

Listed on

6th January 2022

Location

England

Salary/Rate

Negotiable

Salary Notes

Negotiable

Type

Contract

Start Date

ASAP

This job has now expired please search on the home page to find live IT Jobs.

Senior Data Engineer-6 month contract- Fully remote-Inside IR35- Rates £550-750per day depending on experienceExtensive experience in Big Data technologies and expertise in cloud related data services (AWS / Azure / GCP)Have led technical Architecture, Design and Delivery of Big Data and Cloud Data solutions (AWS, Azure, GCP) for multiple projectsExpert in data ingestion, distributed data processing (batch and streaming) and programming languages preferably in Java/Scala and/or Python as secondary language, distributed messaging and ingestion frameworks (Kafka, Pulsar, Pub/Sub etc)End to end architecture including Analytics, ML and Activation tools in overall Data-driven Digital Business Transformation (DBT) and Marketing Transformation programsExperience with NoSQL databases (Cassandra/HBase/MongoDB/ElasticSearch/Neo4j) and scalable analytical data stores like Snowflake, BigQuery, Redshift, TeradataKnowledge of scalable data models that address a wide variety of consumption patterns including random-access, sequential access including necessary optimizations like bucketing, aggregating, sharding.Experience of Performance tuning, optimisation and scaling solutions from a storage/processing standpointGood understanding of Continuous Integration and Continuous Delivery (CI/CD) using Cloud based DevOps services or Jenkins/Bamboo, Maven, Junit, SonarQube, Terraform (one-click infrastructure setup), Kubernetes, containerization, optimisationGood understanding of Data Governance, Data Security, Data Cataloguing and Data Lineage concepts Have led data audits / assessment, defining data strategy and provide consulting skills to the clients

You are currently using an outdated browser.

Please consider using a modern browser such as one listed below: