AWS Data Architect - Big Data


Premium Job From Experis IT

Recruiter

Experis IT

Listed on

10th April 2018

Location

London

Salary/Rate

Excellent Day Rate

Salary Notes

Excellent Day Rate

Type

Contract

Start Date

ASAP

This job has now expired please search on the home page to find live IT Jobs.

Big Data Architect, Data Architect, AWS Solution Architect, Amazon Kinesis, EMR Clusters, AWS Lambda, Redshift, Big Data Files.

My leading financial services client is looking for a AWS Data Architect/ AWS Solution Architect you must have a proven background designing data pipelines leveraging AWS technologies (e.g. AWS data pipelines, Amazon Kinesis, EMR Clusters, AWS Lambda, Redshift) . Strong working knowledge of architecture, performance and best practices in either Apache Hive or Apache Spark, ideally on EMR Clusters. Experience in architecting and designing big data solutions with NoSQL and MPP products. Together with experience with data governance, specifically developing data quality processes. Ideally you will have a good understanding of financial services, banking products and the underlying technology solutions and architectures or/and relevant experience of Digital/Ecommerce platforms

Requirements

* Experience developing Large scale data architecture for a Hadoop environment with at least Hive, Pig, Oozie and Spark

* Experience designing scalable data integration jobs, workflows and orchestration in a multi-TB traditional relational data warehouse and a large scale big data environment

* Experience in designing security, encryption, access control and data masking patterns for large scale batch data ingestion and processing pipelines on AWS

* Experience designing stream ingesting and processing data pipelines leveraging open source technologies like Kafka, Storm, Flink, Flume

* Strong experience working with RDMS databases (e.g. PostgreSQL or SQL Server), managing connection-pools, performance tuning and optimizations

* Exposure to the Hashicorp product stack (Terraform, Consul, Packer, Vault), Jenkins, Config Management and

If this sounds of interest please send me your CV ASAP for review

You are currently using an outdated browser.

Please consider using a modern browser such as one listed below: