AWS Solution Architect - Kinesis, Lambda, Data Pipeline

This job has now expired please search on the home page to find live IT Jobs.

Data Architect, Solution Architect, AWS data pipelines, Amazon Kinesis, EMR Clusters, AWS Lambda, Redshift

My leading financial services client is looking for a lead AWS Solution Architect you must have a proven background designing data pipelines leveraging AWS technologies (e.g. AWS data pipelines, Amazon Kinesis, EMR Clusters, AWS Lambda, Redshift) . Strong working knowledge of architecture, performance and best practices in either Apache Hive or Apache Spark, ideally on EMR Clusters. Experience in architecting and designing big data solutions with NoSQL and MPP products. Together with experience with data governance, specifically developing data quality processes. Ideally you will have a good understanding of financial services, banking products and the underlying technology solutions and architectures or/and relevant experience of Digital/Ecommerce platforms

Technical Requirements

* Experience developing large scale data architecture for a multi-TB traditional relational data warehouse environment

* Experience developing large scale data architecture for a Hadoop environment with at least Hive, Pig, Oozie and Spark

* Experience designing scalable data integration jobs, workflows and orchestration in a multi-TB traditional relational data warehouse and a large scale big data environment

* Experience in designing security, encryption, access control and data masking patterns for large scale batch data ingestion and processing pipelines on AWS

* Experience designing stream ingesting and processing data pipelines leveraging open source technologies like Kafka, Storm, Flink, Flume

* Strong experience working with RDMS databases (e.g. PostgreSQL or SQL Server), managing connection-pools, performance tuning and optimizations

* Exposure to the Hashicorp product stack (Terraform, Consul, Packer, Vault), Jenkins, Config Management and

If this sounds of interest please send me your CV ASAP for review