AWS Data Engineer. Big Data - Financial Serivces


Premium Job From Experis IT

Recruiter

Experis IT

Listed on

16th February 2018

Location

London

Salary/Rate

Negotiable

Salary Notes

Negotiable

Type

Contract

Start Date

1-4 weeks

This job has now expired please search on the home page to find live IT Jobs.

Big Data Developer, AWS, Hadoop, Data Pipelie, Amazon Kinesis, Redshift, Hashicorp, Terraform, SQL, PostgreSQL, Python, Data lake

My leading banking /financial services client is looking for a AWS Data Engineer/ Data Developer to join a ground breaking project- you will be getting involved in the next generation of a data platform including a fully governed and managed data lake as the single source of truth.

You will be implement and operate data ingestion and processing pipeline for collecting millions of metrics per day from client applications and users. Develop data models for various modern data storage and analytics engines. Write code to develop new software products and/or features. Work with data scientists and business stakeholders to understand, capture and interpret requirements

A key element is to bring external DevOps best practice and keep abreast of new tools and ways of working that may improve the efficiency of the DevOps function and enhance its technology platform.

Technical Skills (If you have a mixture of the below that would be great)

* Experience in developing data ingestion and processing pipelines on AWS (at least 12 months of hands-on experience)

* Experience developing data integration jobs for multi-TB traditional relational data warehouses

* Experience developing data integration jobs for Hadoop based big data environment (Specifically Hadoop, Hive, Pig, Spark, Oozie)

* Strong background in designing and optimizing ETL processes to transform large volumes of data from a variety of data sources to a denormalized form

* Experience building stream ingesting and processing data pipelines leveraging open source technologies like Kafka, Storm, Flink, Flume

* Strong experience working with RDMS databases (e.g. PostgreSQL), managing connection-pools, performance tuning and optimizations

* Experience with complex SQL queries and relational models, 3+ years programming in SQL and Python

If this sound of interest please forward over you profile or call to discuss in more detail

You are currently using an outdated browser.

Please consider using a modern browser such as one listed below: