Big Data Engineer

This job has now expired please search on the home page to find live IT Jobs.

Big Data Engineer/£525-£625/London/Contract

The successful Big Data Engineer will have a track-record of designing, developing and testing big data solutions and will possess technical knowledge of all stages involved in building large scale applications and data processing systems.

The perfect Big Data Engineer will have the ability to work within a large team to develop and implement optimal solutions, then maintain and monitor the quality.

Day to day role:

* Responsible for supporting the developers

* Expanding and optimising the data pipelines on Hadoop, PostgreSQL and Spark to deliver usable data to business requirements

* Deploy to, work on and manage AWS especially EMR and S3

Must have Skills:

* Hadoop based big data frameworks

* Spark

* One of Programming Languages - Scala, Python

* RDBMS with SQL Server preferred

* No SQL and in-memory databases

Nice to have skills

* Visualization tools (Spotfire, PowerBI)

* OpenCV

* Understanding of CNN in deep learning

* Source control using GIT/VSTS

* Cloud tech (AWS)

* Rest API using Python/Scala

This is an excellent opportunity for a talented Big Data Engineer where the culture is one that promotes creativity and the ability to think outside of the box.

If you feel you'd be a good fit please send your CV to or call Patrick Robinson:

[email protected]

0203 878 8405