Data Engineer -Manchester
Recruiter
BCT Resourcing
Listed on
25th August 2021
Location
Manchester
Salary/Rate
£70000 - £70000
Type
Permanent
Start Date
2021-08-25 16:29:19
This job has now expired please search on the home page to find live IT Jobs.
We are looking for an experienced Data Engineer to join a rapidly expanding team for one of the worlds leading Financial Services InstitutionsThey are building a greenfield data & services platform to deliver the latest intelligence insights and risk solutions to their clients. You will play a key part in that build operating within a start up mentality.
Key Responsibilities:
* To build & integrate highly scalable and robust data processing pipelines
* To work with clients to understand their data ingestion needs, providing capabilities to securely transfer data into their Azure data lake
* Managing data role-based access controls and tenant-separation
* To build data architecture for ingestion, processing surfacing of data for large-scale applications
* Write versioned and code-reviewed pipeline code to move, clean and prepare data
Skills & Experience:
* Proven experience as a data engineer
* An experienced and active programmer (Python, R, SQL)
* Knowledge around Spark, data lake analytics and big data processing is highly beneficial
* Understanding around data lake compression and indexing formats
* Knowledge of public cloud - Azure, AWS
* A desire and openness to learn and continuously improve yourself and your team
This is a fantastic opportunity to join a company that is striving to become a leader in their field, continuously implementing the latest technologies and tools!
This new platform will have Manchester as its home; however, this role is fully remote.
