Data Engineer

This job has now expired please search on the home page to find live IT Jobs.

***SC Cleared***

Data Engineer

6 Month contract initially + Extensions

Remote + 1 day per week onsite; London

Market rates (Via Umbrella-PAYE)

We have a great opportunity with a great organisation, a true leader in their field. We are looking for a number of Data Engineers to join the successful team on a fantastic program of work.

The available role is a (senior or) mid-level data engineer on a team responsible for designing, implementing and supporting data pipelines on the client's strategic data platform. Delivery will be through close partnerships with other data engineers, data scientists and key business stakeholders to ensure excellent business outcomes.

From a technical perspective, we build our pipelines by making use of an open-source orchestration tool to wrap around PySpark code, so it is essential to have experience of using PySpark. Exposure to Hive is necessary, alongside standard methodology in how to craft data pipelines and store data in an efficient and performant manner. Experience of on-premise data platforms (HDP/CDP) is required, but a broader interest and knowledge of cloud data platforms would be advantageous

Key Skills & Experience:

* Ability to design pipelines/solutions while incorporating security and service considerations (Senior Data Eng).

* Extensive experience of delivering data pipelines on Hortonworks/Cloudera on-prem installations (Senior Data Eng).

* Experience of delivering data pipelines on Hortonworks/Cloudera on-prem installations.

* Work with testing team to ensure pipelines are tested thoroughly.

* Experience using Python or Spark.

* Linux or Unix navigation skills.

* Experience of distributed computing.

* Understanding of standard methodologies for development and use of source control, preferably with experience with Git.

* Experience with using CI/CD environments using industry standard tools, preferably Jenkins.

This is an excellent opportunity on a great project of work, if you are looking for your next exciting opportunity, apply now for your CV to reach me directly, we will respond as soon as possible.

Due to the nature and urgency of this post, candidates holding or who have held high level security clearance in the past are most welcome to apply. Please note successful applicants will be required to be security cleared prior to appointment which can take up to a minimum 10 weeks. LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, LA International welcome applications from all sections of the community and from people with diverse experience and backgrounds.

Award Winning LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period.