Online since 1999 | 12,505 IT Jobs Live NOW
Principal Software Engineer - Big Data
Premium Job From Sainsbury
Recruiter: Sainsbury's
Listed on: Today, 3:51pm
Location: London
Salary Notes: Competitive plus benefits
Type: Permanent
Start Date: ASAP
Reference: SainTJ016
Contact Name: Sainsbury’s
Sainsbury’s, one of the UK’s largest retailers, is investing heavily in digital innovation. We have built a centralised Data Platform in the cloud which allows business users to make better and faster decisions, supported by accurate and up-to-date data from the business. The team is growing rapidly and looking for talented colleagues to continue to deliver an ambitious and market leading data platform that lives up to Sainsbury’s industry leading reputation.

We are looking for talented Principal Data Platform Engineers to lead the design, build, and automate activities for this Data Platform. You will work closely with other Data Engineers, Data Scientists, and Devops Engineers across multiple platforms and technologies to create a highly scalable, secure, and performant data platform.

What I need to do
      •     Design, test, and deploy large scale distributed systems using engineering best practices in the enterprise production context
      •     Design smart and secure ways of storing, analysing, and processing complex data in the cloud, including in real-time
      •     Care about your craft, be aware of new technologies, and be keen to use them when appropriate
      •     Feed your insights to the product team to continuously improve the platform
      •     Be the technical lead of an agile development team
      •     Be diligent and positive about issue tracking, system monitoring, security, auditing, and other ways of ensuring the quality of the platform and the processes around it
      •     Provide third level support for production issues following the "you build it, you fix it" philosophy
      •     Define your career path, grow, and learn

What I need to know
      •     Technical leadership experience in an enterprise Hadoop production environment
      •     Distributed computing, its advantages and disadvantages in Big Data analytical applications
      •     Cloud computing and related challenges around security, bandwidth, etc.
      •     Hadoop application architecture, understanding batch vs. streaming
      •     Understanding statistics and data science to work closely with business analysts
      •     Service oriented architecture and APIs
      •     Unit, regression, and integration testing
      •     Version control
      •     Agile software development
      •     DevOps and infrastructure-as-code

Technologies we are using:
      •     Kafka, Spark, Hadoop, Hive, Impala
      •     AWS, Terraform, Ansible
      •     Scala, Java, R, Python

What I need to show
Communication and Influencing:

      •    Uses range of techniques to influence, adapts to situation

Analytical Thinking:
      •     Pushes boundaries in solving problems

Aptitude to Learn:
      •     Actively seeks feedback from multiple sources
Contributes to wider community in own area of expertise

Team Work:
      •     Supports a collective effort to resolve problems
      •     Uses strengths of team to deliver increased value

Leadership and Mentoring:
      •     Values differences

Commitment and Planning:
      •     Delivers ahead of expectations

Resources available to me
Line manager providing on-going support through 121’s and SMART objectives
Agile coach providing on-going support in terms of Agile ways of working
Wider development community sharing knowledge and support

What decisions I can make
Lead on decisions regarding technology choices for multiple teams
Shape the technical landscape using your experience
Leads on architectural decisions across multiple teams

To find out more information and to apply, please click the APPLY button.

Browse all skill types