Online since 1999 | 11,844 IT Jobs Live NOW
Principal Software Engineer - Big Data
Premium Job From Sainsbury
Recruiter: Sainsbury's
Listed on: 20th November 2017
Location: London
Salary/Rate: Competitive plus benefits
Salary Notes: Competitive plus benefits
Type: Permanent
Start Date: ASAP
Reference: SainTJ016_expired
Contact Name: Sainsbury’s

This job has now expired please search on the home page to find live IT Jobs.

Sainsbury’s, one of the UK’s largest retailers, is investing heavily in digital innovation. We have built a centralised Data Platform in the cloud which allows business users to make better and faster decisions, supported by accurate and up-to-date data from the business. The team is growing rapidly and looking for talented colleagues to continue to deliver an ambitious and market leading data platform that lives up to Sainsbury’s industry leading reputation.

We are looking for talented Principal Data Platform Engineers to lead the design, build, and automate activities for this Data Platform. You will work closely with other Data Engineers, Data Scientists, and Devops Engineers across multiple platforms and technologies to create a highly scalable, secure, and performant data platform.

What I need to do
      Design, test, and deploy large scale distributed systems using engineering best practices in the enterprise production context
      Design smart and secure ways of storing, analysing, and processing complex data in the cloud, including in real-time
      Care about your craft, be aware of new technologies, and be keen to use them when appropriate
      Feed your insights to the product team to continuously improve the platform
      Be the technical lead of an agile development team
      Be diligent and positive about issue tracking, system monitoring, security, auditing, and other ways of ensuring the quality of the platform and the processes around it
      Provide third level support for production issues following the "you build it, you fix it" philosophy
      Define your career path, grow, and learn

What I need to know
      Technical leadership experience in an enterprise Hadoop production environment
      Distributed computing, its advantages and disadvantages in Big Data analytical applications
      Cloud computing and related challenges around security, bandwidth, etc.
      Hadoop application architecture, understanding batch vs. streaming
      Understanding statistics and data science to work closely with business analysts
      Service oriented architecture and APIs
      Unit, regression, and integration testing
      Version control
      Agile software development
      DevOps and infrastructure-as-code

Technologies we are using:
      Kafka, Spark, Hadoop, Hive, Impala
      AWS, Terraform, Ansible
      Scala, Java, R, Python

What I need to show
Communication and Influencing:

     Uses range of techniques to influence, adapts to situation

Analytical Thinking:
      Pushes boundaries in solving problems

Aptitude to Learn:
      Actively seeks feedback from multiple sources
Contributes to wider community in own area of expertise

Team Work:
      Supports a collective effort to resolve problems
      Uses strengths of team to deliver increased value

Leadership and Mentoring:
      Values differences

Commitment and Planning:
      Delivers ahead of expectations

Resources available to me
Line manager providing on-going support through 121’s and SMART objectives
Agile coach providing on-going support in terms of Agile ways of working
Wider development community sharing knowledge and support

What decisions I can make
Lead on decisions regarding technology choices for multiple teams
Shape the technical landscape using your experience
Leads on architectural decisions across multiple teams

To find out more information and to apply, please click the APPLY button.