Principal Software Engineer - Big Data
Recruiter
Listed on
Location
Salary/Rate
Salary Notes
Type
Start Date
This job has now expired please search on the home page to find live IT Jobs.
Sainsbury’s, one of the UK’s largest retailers, is investing heavily in digital innovation. We have built a centralised Data Platform in the cloud which allows business users to make better and faster decisions, supported by accurate and up-to-date data from the business. The team is growing rapidly and looking for talented colleagues to continue to deliver an ambitious and market leading data platform that lives up to Sainsbury’s industry leading reputation.
We are looking for talented Principal Data Platform Engineers to lead the design, build, and automate activities for this Data Platform. You will work closely with other Data Engineers, Data Scientists, and Devops Engineers across multiple platforms and technologies to create a highly scalable, secure, and performant data platform.
What I need to do
Design, test, and deploy large scale distributed systems using engineering best practices in the enterprise production context
Design smart and secure ways of storing, analysing, and processing complex data in the cloud, including in real-time
Care about your craft, be aware of new technologies, and be keen to use them when appropriate
Feed your insights to the product team to continuously improve the platform
Be the technical lead of an agile development team
Be diligent and positive about issue tracking, system monitoring, security, auditing, and other ways of ensuring the quality of the platform and the processes around it
Provide third level support for production issues following the "you build it, you fix it" philosophy
Define your career path, grow, and learn
What I need to know
Technical leadership experience in an enterprise Hadoop production environment
Distributed computing, its advantages and disadvantages in Big Data analytical applications
Cloud computing and related challenges around security, bandwidth, etc.
Hadoop application architecture, understanding batch vs. streaming
Understanding statistics and data science to work closely with business analysts
Service oriented architecture and APIs
Unit, regression, and integration testing
Version control
Agile software development
DevOps and infrastructure-as-code
Technologies we are using:
Kafka, Spark, Hadoop, Hive, Impala
AWS, Terraform, Ansible
Scala, Java, R, Python
What I need to show
Communication and Influencing:
Uses range of techniques to influence, adapts to situation
Analytical Thinking:
Pushes boundaries in solving problems
Aptitude to Learn:
Actively seeks feedback from multiple sources
Contributes to wider community in own area of expertise
Team Work:
Supports a collective effort to resolve problems
Uses strengths of team to deliver increased value
Leadership and Mentoring:
Values differences
Commitment and Planning:
Delivers ahead of expectations
Resources available to me
Line manager providing on-going support through 121’s and SMART objectives
Agile coach providing on-going support in terms of Agile ways of working
Wider development community sharing knowledge and support
What decisions I can make
Lead on decisions regarding technology choices for multiple teams
Shape the technical landscape using your experience
Leads on architectural decisions across multiple teams
To find out more information and to apply, please click the APPLY button.
