Streaming Ingestion Engineer

This job has now expired please search on the home page to find live IT Jobs.

JOB TITLE: Streaming Injestion EngineerSALARY: £85,255 - £100,300LOCATION: ManchesterHOURS: Full-timeWORKING PATTERN: Our work style is hybrid, which involves spending at least two days per week, or 40% of our time, at one of our office sites. Our team We're the Data Movement Lab building and managing the future centralised nervous system, using the power of our existing batch technologies centred on IBM's Infosphere DataStage stack, alongside our emerging cloud strategy and streaming analytics capability to get closer to our customers. This will be the backbone of our Event data processing hub. Our goal is to democratise Lloyds Bank's dataset. We're currently supporting 1'000's of processes across the Bank, acting as the Enterprise Data Integration function within the Bank for Retail, Insurance, Risk, Fraud, Customer Insight, Commercial and Corporate businesses. Core Purpose of the role Our team is looking for a hardworking and adaptable Lead Engineer with depth of knowledge in the Data Domain. A technical leader with data engineering expertise, a growth mind-set and a dedication to technical leadership. As an engineering lead for the Lab, you will lead a large and diverse agile engineering teams, building pipelines patterns and frameworks that enable data to be efficiently and effectively processed at scale. You will work alongside the Product Owner in the development of technical roadmaps supporting the strategy of the Products and Services, ensuring that engineers' capabilities are aligned to the plans. As a key member of our agile development community, you'll evolve our data capabilities whilst embracing the best industry standards. What you'll be involved in Work hand-in-hand with your Product Owner counterpart in a 'two-in-a-box' model to jointly lead the Lab team providing a great value proposition to your stakeholders from across the company.Lead a multi-disciplinary team by blending both deep domain and technical expertise across a number of component and feature teams who build, deploy and maintain capabilities and services enabling earlier value release for our customers.Within the framing of a reference architecture and strategy, set the technical direction and roadmap for the Lab, ensuring software is built consistently using relevant patterns and these patterns and practices are propagated across the wider community.Ensure all Engineering work in the Lab is carried out in line with the Bank standards and that teams are aware of, make decisions within and assist in the implementation and operation of the security, cyber, risk and control management framework.Be part of the broader Data & Machine Learning engineering leadership team driving and supporting initiatives outside the core Lab and Platform as part of the leadership and engineering communityHire and grow engineering talent as well as coaching and mentoring colleagues to enable them to reach their full potential. Essential skills and experience: Strength in collaboration as Data & Machine Learning Platform requires its Labs and Programmes to collaborate in building end-to-end Data products and services across LBG; so, collaboration needs to be a key part of your DNA.An experienced technical leader, able to inspire and encourage the best from their teams, with a passion for coaching and mentoring of less experienced software engineers.Able to show capability to change, evolve and to learn new tools and techniques and help and encourage others to do likewise.Expertise in proto-typing, building, deploying, and maintaining large scale data solutions.Extensive software engineering background with one or more programming languages in a complex technology environmentTechnical know-how of ETL Tooling and Streaming and how they fit with cloud technologies experience and delivering data engineering solutions.Experience in end-to-end delivery of software products using Agile and DevOps, with capabilities such as GitHub, Jenkins and UrbanCode methodologies, demonstrating engineering excellence and a passion for automationAdditionally, data domain technology experience including:Database technology such as Teradata, Oracle, Hadoop, DB2 and familiarity with NoSQL databases such as Cassandra and HBaseExpertise in Container & Virtualization/Hypervisor technologies such as K8,firecracker/gVisor/ cloud--hypervisor/kata-containersExpertise in Cloud Native technologies including networking & security is a plusExperience with Linux kernel technologies such as kernel modules, cgroups/namespaces, eBPF, XDP, etcExcellent experience in at least one programming language: Java, Scala, Python, GOExpertise in Language Runtimes / VMs (JVM/WASM, etc Why Lloyds Banking Group Like the modern Britain we serve, we're evolving. Investing billions in our people, data and tech to transform the way we meet the ever-changing needs of our 26 million customers. We're growing with purpose. Join us on our journey and you will too. About working for usOur focus is to ensure we're inclusive every day, building an organisation that reflects modern society and celebrates diversity in all its forms. We want our people to feel that they belong and can be their best, regardless of background, identity or culture. We were one of the first major organisations to set goals on diversity in senior roles, create a menopause health package, and a dedicated Working with Cancer initiative. And it's why we especially welcome applications from under-represented groups. We're disability confident. So if you'd like reasonable adjustments to be made to our recruitment processes, just let us know We also offer a wide-ranging benefits package, which includes: A generous pension contribution of up to 15%An annual performance-related bonusShare schemes including free sharesBenefits you can adapt to your lifestyle, such as discounted shopping30 days holiday, with bank holidays on topA range of wellbeing initiatives and generous parental leave policies Want to do amazing work, that's interesting and makes a difference to millions of people? Join our journey.