Hadoop Principal Developer

This job has now expired please search on the home page to find live IT Jobs.

What it’s about:

The Data Lab is a small team who run an onsite Hadoop system supported by Hortonworks. The key role of the developer is to archive data from legacy systems, work with data science team, manage data within Hadoop and be capable of working closely with other technical teams.

What you will be doing

                    Producing design and estimations, delivery of developments to budget in the given technology and when required producing detailed technical specification for third party resources and / or in-house custom development.

                    Assist the architectural solution through involvement with the solution architect / business users.

                    To ensure within a program or project that the technical solution follows the high level design and architectural solution, both within the given technology, or across the technology portfolio. Report on progress of development or issues and risks for onward dissemination.

                    Research, present and test cutting edge technologies within CA policies and practices

                    Definition / ownership and adherence of the development standards / processes in the given technology

                    To mentor less experienced development resource within the given technology to support continuous learning and improvement.

What you’ll bring to the team:

The successful candidate will be proficient at:

                    Agile project life cycle

                    Data Modelling

                    Hadoop developer experience using Java, python or scala

                    Data management in HDFS and Hive

                    Writing bash scripts

                    Using tools like oozie and sqoop

You will have extensive experience:

                    As a relational database senior developer for 2 years min

                    Illustrating a complete understanding of Data Lifecycle including design, development, testing and implementation complex data models

                    Monitoring and troubleshooting data issues

                    Using ETL tools

                    In Analytics, Reporting, MDM, Data Governance

Technical Requirements Summary:

The types of solutions you would be expected to collaborate on will require you to demonstrate an:

                    In-depth experience of data modelling - creating a schema from a logical or physical models

                    In-depth experience of project life cycles - ability to work within an agile team or to work to a Waterfall or PrinceII project plan

                    In-depth experience of data life cycles, data governance, QA testing (using scripts) and good working practices - ability to demonstrate secure and good working practices relating to the ingestion, storing, testing and management of data

                    In-depth experience of Sqoop, Oozie, Bash Scripts, Spark, MapReduce, HDFS, Hive, Java, Scala, Python, R - the ability to use these tools to manage data within the Hadoop cluster and to transfer these skills to new tools CA adopts

                    In depth experience of cutting edge tools like NiFi, Kafka, Storm, Spark - demonstrate the ability to use and train other developers to use these tools effectively and to transfer these skills to new tools CA adopts

                    Knowledge of data management tools like Collibra - understanding of what how data management tools work

                    Knowledge of Cloud technologies - demonstrate an understanding of cloud technologies like AWS, AZURE, etc

About Cambridge Assessment

Cambridge Assessment is Europe's largest assessment group, incorporating three major awarding bodies. It plays a leading role in researching, developing and delivering assessment to eight million candidates in 170 countries every year. The Group is a department of the University of Cambridge and a not-for-profit organisation.

This is an excellent opportunity to join a market leader and be rewarded with valuable learning opportunities, a competitive salary and benefits.

Benefits

In addition to a competitive salary, we offer a comprehensive package of benefits to help with your life both inside and outside of work:

                    Generous contributory pension

                    28 days annual leave, plus bank holidays

                    Annual performance related bonus and increases (discretionary)

                    Enhanced maternity/paternity pay and childcare voucher scheme

                    Childcare vouchers

                    Employee discount and cash back scheme at 2,500 retailers

                    Cycle scheme

                    Season Ticket Loan

                    Subsidised staff restaurants

                    Support for professional qualifications

                    Discounted access to the University of Cambridge Sport Centre, along with various other local gyms.

We know that diversity of thinking, backgrounds and approaches leads to innovation and creates an atmosphere where everyone’s contribution is valued. As well as wanting to create diverse teams, we also value diversity in the way our people approach their work. Work/life balance is important to us at Cambridge Assessment and we offer our colleagues a range of flexible working options according to the needs of the business and the individual, so please let us know of any flexible working requirements when applying and we can see how we can support you.

The closing date for receipt of applications is 23 September 2018 and interviews will be held in the following week.

If you’re successful at interview stage we will ask you to undergo background screening (carried out by Credence Background Screening Ltd), to ensure that all information provided to us is accurate. We wish you all the very best with your application.

CAMBRIDGE ASSESSMENT IS AN EQUAL OPPORTUNITIES EMPLOYER