Senior Data QA Engineer


Premium Job From Global Resourcing

Recruiter

Global Resourcing

Listed on

29th July 2019

Location

London

Type

Permanent

This job has now expired please search on the home page to find live IT Jobs.

The Senior Data QA Engineer will be responsible for the testing and validation of data pipelines, and showcase to subject matter experts to learn whether it meets their business outcomes. You will be expert at working in cloud environments, such as on Hortonworks and Cloudera based Hadoop clusters. Assurance of data security and privacy in the platform will be relevant to the data pipelines you validate. You will draw on your experiences to engage in discussion with the technical design lead and other technical staff, recommending options for continuous improvements to testing methods.

Key Responsibilities

Validate software delivered by Data Engineers against user story requirements

Ensure principles of privacy and security are assessed and designed into your data solutions

Write high quality, generalised test datasets and test methods for verifying and validating new functional and non-functional software, enabling automated testing wherever possible

Generate golden datasets to efficiently stress-test software and assure version control

Report QA outcomes to Data Engineers and Business Owners

Work in an agile way and to do so closely with colleagues

Develop new and maintain existing functionality to QA testing for the Data Services platform

Provide documentation and training material to support knowledge retention

Maintain a high-quality audit trail of your software testing

Key Skills

Understanding of Quality Assurance data practices

Awareness of OWASP top 10 security considerations and associated tools

Hands-on experience writing unit tests and mocking the data

Hands on experience to analyse regression reports, automated builds and KPI's

Experience of Test-Driven Development applying pair programming and refactoring principles

Strong experience of writing BDD acceptance criteria or scenarios

Participated in full development data lifecycle

 Knowledge of software development experiences

3+ years experience in one of JS/Java/C#  programming languages and must have desire to develop strong experience in SQL/HQL for complicated queries

Automated test framework development from scratch using Python

Experience or at least keen interest in using big data technologies like PySpark/Yarn and Hive

 Hands on experience with Linux and Microsoft Azure cloud environment or equivalent

Experience in using considerable data sizes (TB/PB)

Exposure to continuous build and deployment process, with hands on experience in using build systems such as Oozie/Jenkins

Familiar with defect management systems either using JIRA or similar

Willingness to constructively challenge the work of others, to ensure high standards are achieved

Experience of carrying out showcase acceptance demonstrations with your stakeholders

Proven experience of innovation and improving best practice

You are currently using an outdated browser.

Please consider using a modern browser such as one listed below: