Software & Data Engineer


Premium Job From LA International Computer Consultants Ltd

Recruiter

LA International Computer Consultants Ltd

Listed on

16th June 2021

Location

England

Salary/Rate

Negotiable

Salary Notes

Negotiable

Type

Contract

Start Date

ASAP

This job has now expired please search on the home page to find live IT Jobs.

FULLY REMOTE

Software/Data Engineer

* Start ASAP

* 6 Months Rolling Contract

* Fully Remote for the duration

Software Engineer with Data Engineering skills to build a sophisticated data pipeline automation framework that automates batch and real-time big data platforms.

Essential Skills

* Solid software development experience in modern programming languages, like Python, Scala and their ecosystem

* Experience with core Big Data technologies: Hadoop ecosystem, Spark, Flume, Flink

* Infrastructure automation with the following: Teraform, Ansible

* Advanced Linux skills

* Monitoring with the following: Zabbix, Prometheus, AWS CloudWatch, Elastic

* Visualization of metrics using Grafana, Kibana or similar

* Ability to develop CI/CD Jenkins pipelines

* Experience with task scheduling framework such as Airflow

* Experience with backend framework such as Flask

* Solid understanding and experience with ANSI SQL

* Solid understanding and experience with containers and orchestration frameworks: Mesos DC/OS, ECS, EKS, Kubernetes or Rancher

* Basic understanding of networks technology stack: OSI model, TCP/IP, HTTP 2.0, DNS, proxy servers, firewalls

Optional Skills

* Functional programming

* Experience with at least one frontend framework

* Knowledge of security and access control with Ambari, Ranger, Knox with AD & Kerberos

* Solid understanding of ETL pipeline developed with AWS Glue

* Realtime streaming application development in Spark or Flink using Python/Scala

* Experience with cloud data warehouse solutions like Redshift/Snowflake

* Experience with NoSQL databases like HBASE/MongoDB/Cassandra

* Cloud cost control strategies

Personal Traits

* Excellent team collaborator

* Ability to work in an agile team

* Ability to step out of the comfort zone and work on unfamiliar tools and technologies

* A willingness to be T-Shaped

* Ability to figure out the business needs behind the work

* Ability to communicate really well within the team as well as with stakeholders outside the team

* Is helpful and likes to solve challenges

LA International Computer Consultants Ltd is an HMG Approved Consultancy and operates as an IT & Engineering Consultancy or as an Employment Business & Agency, depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, we welcome applications from all sections of the community and from people with diverse experience and backgrounds.

Award Winning LA International Computer Consultants Ltd (Recruiter Awards for Excellence - Best IT, Best Public Sector & Gold Awards) and the most prestigious award that any business can receive The Queens Award for Enterprise: International Trade 2015.

You are currently using an outdated browser.

Please consider using a modern browser such as one listed below: