Software & Data Engineer
Recruiter
Listed on
Location
Salary/Rate
Salary Notes
Type
Start Date
This job has now expired please search on the home page to find live IT Jobs.
FULLY REMOTE
Software/Data Engineer
* Start ASAP
* 6 Months Rolling Contract
* Fully Remote for the duration
Software Engineer with Data Engineering skills to build a sophisticated data pipeline automation framework that automates batch and real-time big data platforms.
Essential Skills
* Solid software development experience in modern programming languages, like Python, Scala and their ecosystem
* Experience with core Big Data technologies: Hadoop ecosystem, Spark, Flume, Flink
* Infrastructure automation with the following: Teraform, Ansible
* Advanced Linux skills
* Monitoring with the following: Zabbix, Prometheus, AWS CloudWatch, Elastic
* Visualization of metrics using Grafana, Kibana or similar
* Ability to develop CI/CD Jenkins pipelines
* Experience with task scheduling framework such as Airflow
* Experience with backend framework such as Flask
* Solid understanding and experience with ANSI SQL
* Solid understanding and experience with containers and orchestration frameworks: Mesos DC/OS, ECS, EKS, Kubernetes or Rancher
* Basic understanding of networks technology stack: OSI model, TCP/IP, HTTP 2.0, DNS, proxy servers, firewalls
Optional Skills
* Functional programming
* Experience with at least one frontend framework
* Knowledge of security and access control with Ambari, Ranger, Knox with AD & Kerberos
* Solid understanding of ETL pipeline developed with AWS Glue
* Realtime streaming application development in Spark or Flink using Python/Scala
* Experience with cloud data warehouse solutions like Redshift/Snowflake
* Experience with NoSQL databases like HBASE/MongoDB/Cassandra
* Cloud cost control strategies
Personal Traits
* Excellent team collaborator
* Ability to work in an agile team
* Ability to step out of the comfort zone and work on unfamiliar tools and technologies
* A willingness to be T-Shaped
* Ability to figure out the business needs behind the work
* Ability to communicate really well within the team as well as with stakeholders outside the team
* Is helpful and likes to solve challenges
LA International Computer Consultants Ltd is an HMG Approved Consultancy and operates as an IT & Engineering Consultancy or as an Employment Business & Agency, depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, we welcome applications from all sections of the community and from people with diverse experience and backgrounds.
Award Winning LA International Computer Consultants Ltd (Recruiter Awards for Excellence - Best IT, Best Public Sector & Gold Awards) and the most prestigious award that any business can receive The Queens Award for Enterprise: International Trade 2015.