Data Engineer

This job has now expired please search on the home page to find live IT Jobs.

Data Engineer Job Type: Full-Time, PermanentLocation: RemoteSalary: Up to 178k Summary

As a member of the Technology Services Team, the Senior Data Engineer will participate in the design and development of sophisticated data management systems, data science driven analytics and algorithmic trading platforms. This person will implement and maintain these processes in both internally hosted data center and in AWS in close coordination with onsite and offshore teammates.

Duties and Responsibilities

Design and develop Systems including operational requirements and infrastructure setup in an Agile software development paradigm

Quickly learn new technologies and produce proof of concepts, specially using AWS, Big Data and Open-Source technologies

Work on high priority production support issues, troubleshoot and formulate solutions for those issues in a time sensitive manner

Develop processes to make Operations more manageable and robust, including code refactoring and tuning performance. Analyze existing systems and create technical documentationQualifications & Requirements

5+ years of solid hands-on software development experience with focus on backend technologies and large volume distributed data processing including production support

Bachelor's Degree in computer science or similar discipline

Expertise in building backend systems using AWS Redshift, AWS EMR, SQL Server, PostgreSQL

Expertise in AWS development. AWS Developer Certified is preferred

Experience in building systems using programming language like SQL, Python and Scala

Knowledge of Tableau, Time series databases, Data Lakes, Docker, AWS EKS (Kubernetes), Airflow will be pluses, but not required

Must be knowledgable in Data Warehousing, Big Data Analytics and Distributed data processing

Ability to work in fast paced, high pressure, agile environment, and willingness to learn any new technologies and apply them at work to stay ahead of the curve.

Must be quick to jump into issues and rapidly resolve those with minimal guidance

Strong team focus with outstanding organizational and interpersonal and communication skills

Prior experience in financial industry/quantitative technical analysis will be a plus

Databases - AWS Redshift, PostgreSQL, MS SQL Server; Familiarity with Timescale, Elastic Search/MongoDB

Programming Languages - SQL, Python; exposure to JAVA

Exposure to Tools - AWS - EMR, Lambda, EKS; Apache - Spark, Scala, Airflow; Talend, Tableau

Strong System analysis, design, and development skills in an Agile environment

Must be self-motivated, take ownership of work and be accountable for timely and quality delivery