Online since 1999 | 10,975 IT Jobs Live NOW

Sr. Data Engineer (AWS / Python)

Premium Job From Nigel Frank International
Recruiter: Nigel Frank International
Listed on: 25th July
Location: Los Angeles
Salary/Rate: £98,421 - £147,631
Type: Permanent
Start Date: ASAP

Job Description

Data Engineer - 701 (AWS & Python) Onsite/ Hybrid/ Remote This job is remote! Summary As a member of the Technology Services Team, the Senior Data Engineer will participate in the design and development of sophisticated data management systems, data science driven analytics and algorithmic trading platforms. This person will implement and maintain these processes in both internally hosted data center and in AWS in close coordination with onsite and offshore teammates. Duties and Responsibilities Design and develop Systems including operational requirements and infrastructure setup in an Agile software development paradigm Quickly learn new technologies and produce proof of concepts, specially using AWS, Big Data and Open-Source technologies Work on high priority production support issues, troubleshoot and formulate solutions for those issues in a time sensitive manner Develop processes to make Operations more manageable and robust, including code refactoring and tuning performance. Analyze existing systems and create technical documentation Qualifications & Requirements 5+ years of solid hands-on software development experience with focus on backend technologies and large volume distributed data processing including production support Bachelor's Degree in computer science or similar discipline Expertise in building backend systems using AWS Redshift, AWS EMR, SQL Server, PostgreSQL Expertise in AWS development. AWS Developer Certified is preferred Experience in building systems using programming language like SQL, Python and Scala Knowledge of Tableau, Time series databases, Data Lakes, Docker, AWS EKS (Kubernetes), Airflow will be pluses, but not required Must be knowledgable in Data Warehousing, Big Data Analytics and Distributed data processing Ability to work in fast paced, high pressure, agile environment, and willingness to learn any new technologies and apply them at work to stay ahead of the curve. Must be quick to jump into issues and rapidly resolve those with minimal guidance Strong team focus with outstanding organizational and interpersonal and communication skills Prior experience in financial industry/quantitative technical analysis will be a plus Databases - AWS Redshift, PostgreSQL, MS SQL Server; Familiarity with Timescale, Elastic Search/MongoDB Programming Languages - SQL, Python; exposure to JAVA Exposure to Tools - AWS - EMR, Lambda, EKS; Apache - Spark, Scala, Airflow; Talend, Tableau Strong System analysis, design, and development skills in an Agile environment Must be self-motivated, take ownership of work and be accountable for timely and quality delivery Working Conditions Must be able to perform the essential job duties. Work is performed primarily in an office environment. Typically requires the ability to sit for extended periods of time (80%+ each work day), ability to hear the telephone, ability to enter data on a computer and may also require the ability to lift up to 10 pounds. Remote work allowed.

Contact Name: Brennan Warnick
Reference: TJ/3086/111_1658788634
Job ID: 3122106

Browse all skill types