Azure Data Engineer (Mid-Level)

This job has now expired please search on the home page to find live IT Jobs.

Job Title: Azure Data/ETL Engineer

Job Type: PERM/Full-Time

Salary: $145,000-165,000 + excellent bonus packages

Location: Chicago, IL (must be on-site twice monthly)REQUIRED:Experience in Tools used in the Modern Data Stack - Microsoft Azure, Azure Data Lake, Synapse, DatabricksMastery of SQL, Data warehouse design and implementation experienceAdvanced understanding of software and pipeline development aimed at data-driven business value generationExperience implementing data solutions in AzureBuilding pipelines in Azure Data FactoryExperience building and managing Data Lakes and Data WarehousesStrong technical understanding of ETL processes, data analytics tools, and their associated technologies is requiredJob Functions:Focused responsibility on translating business requirements into tangible data projects developing SQL queries, pipelines, stored procedures, data warehouse load process, etc. that support the business goalsManage data pipelines: assist in creation of end-to-end data pipelines from external and internal sources to the data warehouse; create new pipelines, recreate configuration files as neededDeliver performance at scale, and accurately anticipate system enhancement needsData integrity - Data manipulation, error identification and handling, and modelingAssist with troubleshooting efforts for pre-production and production related codeDevelop custom database objects, stored procedures, functions.Analyze existing SQL queries for performance improvementsData mapping, transformation and performing ETL based on complex logicEnhance and support Modern Data Warehousing and data management projects along with ETL developmentDesign system integrations as required for extracting data, enhancing data models and processes for reporting purposesMapping of data sources, data movement and reconciliation with the goals of ensuring data quality & consistencyData analysis / data profiling to understand gaps, inconsistencies and other quality issues in existing source system data, and develop data sourcing solutions, as well as collaborating with stakeholders to identify, document and implement corrections / business rules / workaroundsDevelop a highly scalable, reliable, and high-performance data processing pipelines to extract, transform and load data from various systemsDevelop and enhance data delivery pipelines, data architecture, leveraging the latest Azure cloud-based data processing technologiesProvide research, high-level design and estimates for data transformation and data integration from source applications to end-user BI solutionsExperience/Knowledge:5+ years of experience in a Data Engineering role.Hands-on experience building and managing Data Lakes & Data Warehouses.Minimum 3+ years of experience with implementing data solutions in Azure, including Azure Data Factory, Azure Data Lake Store and other relevant servicesExperience with SQL, Python/Java, and SOAP/REST Web ServicesStrong development hands on background in creating pipelines, data flows and complex dataExperience with Azure Data Factory in building pipelinesHands on experience in using the Azure data copy and data flow activitiesUnderstanding of APIs and data processing. Knowledge of Business Intelligence, Analytics and Data Science Experience working in Agile and Extreme Programming methodologies in a continuous deployment environmentWorking knowledge of server configuration / deployment infrastructure Benefits:Excellent comp packagesIncredible growth-oriented company cultureMedical/Dental/Vision401KPTORemote *Please email a copy of your resume to [email protected] for consideration! Nigel Frank International is the global leader for Microsoft Azure recruitment, advertising more Microsoft Azure jobs than any other agency. We work with both Microsoft Partners & End Users throughout North America. By specializing solely in placing candidates in the Microsoft Azure market, we've built relationships with the key employers across the nation and have an unrivalled understanding of where the best opportunities are.We understand the need for discretion and would welcome the opportunity to speak to any Azure candidates that are considering a new career or job either now or in the future. Confidentiality is of course guaranteed.Please call or email [email protected] / (718) 412-1203 for additional information about the Azure market and available Azure job opportunities in your area.See www.nigelfrank.com for more fantastic Azure opportunities!Nigel Frank International Inc. is acting as an Employment Agency in relation to this vacancy.