Data Engineer

This job has now expired please search on the home page to find live IT Jobs.

Job DescriptionData Engineer - $155k - 20%-40% Bonus - 1 day in Chicago Office Every Other Week - 2 Anchor Days Per Month - Full Time and Pemranent - Data Driven Organization - No Migration NeededRole & ResponsibilitiesFocused responsibility on translating business requirements into tangible data projects developing SQL queries, pipelines, stored procedures, data warehouse load process, etc. that support the business goals.Manage data pipelines: assist in creation of end-to-end data pipelines from external and internal sources to the data warehouse; create new pipelines, recreate config files as needed.Scale: Deliver performance at scale, and accurately anticipate system enhancement needsData integrity: Data manipulation, error identification and handling, and modelingTune and optimize current jobs for performance and throughput across Modern Data Estate.Apply business and database analysis skill to gain deep understanding of user's needs and aid in the definition and creation of solutions that meet the needs of the business users.Comprehensive documentation of all developed software & repositories and assist in documenting and maintaining requirement specification document.Assist with troubleshooting efforts for pre-production and production related code.Develop custom database objects, stored procedures, functions.Communicate the status of project and planning activities with team leads lead business analyst and surface hurdles early on to find a resolution.Analyze existing SQL queries for performance improvements.Data mapping, transformation and performing ETL based on complex logic.Enhance and support Modern Data Warehousing and data management projects along with ETL development.Design system integrations as required for extracting data, enhancing data models and processes for reporting purposes.Mapping of data sources, data movement and reconciliation with the goals of ensuring data quality & consistency and the ability to satisfy relevant business requirements by following best practices.Collaboration with business analysts and business stakeholders to ensure a thorough understanding of strategic data requirements.Data analysis / data profiling to understand gaps, inconsistencies and other quality issues in existing source system data, and develop data sourcing solutions, as well as collaborating with stakeholders to identify, document and implement corrections / business rules / workarounds.Ability to manage priorities effectively in a dynamic and high performing team setting.Skills & QualificationsBachelor's Degree or higher and an expert-level programming skills with 7+ years' work experience.Experience in Tools used in the Modern Data Stack - Microsoft Azure, Azure Data Lake, Synapse, Databricks.Mastery of SQL, Data warehouse design and implementation experience.Advanced understanding of software and pipeline development aimed at data-driven business value generation.Advanced experience in development, construction, testing, and maintenance of data architecturesA strong technical understanding of ETL processes, data analytics tools, and their associated technologies is required.Sound understanding of software engineering best practices including version control and CI/CD; attention to detail and ready to work collaborativelyStrong project management skills in a deadline-oriented environment are required.Self-starter with a can-do attitude to engage in hands-on fast prototyping and proven business acumen.Excellent proven personal leadership, collaboration, communication, and analytical skills are required.Excellent analytical, problem-solving and decision-making skills, interpreting and analyzing data.Sound understanding of relational and non-relational databases.Experience working in Azure cloud environment is a plusExperience with Database Administrator roles (backup, restore, security) a plusAnalytical capability: strong ability to analyze and evaluate data, formulate accurate conclusions and clearly recommend creative solutionsProven critical thinking and problem-solving skillsBenefits20%-40% Bonus Medical/Dental Hybrid Schedule 401k Student Debt Program