Sr. Data Engineer | 6 Month CTH | Remote

This job has now expired please search on the home page to find live IT Jobs.

Are you currently looking for a new opportunity? If so, I have a role that might be just the thing. I am actively seeking a Sr. Data Engineer to join my client's team. This would be for a 6+ month contract opportunity with the potential for full time conversion. In addition, this would be fully remote, no on-site requirement at this time.What you'll get to do…Work in an agile(scrum) development environment, constantly shipping and iterating.Develop high-quality batch and streaming big data pipelines.Collaborate with our Data Consumers, gathering requirements, and delivering complete data solutions.Own the development, and maintenance of data sets that drive key business decisions.Adopt and define the standards and best practices in data engineering including data integrity, performance optimisation, validation, reliability, and documentation.Keep up to date with advances in big data technologies and run pilots to develop the data architecture to scale with the increased data volume using cloud services.Triage many possible courses of action in a high ambiguity environment, making use of both quantitative analysis and business judgement.Your experience should include…Experience working with Big Data technologies (Hadoop, Hive, Spark, Kafka, Kinesis).Experience with large-scale data processing systems for both batch and streaming technologies (Hadoop, Spark, Kinesis, Flink).Experience in programming using Python, Java or Scala.Experience with data orchestration tools (Airflow, Oozie, Step Functions).Solid understanding of database technologies including NoSQL and SQL.Data lake design strategies for meta data, ontology, governance, authorization, etc.Track record of delivering reliable data pipelines with solid test infrastructure, CICD,data quality checks, monitoring, and alerting.Strong organizational and multitasking skills with the ability to balance competing priorities.Excellent communication (verbal and written) and interpersonal skills and an ability to effectively communicate with both business and technical teams.An ability to work in a fast-paced environment where continuous innovation is occurring, and ambiguity is the norm.Execute a data platform strategy in collaboration with team members, architects, product managers, and other groups across the businessCollaborate as a significant individual technical contributor to meet overall team objectives and goalsStay up to date on emerging technologies, standards, and protocolsYou might also have…Experience with AWS big data technologies - S3, EMR, Kinesis, Redshift, Glue - highly preferredExperience in building Tableau reports for analytics If at all interested please email me at [email protected]