Freelance Big Date Solution Engineer 100% Remote

This job has now expired please search on the home page to find live IT Jobs.

Dear Freelancer,for my client I'm looking for a Big Data Solution Engineer. This includes the following responsibilities:Rollout the Allianz Global Data Platform (GDP) to our customers and support the adaption of the technical services and the data capabilitiesDesign the solutions of the complete use-case pipelines, from data ingestion to data processing, software deployment and feedback loopUnderstand and be able to explain advantages and disadvantages of the proposed solutions to internal and external stakeholdersBuild and maintain data driven applications on top of GDPDefine and apply best practices based on our platformContribute to improve the GDP stack and to define the final production environmentKeep up with trends and evolving technology in the big data and analytics worldIdentify opportunities to improve performance, reliability and automationWrite technical documentation, announcements, and blog posts about our platform on internal channelsTechnical SkillsOur platform is a diverse product consisting of several technologies. This characteristic should be reflected in our cross functional team of individuals who have a deep technical expertise in their core areas and at the same time are able to work also outside of their core area. We encourage to contribute your individual strengths and personality to the team and give you the room to develop some new skills and experiences. The following technical skills are required for this particular position: Data Engineering (using the tools to build data-driven solutions)Theoretical and practical competency in running big data workloads in production at scaleFamiliar with data engineering patterns (Ingestion, Transformation, Storage, Consumption etc.)Event-based systems (deep knowledge on the Kafka confluent stack)Relational databases (e.g. Postgres)Graph databases (e.g. Neo4j, Stardog)Cloud storage (Azure Datalake or AWS S3 with EMR)Distributed systems (e.g. Spark)Knowledge graph (e.g. Stardog)Software DevelopmentProficiency in at least one programming language (we have components written in Python, Angular, Clojure, Scala, Elm, etc.)Software engineering (micro services, design patterns, version control, automated testing, concurrent programming etc.)Continuous integration, deployment, and deliveryGeneral IT SkillsAdvanced experience with LinuxContainerization and container orchestration (Docker & Kubernetes)General understanding of IT infrastructure, orchestration and IT security principles, especially on enterprise levelOther SkillsBachelor (BSc), Master (MSc) or equivalent experience in a technical field (for example, Computer Science, Engineering...)DevOps mindset (you build it, you run it; taking responsibility for your work)Willingness and ability to learn new technologies and toolsTeam player open to work in an agile environmentFluent English (written and spoken) is a must, other languages (e.g. German, French, Italian, etc.) are a plusCapability of result oriented communication with people from different departments with different skill setsProject details: Start: asapDuration: 31.12.2021 (extension possible)Location: RemoteProject language: English must have, german nice to haveWorkload: 100% If you are interested, please send me the following things: CVHourly rateAvailabilityBest regards,

Kevin Negret

k.negret(at)progressive.de

0176 5574 0827