Senior Data Engineer / Tech Lead
Recruiter
Listed on
Location
Salary/Rate
Type
This job has now expired please search on the home page to find live IT Jobs.
Hybrid working 1 day office, Data Engineer, Senior Data Engineer, Data Lead, Python, SQL, Scala, Azure, Big Data, ETLMy leading client is looking to expand their data practise to drive the business to harness the power of data to championing the central Data Platform and Data Product adoption for all analytical needs. So they are looking to grow the function across all level of Data experienceTechnical Skills below - experience will be linked to salaryo Strong Unix and shell scripting.
o Strong data concepts and data modelling principles (e.g. Normalisation (OLTP), Dimensional (DWH), Data Vault).
o Experience of building solutions on a Big Data distributed system (data lakes and data lakehouses).
o Strong software development background, with previous hands-on experience building data applications in Python, Scala on TDD/BDD approach and constant refactoring in continuous integration environment.
o Experience with building real-time pipelines, leveraging message brokering and stream processing technologies (Kafka, RabbitMQ, Flink, Spark Streaming).
o Experienced in building data applications in distributed data programming languages/frameworks such as Python, Scala, Apache Spark and Apache Flink.
o Commercial exposure working with and building solutions on cloud-based Big Data such as technologies like:
o Storage: Blob Storage, S3, EFS
o Processing: Spark, EMR, Data Factory, DataProc
o Serving: Athena, SQLAnalytics, BigQuery, Hive, Presto, SQL Server, Synapse Analytics
o Data Warehousing SaaS: Delta Lake, Snowflake, Redshift
o Scheduling/Toolsets: Airflow, Control-M
o Security: Kerberos, KMS, Anonymisation, Tokenisation
o ELT: DataFactory , FiveTran, AWS Glue, NiFi
If this opportunity sounds like it could be of interest please send me your CV ASAP
