Senior Data Engineer: Python, AWS, Airflow, Athena

This job has now expired please search on the home page to find live IT Jobs.

Senior Data Engineer: Python, AWS, Airflow, Athena Senior Data Engineer: Python, AWS, Airflow, Athena The work location is based in London / Initially working from home 5 Month Contract Pay rate is between £550 - £600 Per Day Skills Required Self-motivated and creative. We're building from ground up, not tweaking legacyGood communicator and team playerSolid understanding of algorithms and data structuresProficiency in scripting languages (especially Python)Experience of cloud platforms (e.g. Amazon Web Services)Commercial experience of writing and optimizing SQL queriesExperience of data orchestration platforms (e.g. Airflow) An ideal candidate (is not required to, but) will also have:Experience in feature engineering for Machine Learning applicationsKnowledge of data versioning libraries/ methods (e.g. DVC)Familiarity with data lakesExperience of cloud data warehouses (e.g. Snowflake)Familiarity with migrations frameworks for change management (e.g. Flyway, Alembic)Experience of dynamic schemas/schemas evolutionExperience building streaming pipelines (e.g. Kafka, Kinesis)Familiarity with continuous deploymentExperience ingesting data from web (e.g. HTTP requests, HTML/ XML parsing)Familiarity with Big Data ecosystem (e.g. Spark/ MapReduce)Experience of load testing data pipelinesExperience of geo-indexing technologies (e.g. PostGIS)Knowledge of columnar data storage formats (e.g. Parquet, ORC)Experience working within an agile team If you are relevant or interested don't delay, contact me on 0161 924 1416 or email me at