Please scroll down, To apply

Lead Data Engineer

hiring now

Eden Smith Limited 110000.00 British Pound . GBP Per annum

2021-12-03 07:40:56

Job location Barkingside, Greater London, United Kingdom

Job type: fulltime

Job industry: I.T. & Communications

Job Contact: Neil Pascoe

Job description

Lead Data Engineer
London/Hybrid
£ - up to £110,000 per annum

An exciting opportunity has arisen to join a cutting edge, up and coming organisation in the financial domain, within a challenging Lead Data Engineer role.

The successful candidate will be highly experienced within the data space with a passion for the power of data and the ability to lead/mentor.

Key Responsibilities:

  • Build, Track and Maintain the flow of data within ETL (extract, transform, load) and analysis pipelines, ensuring successful processing and data validity
  • Identify optimal ways to prepare, store and navigate their datasets in line with requirements provided by the Data Scientists.
  • Work with the Software and Information Technology teams to specify, design, and implement the infrastructure for storing, searching and integrating new datasets.
  • Management of the data ecosystem, ensuring it meets required business service levels is well maintained and cost effective.
  • Mentor/manage other junior engineers.

Essential skills required:

  • Proficient programming skills in a Scripting language - preferably Python.
  • Experience in the design of data pipelines and the architecture of cloud based data ecosystems.
  • Experience of supporting/implementing data pipelines - using Apache Airflow/cloud composer
  • Experience of data engineering best practises. eg CI/CD and using version control.
  • Experience of data quality assessment and validation
  • Working in an Agile Development environment.
  • Cloud Experience with AWS/GCP (preferably GCP - object storage using lambdas etc..)

The company are based in London but are open to flexible (partly remote) working. This role would suit anyone who is already a Lead Data Engineer or someone who has earned their stripes at Principal or Senior level and is now ready for the next step up.

If you are interested, please apply for full details.

Inform a friend!

Top