Lead Data Engineer

Overview

Lead data engineer designing, building, and overseeing Azure data pipelines.

Key Responsibilities

• team leadership
• peer review
• ci/cd
• data pipelines
• azure
• stakeholder engagement

Tasks

-The mindset to lead by example; carrying out your own tasks to a high standard as well as leading a team to ensure task allocation and completion and that the quality of their work adheres to agreed patterns and standards. -Peer review work from team members to ensure quality, consistency, reusability etc. Ensure that appropriate testing for any given solution is considered and applied. Utilise CI/CD techniques for the productionisation of solutions. -Act as a subject matter expert in the data engineering / data solutions space as a key member of the CfE. -Lead and undertake practical work as well as provide advice and guidance to business units in SSE. This will mainly relate to data engineering activities such as the design, development, implementation and maintenance of efficient, reusable and reliable data pipelines in an Azure environment. -Understand business requirements and discuss with stakeholders a recommended solution approach. Work in an inclusive manner with team members in terms of architecture and design of a solution. -Lead, mentor and advise the CfE data solutions team in their work.

Requirements

• databricks
• python
• pyspark
• sql
• leadership
• ci/cd

What You Bring

-Experience in related areas of data and analytics - such as data visualisation, advanced analytics and/or AI capabilities (particularly the use of large language models) - would be beneficial. -Experience of acting in a lead position for a data engineering (data solutions) team in a large and diverse organisation and involvement in the full development lifecycle across varied solutions. -Leadership experience in other facets necessary for solution development such as testing, the wider scope of quality assurance, CI/CD etc. -Extensive experience of using the Databricks platform for developing and deploying data solutions / data products (including ingestion, transformation and modelling) with high proficiency in Python, PySpark and SQL.

People Also Searched For

About Sse Plc

-SSE is a pioneering force in the energy sector, committed to delivering sustainable energy solutions. -Founded with a vision to revolutionize the energy landscape, SSE has grown into a major player in both energy generation and infrastructure development. -With a focus on wind, solar, and other renewable energy sources, SSE has consistently led the way in sustainable energy production. -The company is known for undertaking large-scale projects, including renewable energy plants and energy transmission networks. -SSE also plays a significant role in infrastructure development, working across multiple sectors including utilities, transport, and commercial sectors. -A standout achievement for SSE was the completion of one of the largest offshore wind farms in Europe. -The company’s dedication to reducing carbon emissions and contributing to the global shift toward clean energy is evident in its portfolio of green projects. -SSE’s expansion into international markets has further solidified its position as a leader in the renewable energy space.

Sector Specialisms

Security Clearance

-criminality check required -credit check required