Data Engineer

Overview

Develop and optimise Azure data pipelines for SSEN Distribution's data ecosystem.

Key Responsibilities

• architecture design
• streaming pipelines
• azure databricks
• ai solutions
• reusable assets
• ci/cd

Tasks

-Collaborate on architecture design and integration with various source and target systems to mature platform capabilities. -Design and build high-frequency, high-volume streaming data pipelines, including support for LLM/AI solutions. -Develop and enhance data integration solutions using Azure, Databricks, and the existing data engineering framework. -Drive operational improvements by streamlining reusable assets and accelerating development cycles. -Ensure CI/CD best practices and change control processes are followed from development to production.

Requirements

• azure
• devops
• agile
• data engineering
• databricks
• machine learning

What You Bring

-A strong background in delivering using cloud-based Microsoft Azure Data and Analytics capabilities, Microsoft DevOps and Agile delivery -Data engineering experience - via data preparation, transformation & conversion to allow for rapid processing of system data across a number of different formats & structures -Excellent communications & stakeholder management skills – the ability to drive value via end-to-end ownership of business use cases related problems -Extensive experience with the Microsoft Azure Platform, Databricks, and Machine Learning will be a plus -Experience with high-frequency high-volume signal data (or comparable datasets), event hub, anomaly detection - proven use case examples in this area

People Also Searched For

About Sse Plc

-SSE is a pioneering force in the energy sector, committed to delivering sustainable energy solutions. -Founded with a vision to revolutionize the energy landscape, SSE has grown into a major player in both energy generation and infrastructure development. -With a focus on wind, solar, and other renewable energy sources, SSE has consistently led the way in sustainable energy production. -The company is known for undertaking large-scale projects, including renewable energy plants and energy transmission networks. -SSE also plays a significant role in infrastructure development, working across multiple sectors including utilities, transport, and commercial sectors. -A standout achievement for SSE was the completion of one of the largest offshore wind farms in Europe. -The company’s dedication to reducing carbon emissions and contributing to the global shift toward clean energy is evident in its portfolio of green projects. -SSE’s expansion into international markets has further solidified its position as a leader in the renewable energy space.

Sector Specialisms

Security Clearance

-criminality check and credit check required before starting work.