Sr Data Engineer

Overview

Senior Data Engineer building ETL pipelines, data models, and analytics on Snowflake.

Key Responsibilities

• etl pipelines
• data modeling
• data integration
• data quality
• cloud elasticity
• data analysis

Tasks

-Documentation of the code -Conducts scalable data research. -Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues. -Develops and maintains scalable data pipelines and builds out new integrations to support continuing increases in data volume and complexity. -Develops solutions to gather data to deliver Business Tools that add value to the business -Exploit elasticity and agility of the cloud. -Writes unit/integration tests and documents work. -Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it. -Designing, creating, deploying, and managing Data Architecture/Data models. -Handling the linkages and transformations between different databases, merging and aggregating data -Works closely with a team of frontend and backend engineers, product managers, and analysts. -Designs, modifies, and builds new data wrangling processes. -Design/develop data integrations framework." -Defining, in alignment with analytics team, how the data will be stored, consumed, integrated and managed within Snowflake or other data hub repositories, as well as any applications using or processing that data. -Defines company data assets (data models), spark, sparkSQL, and SnowSQL jobs to populate data models. -Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization. -Responsible for Creation of ETL Pipelines in Python/Pyspark and SQL in Snowflake. -Responsible for designing and building new Data Models and optimizing existing data models. -Assist other team members and ensure team’s success -Responsible and accountable for pipelines reliability and availability. -Responsible of Data analysis for troubleshooting and exploration -Collaborate with Product Owner and Scrum master to understand the requirement and convert the requirement into technology deliverables

Requirements

• powerbi
• sql
• azure
• snowflake
• data modeling
• agile

What You Bring

-Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. -Excellent communication & presentation skills to work with Global, regional & local management teams across the globe -Must have experience is building data connections and models for at least one BI platform like Power BI -Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases -Strong problem-solving skills and ability to deal with ambiguities -Cloud knowledge especially Azure is an added plus -Experience with data modeling, Stored Procedure development and PBI development. -Experience with Data Manipulation in bigdata platform likeSnowflake is a plus(however not mandatory) -Knowledge of programming for ML solutions" -Strong Proficiency in SQL -Curiosity to explore the groundbreaking technologies and bake them into solutions -Experience building and optimizing data pipelines and data sets. -Experience supporting and working with cross-functional teams in a dynamic environment." -Exposure to working in Agile way of working environments preferred" -Understand the meaning, domain and the context of the data. -A successful history of manipulating, processing and extracting value from large, disconnected datasets. -Ownership of physical Data models of serving layer -Experience with working on large scale data hubs.

People Also Searched For

About Eaton

-global leader in power management, providing energy-efficient solutions for managing electrical, hydraulic, and mechanical power. -products and services span across industrial, commercial, residential, and infrastructure markets. -innovative solutions in energy storage, electrical distribution, and industrial automation. -instrumental in advancing technologies for utilities, transportation, and energy management. -recent standout projects include large-scale energy management systems for smart cities and utilities. -systems are crucial for sectors ranging from renewable energy to water resources management. -history of growth through acquisitions, continuously expanding global footprint and product offerings.

Sector Specialisms