Data Warehouse Engineer

Overview

Design, build, and maintain scalable Azure/Databricks data warehouse solutions.

Key Responsibilities

• performance tuning
• troubleshooting
• data architecture
• security compliance
• etl development
• stakeholder collaboration

Tasks

-Performance Optimization: Monitor and optimize data warehouse performance, including query execution, data storage, and cost efficiency, using Azure and Databricks tools. -Troubleshooting: Identify and resolve issues related to data pipelines, warehouse performance, and integrations, ensuring minimal downtime and rapid recovery. -Continuous Improvement: Stay up-to-date with emerging technologies, including advancements in Azure, Databricks, and other data platforms, to drive innovation and inform architectural decisions. -Data Warehouse Architecture: Design, implement, and maintain scalable data warehouse environments using tools like Azure Synapse Analytics, Databricks, and Snowflake, ensuring high availability and performance. -Security and Compliance: Ensure data warehouse solutions adhere to security and compliance best practices, implementing role-based access controls (RBAC), encryption, and compliance with regulations (e.g., GDPR, CCPA) in Azure and Databricks environments. -Documentation: Develop and maintain technical documentation, including data models, ETL process flows, architecture diagrams, and operational procedures. -ETL/ELT Pipeline Development: Develop and optimize ETL/ELT pipelines using Azure Data Factory, Databricks, or dbt to integrate data from diverse sources, including structured and unstructured datasets. -Collaboration: Work closely with data analysts, data scientists, business stakeholders, and IT teams to ensure seamless integration and delivery of data services.

Requirements

• azure
• databricks
• sql
• python
• azure fundamentals
• itil

What You Bring

-Familiarity with data governance frameworks and standards. -Experience with Agile/Kanban methodologies in Azure DevOps or similar platforms. -Microsoft Certified: Azure Fundamentals (AZ-900) -Ability to guide Azure and Databricks pricing models, optimizing resource usage for cost-effective solutions. -Experience with Linux servers and troubleshooting in OS, network, or database environments. -ITIL v3 or v4 Foundations -Databricks Certified Associate Developer for Apache Spark -3+ years of experience in data engineering, data warehousing, or a similar role. -Proficiency in SQL and scripting languages such as Python or Scala. -Understanding of API security, data lake security, and Azure cloud security practices. -In-depth knowledge of Azure services, including Azure Synapse Analytics, Azure Data Lake, and Azure Data Factory. -Working knowledge of Databricks for big data processing, Delta Lake, and machine learning workflows. -Familiarity with project management and workflow tools such as Jira, Azure DevOps, or ServiceNow. -Experience troubleshooting issues across data pipelines, databases, and cloud infrastructure. -Experience with ETL/ELT tools (e.g., Azure Data Factory, Databricks, Apache Airflow, or dbt). -Strong understanding of data modeling, data warehousing principles, and cloud architecture. -Ability to support large-scale data infrastructure with a full understanding of the software development lifecycle (SDLC). -Familiarity with scripting for automation (e.g., Python, PowerShell, or Bash). -General knowledge of Azure networking, security, IaaS, and PaaS services. -Microsoft Certified: Azure Data Engineer Associate (DP-203) -Databricks Certified Data Engineer Professional -Ability to develop and maintain architecture diagrams, technical documentation, and solution roadmaps. -Excellent analytical and interpersonal skills, with a focus on providing exceptional customer service in a complex environment. -Knowledge of DevOps automation tools (e.g., Azure DevOps, GitHub Actions) for data pipeline deployment. -Hands-on experience with Microsoft Azure (e.g., Azure Synapse Analytics, Azure Data Factory, Azure Data Lake) and Databricks.

People Also Searched For

Benefits

-Life Insurance -Health Savings Account -Paid Maternity Leave -Medical/prescription drug, dental, and vision Insurance -Tuition reimbursement -Critical Illness, Hospital Indemnity and Accident Insurance -Flexible Spending Accounts -Employee Assistance Program (EAP) & Perks -Paid time off -Training and Development -Identity Theft and Legal Services -Disability Insurance

About Signature Aviation

-With a rich history of providing exceptional fuel services, ground handling, and aircraft maintenance, the company serves thousands of clients worldwide. -Operates across major airports, offering comprehensive services that cater to both private and commercial aviation. -The company's expertise spans fueling, maintenance, concierge services, and more, making it a go-to partner for aviation professionals. -Noteworthy for their innovation, Signature Aviation also invests in sustainable technologies and solutions that benefit both their clients and the environment. -With an extensive global footprint, Signature Aviation is consistently ranked among the top service providers in the aviation sector.

Sector Specialisms