Principal Specialist - Databricks Developer at Energy Transfer in Houston, TX | Kablio

Role

Description

data governance

bi administration

data pipelines

ci/cd

databricks

etl maintenance

Ensure data quality and integrity by implementing best practices and data governance standards
Assist with server and system administration of On-Prem BI infrastructure such as Power BI/Azure Gateway servers, Business Objects, Tableau, and SSRS.
Lead prototype efforts in various BI tools for capability assessment and demonstrations.
Stay current with industry trends and advancements in BI and data analytics technologies.
Leverage AI tools to assist with the creation, maintenance, and updating of comprehensive documentation for all data solutions and processes.
Develop, monitor, and maintain scalable data pipelines to support analytics and data science projects.
Occasional travel may be required.
Provide general support to BI customers, addressing queries and issues in a timely and effective manner.
Participate in the development and maintenance of CI/CD pipelines for automated testing and deployment of BI solutions.
Utilize Azure Databricks to perform complex data transformation, aggregation, and machine learning tasks.
Implement and manage source control practices using GIT within Azure DevOps to ensure code integrity and facilitate collaboration.
Design and implement end-to-end data solutions using Microsoft Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS), Azure Databricks, Power BI/Fabric.
Collaborate with cross-functional teams to translate business needs into technical specifications and data models.
Assist with designing the architecture and workflow for an Enterprise Data Warehouse in Databricks that leverages a growing Citizen Development population who wish to build their own Data Marts
Maintain and enhance existing ETL Pipelines, Warehouses, and Reporting leveraging traditional MS SQL Stack
Provide ongoing support and enhancements to existing data structures and reporting environments.

Requirements

azure

databricks

python

sql

etl

itil

Minimum 3 years of experience in Databricks and Azure stack.
Confidence in several programming languages such as R, Python, Scala, or Java, with the ability to pick up new languages and technologies quickly.
Understanding of cloud and distributed systems principles, including load balancing, networks, scaling etc.
Bachelor’s degree in Computer Science, Management Information Systems, or related field.
Skilled in Python/Spark
Strong time-management skills, initiative, commitment, and ability to work under pressure to meet tight deadlines while maintaining high quality standards and best practices.
Proficient in Azure Data Factory, Azure Data Lake Storage, and Azure Databricks.
Experience with consuming and developing REST API, JSON, XML, and/or JavaScript
Excellent problem-solving skills and attention to detail.
Minimum 3 years of experience in traditional SQL BI Stack
The Lead IT Specialist level requires a Bachelor's degree or equivalent experience and 8+ years of relevant job related experience
Must be able to work on multiple simultaneous tasks with limited supervision. Able to follow change management procedures and internal guidelines
Must be able to remain in a stationary position 50% of the time due to prolonged periods of sitting or standing.
Experience in Oil & Gas industry, particularly Midstream.
Experience warehousing or reporting against SAP/S4/HANA.
Strong communication and collaboration skills to work effectively in a team environment
Experience with data modeling, data visualization, and reporting tools.
Ability to write clean, well-documented, and efficient code.
The Senior IT Specialist level requires a Bachelor's degree or equivalent experience and 5-8 years of relevant job related experience
ITIL Certification or experience using Remedy application is a plus
The Principal IT Specialist level requires a Bachelor's degree or equivalent experience and 10+ years of relevant job related experience.
Primarily SQL Server, SSIS, and SSRS.
Strong understanding of SQL, data warehousing concepts, and ETL processes.

Benefits

Usually, normal office working conditions.

Training + Development

Information not given or found

Interview process

Information not given or found

Visa Sponsorship

Information not given or found

Security clearance

Information not given or found

Company

Overview

125,000 miles

Pipeline Network

The company owns or operates an extensive network of pipelines crisscrossing the U.S., facilitating the transport of various energy products.

$83 billion

Annual Revenue

In 2023, the company achieved robust financial performance with multibillion-dollar revenues.

$5 billion

2025 Capital Expenditure Plan

The company has allocated significant resources for growth through a strategic capital expenditure plan.

42-inch

Pipeline Diameter

The company operates one of the largest gas pipelines in Texas, showcasing its capacity for major energy infrastructure.

Growth has been fuelled by bold acquisitions—Sunoco, Southern Union, Regency, Williams, SemGroup, Crestwood—each adding new pipeline systems, storage, or marketing reach.
Projects range from the first Dakota Access crude conduit to the Lake Charles LNG export terminal and AI-data center gas supply agreement.
Specialisms span natural gas midstream, interstate/intrastate transport, NGL fractionation, crude/refined-product terminals and LNG operations.
Unusual fact: beyond pipelines, it even struck a deal to power AI-focused data centers via its Oasis Pipeline, showcasing a creative pivot into tech-energy synergy.

Culture + Values

Integrity: Strong enforcement of integrity and compliance standards across the organization
Community: A culture of openness, transparency and continuous improvement
Excellence: Strive to be best in class in EH&S and compliance performance
Responsibility: Committed to protecting the environment and conserving natural resources
We believe in doing what’s right. We strive for honesty and respect in all that we do
We believe in a culture of honesty, trust and respect. Our people are our most valued resource

Environment + Sustainability

20% Renewable Energy

Energy Procurement

Approximately 20% of electrical energy purchased daily is from renewable sources like wind and solar.

~4,000 kW/day

Solar Energy Generation

Installed ~18,000 solar panels at metering stations, generating enough power for ~127 homes daily.

789,908 tons CO₂

Emission Reduction

Dual-Drive compressor technology reduced CO₂ emissions in Texas by ~789,908 tons in 2023.

15% GHG Reduction

Year-over-Year Emissions

Reduced greenhouse gas emissions by 15% from 2022 to 2023.

Installed thermal oxidizers at processing plants to reduce methane and VOC emissions by 98–99%
Use ~12,000 low-emission pneumatic devices, preventing ~71 tons (2.9 M scf) of methane emissions daily
Sequestered ~69,400 metric tons CO₂ via carbon capture in 2023
Partnered conservation projects sequestered ~368 metric tons CO₂e in 2023
Joined Environmental Partnership to reduce emissions and support solar powering of cryogenic plants and compressor stations
Member of Environmental Partnership, API Environmental Partnership, Pipeline Research Council International for emissions reduction best practices
Zero-incident culture goal with tracking via Performance Assurance Program and real-time EHS incident tracking
Reported net reduction of ~765,000 tons of Scope 1 CO₂ emissions via Dual-Drive compressors in 2021
Invested US $150 million in environmental initiatives (2024)
No stated net-zero target by date

Inclusion & Diversity

3.8-3.9/5

D&I Employee Rating

Average diversity and inclusion rating based on feedback from ~263 employees on Glassdoor.

Gender Ratings

D&I Ratings by Gender

Women: 3.7/5 based on 33 responses; Men: 3.9/5 based on 90 responses on Glassdoor.

Top 5% Rank

Diversity Ranking on Comparably

The company scores in the top 5% for gender and diversity ratings among firms with over 10,000 employees on Comparably.

15,000+ Organizations

Job Promotions

Promotes job opportunities to over 15,000 diversity-focused organizations across the U.S.

All leaders receive mandatory diversity & inclusion training.
No gender‑representation % disclosed publicly.

Articles

Energy Transfer Careers

Projects

Energy Transfer Overview

Role

Description

data governance

bi administration

data pipelines

ci/cd

databricks

etl maintenance

Ensure data quality and integrity by implementing best practices and data governance standards
Assist with server and system administration of On-Prem BI infrastructure such as Power BI/Azure Gateway servers, Business Objects, Tableau, and SSRS.
Lead prototype efforts in various BI tools for capability assessment and demonstrations.
Stay current with industry trends and advancements in BI and data analytics technologies.
Leverage AI tools to assist with the creation, maintenance, and updating of comprehensive documentation for all data solutions and processes.
Develop, monitor, and maintain scalable data pipelines to support analytics and data science projects.
Occasional travel may be required.
Provide general support to BI customers, addressing queries and issues in a timely and effective manner.
Participate in the development and maintenance of CI/CD pipelines for automated testing and deployment of BI solutions.
Utilize Azure Databricks to perform complex data transformation, aggregation, and machine learning tasks.
Implement and manage source control practices using GIT within Azure DevOps to ensure code integrity and facilitate collaboration.
Design and implement end-to-end data solutions using Microsoft Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS), Azure Databricks, Power BI/Fabric.
Collaborate with cross-functional teams to translate business needs into technical specifications and data models.
Assist with designing the architecture and workflow for an Enterprise Data Warehouse in Databricks that leverages a growing Citizen Development population who wish to build their own Data Marts
Maintain and enhance existing ETL Pipelines, Warehouses, and Reporting leveraging traditional MS SQL Stack
Provide ongoing support and enhancements to existing data structures and reporting environments.

Requirements

azure

databricks

python

sql

etl

itil

Minimum 3 years of experience in Databricks and Azure stack.
Confidence in several programming languages such as R, Python, Scala, or Java, with the ability to pick up new languages and technologies quickly.
Understanding of cloud and distributed systems principles, including load balancing, networks, scaling etc.
Bachelor’s degree in Computer Science, Management Information Systems, or related field.
Skilled in Python/Spark
Strong time-management skills, initiative, commitment, and ability to work under pressure to meet tight deadlines while maintaining high quality standards and best practices.
Proficient in Azure Data Factory, Azure Data Lake Storage, and Azure Databricks.
Experience with consuming and developing REST API, JSON, XML, and/or JavaScript
Excellent problem-solving skills and attention to detail.
Minimum 3 years of experience in traditional SQL BI Stack
The Lead IT Specialist level requires a Bachelor's degree or equivalent experience and 8+ years of relevant job related experience
Must be able to work on multiple simultaneous tasks with limited supervision. Able to follow change management procedures and internal guidelines
Must be able to remain in a stationary position 50% of the time due to prolonged periods of sitting or standing.
Experience in Oil & Gas industry, particularly Midstream.
Experience warehousing or reporting against SAP/S4/HANA.
Strong communication and collaboration skills to work effectively in a team environment
Experience with data modeling, data visualization, and reporting tools.
Ability to write clean, well-documented, and efficient code.
The Senior IT Specialist level requires a Bachelor's degree or equivalent experience and 5-8 years of relevant job related experience
ITIL Certification or experience using Remedy application is a plus
The Principal IT Specialist level requires a Bachelor's degree or equivalent experience and 10+ years of relevant job related experience.
Primarily SQL Server, SSIS, and SSRS.
Strong understanding of SQL, data warehousing concepts, and ETL processes.

Benefits

Usually, normal office working conditions.

Training + Development

Information not given or found

Interview process

Information not given or found

Visa Sponsorship

Information not given or found

Security clearance

Information not given or found

Company

Overview

125,000 miles

Pipeline Network

The company owns or operates an extensive network of pipelines crisscrossing the U.S., facilitating the transport of various energy products.

$83 billion

Annual Revenue

In 2023, the company achieved robust financial performance with multibillion-dollar revenues.

$5 billion

2025 Capital Expenditure Plan

The company has allocated significant resources for growth through a strategic capital expenditure plan.

42-inch

Pipeline Diameter

The company operates one of the largest gas pipelines in Texas, showcasing its capacity for major energy infrastructure.

Growth has been fuelled by bold acquisitions—Sunoco, Southern Union, Regency, Williams, SemGroup, Crestwood—each adding new pipeline systems, storage, or marketing reach.
Projects range from the first Dakota Access crude conduit to the Lake Charles LNG export terminal and AI-data center gas supply agreement.
Specialisms span natural gas midstream, interstate/intrastate transport, NGL fractionation, crude/refined-product terminals and LNG operations.
Unusual fact: beyond pipelines, it even struck a deal to power AI-focused data centers via its Oasis Pipeline, showcasing a creative pivot into tech-energy synergy.

Culture + Values

Integrity: Strong enforcement of integrity and compliance standards across the organization
Community: A culture of openness, transparency and continuous improvement
Excellence: Strive to be best in class in EH&S and compliance performance
Responsibility: Committed to protecting the environment and conserving natural resources
We believe in doing what’s right. We strive for honesty and respect in all that we do
We believe in a culture of honesty, trust and respect. Our people are our most valued resource

Environment + Sustainability

20% Renewable Energy

Energy Procurement

Approximately 20% of electrical energy purchased daily is from renewable sources like wind and solar.

~4,000 kW/day

Solar Energy Generation

Installed ~18,000 solar panels at metering stations, generating enough power for ~127 homes daily.

789,908 tons CO₂

Emission Reduction

Dual-Drive compressor technology reduced CO₂ emissions in Texas by ~789,908 tons in 2023.

15% GHG Reduction

Year-over-Year Emissions

Reduced greenhouse gas emissions by 15% from 2022 to 2023.

Installed thermal oxidizers at processing plants to reduce methane and VOC emissions by 98–99%
Use ~12,000 low-emission pneumatic devices, preventing ~71 tons (2.9 M scf) of methane emissions daily
Sequestered ~69,400 metric tons CO₂ via carbon capture in 2023
Partnered conservation projects sequestered ~368 metric tons CO₂e in 2023
Joined Environmental Partnership to reduce emissions and support solar powering of cryogenic plants and compressor stations
Member of Environmental Partnership, API Environmental Partnership, Pipeline Research Council International for emissions reduction best practices
Zero-incident culture goal with tracking via Performance Assurance Program and real-time EHS incident tracking
Reported net reduction of ~765,000 tons of Scope 1 CO₂ emissions via Dual-Drive compressors in 2021
Invested US $150 million in environmental initiatives (2024)
No stated net-zero target by date

Inclusion & Diversity

3.8-3.9/5

D&I Employee Rating

Average diversity and inclusion rating based on feedback from ~263 employees on Glassdoor.

Gender Ratings

D&I Ratings by Gender

Women: 3.7/5 based on 33 responses; Men: 3.9/5 based on 90 responses on Glassdoor.

Top 5% Rank

Diversity Ranking on Comparably

The company scores in the top 5% for gender and diversity ratings among firms with over 10,000 employees on Comparably.

15,000+ Organizations

Job Promotions

Promotes job opportunities to over 15,000 diversity-focused organizations across the U.S.

All leaders receive mandatory diversity & inclusion training.
No gender‑representation % disclosed publicly.

Articles

Energy Transfer Careers

Projects

Energy Transfer Overview