Stay abreast of industry trends and advancements in data engineering and Azure technologies.
Collaborate with cross-functional teams, including data scientists, business analysts, and IT teams, to deliver data-driven solutions.
Collaborate with security teams to perform regular audits and vulnerability assessments.
Optimize data workflows to ensure high performance and cost efficiency.
Manage role-based access control (RBAC), encryption, and other security protocols within Azure Subscriptions.
Provide recommendations for long-term data strategy, including data lakehouse adoption and cloud optimization.
Design and implement robust, scalable, and efficient data architectures leveraging Azure Data Lake and Databricks.
Define and enforce best practices for data ingestion, storage, processing, and retrieval.
Drive agile practices and ensure timely delivery of projects.
Oversee the deployment and management of Azure Data Lake and Databricks environments.
Develop and implement security measures for Azure Data Lake, ensuring compliance with organizational and regulatory standards.
Implement monitoring and alerting systems to ensure system reliability and performance.
Lead and mentor a team of data engineers, providing technical guidance and fostering professional development.
Develop and execute a roadmap for data engineering aligned with business objectives.
Evaluate and incorporate new Azure services and technologies to enhance the data platform.
Proficiency in SQL.
Extensive hands-on experience with Azure Data Lake, Databricks, and other Azure services.
Analytical mindset with a proactive approach to problem-solving.
Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
***Business Objects Knowledge, resume should reflect actual experience not just mention.
Deep understanding of Azure security concepts, including subscription management, RBAC, and data encryption.
Experience with implementing data lakehouse architectures.
***Candidates must meet the minimum experience requirements of 8 years' experience or the submittal will be auto rejected.
Strong leadership and team management abilities.
Excellent communication and stakeholder management skills.
We are seeking an experienced and highly skilled Software Engineering Lead to spearhead our data initiatives, with a primary focus on Azure Data Lake and its associated ecosystem. The ideal candidate will possess deep architectural knowledge of Azure Data Lake and Databricks, a solid understanding of security concepts within Azure, and a proven track record of leading teams in delivering scalable and secure data solutions.
Familiarity with CI/CD pipelines and DevOps practices in a data engineering context.
***The candidate will need to have the knowledge to answer detailed questions regarding the required experience and have recent experience.
8+ years of experience in data engineering, with at least 3 years in a leadership role.
Familiarity with data governance frameworks like GDPR, CCPA, or HIPAA.
***Azure Data Lake expertise, if the resume does not reflect the working experience with the employer do not submit.
Proven expertise in architecting and implementing large-scale data solutions.
Azure certifications, such as Azure Data Engineer Associate or Azure Solutions Architect Expert.
Experience with data modeling, ETL pipelines, and big data technologies.
***Must have leadership experience.