Big Data Administrator & Development Engineer

Description

• Implement and Maintain Monitoring Solutions
• Develop and Automate Data Workflows
• Manage and Optimize Big Data Clusters Ensure the reliable, secure, and high-performance operation of on-premise Hadoop, Kafka, and Druid clusters, proactively monitoring performance and system health.
• Administer Access and Security Controls

Requirements

• Experience developing ETL pipelines and integrating diverse data sources.
• Experience with automation and scripting tools such as Ansible, Python, or Bash.
• Proven expertise with HDFS, Hive, Spark, Hue, and NiFi in enterprise data environments.
• Strong SQL proficiency, including query tuning and performance optimization.
• Minimum 8 years of hands-on experience in administering on-premise Hadoop, Kafka, and Druid clusters.
• Solid understanding of Linux system administration and cluster maintenance best practices.
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• Excellent English communication skills and ability to collaborate effectively in agile, cross-functional teams.
• Familiarity with cloud-based Big Data platforms (Azure preferred).
• Knowledge of disaster recovery, high-availability architectures, and runbook creation.

Benefits

Training + Development

Interview process

Visa Sponsorship

Security clearance