Senior Data Engineer

Description

• Ensure platform security, compliance, and best-practice access controls.
• Implement comprehensive monitoring, logging, and observability frameworks.
• Lead DevOps and automation initiatives, including Infrastructure as Code (Terraform) and CI/CD workflows.
• Develop clean, well-tested Python code for automation, infrastructure tooling, and services.
• Architect and operate Kubernetes-based infrastructure (GKE) across a cloud environment.
• Build and deploy high-performance Python APIs (FastAPI, Flask) powering ML predictions and application logic.
• Collaborate cross-functionally and mentor junior team members.
• Build and orchestrate scalable data ingestion and transformation pipelines using modern workflow tools (e.g., Dagster, Airflow).
• Own the design and management of end-to-end MLOps pipelines supporting continuous training, deployment, monitoring, and versioning of ML models.
• Implement automated testing and deployment pipelines (GitHub Actions).

Requirements

**CANDIDATES MUST BE LOCAL TO NYC & OUR CLIENT CANNOT SPONSOR AT THIS TIME**Senior Data Engineer - Media & Digital Platforms

• Deep understanding of Docker, Kubernetes, and infrastructure-as-code (Helm, Crossplane).
• Hands-on experience with data orchestration tools (Dagster, Airflow).
• Advanced proficiency in Python for development and automation.
• Strong experience deploying APIs and backend services using FastAPI, Flask, or similar frameworks.
• Expertise in SQL, schema design, and experience with both relational and NoSQL data stores.
• Strong Git/GitHub workflow knowledge (branching, code review).
• Excellent communication and problem-solving skills.
• Strong understanding of distributed systems, networking, and cloud security principles.
• Significant experience operating within GCP (BigQuery, Pub/Sub, Cloud Storage, Vertex AI, etc.).
• 5+ years in DevOps, Cloud Engineering, or Data Engineering, including 2+ years focused on MLOps in production.

Benefits

Training + Development

Interview process

Visa Sponsorship

Security clearance