Real-Time Data Infrastructure Engineer II

Overview

Build and operate real-time data pipelines using Kafka, Flink, AWS, Snowflake.

Key Responsibilities

• data monitoring
• agile practices
• data governance
• tech research
• team collaboration
• kafka pipelines

Tasks

-Develop techniques for monitoring the completeness, correctness and reliability of our data sets -Leverage agile practices, encourage collaboration, prioritization, and urgency to develop at a rapid pace -Improve data architecture, quality, discoverability and access policies to enable and enforce data governance -Research, share, and recommend new technologies and trends -Collaborate with engineers, data analysts and scientists to ensure that our data infrastructure meets the SLOs of our data-intensive customers -Design, build and operate on next generation data pipeline infrastructure based on Apache Kafka and its ecosystem

Requirements

• sql
• kafka
• python
• aws
• flink
• docker

What You Bring

-Excellent SQL skills with working knowledge of query optimization -Experience with containers and container orchestration tools. Docker and Kubernetes experience is desirable. -3+ years of experience with Apache Kafka, Kafka Connect and its ecosystem -3+ years of experience working with programming languages like Python or Ruby -Experience with distributed SQL query engines, such as Trino is a plus -2+ years of experience with AWS primitives (IAM, VPC, S3, MSK, EKS, etc.) -2+ years of experience in streaming processing technologies, such as Apache Flink -You have hands-on experience with using Apache Kafka in production and have a passion for building a reliable, scalable and fault-tolerant infrastructure. -Experience with Debezium connectors -Experience with large scale Data Lakes and Lake Houses, especially with Apache Iceberg is a plus -You have hands-on experience with data warehouse technology, particularly with Snowflake. -You have worked with a variety of data sources, including change data capture systems, data streaming and event sourcing in production. -You have industry experience with working with real time transformation technologies such as Apache Flink -Bachelors in Computer Science or other quantitative fields. -2+ years of experience working with Infrastructure as Code, configuration management, and monitoring tools. -Data science skills for analyzing data and communicating with ML engineers are a plus.

People Also Searched For

Benefits

-You care about work-life balance and want your company to care about it too; you'll put in the extra hour when needed but won't let it become a habit.

About Appfolio

-Founded in 2006 by Klaus Schauser and Jon Walker, AppFolio emerged to simplify property management through centralized cloud software. -Its flagship product, AppFolio Property Manager, integrates accounting, leasing, marketing, maintenance, and reporting into one platform. -In 2012 it acquired MyCase, later divesting it in 2020 to refocus solely on real estate solutions. -AppFolio has expanded via acquisitions like RentLinx, WegoWise and Dynasty Marketplace to enhance listing presence, analytics, and AI capabilities. -Typical customers range from small landlords to large portfolios, covering single-family, multifamily, commercial, student housing, and community associations. -Its Stack™ Marketplace enables seamless third-party integrations tailored to unique workflows. -In 2024 it introduced Realm-X, a generative AI assistant that automates tasks like report generation, messaging, and maintenance coordination. -Known for rapid feature rollout, mobile-first investor tools, and embedded AI, it stands out in real-time property and investment management.

Sector Specialisms