Kablio AI
AI Turbo Recruiter
Want to hear how I work? Hit play.Find roles with Kablio AI to help build and power the world.Kablio AI helps you secure roles in construction, clean energy, facilities management, engineering, architecture, sustainability, environment and other physical world sectors.
Get hired, get rewarded!
Land a job through Kablio and earn a 5% salary bonus.
Exclusive benefits
5%Bonus
QA Engineer III
Realpage, Inc.
QA engineer for AI model evaluation, building test frameworks and automation.
9d ago
Intermediate (4-7 years), Experienced (8-12 years)
Full Time
Serilingampalli, Telangana, India
Hybrid
Company Size
8,500 Employees
Service Specialisms
Property Management
Real Estate Technology
Data Analytics
Asset Management
Property Development
Leasing Solutions
Tenant and Resident Services
Risk Management
Sector Specialisms
Residential
Commercial
Multifamily
Single-family
Vacation rental
Affordable housing
Military housing
Student living
Role
What you would be doing
automated pipelines
llm evaluation
benchmarking tools
prompt engineering
model analysis
team mentoring
- Act as a quality advocate for AI-driven features across the product lifecycle.
- Develop automated pipelines for regression testing, prompt evaluation, and model comparison.
- Collaborate with product managers, researchers, and engineers to define evaluation metrics aligned with business and ethical goals.
- Mentor junior team members in AI evaluation best practices and tooling.
- Design and execute evaluation strategies for LLM-based systems using LangSmith, OpenAI tools, and custom frameworks.
- Build reusable test harnesses and datasets for benchmarking AI capabilities across tasks and domains.
- Stay current with advancements in LLM evaluation, interpretability, and responsible AI.
- Contribute to the development of internal tools for prompt engineering, evaluation visualization, and feedback loops.
- Analyze model outputs for correctness, bias, safety, and hallucination using both qualitative and quantitative methods.
What you bring
python
openai
playwright
ci/cd
github
bachelor's
- Strong Python skills, especially in building test automation and data analysis scripts.
- Hands-on experience with OpenAI APIs (e.g., GPT-4, function calling, Assistants API).
- Excellent communication and collaboration skills, with the ability to explain complex AI behaviors to diverse stakeholders.
- Experience with prompt engineering, LLM fine-tuning, or RAG pipelines is a plus.
- Proficiency in using tools like Jupyter, Pandas, and/or SQL for evaluation analytics.
- Proficient in the use of various automation frameworks like Playwright (preferred), Protractor, Rest Assured, karate etc.
- Minimum 6-8 years of experience into QA and Automation
- Bachelor's or master's degree in computer science or a related technical field.
- Experience with version control (GitHub), CI/CD pipelines, and test management tools (e.g., JIRA, Azure Test Plans).
- Familiarity with OpenAI Evals and LangSmith for prompt orchestration and evaluation.
- Basic level understanding of software development lifecycle and quality best practices and tools
- Understanding of ethical AI principles, model alignment, and safety concerns.
- Good knowledge on Automation Framework Development
Information not given or found
Training + DevelopmentInformation not given or found
Interview process
Information not given or found
Visa SponsorshipInformation not given or found
Security clearanceInformation not given or found
Company
Overview
20,000+
Customers Served
Cloud-based platform used worldwide to improve property management efficiency.
- Delivers innovative technology solutions to revolutionize the real estate industry.
- Provides software for property management, leasing, accounting, and financial reporting across multifamily, single-family, and commercial real estate sectors.
- Empowers property owners and managers with cutting-edge tools for efficiency.
- Specialized data analytics solutions optimize operational performance, reduce costs, and enhance tenant experience.
- Focus on driving efficiency through automation with an expanding suite of solutions.
- Offers solutions in areas like energy management, marketing, and resident services.
- Trusted by some of the largest real estate companies in the world for seamless property operations at scale.
- Customer-Centric Innovation
- Integrity
- Accountability
- Collaboration
- Passion for Excellence
- Results-Oriented
By 2035
Net Zero Target Achievement
Committed to achieving net zero carbon emissions, demonstrating a significant commitment to environmental sustainability.
- Committed to reducing environmental impact through innovative solutions.
- Provides sustainability-focused tools to enhance energy efficiency and minimize waste.
- Smart Building solutions reduce energy consumption and lower carbon footprint in various properties.
- Pursues green initiatives and renewable energy to decrease operational carbon footprint.
- Committed to fostering an inclusive and diverse workplace culture.
- Set clear diversity hiring goals aiming for balanced gender representation and diverse leadership roles.
- Promotes employee resource groups for various communities.
- Initiatives to increase underrepresented groups in leadership and technical roles.
- Tracks diversity progress through regular reporting and holds leadership accountable for DEI goals.
Kablio AIIf you're someone who helps build and power the world (or dreams to), Kablio AI is your pocket-sized recruiter that gets you hired.
Copyright © 2025 Kablio