Kablio AI
AI Turbo Recruiter
Want to hear how I work? Hit play.Find roles with Kablio AI to help build and power the world.Kablio AI helps you secure roles in construction, clean energy, facilities management, engineering, architecture, sustainability, environment and other physical world sectors.
Get hired, get rewarded!
Land a job through Kablio and earn a 5% salary bonus.
Exclusive benefits
5%Bonus
AI QA Engineer - GenAI
Ge Vernova
Design and lead AI benchmark testing frameworks for GE Vernova.
4d ago
Intermediate (4-7 years), Experienced (8-12 years)
Full Time
Niskayuna, NY
Office Full-Time
Company Size
76,800 Employees
Service Specialisms
Energy Services
Digital Solutions
Sustainability
Smart Grid Technologies
Consulting
Sector Specialisms
Power
Gas Power
Steam Power
Nuclear
Hydro Power
Wind
Onshore Wind
Offshore Wind
Role
What you would be doing
benchmark design
ai monitoring
automated testing
quality metrics
kpi definition
mentorship
- Design, develop, and execute comprehensive benchmark frameworks to evaluate AI use cases, prompt performance, robustness, across diverse array of use cases.
- Monitor AI use cases performance in production, systematically identify issues, and recommend improvements to maintain high standards of AI quality and safety.
- Stay current with emerging AI technologies, contribute to platform and tooling improvements, and share knowledge within the team.
- Conduct quantitative and qualitative evaluations of AI outputs ensuring alignment with business objectives, regulatory standards, and ethical AI principles.
- Document testing methodologies, framework designs, quality metrics, and ensure thorough reporting to stakeholders.
- Support continuous improvement initiatives by incorporating feedback loops and new benchmarking techniques as AI technologies evolve.
- Develop automated testing suites to validate AI functionalities such as prediction accuracy, response consistency, case handling, bias detection, and model degradation over time.
- Collaborate closely with Prompt Engineers, AI Agent Engineers and product owners to define quality standards, acceptance criteria, and key performance indicators (KPIs) for AI deployments.
- Provide training and mentorship on AI testing best practices within GE Vernova’s Prompt engineering and AI Agent Engineering team.
What you bring
llms
python
aws
prompt engineering
master’s
qa
- Deep understanding of machine learning models, LLMs, and AI validation methodologies.
- Familiarity with RAG systems, vector databases, and GenAI architectures.
- Strong communication skills with ability to document and present technical information clearly.
- Ability to analyze complex datasets and performance metrics quantitatively and qualitatively.
- Strong programming skills in Python and experience with automated testing frameworks (e.g., pytest, Selenium).
- Knowledge of cloud environments (AWS, Azure, or GCP), containerization, and deployment pipelines.
- Hands-on experience with LLMs, prompt engineering, and natural language processing (NLP).
- Knowledge of agent orchestration platforms and multi-agent systems (e.g., AutogenAI, LangGraph, MCP protocol).
- Experience with AI fairness, bias detection, and responsible AI practices.
- 3+ years of experience in software quality assurance with at least 2 years focused on AI/ML systems.
- Master’s degree in Computer Science, AI Engineering, Data Science, or related field.
- Proven track record designing and implementing AI benchmark frameworks or quality assurance strategies.
Information not given or found
Training + DevelopmentInformation not given or found
Interview process
Information not given or found
Visa SponsorshipInformation not given or found
Security clearance- offer conditioned upon successful completion of a drug screen.
People also searched
Quality Assurance Jobs in Schenectady United StatesQuality Engineer Jobs in Schenectady United StatesQuality Manager Jobs in Schenectady United StatesQuality Control Jobs in Schenectady United StatesQuality Engineer Jobs in Albany United StatesQuality Manager Jobs in Albany United StatesTesting Engineer Jobs in Albany United StatesQuality Control Jobs in Albany United States
Company
Overview
April 2024
Founded
The company emerged from the spin-off of GE's energy units in April 2024.
>$10B Quarterly Revenue
Revenue Growth
Achieves over $10 billion in quarterly revenue, driven by demand for power infrastructure and digital solutions.
$3B
Wind Turbine Backlog
Maintains a significant backlog in wind turbine orders, reflecting strong market demand.
25%
Global Electricity Supply
Contributes to generating 25% of the world’s electricity through its installed turbines and grids.
- Traces roots back to Edison and Alstom, merging power, renewable, digital & financial wings.
- Headquartered in Cambridge, MA, crafts large-scale gas turbines, SMRs, wind turbines, hydro and grid tech to fuel economies.
- On the nuclear front, advancing small modular reactors (like BWRX‑300) in partnership with utilities and supporting semiconductor projects.
- Wind prowess spans onshore, offshore and blade making—with key sites like Dogger Bank offshore and blade plants in Spain.
- Electrification arm tackles grid stability: HVDC, transformers, storage, conversion, plus GridOS software powering smarter infrastructure.
- Weaves finance and consulting through energy-infrastructure investments, funding solar farms to pipelines via GE Energy Financial Services.
- Relentlessly focused on advancing the world’s transition to cleaner, more sustainable energy.
- Believes in working with customers, partners, and communities to create innovative energy solutions that make a meaningful difference.
- Prioritizes excellence, integrity, and accountability in everything they do.
- Committed to driving real change through technology and partnerships that will transform the global energy landscape.
2050 target
Net zero commitment
Committed to achieving net zero carbon emissions by 2050.
- Focused on reducing emissions through advanced energy technologies.
- Maximizing use of renewable energy sources and leveraging digital solutions for energy efficiency.
- Solutions aim to decarbonize industries and help customers meet their sustainability goals.
Kablio AIIf you're someone who helps build and power the world (or dreams to), Kablio AI is your pocket-sized recruiter that gets you hired.
Copyright © 2025 Kablio