Principal AI Software Engineer

Description

• Drive technical innovation initiatives that differentiate our AI capabilities in the market
• Lead technical due diligence and integration planning for major AI technology decisions
• Lead the development of complex, multi-tenant AI systems serving millions of users with high availability and performance requirements
• Define and drive technical vision and architecture for AI-native applications across multiple product areas
• Act as an enabler for successful execution of identified projects
• Lead incident response and post-mortem processes for complex AI system issues
• Manage risk and uncertainty for self and team within a dynamic priority-setting environment
• Make decisions with confidence when problems or solutions are not well defined
• Design and architect enterprise-scale full stack applications with sophisticated AI integrations across natural language processing, computer vision, and predictive analytics
• Establish frameworks for AI model evaluation, A/B testing, and performance optimization at enterprise scale
• Lead investigation and proof-of-concept development for emerging AI technologies and methodologies
• Drive adoption of emerging AI technologies and evaluate their strategic impact on product development
• Establish and maintain technical documentation, architectural decision records, and knowledge sharing practices
• Design cost-efficient, scalable LLM integration strategies across multiple providers with advanced optimization and failover mechanisms
• Establish monitoring, observability, and cost management frameworks for AI systems across the organization
• Collaborate with external partners, vendors, and research institutions on cutting-edge AI initiatives
• Contribute to open source projects and represent the company at technical conferences and industry events
• Champion engineering best practices including comprehensive testing, code quality, security, and scalability standards
• Establish technical standards, design patterns, and best practices for AI-augmented development across the organization
• Lead cross-functional technical initiatives, collaborating with engineering leadership, product management, and data science teams
• Drive technical decision-making for complex systems that span multiple teams and products
• Contribute as a thought leader within the team, and help to refine current state as well as future state plans and product roadmaps

Requirements

• Demonstrated experience with agentic workflows and autonomous AI system architectures
• Must be 18 years or older.
• Advanced understanding of enterprise RAG architectures, semantic search optimization, and conversation memory management at massive scale
• Strong background in system design, scalability, and performance optimization for high-traffic applications
• Deep expertise with multiple LLM providers and advanced AI orchestration frameworks (LangChain, LlamaIndex, custom frameworks)
• Expert in Agile Development
• Master’s Degree in Electrical, Computer Science, Computer Engineering, Robotics or related field
• 10+ years of non-internship professional software development experience
• Master's degree or PhD in computer science, AI/ML, or equivalent advanced technical education
• 12+ years of programming using JavaScript/TypeScript and multiple backend languages (Python preferred, Node.js, Java, or Go)
• Experience with multi-modal AI integration, model fine-tuning, and deployment of custom AI models
• Background in machine learning research, AI safety, or advanced AI system design
• Expert knowledge of AI observability tools, cost optimization strategies, and performance monitoring at enterprise scale
• Track record of building and scaling AI-powered features for 10M+ users with high availability requirements
• Extensive experience with agent architectures, autonomous AI systems, and cutting-edge agentic workflow implementations
• Must be willing to work out of an office located in Niskayuna, NY.
• 6+ years of experience with modern front-end frameworks (React, Vue, or Angular) and advanced state management patterns
• Expert-level experience with cloud platforms (AWS, GCP, or Azure) and advanced containerization (EKS), orchestration, and infrastructure as code (GitOps)
• Experience with technical strategy development and technology roadmap planning
• Proven track record designing and shipping complex production applications that incorporate LLMs or AI services at enterprise scale (1M+ users)
• 18+ years of full software development lifecycle experience, including architecture design, technical leadership, and large-scale system optimization
• Advanced expertise in prompt engineering, model optimization, and deep understanding of AI system limitations and capabilities
• Architect advanced RAG (Retrieval-Augmented Generation) systems, agentic workflows, and autonomous AI architectures
• Legal authorization to work in the U.S. is required. We will not sponsor individuals at the Bachelor’s level for employment visas, now or in the future, for this job opening.
• Extensive experience leading technical teams, driving cross-team initiatives, and providing technical mentorship
• Expert-level experience with vector databases (Pinecone, Weaviate, pgvector) and advanced embedding model optimization

Benefits

Training + Development

Interview process

Visa Sponsorship

Security clearance