PhD Intern, Research - Model Alignment

Overview

Research intern developing RL methods for generative design models at Autodesk.

Key Responsibilities

• algorithm prototyping
• rl research
• framework development
• distributed training
• model integration
• publication

Tasks

-Prototype and test algorithms that improve the validity, diversity, and stability of generated results -Conduct research on self-play reinforcement learning (RL) methods for structured generative tasks -Design and implement RL-based alignment frameworks using PyTorch, Ray, and RayLightning for distributed training -Collaborate with Autodesk Research scientists and engineers to integrate learned models into real-world generative workflows -Document findings and potentially contribute to a peer-reviewed publication (e.g., NeurIPS, ICLR, ICML)

Requirements

• python
• pytorch
• ray
• phd
• reinforcement learning
• cad

What You Bring

-Proficiency with Python, PyTorch, and deep RL frameworks -Publication or preprint experience in top-tier ML conferences (NeurIPS, ICLR, ICML, CVPR, RLC) -Prior research experience in self-play RL, model alignment, or structured generative modeling (e.g., text, geometry, or graph domains) -Enthusiasm for bridging research and real-world generative design systems. -Ability to work independently while collaborating across multidisciplinary teams -Understanding of distributed training or experience with Ray/RayLightning -Solid background in reinforcement learning, deep learning, language models, and generative modeling -Strong analytical and communication skills; ability to interpret experimental results and iterate quickly -Currently pursuing a PhD in Computer Science, Machine Learning, Artificial Intelligence, or a related field -Familiarity with CAD representations and graph neural networks

People Also Searched For

About Autodesk

-Pioneered software for 2D and 3D design, revolutionizing industries. -Known for products like AutoCAD, it reshaped architecture, engineering, and manufacturing workflows. -Empowering creators in fields from construction to digital media, enabling more innovative designs. -Develops tools used in iconic projects, from skyscrapers to blockbuster movies. -Pushes the boundaries of design technology, leading the way in artificial intelligence and automation. -Software is a cornerstone in diverse sectors, from industrial to infrastructure, energy, and entertainment. -Cloud-based solutions streamline design processes and foster real-time collaboration across industries. -A leader in 3D design software, with solutions powering projects in every corner of the globe. -Committed to shaping the future of digital design, bringing complex visions to life.

Sector Specialisms