Research Scientist (Generative Modeling)
World LabsSan Francisco, California, United States · Posted 8 months agoDescription
About World Labs
World Labs is a frontier AI research and product company advancing spatial intelligence, the next frontier beyond large language models. Co-founded by Dr. Fei-Fei Li, Justin Johnson and Ben Mildenhall, the company is pioneering world models that perceive, generate, reason, and interact with virtual and physical worlds.
The company’s flagship product, Marble, transforms text, images, and video into fully navigable 3D worlds, unlocking applications across gaming, film, architecture, robotics, and immersive digital experiences. Backed by leading investors and with over $1B raised, World Labs is assembling a world-class team at the intersection of AI research and real-world deployment.
Role Overview
We are looking for a talented Research Scientist with a strong background in generative modeling, particularly diffusion models, to join our modeling team. This role is ideal for candidates with deep expertise in diffusion models applied to images, videos, or 3D assets and scenes.
While not required, experience in one or more of the following areas is a strong plus:
- Large-scale model training
- Data curation for pretraining or post-training
- Tokenizers and VAEs for image, video, or 3D data
- Long-context architectures
- 3D vision
You will collaborate closely with researchers, engineers, and product teams to bring advanced 3D modeling and machine learning techniques into real-world applications, ensuring that our technology remains at the forefront of visual innovation. This role involves significant hands-on research and engineering work, driving projects from conceptualization through to production deployment.
What You Will Do
- Design, implement, and train large-scale diffusion models for generating 3D worlds
- Develop and experiment with large-scale diffusion models to add novel control signals, adapt to target aesthetic preferences, or distill for efficient inference
- Collaborate closely with research and product teams to understand and translate product requirements into effective technical roadmaps.
- Contribute hands-on to all stages of model development including data curation, experimentation, evaluation, and deployment.
- Continuously explore and integrate cutting-edge research in diffusion and generative AI more broadly
- Act as a key technical resource within the team, mentoring colleagues, and driving best practices in generative modeling and ML engineering
Key Qualifications
- 3+ years of experience in generative modeling or applied ML roles, ideally at a startup or other fast-paced research environment
- Extensive experience with machine learning frameworks such as PyTorch or TensorFlow, especially in the context of diffusion models and other generative models
- Deep expertise in at least one area of generative modeling: pre-training, post-training, diffusion distillation, fine-tuning with new conditioning signals, etc for diffusion models
- Strong history of publications or open-source contributions involving large-scale diffusion models
- Strong coding proficiency in Python and experience with GPU-accelerated computing.
- Ability to engage effectively with researchers and cross-functional teams, clearly translating complex technical ideas into actionable tasks and outcomes.
- Comfortable operating within a dynamic startup environment with high levels of ambiguity, ownership, and innovation.
Preferred Qualifications
- Contributions to open-source projects in the fields of computer vision, graphics, or ML.
- Familiarity with large-scale training infrastructure (e.g., multi-node GPU clusters, distributed training environments).
- Experience integrating machine learning models into production environments.
- Led or been involved with the development or training of large-scale, state-of-the-art generative models
Who You Are
- Fearless Innovator: We need people who thrive on challenges and aren't afraid to tackle the impossible.
- Resilient Builder: Impacting Large World Models isn't a sprint; it's a marathon with hurdles. We're looking for builders who can weather the storms of groundbreaking research and come out stronger.
- Mission-Driven Mindset: Everything we do is in service of creating the best spatially intelligent AI systems, and using them to empower people.
- Collaborative Spirit: We're building something bigger than any one person. We need team players who can harness the power of collective intelligence.
We're hiring the brightest minds from around the globe to bring diverse perspectives to our cutting-edge work. If you're ready to work on technology that will reshape how machines perceive and interact with the world - then World Labs is your launchpad.
Join us, and let's make history together.
Equal Opportunity & Pay Transparency
Equal Employment Opportunity
World Labs is an equal opportunity employer. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, genetic information, veteran status, or any other characteristic protected under applicable law. We welcome all qualified applicants and are committed to providing reasonable accommodations throughout the hiring process upon request.
California Pay Transparency
In accordance with California law, we disclose the following:
Pay Range
$250,000 - $325,000 base salary (good-faith estimate for San Francisco Bay Area upon hire; actual offer based on experience, skills, and qualifications)
Total Compensation
Base salary plus equity awards
Salary History
We do not request or consider prior compensation in making offers
Compliance: Cal. Lab. Code §432.3 (pay scale disclosure & salary history ban); Cal. Lab. Code §1197.5 (Equal Pay Act); Cal. Gov. Code §12940 (FEHA); 42 U.S.C. §2000e (Title VII); 29 U.S.C. §621 (ADEA); 42 U.S.C. §12101 (ADA)
Similar jobs
Est. 300,000 USD
About World Labs World Labs is a frontier AI research and product company advancing spatial intelligence, the next frontier beyond large language models. Co-founded by Dr. Fei-Fei Li, Justin Johnson and Ben Mildenhall, t…
Est. 287,500 USD
About World Labs World Labs is a frontier AI research and product company advancing spatial intelligence, the next frontier beyond large language models. Co-founded by Dr. Fei-Fei Li, Justin Johnson and Ben Mildenhall, t…
Est. 250,000 USD
About World Labs World Labs is a frontier AI research and product company advancing spatial intelligence, the next frontier beyond large language models. Co-founded by Dr. Fei-Fei Li, Justin Johnson and Ben Mildenhall, t…
Est. 300,000 USD
About World Labs World Labs is a frontier AI research and product company advancing spatial intelligence, the next frontier beyond large language models. Co-founded by Dr. Fei-Fei Li, Justin Johnson and Ben Mildenhall, t…
Est. 300,000 USD
About World Labs World Labs is a frontier AI research and product company advancing spatial intelligence, the next frontier beyond large language models. Co-founded by Dr. Fei-Fei Li, Justin Johnson and Ben Mildenhall, t…
Est. 262,500 USD
About World Labs World Labs is a frontier AI research and product company advancing spatial intelligence, the next frontier beyond large language models. Co-founded by Dr. Fei-Fei Li, Justin Johnson and Ben Mildenhall, t…
Est. 300,000 USD
About World Labs World Labs is a frontier AI research and product company advancing spatial intelligence, the next frontier beyond large language models. Co-founded by Dr. Fei-Fei Li, Justin Johnson and Ben Mildenhall, t…
Est. 225,000 USD
About World Labs World Labs is a frontier AI research and product company advancing spatial intelligence, the next frontier beyond large language models. Co-founded by Dr. Fei-Fei Li, Justin Johnson and Ben Mildenhall, t…
Est. 326,700 USD
Scale AI accelerates the development of AI systems by providing the data, infrastructure, and tooling that power the most advanced models in the world. Our teams operate at the intersection of cutting-edge research, larg…
Est. 203,175 USD
Scale works with the industry's leading AI labs to provide high quality data and accelerate progress in GenAI research. We are looking for Research Scientists and Research Engineers with expertise in LLM post-training (S…
Est. 243,000 USD
Scale Labs, Research Scientist — AI Controls and Monitoring As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models…
Est. 203,175 USD
Scale works with the industry’s leading AI labs to provide high quality data and accelerate progress in GenAI research. We are looking for Research Scientists and Research Engineers with expertise in LLM post-training (S…
Est. 243,000 USD
Scale Labs, Research Scientist — Frontier Risk Evaluations As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models a…
Est. 235,200 USD
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and…
Est. 445,000 GBP
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…
Est. 600,000 USD
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…
Est. 239,000 USD
Your Impact at LILA The AI Research team is tackling one of the most exciting, open problems in AI: training LLMs to run long-horizon scientific discovery tasks. Our approach spans the full post-training stack - from SFT…
Est. 243,000 USD
Scale Labs, Research Scientist — Safety Post Training As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and sy…
Est. 283,500 USD
Our Generative AI Data Engine powers the world’s most advanced LLMs and generative models through world-class RLHF (Reinforcement Learning with Human Feedback), human data generation, model evaluation, safety, and alignm…
Est. 297,900 USD
AI is becoming vitally important in every function of our society. At Scale, our mission is to accelerate the development of AI applications. For 9 years, Scale has been the leading AI data foundry, helping fuel the most…
Est. 600,000 USD
About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of co…
Est. 510,300 USD
As the leading data and evaluation partner for frontier AI companies, Scale is dedicated to advancing the progress of generative AI, with a focus around frontier evaluations, the science of data around posttraining, agen…
Est. 201,825 USD
About Scale AI At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including generativ…
Est. 255,600 USD
About Scale Scale’s mission is to develop reliable AI systems for the world’s most important decisions. As the leading AI data foundry, we provide the high-quality data and full-stack technologies that power the world’s…
Est. 297,900 USD
AI is becoming vitally important in every function of our society. At Scale, our mission is to accelerate the development of AI applications. For 9 years, Scale has been the leading AI data foundry, helping fuel the most…
Est. 269,265 USD
Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. At Roblo…
Est. 243,000 USD
Scale Labs, Research Scientist — Agent Robustness As the leading data and evaluation partner for frontier AI companies, Scale plays an integral role in understanding the capabilities and safeguarding AI models and system…
Est. 273,875 USD
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and…
Est. 245,700 USD
About Scale At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale has been the leading AI data foundry, helping fuel the most exciting advancements in AI, including: generative…
Est. 294,500 USD
Biohub is the first large-scale initiative bringing frontier AI models, massive compute, and frontier experimental capabilities under one roof. We're building a general-purpose system to accelerate scientific discovery,…