Back to Homepage

AI for 3D Modeling

This exploration uses the Ambrosinus Toolkit in Rhino Grasshopper 3D and Stable diffusion's ControlNet to transform Rhino's viewport into realistic or stylized visuals with prompts, showcasing innovative 3D design visualization.
Inline Styled Line

AI-Enhanced Real-Time Algorithm for Streamlined Rendering in a 3D Modeling Workflow

This AI-assisted method uses Stable Diffusion and ControlNet within Rhino and Grasshopper. It streamlines the design process, allowing for rapid visual experimentation and iteration directly within the 3D modeling workflow.

Click here for full research document
Inline Styled Line

Research through Design

The AIR STREaM project followed a "Research through Design" methodology, exploring various AI tools across text, image, and audio domains. This iterative process involved testing and integrating platforms like Stable Diffusion and ControlNet into existing 3D modeling workflows to enhance real-time rendering capabilities.

Inline Styled Line

Workflows

Conventional workflows are time-consuming, involving multiple steps from 3D modeling to final rendering, which slow down design feedback loops.

Proposed AI-Assisted Workflows

The new pipeline integrates AI for immediate visualization during 3D modeling:

  • Perform 3D modeling in Rhino.
  • Use Grasshopper to input desired visual prompts.
  • Instantly view AI-generated visual variations within the modeling environment.
Inline Styled Line

AI Assisted Workflow

This AI-assisted method, which uses Stable Diffusion and ControlNet within Rhino and Grasshopper, streamlines the design process. It allows for rapid visual experimentation and iteration directly within the 3D modeling workflow. Below are some samples demonstrating the depth extraction of a 3D model and its AI render.

Inline Styled Line

Github Repository with code and models

calluxpore/AI-Enhanced-Real-time-Algorithm-for-Streamlined-Rendering-in-a-3D-Modeling-workflow-AIR-STREaM- (github.com)
Previous project
Back to all projects