Skip to content

Conversation

@yuripourre
Copy link
Contributor

@yuripourre yuripourre commented Nov 17, 2025

Title

Initial implementation of AI Assistant. I recommend using the qwen family but any model with tools support should work.

Screencast.From.2025-11-17.13-08-09.mp4

Summary

Add a new tab called AI Assistant where the user can send messages to a LLM to modify the scene. Currently only local Ollama is supported and it can only modify meshes, materials, lights and cameras.

It is still in very early stages but shouldn't be hard to add more features from there.

Changes Made

AI Assistant tab

Creates a new tab AI Assistant with a chat interface.

Integration with Ollama using langgchain

  • Added langgchain tools to the project
  • Added integration with ollama

Benefits

Users can use LLMs to modify the scene

@yuripourre yuripourre mentioned this pull request Nov 17, 2025
@julien-moreau
Copy link
Contributor

@yuripourre did you try the idea you had to have more "common way" to handle actions?

@yuripourre
Copy link
Contributor Author

@julien-moreau no, I thought about it a lot and I think the current implementation would be better long-term. The reason is, the tools would be separate by the type of element.

We spoke about having this as an external plugin, maybe it's the way to go.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants