UnrealGenAISupport

[](https://discord.com/invite/KBWmkCKv5U) [](LICENSE) ## Usage Examples: #### MCP Example: Claude spawning scene objects and controlling their transformations and materials, generating blueprints, functions, variables, adding components, running python scripts etc. <img src="Docs/UnrealMcpDemo.gif" width="480"/> #### API Example: A project called become human, where NPCs are OpenAI agentic instances. Built using this plugin.  # Unreal Engine Generative AI Support Plugin: Every month, hundreds of new AI models are released by various organizations, making it hard to keep up with the latest advancements. The "Unreal Engine Generative AI Support Plugin" allows you to focus on game development without worrying about the LLM/GenAI integration layer. <p align="center"><img src="Docs/Repo Card - Updated.png" width="512"/></p> Currently working on chinese LLMs support like Alibaba Qwen for both Chinese Mainland and International markets. This project aims to build a long-term support (LTS) plugin for various cutting-edge LLM/GenAI models and foster a community around it. It currently includes OpenAI's GPT-4o, Deepseek R1, Claude Sonnet 4, Claude Opus 4, and GPT-4o-mini for Unreal Engine 5.1 or higher, with plans to add , real-time APIs, Gemini, MCP, and Grok 3 APIs soon. The plugin will focus exclusively on APIs useful for game development, evals and interactive experiences. All suggestions and contributions are welcome. The plugin can also be used for setting up new evals and ways to compare models in game battlefields. ## Current Progress: **This plugin will continue to get updates with the latest features and models as they become available. Contributions are welcome.** **If you want a more production ready alternative, with more features and guaranteed stability please checkout the [Gen AI Pro](https://muddyterrain.com/t/genai-fab?utm_source=github.com&utm_medium=repo-free&utm_campaign=genai-plugin) and [Gen AI Pro China](https://www.fab.com/listings/73b2e976-db06-46a5-a144-defecdc3004a) plugins, as it costs a lot of API credits for me to test different models per feature and per engine version to make sure everything works well and compatible. Together both these plugins support 150+ AI models, from all over the globe! Otherwise, I feel this free plugin is good enough for many use cases (including the examples shown in the beginning) and you can use it for free, forever.** ### LLM/GenAI API Support: - OpenAI API Support: - OpenAI Chat API ✅ - `gpt-5.1` 🛠️ - `gpt-5` ✅, - `gpt-4.1`, `gpt-4.1-mini`, `gpt-4.1-nano`,`o4-mini`, `o3`, `o3-pro`, `o3-mini` Models ✅ - OpenAI DALL-E API [(available in pro)](https://muddyterrain.com/t/genai-fab?utm_source=github.com&utm_medium=repo-free&utm_campaign=genai-plugin) ☑️ - Responses API 🛠️ - OpenAI Vision API [(available in pro)](https://muddyterrain.com/t/genai-fab?utm_source=github.com&utm_medium=repo-free&utm_campaign=genai-plugin) ☑️ - OpenAI Realtime API - `gpt-realtime`, `gpt-realtime-mini` Models [(available in pro)](https://muddyterrain.com/t/genai-fab?utm_source=github.com&utm_medium=repo-free&utm_campaign=genai-plugin) ☑️ - OpenAI Structured Outputs ✅ - OpenAI Whisper & TTS API [(available in pro)](https://muddyterrain.com/t/genai-fab?utm_source=github.com&utm_medium=repo-free&utm_campaign=genai-plugin) ☑️ - Multimodal API Support [(available in pro)](https://muddyterrain.com/t/genai-fab?utm_source=github.com&utm_medium=repo-free&utm_campaign=genai-plugin) ☑️ - Text and Audio Streaming [(available in pro)](https://muddyterrain.com/t/genai-fab?utm_source=github.com&utm_medium=repo-free&utm_campaign=genai-plugin) ☑️ - Anthropic Claude API Support: - Claude Chat API ✅ - `claude-4.5-latest` 🛠️ - `claude-4-latest`, `claude-3-7-sonnet-latest`, `claude-3-5-sonnet`, `claude-3-5-haiku-latest`, `claude-3-opus-latest` Model ✅ - Multimodal/Vision API Support [(available in pro)](https://muddyterrain.com/t/genai-fab?utm_source=github.com&utm_medium=repo-free&utm_campaign=genai-plugin) ☑️ - XAI (Grok 3) API Support: - XAI Chat Completions API ✅ - `grok-3-latest`, `grok-3-mini-beta` Model ✅ - `grok-3`, `grok-3-mini`, `grok-3-fast`, `grok-3-mini-fast`, `grok-2-vision-1212`, `grok-2-1212`. - `grok-4` Reasoning API [(available in pro)](https://muddyterrain.com/t/genai-fab?utm_source=github.com&utm_medium=repo-free&utm_campaign=genai-plugin) ☑️ - XAI Image API 🚧 - Text Streaming API [(available in pro)](https://muddyterrain.com/t/genai-fab?utm_source=github.com&utm_medium=repo-free&utm_campaign=genai-plugin) ☑️ - Multimodal API Support [(available in pro)](https://muddyterrain.com/t/genai-fab?utm_source=git