Unreal Engine: Creating a ChatGPT / Dall-E Plugin

Purchase Course

Course Description

Learn how to create an OpenAI ChatGPT and Dall-E plugin directly in the Unreal Engine!

The future is here.

Natural Language Processing and Generative AI have taken the world by storm, enabling automation, code generation, and image generation with a simple text prompt. ChatGPT has allowed users to generate an unlimited amount of content, from code generation, to creative writing, to email and web site templates, and so much more! Dall-E has allowed everyone, no matter their artistic skill, to generate art and design as if they were a professional artist!

In this course, you will learn how to create a custom Unreal Editor plugin which adds ChatGPT and Dall-E functionality to the Unreal Engine! At the end of this course, you will have created an Unreal Engine plugin, ported ChatGPT and Dall-E into the editor using Python, and created a full editor utility widget menu to generate ChatGPT responses and Dall-E imagery directly in the Editor! The imagery you generate in Dall-E will also be imported and saved right in the Content Browser!

This is an intermediate course for those who already know the basics of Unreal Engine. We will not be going over how to download and install the Engine or general navigation of the Editor. We will also not be discussing the principles of programming. However, you will be able to follow along in every step of the creation of a fully functional ChatGPT and Dall-E plugin in Unreal Engine!

What You Will Learn

  • How to create a custom plugin in Unreal Engine
  • How to write a Python script to call a ChatGPT prompt
  • How to write a Python script to call a Dall-E prompt
  • How to script the Unreal Editor to call custom commands
  • How to design and spawn a custom Unreal Editor window

Requirements/Prerequisites

  • Recommended: Basic computer knowledge
  • Recommended: An understanding of basic navigation for the Unreal Engine
  • Recommended: A basic understanding of Unreal widgets
  • Recommended: Some Python scripting experience
  • Recommended: A credit card to connect to your OpenAI account
  • Recommended: Unreal Engine 5.1 or higher installed
  • Recommended: Python compatible IDE installed (Visual Studio, VSCode, etc.)
  • Recommended: Desktop PC with Windows 7 (or later) 64-bit – OR – a Mac with Mac OS X 10.9.2 or later
  • Recommended: DirectX 11 compatible video card
  • Recommended: Quad-core Intel or AMD processor
  • Recommended: 8 GB RAM

Intended Audience

  • Students who want to learn how to create plugins for the Unreal Engine
  • Students interested in generative AI such as ChatGPT and Dall-E
  • Students interested in using Python with the Unreal Engine
  • Students interested in scripting the Unreal Editor workspace

Length

1 hour 17 minutes

Curriculum

  1. Introduction
    • Project Primer
  2. Set Up
    • Setting Up Our Project
    • Creating the Unreal Plugin
    • Creating an OpenAI Account
  3. ChatGPT
    • Creating the Python Script
    • Widget Design
    • Widget Blueprints
  4. Dall-E
    • Creating the Python Script
    • Widget Design
    • Widget Blueprints
    • Combining the Widgets
  5. Conclusion

Video Previews

In this project primer, we will walk through why ChatGPT and Dall-E are such a big deal and what we will be creating in this course.

In this lesson we will download an IDE and Python and set up our Unreal project.

In this video, we will design the Editor Utility Widget which will contain our ChatGPT Plugin.

Purchase Course