SimWorld Documentation

Welcome to SimWorld Documentation!

SimWorld is a novel Unreal Engine-based simulator designed to generate unlimited, diverse urban environments for embodied AI tasks.

Existing embodied simulators typically focus on indoor scenes. There have been urban simulators, but they either lack realism or are limited to autonomous driving. Critically, most of them do not allow users to flexibly generate new scenes or define new embodied AI tasks. In contrast, SimWorld provides a user-friendly Python API and diverse 3D assets that enable users to procedurally generate realistic and dynamic city-scale environments to support various Embodied AI research tasks. Our simulator can also be connected with large language models (LLMs) to drive the behavior of different types of agents (humans, vehicles, and robots) in the environments. simulation powered by Unreal Engine 5.

Note

This project is under active development.

GETTING STARTED

• SimWorld
  • Simulator
• Quick Start
  • Before you begin
  • Installation

SIMWORLD COMPONENTS

• Overview
• Layout Generation
  • Overview
  • Procedural Generation Process
  • Using Layout Generation
• Waypoint System
  • Overview
  • Map
  • Granularity
• Traffic System
  • Overview
  • Architecture
  • Important Class
  • Using Traffic System
• Communicator
  • Overview
  • Communicator
  • Using Communicator
• Agent System
  • Overview
  • Base Agent
  • Local Planner
  • Base LLM
  • Action Space
  • Using Local Planner
• Unreal Engine Integration
  • Assets
  • Actions
  • Sensors
  • Synchronous and Asynchronous mode

PYTHON API REFERENCE

• API

SIMWORLD ROBOTICS

• SimWorld-Robotics