HydroVerse VR Equipment Hub is an immersive virtual reality framework designed for workforce development and training in environmental monitoring. Developed at the University of Iowa, this platform integrates extended reality (XR), high-fidelity 3D models from photogrammetry, and AI-driven voice guidance (Meta VoiceSDK).
The platform bridges theory and practice, allowing users to build technical proficiency and confidence without on-site risks by training on virtual replicas of existing devices.
- Key Features
- System Architecture
- Installation & Requirements
- Modules & Usage
- Data Availability
- License
- Funding & Acknowledgements
- Citation
- Immersive Training: Provides a safe environment for equipment assembly, calibration, and troubleshooting.
- High-Fidelity Photogrammetry: Utilizes sub-millimeter accurate 3D models of sensors (e.g., IFC Water Level Sensor) created using RealityCapture.
- Voice Command Integration: Features Meta VoiceSDK for hands-free navigation and task assistance.
- Realistic Urban Simulation: Integrates CityEngine and Unreal Engine Water System to simulate real-world deployment environments, such as the Iowa River corridor.
- Transferable Skills: Training is conducted on virtual replicas of real devices to ensure skills are directly applicable to field work.
The HydroVerse framework connects physical environmental components with a digital simulation through a multi-layered architecture. As shown in the figure below, the system integrates high-fidelity data input, advanced rendering engines, and intuitive user interactions.
Figure: System architecture of the HydroVerse VR Equipment Hub.
- 3D Assets: Physical water level sensors and components are digitized using photogrammetry (RealityCapture) to create high-fidelity 3D models.
- User Interface: Users interact with the system via Meta Quest Touch Plus controllers for object manipulation and Meta VoiceSDK for hands-free AI-driven navigation and guidance.
The virtual environment is powered by Unreal Engine 5, integrating specialized technologies to ensure realism:
- Twinmotion: Enhances visual fidelity and rendering.
- Water Simulation: Models realistic streamflow and hydrodynamic behaviors.
- CityEngine: Generates the digital twin of the Iowa River location and urban infrastructure.
A centralized Navigation Center serves as the hub, allowing users to seamlessly transition between three functional modules:
- Education Center: For studying sensor composition.
- Repair Center: For diagnostic and maintenance training.
- Operation Center: For real-world deployment simulations.
- VR Headset: Meta Quest 3 (Recommended) or OpenXR-compatible headset.
- PC Specifications: Requires high-performance computing resources for real-time rendering of high-fidelity assets and water simulations.
- Unreal Engine 5.3
- RealityCapture (for processing new photogrammetry assets)
- Meta VoiceSDK
- CityEngine (for urban modeling)
- Clone the repository:
git clone https://github.com/uihilab/HydroVerse-VR-Equipment-Hub.git
- Project Setup:
- Open the
.uprojectfile in Unreal Engine 5.3. - Ensure the MetaXR, VoiceSDK, and Water plugins are enabled.
- Wait for shaders to compile (this may take time due to high-fidelity assets).
- Open the
- Build:
- The project uses C++ and Blueprints; ensure you have Visual Studio installed to build the source.
Users engage in detailed inspection and manipulation of high-fidelity 3D sensor models. This module allows for the decomposition and reassembly of components (e.g., solar panels, circuit boards) to understand internal structures.
Figure: Education Center for sensor assembly visualization.
This module provides a hands-on environment for fault detection. A Repair Wizard guides users through diagnostic steps (e.g., checking power management or batteries) using voice commands and virtual tools.
Figure: Repair Center for diagnostic and troubleshooting tasks.
Simulates real-world sensor installation within a digital twin of Iowa City. Users can navigate the urban environment, assess spatial constraints, and observe hydrological behaviors (water flow and reflections) to plan optimal sensor placement.
Figure: Operation Center simulating real-world sensor deployment.
- Source Code: The development repository is available under an open-source license.
- 3D Assets: Photogrammetry datasets and 3D sensor models generated for this study are stored locally and will be made available upon request or released alongside the repository.
- Documentation: Full system architecture and setup guides are provided in this repository.
This project is licensed under the MIT License - see the LICENSE file for details.
This project was funded by the National Oceanic and Atmospheric Administration (NOAA) via the Cooperative Institute for Research to Operations in Hydrology (CIROH). We thank the Iowa Flood Center for providing access to sensor equipment and technical advisory.
If you use this software in your research, please cite our paper:
Rahmani, A., Sermet, Y., & Demir, I. (2025). HydroVerse VR Equipment Hub: An Integrated Virtual Reality Framework for Training and Workforce Development in Environmental Monitoring. EarthArXiv. doi:10.31223/X54J2X
BibTeX:
@article{rahmani2025hydroverse,
title={HydroVerse VR Equipment Hub: An Integrated Virtual Reality Framework for Training and Workforce Development in Environmental Monitoring},
author={Rahmani, Ali and Sermet, Yusuf and Demir, Ibrahim},
journal={EarthArXiv},
year={2025},
doi={10.31223/X54J2X},
url={[https://doi.org/10.31223/X54J2X](https://doi.org/10.31223/X54J2X)}
}
---