Hightopo 3D Meets Gaussian Splashes: A New Era in Data Visualization

3D Gaussian Splatting (also known as 3D Gaussian Splashing or 3D Gaussian Spray) represents a significant breakthrough in 3D scene representation and rendering. It utilizes deep learning technology, using 3D Gaussian points instead of traditional triangle meshes to express scenes. This approach facilitates both efficient 3D transformation and produces exceptional photorealistic rendering results. In comparison to conventional methodologies, this technology has significant improvements across key performance metrics, including rendering quality, rendering speed, and training speed.

In this article, we will introduce the visualization project built using 3D Gaussian Splatting technology for Hightopo Software’s Xiamen office and Zhongshan Road Pedestrian Street. By completely mapping every building, detail, light and shadow from the real scene into the virtual space, users can enjoy the architectural environment from all angles in the virtual space and obtain an immersive spatial interactive experience.

About 3D Gaussian Splatting The basic workflow of 3D Gaussian Splatting can be divided into three main stages:

1. Data Acquisition Stage

• For small scenes: Simple video capture using a smartphone is sufficient

• For large scenes: Professional equipment is used to ensure high precision and clarity, typically completed within 30 minutes

1. Model Training Stage

• Utilizes GPU computing power to process and train the model data

• Training duration depends on GPU capabilities, usually taking about one day

• Involves processing captured images to generate 3D Gaussian points with position, scale, rotation, and appearance attributes

1. Rendering and Deployment Stage

Implementation of real-time rendering using Hightopo graphics engines

Technical Advantages and Limitations ■ Key Advantages

High-Quality Rendering: 3D Gaussian Splatting can generate highly realistic 3D scenes with excellent detail and texture representation. Efficient Modeling: Compared to traditional methods and other techniques like NeRF, training with 3D Gaussian Splatting converges faster, allowing complex scene modeling in less time. Strong Adaptability: This technique can handle a wide range of scenarios, from microscopic objects to macro environments. Real-time Performance: 3D Gaussian Splatting provides fast rendering and real-time interaction, offering a smooth user experience. Flexible Data Processing: The method can process multiple data inputs, including images, videos, and point clouds. ■ Limitations

High Storage Requirements: Large-scale point cloud data processing and storage demand significant disk space, affecting web page loading speed. Compatibility Issues: Integrating 3D Gaussian Splatting models with traditional triangle-based mesh models presents challenges. Hardware Requirements: Performing large-scale scene rendering requires high-performance hardware and GPUs. 3D Gaussian Splatting Scene of Hightopo Office Using 3D Gaussian Splatting technology combined with the Hightopo graphics engine, we have achieved precise reconstruction of the office’s interior space. Beyond perfectly capturing the geometric structure of the space, it excellently renders material textures and lighting effects. The surface materials of walls, floors, furniture, and LED lighting fixtures have been meticulously modeled, creating a scene experience that rivals video-like realism.

This demonstration showcases our office environment through an immersive third-person perspective, utilizing advanced PBR (Physically Based Rendering) material technology to deliver sophisticated character visualization.

3D Navigation Within our advanced 3D office environment, users navigate the workspace through an interactive virtual avatar. Upon approaching designated workstations, the system renders a detailed 3D representation of the corresponding employee and their current status. A professional interface displays pertinent organizational information, including departmental affiliations and role specifications. This sophisticated interactive framework facilitates comprehensive visualization of workplace dynamics and personnel distribution, optimizing both operational efficiency and user engagement in information acquisition.

Point Cloud Mode This 3D scene also supports point cloud mode, which clearly displays the spatial layout and details.

Each office area, meeting room, and facility is precisely represented by dense point clusters, fully recreating the geometric structure, furniture layout, and spatial characteristics of the office environment.

Point clouds have extensive applications, playing crucial roles in urban planning, architectural surveying, human-computer interaction, autonomous driving and other fields, providing a reliable data foundation for spatial analysis and scene understanding.

Outdoor 3D Gaussian Splatting Scene In this scene, we collected 3D data of Xiamen’s Zhongshan Road pedestrian street using point cloud technology and transformed it into Gaussian points, precisely capturing the geometric shapes and material details of the buildings. After professional processing, these Gaussian points form continuous smooth surface effects, perfectly reproducing the architectural features. Whether it’s buildings, road vegetation, street lights, or vehicles, all scene elements are accurately recreated at a 1:1 scale.

Virtual Street Tour In this high-quality 3D visualization scene, the unique Southern Fujian architectural charm of Zhongshan Road is fully preserved, with clear presentation of everything from the green glazed tile gate tower roofs to the Chinese cloud pattern decorations on the door pillars. Users can freely stroll in this virtual environment, experiencing an immersive journey through the distinctive Southeast Asian style and Southern Fujian traditional architectural charm of Zhongshan Road’s arcade buildings.

Multi-Device Interaction In terms of system functionality and accessibility, Hightopo Graphics Engine’s underlying technology ensures perfect operation of the system across multiple devices.

Users can operate through various terminal devices including PC, mobile phones, tablets, large screens, and VR/AR devices. It supports keyboard control using WASD or arrow keys, and for touch screen devices, it offers functions like single-finger rotation, two-finger zooming, and three-finger panning.

Summary In recent years, 3D Gaussian Splatting technology has shown tremendous application potential in virtual tours, digital cultural tourism, emergency rescue, and other fields of scene reconstruction, providing unlimited possibilities for virtual reality and metaverse industries.

As a pioneer in HTML5 (Canvas/WebGL/WebGPU/WebXR) Web technology innovation, Hightopo Software will continue to deepen industry development, delivering stunning large-scale scenes to clients through more refined, realistic, and efficient 3D rendering technology, driving digital transformation across industries to new heights.

Virtual Reality (VR) applications in multiple industries

Virtual reality technology (VR) has important features such as perception, immersion, and interactivity. It integrates the latest high-tech development achievements such as 3D graphics, display, and simulation, to generate a digital environment that is highly similar to the real world in terms of vision, hearing, and touch. So that people in the virtual world can have an immersive feeling and experience.

Hightopo’s self-developed “HT for Web” product can interact with various objects in the virtual environment by adapting to VR devices, such as grabbing, moving, and splitting. Now it has compatible with many VR devices such as HTC Vive, Oculus, Qeust2, Pico, etc.

Digital Twins Empower Carbon Neutral Industrial Park Management

Growing climate change concerns in recent years have led to an increased need for carbon dioxide emission reduction. This can be achieved by implementing the concept of circular economy, which promotes the practice of resource conservation, emission minimization, and the maintenance of sustainable revenue streams. Hightopo utilizes the self-developed visualization product — HT for Web to build a lightweight, interactive, and smart energy visualization management system for industrial parks. HT for Web contains not only 2D dashboards but also 3D graphics, to provide a comprehensive solution for energy management and monitory. Empower industrial park managers and operators to achieve energy saving, centralized monitoring, management & decentralized control of energy. The system includes power distribution, lighting, air conditioning, heating, water supply and drainage of buildings, etc.

Based on Web, the B/S structure system adopts a modular idea in the development process, that is, each module is developed separately and then integrated to reduce circular dependence and coupling. So as to unify the supervision of each measurement point and optimize the construction management. On the one hand, find out the inefficient operation of the equipment or the corresponding floor area, on the other hand, find out the abnormal energy consumption, reduce the peak power consumption level, and give reasonable suggestions based on data analysis.

Responsive design and cross-platform capability allow users to access the system anywhere, any time, using any kind of device. Highly interactive and lightweight models ensure an outstanding user experience, regardless its even visit from mobile devices. Main System Overview The Energy Medium module shows users the current medium consumption in two ways, one is divided systematic, the other is divided in spatial. Clicks again to trigger the information about the energy consumption of each subsystem or each device respectively.

Enviorment Data Visualization Use wireless sensors to collect environmental data, including indoor and outdoor temperature, humidity, CO2 concentration, VOC concentration, PM2.5 concentration, etc., and classify them according to whether to realize self-renewal in different environments, and propose energy storage optimization solutions for photovoltaics and wind power. Energy Consumption Visualization Data was synced and displayed at the 2D data panel, data sourced from AC, lighting system, and other consumer systems was sorted, analysed and updated in real-time. Water Supply Device Visualization

The core system achieves automatic loading and unloading of equipment by communicating with background data. The 2D data panel enables intelligent control and management of all pipelines, equipment and structures in the water supply and drainage system, get a full grasp of the water system equipment operation status, which includes each floor wireless water meters, LORA switches, and energy efficiency management platform to ensure the safe and efficient operation of the water supply system. Power Supply Equipment Visualization

The highly interactive system ensures fast response for the power supply. Each equipment is able to interact and give feedback in real-time. This includes sensors, GPRS/4G/NB-IoT and more. HT cross-platform capability allows users to visit the system on their mobile phones, tablets, and PC devices. PV Energy Storage Visualization

PV Energy Storage is easy to get affected by multiple factors such as weather, temperature, and humidity during actual operation, resulting in intermittent photovoltaic power and random fluctuations in grid power. Digital twins are a good solution for this issue. HT integrated with energy storage equipment data and weather sensor data, TN-S power supply system data to visualize and provide continuous & stable power supply, improve the system work efficiency and power supply reliability. Distribution System

The power supply system is generally constructed at the same time as the main building, often comes with problems such as ageing equipment, hidden safety hazards, and low intelligence. HT simulates the application scenario of power distribution equipment in buildings. Basement Power Distribution Room Visualization

The power distribution room refers to the indoor power distribution place with a low-voltage load, which mainly distributes electric energy for low-voltage users, and is equipped with medium-voltage incoming wires, distribution transformers and low-voltage power distribution devices. The appearance of the underground power distribution room is highly restored and modelled according to the on-site pictures, CAD drawings, and other data. Based on this, an interactive Web 3D scene can be made and each piece of equipment in the power distribution room can respond to interactive events. When a situation such as a short circuit, electric leakage occurs, an alarm signal will be issued in time, and supervisors will be notified in real-time, prevent fire and other safety accidents, and ensure the normal operation of system functions and system safety. Electrical Wiring Diagram

HT for Web not only has a powerful render for 3D graphics, but HT also supports the 2D vector component and the HT special rendering makes 2D and 3D can merge together and reusable. Water Supply Visualization

Water supply systems use a combination of pipes (of different dimensions and materials), valves and outlets to deliver water to building users. Some water supply systems also use storage tanks and pumps. Visualize the water flow/pipeline location on the 3D will greatly help operators to get a comprehensive understanding of the whole water supply system.

Photo-realistic modelling restores the water pump room. Realize the unified management of water supply flow, pump frequency, inlet and outlet pressure, and water turbidity, pH value, residual chlorine, etc., to meet the user’s needs for water quality, water volume and water pressure, and to solve the actual operation problem of the water supply system due to changes in water demand, accidents such as pump stoppage, etc., to ensure the normal operation of enterprises. HVAC System Chilled Water Storage

A chilled water system uses a conventional electric chiller to prepare cold water during the valley power period at night, and then store the cold water in a water tank (tank). The water storage technology can cut peaks fill valleys and balance the load of the power grid. The water absorbs heat from the building and disperses it outside. The system cools the water down to a temperature of 4 degrees and then circulates it through the water coil’s air handler. Water Level Visualization

Using cloud computing, Internet, GIS and other technologies to remotely monitor parameters such as water level, water flow speed, load flow rate, cooling tower energy consumption, etc., to obtain the complete change of water level, and convert them into electrical signals to transmit to the computer. Reduce the installed capacity of various equipment, improve the efficiency of the host, make full use of the advantages of the cold storage device, and reduce the energy consumption of the system. Lightning System Visualization

HT supports OBJ format 3d modelling files and MTL files and displays them on the web. Combine with the weather system, we can analyst and control the indoor light intensity and operation duration. Therefore, control the energy consumption. Also, system will highlight the out-of-function device, easy for operators to locate and maintain. Guest Room Control System

HT as a visualization tool, adapted with B/S structure, makes it easy to integrate with other systems. Also, the B/S structure offers the capability of remote access the system anywhere, anytime. Without downloading app all the data are live in real-time. Operators can access the system on phone, PC or tablet and with any modern browser, reducing the uncertainty of management and daily operation, increasing efficiency. Conclusion Building Energy Management Systems (BEMS) provide real-time remote monitoring and integrated control of a wide range of connected systems, allowing modes of operation, energy use, environmental conditions and so on to be monitored and allowing hours of operation, set points and so on to be adjusted to optimise performance and comfort. BEMS can also trigger alarms, predict problems and inform maintenance programmes. Hightopo brings the market-leading web graphic component library — HT for Web to empower BEMS, use digitization and visualization as two key pillars to help achieve the energy efficiency goals and towards the goal of Carbon Neutral.

Tokyo Olympics draw to a close this Sunday night after more than two weeks of competitions held amid extraordinary restrictions and mostly behind closed doors. The pandemic Olympics give us a thought, how we should improve stadium management? One of the answers is definitely Digital Twin.

How Digital Twins Enhance Large Event Spaces

Managing large event spaces, such as football stadiums and performance halls, comes with several challenges: ensuring security, responding to dynamic circumstances, controlling the influx of people, and providing the audience with a comfortable and entertaining experience.

Hightopo 3D Visualization solution is the best fit for these circumstances. By capturing data in and around the stadium, allowing us to create a virtual copy(Digital Twin) of the area that will be used to provide analytics and insight into the experience of attending a game there. This data will help stadium and venues facilities managers to identify potential problems, optimize sustainability and manage risk.

Web-based Lightweight 3D Model

stadium layout

Utilizing Hightopo powerful 3d graphic rendering engine to achieve this interactive 3D scene. The web-based visualization solution enables interactive events from any modern browser. The elements/ scenes can be zoomed, panned, and rotated. The lightweight models make sure a fast and immersive user experience.

Crowed / Traffic Monitoring

Hightopo visualization solution combines 3D model with 2D data visualization such as bar chart, line chart and data indicator to display the important data sourcing such as traffic, crowd density, regional congestion etc. Breaking down the data silos.

Combine with facial recognition and 5G technology, the visualization solution will leverage stadium security and management. With AI technology, the system can even predict the traffic and crowd density, so that venues managers can act before things go sideways and to effectively guide and evacuate the passenger that exceeds the carrying capacity of the stadium.

3D Heatmap Visualizations

Heatmap Visualization

Through the image recognition and analysis of multiple cameras, a complete heat map(thermal map) of the stadium can be formed. The heatmap provides an understanding of crowd density distribution, help in decisions such as the number of employees needed and managing assets such as lighting and cooling devices.

Immersive AR and VR Experiences

The use of augmented reality (AR) and virtual reality (VR) is on the rise in large event venues, especially with the roll-out of 5G in event stadiums. AR and VR tools can help make the experience unforgettable, converting a one-time event attendee into a lifelong customer.

VR can provide a virtual tour of the entire venue to an immersive experience of the event. On the other hand, AR maps, which introduce geospatial awareness tapping into the users’ location coordinates, can be effective in guiding visitors to their seats, parking locations, and other spots within the event area.

Hightopo 3D models work seamlessly on VR and AR, the ht-vr.js plugin makes sure a smooth integration for your 3d scene to VR scene.

Surveillance Video Integration and Video Fusion

The digitization of information flow, coding compression, and open protocol enables a seamless connection between the intelligent network video surveillance system and the various subsystems in the security system, and realize management and control on Hightopo visual management platform.

Combined with video fusion technology, multiple surveillance videos can be fused, so that the originally fragmented video can be viewed in a panoramic view of the real three-dimensional scene, and the overall scene can be grasped from any angle required to help users quickly overview the overall situation. The 3d scene and the dome camera work together to accurately locate the target area to be tracked in the scene, and drive the pan-tilt to control and adjust the camera direction and focal length to achieve precise tracking.

Better Resource Efficiency

Minimizing operational costs and maximizing resource efficiencies are important objectives for building management. Digital twins — integrated with IoT sensors — enable data-driven decision-making, as they collect real-time data. Here are a few examples:

• Gathering data from sensors, digital twins improve energy efficiency by automatically turning systems on or off, or adjusting settings, based on need and finding the right level of resource usage at specific times to serve large crowds.
• Visibility into available parking stalls improves space management and also helps visitors not waste time and fuel finding an open spot.
• Better facility management practices can be implemented with multi-scenario testing and predictive asset maintenance.

Meticulous Planning for Emergencies

A huge concern in large event spaces is to ensure safety and be prepared for possible disasters. A digital twin event venue helps with disaster response. It can model entry and exit points, a large number of people who will exacerbate an emergency situation, and numerous other constraints and stress factors.

AR and VR technologies take disaster response training from classrooms to the ground, aiding in scenario testing, simulating disaster events, and guiding through possible solutions. During an emergency, heat map visualizations help monitor the shifting footfalls and come up with a corresponding evacuation plan.

disaster response

While conventional approaches rely on experience, expertise, and intuition in planning events in large spaces and stadiums, the advanced digital twin technology relies on sensors, AR and VR tools, heat map visualizations, IPS to gather real-time data and perform simulations that can assist before and during the event.

Conclusion

Hightopo visualization solution converts all quantifiable aspects of a physical building into an evolving virtual replica, allowing owners, facility managers and built environment professionals real-time insights to strategize and optimize every aspect of a building’s operations.

• Insight into a building’s efficiency performance in real-time.
• Predicting potential failures in systems like HVAC, water and electrical.
• Providing project team with access to lookalike built and lookalike design models, which are constantly synced in real-time.
• Providing insight to a client to support ongoing structural enhancements.

Besides stadiums, Hightopo has had also done some projects that cover archives, exhibition halls and other smart buildings. Combined with GIS, BIM and other technologies to improve the efficiency of operation and maintenance personnel and the green and intelligent development of venues and exhibition halls.

For more information, please refer to our website: https://www.hightopo.com/

or contact us by Email: service@hightopo.com

Tokyo Olympics draw to a close this Sunday night after more than two weeks of competitions held amid extraordinary restrictions and mostly behind closed doors. The pandemic Olympics give us a thought, how we should improve stadium management? One of the answers is definitely Digital Twin.

How Digital Twins Enhance Large Event Spaces

Managing large event spaces, such as football stadiums and performance halls, comes with several challenges: ensuring security, responding to dynamic circumstances, controlling the influx of people, and providing the audience with a comfortable and entertaining experience.

Hightopo 3D Visualization solution is the best fit for these circumstances. By capturing data in and around the stadium, allowing us to create a virtual copy(Digital Twin) of the area that will be used to provide analytics and insight into the experience of attending a game there. This data will help stadium and venues facilities managers to identify potential problems, optimize sustainability and manage risk.

Web-based Lightweight 3D Model

stadium layout

Utilizing Hightopo powerful 3d graphic rendering engine to achieve this interactive 3D scene. The web-based visualization solution enables interactive events from any modern browser. The elements/ scenes can be zoomed, panned, and rotated. The lightweight models make sure a fast and immersive user experience.

Crowed / Traffic Monitoring

Hightopo visualization solution combines 3D model with 2D data visualization such as bar chart, line chart and data indicator to display the important data sourcing such as traffic, crowd density, regional congestion etc. Breaking down the data silos.

Combine with facial recognition and 5G technology, the visualization solution will leverage stadium security and management. With AI technology, the system can even predict the traffic and crowd density, so that venues managers can act before things go sideways and to effectively guide and evacuate the passenger that exceeds the carrying capacity of the stadium.

3D Heatmap Visualizations

Heatmap Visualization

Through the image recognition and analysis of multiple cameras, a complete heat map(thermal map) of the stadium can be formed. The heatmap provides an understanding of crowd density distribution, help in decisions such as the number of employees needed and managing assets such as lighting and cooling devices.

Immersive AR and VR Experiences

The use of augmented reality (AR) and virtual reality (VR) is on the rise in large event venues, especially with the roll-out of 5G in event stadiums. AR and VR tools can help make the experience unforgettable, converting a one-time event attendee into a lifelong customer.

VR can provide a virtual tour of the entire venue to an immersive experience of the event. On the other hand, AR maps, which introduce geospatial awareness tapping into the users’ location coordinates, can be effective in guiding visitors to their seats, parking locations, and other spots within the event area.

Hightopo 3D models work seamlessly on VR and AR, the ht-vr.js plugin makes sure a smooth integration for your 3d scene to VR scene.

Surveillance Video Integration and Video Fusion

The digitization of information flow, coding compression, and open protocol enables a seamless connection between the intelligent network video surveillance system and the various subsystems in the security system, and realize management and control on Hightopo visual management platform.

Combined with video fusion technology, multiple surveillance videos can be fused, so that the originally fragmented video can be viewed in a panoramic view of the real three-dimensional scene, and the overall scene can be grasped from any angle required to help users quickly overview the overall situation. The 3d scene and the dome camera work together to accurately locate the target area to be tracked in the scene, and drive the pan-tilt to control and adjust the camera direction and focal length to achieve precise tracking.

Better Resource Efficiency

Minimizing operational costs and maximizing resource efficiencies are important objectives for building management. Digital twins — integrated with IoT sensors — enable data-driven decision-making, as they collect real-time data. Here are a few examples:

• Gathering data from sensors, digital twins improve energy efficiency by automatically turning systems on or off, or adjusting settings, based on need and finding the right level of resource usage at specific times to serve large crowds.
• Visibility into available parking stalls improves space management and also helps visitors not waste time and fuel finding an open spot.
• Better facility management practices can be implemented with multi-scenario testing and predictive asset maintenance.

Meticulous Planning for Emergencies

A huge concern in large event spaces is to ensure safety and be prepared for possible disasters. A digital twin event venue helps with disaster response. It can model entry and exit points, a large number of people who will exacerbate an emergency situation, and numerous other constraints and stress factors.

AR and VR technologies take disaster response training from classrooms to the ground, aiding in scenario testing, simulating disaster events, and guiding through possible solutions. During an emergency, heat map visualizations help monitor the shifting footfalls and come up with a corresponding evacuation plan.

disaster response

While conventional approaches rely on experience, expertise, and intuition in planning events in large spaces and stadiums, the advanced digital twin technology relies on sensors, AR and VR tools, heat map visualizations, IPS to gather real-time data and perform simulations that can assist before and during the event.

Conclusion

Hightopo visualization solution converts all quantifiable aspects of a physical building into an evolving virtual replica, allowing owners, facility managers and built environment professionals real-time insights to strategize and optimize every aspect of a building’s operations.

• Insight into a building’s efficiency performance in real-time.
• Predicting potential failures in systems like HVAC, water and electrical.
• Providing project team with access to lookalike built and lookalike design models, which are constantly synced in real-time.
• Providing insight to a client to support ongoing structural enhancements.

Besides stadiums, Hightopo has had also done some projects that cover archives, exhibition halls and other smart buildings. Combined with GIS, BIM and other technologies to improve the efficiency of operation and maintenance personnel and the green and intelligent development of venues and exhibition halls.

For more information, please refer to our website: https://www.hightopo.com/

or contact us by Email: service@hightopo.com