From Murals to Metadata: Digitizing Cultural Heritage in the Tech Age

Cultural heritage is a testament to millennia of civilization, but it is threatened by natural erosion, tourism, and time. Most traditional methods of conservation, though foundational, have difficulty responding to the scale and complexity of these emerging challenges. Digital technologies, such as artificial intelligence (AI), 3D scanning, virtual reality (VR), and blockchain, can offer new solutions. They make it possible to share cultural assets worldwide, restore them, and archive them permanently. This article examines how digitization preserves and revitalizes cultural property using the Mogao Caves as a case study. It also demonstrates how the international community collaborates to have a beneficial effect.

A concerted effort to preserve our heritage is a vital link to our cultural, educational, aesthetic, inspirational and economic legacies - all of the things that quite literally make us who we are.
— Steve Berry

This article explicates the roles of technology in cultural heritage. This includes a breadth of analysis demonstrating how various countries are currently employing emerging technologies to preserve and promote cultural heritage, while also addressing the associated challenges and opportunities. The article includes a case study of the Mogao Caves in China, illustraing how a single heritage site can integrate a range of advanced technologies and revealing both the potential and the complexities involved in tech-enabled preservation. Finally, the article explores future directions and collaborative models, proposing that interdisciplinary efforts and AI-driven applications may play a key role in advancing the field of heritage preservation.

Cultural heritage

The tangible forms of cultural heritage, such as historical structures, artwork, relics, and archeological sites, are delicate by nature. Based on UNESCO’s research, around 14 primary factors like human activities, transportation infrastructure, climate change, and even pollution continually threaten these irreplaceable treasures. 

Ancient frescoes flake and fade, wooden structures decay, and natural disasters or even war can turn once-vibrant locations into ruins. In Syria, for example, relentless war devastated World Heritage sites, “including the Ancient City of Aleppo and its citadel — one of the oldest castles in the world.”

Side-by-side comparison of Aleppo cityscape, with the top image showing intact buildings and a central square, and the bottom image showing widespread destruction and damaged structures.

Figure 1. Aleppo before and after. Source: RadioFreeEurope/RadioLiberty

Even in peacetime, hazards abound: a devastating fire at Brazil’s National Museum in 2018 destroyed up to 92.5% of its 20 million artifacts. Although the physical loss was incalculable, Google Arts & Culture still made efforts and worked with the museum to digitally preserve parts of its collection by using technology. As program manager Chance Coughenour said, “Advances in technology — like high-resolution photography, photogrammetry, 3D laser scanning, and virtual and augmented reality — have not only introduced new forms of art, but help us preserve the world's most precious heritage… Even though images cannot replace what has been lost, they offer us a way to remember.”

Traditional preservation methods, such as physical restoration, conservation science, environmental controls, and tourist access restrictions, are still important but frequently struggle to succeed against these powerful threats. 

At China's Mogao Caves, conservators strictly monitor factors like wind erosion, humidity, and visitor impact to protect ancient wall paintings. However, balancing broader public access with traditional preservation is a constant challenge. Due to years of wind erosion, the cave's cliff surface has suffered shifting sands and rockfalls, which could bring potential dangers for both the site's sustainability and its visitors. Severe weather has also made the cave's humidity levels more extreme, which has harmed the murals by causing problems like efflorescence and flaking.

To manage these risks, sometimes authorities had to close caves or limit visitor numbers, exposing the limitations of relying solely on physical protection. To put it briefly, the preservation of cultural assets on site or in archives is a race against time that humanity hasn't always won.

Diagram comparing a closed cave with limited air permeation and an open cave where visitors introduce heat and moisture through air change.

Figure 2. “Visitor impacts on cave environments” Source: npj | heritage science

Emerging digital technologies are bringing new hope to cultural heritage preservation

In the past few decades, tools like 3D scanning, virtual reality (VR), artificial intelligence (AI), and blockchain have developed ways that we protect and share cultural memory. These tools help create accurate digital copies and backups of heritage sites and artifacts.

Digitization allows us to preserve fragile artworks and let people explore historic places through immersive media without risking physical damage to the originals. These technologies are not only helping preserve heritage but also making museums and cultural sites more accessible to broader audiences.

Diagram comparing the lifecycle of new construction with stages from creation to disposal, and a digital twin–oriented heritage conservation lifecycle from data acquisition to data application.

Figure 3. Lifecycle Comparison: Digital Twin vs. New Construction. Source: ScienceDirect

3D Scanning and High-Precision Digitization

3D scanning is like taking a digital "mold" of an object without ever touching it. Think of it as creating a perfect digital twin of a cultural artifact that can be studied, shared, and preserved forever. Documentation and recording are the first steps in the preservation process. Instead of spending several months meticulously hand-drawing artifacts, researchers can use 3D scanning and modeling tools to revolutionize the process by increasing efficiency, enhancing accuracy, and minimizing contact with delicate objects at the same time. This digital revolution is happening across museums and heritage sites worldwide. There are four main technologies that capture the physical world in digital form:

Light Detection and Ranging (LiDAR) is like thousands of invisible measuring tapes working simultaneously. The scanner emits a laser beam that reflects off the surface and returns to the device. By calculating the return time of each laser beam, the scanner can create what is called a “point cloud,” millions of accurately measured three-dimensional points in space that make up a detailed digital replica of the object. It’s ideal for capturing large structures like temple facades or entire archaeological sites. 

Workflow diagram illustrating the steps in a 3D laser scanning research process, including data acquisition, processing, accuracy verification, and backup.

Figure 4. Workflow of 3D Laser Scanning Process. Source: Nature

Table showing five cultural heritage sites with four columns: real pictures, point cloud images, 3D modeling images, and statistics of stations and point counts.

Figure 5. Visual comparison of five digitized cultural heritage sites. Source: Hung-Ming Cheng, Ya-Ning Yen, Min-Bin Chen, and Wun-Bin Yang, "A Processing for Digitizing Historical Architecture," China University of Technology.

Photogrammetry can identify common points across images and use math to calculate their 3D positions by taking many overlapping pictures from different angles. This transforms regular photographs into accurate 3D models. It is budget-friendly and especially useful for field documentation.

Structured Light Scanning projects patterns (usually stripes or grids) onto an object. When these patterns hit the surface, they deform based on the object's shape. Special cameras capture these deformations, and algorithms convert them into detailed 3D data. Museums and heritage organizations often use this technology as a complementary tool for LiDAR. Unlike LiDAR, which can scan entire building and surrounding area, structured light scanning can capture fine details on smaller artifacts like coins or jewelry.

Figure 6. A technician using EinScan Pro 2X 2020 to scan a Western Jin Dynasty tablet. The handheld scanner allows for high-precision data capture of fragile heritage surfaces. Source: EinScan

Figure 7. A step-by-step virtual restoration of a fragmented clay Buddha face using 3D scanning and digital reconstruction techniques. Source: EinScan

CT Scanning uses X-rays to see inside objects without damaging them. Similar to medical CT scans, the process involves rotating X-ray sources and detectors around the object, creating cross-sectional images that are then stacked to form a complete 3D model. This technology is revolutionary for examining the internal structure of artifacts that cannot be opened or disassembled, such as sealed ancient scrolls, mummies, or composite artifacts. CT scans can reveal hidden details that cannot be seen by the naked eye, helping researchers understand construction techniques and internal damage without any physical intervention.

Figure 8. A step-by-step process for creating a 3D model using CT scans. Source: Nature Communications

AI-Assisted Analysis and Machine Learning

These tools are effective, but imagine having a digital assistant that can learn from experience and recognize patterns that even trained experts might miss. That's what AI and machine learning bring to cultural heritage preservation. 

Artificial Intelligence (AI) lets computers do tasks that normally need human intelligence. This includes recognizing images, understanding speech, making decisions, and solving problems. Think of AI as the overarching goal to make machines "smart." Machine Learning (ML) is how we actually teach computers to be smart. Instead of programming specific instructions for every task, we feed the computer lots of examples and let it learn patterns by itself. For instance, if you show a computer thousands of photos of cats and dogs, it learns to tell them apart without being explicitly programmed what makes a cat different from a dog.

The application of AI and machine learning has been changed from basic “Linear Regression analysis to complex Deep Learning models." These smart computer systems can study thousands of examples to learn what damage on a mural looks like, how to virtually restore faded colors, or how to piece together fragments of ancient texts. While traditional conservation relies on the human eye and expertise, AI can analyze millions of data points in seconds, detecting subtle changes in condition that signal early deterioration before it becomes visible. 

Long-term Preservation and Authentication Technologies

Blockchain might sound like financial tech jargon, but it's solving one of heritage's oldest problems: proving what's real and tracking where it's been. The role of blockchain in cultural heritage protection is essentially a distributed digital ledger. The origin, ownership change, exhibition history, and restoration records of each cultural relic are permanently recorded on multiple computers. Using blockchain is like establishing a complete “digital ID card” system to ensure the important information cannot be modified or deleted by anyone. NFTs (non-fungible tokens) are unique digital asset certificates based on blockchain technology. Museums can sell NFTs related to cultural relics to raise funds for restoration. For example, issue digital collectible NFTs of specific murals, and use the income for mural protection. Together, they provide a reliable and transparent digital protection solution for cultural heritage.

The Emerging Tech podcast episode "Bridging Art and Blockchain, Bringing Certification to Woo with Robert Norton" featuring Verisart CEO Robert Norton offers valuable insights into this topic. The episode touches on how blockchain technology creates trust and authenticity in the art world, the evolution from digital limited editions to NFTs, and how this technology is revolutionizing art authentication and preservation. Key takeaways include how Verisart is using blockchain to combat art forgery and create transparent provenance records, ultimately democratizing access to art certification and preservation.

Diagram showing blockchain use for digital heritage, with digitized files stored in the cloud, ledger management through blocks and connected devices, and digital tokens stored below.

Figure 9. Using blockchain to store and protect digital heritage files. Source: Nature

Case studies

Even though each emerging technology is powerful, cultural heritage preservation projects in reality often combine multiple technologies together to create comprehensive solutions. Leading art and technology institutions show how this integrated approach can transform our understanding and experience of cultural heritage.

Harvard CAMLab

Harvard University’s CAMLab is a great example of this multi-technical integration through its Cave Dance project. They combined machine learning algorithms to analyze ancient dance murals, used motion capture technology to bring static characters to life with professional dancers, used VR experiences to immerse visitors in reconstructed cave environments, and combined immersive installations with interactive media to tell rich cultural stories. This technological combination has created a comprehensive digital ecosystem that not only protects Buddhist art and architecture but also actively reshapes them for contemporary audiences.

UChicago DCADP

Similarly, the University of Chicago’s Dispersed Chinese Art Digitization Project (DCADP) uses advanced 3D scanning technology to capture scattered Chinese artifacts from museums around the world, digital modeling technology to virtually restore architectural elements, a complex database system to manage global artifact information, and virtual reconstruction technology to reassemble physically separated cultural treasures in their original environments. The DCADP overcomes geographic limitations and digitally reassembles China's dispersed cultural legacy.

Mogao Caves

The Dunhuang Mogao Caves, a UNESCO World Heritage Site, are one of humanity’s great cultural treasures. These 735 caves, which date from the fourth to the fourteenth centuries, are built on cliffs in the Dunhuang desert, in the northwest part of China. These caves are home to breathtaking Buddhist artworks, including 45,000 square meters of vivid murals, intricately crafted sculptures, and manuscripts documenting the cultural exchanges along the Silk Road.

To protect this legacy legally, the Dunhuang Academy, China’s first state-funded conservation institution, was established in 1944. The Dunhuang Academy has transformed how we protect the Mogao Caves through smart use of technology. They started the "Digital Dunhuang" project, which uses high-tech cameras and 3D scanning to create perfect digital copies of 735 caves, capturing every tiny detail of 45,000 square meters of murals and 2,400 sculptures.

Figure 10. A digital panoramic view of Mogao Cave 254. This interactive visualization allows users to explore the cave interior by following directional arrows, revealing murals and sculptures from multiple angles. Source: Screenshot from Digital Dunhuang

The Academy works with big tech companies like Tencent to create virtual reality experiences, letting people explore caves digitally without damaging the real ones. They've built a Digital Exhibition Center where visitors can see life-size digital copies of the caves using projection technology. This means fewer people need to enter the fragile original caves.

They have collaborated to develop a blockchain-based Digital Dunhuang Material Library and co-creation platform. The platform not only hosts high-definition digital assets but also enables a co-creation model that allows individual and enterprise creators to download materials for their own creative works. As a leading Chinese gaming company, Tencent has also created "Jiayao," the first digital avatar and ambassador for Dunhuang culture, bringing this ancient heritage to life in a more engaging way.

Figure 11. Jiayao, a virtual dancer developed with real-time rendering and motion capture technology. Source: Tencent Games – Technology Empowers Culture

These innovative projects prove that the future of cultural heritage conservation does not depend on a single technology, but somewhat on combining multiple emerging technologies to provide digital solutions that meet complex conservation needs.

Challenges & opportunities

While new technologies offer innovative solutions for heritage conservation, they also bring potential challenges. Cultural heritage sites face several real problems when trying to use new digital tools. On the technical side, equipment and software quickly become outdated. The legal ownership of digital reproductions of artifacts is also unpredictable, and global cooperation is challenging due to different international regulations.

Money is a major concern because most cultural organizations and institutions have tight resources and budgets, and these new technologies are expensive to get and maintain. The remaining human challenges include encouraging constructive departmental collaboration, convincing traditionalists to adopt new methods, and helping staff learn new abilities. These challenges show that sustainable digital preservation requires more than just high-tech tools; it requires institutions to change how they operate and think about heritage preservation.

Future applications

Integrating emerging technologies into cultural heritage preservation requires interdisciplinary collaboration around the world. Historians, conservators, AI researchers, and technologists should work together to ensure that innovations serve both cultural and technical goals.

Future applications of these technologies could transform how we protect and interact with heritage sites worldwide. Advanced AI systems may help predict when ancient buildings are at risk by identifying early signs of structural damage. This would allow conservators to take action before any real visible deterioration occurs.

Digital twins of entire historical districts could allow urban planners to simulate the impact of modern development on heritage sites. Blockchain technology might create a global shared network digital platform for tracking dispersed artifacts, establishing secure provenance records for museums and collectors. Extended reality formats could democratize access by creating virtual museums that combine collections from different countries, while haptic technology might allow people to "touch" ancient artifacts safely. What’s more, advanced robotics could assist in delicate restoration work, performing tasks with microscopic precision that exceed human capabilities. These innovations suggest a future where technology not only protects heritage but also actively enhances our connection to it.

Figure 12. The Future of Art, a virtual NFT art gallery concept exploring immersive exhibition spaces powered by Web3 and generative AI. Source: Forbes

conclusion

Digital technology has become a powerful tool in the effort to protect cultural heritage around the world. However, it is essential to remember that technology should serve culture. We should support the goal of preserving historical authenticity while also encouraging innovation. The most effective digital transformations do not try to replace traditional conservation practices. Instead, they enhance and expand what is already possible. They open new ways to document, study, and share cultural heritage that would otherwise remain hidden or at risk. When applied thoughtfully, digital methods can help cultural heritage move beyond the limits of physical survival and enter a new era of “digital immortality" and preserve the memory of civilization for future generations.