VegSense makes sense for forest studies

HOUSTON – (Aug. 1, 2022) – Ecologists won’t always need expensive and bulky equipment to measure vegetation in the wild. Rice University scientists have discovered a modern heads-up display works pretty well.

Rice researchers set up a Microsoft HoloLens as a mixed-reality sensor to feed VegSense, their application to measure understory vegetation, plant life that grows between the forest canopy and floor.

A proof-of-concept study by graduate student Daniel Gorczynski and bioscientist Lydia Beaudrot shows VegSense could be a suitable alternative to traditional classical field measurements at a low cost.

Their study in Methods in Ecology and Evolution shows the hardware-software combination excels at quantifying relatively mature trees in the wild, which is one measure of a forest’s overall health.

Gorczynski came up with the idea to try HoloLens, commonly marketed as a productivity tool for manufacturing, health care and education. He developed the open-source software for the device and noted that while the combination is less effective at picking up saplings and small branches, there’s ample room for improvement.

Gorczynski said he was introduced to mixed-reality sensing while an undergraduate at Vanderbilt University and recognized its potential for biological studies. “It seemed sort of like a natural fit,” he said. Gorczynski brought the idea to Beaudrot in 2019 shortly after his arrival at Rice.

The combination of stock hardware and custom software cost far less than systems based on lidar (for “light detection and ranging”) most often used in three-dimensional field studies, said Gorczynski, who developed VegSense on a platform geared more toward 3D games and interactive experiences than hard science.

Field tests at Houston’s Memorial Park showed that at least for mature trees, the smaller solution is just as good. In their case study, VegSense easily detected 48 of 50 such trees in the target area, a circle about 30 feet in diameter that Gorczynski walked, looking up, down and around to build the 3D database. (“Imagine an asterisk with a circle around it,” he said, describing the data-capture pattern.)

“For this study, we wanted to be really deliberate in trying to replicate more traditional understory vegetation structure measurements,” Gorczynski said. “We tried to get that level of detail.”

What he sees as he scans the environment is a holograph-like grid pattern that tracks the surfaces of vegetation. “What’s really cool about that is you can see what the scanner is picking up, but also the spots you missed,” Gorczynski said. “The idea is to get the mesh to cover as much of the vegetation as possible because that’s what gets you the best scan.”

“The results were so nice that Dan quickly wrote it up for publication,” Beaudrot said, noting that Gorczynski expanded his validation of the gear during a subsequent field trip to Tanzania, the focus of one of 15 tropical forests in a recent rainforest study by the Rice group.

“This device can facilitate a lot of great ecological research, particularly because it’s so cost-effective,” she said. “Collecting vegetation information on the forest floor right now is really hard to do without a lot of manual labor, or a really expensive lidar system.”

“So this is a groundbreaking, cost-effective device,” Beaudrot said. “It’s not going to give you the same resolution data that lidar will, but this is just the first application. We hope making VegSense open-source to the ecological research community will spur all the potential ways it can be developed.”

Northrop Grumman, Conservation International and Rice supported the research.

-30-

Peer-reviewed paper:

“Measuring understorey vegetation structure using a novel mixed-reality device” | Methods in Ecology and Evolution | DOI: 10.1111/2041-210X.13927

Daniel Gorczynski and Lydia Beaudrot

https://besjournals.onlinelibrary.wiley.com/doi/10.1111/2041-210X.13927

Links:

VegSense software repository: https://zenodo.org/record/6624972#.YufyZi-B2L0

Beaudrot Lab: lydiabeaudrot.weebly.com

Department of BioSciences: biosciences.rice.edu

Wiess School of Natural Sciences: naturalsciences.rice.edu

Video:

https://youtu.be/dBHfxvhMChU
A Rice University lab that specializes in applying data science to the study of conservation biology has created an open-source app to harvest field data from Microsoft’s HoloLens mixed-reality headset. Daniel Gorczynski, a graduate student in the lab of Rice data scientist and conservation biologist Lydia Beaudrot, created the software package called VegSense. It works with the Microsoft headset to gather field data about understory vegetation in specific locations. The app allows researchers to gather data as they walk and look at vegetation. Spatial data is displayed on the HoloLens screen in real time and can be stored for later analysis. (Video by Brandon Martin/Rice University)

Image downloads:

https://news-network.rice.edu/news/files/2022/07/0727_HOLO-reach980-lg.jpg
CAPTION: Rice University graduate student Daniel Gorczynski created an open-source app called VegSense to gather field data about understory vegetation using Microsoft’s HoloLens headset. The app allows field researchers to gather data as they walk and look at vegetation. Spatial data is displayed on the HoloLens screen in real time and can be stored for later analysis. (Photo by Jeff Fitlow/Rice University)

https://news-network.rice.edu/news/files/2022/07/0727_HOLO-HLsplt-lg.jpg
CAPTION: Rice University’s open-source VegSense app allows researchers to gather field data about understory vegetation as they walk and look at vegetation using Microsoft’s HoloLens headset. This split-screen image shows what VegSense creator Daniel Gorczynski sees through the headset (top) while he walks and looks at vegetation beneath trees on Rice’s campus (bottom). (Photo by Brandon Martin/Rice University)

https://news-network.rice.edu/news/files/2022/07/0727_HOLO-HLhnd-lg.jpg
CAPTION: Rice University’s open-source VegSense app for the Microsoft HoloLens headset allows researchers to record data about vegetation they see as they walk through a field site and create downloadable files for later analysis. (Photo by Brandon Martin/Rice University)

https://news-network.rice.edu/news/files/2022/07/0727_HOLO-hdsup832s-lg.jpg
CAPTION: Rice Ph.D. student Daniel Gorczynski wearing a Microsoft HoloLens headset. Gorczynski, a data scientist and conservation biologist, wrote an open-source app for the headset to streamline the collection of field data about understory vegetation. (Photo by Jeff Fitlow/Rice University)

https://news-network.rice.edu/news/files/2022/07/0727_HOLO-lb160-lg.jpg
CAPTION: Data scientist and conservation biologist Lydia Beaudrot is an assistant professor of biosciences at Rice University. (Photo by Jeff Fitlow/Rice University)

Related stories:

Camera traps reveal newly discovered biodiversity relationship - March 3, 2021
news.rice.edu/news/2021/camera-traps-reveal-newly-discovered-biodiversity-relationship

National parks preserve more than species – Sept. 9, 2020
news.rice.edu/news/2020/national-parks-preserve-more-species

Where lions operate, grazers congregate … provided food is great – Aug. 17, 2020
news.rice.edu/news/2020/where-lions-operate-grazers-congregate-provided-food-grea

This release can be found online at news.rice.edu.

Follow Rice News and Media Relations via Twitter @RiceUNews.

Located on a 300-acre forested campus in Houston, Rice University is consistently ranked among the nation’s top 20 universities by U.S. News & World Report. Rice has highly respected schools of Architecture, Business, Continuing Studies, Engineering, Humanities, Music, Natural Sciences and Social Sciences and is home to the Baker Institute for Public Policy. With 4,240 undergraduates and 3,972 graduate students, Rice’s undergraduate student-to-faculty ratio is just under 6-to-1. Its residential college system builds close-knit communities and lifelong friendships, just one reason why Rice is ranked No. 1 for lots of race/class interaction and No. 1 for quality of life by the Princeton Review. Rice is also rated as a best value among private universities by Kiplinger’s Personal Finance.