Researchers in UC Santa Barbara professor Yasamin Mostofi’s lab have enabled, for the first time, counting a stationary seated crowd using WiFi signals, and without relying on people to carry a device. The technique, which also counts through walls, needs only a wireless transmitter and receiver outside the area of interest where the crowd is seated. It has a variety of applications, including smart energy management, controlling the crowd size during a pandemic, business planning and security.
“Our proposed approach makes it possible to estimate the number of seated people in an area from outside,” said Mostofi, a professor of electrical and computer engineering at UCSB. “This approach utilizes only the received power measurements of one WiFi link, does not rely on people to carry a device and works through walls.”
The proposed methodology and experimental results appeared in the recent 19th ACM International Conference on Mobile Systems, Applications, and Services (MobiSys).
In the team’s experiments, one WiFi transmitter and one WiFi receiver (both off-the-shelf) are in an area where a number of people are seated. The transmitter sends a wireless signal whose received power is measured by the receiver. By using only such received signal power measurements, the receiver estimates how many people are present — an estimate that closely matches the actual number.
This innovation builds on previous work in the Mostofi Lab, which has pioneered sensing with everyday radio frequency signals such as WiFi since 2009. For instance, their 2018 paper showed how WiFi can count a crowd of mobile people. However, people had to move around to be counted.
“Counting a stationary seated crowd is a considerably challenging problem due to the lack of major body motion,” said Mostofi. Her lab’s success in this endeavor is due to the new proposed methodology they developed.
“While the people in the crowd are stationary, i.e., with no major body motion except breathing, they do not stay still for a long period of time and frequently engage in small in-place natural body motions called fidgets,” Mostofi explained. “For instance, they may adjust their seating position, cross their legs, check their phones, stretch, or cough, among others.”
The researchers have proposed that the aggregate collective natural fidgeting and in-place motions of a seated crowd carry crucial information on the crowd count, and have shown, for the first time, how to extract the aggregate fidgets and count the total number of people based on them.
"Consider the Crowd Fidgeting Periods (CFPs), which we define as the time durations in which at least one person in the WiFi area is fidgeting, as well as the Crowd Silent Periods (CSPs), which we define as the time durations in which none of the people are fidgeting. These periods are easily extractable from the received WiFi signals,"said Belal Korany, the main Ph.D. student on the project. "Intuitively speaking, the greater the number of people, the higher the chance that CFPs are longer and the CSPs are shorter. Thus, these periods implicitly carry information on the total number of people."
The researchers then developed a new mathematical model that statistically describes the collective fidgeting behavior of a stationary crowd, i.e., the CFPs and CSPs, and explicitly relates them to the total number of seated people.
In developing their mathematical formulation, they first reveal how this problem resembles a several decades-old queuing theory problem, a seemingly unrelated problem from a completely different field. "Queuing theory is a branch of mathematics that studies waiting lines in systems that involve the arrival of customers, who require a service from an entity that includes a number of servers," said Mostofi. They then show how the CSPs are similar to the times when no customer is at a queue that has infinite servers, while the CFPs resemble the times when at least one customer is being served at such a queue. This then allows them to borrow mathematical tools from queuing theory to develop a completely new technique for counting the total number of stationary people.
"We have tested this technology extensively in different locations, and with different numbers of people in several different seating configurations," said Korany. The lab has tested their new technology with 47 experiments in four different environments (including through-wall settings), in which up to and including 10 people are seated and behaving normally, while a pair of WiFi transceivers make WiFi measurements. Their experiments embody various occasions, such as attending a lecture/presentation, watching a movie or reading in a library.
Their evaluation results show a very high counting accuracy, with the estimated number of people being zero or one person off from the true number of people 96.3% of the time in non-through-wall settings, and 90% of the time in through-wall settings. Overall, their results show the potential of this new technology for crowd-counting in real-world scenarios, such as for limiting the total number of people in a crowd during a pandemic.
For a demonstration of this technology, check their video at https://www.youtube.com/watch?v=-UTaVmCiUPs
Morie information about the project can be found at https://web.ece.ucsb.edu/~ymostofi/CountingStationaryCrowd
Additional information about Mostofi's research is available at https://web.ece.ucsb.edu/~ymostofi/