Following a Group of Moving Targets
Christopher Vo, Jixuan Zhi, Yue Hao and Jyh-Ming Lien
Overview
There are many scenarios in the real and virtual world where it is desired to maximize sensor visibility of groups of targets. For example, in video games, it may be desired for a third-person view camera to track and follow a group of characters through complicated virtual environments. In robotics, a camera attached to robotic manipulators could also be controlled to observe live performers in a concert, monitor other robots as they perform a task such as assembling a mechanical system, or maintain task visibility automatically during teleoperated surgical procedures.
![]() | ![]() |
The following videos show the difference between the reactive camera (left) and the camera that plans its motion (right). The reactive camera quickly loses its visibility of the moving group after the group starts to move.
Using the ideas of monotonic tracking regions and ghost targets, we can address the difficulties of maintaining visibility of coherent groups of targets (such as flocks or crowds) that may bend around obstacles and split into multiple groups, and show the ability to track large groups (with tens to hundreds) of targets at interactive speeds.
Based on the new idea of visibility integrity, we show that the visibility-integrity roadmap (VIR), a data structure that partitions a space into zones, can be used to solve group visibility and group following problems in 3D.
Videos
This video shows a simple example of our following algorithm (MTR Camera) tracking and following a group of agents through an obstacle filled environment. The camera can maintain high visibility of the flocking agents despite the flock splitting and merging, going around corners, and entering narrow passages.
The following videos again show the difference between the reactive camera (left) and the camera that plans its motion (right). In this example, both cameras are following the points sampled from a rigid body (a dog in this case). The reactive camera have much higher chance of colliding with the dog while the camera with proposed motion strategy is able to maintain the visibility while avoid collision.
This video shows the camera with proposed motion strategy following a group of agents in a city-scale environment with 161 buildings (as shown in the image on the right).

The video shows the concept of Visibility integrity (VI), how Visibility integrity partitions the space and a planning algorithm for the camera to maintain visibility of group targets by querying the visibility-integrity roadmap.
Publications
Computing 3D From-Region Visibility Using Visibility Integrity, Jixuan Zhi and Yue Hao and Christopher Vo and Marco Morales and Jyh-Ming Lien, IEEE Robotics and Automation Letters, 07 2019
Web Site / BibTeX
Web Site / BibTeX
Follow a Group of Targets in Large Environments, Christopher Vo and Sam McKay and Nikhil Garg and Jyh-Ming Lien, Proceedings of the International Conference on Motion in Games (MIG), Springer (invited), 2012
Web Site / BibTeX
Web Site / BibTeX
Following a Large Unpredictable Group of Targets Among Obstacles, Christopher Vo and Jyh-Ming Lien, George Mason University, (Technical Report), Jan. 2010
Web Site / Tech Report (pdf) / BibTeX
Web Site / Tech Report (pdf) / BibTeX
Following Multiple Unpredictable Coherent Targets Among Obstacles, Christopher Vo and Jyh-Ming Lien, Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D graphics and Games (I3D 2010) Poster, ACM, Feb. 2010
Web Site / Abstract (pdf) / Poster (pdf) / BibTeX
Web Site / Abstract (pdf) / Poster (pdf) / BibTeX
Visibility-Based Strategies for Searching and Tracking Unpredictable Coherent Targets Among Known Obstacles, Christopher Vo and Jyh-Ming Lien, IEEE International Conference on Robotics and Automation (ICRA 2010) Workshop: Search and Pursuit/Evasion in the Physical World: Efficiency, Scalability, and Guarantees, May 2010
Web Site / Paper (pdf) / BibTeX
Web Site / Paper (pdf) / BibTeX
Following a Large Unpredictable Group of Targets Among Obstacles, Christopher Vo and Jyh-Ming Lien, Proceedings of the Third International Conference on Motion in Games, Springer, 2010
Web Site / Paper (pdf) / BibTeX
Web Site / Paper (pdf) / BibTeX