Image compensation and stabilization for capsule endoscopy

We proposed image processing that can be used to develop immersive 360-degree videos using capsule endoscopy procedures. When viewed through a head-mounted display (HMD), doctors are able to inspect the human gastrointestinal tract as if they were inside the patient's body. Although the endoscopy capsule has two tiny fisheye cameras, the images captured by these cameras cannot be converted to equirectangular images which is the basic format used to produce 360-degree videos. This study proposes a method to generate a pseudo-omnidirectional video from the original images and stabilizes the video to prevent virtual reality (VR) sickness.


  • Kazuki Shimozawa, Masakazu Nakazawa, Hideki Koike, Ryoichi Miyanaga, and Naoki Hosoe. 2018. Image compensation and stabilization for immersive 360-degree videos from capsule endoscopy. In Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology(VRST '18), Stephen N. Spencer (Ed.). ACM, New York, NY, USA, Article 97, 2 pages. (ACM DL)