We have proposed several light-field 3D imaging (i.e., integral imaging) that use a micro lens array to capture and represent whole 3D rays within a single shot of the elemental image. These systems permit real-time capturing and reconstruction of 3D volume data, as well as confocal image generation. We have developed computational photography algorithms for 3D depth extraction, volume reconstruction, and modification using light-field technology. This project is to develop and evaluate a novel front-end optical and video processing system based on light-field imaging and computational photography to be used with any mobile systems that will remove background clutter and therefore improve object detection and recognition.
We have also developed real-time light-field microscopy that captures and simultaneously represents entire 3D volumetric information of live specimens. This novel microscopy system can capture the 3D live movements of specimens and display it with a multi-view 3D display, without the need for special glasses, to share with multiple observers.
We have investigated the impact of light-field display in accommodation and convergence responses and recently focused on motion sickness in VR head-mounted display induced by spatial distortions.
Grants
01/2016 – 01/2021, Active confocal imaging for visual prostheses, US Department of Defense, Vision Research Program, W81XWH-16-1-0033 (Co-PI)
02/2015-10/2015, Active confocal imaging for visual prostheses, Grant from the Promobilia Foundation, Stockholm, Sweden #14222 (PI)
12/2012-12/2014, Model-Based Image Enhancement for the Visually Impaired, NIH/NEI R01 – EY05957 (Co-Investigator)
12/2012-12/2013, Study on effect of super multi-view condition in three-dimensional display to accommodation response and improvement of optical vision rehabilitation device, Basic Research Fellowship, National Research Foundation of Korea, 2012R1A6A3A03038820 (PI)
Publications
Avraham D, Samuels G, Jung J-H, Peli E, Yitzhaky Y. Computational integral imaging based on a novel miniature camera array. In Proc. Imaging and Applied Optics Congress 2022, OSA Technical Digest, paper 3Tu5A.2, Jun. 2022. Publisher’s Version
Jung, J. – H., Kurukuti, N. M., & Peli, E. (2021). Photographic Depiction of the Field of View with Spectacles-mounted Low Vision Aids. Optometry and Vision Science , 98 (10), 1210-1226. Publisher’s Version
Peli, E., & Jung, J. – H. (2020). Active confocal imaging systems and methods for visual prostheses . US Patent No. US10857036B2 . US patent.
Peli, E., & Jung, J. – H. (2018). Active confocal imaging systems and methods for visual prostheses . US Patent No. US10130513B2 . US Patent.
Aloni, D., Jung, J. – H., & Yitzhaky, Y. (2017). 3D noise-resistant segmentation and tracking of unknown and occluded objects using integral imaging. Proc. SPIE 10441, Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies, 104410D (5 October 2017) Publisher’s Version
Jung, J. – H., Qiu, C., & Peli, E. (2017). Background de-cluttering for object recognition in video-based visual prostheses. 10th The Eye and The Chip World Research Congress . Detroit, MI.
Jung, J. – H., Aloni, D., Yitzhaky, Y., & Peli, E. (2015). Active Confocal Imaging for Visual Prostheses. Vision Research , 111 (June), 182-196. Publisher’s Version activeconfocalimaging_datasharing_2.xlsx (Best paper of the year by a trainee in SERI, Harvard Medical School)
Kim, J., Jung, J. – H., Jeong, Y., Hong, K., & Lee, B. (2014). Real-time integral imaging system for light field microscopy. Opt. Express , 22, 10210–10220 . OSA. Publisher’s Version
Kim, J., Jung, J. – H., & Lee, B. (2013). Real-time pickup and display integral imaging system without pseudoscopic problem. Proc. SPIE. 8643, Advances in Display Technologies III. Publisher’s Version
Kim, J., Jung, J. – H., Jang, C., & Lee, B. (2013). Real-time capturing and 3D visualization method based on integral imaging. Opt. Express , 21, 18742–18753 . OSA. Publisher’s Version
Jung, J. – H., Kim, J., & Lee, B. (2013). Solution of pseudoscopic problem in integral imaging for real-time processing. Opt. Lett. , 38, 76–78 . OSA. Publisher’s Version
Hong, J., Jung, J. – H., Hong, K., Kim, Y., & Lee, B. (2012). Method and system for imaging display. Korean Patent . KR Patent No. 10-1118745.
Kim, J., Jung, J. – H., Hong, J., Yeom, J., & Lee, B. (2012). Elemental Image Generation Method with the Correction of Mismatch Error by Sub-pixel Sampling between Lens and Pixel in Integral Imaging. J. Opt. Soc. Korea , 16, 29–35 . OSA. Publisher’s Version
Jung, J. – H., Hong, J., Park, G., Hong, K., & Lee, B. (2011). Computational reacquisition of a real three-dimensional object for integral imaging without matching of pickup and display lens array. Proc. SPIE. 8134, Optics and Photonics for Information Processing V. Publisher’s Version
Jung, J. – H., Yeom, J., Hong, J., Hong, K., Min, S. – W., & Lee, B. (2011). Effect of fundamental depth resolution and cardboard effect to perceived depth resolution on multi-view display. Opt. Express , 19, 20468–20482 . OSA. Publisher’s Version Cover image paper, Top downloaded paper
Jung, J. – H., Hong, K., Park, G., Chung, I., Park, J. – H., & Lee, B. (2010). Reconstruction of three-dimensional occluded object using optical flow and triangular mesh reconstruction in integral imaging. Opt. Express , 18, 26373–26387 . OSA. Publisher’s Version
Hong, K., Hong, J., Jung, J. – H., Park, J. – H., & Lee, B. (2010). Rectification of elemental image set and extraction of lens lattice by projective image transformation in integral imaging. Opt. Express , 18, 12002–12016 . OSA. Publisher’s Version
Jung, J. – H., Hong, K., Park, J. – H., Chung, I., & Lee, B. (2010). Disparity estimation based on integral imaging in sub-pixel resolution using maximum a priori (MAP) registration. Proc. SPIE. 7797, Optics and Photonics for Information Processing IV. Publisher’s Version
Hong, K., Jung, J. – H., Park, J. – H., & Lee, B. (2010). Accurate Lens Lattice Extraction in Distorted Elemental Image Set. Digital Holography and Three-Dimensional Imaging . Optical Society of America. Publisher’s Version
Chung, I., Jung, J. – H., Hong, J., Hong, K., & Lee, B. (2010). Depth Extraction with Sub-Pixel Resolution in Integral Imaging Based on Genetic Algorithm. Digital Holography and Three-Dimensional Imaging . Optical Society of America. Publisher’s Versio
Kim, Y., Hong, K., Jung, J. – H., Hong, J., Lee, Y., Min, S. – W., & Lee, B. (2010). Enhanced Optical Depth Converter Based on Integral Imaging. Digital Holography and Three-Dimensional Imaging . Optical Society of America. Publisher’s Version
Hong, K., Hong, J., Kang, J. – M., Jung, J. – H., Park, J. – H., & Lee, B. (2009). Improved Three-Dimensional Depth Extraction Using Super Resolved Elemental Image Set. Digital Holography and Three-Dimensional Imaging . Optical Society of America. Publisher’s Version
Kang, J., Jung, J. – H., Lee, B., & Park, J. – H. (2009). Object-based integral imaging depth extraction using segmentation. Korean Journal of Optics and Photonics , 20 (2), 94-101. Publisher’s Version
Jung, J. – H., Park, G., Kim, J., Kang, J., & Lee, B. (2009). Three-dimensional conversion of two-dimensional movie using optical flow and normalized cut. Korean Journal of Optics and Photonics , 20 (1), 16-22. Publisher’s Version
Park, G., Jung, J. – H., Kim, J., & Lee, B. (2008). Computer-Generation Method for Elemental Image of Integral Floating Display Using Virtual Integral Imaging System. Digital Holography and Three-Dimensional Imaging . Optical Society of America. Publisher’s Version