Welcome!

Digital Image Media Lab is a research lab based in Yonsei University, Seoul, South Korea. Since the lab was founded in 1996 under supervision of Prof. Kwanghoon Sohn, we have been conducting research on diverse topics in image processing and computer vision area.

Some of the selected topics we are interested and currently working on are:

3D Video Processing Deep Learning for 3D Video Processing Multi-view Video Processing Image Enhancement / Editing Intelligent Computer Vision Deep Learning for Vision ADAS(advanced driver assistance systems) Multispectral Imaging / Feature Extraction

News

Congratulations! Wonil Song (Ph.D. Student)'s paper has been accepted in AAAI (Oral), Nov. 2019

"Stereoscopic Image Super-Resolution with Stereo Consistent Feature"
W. Song, S. Choi, S. Jeong, and K. Sohn
The Thirty-Fourth AAAI Conference on Artificial Intelligence, February 2020.


Congratulations! Jungin Park (Ph.D. Student) has won The 3rd place for the challenge on CoVieW'2019 ICCV Workshop, Oct. 2019


"Video Summarization by Learning Relationships between Action and Scene"
J. Park, J. Lee, S. Jeon, and K. Sohn
IEEE International Conference on Computer Vision Workshop (ICCVW), October 2019.
Jungin Park (Ph.D. Student)'s work has been awarded The Third Place in Challenge Track for video summarization and recognition task on CoVieW'2019 ICCV Workshop.

Congratulations! One of our project has been awarded Outstanding 100 National Research Projects, Oct. 2019


Our project Research on Fundamental Technology for Deep Learning-Based Semantic State Understanding has been awarded Outstanding 100 National Research Projects by Ministry of Science and ICT.
The research team developed an efficient algorithm that automatically annotate emotion/action/scene labels on the untrimmed videos. The newly introduced dataset annotated with developed algorithm has been publicly released for reproducability and used as a standard benchmark for CoVieW 2018 (in conjunction with ACMMM2018) and 2019 (in conjunction with ICCV2019) challenge.


Congratulations! Jungin Park (Ph.D. Student)'s paper has been accepted in ICCV Workshop, Sep. 2019

"Video Summarization by Learning Relationships between Action and Scene"
J. Park, J. Lee, S. Jeon, and K. Sohn
IEEE International Conference on Computer Vision Workshop (ICCVW), October 2019.


Congratulations! Jiyoung Lee (Ph.D. Student)'s paper has been accepted in International Conference on Computer Vision (ICCV), Jul. 2019

"Context-Aware Emotion Recognition Networks"
J. Lee, S. Kim, S. Kim, J. Park, and K. Sohn
International Conference on Computer Vision (ICCV), October 2019.


Congratulations! Sangryul Jeon (Ph.D. Student)'s paper has been accepted in International Conference on Computer Vision (ICCV), Jul. 2019

"Joint Learning of Semantic Alignment and Object Landmark Detection"
S. Jeon, D. Min, S. Kim, and K. Sohn
International Conference on Computer Vision (ICCV), October 2019.


Congratulations! Changjae Oh(Ph.D.) will join the faculty of Queen Mary University of London, Jul. 2019


Changjae Oh is employed as a Lecturer (Assistant Professor) in School of Electronic Engineering and Computer Science (EECS), specifically Multimedia area.
EECS at QMUL is ranked 100th in the 2019 Times Higher Education World University Rankings, 9th most highly ranked in the UK for computer science.


Congratulations! Somi Jeong (Ph.D. Student)'s paper has been accepted in IEEE Trans. on Image Processing, May. 2019

"Learning to Find Unpaired Cross-spectral Correspondences"
S. Jeong, S. Kim, K. Park, and K. Sohn
IEEE Trans. on Image Processing (TIP).


Congratulations! Sunghun Joung (Ph.D. Student)'s paper has been accepted in IEEE Trans. on Intelligent Transportation Systems, May. 2019

"Unsupervised Stereo Matching Using Confidential Correspondence Consistency"
S. Joung, S. Kim, K. Park, and K. Sohn
IEEE Trans. on Intelligent Transportation Systems (TITS).


Congratulations! Jungin Park (Ph.D. Student)'s paper has been accepted in ICIP (Oral), May. 2019

"Graph Regularization Network with Semantic Affinity for Weakly-supervised Temporal Action Localization"
J. Park, J. Lee, S. Jeon, S. Kim, and K. Sohn
IEEE International Conference on Image Processing (ICIP), September 2019.


Congratulations! Minsu Kim (Ph.D. Student)'s paper has been accepted in ICIP (Oral), May. 2019

"Unpaired Cross-Spectral Pedestrian Detection Via Adversarial Feature Learning"
M. Kim, S. Joung, K. Park, S. Kim, and K. Sohn
IEEE International Conference on Image Processing (ICIP), September 2019.


Congratulations! Seungryong Kim (Ph.D.)'s paper has been accepted in CVPR, Mar. 2019

"Semantic Attribute Matching Networks"
S. Kim, D. Min, S. Jeong, S. Kim, S. Jeon, and K. Sohn
IEEE Conf. Computer Vision Pattern Recognition (CVPR), June 2019.


Congratulations! Sunok Kim (Ph.D.)'s paper has been accepted in CVPR (Oral), Mar. 2019

"LAF-Net: Locally Adaptive Fusion Networks for Stereo Confidence Estimation"
S. Kim, S. Kim, D. Min, and K. Sohn
IEEE Conf. Computer Vision Pattern Recognition (CVPR), June 2019.


Congratulations! Changjae Oh(Ph.D.)'s paper has been accepted in Expert Systems With Applications, Jan. 2019

"OCEAN: Object-Centric Arranging Network for Self-supervised Visual Representations Learning"
C. Oh, B. Ham, H. Kim, A. Hilton, and K. Sohn
Expert Systems With Applications (ESWA), Jan 2019.


Congratulations! Yoonji Cho(Postdoctoral Researcher)'s paper has been accepted in Coloration Technology, Jan. 2019

"The Impact of Viewing Conditions on Observer Variability for Cross-Media Colour Reproduction"
Y. Cho, G. Cui, R. Luo, and K. Sohn
Coloration Technology, Jan 2019.


Congratulations! Kihong Park(Ph.D. Student)'s paper has been accepted in IEEE Trans. on Intelligent Transportation Systems, Dec. 2018

"High-precision Depth Estimation Using Uncalibrated LiDAR and Stereo Fusion"
K. Park, S. Kim, and K. Sohn
IEEE Trans. on Intelligent Transportation Systems (TITS), Dec 2018.


Congratulations! Youngjung Kim(Ph.D.)'s paper has been accepted in IEEE Trans. on Image Processing, Dec. 2018

"Structure-Texture Image Decomposition using Deep Variational Priors"
Y. Kim, B. Ham, M. Do, and K. Sohn
IEEE Trans. on Image Processing (TIP), Dec 2018.


We co-organized The 1st Workshop and Challenge on Comprehensive Video Understanding in the Wild (CoVieW'18) in ACM Multimedia Workshop 2018.





The 1st Workshop and Challenge on Comprehensive Video Understanding in the Wild (CoVieW'18)


We co-organized Workshop on Audio-Visual Scene Understanding for Immersive Multimedia in ACM Multimedia Workshop 2018.





Workshop on Audio-Visual Scene Understanding for Immersive Multimedia


Congratulations! Sunok Kim(Ph.D. Student)'s paper has been accepted in IEEE Trans. on Image Processing, Oct. 2018

"Unified Confidence Estimation Networks for Robust Stereo Matching"
S. Kim, D. Min, S. Kim, and K. Sohn
IEEE Trans. on Image Processing (TIP), Oct 2018.


Congratulations! Seungryong Kim(Postdoctoral Researcher)'s paper has been accepted in IEEE Trans. on Pattern Analysis and Machine Intelligence, Sep. 2018

"Discrete-Continuous Transformation Matching for Dense Semantic Correspondence"
S. Kim, D. Min, S. Lin, and K. Sohn
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), Sep 2018.


Congratulations! Taeyong Song(Ph.D. Student) was awarded the Best Science Paper Honourable Mention in BMVC 2018, Sep. 2018



"Deep Network for Simultaneous Stereo Matching and Dehazing"
T. Song, Y. Kim, C. Oh, and K. Sohn
BMVC, September. 2018.


Congratulations! Seungryong Kim(Postdoctoral Researcher)'s paper has been accepted in NIPS (Spotlight), Dec. 2018

"Recurrent Transformer Networks for Semantic Correspondence"
S. Kim, S. Lin, S. Jeon, D. Min, and K. Sohn
ACMMM Workshops, October. 2018.


Congratulations! Jungin Park(Ph.D. Student)'s paper has been accepted in ACMMM Workshop, Oct. 2018

"Learning to Detect, Associate, and Recognize Human Actions and Surrounding Scenes in Untrimmed Videos"
J. Park, S. Jeon, S. Kim, J. Lee, S. Kim, and K. Sohn
ACMMM Workshops, October. 2018.


Congratulations! Jiyoung Lee(Ph.D. Student)'s paper has been accepted in ACMMM Workshop, Oct. 2018

"Audio-Visual Attention Networks for Emotion Recognition"
J. Lee, S. Kim, S. Kim and K. Sohn
ACMMM Workshops, October. 2018.


Congratulations! Yoonji Cho(Postdoctoral Researcher)'s paper has been accepted in CIC26, Nov. 2018

"Reversible Colour Appearance Scales for Describing Saturation, Vividness, Blackness, and Whiteness for Image Enhancement"
Y. Cho, G. Cui, and K. Sohn
CIC26, November. 2018.


Congratulations! Sangryul Jeon(Ph.D. Student)'s paper has been accepted in ECCV , Sep. 2018

"PARN : Pyramidal Affine Regression Networks for Dense Semnatic Correspondence Estimation"
S. Jeon, S. Kim, D. Min, and K. Sohn
ECCV, September. 2018.


Congratulations! Taeyong Song(Ph.D. Student)'s paper has been accepted in BMVC (Oral) , Sep. 2018

"Deep Network for Simultaneous Stereo Matching and Dehazing"
T. Song, Y. Kim, C. Oh, and K. Sohn
BMVC, September. 2018.


Congratulations! Sungil Choi(Ph.D. Student)'s paper has been accepted in CVPR Workshop, June. 2018

"Learning Descriptor, Confidence, and Depth Estimation in Multi-view Stereo"
S. Choi, S. Kim, K. Park, and K. Sohn
IEEE Conf. Computer Vision Pattern Recognition(CVPR) Workshop, June 2018.


Congratulations! Youngjung Kim(Ph.D. Student)'s paper has been accepted for publication in IEEE Trans. on Image Processing, May. 2018

"Deep Monocular Depth Estimation via Integration of Global and Local Predictions"
Y. Kim, H. Jung, D. Min, and K. Sohn
IEEE Trans. on Image Processing, May 2018.


Congratulations! Seungryong Kim(Postdoctoral Researcher), being named the 33th Chun-Gang Outstanding Research Award 2018, June. 2018

Achievement : IEEE Trans. on Pattern Analysis and Machine Intelligence Vol.39, No.9, pp1712-1729, September, 2017"


Congratulations! Changjae Oh(Ph.D.) will join the postdoctoral researcher of Queen Mary University of London, April. 2018
Congratulations! Jaehoon Cho(Ph.D. Student)'s paper has been accepted in ICME (Oral), July. 2018

"Multi-task Self-supervised Visual Representation Learning for Monocular Road Segmentation."
J. Cho, Y. Kim, H. Jung, C. Oh, J. Youn, and K. Sohn
IEEE International Conference on Multimedia and Expo (ICME), July 2018.


Congratulations! Kihong Park(Ph.D. Student)'s paper has been accepted in Pattern Recognition, March. 2018

"Unified Multi-spectral Pedestrian Detection Based on Probabilistic Fusion Networks."
K. Park, S. Kim, and K. Sohn
Pattern Recognition (PR), March 2018.


Congratulations! Jiyoung Lee(Ph.D. Student)'s paper has been accepted in ICASSP, April. 2018

"Spatiotemporal Attention Based Deep Neural Networks for Emotion Recognition."
J. Lee, S. Kim, S. Kim, and K. Sohn
IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), April 2018.


Congratulations! Kihong Park(Ph.D. Student)'s paper has been accepted in ICRA, May. 2018

"High-precision Depth Estimation with the 3D LiDAR and Stereo Fusion."
K. Park, S. Kim, and K. Sohn
International Conference on Robotics and Automation (ICRA), May 2018.


Congratulations! Seungryong Kim(Ph.D. Student)'s paper has been accepted in IEEE Trans. on Pattern Analysis and Machine Intelligence, Jan. 2018

"FCSS: Fully Convolutional Self-Similarity for Dense Semantic Correspondence."
S. Kim, D. Min, B. Ham, S. Lin , and K. Sohn
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), Jan 2018.


Congratulations! Kyuwon Kim(Ph.D.) being named a 2018 winner of the IEEE Consumer Electronics Society Chester Sall Award for the First place best paper in IEEE Trans. on Consumer Electronics 2016, Oct. 2017

"Non-Parametric Human Segmentation Using Support Vector Machine"
K. Kim, C. Oh, and K. Sohn,
IEEE Trans. on Consumer Electronics, vol. 62, no. 2, pp. 150-158, May. 2016.


Congratulations! Sunok Kim(Ph.D. Student)'s paper has been accepted for publication in IEEE Trans. on Image Processing, Aug. 2017

"Feature Augmentation for Learning Confidence Measure in Stereo Matching"
S. Kim, D. Min, S. Kim, and K. Sohn
IEEE Trans. on Image Processing, August 2017.


Congratulations! Seungryong Kim(Ph.D. Student)'s paper has been accepted in ICCV (Oral), Oct. 2017


"DCTM: Discrete-Continuous Transform Matching for Semantic Flow"
S. Kim, D. Min, S. Lin, and K. Sohn
International Conference on Computer Vision(ICCV), October 2017.
Only oral presentation among Korean authors (top 2%, total of 40 papers).

This research was performed in collaboration with Dr. Steve Lin from Microsoft Research Asia (MSRA) and published on the Microsoft research Blog Link.


Congratulations! 8 members' papers have been accepted in ICIP, Sep. 2017

"Pedestrian Proposal Generation using Depth-aware Scale Estimation"
K. Park, S. Kim and K. Sohn
"Deep Stereo Confidence Prediction for Depth Estimation"
S. Kim, D. Min, B. Ham, S. Kim and K. Sohn
"Depth Prediction from a Single Image with Conditional Adversarial Networks"
H. Jung, Y. Kim, D. Min, C. Oh and K. Sohn
"Multi-spectral Human Co-segmentation via Joint Convolutional Neural Networks"
S. Choi, S. Kim, K. Park and K. Sohn
"Automatic 2D-to-3D Conversion using Multi-scale Deep Neural Network"
J. Lee, H. Jung, Y. Kim and K. Sohn
"Unsupervised Stereo Matching using Correspondence Consistency"
S. Joung, S. Kim, B. Ham and K. Sohn
"Convolutional Feature Pyramid Fusion via Attention Network"
S. Jeon, S. Kim and K. Sohn
"Convolutional Cost Aggregation for Robust Stereo Matching"
S. Jeong, S. Kim, B. Ham and K. Sohn
IEEE International Conference on Image Processing(ICIP), September 2017.


Congratulations! Youngjung Kim(Ph.D. Student)'s paper has been accepted for publication in IEEE Trans. on Image Processing, May. 2017

"Fast Domain Decomposition for Global Image Smoothing"
Y. Kim, D. Min, B. Ham, and K. Sohn
IEEE Trans. on Image Processing, May 2017.


An article about collaboration between MSRA and DIML is published on the Microsoft Webpage, May. 2017

Link to article
"Unified Depth Prediction and Intrinsic Image Decomposition from a Single Image via Joint Convolutional Neural Fields"
S. Kim, K. Park, K. Sohn, and S. Lin
in Proc. European Conference on Computer Vision(ECCV), May 2017.


Congratulations! Youngjung Kim(Ph.D. Student)'s paper has been accepted in CVPR (spotlight), Mar. 2017

"Deeply Aggregated Alternating Minimization for Image Resotration."
Y. Kim, H. Jung, D. Min, and K. Sohn
IEEE Conf. Computer Vision Pattern Recognition(CVPR), Mar 2017.


Congratulations! Seungryong Kim(Ph.D. Student)'s paper has been accepted in CVPR, Mar. 2017

"FCSS: Fully Convolutional Self-Similarity for Dense Semantic Correspondence."
S. Kim, D. Min, B. Ham, S. Jeon, S.Lin and K. Sohn
IEEE Conf. Computer Vision Pattern Recognition(CVPR), Mar 2017.


Congratulations! Jongin Son(Ph.D.) and Hangil Choi(M.S.) have been graduated from Yonsei Univ. Feb. 2017
Congratulations! Seungryong Kim(Ph.D. Student)'s paper has been accepted for publication in IEEE Trans. on Image Processing, Nov. 2016

"Modality-Invariant Image Classification Based on Modality Uniqueness and Dictionary Learning."
S. Kim, R. Cai, K. Park, S. Kim, and K. Sohn
IEEE Trans. on Image Processing, November 2016.


Congratulations! Seungryong Kim(Ph.D. Student)'s paper has been accepted for publication in IEEE Trans. on Pattern Analysis and Machine Intelligence, Sep. 2016

"DASC: Robust Dense Descriptor for Multi-modal and Multi-spectral Correspondence Estimation."
S. Kim, D. Min, B. Ham, M. Do, and K. Sohn
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), September 2016.


Congratulations! Seungryong Kim(Ph.D. Student), Kihong Park(Ph.D. Student) and Hangil Choi(M.S. Student) won the Hyundai Hackathon Callenge 2016, Aug. 2016





S. Kim, K. Park, and H. Choi
Hyundai Hackathon Callenge 2016


Congratulations! Seungchul Ryu(Ph.D. Student)'s paper has been accepted for publication in Pattern Recognition, Sep. 2016

"Local Area Transform for Cross Modal Correspondence Matching."
S. Ryu, S. Kim, and K. Sohn
Pattern Recognition (PR), September 2016.


Congratulations! Youngjung Kim(Ph.D. Student)'s paper has been accepted for publication in IEEE Trans. on Image Processing, Aug. 2016

"Structure selective depth super-resolution for RGB-D cameras."
Y. Kim, B. Ham, C. Oh, and K. Sohn
IEEE Trans. on Image Processing, August 2016.


• Congratulations! Bumsub Ham(Ph.D.) will join the faculty of Yonsei University, Aug. 2016
• Congratulations! Seungryong Kim(Ph.D. Student)'s papers have been accepted in ECCV (spotlight), Jul. 2016

Recent activities

• ICIP 2019, Taipei, Taiwan: M. Kim, "Unpaired Cross-Spectral Pedestrian Detection Via Adversarial Feature Learning"
• ICIP 2019, Taipei, Taiwan: J. Park, "Graph Regularization Network with Semantic Affinity for Weakly-supervised Temporal Action Localization"
• CVPR 2019, Long Beach, CA: S. Kim, "LAF-Net: Locally Adaptive Fusion Networks for Stereo Confidence Estimation"
• CVPR 2019, Long Beach, CA: S. Kim, "Semantic Attribute Matching Networks"
• NIPS 2018, Montreal, Canada: S. Kim, "Recurrent Transformer Networks for Semantic Correspondence"
• CIC26 2018, Vancouver, Canada: Y. Cho, "Reversible Colour Appearance Scales for Describing Saturation, Vividness, Blackness, and Whiteness for Image Enhancement"
• ACMMM Workshop 2018, Seoul, Korea: J. Lee, "Audio-Visual Attention Networks for Emotion Recognition"
• ACMMM Workshop 2018, Seoul, Korea: J. Park, "Learning to Detect, Associate, and Recognize Human Actions and Surrounding Scenes in Untrimmed Videos"
• ECCV 2018, Munich, Germany: S. Jeon, "PARN : Pyramidal Affine Regression Networks for Dense Semnatic Correspondence Estimation"
• BMVC 2018, Newcastle upon Tyne, UK: T. Song, "Deep Network for Simultaneous Stereo Matching and Dehazing"
• ICME 2018, Sandiego, US: J. Cho, "Multi-task Self-supervised Visual Representation Learning for Monocular Road Segmentation"
• CVPR Workshop 2018, Salt Lake City, US: S. Choi, "Learning Descriptor, Confidence, and Depth Estimation in Multi-view Stereo"
• ICRA 2018, Brisbane, Australia: K. Park, "High-precision Depth Estimation with the 3D LiDAR and Stereo Fusion"
• ICASSP 2018, Calgary, Canada: J. Lee, "Spatiotemporal Attention Based Deep Neural Networks for Emotion Recognition"
• ICCV 2017, Venice, Italy: S. Kim, "DCTM: Discrete-Continuous Transform Matching for Semantic Flow"
• ICIP 2017, Beijing, China: K. Park, "Pedestrian Proposal Generation using Depth-aware Scale Estimation"
• ICIP 2017, Beijing, China: S. Kim, "Deep Stereo Confidence Prediction for Depth Estimation"
• ICIP 2017, Beijing, China: H. Jung, "Depth Prediction from a Single Image with Conditional Adversarial Networks"
• ICIP 2017, Beijing, China: S. Choi, "Multi-spectral Human Co-segmentation via Joint Convolutional Neural Networks"
• ICIP 2017, Beijing, China: J. Lee, "Automatic 2D-to-3D Conversion using Multi-scale Deep Neural Network"
• ICIP 2017, Beijing, China: S. Joung, "Unsupervised Stereo Matching using Correspondence Consistency"
• ICIP 2017, Beijing, China: S. Jeon, "Convolutional Feature Pyramid Fusion via Attention Network"
• ICIP 2017, Beijing, China: S. Jeong, "Convolutional Cost Aggregation for Robust Stereo Matching"
• CVPR 2017, Hawaii, US: Y. Kim, "Deeply Aggregated Alternating Minimization for Image Resotration"
• CVPR 2017, Hawaii, US: K. Kim, "FCSS: Fully Convolutional Self-Similarity for Dense Semantic Correspondence"
• ICCE 2017, Las Vegas, US: K. Kim, "Lazy Dragging: Effortless Bounding-box Drawing for Touch-screen Devices"
• APSIPA 2016, Jeju, KOR: K. Park, "Homography Flow for Dense Correspondences"
• ICPR 2016, Cancun, MEX: H. Choi, "Multi-spectral Pedestrian Detection Based on Accumulated Object Proposal with Fully Convolution Network"
• ACCV 2016, Taipei, TPE: C. Oh, "Point-cut: Interactive Image Segmentation using One-point Supervision"
• ECCV 2016, Amsterdam, NLD: S. Kim, "Deep Self-Convolutional Activations Descriptor for Dense Cross-Modal Correspondence"
• ECCV 2016, Amsterdam, NLD: S. Kim, "Unified Depth Prediction and Intrinsic Image Decomposition from a Single Image via Joint Convolutional Neural Fields"
• ICIP 2016, Arizona, US: S. Kim, "ANCC FLOW: Adaptive Normalized Cross-Correlation with Evolving Guidance Aggregation for Dense Correspondence Estimation"
• EI 2016, San Francisco, US: S. Choi, "Multi-level segment based dense correspondence: an affine transformation approach"
• EI 2016, San Francisco, US: H. Jung, "Depth Extraction from a Single Image Based on Block-Matching and Robust Regression"
• ICCE 2016, Las Vegas, US: K. Kim, "Non-Parametric Human Segmentation Using Support Vector Machine"

Menu

• Home
• Introduction
• Research
  • Overview
    
  • Projects
• People
  • Professor
    
  • Research Professor
  • Students
  • Alumni
• Lecture
  • Undergraduate
    
  • Graduate
  • Graduate (Engineering)
• Publications
  • International Journals
    
  • International Conferences
  • Domestic Journals
  • Domestic Conferences
  • Patents
• Photo
• Dataset
• Contact

Contact

• C129, The 3rd Engineering Building, Yonsei University, 50 Yonsei-ro, Seodaemun-Gu, Seoul 120-749, Korea
• Phone: +82-2-2123-2879
  Fax: +82-2-313-2879
  Email: khsohnyonsei.ac.kr

Home | Introduction | Research | People | Lecture | Publications | Photo | Dataset | Contact

© 2012 Digital Image Media Lab @ Yonsei University