Projects with NRF-NSFC Joint Research Grant

 

NRF-NSFC Joint Research Grant 2016

 

Project Title:  Dietary Computational Model for Mobile Health

Partner:  Peking University (PKU)

Description:  The objective of this project is to develop new computational model for dietary monitoring, including:

  1. Collection of various local food datasets in Singapore for evaluating and test.
  2. Dietary computational model based on advanced deep learning technologies, that can be amenable for mobile use.
  3. Robust food dish recognition based on novel knowledge distillation and few-shot techniques.

 

Duration:  01 Jan 2017 – 30 Jun 2020

 

 

 

 

Project Outcomes:

  • 3 food datasets: NTU-IndianFood-107, MalaysianFood-52 and SingaporeanFood-24
  • 6 journal papers published
  • 12 conference papers published
  • 1 book chapter accepted
  • 2 technology disclosures

 

List of Publications:

Journals:

[1] Heng Zhao, Kim-Hui Yap, Alex C. Kot and Lingyu Duan. JDNet: A Joint-learning Distilled Network for Mobile Visual Food Recognition. IEEE Journal of Selected Topics in Signal Processing. JSTSP.2020.2969328

[2] Renjie Wan, Boxin Shi, Haoliang Li, Lingyu Duan, Ah-Hwee Tan and Alex C. Kot. CoRRN: Cooperative Reflection Removal Network. IEEE Transactions on Pattern Analysis and Machine Intelligence. TPAMI.2019.2921574

[3] Haoliang Li, Sinno Jialin Pan, Shiqi Wang and Alex C. Kot. Heterogeneous Domain Adaptation via Nonlinear Matrix Factorization. IEEE Transactions on Neural Networks and Learning Systems. TNNLS.2019.2913723

[4] Lou Yihang, Yan Bai, Jun Liu, Shiqi Wang and Lingyu Duan. Embedding adversarial learning for vehicle re-identification. IEEE Transactions on Image Processing. TIP.2019.2902112

[5] Lingyu Duan, Vijay Chandrasekhar, Shiqi Wang, Yihang Lou, Jie Lin, Yan Bai, Tiejun Huang, Alex C. Kot and Wen Gao. Compact Descriptors for Video Analysis: The Emerging MPEG Standard. IEEE MultiMedia. MMUL.2018.2873844

[6] Ziqian Chen, Lingyu Duan, Shiqi Wang, Yihang Lou, Tiejun Huang, Dapeng Oliver Wu and Wen Gao. Towards knowledge as a service over networks: a deep learning model communication paradigm. IEEE Journal on Selected Areas in Communications. JSAC.2019.2904360

 

Conference papers:

[7] Renjie Wan, Boxin Shi, Haoliang Li, Lingyu Duan and Alex C. Kot.  Reflection Scene Separation From a Single Image. 2020 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). CVPR42600.2020.00247

[8] Qian Zheng, Jinnan Chen, Zhan Lu, Boxin Shi, Xudong Jiang, Kim-Hui Yap, Lingyu Duan and Alex C. Kot. What does plate glass reveal about camera calibration. 2020 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). CVPR42600.2020.00309

[9] Daiqian Ma, Renjie Wan, Boxin Shi, Alex C Kot and Lingyu Duan. Learning to Jointly Generate and Separate Reflections. 2019 IEEE/CVF Internaltional Conference on Computer Vision (ICCV). ICCV.2019.00253

[10] Qian Zheng, Yiming Jia, Boxin Shi, Xudong Jiang, Ling-Yu Duan and Alex C Kot. SPLINE-Net: Sparse Photometric Stereo through Lighting Interpolation and Normal Estimation Networks. 2019 IEEE/CVF International Conference on Computer Vision (ICCV). ICCV.2019.00864

[11] Qian Zheng, Boxin Shi, Xudong Jiang, Ling-Yu Duan and Alex C. Kot. Denoising Adversarial Networks for Rain Removal and Reflection Removal. 2019 IEEE International Conference on Image Processing (ICIP). ICIP.2019.8803225

[12] Zhao Heng, Kim-Hui Yap and Alex C. Kot. A Compact Distilled Network by Accelerated Ensemble Learning for Mobile Visual Food Recognition. 2019 The 21st  International Conference on Artificial Intelligence (ICAI).

[13] Ce Wang, Renjie Wan, Feng Gao, Boxin Shi and Lingyu Duan. Learning to remove reflections from text images. 2019 IEEE International Conference on Multimedia and Expo (ICME). ICME.2019.00222

[14] Lin Zhang, Jianbo Zhao, Si Li, Boxin Shi and Lingyu Duan. From market to dish: Multi-ingredient image recognition for personalized recipe recommendation. 2019 IEEE International Conference on Multimedia and Expo (ICME).  ICME.2019.00218

[15] Heng Zhao, Kim-Hui Yap, Alex C. Kot, Lingyu Duan and Ngai-Man Cheung. Few-shot and Many-shot Fusion Learning in Mobile Visual Food Recognition. FoodCAS, 2019 IEEE International Symposium on Circuits and Systems (ISCAS). ISCAS.2019.8702564

[16] Haoliang Li, Sinno Jialin Pan, Renjie Wan and Alex C. Kot. Heterogeneous Transfer Learning via Deep Matrix Completion with Adversarial Kernel Embedding. 2019 The 33rd  AAAI Conference on Artificial Intelligence (AAAI-19).

[17] Zhao Heng, Sharmili Roy, Kim-Hui Yap, Alex C. Kot and Lingyu Duan. Personalized Knowledge Distillation-based Mobile Food Recognition. 2018 The 20th International Conference on Artificial Intelligence (ICAI).

[18] Renjie Wan, Boxin Shi, Lingyu Duan, Ah-Hwee Tan and Alex C. Kot. Benchmarking Single-image Reflection Removal Algorithms. 2017 IEEE International Conference on Computer Vision (ICCV). ICCV.2017.423

 

 

Sample Images from collected datasets:

Sample Images from collected datasets:

 

 

Screenshot of mobile food recognition app prototype:

Screenshot of mobile food recognition app prototype: Screenshot of mobile food recognition app prototype: