Illumination Estimation Challenges

First Leaderboard

Two evaluations were formed for the submitted results of the first validation set. The first leaderboard is based on the people's opinion and the second is based on the professinal photographer's opinion, which is explained in more detail here.

The password for the encrypted validation set archive is "RWL53C5zfr2s4xLY6Z06" without the double quotes.

People's choice

The leaderboard was formed by including every submission in 1500 comparisons using the Toloka platform. The score mean multiplied by 1500 gives the number of actual votes that a particular submission received.

Rank Team Member(s) Affiliation Score mean Votes
1 MIALGO Shuai Liu Xiaomi 0.8133 1220
2 Feedback is all you need (2nd submission) Ling-Hao Han, Xin Jin Nankai University 0.6003 901
3 Feedback is all you need (1st submission) Ling-Hao Han, Xin Jin Nankai University 0.5930 890
4 NoahTCV Li Wei Huawei Noah's Ark Lab 0.5507 826
5 IVLTeam (1st submission) Simone Zini, Marco Buzzelli, Simone Bianco, Claudio Rota, Raimondo Schettini University of Milano - Bicocca 0.5120 768
6 dbs (2nd submission) Bosong Ding - 0.5033 755
7 IVLTeam (2nd submission) Simone Zini, Marco Buzzelli, Simone Bianco, Claudio Rota, Raimondo Schettini University of Milano - Bicocca 0.4903 735
8 baseline - - 0.3447 517
9 sorashiro - Nanjing University 0.3070 461
10 dbs (1st submission) Bosong Ding - 0.2853 428
- Alielie Fan Siyuan Beihang University - -
- Artificially Inspired Sanchit Hira, Ritwik Das - - -
- BISPL Dohoon Ryu, Taesung Kwon, Hyokyung Bae KAIST - -
- Bridge AI Tu Vo KC-ML2 - -
- DarkSoul Changlin Li, Xin Tao Kuaishou - -
- HCMUS-Illuminate Thuc Nguyen-Quang, Minh-Triet Tran University of Science and John von Neumann Institute, VNUHCM - -
- IPCV_IITM Maitreya Suin, A. N. Rajagopalan IIT Madras - -
- LeonShangguan Zhongkai Shangguan, Zihe Zheng Boston University, University of Rochester - -
- Low Light Hypnotize Amogh Joshi, Chinmayee Mandi, Sampada Malagi, Akash Uppin KLE Technological University, Hubli, INDIA - -
- MLIP_Lab_SVNIT_NTNU Heena Patel SVNIT, Surat - -
- MLIP_SVNIT_NTNU_2 Anjali Sarvaiya SVNIT, Surat - -
- MLIP_SVNIT_NTNU_3 Hiren SVNIT-Surat - -
- OrangeNewBlock Joohyeok Kim UNIST - -
- Signal - UNIST - -
- SKKU-AL Long Hoang Pham, Duong Nguyen-Ngoc Tran, Huy-Hung Nguyen, Tai Huu-Phuong Tran, Hyung-Joon Jeon, Jae Wook Jeon Sungkyunkwan University, South Korea - -
- Tstar - University of Science and Technology of China - -
- USTC-MCC - - - -
- xdTeam2022 Weiran Wang, Shirui Huang, Honglei Lu Xidian University - -
- Xpixel-UM Xiangyu Chen University of Macau - -
- Zhen Li Zhen Li Nankai University - -

Photographer's choice

Rank Team Member(s) Affiliation
1 MIALGO Shuai Liu Xiaomi
2 Feedback is all you need (2nd submission) Ling-Hao Han, Xin Jin Nankai University
3 dbs (1st submission) Bosong Ding -
4 dbs (2nd submission) Bosong Ding -
5 baseline - -
6 sorashiro - Nanjing University
7 Feedback is all you need (1st submission) Ling-Hao Han, Xin Jin Nankai University
8 NoahTCV Li Wei Huawei Noah's Ark Lab
9 IVLTeam (1st submission) Simone Zini, Marco Buzzelli, Simone Bianco, Claudio Rota, Raimondo Schettini University of Milano - Bicocca
10 IVLTeam (2nd submission) Simone Zini, Marco Buzzelli, Simone Bianco, Claudio Rota, Raimondo Schettini University of Milano - Bicocca
- Alielie Fan Siyuan Beihang University
- Artificially Inspired Sanchit Hira, Ritwik Das -
- BISPL Dohoon Ryu, Taesung Kwon, Hyokyung Bae KAIST
- Bridge AI Tu Vo KC-ML2
- DarkSoul Changlin Li, Xin Tao Kuaishou
- HCMUS-Illuminate Thuc Nguyen-Quang, Minh-Triet Tran University of Science and John von Neumann Institute, VNUHCM
- IPCV_IITM Maitreya Suin, A. N. Rajagopalan IIT Madras
- LeonShangguan Zhongkai Shangguan, Zihe Zheng Boston University, University of Rochester
- Low Light Hypnotize Amogh Joshi, Chinmayee Mandi, Sampada Malagi, Akash Uppin KLE Technological University, Hubli, INDIA
- MLIP_Lab_SVNIT_NTNU Heena Patel SVNIT, Surat
- MLIP_SVNIT_NTNU_2 Anjali Sarvaiya SVNIT, Surat
- MLIP_SVNIT_NTNU_3 Hiren SVNIT-Surat
- OrangeNewBlock Joohyeok Kim UNIST
- Signal - UNIST
- SKKU-AL Long Hoang Pham, Duong Nguyen-Ngoc Tran, Huy-Hung Nguyen, Tai Huu-Phuong Tran, Hyung-Joon Jeon, Jae Wook Jeon Sungkyunkwan University, South Korea
- Tstar - University of Science and Technology of China
- USTC-MCC - -
- xdTeam2022 Weiran Wang, Shirui Huang, Honglei Lu Xidian University
- Xpixel-UM Xiangyu Chen University of Macau
- Zhen Li Zhen Li Nankai University