2023 IEEE International Conference on Image Processing

2023 IEEE SPS VIP Cup at ICIP 2023

IEEE VIP Cup 2023: Ophthalmic Biomarker Detection

ICIP 2023 SPS Website | VIP Cup 2023 Website
[Sponsored by the IEEE Signal Processing Society]

VIP Cup @ ICIP 2023 final rankings:
Grand Prize: Team Synapse
First Runner-Up Prize: Team Neurons
Second Runner-Up Prize: IITH

The IEEE SPS Video and Image Processing Cup (VIP Cup) student competition, presented by the IEEE Signal Processing Society, gives students the opportunity to work together to solve real-life problems using video and image processing methods. After students submit their work, three final teams are selected to present their work and compete for the grand prize at ICIP 2023.

The three finalist teams have been announced:

Supported by

• Georgia Institute of Technology (Georgia Tech)
• ICIP committee
• IVMSP (Image, Video, and Multidimensional Signal Processing) Technical Committee

Ophthalmic Biomarker Detection

Ophthalmic clinical trials that study treatment efficacy of eye diseases are performed with a specific purpose and a set of procedures that are predetermined before trial initiation. Hence, they result in a controlled data collection process with gradual changes in the state of a diseased eye. In general, these data include 1D clinical measurements and 3D optical coherence tomography (OCT) imagery. Physicians interpret structural biomarkers for every patient using the 3D OCT images and clinical measurements to make personalized decisions for every patient.

Fig 1: An illustration of personalization challenges within the dataset.

Two main challenges in medical image processing have been generalization and personalization. Teams are asked to predict the presence or absence of six different biomarkers simultaneously on every OCT scan in the held-out test set. There will be two phases to the competition leading to the final competition at ICIP 2023.

PHASE 1: Teams register for the competition challenge through the official 2023 VIP Cup Registration System and by filling out this form. Both steps need to be completed in order to register your team and compete.

The leaderboard for PHASE 1 will be hosted on Codalab: HERE

PHASE 2: The TOP 10 TEAMS from the PHASE 1 leaderboard will be invited to re-train their models and submit the same biomarker prediction csv files for each image in the test set to assess how well the model is able to personalize.

Results for PHASE 2 will be published HERE.
Note: In the event of a tie, the performance in phase 1 will determine the winner.

FINAL COMPETITION: The teams will present their work at ICIP 2023.

Full details of this competition including team eligibility and how to submit your work can be found in the 2023 VIP Cup Official Document.
Each team member needs to read the full document.

Data set

To download the dataset, visit Zenodo: https://zenodo.org/record/8040573

Challenge Evaluation Criteria

To measure the performance of the biomarker detection task, we will make use of the macro averaged F1-score.

Calculation:

The equation for F1 score

If we express it in terms of True Positive (TP), False Positive (FP), and False Negative (FN), we get this equation:

The alternative equation for F1 score

The macro-averaged F1 score (or macro F1 score) is computed using the arithmetic mean (aka unweighted mean) of all the per-class F1 scores.

This method treats all classes equally regardless of their support values.

Team Formation Eligibility

Each team participating should be composed of one faculty member or someone with a PhD degree employed by the university (the Supervisor), at most one graduate student (the Tutor), and at least three, but no more than ten undergraduate students. At least three of the undergraduate team members must hold either regular or student memberships of the IEEE Signal Processing Society. Undergraduate students who are in the first two years of their college studies, as well as high school students who are capable to contribute are welcome to participate in a team. A participant cannot be on more than one team.

Prize for Finalists

The three teams with highest performance in the open competition based on the above criteria will be selected as finalists and invited to participate in the final competition at ICIP 2023. The champion team will receive a grand prize of $5,000. The first and the second runner-up will receive a prize of $2,500 and $1,500, respectively, in addition to travel grants and complimentary conference registrations.

• Up to three student members from each finalist team will be provided travel support to attend the conference in-person. In-person attendance of the physical conference is required for reimbursement.
• Complimentary conference registration for the three finalist team members from each team who present at ICIP. These complimentary conference registrations cannot be used to cover any papers accepted by the conference. If you are one of the three finalist team members from each team and wish to receive complimentary registration and/or conference banquet access, you must email Jaqueline Rash, Jaqueline.rash@ieee.org, with this information once your team has been selected as a finalist.
• The three finalist team members from each team will also be invited to join the Conference Banquet and the SPS Student Job Fair, so that they can meet and talk to SPS leaders and global experts. Please note registration to the Conference Banquet and Student Job Fair is limited and based on availability.

Timeline

• 1 July 2023: Registration opens (open till last day of submission) and Training, Validation & Testing (hidden ground truth) data + Starter code availability
• 27 August 2023: Phase 1 + Submission ends (Top 10 TEAM announced)
• 27 August 2023: Phase 2 starts (Submission form available)
• 1 September 2023: Phase 2 submission ends (both csv and report)
• 3 September 2023: Three finalist teams announced
• 8 October 2023: VIP Cup at ICIP 2023

Organizing Committee

School of Electrical and Computer Engineering at the Georgia Institute of Technology (Georgia Tech)

• Ghassan AlRegib (alregib@gatech.edu)
• Mohit Prabhushankar (mohit.p@gatech.edu)
• Kiran Kokilepersaud (kpk6@gatech.edu)
• Prithwijit Chowdhury (pchowdhury6@gatech.edu)
• Zoe Fowler (zfowler3@gatech.edu)