Could you please provide some info if possible that how would you evaluate the rank metric in our submission?
We will employ the Spearman Rank Correlation Coefficient as our metric for evaluation. For each task, the ranks submitted by contestants will be compared with those calculated from actual values using the Spearman Correlation Coefficient. I hope this helps. Also, if you would like to read details about how submission results will be analyzed, feel free to refer to the results summary from 1st (internal) challenge here.