# Crunch 1 learderboard ranking

**URL:** https://forum.crunchdao.com/t/crunch-1-learderboard-ranking/696
**Category:** (ended) Broad Institute Crunch #1
**Created:** [January 2, 2025, 7:37pm UTC](https://forum.crunchdao.com/t/crunch-1-learderboard-ranking/696 "2025-01-02T19:37:40Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![relieved-jingzhe](https://forum.crunchdao.com/user_avatar/forum.crunchdao.com/relieved-jingzhe/32/385_2.png) [@relieved-jingzhe](https://forum.crunchdao.com/u/relieved-jingzhe)
#### Post date: [January 2, 2025, 7:37pm UTC](https://forum.crunchdao.com/t/crunch-1-learderboard-ranking/696/1 "2025-01-02T19:37:40Z")

</div>

Hi, looks like the ranking is based on the ‘best’ Spearman’s correlation. Can you please clarify the ‘Best’? the best of what? For each model, we can only select one submission for checkpoint, right?  
Thank you in advance!

---

<div class="post-metadata">

### Author: ![enzo](https://forum.crunchdao.com/user_avatar/forum.crunchdao.com/enzo/32/15_2.png) [@enzo](https://forum.crunchdao.com/u/enzo)
#### Post date: [January 3, 2025, 11:30am UTC](https://forum.crunchdao.com/t/crunch-1-learderboard-ranking/696/2 "2025-01-03T11:30:23Z")

</div>

We rank based on the best prediction score. Where best is the highest spearman score.

---

<div class="post-metadata">

### Author: ![relieved-jingzhe](https://forum.crunchdao.com/user_avatar/forum.crunchdao.com/relieved-jingzhe/32/385_2.png) [@relieved-jingzhe](https://forum.crunchdao.com/u/relieved-jingzhe)
#### Post date: [January 3, 2025, 2:52pm UTC](https://forum.crunchdao.com/t/crunch-1-learderboard-ranking/696/3 "2025-01-03T14:52:13Z")

</div>

I’m still confused. The highest spearman score among all the submissions, or among 8 samples, or among all the cells and genes or what? Can you please further clarify it? Thank you!

---

<div class="post-metadata">

### Author: ![enzo](https://forum.crunchdao.com/user_avatar/forum.crunchdao.com/enzo/32/15_2.png) [@enzo](https://forum.crunchdao.com/u/enzo)
#### Post date: [January 3, 2025, 3:05pm UTC](https://forum.crunchdao.com/t/crunch-1-learderboard-ranking/696/4 "2025-01-03T15:05:54Z")

</div>

The score is a mean across all samples, which is the weighted mean across all cells.

The best value is your highest score (the mean of means).

---

<div class="post-metadata">

### Author: ![relieved-jingzhe](https://forum.crunchdao.com/user_avatar/forum.crunchdao.com/relieved-jingzhe/32/385_2.png) [@relieved-jingzhe](https://forum.crunchdao.com/u/relieved-jingzhe)
#### Post date: [January 3, 2025, 6:07pm UTC](https://forum.crunchdao.com/t/crunch-1-learderboard-ranking/696/5 "2025-01-03T18:07:03Z")

</div>

Sorry, what I still don’t understand is why some of the ‘last subm. Spearman’ are NOT the same of the ‘Best’. Is the ‘Best’ the best among all submission history? Does ‘last’ mean ‘latest’ submission? For each model, we can only select one submission for checkpoint, right? Can you please explain using this example , the current Rank 2 (Best = 39.067, last subm. Spearman = 29.906)? What is the ‘Best’ here? Thank you very much!

---

<div class="post-metadata">

### Author: ![enzo](https://forum.crunchdao.com/user_avatar/forum.crunchdao.com/enzo/32/15_2.png) [@enzo](https://forum.crunchdao.com/u/enzo)
#### Post date: [January 4, 2025, 3:11pm UTC](https://forum.crunchdao.com/t/crunch-1-learderboard-ranking/696/6 "2025-01-04T15:11:29Z")

</div>

Normally the leaderboard everytime some is scored while on the public leaderboard.  
That mean the “last submission” is really the last submission they sent and run!

Since the broad competitions does not have a live public leaderboard, the “last submission” refers to the last submission before the checkpoint.
