Survey on scoring and ranking @
At Ultrasignup.com we are exploring ways that we may be able to improve our racer ranking system.
We know you might think that this is a terrible idea, but we want to reassure you that the old ranking will still exist! This is our legacy ranking system and it will never disappear from the system. We may find that our ranking system, as it currently exists, needs no improvement. If this is the conclusion, then we will continue to ride this ranking system. But, if we can make improvements to the way that athletes are ranked, then we want to consider all options.
Indeed, we hope that an additional ranking will overcome some of the limitations of the current ranking system.
However, we would love to hear feedback from you about what you would like to see in this new system.
Please let us know your opinion by filling out this survey!
Sign in to Google
to save your progress.
Should all races count towards a runner's ranking (regardless of age of results) or should the system only consider those races completed in the past few years (say between 3-5 years)?
All past races
Should all of a runner's races count towards the their ranking or only their best 5 or 10 results?
All past races
Would you prefer a system where
scores range between 0 and 100
scores range between 0 and 1000
scores do not have an upper bound
Should the new ranking system be weigher more heavily towards an athlete's finishing time (relevant to the winner's finishing time) or should a racer's finishing position carry more weight?
finishing time more important than finishing position
finishing position more important than finishing time
Should DNFs in a race count towards an athlete's ranking?
Yes, DNFs should be taken into account
No, DNFs should not be taken into account
Would you prefer a ranking system that "evolves" over time through the use of machine learning or would you prefer a "fixed" ranking system that only changes through active edits by UltraSignup? Note that both UltraSignup and ITRA currently have "fixed" systems.
Fixed system: scores of my past performances never change
Evolving system: machine learning and algorithm improvements will allow scores of my past performances (and resulting overall score) to change
Should depth of field (ranking of other athletes in the race) count towards a racer's score for that race? E.g., winning 1st place in a race where all runners have low ranking would improve a racer's overall ranking score less than winning 1st place in a race where all runners have high ranking (elite runners).
Should the scoring system be gender neutral or categorized? Gender neutral means that we would have a single unique raking system for everyone - regardless of gender.
gender neutral/agnostic of gender
To which gender identity do you most identify?
Rather not say
What should a "fair" ranking system look like?
Can you think of other types of rankings and scores that you would like to see? For example, separate rankings for short vs. long distance races, or a ranking for legacy (career length and achievements), or grit (difficulty of accomplishments).
Can you think of other ways in which the current scoring system could be improved?
Let us know any further feedback you might have.
Page 1 of 1
Never submit passwords through Google Forms.
This form was created inside of Carnegie Mellon University.