Statistical Analysis Stack Exchange
Statistical Analysis Stack Exchange

Questions tagged [ranking]

Ranking is the task (for respondents) or the result of ordering the given stimuli or performers from "highest" to "lowest" (or *vice versa*) in some respect. It is usually contrasted with rating of stimuli. (For ranking as a way of data transformation - use tag [ranks]).

595 questions
28
votes
3 answers

Metrics for evaluating ranking algorithms

I'm interested in looking at several different metrics for ranking algorithms - there are a few listed on the Learning to Rank wikipedia page, including: • Mean average precision (MAP); • DCG and NDCG; • Precision@n, NDCG@n, where "@n" denotes that…
anthr
  • 777
  • 3
  • 8
  • 21
23
votes
5 answers

Creating an index of quality from multiple variables to enable rank ordering

I have four numeric variables. All of them are measures of soil quality. Higher the variable, higher the quality. The range for all of them is different: Var1 from 1 to 10 Var2 from 1000 to 2000 Var3 from 150 to 300 Var4 from 0 to 5 I need to…
user333
  • 6,621
  • 17
  • 44
  • 54
21
votes
4 answers

Comparison of ranked lists

Suppose that two groups, comprising $n_1$ and $n_2$ each rank a set of 25 items from most to least important. What are the best ways to compare these rankings? Clearly, it is possible to do 25 Mann-Whitney U tests, but this would result in 25 test…
Peter Flom
  • 94,055
  • 35
  • 143
  • 276
19
votes
4 answers

How to get started with rating and ranking based on pairwise competition data?

I'm interesting in learning about how to rate and rank individuals in a group who only interact/compete in a pairwise fashion (i.e., systems like the ELO rating system for chess). Are there are any go-to methods or more accurate and advanced…
dcl
  • 2,610
  • 3
  • 19
  • 30
19
votes
4 answers

Measuring individual player effectiveness in 2-player per team sports

I've got a spreadsheet of some team scores. First team to 10 points wins. There are 2 players on each team. The players play with different teammates all the time, although they are not chosen perfectly randomly. No individual scores are kept. So…
Bill Waterson
  • 191
  • 3
18
votes
1 answer

Combining multiple metrics to provide comparisons/ranking of k objects [Question and Reference Request]

Collecting $n$ metrics about $k$ objects Suppose I collect $n$ metrics about $k$ objects. I am looking into valid ways to compare the $k$ objects so they can be "ranked". I think this may be well-trodden ground (sports statistics like total…
user2321
  • 405
  • 3
  • 10
17
votes
4 answers

Overall rank from multiple ranked lists

I've looked through a lot of literature available online, including this forum without any luck and hoping someone can help a statistical issue I currently face: I have 5 lists of of ranked data, each containing 10 items ranked from position 1…
Liam
  • 171
  • 1
  • 1
  • 3
17
votes
4 answers

How would one graph the results of subjective rank order?

I'm looking for way to visualize subjective rankings, separate from my non-parametric tests. I've asked 12 participants to rank 8 different items according to different subjective criterion (separate rankings for each one). For any individual set of…
Jesse
  • 171
  • 1
  • 1
  • 4
15
votes
3 answers

Do alternatives to Elo exist for non-team/individual events?

Are there any well-known rating or ranking systems, similar to Elo, for multi-participant events? For example, a system that can rate various forms of racing (auto, downhill, horse etc.) or other individual sports (golf, for example)?
TravisVOX
  • 403
  • 3
  • 12
14
votes
5 answers

How to prove that Elo rating or Page ranking have a meaning for my set?

I have a set of players. They play against each other (pairwise). Pairs of players are chosen randomly. In any game, one player wins and another one loses. The players play with each other a limited number of games (some players play more games,…
Roman
  • 1,013
  • 2
  • 23
  • 38
13
votes
1 answer

How to measure the reliability of a consensus ranking (problem from Kemeny-Snell book)

Suppose that $k$ experts are each asked to rank a set of $n$ objects in order or preference. Let allow ties in the rankings. John Kemeny and Laurie Snell in their 1962 year book "Mathematical models in the Social Sciences" propose to solve next…
aeiklmkv
  • 131
  • 6
13
votes
2 answers

Converting a list of partial rankings into a global ranking

I'm working on something like the following problem. I have a bunch of users and N books. Each user creates an ordered ranking of all the books he's read (which is likely a subset of the N books), e.g., Book 1 > Book 40 > Book 25. Now I want to turn…
raegtin
  • 9,090
  • 12
  • 48
  • 53
13
votes
2 answers

What is the difference between ordinal regression and ranking?

In both ordinal regression and ranking you are learning from an ordered dependent variables, so my question is: What is the difference in formulation (if any) between the ordinal regression problem and a learning to rank problem?
Fabian Pedregosa
  • 526
  • 4
  • 12
13
votes
5 answers

How to measure the "well-roundedness" of SE contributors?

Stack Exchange, as we all know it, is a collection of Q&A sites with diversified topics. Assuming that each site is independent from each other, given the stats a user has, how to compute his "well-roundedness" as compared to the next guy? What is…
Graviton
  • 845
  • 1
  • 15
  • 28
11
votes
3 answers

Machine learning algorithm for ranking

I have got a set of elements $X$ which I can describe according to $n$ characteristics. Thus: $$x_i: \{c_{i1}, c_{i2}, \ldots, c_{in}\} \mid x_i \in X $$ where $c_{ij}$ is the (numerical) evaluation for element $i$ according to the characteristics…
almathie
1
2 3
…
39 40