MaxDiff

Not to be confused with Best–worst scaling.

The MaxDiff is a long-established theory in mathematical psychology with very specific assumptions about how people make choices: it assumes that respondents evaluate all possible pairs of items within the displayed set and choose the pair that reflects the maximum difference in preference or importance. It may be thought of as a variation of the method of Paired Comparisons. Consider a set in which a respondent evaluates four items: A, B, C and D. If the respondent says that A is best and D is worst, these two responses inform us on five of six possible implied paired comparisons:

• A > B
• A > C
• A > D
• B > D
• C > D

The only paired comparison that cannot be inferred is B vs. C. In a choice, like above, with four items MaxDiff questioning informs on five of six implied paired comparisons. In a choice among five items, MaxDiff questioning informs on seven of ten implied paired comparisons.

The total amount of known relations between items, can be mathematically expressed as follows: $(2(N-1))-1)$. N represents here the total amount of items. The formula, makes it clear that the effectiveness of this method, of assuming relations, drastically decreases as N grows bigger.

Overview

In 1938 Richardson introduced a choice method in which subjects reported the most alike pair of a triad and the most different pair. The component of this method involving the most different pair may be properly called "MaxDiff" in contrast to a "most-least" or "best-worst" method where both the most different pair and the direction of difference are obtained. Ennis, Mullen and Frijters (1988) derived a unidimensional Thurstonian scaling model for Richardson's method of triads so that the results could be scaled under normality assumptions about the item percepts.

MaxDiff may involve multidimensional percepts, unlike most-least models that assume a unidimensional representation. MaxDiff and most-least methods belong to a class of methods that do not require the estimation of a cognitive parameter as occurs in the analysis of ratings data. This is one of the reasons for their popularity in applications. Other methods in this class include the 2- and 3-alternative forced choice methods, the triangular method which is a special case of Richardson's method, the duo-trio method and the specified and unspecified methods of tetrads. All of these methods have well-developed Thurstonian scaling models as discussed recently in Ennis (2016) which also includes a Thurstonian model for first-last or most-least choice and ranks with rank-induced dependencies. There are a number of possible processes through which subjects may make a most-least decision, including paired comparisons and ranking, but it is typically not known how the decision is reached.

Relationship to best–worst scaling ("MaxDiff" surveys)

MaxDiff and best–worst scaling (BWS or "MaxDiff surveys") have erroneously been considered synonyms. Respondents can produce best-worst data in any of a number of ways, with a MaxDiff process being but one. Instead of evaluating all possible pairs (the MaxDiff model), they might choose the best from n items, the worst from the remaining n-1, or vice versa (sequential models). Or indeed they may use another method entirely. Thus it should be clear that MaxDiff is a subset of BWS; MaxDiff is BWS, but BWS is not necessarily MaxDiff. Indeed, MaxDiff might not be considered an attractive model on psychological and intuitive grounds: as the number of items increases, the number of possible pairs increases in a multiplicative fashion: n items produces n(n-1) pairs (where best-worst order matters). Assuming respondents do evaluate all possible pairs is a strong assumption. Early work did use the term MaxDiff to refer to BWS, but with Marley's return to the field, correct academic terminology has been disseminated in some parts of the world.