博弈论导论
Game Theory?
Theodore L.Turocy Texas A&M University
Bernhard von Stengel London School of Economics
CDAM Research Report LSE-CDAM-2001-09
October8,2001
Contents
1What is game theory?4 2De?nitions of games6 3Dominance8 4Nash equilibrium12 5Mixed strategies17 6Extensive games with perfect information22 7Extensive games with imperfect information29 8Zero-sum games and computation33 9Bidding in auctions34 10Further reading38
?This is the draft of an introductory survey of game theory,prepared for the Encyclopedia of Information Systems,Academic Press,to appear in2002.
Glossary
Backward induction
Backward induction is a technique to solve a game of perfect information.It?rst consid-ers the moves that are the last in the game,and determines the best move for the player in each case.Then,taking these as given future actions,it proceeds backwards in time, again determining the best move for the respective player,until the beginning of the game is reached.
Common knowledge
A fact is common knowledge if all players know it,and know that they all know it,and so on.The structure of the game is often assumed to be common knowledge among the players.
Dominating strategy
A strategy dominates another strategy of a player if it always gives a better payoff to that player,regardless of what the other players are doing.It weakly dominates the other strategy if it is always at least as good.
Extensive game
An extensive game(or extensive form game)describes with a tree how a game is played. It depicts the order in which players make moves,and the information each player has at each decision point.
Game
A game is a formal description of a strategic situation.
Game theory
Game theory is the formal study of decision-making where several players must make choices that potentially affect the interests of the other players.
Mixed strategy
A mixed strategy is an active randomization,with given probabilities,that determines the player’s decision.As a special case,a mixed strategy can be the deterministic choice of one of the given pure strategies.
Nash equilibrium
A Nash equilibrium,also called strategic equilibrium,is a list of strategies,one for each player,which has the property that no player can unilaterally change his strategy and get a better payoff.
Payoff
A payoff is a number,also called utility,that re?ects the desirability of an outcome to a player,for whatever reason.When the outcome is random,payoffs are usually weighted with their probabilities.The expected payoff incorporates the player’s attitude towards risk.
Perfect information
A game has perfect information when at any point in time only one player makes a move, and knows all the actions that have been made until then.
Player
A player is an agent who makes decisions in a game.
Rationality
A player is said to be rational if he seeks to play in a manner which maximizes his own payoff.It is often assumed that the rationality of all players is common knowledge.
Strategic form
A game in strategic form,also called normal form,is a compact representation of a game in which players simultaneously choose their strategies.The resulting payoffs are pre-sented in a table with a cell for each strategy combination.
Strategy
In a game in strategic form,a strategy is one of the given possible actions of a player.In an extensive game,a strategy is a complete plan of choices,one for each decision point of the player.
Zero-sum game
A game is said to be zero-sum if for any outcome,the sum of the payoffs to all players is zero.In a two-player zero-sum game,one player’s gain is the other player’s loss,so their interests are diametrically opposed.
1What is game theory?
Game theory is the formal study of con?ict and cooperation.Game theoretic concepts apply whenever the actions of several agents are interdependent.These agents may be individuals,groups,?rms,or any combination of these.The concepts of game theory provide a language to formulate,structure,analyze,and understand strategic scenarios.
History and impact of game theory
The earliest example of a formal game-theoretic analysis is the study of a duopoly by Antoine Cournot in1838.The mathematician Emile Borel suggested a formal theory of games in1921,which was furthered by the mathematician John von Neumann in1928 in a“theory of parlor games.”Game theory was established as a?eld in its own right after the1944publication of the monumental volume Theory of Games and Economic Behavior by von Neumann and the economist Oskar Morgenstern.This book provided much of the basic terminology and problem setup that is still in use today.
In1950,John Nash demonstrated that?nite games have always have an equilibrium point,at which all players choose actions which are best for them given their opponents’choices.This central concept of noncooperative game theory has been a focal point of analysis since then.In the1950s and1960s,game theory was broadened theoretically and applied to problems of war and politics.Since the1970s,it has driven a revolution
in economic theory.Additionally,it has found applications in sociology and psychology, and established links with evolution and biology.Game theory received special attention in1994with the awarding of the Nobel prize in economics to Nash,John Harsanyi,and Reinhard Selten.
At the end of the1990s,a high-pro?le application of game theory has been the design of auctions.Prominent game theorists have been involved in the design of auctions for al-locating rights to the use of bands of the electromagnetic spectrum to the mobile telecom-munications industry.Most of these auctions were designed with the goal of allocating these resources more ef?ciently than traditional governmental practices,and additionally raised billions of dollars in the United States and Europe.
Game theory and information systems
The internal consistency and mathematical foundations of game theory make it a prime tool for modeling and designing automated decision-making processes in interactive en-vironments.For example,one might like to have ef?cient bidding rules for an auction website,or tamper-proof automated negotiations for purchasing communication band-width.Research in these applications of game theory is the topic of recent conference and journal papers(see,for example,Binmore and Vulkan,“Applying game theory to auto-mated negotiation,”Netnomics V ol.1,1999,pages1–9)but is still in a nascent stage.The automation of strategic choices enhances the need for these choices to be made ef?ciently, and to be robust against abuse.Game theory addresses these requirements.
As a mathematical tool for the decision-maker the strength of game theory is the methodology it provides for structuring and analyzing problems of strategic choice.The process of formally modeling a situation as a game requires the decision-maker to enu-merate explicitly the players and their strategic options,and to consider their preferences and reactions.The discipline involved in constructing such a model already has the poten-tial of providing the decision-maker with a clearer and broader view of the situation.This is a“prescriptive”application of game theory,with the goal of improved strategic deci-sion making.With this perspective in mind,this article explains basic principles of game theory,as an introduction to an interested reader without a background in economics.
2De?nitions of games
The object of study in game theory is the game,which is a formal model of an interactive situation.It typically involves several players;a game with only one player is usually called a decision problem.The formal de?nition lays out the players,their preferences, their information,the strategic actions available to them,and how these in?uence the outcome.
Games can be described formally at various levels of detail.A coalitional(or cooper-ative)game is a high-level description,specifying only what payoffs each potential group, or coalition,can obtain by the cooperation of its members.What is not made explicit is the process by which the coalition forms.As an example,the players may be several parties in parliament.Each party has a different strength,based upon the number of seats occupied by party members.The game describes which coalitions of parties can form a majority,but does not delineate,for example,the negotiation process through which an agreement to vote en bloc is achieved.
Cooperative game theory investigates such coalitional games with respect to the rel-ative amounts of power held by various players,or how a successful coalition should divide its proceeds.This is most naturally applied to situations arising in political science or international relations,where concepts like power are most important.For example, Nash proposed a solution for the division of gains from agreement in a bargaining prob-lem which depends solely on the relative strengths of the two parties’bargaining position. The amount of power a side has is determined by the usually inef?cient outcome that results when negotiations break down.Nash’s model?ts within the cooperative frame-work in that it does not delineate a speci?c timeline of offers and counteroffers,but rather focuses solely on the outcome of the bargaining process.
In contrast,noncooperative game theory is concerned with the analysis of strategic choices.The paradigm of noncooperative game theory is that the details of the ordering and timing of players’choices are crucial to determining the outcome of a game.In contrast to Nash’s cooperative model,a noncooperative model of bargaining would posit a speci?c process in which it is prespeci?ed who gets to make an offer at a given time.The term“noncooperative”means this branch of game theory explicitly models the process of
players making choices out of their own interest.Cooperation can,and often does,arise in noncooperative models of games,when players?nd it in their own best interests.
Branches of game theory also differ in their assumptions.A central assumption in many variants of game theory is that the players are rational.A rational player is one who always chooses an action which gives the outcome he most prefers,given what he expects his opponents to do.The goal of game-theoretic analysis in these branches,then, is to predict how the game will be played by rational players,or,relatedly,to give ad-vice on how best to play the game against opponents who are rational.This rationality assumption can be relaxed,and the resulting models have been more recently applied to the analysis of observed behavior(see Kagel and Roth,eds.,Handbook of Experimental Economics,Princeton Univ.Press,1997).This kind of game theory can be viewed as more“descriptive”than the prescriptive approach taken here.
This article focuses principally on noncooperative game theory with rational play-ers.In addition to providing an important baseline case in economic theory,this case is designed so that it gives good advice to the decision-maker,even when–or perhaps especially when–one’s opponents also employ it.
Strategic and extensive form games
The strategic form(also called normal form)is the basic type of game studied in non-cooperative game theory.A game in strategic form lists each player’s strategies,and the outcomes that result from each possible combination of choices.An outcome is repre-sented by a separate payoff for each player,which is a number(also called utility)that measures how much the player likes the outcome.
The extensive form,also called a game tree,is more detailed than the strategic form of a game.It is a complete description of how the game is played over time.This includes the order in which players take actions,the information that players have at the time they must take those actions,and the times at which any uncertainty in the situation is resolved.
A game in extensive form may be analyzed directly,or can be converted into an equivalent strategic form.
Examples in the following sections will illustrate in detail the interpretation and anal-ysis of games in strategic and extensive form.
3Dominance
Since all players are assumed to be rational,they make choices which result in the out-come they prefer most,given what their opponents do.In the extreme case,a player may have two strategies A and B so that,given any combination of strategies of the other players,the outcome resulting from A is better than the outcome resulting from B .Then strategy A is said to dominate strategy B .A rational player will never choose to play a dominated strategy.In some games,examination of which strategies are dominated re-sults in the conclusion that rational players could only ever choose one of their strategies.The following examples illustrate this idea.
Example:Prisoner’s Dilemma
The Prisoner’s Dilemma is a game in strategic form between two players.Each player has two strategies,called “cooperate”and “defect,”which are labeled C and D for player I and c and d for player II,respectively.(For simpler identi?cation,upper case letters are used for strategies of player I and lower case letters for player II.)d d d 223
00
3
11
I II
C D c
d Figur
e 1.The Prisoner’s Dilemma game.
Figure 1shows the resulting payoffs in this game.Player I chooses a row,either C or D ,and simultaneously player II chooses one of the columns c or d .The strategy combination (C,c )has payoff 2for each player,and the combination (D,d )gives each player payoff 1.The combination (C,d )results in payoff 0for player I and 3for player II,and when (D,c )is played,player I gets 3and player II gets 0.
Any two-player game in strategic form can be described by a table like the one in Figure 1,with rows representing the strategies of player I and columns those of player II.(A player may have more than two strategies.)Each strategy combination de?nes a payoff pair,like (3,0)for (D,c ),which is given in the respective table entry.Each cell of the table shows the payoff to player I at the (lower)left,and the payoff to player II at the (right)top.These staggered payoffs,due to Thomas Schelling,also make transparent when,as here,the game is symmetric between the two players.Symmetry means that the game stays the same when the players are exchanged,corresponding to a re?ection along the diagonal shown as a dotted line in Figure 2.Note that in the strategic form,there is no order between player I and II since they act simultaneously (that is,without knowing the other’s action),which makes the symmetry possible...................................................d d d 2
2
30031
1I II
C D
c d ↓
↓→
→Figure 2.The game of Figure 1with annotations,implied by the payoff structure.The
dotted line shows the symmetry of the game.The arrows at the left and right point to the preferred strategy of player I when player II plays the left or right column,respectively.Similarly,the arrows at the top and bottom point to the preferred strategy of player II when player I plays top or bottom.
In the Prisoner’s Dilemma game,“defect”is a strategy that dominates “cooperate.”Strategy D of player I dominates C since if player II chooses c ,then player I’s payoff is 3when choosing D and 2when choosing C ;if player II chooses d ,then player I receives 1for D as opposed to 0for C .These preferences of player I are indicated by the downward-pointing arrows in Figure 2.Hence,D is indeed always better and dominates C .In the same way,strategy d dominates c for player II.
No rational player will choose a dominated strategy since the player will always be better off when changing to the strategy that dominates it.The unique outcome in this game,as recommended to utility-maximizing players,is therefore(D,d)with payoffs (1,1).Somewhat paradoxically,this is less than the payoff(2,2)that would be achieved when the players chose(C,c).
The story behind the name“Prisoner’s Dilemma”is that of two prisoners held suspect of a serious crime.There is no judicial evidence for this crime except if one of the prison-ers testi?es against the other.If one of them testi?es,he will be rewarded with immunity from prosecution(payoff3),whereas the other will serve a long prison sentence(pay-off0).If both testify,their punishment will be less severe(payoff1for each).However,if they both“cooperate”with each other by not testifying at all,they will only be imprisoned brie?y,for example for illegal weapons possession(payoff2for each).The“defection”from that mutually bene?cial outcome is to testify,which gives a higher payoff no matter what the other prisoner does,with a resulting lower payoff to both.This constitutes their “dilemma.”
Prisoner’s Dilemma games arise in various contexts where individual“defections”at the expense of others lead to overall less desirable outcomes.Examples include arms races,litigation instead of settlement,environmental pollution,or cut-price marketing, where the resulting outcome is detrimental for the players.Its game-theoretic justi?cation on individual grounds is sometimes taken as a case for treaties and laws,which enforce cooperation.
Game theorists have tried to tackle the obvious“inef?ciency”of the outcome of the Prisoner’s Dilemma game.For example,the game is fundamentally changed by playing it more than once.In such a repeated game,patterns of cooperation can be established as rational behavior when players’fear of punishment in the future outweighs their gain from defecting today.
Example:Quality choice
The next example of a game illustrates how the principle of elimination of dominated strategies may be applied iteratively.Suppose player I is an internet service provider and player II a potential customer.They consider entering into a contract of service provision for a period of time.The provider can,for himself,decide between two levels of quality
of service,High or Low .High-quality service is more costly to provide,and some of the cost is independent of whether the contract is signed or not.The level of service cannot be put veri?ably into the contract.High-quality service is more valuable than low-quality service to the customer,in fact so much so that the customer would prefer not to buy the service if she knew that the quality was low.Her choices are to buy or not to buy the service.d d d 223
00
1
1
1
I II
High Low buy
don’t buy ↓↓→←Figure 3.High-low quality game between a service provider (player I)and a customer
(player II).
Figure 3gives possible payoffs that describe this situation.The customer prefers to buy if player I provides high-quality service,and not to buy otherwise.Regardless of whether the customer chooses to buy or not,the provider always prefers to provide the low-quality service.Therefore,the strategy Low dominates the strategy High for player I.Now,since player II believes player I is rational,she realizes that player I always prefers Low ,and so she anticipates low quality service as the provider’s choice.Then she prefers not to buy (giving her a payoff of 1)to buy (payoff 0).Therefore,the rationality of both players leads to the conclusion that the provider will implement low-quality service and,as a result,the contract will not be signed.
This game is very similar to the Prisoner’s Dilemma in Figure 1.In fact,it differs only by a single payoff,namely payoff 1(rather than 3)to player II in the top right cell in the table.This reverses the top arrow from right to left,and makes the preference of player II dependent on the action of player I.(The game is also no longer symmetric.)Player II does not have a dominating strategy.However,player I still does,so that the
resulting outcome,seen from the“?ow of arrows”in Figure3,is still unique.Another way of obtaining this outcome is the successive elimination of dominated strategies:First, High is eliminated,and in the resulting smaller game where player I has only the single strategy Low available,player II’s strategy buy is dominated and also removed.
As in the Prisoner’s Dilemma,the individually rational outcome is worse for both players than another outcome,namely the strategy combination(High,buy)where high-quality service is provided and the customer signs the contract.However,that outcome is not credible,since the provider would be tempted to renege and provide only the low-quality service.
4Nash equilibrium
In the previous examples,consideration of dominating strategies alone yielded precise advice to the players on how to play the game.In many games,however,there are no dominated strategies,and so these considerations are not enough to rule out any outcomes or to provide more speci?c advice on how to play the game.
The central concept of Nash equilibrium is much more general.A Nash equilibrium recommends a strategy to each player that the player cannot improve upon unilaterally, that is,given that the other players follow the recommendation.Since the other players are also rational,it is reasonable for each player to expect his opponents to follow the recommendation as well.
Example:Quality choice revisited
A game-theoretic analysis can highlight aspects of an interactive situation that could be changed to get a better outcome.In the quality game in Figure3,for example,increasing the customer’s utility of high-quality service has no effect unless the provider has an incentive to provide that service.So suppose that the game is changed by introducing an opt-out clause into the service contract.That is,the customer can discontinue subscribing to the service if she?nds it of low quality.
The resulting game is shown in Figure4.Here,low-quality service provision,even when the customer decides to buy,has the same low payoff1to the provider as when the
d d d 221
00
1
1
1
I II
High Low buy
don’t buy ↑↓→←Figure 4.High-low quality game with opt-out clause for the customer.The left arrow
shows that player I prefers High when player II chooses buy .
customer does not sign the contract in the ?rst place,since the customer will opt out later.However,the customer still prefers not to buy when the service is Low in order to spare herself the hassle of entering the contract.
The changed payoff to player I means that the left arrow in Figure 4points upwards.Note that,compared to Figure 3,only the provider’s payoffs are changed.In a sense,the opt-out clause in the contract has the purpose of convincing the customer that the high-quality service provision is in the provider’s own interest.
This game has no dominated strategy for either player.The arrows point in different directions.The game has two Nash equilibria in which each player chooses his strategy deterministically.One of them is,as before,the strategy combination (Low,don’t buy ).This is an equilibrium since Low is the best response (payoff-maximizing strategy)to don’t buy and vice versa.
The second Nash equilibrium is the strategy combination (High,buy ).It is an equilib-rium since player I prefers to provide high-quality service when the customer buys,and conversely,player II prefers to buy when the quality is high.This equilibrium has a higher payoff to both players than the former one,and is a more desirable solution.
Both Nash equilibria are legitimate recommendations to the two players of how to play the game.Once the players have settled on strategies that form a Nash equilibrium,neither player has incentive to deviate,so that they will rationally stay with their strategies.This makes the Nash equilibrium a consistent solution concept for games.In contrast,a
strategy combination that is not a Nash equilibrium is not a credible solution.Such a strategy combination would not be a reliable recommendation on how to play the game, since at least one player would rather ignore the advice and instead play another strategy to make himself better off.
As this example shows,a Nash equilibrium may be not unique.However,the pre-viously discussed solutions to the Prisoner’s Dilemma and to the quality choice game in Figure3are unique Nash equilibria.A dominated strategy can never be part of an equilib-rium since a player intending to play a dominated strategy could switch to the dominating strategy and be better off.Thus,if elimination of dominated strategies leads to a unique strategy combination,then this is a Nash https://www.sodocs.net/doc/a817021630.html,rger games may also have unique equilibria that do not result from dominance considerations.
Equilibrium selection
If a game has more than one Nash equilibrium,a theory of strategic interaction should guide players towards the“most reasonable”equilibrium upon which they should focus. Indeed,a large number of papers in game theory have been concerned with“equilibrium re?nements”that attempt to derive conditions that make one equilibrium more plausible or convincing than another.For example,it could be argued that an equilibrium that is better for both players,like(High,buy)in Figure4,should be the one that is played.
However,the abstract theoretical considerations for equilibrium selection are often more sophisticated than the simple game-theoretical models they are applied to.It may be more illuminating to observe that a game has more than one equilibrium,and that this is a reason that players are sometimes stuck at an inferior outcome.
One and the same game may also have a different interpretation where a previously undesirable equilibrium becomes rather plausible.As an example,consider an alternative scenario for the game in Figure4.Unlike the previous situation,it will have a symmetric description of the players,in line with the symmetry of the payoff structure.
Two?rms want to invest in communication infrastructure.They intend to communi-cate frequently with each other using that infrastructure,but they decide independently on what to buy.Each?rm can decide between High or Low bandwidth equipment(this
time,the same strategy names will be used for both players).For player II,High and Low replace buy and don’t buy in Figure 4.The rest of the game stays as it is.
The (unchanged)payoffs have the following interpretation for player I (which applies in the same way to player II by symmetry):A Low bandwidth connection works equally well (payoff 1)regardless of whether the other side has high or low bandwidth.How-ever,switching from Low to High is preferable only if the other side has high bandwidth (payoff 2),otherwise it incurs unnecessary cost (payoff 0).
As in the quality game,the equilibrium (Low,Low )(the bottom right cell)is inferior to the other equilibrium,although in this interpretation it does not look quite as bad.Moreover,the strategy Low has obviously the better worst-case payoff,as considered for all possible strategies of the other player,no matter if these strategies are rational choices or not.The strategy Low is therefore also called a max-min strategy since it maximizes the minimum payoff the player can get in each case.In a sense,investing only in low-bandwidth equipment is a safe choice.Moreover,this strategy is part of an equilibrium,and entirely justi?ed if the player expects the other player to do the same.
Evolutionary games
The bandwidth choice game can be given a different interpretation where it applies to a large population of identical players.Equilibrium can then be viewed as the outcome of a dynamic process rather than of conscious rational analysis.d d d 5
51
00
1
11
I II
High Low
High Low ↑
↓→
←
Figure 5.The bandwidth choice game.
Figure5shows the bandwidth choice game where each player has the two strategies High and Low.The positive payoff of5for each player for the strategy combination (High,High)makes this an even more preferable equilibrium than in the case discussed above.
In the evolutionary interpretation,there is a large population of individuals,each of which can adopt one of the strategies.The game describes the payoffs that result when two of these individuals meet.The dynamics of this game are based on assuming that each strategy is played by a certain fraction of individuals.Then,given this distribution of strategies,individuals with better average payoff will be more successful than others, so that their proportion in the population increases over time.This,in turn,may affect which strategies are better than others.In many cases,in particular in symmetric games with only two possible strategies,the dynamic process will move to an equilibrium.
In the example of Figure5,a certain fraction of users connected to a network will already have High or Low bandwidth equipment.For example,suppose that one quarter of the users has chosen High and three quarters have chosen Low.It is useful to assign these as percentages to the columns,which represent the strategies of player II.A new user,as player I,is then to decide between High and Low,where his payoff depends on the given fractions.Here it will be1/4×5+3/4×0=1.25when player I chooses High,and 1/4×1+3/4×1=1when player I chooses Low.Given the average payoff that player I can expect when interacting with other users,player I will be better off by choosing High, and so decides on that strategy.Then,player I joins the population as a High user.The proportion of individuals of type High therefore increases,and over time the advantage of that strategy will become even more pronounced.In addition,users replacing their equipment will make the same calculation,and therefore also switch from Low to High. Eventually,everyone plays High as the only surviving strategy,which corresponds to the equilibrium in the top left cell in Figure5.
The long-term outcome where only high-bandwidth equipment is selected depends on there being an initial fraction of high-bandwidth users that is large enough.For example,if only ten percent have chosen High,then the expected payoff for High is0.1×5+0.9×0= 0.5which is less than the expected payoff1for Low(which is always1,irrespective of the distribution of users in the population).Then,by the same logic as before,the fraction of Low users increases,moving to the bottom right cell of the game as the equilibrium.It
is easy to see that the critical fraction of High users so that this will take off as the better strategy is1/5.(When new technology makes high-bandwidth equipment cheaper,this increases the payoff0to the High user who is meeting Low,which changes the game.) The evolutionary,population-dynamic view of games is useful because it does not require the assumption that all players are sophisticated and think the others are also ra-tional,which is often unrealistic.Instead,the notion of rationality is replaced with the much weaker concept of reproductive success:strategies that are successful on average will be used more frequently and thus prevail in the end.This view originated in the-oretical biology with Maynard Smith(Evolution and the Theory of Games,Cambridge University Press,1982)and has since signi?cantly increased in scope(see Hofbauer and Sigmund,Evolutionary Games and Population Dynamics,Cambridge University Press, 1998).
5Mixed strategies
A game in strategic form does not always have a Nash equilibrium in which each player deterministically chooses one of his strategies.However,players may instead randomly select from among these pure strategies with certain probabilities.Randomizing one’s own choice in this way is called a mixed strategy.Nash showed in1951that any?nite strategic-form game has an equilibrium if mixed strategies are allowed.As before,an equilibrium is de?ned by a(possibly mixed)strategy for each player where no player can gain on average by unilateral deviation.Average(that is,expected)payoffs must be considered because the outcome of the game may be random.
Example:Compliance inspections
Suppose a consumer purchases a license for a software package,agreeing to certain re-strictions on its use.The consumer has an incentive to violate these rules.The vendor would like to verify that the consumer is abiding by the agreement,but doing so requires inspections which are costly.If the vendor does inspect and catches the consumer cheat-ing,the vendor can demand a large penalty payment for the noncompliance.
Figure6shows possible payoffs for such an inspection game.The standard outcome, de?ning the reference payoff zero to both vendor(player I)and consumer(player II),
d d d 0
–1
–1010–6–90I II
Don’t inspect Inspect
comply cheat
↑↓→←Figure 6.Inspection game between a software vendor (player I)and consumer (player II).is that the vendor chooses Don’t inspect and the consumer chooses to comply .Without inspection,the consumer prefers to cheat since that gives her payoff 10,with resulting negative payoff ?10to the vendor.The vendor may also decide to Inspect .If the con-sumer complies,inspection leaves her payoff 0unchanged,while the vendor incurs a cost resulting in a negative payoff ?1.If the consumer cheats,however,inspection will result in a heavy penalty (payoff ?90for player II)and still create a certain amount of hassle for player I (payoff ?6).
In all cases,player I would strongly prefer if player II complied,but this is outside of player I’s control.However,the vendor prefers to inspect if the consumer cheats (since ?6is better than ?10),indicated by the downward arrow on the right in Figure 6.If the
vendor always preferred Don’t inspect ,then this would be a dominating strategy and be part of a (unique)equilibrium where the consumer cheats.
The circular arrow structure in Figure 6shows that this game has no equilibrium in pure strategies.If any of the players settles on a deterministic choice (like Don’t inspect by player I),the best reponse of the other player would be unique (here cheat by player II),to which the original choice would not be a best reponse (player I prefers Inspect when the other player chooses cheat ,against which player II in turn prefers to comply ).The strategies in a Nash equilibrium must be best responses to each other,so in this game this fails to hold for any pure strategy combination.
Mixed equilibrium
What should the players do in the game of Figure6?One possibility is that they prepare for the worst,that is,choose a max-min strategy.As explained before,a max-min strategy maximizes the player’s worst payoff against all possible choices of the opponent.The max-min strategy for player I is to Inspect(where the vendor guarantees himself payoff ?6),and for player II it is to comply(which guarantees her payoff0).However,this is
not a Nash equilibrium and hence not a stable recommendation to the two players,since player I could switch his strategy and improve his payoff.
A mixed strategy of player I in this game is to Inspect only with a certain probability. In the context of inspections,randomizing is also a practical approach that reduces costs. Even if an inspection is not certain,a suf?ciently high chance of being caught should deter from cheating,at least to some extent.
The following considerations show how to?nd the probability of inspection that will lead to an equilibrium.If the probability of inspection is very low,for example one percent,then player II receives(irrespective of that probability)payoff0for comply,and payoff0.99×10+0.01×(?90)=9,which is bigger than zero,for cheat.Hence,player II will still cheat,just as in the absence of inspection.
If the probability of inspection is much higher,for example0.2,then the expected payoff for cheat is0.8×10+0.2×(?90)=?10,which is less than zero,so that player II prefers to comply.If the inspection probability is either too low or too high,then player II has a unique best response.As shown above,such a pure strategy cannot be part of an equilibrium.
Hence,the only case where player II herself could possibly randomize between her strategies is if both strategies give her the same payoff,that is,if she is indifferent.It is never optimal for a player to assign a positive probability to playing a strategy that is inferior,given what the other players are doing.It is not hard to see that player II is indifferent if and only if player I inspects with probability0.1,since then the expected payoff for cheat is0.9×10+0.1×(?90)=0,which is then the same as the payoff for comply.
With this mixed strategy of player I(Don’t inspect with probability0.9and Inspect with probability0.1),player II is indifferent between her strategies.Hence,she can mix
them(that is,play them randomly)without losing payoff.The only case where,in turn, the original mixed strategy of player I is a best response is if player I is indifferent.Ac-cording to the payoffs in Figure6,this requires player II to choose comply with probability 0.8and cheat with probability0.2.The expected payoffs to player I are then for Don’t inspect0.8×0+0.2×(?10)=?2,and for Inspect0.8×(?1)+0.2×(?6)=?2,so that player I is indeed indifferent,and his mixed strategy is a best response to the mixed strategy of player II.
This de?nes the only Nash equilibrium of the game.It uses mixed strategies and is therefore called a mixed equilibrium.The resulting expected payoffs are?2for player I and0for player II.
Interpretation of mixed strategy probabilities
The preceding analysis showed that the game in Figure6has a mixed equilibrium,where the players choose their pure strategies according to certain probabilities.These probabil-ities have several noteworthy features.
The equilibrium probability of0.1for Inspect makes player II indifferent between comply and cheat.This is based on the assumption that an expected payoff of0for cheat, namely0.9×10+0.1×(?90),is the same for player II as when getting the payoff0 for certain,by choosing to comply.If the payoffs were monetary amounts(each payoff unit standing for one thousand dollars,say),one would not necessarily assume such a risk neutrality on the part of the consumer.In practice,decision-makers are typically risk averse,meaning they prefer the safe payoff of0to the gamble with an expectation of0.
In a game-theoretic model with random outcomes(as in a mixed equilibrium),how-ever,the payoff is not necessarily to be interpreted as money.Rather,the player’s attitude towards risk is incorporated into the payoff?gure as well.To take our example,the con-sumer faces a certain reward or punishment when cheating,depending on whether she is caught or not.Getting caught may not only involve?nancial loss but embarassment and other undesirable consequences.However,there is a certain probability of inspec-tion(that is,of getting caught)where the consumer becomes indifferent between comply and cheat.If that probability is1against9,then this indifference implies that the cost (negative payoff)for getting caught is9times as high as the reward for cheating success-fully,as assumed by the payoffs in Figure6.If the probability of indifference is1against