Strategies

  • A pure strategy for player is a deterministic plan of action. The set of all pure strategies of player is denoted .

    • Strategies are distinct from actions. The outcomes may be conditioned on the choice of actions but not the strategy.

    • In an extensive-form game, the strategy also describes what player will choose at each of his information sets .

      More formally, it is a mapping that assigns action for every information set .

    A profile of pure strategies, describes a particular combination of pure strategies chosen by all players of the game

  • The simplex of , denoted . is the set of all Probability distributions over .

Incorporating Beliefs

  • A strategy is player ’s best response to his opponents’ strategies if

  • A rational player who believes his opponents are playing some will always choose a best response to .

  • A belief of player is a possible profile of his opponents’ strategies . More formally , it is given by a probability distribution . is the belief of player corresponding to their opponents playing .

  • The best response correspondence of player , selects for each a subset where each strategy is a best response to based on the player’s beliefs.

  • A strategy is never a best response if there are no beliefs for player for which

Mixed Strategies

  • A mixed strategy for player is defined as where we have a probability distribution

    Where is the probability that player plays .

    In other words, a mixed strategy is simply a distribution over pure strategies.

  • Given a mixed strategy , we say that is in the support of if and only if it occurs with positive probability. That is .

  • For continuous settings, the simplex is an interval, the mixed strategy is a cumulative distribution function, and the support is the set of where the density function is positive. That is

  • The expected payoff is given as follows: 1

    This degenerates when is a pure strategy

  • If a player is mixing between several strategies, he must be indifferent between them. Hence, for mixed strategies, we can check which opponent strategies causes the player to be indifferent.
    • This follows from the fact that suppose the player weren’t indifferent, then clearly one strategy must be better than the other in which case it is more optimal to simply not mix.
    • Indifference means that the expected utility from choosing either strategy is the same.

Behavioral Strategies

  • A behavioral strategy specifies for each information set an independent probability distribution over and is denoted , where is the probability that player plays action in information set /

  • It generalizes Mixed Strategies form extensive-form games by *allowing players to not only randomize between a choice of overall strategy, but randomize the strategy taken at each turn. *

Substitutes and Complements

  • A game with strategic substitutes is a game where the best response of one player decreases in the choice of the other. That is, they mutually reinforce each other.
  • A game with strategic complements is a game where the best response of one player increases the choice of the other. That is they mutually offset one another.

Multistage Conditional Strategies

  • In a multistage game, a pure strategy of player will be a list of conditional pure strategies of the following form

    where is a particular outcome that occurred up to period , not including period . It denotes the history of events that occurred up to .

  • A mixed behavioral strategy is a list of conditional randomizations of the form

Strategies for Infinitely Repeating Games

  • Let denote the possible histories of length and .
    Let be the set of all possible histories .

    A pure strategy for player is a mapping . A behavioral strategy for player is a mapping .

Strategies in Incomplete Information Settings

  • A strategy in an incomplete information setting is a prescription on what each player should do in response to each type of player.

Solving Games

  • A solution concept is a method of analyzing games with the objective of restricting the set of all possible outcomes to those that are more reasonable than others. It is a formal rule for predicting how the game will play.

    • Solution concepts prescribe solutions. Solutions are strategies
  • Equilibrium refers to a strategy profile that emerges as one of the solution concept’s predictions. It is the actual / likely predictions of our theory.

  • In analyzing equilibria, we assume the following:

    • Players are rational. Players maximize payoff consistent with their beliefs about the game
    • Players are Intelligent. They know everything about the game—actions, outcomes, and preferences of all players
    • Common knowledge - the fact that players are rational and intelligent is common knowledge among all players .
    • Self-enforcement - any prediction or equilibrium of a solution concept must be self-enforcing. That is, players engage in noncooperative behavior — players are happy with their own choices given how the others have made their own choices .
  • We can analyze solution concepts by evaluating three things

    • Existence - a solution concept must apply to a wide variety of games. It applies generally and we can show that it results in an equilibrium.
    • Uniqueness - a solution concept must restrict the set of possible outcomes to a smaller set of reasonable outcomes. Ideally, we want a single unique outcome.
    • Invariance - Slight perturbations in the payoff functions do not affect the predictions of a robust solution concept.
  • We may want solutions to games that are socially desirable. An outcome is socially undesirable if there is a better outcome that would make some people better off without harming anyone else. This is captured in Pareto optimality.

  • A strategy profile Pareto dominates strategy profile if

    We say that is Pareto dominated by .

    A strategy profile is Pareto optimal if it is not Pareto dominated by any other strategy profile.

    • Pareto optimality does not necessarily leave all players equally happy
    • Pareto optimality is not guaranteed in noncooperative settings.
    • In general, maximizing the sum of utility functions or maximizing total welfare will result in a Pareto optimal outcome. However, it need not be the unique one.

Links

Footnotes

  1. As usual, we give the discrete definition. For the continuous case, simply replace sums with integrals.