Preface |
|
xiii | |
|
|
1 | (6) |
|
1.1 Strategic-Form Games and Nash Equilibrium |
|
|
1 | (1) |
|
1.2 Extensive-Form Games and Subgame-Perfect Nash Equilibrium |
|
|
2 | (2) |
|
1.3 Incomplete Information: Signal and Bayesian Equilibrium |
|
|
4 | (1) |
|
1.4 Repeated Games and Stochastic Games |
|
|
5 | (2) |
|
Part I Indirect Reciprocity |
|
|
7 | (100) |
|
2 Indirect Reciprocity Game in Cognitive Networks |
|
|
9 | (19) |
|
|
9 | (2) |
|
|
11 | (2) |
|
|
12 | (1) |
|
|
13 | (1) |
|
|
13 | (5) |
|
2.3.1 Reputation Updating Policy |
|
|
13 | (2) |
|
2.3.2 Stationary Reputation Distribution |
|
|
15 | (1) |
|
|
16 | (1) |
|
2.3.4 Optimal Action Using an Alternative Algorithm |
|
|
17 | (1) |
|
2.4 Action Spreading Due to Natural Selection |
|
|
18 | (2) |
|
2.4.1 Action Spreading Algorithm Using the Wright-Fisher Model |
|
|
19 | (1) |
|
2.4.2 Action Spreading Algorithm Using the Replicator Dynamic Equation |
|
|
19 | (1) |
|
2.5 Evolutionarily Stable Strategy and Simulations |
|
|
20 | (5) |
|
2.5.1 Binary Reputation Scenario |
|
|
21 | (1) |
|
2.5.2 Multilevel Reputation Scenario |
|
|
22 | (3) |
|
|
25 | (3) |
|
|
26 | (2) |
|
3 Indirect Reciprocity Game for Dynamic Channel Access |
|
|
28 | (27) |
|
|
28 | (2) |
|
|
30 | (3) |
|
|
31 | (1) |
|
3.2.2 Social Norm: How to Assign Reputation |
|
|
31 | (1) |
|
3.2.3 Power Level and Relay Power |
|
|
32 | (1) |
|
3.2.4 Channel Quality Distribution |
|
|
33 | (1) |
|
|
33 | (12) |
|
3.3.1 Reputation Updating Policy |
|
|
33 | (2) |
|
3.3.2 Power Detection and Power Detection Transition Matrix |
|
|
35 | (2) |
|
3.3.3 Stationary Reputation Distribution |
|
|
37 | (1) |
|
3.3.4 Payoff Function and Equilibrium of the Indirect Reciprocity Game |
|
|
38 | (3) |
|
3.3.5 Stability of the Optimal Action Rule |
|
|
41 | (4) |
|
|
45 | (7) |
|
3.4.1 Evolutionary Stability of Optimal Action flj |
|
|
45 | (2) |
|
|
47 | (2) |
|
3.4.3 Different Social Norms |
|
|
49 | (3) |
|
|
52 | (3) |
|
|
52 | (3) |
|
4 Multiuser Indirect Reciprocity Game for Cooperative Communications |
|
|
55 | (25) |
|
|
55 | (2) |
|
|
57 | (5) |
|
4.2.1 Physical Layer Model with Relay Selection |
|
|
57 | (2) |
|
4.2.2 Incentive Schemes Based on the Indirect Reciprocity Game |
|
|
59 | (1) |
|
4.2.3 Overheads of the Scheme |
|
|
60 | (1) |
|
|
61 | (1) |
|
4.3 Steady-State Analysis Using Markov Decision Processes |
|
|
62 | (7) |
|
4.3.1 Stationary Reputation Distribution |
|
|
62 | (1) |
|
4.3.2 Long-Term Expected Payoffs at Steady States |
|
|
63 | (2) |
|
4.3.3 Equilibrium Steady State |
|
|
65 | (4) |
|
4.4 Evolutionary Modeling of the Indirect Reciprocity Game |
|
|
69 | (1) |
|
4.4.1 Evolutionary Dynamics of the Indirect Reciprocity Game |
|
|
69 | (1) |
|
4.4.2 Evolutionarily Stable Strategy |
|
|
70 | (1) |
|
|
70 | (2) |
|
|
72 | (5) |
|
4.7 Discussion and Conclusion |
|
|
77 | (3) |
|
|
78 | (2) |
|
5 Indirect Reciprocity Data Fusion Game and Application to Cooperative Spectrum Sensing |
|
|
80 | (27) |
|
|
80 | (2) |
|
5.2 Indirect Reciprocity Data Fusion Game |
|
|
82 | (7) |
|
|
82 | (1) |
|
5.2.2 Action and Action Rule |
|
|
83 | (1) |
|
5.2.3 Social Norm: How to Assign Reputation |
|
|
84 | (1) |
|
5.2.4 Decision Consistency Matrix |
|
|
84 | (1) |
|
5.2.5 Reputation Updating Policy |
|
|
85 | (2) |
|
|
87 | (2) |
|
5.2.7 Equilibrium of the Indirect Reciprocity Data Fusion Game |
|
|
89 | (1) |
|
5.3 Application to Cooperative Spectrum Sensing |
|
|
89 | (10) |
|
|
90 | (1) |
|
5.3.2 Fusion Game for the Single-Channel {K = 1) and Hard Fusion Case |
|
|
91 | (4) |
|
5.3.3 Fusion Game for the Single-Channel (K = 1) and Soft Fusion Case |
|
|
95 | (2) |
|
5.3.4 Fusion Game for the Multichannel (K > 1) Case |
|
|
97 | (2) |
|
|
99 | (5) |
|
5.4.1 The Optimal Action Rule and Its Evolutionary Stability |
|
|
99 | (2) |
|
|
101 | (2) |
|
|
103 | (1) |
|
|
104 | (3) |
|
|
105 | (2) |
|
Part II Evolutionary Games |
|
|
107 | (140) |
|
6 Evolutionary Game for Cooperative Peer-to-Peer Streaming |
|
|
109 | (22) |
|
|
109 | (2) |
|
6.2 The System Model and Utility Functions |
|
|
111 | (3) |
|
|
111 | (1) |
|
|
112 | (2) |
|
6.3 Agent Selection within a Homogeneous Group |
|
|
114 | (6) |
|
6.3.1 Centralized Agent Selection |
|
|
114 | (1) |
|
6.3.2 Distributed Agent Selection |
|
|
114 | (1) |
|
6.3.3 Evolutionary Cooperative Streaming Game |
|
|
115 | (1) |
|
6.3.4 Analysis of the Cooperative Streaming Game |
|
|
116 | (4) |
|
6.4 Agent Selection within a Heterogeneous Group |
|
|
120 | (2) |
|
|
120 | (2) |
|
|
122 | (1) |
|
6.5 A Distributed Learning Algorithm for an ESS |
|
|
122 | (1) |
|
|
123 | (5) |
|
|
128 | (3) |
|
|
128 | (3) |
|
7 Evolutionary Game for Spectrum Sensing and Access in Cognitive Networks |
|
|
131 | (27) |
|
|
131 | (2) |
|
|
133 | (3) |
|
|
133 | (1) |
|
7.2.2 Spectrum Sensing Model |
|
|
134 | (1) |
|
7.2.3 Synchronous and Asynchronous Scenarios |
|
|
135 | (1) |
|
7.3 Evolutionary Game Formulation for the Synchronous Scenario |
|
|
136 | (7) |
|
|
136 | (2) |
|
7.3.2 Replicator Dynamics of Spectrum Sensing |
|
|
138 | (1) |
|
7.3.3 Replicator Dynamics of Spectrum Access |
|
|
138 | (1) |
|
7.3.4 Analysis of the ESS |
|
|
139 | (4) |
|
7.4 Evolutionary Game Formulation for the Asynchronous Scenario |
|
|
143 | (5) |
|
7.4.1 ON--OFF Primary Channel Model |
|
|
143 | (1) |
|
7.4.2 Analysis of SUs' Access Time Ta |
|
|
144 | (2) |
|
7.4.3 Analysis of the ESS |
|
|
146 | (2) |
|
7.5 A Distributed Learning Algorithm for the ESSs |
|
|
148 | (3) |
|
|
151 | (4) |
|
7.6.1 ESSs of the Synchronous and Asynchronous Scenarios |
|
|
151 | (2) |
|
7.6.2 Stability of the ESSs |
|
|
153 | (1) |
|
7.6.3 Performance Evaluation |
|
|
154 | (1) |
|
|
155 | (3) |
|
|
155 | (3) |
|
8 Graphical Evolutionary Game for Distributed Adaptive Networks |
|
|
158 | (28) |
|
|
158 | (1) |
|
|
159 | (3) |
|
8.3 Graphical Evolutionary Game Formulation |
|
|
162 | (7) |
|
8.3.1 Introduction to the Graphical Evolutionary Game |
|
|
162 | (2) |
|
8.3.2 Graphical Evolutionary Game Formulation |
|
|
164 | (2) |
|
8.3.3 Relationship to Existing Distributed Adaptive Filtering Algorithms |
|
|
166 | (1) |
|
8.3.4 Error-Aware Distributed Adaptive Filtering Algorithm |
|
|
167 | (2) |
|
|
169 | (7) |
|
8.4.1 Strategies and Utility Matrix |
|
|
170 | (2) |
|
8.4.2 Dynamics of pm and qm\m |
|
|
172 | (2) |
|
8.4.3 Diffusion Probability Analysis |
|
|
174 | (2) |
|
8.5 Evolutionarily Stable Strategy |
|
|
176 | (2) |
|
8.5.1 ESS in Complete Graphs |
|
|
177 | (1) |
|
8.5.2 ESS in Incomplete Graphs |
|
|
177 | (1) |
|
|
178 | (5) |
|
8.6.1 Mean-Square Performance |
|
|
179 | (3) |
|
8.6.2 Diffusion Probability |
|
|
182 | (1) |
|
8.6.3 Evolutionarily Stable Strategy |
|
|
182 | (1) |
|
|
183 | (3) |
|
|
183 | (3) |
|
9 Graphical Evolutionary Game for Information Diffusion in Social Networks |
|
|
186 | (30) |
|
|
186 | (3) |
|
9.2 Diffusion Dynamics over Complete Networks |
|
|
189 | (4) |
|
9.2.1 Basic Concepts of Evolutionary Game Theory |
|
|
189 | (1) |
|
9.2.2 Evolutionary Game Formulation |
|
|
190 | (1) |
|
9.2.3 Information Diffusion Dynamics over a Complete Network |
|
|
191 | (2) |
|
9.3 Diffusion Dynamics over Uniform-Degree Networks |
|
|
193 | (9) |
|
9.3.1 Basic Concepts of Graphical EGT |
|
|
193 | (1) |
|
9.3.2 Graphical Evolutionary Game Formulation |
|
|
194 | (1) |
|
9.3.3 Diffusion Dynamics over Uniform-Degree Networks |
|
|
195 | (7) |
|
9.4 Diffusion Dynamics over Nonuniform-Degree Networks |
|
|
202 | (3) |
|
|
202 | (2) |
|
|
204 | (1) |
|
|
205 | (8) |
|
9.5.1 Synthetic Networks and a Real-World Network |
|
|
205 | (3) |
|
9.5.2 Twitter Hashtag Data Set Evaluation |
|
|
208 | (5) |
|
|
213 | (3) |
|
|
213 | (3) |
|
10 Graphical Evolutionary Game for Information Diffusion in Heterogeneous Social Networks |
|
|
216 | (31) |
|
|
216 | (2) |
|
10.2 Heterogeneous System Model |
|
|
218 | (4) |
|
10.2.1 Basics of Evolutionary Game Theory |
|
|
218 | (2) |
|
10.2.2 Unknown User-Type Model |
|
|
220 | (1) |
|
10.2.3 Known User-Type Model |
|
|
221 | (1) |
|
10.3 Theoretical Analysis for the Unknown User-Type Model |
|
|
222 | (5) |
|
10.4 Theoretical Analysis for the Known User-Type Model |
|
|
227 | (5) |
|
|
232 | (10) |
|
10.5.1 Synthetic Data Experiments |
|
|
232 | (6) |
|
10.5.2 Real Data Experiments |
|
|
238 | (4) |
|
10.6 Discussion and Conclusion |
|
|
242 | (5) |
|
|
244 | (3) |
|
Part III Sequential Decision-Making |
|
|
247 | (205) |
|
11 Introduction to Sequential Decision-Making |
|
|
249 | (4) |
|
11.1 Decision-Making in Networks |
|
|
249 | (1) |
|
|
250 | (1) |
|
|
251 | (1) |
|
11.4 Reinforcement Learning |
|
|
251 | (2) |
|
12 Chinese Restaurant Game: Sequential Decision-Making in Static Systems |
|
|
253 | (28) |
|
|
253 | (3) |
|
|
256 | (2) |
|
12.3 Equilibrium Grouping and Advantage in Decision Order |
|
|
258 | (6) |
|
12.3.1 Equilibrium Grouping |
|
|
258 | (2) |
|
12.3.2 Subgame-Perfect Nash Equilibrium |
|
|
260 | (4) |
|
12.4 Signals: Learning Unknown States |
|
|
264 | (3) |
|
12.4.1 Best Response of Customers |
|
|
265 | (1) |
|
12.4.2 Recursive Form of the Best Response |
|
|
265 | (2) |
|
12.5 Simulation Results and Analysis |
|
|
267 | (6) |
|
12.5.1 Advantage of Playing Positions vs. Signal Quality |
|
|
268 | (1) |
|
|
269 | (1) |
|
12.5.3 Case Study: Resource Pool and Availability Scenarios |
|
|
270 | (3) |
|
12.6 Application: Cooperative Spectrum Access in Cognitive Radio Networks |
|
|
273 | (5) |
|
|
273 | (2) |
|
12.6.2 Simulation Results |
|
|
275 | (3) |
|
|
278 | (3) |
|
|
279 | (2) |
|
13 Dynamic Chinese Restaurant Game: Sequential Decision-Making in Dynamic Systems |
|
|
281 | (29) |
|
|
281 | (2) |
|
|
283 | (4) |
|
13.2.1 Bayesian Learning for the Restaurant State |
|
|
284 | (3) |
|
13.3 Multidimensional MDP-based Table Selection |
|
|
287 | (5) |
|
13.4 Application to Cognitive Radio Networks |
|
|
292 | (11) |
|
|
293 | (1) |
|
13.4.2 Bayesian Channel Sensing |
|
|
294 | (3) |
|
13.4.3 Belief State Transition Probability |
|
|
297 | (1) |
|
13.4.4 Channel Access: Two Primary Channels Case |
|
|
298 | (3) |
|
13.4.5 Channel Access: Multiple Primary Channels Case |
|
|
301 | (1) |
|
13.4.6 Analysis of Interference to the PU |
|
|
302 | (1) |
|
|
303 | (4) |
|
13.5.1 Bayesian Channel Sensing |
|
|
303 | (1) |
|
13.5.2 Channel Access in the Two Primary Channels Case |
|
|
304 | (2) |
|
13.5.3 Fast Algorithm for Multichannel Access |
|
|
306 | (1) |
|
13.5.4 Interference Performance |
|
|
307 | (1) |
|
|
307 | (3) |
|
|
308 | (2) |
|
14 Indian Buffet Game for Multiple Choices |
|
|
310 | (31) |
|
|
310 | (2) |
|
|
312 | (4) |
|
14.2.1 Indian Buffet Game Formulation |
|
|
312 | (2) |
|
14.2.2 Time Slot Structure of the Indian Buffet Game |
|
|
314 | (2) |
|
14.3 Indian Buffet Game without Budget Constraints |
|
|
316 | (6) |
|
14.3.1 Recursive Best Response Algorithm |
|
|
318 | (1) |
|
14.3.2 Subgame-Perfect Nash Equilibrium |
|
|
319 | (1) |
|
|
320 | (2) |
|
14.4 Indian Buffet Game with Budget Constraints |
|
|
322 | (5) |
|
14.4.1 Recursive Best Response Algorithm |
|
|
322 | (3) |
|
14.4.2 Subgame-Perfect Nash Equilibrium |
|
|
325 | (1) |
|
|
325 | (2) |
|
14.5 Non-Bayesian Social Learning |
|
|
327 | (4) |
|
|
331 | (7) |
|
14.6.1 Indian Buffet Game without Budget Constraints |
|
|
332 | (3) |
|
14.6.2 Indian Buffet Game with Budget Constraints |
|
|
335 | (1) |
|
14.6.3 Non-Bayesian Social Learning Performance |
|
|
336 | (1) |
|
14.6.4 Application in Relay Selection of Cooperative Communication |
|
|
336 | (2) |
|
|
338 | (3) |
|
|
339 | (2) |
|
15 Hidden Chinese Restaurant Game: Learning from Actions |
|
|
341 | (29) |
|
|
341 | (3) |
|
|
344 | (3) |
|
15.2.1 Customers: Naive and Rational |
|
|
345 | (1) |
|
15.2.2 Observable Information |
|
|
346 | (1) |
|
15.3 Hidden Chinese Restaurant Game |
|
|
347 | (9) |
|
15.3.1 System State Transition |
|
|
350 | (1) |
|
15.3.2 Grand Information Extraction |
|
|
351 | (2) |
|
15.3.3 Equilibrium Conditions |
|
|
353 | (3) |
|
|
356 | (3) |
|
15.4.1 Centralized Policy |
|
|
356 | (1) |
|
|
357 | (2) |
|
15.5 Application: Channel Access in Cognitive Radio Networks |
|
|
359 | (6) |
|
15.5.1 Simulation Results |
|
|
361 | (4) |
|
|
365 | (1) |
|
|
366 | (4) |
|
|
368 | (2) |
|
16 Wireless Network Access with Mechanism Design |
|
|
370 | (27) |
|
|
370 | (2) |
|
16.2 System Model and Problem Formulation |
|
|
372 | (4) |
|
|
372 | (3) |
|
|
375 | (1) |
|
16.2.3 Best Response of Rational Users |
|
|
376 | (1) |
|
16.3 Modified Value Iteration Algorithm |
|
|
376 | (2) |
|
16.4 Threshold Structure of the Strategy Profile |
|
|
378 | (2) |
|
16.5 Truthful Mechanism Design |
|
|
380 | (6) |
|
|
384 | (2) |
|
16.6 Numerical Simulation |
|
|
386 | (6) |
|
|
392 | (1) |
|
|
392 | (1) |
|
|
393 | (4) |
|
|
394 | (3) |
|
17 Deal Selection on Social Media with Behavior Prediction |
|
|
397 | (26) |
|
|
397 | (3) |
|
17.2 Cross-Social Media Data Set |
|
|
400 | (5) |
|
|
405 | (2) |
|
17.3.1 External Information from Social Media |
|
|
406 | (1) |
|
|
407 | (7) |
|
17.4.1 Multidimensional Markov Decision Process |
|
|
407 | (1) |
|
|
408 | (3) |
|
17.4.3 Expected Utility and Strategy Profile |
|
|
411 | (1) |
|
17.4.4 Nash Equilibrium and Value Iteration Algorithm |
|
|
412 | (2) |
|
|
414 | (3) |
|
|
416 | (1) |
|
|
416 | (1) |
|
17.6 Experiments: Are Customers Rational? |
|
|
417 | (2) |
|
|
419 | (1) |
|
|
420 | (3) |
|
|
421 | (2) |
|
18 Social Computing: Answer vs. Vote |
|
|
423 | (29) |
|
|
423 | (3) |
|
|
426 | (4) |
|
18.3 Equilibrium Analysis |
|
|
430 | (7) |
|
18.4 Extensions to Endogenous Effort |
|
|
437 | (3) |
|
18.5 Empirical Evaluations |
|
|
440 | (3) |
|
18.5.1 Data Set Description |
|
|
440 | (1) |
|
18.5.2 Observations and Validations |
|
|
441 | (2) |
|
18.6 Numerical Simulations |
|
|
443 | (5) |
|
18.6.1 Simulation Settings |
|
|
443 | (1) |
|
18.6.2 Simulation Results for Homogeneous Effort |
|
|
444 | (3) |
|
18.6.3 Simulation Results for Endogenous Effort |
|
|
447 | (1) |
|
|
448 | (1) |
|
|
449 | (3) |
|
|
450 | (2) |
Index |
|
452 | |