Preface |
|
xiii | |
|
1 Introduction: Donsker's Theorem, Metric Entropy, and Inequalities |
|
|
1 | (22) |
|
1.1 Empirical processes: the classical case |
|
|
2 | (8) |
|
1.2 Metric entropy and capacity |
|
|
10 | (2) |
|
|
12 | (11) |
|
|
18 | (1) |
|
|
19 | (2) |
|
|
21 | (2) |
|
2 Gaussian Measures and Processes; Sample Continuity |
|
|
23 | (68) |
|
|
23 | (1) |
|
2.2 Gaussian vectors are probably not very large |
|
|
24 | (7) |
|
2.3 Inequalities and comparisons for Gaussian distributions |
|
|
31 | (9) |
|
2.4 Gaussian measures and convexity |
|
|
40 | (3) |
|
2.5 The isonormal process: sample boundedness and continuity |
|
|
43 | (9) |
|
2.6 A metric entropy sufficient condition for sample continuity |
|
|
52 | (7) |
|
|
59 | (15) |
|
2.8 Sample continuity and compactness |
|
|
74 | (4) |
|
2.9 Volumes, mixed volumes, and ellipsoids |
|
|
78 | (4) |
|
2.10 Convex hulls of sequences |
|
|
82 | (9) |
|
|
83 | (3) |
|
|
86 | (2) |
|
|
88 | (3) |
|
3 Foundations of Uniform Central Limit Theorems: Donsker Classes |
|
|
91 | (43) |
|
3.1 Definitions: convergence in law |
|
|
91 | (4) |
|
3.2 Measurable cover functions |
|
|
95 | (5) |
|
3.3 Almost uniform convergence and convergence in outer probability |
|
|
100 | (3) |
|
|
103 | (3) |
|
3.5 Almost surely convergent realizations |
|
|
106 | (5) |
|
3.6 Conditions equivalent to convergence in law |
|
|
111 | (6) |
|
3.7 Asymptotic equicontinuity and Donsker classes |
|
|
117 | (4) |
|
3.8 Unions of Donsker classes |
|
|
121 | (1) |
|
3.9 Sequences of sets and functions |
|
|
122 | (12) |
|
|
127 | (3) |
|
|
130 | (2) |
|
|
132 | (2) |
|
4 Vapnik-Cervonenkis Combinatorics |
|
|
134 | (36) |
|
4.1 Vapnik-Cervonenkis classes |
|
|
134 | (4) |
|
4.2 Generating Vapnik-Cervonenkis classes |
|
|
138 | (4) |
|
|
142 | (3) |
|
|
145 | (7) |
|
|
152 | (4) |
|
4.6 Probability laws and independence |
|
|
156 | (3) |
|
4.7 Vapnik-Cervonenkis properties of classes of functions |
|
|
159 | (2) |
|
4.8 Classes of functions and dual density |
|
|
161 | (4) |
|
4.9 Further facts about VC classes |
|
|
165 | (5) |
|
|
166 | (1) |
|
|
167 | (1) |
|
|
168 | (2) |
|
|
170 | (26) |
|
|
171 | (8) |
|
|
179 | (6) |
|
5.3 Suslin properties, selection, and a counterexample |
|
|
185 | (11) |
|
|
191 | (2) |
|
|
193 | (1) |
|
|
194 | (2) |
|
6 Limit Theorems for Vapnik-Cervonenkis and Related Classes |
|
|
196 | (38) |
|
6.1 Koltchinskii-Pollard entropy and Glivenko-Cantelli theorems |
|
|
196 | (7) |
|
6.2 Vapnik-Cervonenkis-Steele laws of large numbers |
|
|
203 | (5) |
|
6.3 Pollard's central limit theorem |
|
|
208 | (7) |
|
6.4 Necessary conditions for limit theorems |
|
|
215 | (5) |
|
6.5 Inequalities for empirical processes |
|
|
220 | (3) |
|
6.6 Glivenko-Cantelli properties and random entropy |
|
|
223 | (3) |
|
6.7 Classification problems and learning theory |
|
|
226 | (8) |
|
|
227 | (1) |
|
|
228 | (2) |
|
|
230 | (4) |
|
7 Metric Entropy, with Inclusion and Bracketing |
|
|
234 | (16) |
|
7.1 Definitions and the Blum-DeHardt law of large numbers |
|
|
234 | (4) |
|
7.2 Central limit theorems with bracketing |
|
|
238 | (6) |
|
7.3 The power set of a countable set: the Borisov-Durst theorem |
|
|
244 | (2) |
|
7.4 Bracketing and majorizing measures |
|
|
246 | (4) |
|
|
247 | (1) |
|
|
248 | (1) |
|
|
248 | (2) |
|
8 Approximation of Functions and Sets |
|
|
250 | (35) |
|
8.1 Introduction: the Hausdorff metric |
|
|
250 | (2) |
|
8.2 Spaces of differentiable functions and sets with differentiable boundaries |
|
|
252 | (12) |
|
|
264 | (5) |
|
8.4 Metric entropy of classes of convex sets |
|
|
269 | (16) |
|
|
281 | (1) |
|
|
282 | (1) |
|
|
283 | (2) |
|
9 Sums in General Banach Spaces and Invariance Principles |
|
|
285 | (29) |
|
9.1 Independent random elements and partial sums |
|
|
286 | (5) |
|
9.2 A CLT implies measurability in separable normed spaces |
|
|
291 | (2) |
|
9.3 A finite-dimensional invariance principle |
|
|
293 | (8) |
|
9.4 Invariance principles for empirical processes |
|
|
301 | (5) |
|
9.5 Log log laws and speeds of convergence |
|
|
306 | (8) |
|
|
309 | (1) |
|
|
310 | (1) |
|
|
311 | (3) |
|
10 Universal and Uniform Central Limit Theorems |
|
|
314 | (18) |
|
10.1 Universal Donsker classes |
|
|
314 | (8) |
|
10.2 Metric entropy of convex hulls in Hilbert space |
|
|
322 | (6) |
|
10.3 Uniform Donsker classes |
|
|
328 | (4) |
|
|
330 | (1) |
|
|
330 | (1) |
|
|
330 | (2) |
|
11 The Two-Sample Case, the Bootstrap, and Confidence Sets |
|
|
332 | (31) |
|
|
332 | (3) |
|
11.2 A bootstrap central limit theorem in probability |
|
|
335 | (22) |
|
11.3 Other aspects of the bootstrap |
|
|
357 | (1) |
|
11.4 Further Gine-Zinn bootstrap central limit theorems |
|
|
358 | (5) |
|
|
359 | (1) |
|
|
360 | (1) |
|
|
361 | (2) |
|
12 Classes of Sets or Functions Too Large for Central Limit Theorems |
|
|
363 | (28) |
|
12.1 Universal lower bounds |
|
|
363 | (2) |
|
|
365 | (2) |
|
12.3 Poissonization and random sets |
|
|
367 | (6) |
|
12.4 Lower bounds in borderline cases |
|
|
373 | (11) |
|
12.5 Proof of Theorem 12.4.1 |
|
|
384 | (7) |
|
|
388 | (1) |
|
|
388 | (1) |
|
|
389 | (2) |
Appendix A Differentiating under an Integral Sign |
|
391 | (8) |
Appendix B Multinomial Distributions |
|
399 | (3) |
Appendix C Measures on Nonseparable Metric Spaces |
|
402 | (3) |
Appendix D An Extension of Lusin's Theorem |
|
405 | (2) |
Appendix E Bochner and Pettis Integrals |
|
407 | (6) |
Appendix F Nonexistence of Types of Linear Forms on Some Spaces |
|
413 | (4) |
Appendix G Separation of Analytic Sets; Borel Injections |
|
417 | (4) |
Appendix H Young-Orlicz Spaces |
|
421 | (4) |
Appendix I Modifications and Versions of Isonormal Processes |
|
425 | (2) |
Subject Index |
|
427 | (5) |
Author Index |
|
432 | (3) |
Index of Notation |
|
435 | |