|
I The Why, the Types, and the Tools of Cost-Inclusive Evaluation |
|
|
|
1 Cost-Inclusive Evaluation |
|
|
3 | (23) |
|
Cost Data: The Lifeblood of Cost-Inclusive Decision Making |
|
|
4 | (1) |
|
Why Consider Costs in Evaluations? |
|
|
5 | (4) |
|
Implicit Inclusion of Costs in All Evaluations |
|
|
9 | (2) |
|
Dangers of Not Making Costs Explicit in Program Evaluations |
|
|
11 | (3) |
|
Current Use of Cost-Inclusive Evaluations by Funding Decision Makers |
|
|
14 | (2) |
|
Why Many Program Evaluators Are Ideally Positioned to Include Costs in Evaluations |
|
|
16 | (1) |
|
Roles for Quantitative, Qualitative, and Mixed Methods |
|
|
17 | (1) |
|
Resistance to Inclusion of Costs in Evaluation |
|
|
18 | (2) |
|
Strategies That Can Be Used to Conduct a Cost-Inclusive Evaluation |
|
|
20 | (1) |
|
|
21 | (2) |
|
|
23 | (1) |
|
Appendix 1.1 Free Electronic Resources on Cost Analysis |
|
|
24 | (1) |
|
Appendix 1.2 Institutions Offering Training in Cost-Benefit Analysis |
|
|
25 | (1) |
|
2 Types of Costs and Outcomes That Need to Be Considered in Cost-Inclusive Evaluations |
|
|
26 | (21) |
|
Fixed Costs versus Variable Costs |
|
|
27 | (1) |
|
Direct Costs versus Indirect Costs |
|
|
28 | (2) |
|
Capital Costs versus Recurrent or Operational Costs |
|
|
30 | (1) |
|
|
31 | (1) |
|
|
32 | (2) |
|
Tangible versus Intangible Costs and Outcomes |
|
|
34 | (1) |
|
Monetary versus Nonmonetary Costs and Outcomes |
|
|
34 | (2) |
|
Quantitative versus Qualitative Costs and Outcomes |
|
|
36 | (1) |
|
|
37 | (3) |
|
When Are Differences in Costs and Outcomes Real? |
|
|
40 | (2) |
|
Questions about Cost and Outcome Differences |
|
|
42 | (1) |
|
Distinguishing Effectiveness from Benefits |
|
|
43 | (1) |
|
|
44 | (2) |
|
|
46 | (1) |
|
3 Tools for Identifying and Measuring Costs and Outcomes and Other Issues for Consideration |
|
|
47 | (24) |
|
Challenges with Gathering Cost Data |
|
|
48 | (1) |
|
Double Counting and Its Implications |
|
|
49 | (2) |
|
Costs Identification Tools |
|
|
51 | (5) |
|
Outcomes Identification Tools |
|
|
56 | (4) |
|
Macro-, Meso-, and Micro-Level Program Operation and Evaluation |
|
|
60 | (2) |
|
Why Budgets and Accounting Records Are Often Not Enough |
|
|
62 | (1) |
|
Ethics and Cost-Inclusive Evaluation |
|
|
63 | (2) |
|
Common Traps and Pitfalls |
|
|
65 | (2) |
|
|
67 | (1) |
|
|
68 | (3) |
|
II Adapting Economic Methods to Enhance Cost-Inclusive Evaluation |
|
|
|
4 Economic Appraisal Methodologies |
|
|
71 | (28) |
|
Evolution and Development of Cost Analysis |
|
|
71 | (1) |
|
Traditional Economic Frameworks |
|
|
72 | (1) |
|
Time Preference and Discounting |
|
|
73 | (2) |
|
|
75 | (1) |
|
|
76 | (1) |
|
|
77 | (2) |
|
Payback Period and Discounted Payback Period |
|
|
79 | (1) |
|
Cost-Effectiveness Analysis |
|
|
80 | (1) |
|
Cost-Feasibility Analysis |
|
|
81 | (1) |
|
|
81 | (5) |
|
|
86 | (1) |
|
Surrogate Market Valuation Methodologies |
|
|
86 | (2) |
|
Advantages and Disadvantages of Different Economic Appraisal Methods |
|
|
88 | (1) |
|
|
88 | (4) |
|
|
92 | (3) |
|
Economic Appraisal Formulas |
|
|
95 | (2) |
|
Appendix 4.1 Executive Order 12291 |
|
|
97 | (1) |
|
Appendix 4.2 Present-Value Discount Tables |
|
|
98 | (1) |
|
5 Considerations When Using Economic Appraisal Methods |
|
|
99 | (24) |
|
Which Cost-Analytical Methodology Is Best? |
|
|
100 | (2) |
|
Perspective for the Study |
|
|
102 | (1) |
|
When Different Stakeholders Prefer Different Cost-Analytical Frameworks |
|
|
103 | (1) |
|
When Stakeholders Wish to Exclude Some Costs, Benefits, Effectiveness Measures, or Cost-Analytical Frameworks |
|
|
104 | (3) |
|
Inappropriate Interpretations of Findings from Different Cost-Inclusive Evaluation Frameworks |
|
|
107 | (2) |
|
Discount Rate Choices and Their Impact on Analyses |
|
|
109 | (2) |
|
Market Prices versus Shadow Prices |
|
|
111 | (1) |
|
The Role of Sensitivity Analyses in Gauging Uncertainty |
|
|
112 | (2) |
|
|
114 | (1) |
|
Implications for Over- and Underestimation of Costs and Outcomes |
|
|
115 | (1) |
|
|
116 | (2) |
|
|
118 | (5) |
|
III Adapting Concepts and Tools from Accounting to Improve Cost-Inclusive Evaluation |
|
|
|
6 Financial Accounting Concepts and Tools |
|
|
123 | (26) |
|
Understanding Accounting Records to Extract Relevant Data |
|
|
125 | (6) |
|
Income Statement: Importance, Terminology, and Interpretation |
|
|
131 | (1) |
|
Statement of Cash Flows: Importance, Terminology, and Interpretation |
|
|
132 | (2) |
|
Balance Sheet: Importance, Terminology, and Interpretation |
|
|
134 | (6) |
|
Notes to Financial Statements |
|
|
140 | (1) |
|
|
140 | (3) |
|
|
143 | (2) |
|
|
145 | (2) |
|
|
147 | (2) |
|
7 Cost and Management Accounting Concepts and Tools |
|
|
149 | (30) |
|
How Cost and Management Accounting Can Enhance Decision Making and Cost-Inclusive Evaluation |
|
|
150 | (1) |
|
Understanding Cost Behavior |
|
|
151 | (1) |
|
|
152 | (3) |
|
Understanding Program Cost or Activity Drivers |
|
|
155 | (2) |
|
Understanding Program Cost Structure |
|
|
157 | (1) |
|
|
158 | (3) |
|
Cost-Volume-Profit Analysis |
|
|
161 | (4) |
|
|
165 | (7) |
|
|
172 | (2) |
|
|
174 | (2) |
|
Cost And Management Accounting Formulas |
|
|
176 | (3) |
|
IV Cost-Inclusive Evaluation for the Scientist-Manager-Practitioner |
|
|
|
8 Breaking Down Cost by Activity for Better Cost-Inclusive Evaluations |
|
|
179 | (32) |
|
Capture the Essence of a Program: Its Activities |
|
|
179 | (3) |
|
Develop a Resource × Activity Matrix to Characterize and Analyze the Program |
|
|
182 | (1) |
|
List and Define the Major Activities of the Program |
|
|
183 | (1) |
|
List and Define the Major Resources Used by the Program |
|
|
184 | (1) |
|
Capture Activity Occurrence, Frequency, and Intensity |
|
|
185 | (1) |
|
Activities Planned versus Activities Implemented Using Resource × Activity Matrixes to Improve |
|
|
186 | (2) |
|
Program Cost-Effectiveness |
|
|
188 | (2) |
|
Summarizing Resources → Activities Findings, Quantitatively and Qualitatively |
|
|
190 | (5) |
|
Assess Reliability and Validity of Resource → Activity Findings |
|
|
195 | (2) |
|
|
197 | (3) |
|
Valuing Resources Consumed |
|
|
200 | (5) |
|
Dealing with Unmeasured or Unallocated Resources |
|
|
205 | (1) |
|
|
205 | (2) |
|
|
207 | (2) |
|
|
209 | (2) |
|
9 Completing the Model with Activity → Process and Process → Outcome Analyses |
|
|
211 | (30) |
|
Discover the Biopsychosocial Processes That Make a Program Work |
|
|
212 | (2) |
|
Psychological and Other Methods of Measuring Processes |
|
|
214 | (1) |
|
Methods for Finding Biological, Psychological, and Social Processes That Foster Program Outcomes |
|
|
215 | (3) |
|
Complete the Model: Assess Existence, Direction, and Strength of Activity → Process and Process → Outcome Relationships |
|
|
218 | (3) |
|
Mixed Methods RAPOA That Quantifies Resource Use for Changes in Activities, in Processes, and in Outcomes |
|
|
221 | (1) |
|
Resource x Activity Analysis Matrix |
|
|
222 | (1) |
|
Activity x Process Analysis Matrix |
|
|
223 | (2) |
|
Process x Outcome Analysis Matrix |
|
|
225 | (2) |
|
Formative Findings of Cost-Inclusive Mixed Methods Evaluation |
|
|
227 | (1) |
|
Complexities and Individual Variability in Indices of Cost-Effectiveness |
|
|
227 | (2) |
|
Cost-Effectiveness and Cost/Effectiveness (and Effectiveness/Cost) Ratios |
|
|
229 | (3) |
|
Cost-Benefit and Benefit/Cost Ratios |
|
|
232 | (2) |
|
Conclusion: Really Doing Cost-lnclusive Evaluation! |
|
|
234 | (3) |
|
|
237 | (1) |
|
Statistical Analysis Programs and Associated Websites |
|
|
238 | (1) |
|
|
239 | (2) |
List of Acronyms |
|
241 | (2) |
Glossary |
|
243 | (8) |
References |
|
251 | (12) |
Author Index |
|
263 | (4) |
Subject Index |
|
267 | (11) |
About the Authors |
|
278 | |