Outcome-Based
Evaluation
A Working Model for
Arts Projects
Section 3: Evaluating the Project (cont): Elements Six-Nine |
| |
| Reminder:
The NEA requires each grant applicant to identify one of the NEA-defined
outcomes for the category under which it applies, discuss it in the narrative,
and describe how it will be measured. Applicants may also identify and
discuss additional outcomes established for their projects; however, this
not a required part of the application process. Applicants may find the
remaining elements of the outcomes logic model useful for developing an
evaluation plan, but they are NOT required of NEA applicants.
|
 |
|
 |
Element Six - Data Sources
For each indicator of an outcome, information must be collected
that demonstrates that the change has occurred. Data sources are the vehicles
or methods used to collect data concerning indicators. Various types of
data sources include pre- and post-test scores, project records, assessment
reports, records from other organizations, or observations of behaviors
through checklists and other tools and approaches. |
| |
|
 |
Some data sources are more
reliable than others. A school report or test may be the best evidence
of change for certain types of behaviors or knowledge. However, such data
may not always be appropriate or achievable for the indicator. In some
instances, self-reports from individuals may be the primary source, or
there may be trained observers that can be utilized. |
| |
|
 |
|
| |
|
 |
Element Seven - Who
For each data source, it is necessary to specify whether
the information will be collected from all participants in the project
or only those who complete the project. This determination may affect
the results of the project. Individuals who complete a project are more
likely to experience the impact of the project than those individuals
who do not complete the project. |
| |
|
 |
Element Eight - Data Intervals
Outcome information for each indicator may be collected
at specific intervals, such as every six months, or at fixed points such
as the beginning and end of a project or at a point in the future called
"follow-up." The timing of the data collection needs to be specified,
and the timing may depend on when the information or data is available.
If the service is delivered for only a short period of time, then the
data collection may be only at the end of a particular activity. In projects
where increases in skill, behavior, or knowledge are expected, the data
is usually collected at project start and completion. |
| |
|
 |
Element Nine - Target
Targets are goals that state the expectations for performance
of outcomes. Generally, they are stated as a percentage and/or number.
Goals are set for each indicator of each outcome. Knowing how to set a
target is often difficult. It may be best to rely on information you may
have concerning how this project has worked in the past, or you may decide
to use target information based on what your funders and other "stakeholders"
expect of your project. With new projects, the capabilities, needs and
abilities of your audience will be factors in setting your targets for
outcomes. |
| |
|
<Prev.
Page | Index | Next Page> |
Introduction | Building
a Project | Evaluating the project | Reporting |
