Expected Number of Valid Matches
The most reliable method of comparing scholarship databases is to
count the number of distinct addresses listed in each
database. This gives an indication as to the number of different
scholarship programs listed in the database, and
correlates well with the number of good matches a typical student
can expect.
Since the scholarship databases are unwilling to release their
proprietary lists of sponsor addresses, the only available option is
to use statistical sampling techniques to estimate the expected number
of matches for each database:
- Create a set of student profiles that are designed to reflect
the typical student, varying primary characteristics like gender,
race, and year in school.
- Establish a set of population weights according to the
prevalence of these profiles in the student population.
- Use the profiles to search each scholarship database, counting
the number of initial matches.
- Review the initial matches to filter out award programs that do
not actually match the profile to arrive at the number of valid matches.
- The number of valid matches also omits matches that are not up
to date (defunct award programs and awards for which none of the
contact information is current), duplicated awards (i.e., same award
under slightly different names), and scholarship scams.
- Compute the weighted average of the number of valid matches
using the population prevalence rates for the profiles and the number
of valid matches for each profile.
The result is the expected number of valid matches for a typical user.
This result doesn't give any information about the total number of
awards or the total dollar amount available, but can be used to derive
two quality measures for comparing scholarship databases: precision
and recall.
Precision is the percentage of initial matches that turn out to
be valid matches. It is a measure of whether the match results will
actually be relevant to the student. A database with a low precision
score will force users to read through hundreds of irrelevant awards
in order to find the awards for which they are qualified. Precision is
reported on a scale from 0% to 100%, with 100% being best.
Recall is the percentage of relevant awards that appear in the
search results. It is a measure of the coverage of the database,
indicating whether the results include all awards for which the
student is qualified, or whether some awards are missing from the
database. To arrive at this figure, one compares the matches from one
database with the union of valid matches from all databases. A score
of 100% indicates that all valid matches are included in the
database. Recall is reported on a scale from 0% to 100%, with 100%
being best.
The following table ranks the major scholarship databases according to
recall, and also reports the precision of each database.
| Scholarship Database Quality |
| Scholarship Database |
Recall |
Precision |
| FastWeb |
100% |
100% |
| Scholarships.com |
93% |
75% |
| Peterson's |
87% |
26% |
| College Board |
78% |
40% |
| Scholarship Experts |
77% |
73% |
| FindTuition.com |
75% |
15% |
| NextStudent |
43% |
38% |
| SRN Express |
33% |
31% |
| BrokeScholar |
18% |
75% |
The low precision of the Peterson's, FindTuition.com and College Board
scholarship matches yielded a significant number of irrelevant
awards. (The NextStudent and SRN Express databases also had low
precision, but yielded fewer irrelevant awards due to the smaller size
of their databases.)
National Postsecondary Student Aid Study
The National Postsecondary Student Aid Study (NPSAS)
is a large survey of college students to gather data on how they paid for
school. It is conducted every 3-4 years by the National Center for Education
Statistics (NCES) at the US Department of Education.
The NPSAS is the largest survey of its kind. The 2003-2004 NPSAS
surveyed about 80,000 undergraduate students and
11,000 graduate and professional students. This is a
statistically significant representative sample of the
student population.
The NPSAS's PRIVAID variable (PRIVAIDR in 1989-1990) contains
information about private sector
scholarships from "outside" sources. It excludes government, employer and
institutional aid, such as athletic scholarships. The following
tables provide statistics for graduate and undergraduate students
based on this variable.
| NPSAS Undergraduate Students |
| Study Year |
Average Scholarship Amount |
Percentage Receiving Scholarships |
Number of Recipients |
Amount of Awards |
| 1989-1990 |
$1,320.70 |
3.2% |
526,000 |
$695 million |
| 1992-1993 |
$1,440.52 |
3.5% |
638,974 |
$920 million |
| 1995-1996 |
$1,560.91 |
3.5% |
577,000 |
$900 million |
| 1999-2000 |
$2,050.84 |
6.9% |
1,141,000 |
$2.34 billion |
| 2003-2004 |
$1,982.02 |
6.7% |
1,276,000 |
$2.53 billion |
| NPSAS Graduate Students |
| Study Year |
Average Fellowship Amount |
Percentage Receiving Fellowships |
Number of Recipients |
Amount of Awards |
| 1995-1996 |
$3,233.40 |
2.4% |
66,000 |
$213 million |
| 1999-2000 |
$3,857.50 |
5.2% |
138,000 |
$532 million |
| 2003-2004 |
$3,557.10 |
5.5% |
154,000 |
$548 million |