All Academic, Inc. Research Logo

Info/CitationFAQResearchAll Academic Inc.
Document

An Academic Accomplishment Index For Assessing Faculty Performance
Unformatted Document Text:  6 identified. It may be noted that getting these questionnaires completed and returned was a difficult task. The questionnaire was complex and time-consuming. Such administrators are busy people, and in many cases follow-up requests had to be made to motivate compliance. In the end, however, from these 148 institutions, a total of 109 completed questionnaires were received. 1 The Thurstone paired-comparison procedure requires that the person responding to the questionnaire consider every possible pair of (whatever is being examined) and make a comparative judgment as to which of the to in the pair is greater regarding some aspect or feature under consideration (Edwards, 1957). In other words, each administrator responding to the questionnaire was asked to select which statement in a pair of performance criteria was likely to be seen as most meritorious for awarding an academic reward. An example was the following: Publishing a refereed article in print media Publishing a refereed article in online media. In this particular case, almost all respondents indicated that the refereed article in print media was a more significant accomplishment than publishing a refereed article online. From the resulting 55 judgments, a matrix was developed listing the proportion of times that each criterion was judged to have greater weight than the one with which it was compared. The underlying statistical model is that if only chance provided the basis of the outcome of these judgments, then a random (normal) distribution would prevail among them. Obviously, however, chance was not at work here. The judgments made by the administrators caused some of the criteria in the pairs to be very frequently viewed as of high value, and some as low, with others arrayed in between. This judge as of greater importance, then, showed large proportions and those of lesser significance smaller ones. From the matrix of proportions, a second array can be obtained by looking up the z- scores associated with each proportion. Those with very or very low proportions will be at the extremes of the normal distribution, indicating high or low importance or weight in terms of the judgments of the administrators. Those z-scores can be averaged for each of the 11 criteria used

Authors: Adams, Jonathan.
first   previous   Page 6 of 14   next   last



background image
6
identified. It may be noted that getting these questionnaires completed and returned was a
difficult task. The questionnaire was complex and time-consuming. Such administrators are busy
people, and in many cases follow-up requests had to be made to motivate compliance. In the end,
however, from these 148 institutions, a total of 109 completed questionnaires were received.
1
The Thurstone paired-comparison procedure requires that the person responding to the
questionnaire consider every possible pair of (whatever is being examined) and make a
comparative judgment as to which of the to in the pair is greater regarding some aspect or feature
under consideration (Edwards, 1957). In other words, each administrator responding to the
questionnaire was asked to select which statement in a pair of performance criteria was likely to
be seen as most meritorious for awarding an academic reward. An example was the following:
Publishing a refereed article in print media
Publishing a refereed article in online media.
In this particular case, almost all respondents indicated that the refereed article in print media
was a more significant accomplishment than publishing a refereed article online.
From the resulting 55 judgments, a matrix was developed listing the proportion of times
that each criterion was judged to have greater weight than the one with which it was compared.
The underlying statistical model is that if only chance provided the basis of the outcome of these
judgments, then a random (normal) distribution would prevail among them. Obviously, however,
chance was not at work here. The judgments made by the administrators caused some of the
criteria in the pairs to be very frequently viewed as of high value, and some as low, with others
arrayed in between. This judge as of greater importance, then, showed large proportions and
those of lesser significance smaller ones.
From the matrix of proportions, a second array can be obtained by looking up the z-
scores associated with each proportion. Those with very or very low proportions will be at the
extremes of the normal distribution, indicating high or low importance or weight in terms of the
judgments of the administrators. Those z-scores can be averaged for each of the 11 criteria used


Convention
Convention is an application service for managing large or small academic conferences, annual meetings, and other types of events!
Submission - Custom fields, multiple submission types, tracks, audio visual, multiple upload formats, automatic conversion to pdf.
Review - Peer Review, Bulk reviewer assignment, bulk emails, ranking, z-score statistics, and multiple worksheets!
Reports - Many standard and custom reports generated while you wait. Print programs with participant indexes, event grids, and more!
Scheduling - Flexible and convenient grid scheduling within rooms and buildings. Conflict checking and advanced filtering.
Communication - Bulk email tools to help your administrators send reminders and responses. Use form letters, a message center, and much more!
Management - Search tools, duplicate people management, editing tools, submission transfers, many tools to manage a variety of conference management headaches!
Click here for more information.

first   previous   Page 6 of 14   next   last

©2012 All Academic, Inc.