Improving the Performance of People, Processes and Organizations
Articles Columns Projects Resume Services Tool Room
Concerning Performance & Performance Standards
© Fred Nickols 2012
This article originally appeared in the "Speaking Out" section
of the NSPI Journal. After dusting it off, and doing a little light
editing, it seems as sound as when I first wrote it. At least that, like the rest of this
article, is my opinion.
Introduction and Overview
Performance standards play a key role in determining the success or failure of training programs and performance improvement efforts because they provide the yardsticks against which performance is measured. When performance standards are valid, such efforts have a better than even chance of being successful; when performance standards are invalid, the odds weigh heavily against success. In short, the validity of performance standards is the sine qua non of performance measurement, and performance measurement is in turn the sine qua non of successful performance improvement programs.
A fundamental issue regarding the validity of performance standards is the way in which performance itself is defined. I am of the opinion that the way in which performance is ordinarily defined makes the task of establishing valid performance standards a misleading and an unnecessarily difficulty one. Performance is commonly equated with what people do; that is, performance and behavior are seen as one and the same. In this opinion piece, I intend to define what I mean by performance, distinguishing it from behavior, and to discuss what I see as some of the costs of not making such a distinction. I also intend to suggest some initial guidelines for establishing valid performance standards -- guidelines that recognize performance as something more than just behavior.
Performance, as I view it, is defined by the outcomes of behavior. Behavior is individual activity, whereas the outcomes of behavior are the ways in which the behaving individuals environment is somehow different as a result of his or her behavior. The concept of outcomes is similar (if not identical) to the concept of accomplishment described by Thomas F. Gilbert in Levels and Structure of Performance Analysis (1974), and to the concept of achievements described by Gilbert Ryle in The Concept of Mind (1949).
Performance, then, is the achievement of some condition that reflects one or more outcomes of the behavior of one or more individuals. (A definition of performance that is not behavior-dependent is particularly useful in integrating and understanding the many different kinds and levels of performance that occur within organizations.)
To illustrate these points, lets analyze the following behavioral objective, taken from Robert F. Mager's Preparing Instructional Objectives (1962, p.59):
The behavior described in this objective may be conveniently termed as adjusting behavior, whereas the outcomes of this adjusting behavior are reflected in the state of the audiometer, namely, controls that are set and adjusted. The performance implied in this objective is also reflected by the audiometer, that is, when the student completes his or her activity, the audiometer is to be in a condition suitable for conducting a standard hearing test. The measure of performance for this objective is the extent to which the audiometer is or is not in that condition upon completion of student activity. From the presumably verifiable condition of the audiometer, it is reasonable to infer that the proper adjusting behavior did or did not occur. (It is also possible to deduce, from an improperly adjusted audiometer, where the adjusting process went awry and to make some reasonably useful inferences about how and why it went awry. However, the analysis of performance is not the subject of this paper, so comments about performance diagnostics will have to wait.)
The preceding analysis of a behavioral objective illustrates my central point: Performance is (or ought to be) defined more by the outcomes of behavior than by the behavior itself. It follows, therefore, that the development of performance standards should be based on an examination of the outcomes of behavior instead of the behavior that is thought to lead to those outcomes. As Gilbert (1974, p.13) wrote, If you think about it, then, it is only the accomplishments of performance that we value -- never the behaviors that produce them.
The failure to distinguish behavior from performance is a misleading and a costly one. There are at least two ways in which behaviorally-oriented attempts to establish performance standards are misled:
A discussion of both these false trails to performance standards is next, following by a discussion of some of the costs of taking these false trails.
False Trails to Performance Standards
Statements of behavior are abstractions; for example, the behavior of people called computer programmers is often referred to as programming, obviously an abstraction, and a generalization. Regardless of the degree of specificity used in describing programmer behavior (whether done by an observer, by the programmer, or by a panel of experts), the resultant descriptions are still abstractions -- descriptions of behavioral events are simply not the same as the events they describe. More important, because behavioral statements are the direct products of the conceptual-verbal processes of the person formulating them, there is some question as to just what a supposedly behavioral statement actually describes -- behavior, or the conceptual-verbal structure of the person formulating the description.
Statements of outcomes are also abstractions, however, they describe the products of activity. The outcomes of programming activity include function hierarchies, coding sheets, flowcharts, and other tangible products. Standards defining the quality of tangible products are much more easily developed and agreed upon than are standards for abstract descriptions of behavior. Performance standards relating to the outcomes of behavior are also more valid than standards relating to behavior because the outcomes of behavior literally define performance, whereas behavioral statements reflect little more than an abstract description of the presumed causes of performance (which brings us to the problem of imposing standards on activity).
There are three generally accepted classifications of performance standards: quality (accuracy), quantity (amount), and time (speed). A point seemingly overlooked in many attempts to establish performance standards is that quality, quantity, and time are classification categories for standards, not sources of standards. Standards should be derived from the outcomes of activity and they may then be classified in accordance with the three aforementioned categories. Instead, standards are all too often generated from these abstract categories and then arbitrarily imposed on activity. In the most extreme case imaginable, it is possible to have a supposedly measurable performance objective that not only does not describe performance, but that also has measures of performance that are arbitrary and totally lacking in validity.
As a case in point, consider the computer programmer who was transferred out of her organizations programming effort because she took too long from the start of her programming assignments to the point where she was ready to compile and edit her programs. Later, it was discovered that this same programmer had been taking practically no time at all to compile, edit, and de-bug her programs due to the care she exercised in their initial development. Consequently, the total elapsed time from her initial programming assignments to the point where her programs were up and running was no more than that for the other programmers in her group. More important, because her initial programs contained fewer errors than those of other programmers, the dollar-costs of her program were significantly lower than those of the other programmers. It seems the other programmers were hurrying through the initial program development phase to meet the compilation deadline and then using inordinate amounts of very expensive computer time in de-bugging their programs. All in all, the programmer who was transferred out of the unit was creating the best programs in terms of both quality and cost. Unfortunately, she fell victim to a performance standard that was arbitrary, invalid, and imposed on activity, a standard that had not been derived from an analysis of the outcomes of programming activity.
The important point is to recognize that the true measures of performance are found in the outcomes of behavior, in the ways in which the performers environment is somehow different as a result of his or her behavior. When behavior and performance are considered equivalents, attempts to measure performance wrongly focus on behavior and the behaving individuals instead of the outcomes of behavior. As we have just seen, this practice is very misleading. As we are about to see, it is very costly.
The Costs of Following False Trails
A focus on behavior, especially a focus on the behaving individuals, often leads to the use of normative measures of performance. Norm-referenced measures are largely irrelevant to the task of measuring performance because they measure differences between individuals and the task of performance measurement is to measure the consequences of interaction between individuals and their environment. As William Powers put it in Behavior: The Control of Perception (1973, p.12), It is unfortunate but true that measures and predictions obtainable only through averaging the performance of many persons are applied to individuals, so that a persons life may be seriously affected by his performance on a test that is valid only for predicting behavior en masse. It is also unfortunate but true that the money spent on norm-referenced attempts to measure performance is by and large wasted because that which is being measured in such attempts is not performance.
To concentrate on behavior as the source or application point for performance standards is also to zero in on activity instead of results. Measures of activity (normative or otherwise) are, of necessity, measures of efficiency and not measures of effectiveness. Given the misleading nature of many activity-oriented standards, it is likely that measurement based on such standards leads to false conclusions regarding efficiency and to the neglect of measures of effectiveness. I think it is impossible even to begin to estimate the costs of what appear to be frequent sacrifices of the measurement of effectiveness to what are certainly misleading and possible invalid measurements of efficiency.
Equating behavior with performance leads also to unnecessary conflict between the individual and the organization. Human behavior is but the means to various ends, and it must usually satisfy the ends of at least two separate parties: the behaving individual, and those interested in his or her performance. If performance is described only in terms of behavior, then there is no alternative but for the management of performance to rest squarely on a strategy of direct control and manipulation of human behavior. The consequence of such an approach is predictable, inevitable, and costly: Conflict. On the other hand, as the percentage of performance that is described in terms of outcomes is increased, the requirement to manage performance through the control and manipulation of individual behavior is decreased, as is the potential for conflict between the individual and the organization.
Confusing behavior with performance greatly reduces the value of feedback as a technique for maintaining and improving performance. The concept of feedback requires the monitoring of outputs, not activity, and behavior is activity. Technically speaking, feedback is information about an actual condition with regard to some reference condition. (See William Powers book, cited above, for a fascinating description of human behavior as the means whereby individuals control their perceptions of input stimuli as opposed to being controlled by them.) If an individual is truly to receive feedback, then that individual must be able to recognize the reference condition, interpret information about actual conditions relevant to the reference condition, and act to reduce the difference between the two, otherwise, data from his or her environment is not feedback, it is just so much noise. The reference condition for a given performance is defined by the standards for that performance and, as we have seen from the example involving the audiometer, standards should be based on the outcomes of behavior. True feedback is possible only when the standards for performance are based on the outcomes of behavior, otherwise, feedback is nothing more than a device to ensure obedience and accountability for performance is lost in a struggle for the control of behavior.
One implication of the relationship between feedback and performance standards is obvious but frequently overlooked, namely, that performers must be able to recognize quality in the outcomes of their behavior. (Robert M. Pirsig provides some interesting insights into the basic nature of quality in his bestseller, Zen and The Art of Motorcycle Maintenance.) If, for example, the standards for good computer programs are specified so the programmers can discriminate between good programs and bad, they are in a position to monitor and correct their own program development activities. (In 1969, the Programmed Instruction (PI) Writers Course at the Navys Instructor Training School in San Diego, California was redesigned based on just such an approach. The trainees were taught to tell the difference between good PI and bad, and then provided with the opportunity to write good PI. The premise was that the trainees would be capable of providing their own feedback. Indeed, they were.) On the other hand, if programmers are held responsible only for adherence to a set of abstractly defined developmental procedures, then all that can be monitored is activity, not output, and feedback will consist only of vague indications that the programmers arent doing it right. The net result is the proliferation of myths and mythunderstandings about the right way of doing things.
Behavioral descriptions of performance have their origins in the field of training development. There, too, behavioral descriptions of performance incur high costs. There is usually more than one way to achieve a given outcome or result. Consequently, when one right way is prescribed, through a rigid behavioral or procedural description of performance, the individual performers flexibility and adaptability are severely reduced, if not completely eliminated. More important, overly precise procedural descriptions of performance prevent the drawing of an accurate picture of the individual performers true capabilities, that is, it is entirely possible that the individual can produce the desired results, but not through the specified activities. In fact, it is even possible that many training programs are created only because unduly confining procedural models of performance are specified and performers are then restricted to these models. The performers so restricted, are of course subsequently identified as trainees. The costs of such unnecessary training programs are probably astronomical.
To summarize thus far, when behavior is equated with performance, attempts to establish performance standards can be misled. Being misled, they incur high costs in the form of inappropriate measurement methodologies, false measures of efficiency, neglected measures of effectiveness, unnecessary conflict between the individual and the organization, vague and confusing performance feedback that really isnt feedback at all, and irrelevant and unnecessary training programs.
It is obviously easier to deal with issues of performance when performance standards are valid than when they are invalid. A likely question at this point is, How does one go about establishing valid performance standards? To answer that question would be to focus on activity, the very act I have been criticizing. A question more in keeping with the ideas presented thus far is, What are the criteria for distinguishing between valid and invalid performance standards? I choose to answer this latter question because I think it is more important to begin the task of setting standards for standards than to describe procedures for establishing standards, especially in light of the fact that the qualities of good performance standards have not yet been specified.
Standards for Standards
Summary and Conclusions
One focal point of this article has been the distinction between behavior and performance, namely, that behavior is individual human activity and that performance is defined by the outcomes of behavior. I have argued that performance standards should be based on the outcomes of behavior instead of behavior. Basing performance standards on the outcomes of behavior offers several advantages:
Basing performance standards on the outcomes of behavior is also advantageous because it draws attention to many performance-related issues that are not highlighted by purely behavioral descriptions of performance. For example, behavior serves the individuals needs as well as those of the organization. It is necessary, then, to examine the outcomes sought by the individual as well as those sought by the organization and to examine how these two sets of outcomes relate to one another. Human behavior in organizations has many outcomes that are in no way task or work-related, so it is important to examine the social as well as the technical aspect of performance. Perceptions and expectations regarding performance are held by many people in organizations and these might relate to behavior, to its outcomes, or to both. It is therefore essential to identify and reconcile the perceptions and expectations of all those having a stake in a given performance. Finally, many organizational outcomes are the result of more than one level of performance. Accordingly, it is important to determine how the outcomes of the behavior of many individuals interact and combine so as to produce unit and organizational outcomes. These are all issues that must be resolved in the course of defining desired performance and establishing standards for that performance.
At least, thats my opinion.
This page last updated on June 27, 2015