level of difficulty, their frequency of performance, the consequences of error or other appropriate factors (essential). Where jobs are grouped or compared for the purposes of generalizing validity evidence, the work behavior(s) and work product(s) for each of the jobs should be described, and conclusions concerning the similarity of the jobs in terms of observable work behaviors or work products should be made (essential). (5) Job titles and codes. It is desirable to provide the selection procedure user's job title(s) for the job(s) in question and the corresponding job title(s) and code(s) from the United States Employment Service's dictionary of occupational titles. (6) Selection procedure. The selection procedure used as a measure of the construct should be completely and explicitly described or attached (essential). If commercially available selection procedures are used, they should be identified by title, form and publisher (essential). The research evidence of the relationship between the selection procedure and the construct, such as factor structure, should be included (essential). Measures of central tendency, variability and reliability of the selection procedure should be provided (essential). Whenever feasible, these measures should be provided separately for each relevant race, sex and ethnic group. (7) Relationship to job performance. The criterion-related study(ies) and other empirical evidence of the relationship between the construct measured by the selection procedure and the related work behavior(s) for the job or jobs in question should be provided (essential). Documentation of the criterion-related study(ies) should satisfy the provisions of paragraph 15B of this section or paragraph 115E(1) of this section, except for stud■ies conducted prior to the effective date of these guidelines (essential). Where a study pertains to a group of jobs, and, on the basis of the study, validity is asserted for a job in the group, the observed work behaviors and the observed work products for each of the jobs should be described (essential). Any other evidence used in determining whether the work behavior(s) in each of the jobs is the same should be fully described (essential). (8) Alternative procedures investigated. The alternative selection procedures investigated and available evidence of their impact should be identified (essential). The scope, method, and findings of the investigation, and the conclusions reached in light of the findings should be fully described (essential). (9) Uses and applications. The methods considered for use of the selection procedure (e.g., as a screening device with a cutoff score, for grouping or ranking, or combined with other procedures in a battery) and available evidence of their impact should be described (essential). This description should include the rationale for choosing the method for operational use, and the evidence of the validity and utility of the procedure as it is to be used (essential). The purpose for which the procedure is to be used (e.g., hiring, transfer, promotion) should be described (essential). If weights are assigned to different parts of the selection procedure, these weights and the validity of the weighted composite should be reported (essential). If the selection procedure is used with a cutoff score, the user should describe the way in which normal expectations of proficiency within the work force were determined and the way in which the cutoff score was determined (essential). (10) Accuracy and completeness. The report should describe the steps taken to assure the accuracy and completeness of the collection, analysis, and report of data and results. (11) Source data. Each user should maintain records showing all pertinent information relating to its study of construct validity. (12) Contact person. The name, mailing address, and telephone number of the individual who may be contacted for further information about the validity study should be provided (essential). E. Evidence of validity from other studies. When validity of a selection procedure is supported by studies not done by the user, the evidence from the original study or studies should be compiled in a manner similar to that required in the appropriate paragraph of this section 15 above. In addition, the following evidence should be supplied: (1) Evidence from criterion-related validity studies—a. Job information. A description of the important job behavior(s) of the user's job and the basis on which the behaviors were determined to be important should be provided (essential). A full description of the basis for determining that these important work behaviors are the same as those of the job in the original study (or studies) should be provided (essential). b. Relevance of criteria. A full description of the basis on which the criteria used in the original studies are determined to be relevant for the user should be provided (essential). c. Other variables. The similarity of important applicant pool or sample characteristics reported in the original studies to those of the user should be described (essential). A description of the comparison between the race, sex and ethnic composition of the user's relevant labor market and the sample in the original validity studies should be provided (essential). d. Use of the selection procedure. A full description should be provided showing that the use to be made of the selection procedure is consistent with the findings of the original validity studies (essential). e. Bibliography. A bibliography of reports of validity of the selection procedure for the job or jobs in question should be provided (essential). Where any of the studies included an investigation of test fairness, the results of this investigation should be provided (essential). Copies of reports published in journals that are not commonly available should be described in detail or attached (essential). Where a user is relying upon unpublished studies, a reasonable effort should be made to obtain these studies. If these unpublished studies are the sole source of validity evidence they should be described in detail or attached (essential). If these studies are not available, the name and address of the source, an adequate abstract or summary of the validity study and data, and a con tact person in the source organization should be provided (essential). (2) -Evidence from content validity studies. See sections 14C(3) and section 15C of this section. (3) Evidence from construct validity studies. See sections 14D(2) and 15D of this section. F. Evidence of validity from cooperative studies. Where a selection procedure has been validated through a cooperative study, evidence that the study satisfies the requirements of sections 7, 8 and 15E should be provided (essential). G. Selection for higher level job. If a selection procedure is used to evaluate candidates for jobs at a higher level than those for which they will initially be employed, the validity evidence should satisfy the documentation provisions of this section 15 for the higher level job or jobs, and in addition, the user should provide: (1) a description of the job progression structure, formal or informal; (2) the data showing how many employees progress to the higher level job and the length of time needed to make this progression; and (3) an identification of any anticipated changes in the higher level job. In addition, if the test measures a knowledge, skill or ability, the user should provide evidence that the knowledge, skill or ability is required for the higher level job and the basis for the conclusion that the knowledge, skill or ability is not expected to develop from the training or experience on the job. A. Ability. A present competence to perform an observable behavior or a behavior which results in an observable product. B. Adverse impact. A substantially different rate of selection in hiring, promotion, or other employment decision which works to the disadvantage of members of a race, sex, or ethnic group. See section 4 of these guidelines. C. Compliance with these guidelines. Use of a selection procedure is in compliance with these guidelines if such use has been validated in accord with these guidelines (as defined below), or if such use does not result in adverse impact on any race, sex, or ethnic group (see section 4, of this part), or, in unusual circumstances, if use of the procedure is otherwise justified in accord with Federal law. See section 6B, of this part. D. Content validity. Demonstrated by data showing that the content of a selection procedure is representative of important aspects of performance on the job. See section 5B and section 14C. E. Construct validity. Demonstrated by data showing that the selection procedure measures the degree to which candidates have identifiable characteristics which have been determined to be important for successful job performance. See section 5B and section 14D. F. Criterion-related validity. Demonstrated by empirical data showing that the selection procedure is predictive of or significantly correlated with important elements of work behavior. See sections 5B and 14B. G. Employer. Any employer subject to the provisions of the Civil Rights Act of 1964, as amended, including State or local governments and any Federal agency subject to the provisions of section 717 of the Civil Rights Act of 1964, as amended, and any Federal contractor or subcontractor or federally assisted construction contractor or subcontactor covered by Executive Order 11246, as amended. H. Employment agency. Any employment agency subject to the provisions of the Civil Rights Act of 1964, as amended. I. Enforcement action. For the purposes of section 4 a proceeding by a Federal enforcement agency such as a lawsuit or an administrative proceeding leading to debarment from or withholding, suspension, or termination of Federal Government contracts or the suspension or withholding of Federal Government funds; but not a finding of reasonable cause or a concilation process or the issuance of right to sue letters under title VII or under Executive Order 11246 where such finding, conciliation, or issuance of notice of right to sue is based upon an individual complaint. J. Enforcement agency. Any agency of the executive branch of the Federal Government which adopts these guidelines for purposes of the enforcement of the equal employment opportunity laws or which has responsibility for securing compliance with them. K. Job analysis. A detailed statement of work behaviors and other information relevant to the job. L. Job description. A general statement of job duties and responsibilities. M. Knowledge. A body of information applied directly to the performance of a function. N. Labor organization. Any labor organization subject to the provisions of the Civil Rights Act of 1964, as amended, and any committee subject thereto controlling apprenticeship or other training. O. Observable. Able to be seen, heard, or otherwise perceived by a person other than the person performing the action. P. Race, sex, or ethnic group. Any group of persons identifiable on the grounds of race, color, religion, sex, or national origin. Q. Selection procedure. Any measure, combination of measures, or procedure used as a basis for any employment decision. Selection procedures include the full range of assessment techniques from traditional paper and pencil tests, performance tests, training programs, or probationary periods and physical, educational, and work experience requirements through informal or casual interviews and, inscored application forms. this statement expresses only the views of the signatory agencies concerning this important subject, the principles set forth below should serve as policy guidance for other Federal agencies as well. (1) Equal employment opportunity is the law of the land. In the public sector of our society this means that all persons, regardless of race, color, religion, sex, or national origin shall have equal access to positions in the public service limited only by their ability to do the job. There is ample evidence in all sectors of our society that such equal access frequently has been denied to members of certain groups because of their sex, racial, or ethnic characteristics. The remedy for such past and present discrimination is twofold. On the one hand, vigorous enforcement of the laws against discrimination is essential. But equally, and perhaps even more important are affirmative, voluntary efforts on the part of public employers to assure that positions in the public service are genuinely and equally accessible to qualified persons, without regard to their sex, racial, or ethnic characteristics. Without such efforts equal employment opportunity is no more than a wish. The importance of voluntary affirmative action on the part of employers is underscored by title VII of the Civil Rights Act of 1964, Executive Order 11246, and related laws and regulations-all of which emphasize voluntary action to achieve equal employment opportunity. As with most management objectives, a systematic plan based on sound organizational analysis and problem identification is crucial to the accomplishment of affirmative action objectives. For this reason, the Council urges all State and local governments to develop and implement results oriented affirmative action plans which deal with the problems so identified. The following paragraphs are intended to assist State and local governments by illustrating the kinds of analyses and activities which may be appropriate for a public employer's voluntary affirmative action plan. This statement does not address reme dies imposed after a finding of unlawful discrimination. (2) Voluntary affirmative action to assure equal employment opportunity is appropriate at any stage of the employment process. The first step in the construction of any affirmative action plan should be an analysis of the employer's work force to determine whether precentages of sex, race, or ethnic groups in individual job classifications are substantially similar to the precentages of those groups available in the relevant job market who possess the basic job-related qualifications. When substantial disparities are found through such analyses, each element of the overall selection process should be examined to determine which elements operate to exclude persons on the basis of sex, race, or ethnic group. Such elements include, but are not limited to, recruitment, testing, ranking certification, interview, recommendations for selection, hiring, promotion, etc. The examination of each element of the selection process should at a minimum include a determination of its validity in predicting job performance. (3) When an employer has reason to believe that its selection procedures have the exclusionary effect described in paragraph 2 of this section, it should initiate affirmative steps to remedy the situation. Such steps, which in design and execution may be race, color, sex, or ethnic "conscious," include, but are not limited to, the following: (a) The establishment of a long-term goal, and short-range, interim goals and timetables for the specific job classifications, all of which should take into account the availability of basically qualified persons in the relevant job market; (b) A recruitment program designed to attract qualified members of the group in question; (c) A systematic effort to organize work and redesign jobs in ways that provide opportunities for persons lacking "journeyman" level knowledge or skills to enter and, with appropriate training, to progress in a career field; (d) Revamping selection instruments or procedures which have not yet been validated in order to reduce or elimi |