Applicants will be evaluated and rated by a peer review panel according to the review criteria outlined below.

Understanding of the Problem (20 points)

The applicant must demonstrate a clear understanding of comprehensive, communitywide strategies to create safe and drug-free schools and to promote healthy childhood development. Applicants should discuss how to apply state-of-the-art evaluation methods and models -- including collection of surveillance data and economic analyses -- to achieve evaluation objectives. Also, applicants should discuss any anticipated methodological challenges associated with this type of evaluation and describe proposed strategies for addressing these challenges. A thorough understanding of theory-driven evaluation, school-community collaboration to effect systems change and service delivery improvement, and rigorous cross-site outcome research on a national level is essential.

Goals and Objectives (10 points)

Applicants must specify goals and measurable objectives for coordinating and implementing this project consistent with the Initiative's goals and objectives. These should be guided by the requirements in this solicitation and should be clearly defined and attainable. The extent to which the proposed evaluation strategy will meet the established goals and objectives must be addressed.

Project Design (35 points)

In response to this solicitation, applicants must present a detailed and clear design for accomplishing all project goals and objectives (year 1-year 5). The applicant must include a timetable/workplan and detailed budget for accomplishing the goals and objectives and delivering the required products.

In presenting the project design, applicants must describe how they will carry out the major evaluation activities -- surveillance, process evaluation, and intensive outcome (including economic) evaluation -- and outline the research questions to be answered through each activity. More specifically, applicants must present a plan for the collection of a core set of surveillance data from all sites, including an indication of what this core set might include and a draft protocol to be used for data collection across all sites. Applicants must describe how they will work with the sites, as requested and as needed, to carry out local process evaluations.

With regard to the intensive outcome evaluation, applicants must present (1) a discussion of the educational, mental health, juvenile justice, and economic outcomes to be measured; (2) research design options, including appropriate comparison or control groups; (3) a clear plan for the selection of the subsample of sites; and (4) a discussion of proposed instrumentation. The overall project design must include both an evaluation of the comprehensive, integrated initiative as a whole and an assessment of all six program components implemented by the sites (see the Safe Schools/Healthy Students Initiative Program Announcement).

Applicants must describe how they plan to work with local evaluators to carry out all major types of evaluation activity. It is imperative that the proposed design foster a collaborative and supportive relationship among local site personnel, local evaluators, and the national evaluator. Finally, applicants must describe procedures for ensuring the confidentiality of all subjects.

Management and Organizational Capability (25 points)

The application must include a discussion of how the applicant will coordinate and manage this evaluation to achieve evaluation goals and objectives. The management plan should address how the evaluation activities will be coordinated with the local evaluators and the IEMT. The applicant's management structure and staffing must be adequate and appropriate for the successful implementation of the project and must contain appropriate expertise in all major evaluation areas. The applicant must identify responsible individuals and key consultants, their primary areas of expertise, their time commitment, and major tasks. The range of expertise represented by key staff and consultants should include significant experience in the following areas: evaluation of multisite, school-linked, community initiatives; evidence-based preventive interventions for violent behaviors; health or mental health; economics; and early childhood development. The applicant must demonstrate the ability to work effectively with school districts and with a range of agencies and service providers (including schools, early education programs, mental health agencies, and law enforcement agencies) to collect data and manage other requirements of the project. The application must describe a plan for coordinating evaluation efforts with the work of the technical assistance provider to the Initiative. Staff and key consultant résumés must be included in the appendixes.

Budget (10 points)

The applicant must provide a proposed budget that is complete, detailed, reasonable, allowable, and cost effective in relation to the activities to be undertaken during year 1. The budget must be comprehensive and should include costs such as support to local evaluators for collection of common cross-site surveillance and process data, any data collection by local evaluators as part of the intensive outcome analyses, and costs for collateral activities (e.g., the periodic convening of an advisory panel).

National Evaluation of the Safe Schools/ Healthy Students Initiative	Due Date: July 21, 1999