| Course | PSY FPX 5140 Program Evaluation |
|---|---|
| Assessment | Assessment 2 |
| Paper type | Program evaluation design |
| Length | About 1,080 words, 5 pages |
| Format | APA 7 student paper |
| School | Capella University |
| Program | MS in Psychology |
| Updated | September 2026 |
Free sample paper for PSY FPX 5140 Assessment 2
Evaluating Summer Works With Its Own Lottery: An Evaluation Design With Questions Written From the Council's Decision, a Summative Purpose Declared, the Design Argued for Fit, Measures Priced in Burden, and Limits Stated
Student Name
Capella University
PSY FPX 5140: Program Evaluation
Instructor Name
Month Day, Year
Questions Written From Real Decisions
The evaluation begins from a decision. Next spring, the city council will decide whether to expand Summer Works from 300 to 500 slots, at an added cost of about 700,000 dollars a year. Council members have said they will support expansion if the program reduces youth violence, and several also want to know whether it helps participants in school. The agency wants to know whether mentoring works as intended. From those needs, the evaluation asks three questions. First, do youth offered a place in Summer Works have fewer violent-crime arrests in the 16 months after the program than similar youth not offered a place? Second, do they have better school attendance in the following fall semester? Third, do they work for pay the following summer at a higher rate? A fourth, process question asks how consistently mentor meetings and job supervision were delivered, because a null result would mean something different if the program was not delivered as designed. The evaluation does not ask whether participants enjoyed the program or whether employers were satisfied, although both are pleasant to know, because neither would change the council's decision.
Formative or Summative, Declared Not Blurred
The evaluation is summative: its main purpose is to judge whether the program achieves its intended outcomes, to inform a funding decision. Scriven (1991) distinguished formative evaluation, conducted to improve a program while it is running, from summative evaluation, conducted to judge its merit. Blurring the two is a common problem: an evaluator who is also helping staff improve the program mid-summer changes the program being judged. The process question provides formative information to the agency, but it is reported after the summer, and no mid-summer changes to the program are made on the basis of evaluation data.
Design Argued for Its Fit
The program already selects participants by lottery, because about 900 young people apply for 300 slots. That lottery creates a randomized comparison without denying services to anyone who would otherwise receive them: lottery winners form the treatment group, and applicants who were not selected form the comparison group. Because selection is random, the two groups should be similar in motivation, family circumstances, and prior behavior, which is the central problem in evaluating youth programs: youth who seek out jobs may differ from those who do not. Heller (2014) relied on a lottery of this kind in Chicago, where violent-crime arrests among youth offered jobs fell by more than two fifths, which provides both a precedent for the design and a benchmark for the results. Alternatives were considered and rejected. Comparing participants with youth from the same neighborhoods who did not apply would confuse the program's effect with differences between applicants and non-applicants. Comparing participants' arrests before and after the program would confuse the program's effect with aging and with changes in local crime. A lottery also has a practical advantage: it is already accepted by families and the council as a fair way to allocate scarce places, so using it for evaluation requires no change in how youth are chosen, only an agreement to collect the same data on those who were not chosen. The program's own lottery does the hardest part of the evaluation for free.
Measures Priced in Program Burden
Each measure is priced in the burden it places on youth, staff, and partners. Arrests: juvenile and adult arrest records for all applicants, obtained through a data-sharing agreement with the police department and the juvenile court. Burden on youth: none. Burden on partners: one data request per year and legal review of the agreement, about 40 hours. School attendance: fall semester attendance from the school district, through an existing agreement. Burden on youth: none; on the district, one data pull. Summer employment the following year: state wage records for applicants 16 and older, with consent obtained at application. Burden on youth: a consent line on the application form. Program delivery: mentor meeting logs, which mentors already keep, and site visits by the evaluator to 30 of 120 job sites. Burden on mentors: about ten minutes a week for logs; on sites, one hour-long visit. A participant survey was considered and limited to a single ten-minute questionnaire at the end of the summer, for participants only, because a survey of both groups would impose burden on non-winners who receive nothing and would likely have low response.
What the Design Cannot Establish
The design has limits that the council should know before it sees results. First, statistical power for the violence question is limited in one summer. If about 4 in 100 comparison youth are arrested for a violent crime over 16 months and the program reduced that by 43%, as in Chicago, the difference between 300 winners and 600 non-winners would probably not reach statistical significance. The evaluation therefore plans to pool two or three summers before drawing conclusions about violence, and it will say so in the first report. Pooling is possible because the lottery, the program, and the data sources will be the same each year, and the analysis plan, including the outcomes and the comparison, will be registered with the city before the first data are received so that it cannot be adjusted after results are seen. Second, the design estimates the effect of being offered a place, not of completing the program, since some winners will not attend. Third, it cannot say which component, the job, the wages, or the mentor, produced any effect, because all three are delivered together. Fourth, it cannot establish long-term outcomes such as graduation within the council's decision timeline. These limits do not make the evaluation weak; they define what its results will and will not mean, and stating them in advance prevents the council from reading a modest first-year result as proof that the program fails or succeeds.
Conclusion
The evaluation uses the program's existing lottery to compare winners with non-winners on violent-crime arrests, school attendance, and later employment, answering questions drawn from the council's decision. It is declared summative, it relies mostly on administrative records that impose little burden on youth, and it states that one summer will not be enough to answer the violence question with confidence.
References
Heller, S. B. (2014). Summer jobs reduce violence among disadvantaged youth. Science, 346(6214), 1219-1223. https://doi.org/10.1126/science.1257809
Scriven, M. (1991). Evaluation thesaurus (4th ed.). SAGE Publications.
The Capella PSY FPX 5140 Assessment 2 instructions
Assessment 2 in PSY FPX 5140 has you design an evaluation of the program modeled in Assessment 1. You write evaluation questions tied to a real decision, state whether the evaluation is formative or summative, pick a design that suits the questions and the setting and say why, select measures and data sources, consider the burden on participants and staff, address ethics and state the design's limitations. Rigor should match the decision being made. The logic model's weak links should guide the questions. Evaluation texts such as Rossi, Lipsey and Henry, and research using lotteries to evaluate youth programs support the design.
How the PSY-FPX5140 Assessment 2 example is put together
The document is arranged so that every later section can be checked against an earlier one. It opens with the users of the evaluation and the decisions in front of them, which is the anchor everything else is fastened to. The questions section follows, and each question is written beside the decision it serves, so a reader can see that nothing has been asked out of habit. A purpose section commits to formative or summative work and explains the consequences of that commitment for what the evaluation can claim. The design section proposes the approach, comparison or its absence, timing, data sources, and argues its fit rather than asserting it. The measurement section pairs each question with instruments or indicators and says what each will cost the program to collect. A limits and ethics section closes, covering consent, burden on participants, and what the design cannot establish.
Where the marks sit in the PSY FPX 5140 Assessment 2 scoring guide
Marks go to the evaluation questions, the declared purpose, the argument for the design, the measures and their burden, the ethics and the limits. Questions reach Distinguished when written from the decision the council must make, such as whether to expand the program next summer. Purpose scores higher when declared as summative or formative with reasons. The design earns credit when argued for fit, since the lottery creates comparable groups without denying anyone a place the city could have offered. Measures are judged on whether each is priced in time and effort for young people and site supervisors, not just listed. Ethics should cover consent for minors and data linking with schools and police. Limits should be stated plainly, including outcomes the data cannot capture. Distinguished designs are rigorous enough for the decision and realistic enough to run.
PSY FPX 5140 Assessment 2 help: mistakes that cost marks
Evaluation designs often begin with a method the writer likes, such as a satisfaction survey, and then look for questions it can answer. Another weakness is writing questions that no one needs answered, disconnected from any funding or program decision. The purpose is never declared, so the design tries to both improve and judge the program at once. Rigorous designs are proposed without asking whether the setting allows them. Measures are listed without their cost to participants, which leads to long surveys that young people will not complete. Consent for minors and data sharing with schools are overlooked. Limits are hidden. Tying each evaluation question to one weak link from the logic model, then choosing the lightest measure that answers it, keeps the design focused and prepares the stakeholder report in Assessment 3.
Get a PSY FPX 5140 Assessment 2 example written to your instructions
Forward the Assessment 2 instructions and scoring guide from your PSY FPX 5140 section, plus the program and the stakeholders you are designing for. The plan comes back aligned question by question inside 24-48h, and the first custom sample costs nothing. Bring the logic model from the previous assessment along if you have one; the design should grow out of it. The paper above is an original model document written by our desk, not a submitted student paper and not an official Capella University document.
More PSY FPX 5140 papers and MS in Psychology samples
- PSY FPX 5140 Assessment 1: Program Logic Model
- PSY FPX 5140 Assessment 3: Stakeholder Evaluation Report
- PSY FPX 5201 Assessment 2: Integrative Literature Review
- PSY FPX 5120 Assessment 2: Group Process Analysis
- PSY FPX 6010 Assessment 2: Teratogen Research Review
- PSY FPX 5110 Assessment 2: Individual Differences Paper
PSY FPX 5140 Assessment 2 questions, answered
How rigorous does the design have to be?
As rigorous as the decision justifies and the setting will bear. Randomized comparison is not the goal of every evaluation; it is one option whose cost has to be weighed against what the stakeholder needs to know and what the program can survive. Criteria reward a design argued as a trade-off, and penalize both unattainable rigor and rigor abandoned without discussion.
Can I evaluate a program I helped build?
You can, with the conflict named in the document and handled in the design. Insider knowledge makes the logic and the measures better; insider investment makes negative findings harder to plan for. Say plainly what your role is, build in a route for unwelcome results, and where possible give an outside reader a say in interpretation. Evaluators face this constantly, and naming it is the professional move.
Do I need to collect data for this assessment?
Typically not; the deliverable is usually the plan rather than its execution, and your courseroom documents confirm the format your section uses. That makes the design criteria unusually demanding, since nothing can be rescued later by interesting results. Where a section does require pilot data or a small collection, consent and participant protection obligations apply exactly as they would in any study.
Where can I find a free PSY FPX 5140 Assessment 2 sample paper?
This page presents the lottery-based evaluation design for the summer program, with questions written from the council's decision, a summative purpose declared, the design argued for fit and measures priced in burden.
How rigorous does the design need to be in PSY FPX 5140 Assessment 2?
Rigorous enough for the decision at stake. A funding decision about expansion needs a credible comparison group; a small improvement question may not.