| |
Outcomes Evaluation
and Program Effectiveness
|
The measuring of outcomes and evaluating the effectiveness of programs is critical.
Measuring outcomes ensures that the program is making real change in the lives of participants.
It also provides the agency with the ability to continue to meet standards of Best Practice and ongoing quality assurance.
Each of Parent Trust for Washington Children’s programs has it’s own benchmarks for success (and related achievement rate) and measurement for
percentage of change related to the Outcomes.
Investing Time
Parent Trust for Washington Children has invested over 300 staff hours and resources consulting with leading evaluators and researchers to provide accurate
and thorough program outcome measures.
The agency currently measures all programs for
their effect on providing new skills and knowledge to create stronger families, ensure family bonding, create healthy early brain development in children, enhance early
learning and prevent child abuse and neglect.
Investing Resources
Parent Trust for Washington Children’s ongoing Outcomes Evaluations utilize survey’s filled out periodically by program participants.
These surveys measure critical Protective Factors that research has shown decreases the risk of maltreatment and dysfunction in the home:
- Increase of social support networks for the family
- Increase in applied family management skills and knowledge of normal child development
- Increase in life management skills
|
You can view Outcomes Effectiveness Data On Our Website. Full reports are PDF files.
Parent Education & Support Programs
Family Help Line
New and Expectant Parents Programs
Child/Teen Leadership & Support Program
|
Overview
Achievement Rate Goal: 60% of participants will increase their knowledge and skills to meet the minimum outcome goal.
Achievement Rate Results:
- 74% of participants in this program met or exceeded the minimum benchmark for an increase in their family management skills.
- 66% of participants in this program met or exceeded the minimum benchmark for an increase in their social support network.
- 68% of participants in this program met or exceeded the minimum benchmark for an increase in nurturing/healthy relationship.
Outcome Goal: Increase social support and family management skills by 10%.
Outcome Goal Results:
12 Sessions: Our outcome evaluations indicate that the parent/caregivers attending up to 12 group sessions report a minimum:
- 23% increase in family management skills
- 24% increase in nurturing/healthy relationships
- 23% increase in social supports.
13 to 24 Sessions:
- 29% increase in family management.
- 28% increase in nurturing/healthy relationships
- 27% increase in social supports.
back to top
Overview
Achievement Goals:
60% of participants will increase their knowledge/skills to meet the minimum outcome goal.
Achievement Results:
- 73% of participants reported an increase in knowledge of the parenting role and responsibilities.
- 86% of participants reported an increase in knowledge of age appropriate child development.
- 86% of participants reported an increase in knowledge of family management techniques.
Outcomes Goal: Participants will report at least a 10% average increase of goals.
Outcomes Results:
- 18% increase in knowledge of the parenting role and responsibilities.
- 23% increase in knowledge of age appropriate child development.
- 16% increase in knowledge of family management techniques.
back to top
Overview
Outcome Goal: Participants’ confidence will increase by 10%. (Confidence is scored on a scale of 1 to 5)
Outcome Goal Results:
- Average confidence ratings about the upcoming birth increased from 3.2 before class to 4.0 at the end of class, an increase of 28%.
- Average confidence about breastfeeding increased 3.1 to 4.1, a 32% increase.
back to top
Overview
Achievement Rate Goal: 60% of participants will increase their knowledge/skills to meet the minimum outcome.
Achievement Rate Results:
Participants show significant increases in risk-reducing Protective Factors.
- 77% of participants in this program met the minimum benchmark increase of 10% or more in their family management skills.
- 72% of participants in this program met the minimum benchmark increase of 10% or more in nurturing/healthy relationships in their family.
- 69% of participants in this program met the minimum benchmark increase of 10% or more in their social support network.
Outcome Goal: Participants will increase and maintain knowledge/skills by 10%.
Outcome Goal Results:
Our outcome evaluations indicate that the parent/caregivers attending up to 12 group sessions report a minimum:
- 21%* increase in family management skills.
- 21%* increase in nurturing/healthy Relationships
- 21%* increase in social support
13 to 24 Sessions:
- 28%* increase in family management skills.
- 26%* increase in nurturing/healthy Relationships
- 25%* increase in social support
25 or more Sessions:
- 33%* increase in family management skills.
- 33%* increase in nurturing/healthy Relationships
- 33%* increase in social support
* = Statistical significance at p < 0.001 " (very strong evidence that results are statistically significant)
Outcomes Data Tested for Statistical Significance: Outcomes data for parent programs have been t- tested for statistical significance. A t-test assesses probability levels, whether the mean differences between samples (pre and post) are statistically significant and not due to chance. The parent mutual-support and education data indicates that the probability of chance (p-value) for all the data samples from 2003 to 2007 is below .05 – therefore, we can conclude that there is a significant difference between the means (pre and post).
back to top
Overview
Achievement Rate Goal: 60% of the participants will increase their knowledge/skills to meet the minimum outcome goal of 10%..
Achievement Rate Results:
- 95.4 % of IPTS parents/caregivers reported at least a 10% increase in their non-punitive discipline and guidance knowledge
Outcome Goal: Participants will increase knowledge/skills by 10%.
Outcome Results:
Up to 12 sessions of Intensive Parent Training and Support services (8 sessions average)
- After an average of 8 sessions, parents reported an 18.1% increase in skills/knowledge in the outcome “Increase use of non-punitive discipline and guidance”.
From 13 or more sessions of Intensive Parent Training and Support services (34 sessions average):
- After an average of 34 sessions, parents reported a 36.3% increase in skills/knowledge in the outcome “Increase use of non-punitive discipline and guidance”.
back to top
Overview
Results of a 2006 study of 7,710 Missouri children who participated in Parents as Teachers and other early childhood experiences clearly shows that Parents as Teachers not only predicts children’s school readiness, but that it also predicts third grade achievement regardless of income level.
Adapted from “The Parents as Teachers program: its impact on school readiness and later school achievement”.
Results:
- 88% of children in high poverty schools who participated in at least two years of Parents as Teachers and one year of preschool scored above the lowest levels of the third grade MAP communications arts test.
- 85% of children in high poverty schools who participated in Parents as Teachers only (no preschool) scored above the lowest levels of the third grade MAP communications arts test.
- 84% of children in high poverty schools who participated in some Parents as Teachers and preschool scored above the lowest levels of the third grade MAP communications arts test.
- 79% of children in high poverty schools who attended preschool only and 77% of children in high poverty schools who had neither PAT nor preschool scored above the lowest levels of the third grade MAP communications arts test.
back to top
Overview
Achievement Rate Goal: 60% of participants will increase their new skills.
Achievement Rate Results: Participants show significant increases in risk-reducing Protective Factors:
- 95% of callers met the minimum benchmark increase of 10% or more in knowledge of parenting skills (positive parenting and stress management techniques).
- 84% of callers met the minimum benchmark increase of 10% or more in healthy, nurturing relationships (knowledge of ways to improve communication/ interactions with family members).
- 95% of callers met the minimum benchmark of 10% or more in responsive social supports (knowledge of key community resources/social supports).
Outcome Goal: Callers will increase knowledge by 10%.
Outcome Results: Callers participating in the evaluation reported a:
- 43% increase in knowledge of positive parenting and stress management techniques.
- 36% increase in knowledge of skills to improve communications and interactions with family members.
- 46% increase in knowledge of key community resources/social supports.
back to top
Overview
Achievement Rate Goal: 60% of parents surveyed will indicate a positive change in their child’s skills and/or environment to meet the minimum outcome goal.
Achievement Rate Results:
97% of the parents surveyed indicated at least a 10% positive change in both indicators. 63% of the parents surveyed indicated at least a 15% positive change in both indicators.
Environment: 100% of the parents surveyed indicated at least a 10% positive change. 73% of the parents surveyed indicated at least a 15% positive change in this indicator.
Role model: 88% of the parents surveyed indicated at least a 10% positive change. 64% of the parents surveyed indicated at least a 15% positive change.
Outcome Goal: Parents will indicate a minimum 10% increase in skills/behavior/positive environment for their child.
Outcome Goal Results: Parents surveyed reported:
- 13% average increase in pro-social behavior.
- My child helps other children
- My child interacts with peers in a positive way
- 14% average increase in access to a positive, healthy, environment for the child.
- 13% average increase in availability of caring, adult role model.
back to top
Overview
Achievement Rate Goal: 60% of participants will increase their knowledge/skills to meet the minimum outcome goal.
Achievement Rate Results: Participants show significant increases in risk-reducing protective factors:
- An average of 85% of teens surveyed report an increase in life skills
- An average of 87% of teen surveyed report an increase in social supports
Outcomes Goal: Participants will increase or maintain knowledge/skills by 10%
Outcomes Results:
- At 12 sessions, teens attending report ann average of:
- 14% increase in social supports
- 17% increase in life skills
- 13-38 Sessions:
- 29% increase in social supports
- 24% increase in life skills
- 33-99 Sessions:
- 19% increase in social supports
- 20% increase in life skills
- 100+ sessions:
- 19% increase in social supports
- 11% increase in life skills
back to top
|
|
