#Prepared4PA Pilot

Program Evaluation

August 2021-April 2022

​

Onboarding Webinar

November 2, 2021

3pm ET

Meeting

Overview

Our topics today

1. Welcome
2. Objectives
3. CAEL / QAC / PASSHE Roles
4. Competencies
5. Timeline
6. Evaluation Framework & Process
7. Expectations
8. What Next?
9. Questions

PASSHE Foundation Introduction

“Pennsylvania is a very diverse economy and society. It is actually a combination of new and old economies run by a multi-generational workforce. However, a new economy that is more automated and connected is emerging and it isn’t a matter of “if,” it’s a matter of “when.” The Commonwealth has an opportunity to develop 21st century strategy that better connects higher education and industry at different levels.”

Jim Fong, Chief Research Officer and Director

University Professional and Continuing Education Association

• The State System seeks to refresh its version and vision of public higher education and remains focused on fundamentally transforming its education and business models so that it can sustainably drive economic development and social mobility into the 21st century.
• Higher education is at a critical juncture and must leverage the opportunity to be part of the Commonwealth’s solution in building a vibrant economy and helping to foster a brighter future for our students.
• This evaluation is a critical part of the pilot process and will enhance our ability to secure ongoing funding and employer investments.
• This process will help us achieve transparency and hold us accountable to the desired outcomes – making these credentialing initiatives more viable across sectors.

Expectations & Spirit of the Evaluation

Programs are asked to answer questions candidly and thoughtfully.

The QA Commons strives to deliver evaluations that are accurate, formative, and practical.

Objectives

Project

• Building industry-education- workforce collaboratives
• Fostering stronger connections in the state’s workforce ecosystem
• Articulate the competencies, skills, and credentials required by employers
• Inform quality, robust, industry-validated training and education programs

Evaluation

• Evaluate curriculum alignment with industry competencies
• Evaluate the creation and fostering of effective partnerships with employees, workforce and/or other education providers to address workforce needs
• Begin to identify both challenges and promising practices in the implementation of the #Prepared4PA projects objectives

Who’s Who

​

​

​

​

​

​

​

​

​

​

Implementation

Evaluation

Sponsor

Facilitation

Competency Maps

• Designed to articulate employers’ requirements for competencies and credentials for in-demand occupations that will inform training and education programs designed to help build our talent pipeline
• A part of #Prepared4PA's efforts to bring together employers and educators to align competencies and skills needed for successful transitions in the workforce
• To be used as a resource when building pilot programs to train workers, job seekers, student to meet employers workforce needs
• Include personal effectiveness, academic, and workplace competencies

​

Technical Skill +

Soft Skills =

Success

QA Commons’ Pitch

When we think about training, soft skills can often be overlooked because they’re not as tangible as ‘hard skills’ like coding or operating machinery. But both types of skills are necessary to successfully perform and advance in most jobs.

Some Statistics

92% of executives consider soft skills and technical skills equally important. － Wall Street Journal�

89% of talent professionals said bad hires typically lack soft skills.

－ LinkedIn

​

75% of the long-term success in a given job role is based on a mastery of soft skills, and only 25% of that job success comes from technical skills. － Stanford Research Institute International

​

Nearly 75% of employers report difficulty hiring graduates with the “soft skills” they need. － Society for Human Resource Management

​

42% of new hires fail within 18 months due to a lack of soft skills.

－ Leadership IQ study

​

​

​

​

​

​

​

​

​

Timeline (to be adjusted as necessary)

Evaluation Framework

1. General Student Success
1. Enrollment/registration process is navigable
2. Course schedule accommodates working adults and non-traditional students
3. Students are actively engaged in course activities
4. Course delivery method is appropriate and effective for students and subject matter
5. Procedures in place to check-in with students and keep them connected and focused
2. Student Competency Preparation
• Program addresses and develops each grouping of the industry identified competencies
• The program articulates the proficiencies to students
• All students have multiple opportunities to apply learning in work-relevant contexts
3. Employer Engagement
• Employers engaged in developing/delivering/reviewing program outcomes and learning
• Clear mechanisms for employer feedback about students/graduates/program
• Program systematically uses employer information & feedback to continuously improve

​

​

​

​

​

​

​

​

Evaluation Process

• Answers to qualitative questions
• “Evidence” required for some answers�(Dropbox folders provided)
• Questions may be asked throughout
• Program submissions, along with employer and student feedback, to be scored and provided with formative feedback
• Meetings with programs to review report and process
• Summary report, with recommendations and noteworthy practices

​

​

​

​

​

​

​

​

Participant Resource Portal

All materials, as well as additional readings and resources, can be found on the QA Commons’ PASSHE participant portal

​

​

​

​

​

​

​

​

​

​

To access the portal, go to the bottom of any page on the QA Commons website and login with:

• Prepared4PA
• Pilot

What Next?

• Login to the participant portal
• Review the evaluation submission form!
• Consider starting a draft of the evaluation submission
• Reach out with questions anytime

​

​

​

​

​

​

​

​

Questions?