APPENDIX 1: DATA LANDSCAPE

The charts below capture a sample of the analysis conducted by the performance and commercial working groups. They outline some of the key sources reviewed by the working group members; the metrics currently included in those sources and their use cases; as well as data and access gaps and limitations. While this information is not meant to be exhaustive, it offers a snapshot of some of the key data sources relevant to job quality and an understanding of how the working groups structured their analysis.

Data sources

Performance Data Landscape

WIOA Programs

Includes Adult, Dislocated Worker, Youth, Adult Education and Family Literacy Act, Employment Service, Vocational Rehabilitation, Native American, and Migrant and Seasonal Farmworker Programs

Metrics(s) Included Current Use Cases Data Limitations Access Limitations

Performance metrics include: Employment Rate 2nd Quarter and 4th Quarter after Exit, Median Earnings, Credential Attainment, Measurable Skills Gain, and 

Effectiveness in Serving Employers.  Data on demographics as well as barriers is also collected but not considered a performance metric. Information on services delivered is also collected as a participant moves through the program. 

Data are primarily used for state and local performance measurement for WIOA programs. Compliance influences the formula funding received by the workforce board. Each state is required to establish a “state adjusted level of performance” in the state plan. Indicators are identified in WIOA Section 116, but the levels are determined through negotiation between states and the Secretaries of Labor and Education.

 

Local workforce boards, and their Americas Job Center operators, collect and maintain the data.

Data collection is influenced by what is required in federal or state regulations. Collection is performed by service providers; who is enrolled and what data are collected is tied to what is incentivized. For example, the primary metric is placement, so service providers are disincentivized to enroll individuals who will not be placed quickly. Additionally, as information on only one barrier is required, not all data about an individual is routinely captured.  States can add additional collection requirements beyond what is included in the federal regulations. This results in variance by state.

 

Each local area or state has their own database. Roll up at the federal level is performed through data extracts using the Participant Individual Record Layout (PIRL) template. Some states publish data on a regular basis but when and how varies greatly.  DOL publishes data at the system and the state level each year.

Only individuals directly supporting the WIOA program or state administrators have direct access to the data as it includes participant demographics, contact information, and the details of the services received. Many states do not permit the use of an API (e.g. California), so data cannot be pushed to/pulled from the data system easily.  

Tags: Stability, Wage, Mobility

TANF

Metrics(s) Included

Current Use Cases

Data Limitations

Access Limitations

The primary performance metric is Work Participation Rate (WPR) which requires states to ensure that 50 percent of TANF-receiving families with a work-eligible adult – and 90 percent of families with two work-eligible adults – be engaged in a minimum number of hours of work or other qualifying activities. Some states have gone beyond the WPR and added additional performance measures for their state but this is not standardized across the country.  Common measures include new placements, ongoing employment, wages, wage gains, and employment retention.  Data on demographics is also collected but not considered a performance metric.  Information on services delivered, along with the individual’s eligibility status, are also collected as the participant moves through the program. 

Data are primarily used to ensure that individuals remain eligible for program services and secondarily to determine program outcomes.

 

Counties and TANF service providers collect and maintain the data. States and territories must provide information on families receiving and formerly receiving assistance for each sample month in a quarter. 

Data collection is influenced by what is required by federal or state regulations. Collection is performed by service providers; who is enrolled and what data are collected is tied to what is incentivized. For example, the primary metric is work participation rates, so service providers will regularly see individuals move on and off their caseload as they become ineligible.

 

Data extracts are sent quarterly to the US Department of Health and Human Services and Office of Family Assistance.  HHS publishes data at least annually. 

Program level data are limited to staff supporting TANF. States have access to wage data for verification purposes but are often limited in how they may use these data analytically. Additionally, many states do not have access to employment data for former TANF recipients.

Tags: Stability, Wage

SNAP/SNAP E+T

 

Metrics(s) Included

Current Use Cases

Data Limitations

Access Limitations

Primary performance measures include the number and percentage of current and former participants in unsubsidized employment AND their median quarterly earnings during the 2nd and 4th quarter after completion of participation in SNAP E&T; who completed a training, educational or work experience, or an on-the-job training component; or who fall within certain demographic criteria. Data on demographics is also collected but not considered a performance metric.  Information on services delivered, along with the individual’s eligibility status, are also collected as the participant moves through the program.   

Data are primarily collected to determine if the individual remains eligible for SNAP services and secondarily to track the performance of the program itself.

States administer SNAP; however, data are normally collected by a local provider.

Data collection is influenced by what is required in federal or state regulations. Collection is performed by service providers; who is enrolled and what data are collected is eligibility requirements. 

State data are transmitted to the federal government through required reporting. The Health and Human Services Office of Family Assistance collects and analyzes data on caseloads, expenditures, work participation, and more.  HHS provides reporting on trends system wide each year.

Program level staff supporting SNAP E+T for their area.

Each state is encouraged to develop their own system, and access is managed at the state level.

Tags: Stability, Wage, Mobility

For additional government survey-based data sources, refer to:

Additional Resources and Efforts Consulted