Costs of preparing to implement a virtual reality job interview training programme in a community mental health agency: A budget impact analysis

Matthew J. Smith*, Andrea K. Graham, Rachel Sax, E. Shawn Spencer, Lisa A. Razzano, Justin D. Smith, Neil Jordan

*Corresponding author for this work

Research output: Contribution to journalArticle

Abstract

Rational, aims and objectives: Individual Placement and Support (IPS) is an evidence based strategy for facilitating employment among adults with severe mental illness (SMI) where staff may lead mock job interviews to prepare clients for real-world interviews (a method with limited scalability and cost effectiveness). A virtual reality job interview training program (VR-JIT)—delivered via the internet—has demonstrated efficacy for increasing employment among adults with SMI. Now, VR-JIT is being implemented with a community mental health agency (CMHA) and evaluated for its effectiveness within IPS. This study is a budget impact analysis, evaluating the costs of preparing a CMHA to implement VR-JIT. Method: Implementation preparation occurred over 7 months from October 1, 2016 to April 30, 2017. CMHA staff (n = 15) and external research partners (n = 3) tracked their hours completing implementation preparation activities. Salaries plus a 28% fringe benefit rate were used to derive a per-hour salary amount for each individual and applied to each activity. Non-labor equipment costs were obtained from purchase receipts. A budget impact analysis evaluated the expenditures associated with preparing the CMHA to implement VRJIT. Results: The total implementation preparation costs equaled $25,482. Labor costs equaled $22,882 and non-labor costs equaled $2,600. In total, 655 person-hours were spent preparing for VR-JIT implementation (e.g., preparing lab space, training, and supervising operations). Conclusions: This study presents an initial evaluation of the budget impact of preparing to implement VR-JIT in a CMHA. Cost considerations for future implementation preparation will be discussed. Given that the cost to prepare to implement an intervention can hinder its adoption, results provide an important analysis for decision-makers that may enhance uptake. Future work will determine the cost-effectiveness of VR-JIT implemented within IPS. This study is registered at http://clinicaltrials.gov, NCT = 03049813, “Virtual Reality Job Interview Training: An Enhancement to Supported Employment in Severe Mental Illness.”.

Original languageEnglish (US)
JournalJournal of Evaluation in Clinical Practice
DOIs
StateAccepted/In press - Jan 1 2019

Fingerprint

Budgets
Mental Health
Interviews
Education
Costs and Cost Analysis
Salaries and Fringe Benefits
Cost-Benefit Analysis
Supported Employment
Decision Support Techniques
Health Expenditures
Equipment and Supplies
Research

Keywords

  • budget impact analysis
  • community mental health
  • health economics
  • implementation cost
  • virtual reality job interview training

ASJC Scopus subject areas

  • Health Policy
  • Public Health, Environmental and Occupational Health

Cite this

@article{dccc16548f5c48b8ae15e7c1dabec7ca,
title = "Costs of preparing to implement a virtual reality job interview training programme in a community mental health agency: A budget impact analysis",
abstract = "Rational, aims and objectives: Individual Placement and Support (IPS) is an evidence based strategy for facilitating employment among adults with severe mental illness (SMI) where staff may lead mock job interviews to prepare clients for real-world interviews (a method with limited scalability and cost effectiveness). A virtual reality job interview training program (VR-JIT)—delivered via the internet—has demonstrated efficacy for increasing employment among adults with SMI. Now, VR-JIT is being implemented with a community mental health agency (CMHA) and evaluated for its effectiveness within IPS. This study is a budget impact analysis, evaluating the costs of preparing a CMHA to implement VR-JIT. Method: Implementation preparation occurred over 7 months from October 1, 2016 to April 30, 2017. CMHA staff (n = 15) and external research partners (n = 3) tracked their hours completing implementation preparation activities. Salaries plus a 28{\%} fringe benefit rate were used to derive a per-hour salary amount for each individual and applied to each activity. Non-labor equipment costs were obtained from purchase receipts. A budget impact analysis evaluated the expenditures associated with preparing the CMHA to implement VRJIT. Results: The total implementation preparation costs equaled $25,482. Labor costs equaled $22,882 and non-labor costs equaled $2,600. In total, 655 person-hours were spent preparing for VR-JIT implementation (e.g., preparing lab space, training, and supervising operations). Conclusions: This study presents an initial evaluation of the budget impact of preparing to implement VR-JIT in a CMHA. Cost considerations for future implementation preparation will be discussed. Given that the cost to prepare to implement an intervention can hinder its adoption, results provide an important analysis for decision-makers that may enhance uptake. Future work will determine the cost-effectiveness of VR-JIT implemented within IPS. This study is registered at http://clinicaltrials.gov, NCT = 03049813, “Virtual Reality Job Interview Training: An Enhancement to Supported Employment in Severe Mental Illness.”.",
keywords = "budget impact analysis, community mental health, health economics, implementation cost, virtual reality job interview training",
author = "Smith, {Matthew J.} and Graham, {Andrea K.} and Rachel Sax and Spencer, {E. Shawn} and Razzano, {Lisa A.} and Smith, {Justin D.} and Neil Jordan",
year = "2019",
month = "1",
day = "1",
doi = "10.1111/jep.13292",
language = "English (US)",
journal = "Journal of Evaluation in Clinical Practice",
issn = "1356-1294",
publisher = "Wiley-Blackwell",

}

TY - JOUR

T1 - Costs of preparing to implement a virtual reality job interview training programme in a community mental health agency

T2 - A budget impact analysis

AU - Smith, Matthew J.

AU - Graham, Andrea K.

AU - Sax, Rachel

AU - Spencer, E. Shawn

AU - Razzano, Lisa A.

AU - Smith, Justin D.

AU - Jordan, Neil

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Rational, aims and objectives: Individual Placement and Support (IPS) is an evidence based strategy for facilitating employment among adults with severe mental illness (SMI) where staff may lead mock job interviews to prepare clients for real-world interviews (a method with limited scalability and cost effectiveness). A virtual reality job interview training program (VR-JIT)—delivered via the internet—has demonstrated efficacy for increasing employment among adults with SMI. Now, VR-JIT is being implemented with a community mental health agency (CMHA) and evaluated for its effectiveness within IPS. This study is a budget impact analysis, evaluating the costs of preparing a CMHA to implement VR-JIT. Method: Implementation preparation occurred over 7 months from October 1, 2016 to April 30, 2017. CMHA staff (n = 15) and external research partners (n = 3) tracked their hours completing implementation preparation activities. Salaries plus a 28% fringe benefit rate were used to derive a per-hour salary amount for each individual and applied to each activity. Non-labor equipment costs were obtained from purchase receipts. A budget impact analysis evaluated the expenditures associated with preparing the CMHA to implement VRJIT. Results: The total implementation preparation costs equaled $25,482. Labor costs equaled $22,882 and non-labor costs equaled $2,600. In total, 655 person-hours were spent preparing for VR-JIT implementation (e.g., preparing lab space, training, and supervising operations). Conclusions: This study presents an initial evaluation of the budget impact of preparing to implement VR-JIT in a CMHA. Cost considerations for future implementation preparation will be discussed. Given that the cost to prepare to implement an intervention can hinder its adoption, results provide an important analysis for decision-makers that may enhance uptake. Future work will determine the cost-effectiveness of VR-JIT implemented within IPS. This study is registered at http://clinicaltrials.gov, NCT = 03049813, “Virtual Reality Job Interview Training: An Enhancement to Supported Employment in Severe Mental Illness.”.

AB - Rational, aims and objectives: Individual Placement and Support (IPS) is an evidence based strategy for facilitating employment among adults with severe mental illness (SMI) where staff may lead mock job interviews to prepare clients for real-world interviews (a method with limited scalability and cost effectiveness). A virtual reality job interview training program (VR-JIT)—delivered via the internet—has demonstrated efficacy for increasing employment among adults with SMI. Now, VR-JIT is being implemented with a community mental health agency (CMHA) and evaluated for its effectiveness within IPS. This study is a budget impact analysis, evaluating the costs of preparing a CMHA to implement VR-JIT. Method: Implementation preparation occurred over 7 months from October 1, 2016 to April 30, 2017. CMHA staff (n = 15) and external research partners (n = 3) tracked their hours completing implementation preparation activities. Salaries plus a 28% fringe benefit rate were used to derive a per-hour salary amount for each individual and applied to each activity. Non-labor equipment costs were obtained from purchase receipts. A budget impact analysis evaluated the expenditures associated with preparing the CMHA to implement VRJIT. Results: The total implementation preparation costs equaled $25,482. Labor costs equaled $22,882 and non-labor costs equaled $2,600. In total, 655 person-hours were spent preparing for VR-JIT implementation (e.g., preparing lab space, training, and supervising operations). Conclusions: This study presents an initial evaluation of the budget impact of preparing to implement VR-JIT in a CMHA. Cost considerations for future implementation preparation will be discussed. Given that the cost to prepare to implement an intervention can hinder its adoption, results provide an important analysis for decision-makers that may enhance uptake. Future work will determine the cost-effectiveness of VR-JIT implemented within IPS. This study is registered at http://clinicaltrials.gov, NCT = 03049813, “Virtual Reality Job Interview Training: An Enhancement to Supported Employment in Severe Mental Illness.”.

KW - budget impact analysis

KW - community mental health

KW - health economics

KW - implementation cost

KW - virtual reality job interview training

UR - http://www.scopus.com/inward/record.url?scp=85074329037&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85074329037&partnerID=8YFLogxK

U2 - 10.1111/jep.13292

DO - 10.1111/jep.13292

M3 - Article

C2 - 31631470

AN - SCOPUS:85074329037

JO - Journal of Evaluation in Clinical Practice

JF - Journal of Evaluation in Clinical Practice

SN - 1356-1294

ER -