Help Improve the Model2018-09-20T05:53:26+00:00

Be a Part of the Open-Source Process

Models developed as part of IVI’s Open-Source Value Project serve as a hands-on “laboratory” for improving methods, resolving scientific questions, and engaging in an ongoing public discussion about value in healthcare. This iterative process is made possible by an ongoing public discussion about value in healthcare. This iterative process is made possible by an ongoing cycle of public feedback, expert review, revision, and re-release.

Everyone with a stake in how treatment value is measured and paid for in the U.S. health care system has a voice in the open-source development of IVI models. Feedback is welcome and encouraged, from the highly detailed, like suggestions such as how to fix a bug in the model’s source code to the big picture – like identifying important determinants of value that are currently missing from the model, for example, or proposing alternative approaches to value-based decision-making.

There are multiple ways to provide feedback and make recommendations to improve the value tools:

  • Submit Formal Comments During Open Comment Periods: Written comments, methodological feedback, and recommendations for additions or changes should be submitted in Word format to research@thevalueinitiative.org. All submitted comments will be made publicly available. Please include organizational letterhead, if applicable.
  • Modify the Source Code: To contribute directly to the development of the underlying model, click here access the source code and submit changes on the IVI GitHub page.
All feedback submitted during open comment periods will be reviewed by a panel of independent subject matter experts. The role of the Technical Expert Panel is to synthesize feedback and develop a prioritized list of recommended changes to the modeling platform, as well as areas for further research.

Based on the recommendations from the previous step, IVI researchers will implement changes and develop a “roadmap” for future revisions. As needed, IVI partners with patients and patient advocates, providers, external scientific teams, and others to implement changes.

A new version of each IVI value tool and the underlying model is released after recommended changes have been completed. These model releases are accompanied by documentation that includes the recommendations of the Technical Expert Panel, a summary of changes made to the model, and draft “roadmap” for future development. At this time, a new period of public feedback will begin, and the process will repeat.

The IVI Open-Source Development Process

Feedback Received on the IVI-RA Model

All feedback received on IVI’s Open-Source Value Project models is made publicly available. Public comments received on the initial IVI-RA model release is available below.

IVI received helpful feedback from a wide range of stakeholders prior to release, including detailed review of model methods and interface design. IVI received feedback in a variety of formats, including both informal discussions with patient advocates and clinicians, as well as formal written comments.

View Pre-Release Comments
IVI held an open feedback period on the initial IVI-RA model release. These comments, which represent a range of perspectives, are the basis for upcoming model revisions and will inform future iterations of both the IVI-RA model and future OSVP models. Click below to view these public comments.

View Public Comments

Public feedback received on the initial release of the IVI-RA model was reviewed by the RA Technical Expert Panel (TEP), an objective third party comprised of leaders in health economics, epidemiology, rheumatology, and patient communities. Based on public input, the TEP provided recommendations for revisions for version 2.0 of the IVI-RA model. Click below for a detailed report of the TEP’s feedback and recommendations and IVI’s plans for revision.


Timeline and Important Dates

  • Release of Version 1: November 8, 2017

  • Close of Public Feedback Period: February 16, 2018

  • Release of Version 2: Spring 2019