Submissions will be evaluated according to the review criteria. The Federal Judges, in consultation with the Expert Advisors, will make the final selection.

Phase 1: Design

Problem Identification and Significance

  • How clearly and concisely does the proposal identify the problem and its significance to the target stakeholder group?
  • How prevalent is the stated problem?
  • How significant of a burden is the stated problem to the target stakeholder group?
  • How costly is the problem to the target stakeholder group?
  • How is this problem specific to the target stakeholder group, and therefore unlikely to be addressed by other initiatives targeting the general population?

Impact

  • How well will the proposed solution address the problem? 
  • How significantly will the proposed solution improve the quality of care, potentially save costs, and enhance CSHCN and family experiences?
  • How feasible is the plan to assess impact?
  • Does the proposal demonstrate the ability of the solution to reach various populations and different conditions? 

Evidence Base or Testing Method

  • How well does the provided evidence and background information support the ideas for the proposed solution?
  • How well does the proposal describe plans to collect evidence, test and validate the impact of the proposed solution in real world settings across stakeholder groups?

Innovation

  • How compelling is the case for innovation and interoperability?  Does the solution use nationally recognized health IT standards to integrate with other technology (e.g., Office of the National Coordinator (ONC) certification standards) in its functions? 
  • How likely is the proposed solution to succeed when other ideas to address similar problems have not?
  • Is the solution designed and developed using human centered design principles? Does the design support sustained use of the technology by the target stakeholder group?

Accessibility

  • How well does the proposal describe the target stakeholder group? 
  • Is the solution designed with CSHCN and families as the primary stakeholders?
  • How inclusive is the solution plan of other stakeholder and end-user groups with which the innovation would interface?
  • Does the proposal have broad applicability (i.e., across conditions, populations, health IT environments/technologies/platforms)?
  • Are the technical requirements of the proposed solution accessible (e.g., low-cost, plain language, device agnostic, etc.) to a broad range of socio-economically diverse populations?

Team Qualifications and Setting

  • Does the team include the necessary administrative, clinical, technical, and design expertise to complete the proposed project? Are CSHCN and/or their families members of the team?
  • Does the proposal include adequate input from the target stakeholder group and participatory design methods?
  • Does the team have support to accomplish the proposed project?

Project Potential in Remaining Phases

  • If the solution is a new or early-stage innovation, is the plan for later stages clearly described, and is it achievable given prize money and other available resources? 
  • How feasible is the proposal?

Phase 2: Development and Small-Scale Testing

Testing and Results

  • Can the solution be adapted to unexpected results or stakeholder feedback and experiences?
  • Is the plan for future development clearly described, and is it achievable given prize money and other available resources?
  • How well is the team meeting expected outcome or process measures?
  • How sustained is the interaction with the target stakeholder group?  Is the team demonstrating how the solution functions and addresses technical requirements (e.g., nationally recognized health information technology standards such as the ONC certification standards)?

Innovation

  • Does the evidence gathered suggest that the solution will be compelling to the target stakeholder group?  Will CSHCN and their families engage with the technology/innovation continually over an extended period of time?  
  • Does the solution demonstrate an interface that optimizes the stakeholder’s understanding of the issue and ease of use of the software?

Feasibility and Sustainability

  • How significant is the team’s progress? Is there enough evidence of success to suggest further development and evaluation will be successful? 
  • How appropriate is the team’s support and plan for continuing the solution’s development?

Phase 3: Scaling

Impact

  • How much potential does the solution have for making a large-scale impact on improving the quality and experiences of care for CSHCN and their families?
  • How much potential does the solution have for saving costs to families and the health care system?

Innovation

  • How significantly has prior work demonstrated the team’s ability to succeed at creating a viable, sustainable solution where others have not?
  • Overall, how promising is the solution in terms of potential for CSHCN, their families, health professionals, health care delivery systems, and payers buy-in?
  • How well was the team able to adapt the solution based on stakeholder feedback?

Accessibility

  • Has the team demonstrated the solution can be accessible (e.g., low-cost, plain language, device agnostic, etc.) to families from a broad range of socio-economically diverse populations?
  • Has the team demonstrated the solution is desired by the target stakeholder group?

Sustainability

  • Based on development and testing in the challenge, how viable is the solution for addressing the problem?
  • How well will the solution scale to various populations and different conditions?
  • How well has the team described next steps beyond the Challenge? How feasible are the steps?  
  • Are there incentives for CSHCN, their families and providers to continue to use this solution?