Recommendations

Similar to the alerts dashboard, the recommendations panel lists the recommendations provided by the system, and the user can click on one of them to read further information about it.

Surveys

If the center has gathered information from satisfaction surveys, a summary of the results of these surveys is shown in this dashboard. It also shows the trend (whether positive or negative) using a color code so that users can easily identified whether patient perception has improved regarding a certain KPI.

Evaluation

The system has been evaluated at the residential center of Aravaca (Madrid, Spain), gathering a total of 7,473 events. The KPIs that have been identified as essential are the number of hourly events (avg.: 15.37), the average waiting time (351.15 secs), the average time required by the healthcare personnel (35.47 secs), the average time required by other processes (315.68 secs), the daily number of remote cancellations (avg.: 46.36), and the average number of available nurses (6.79).
During the pilot, we observed that the average waiting time during the night was much smaller (184.54 secs) than in other shifts, and most of the events took place in the evening shift (16.14 vs. 7.76 in the morning and 8.19 at night). Also, we conclude that there is a positive correlation between the number of events and the waiting time.
Regarding the floor number, we have seen that lower floors have more events and higher waiting times; further, the trend shows that as the floor number grows (from 1 to 4), the activity decreases.
The time frame between 8 p.m. and 1 a.m. is the busiest, showing that more personnel is required to attend the center's demand.
Additionally, we have considered satisfaction surveys as an additional validation mechanism. To ensure that the quality metrics match the surveys’ results, we have computed the Pearson R2 correlation between the satisfaction levels and the number of events and waiting times (see Table 1). As we expected, in almost every case, there is a strong inverse correlation, showing that more activity higher waiting times lead to less satisfied patients.
Table 1. Pearson R2 correlation coefficient over waiting time or activity with patients' satisfaction, grouped by shift and floor
ShiftFloorR2 (Waiting Time)R2 (Activity)
Morning1-0.791-0.320
2-0.5740.176
30.058-0.767
4-0.4560.147
Evening1-0.631-0.174
2-0.611-0.754
3-0.7200.070
4-0.928-0.404
Night1-0.733-0.524
2-0.910-0.163
3-0.841-0.266
40.032-0.539

Conclusions and future work

In this paper we have presented DataCare, an intelligent and scalable healthcare management system. DataCare is able to retrieve data from AdvantCare through sensors which are installed in healthcare center rooms and from contextual information.
The Data Processing and Analysis modules are able to preprocess, process, and analyze data in a scalable fashion. The system processes are implemented over Apache Spark, and as such they are able to work with big data, and all data (including historic, real-time, and consolidated and aggregated values) are stored in MongoDB.
The Analytics Engine, which is part of the aforementioned module, implements a three-fold intelligent behavior. First, it provides a prediction system which is able to estimate the values of the KPIs for the rest of the day. This system runs as a daily batch process, and the forecast is updated twice, at 8 a.m. and at 4 p.m., to provide more accurate results. Second, it can provide both real-time alerts and early alerts, with the latter ones being fired when some future prediction of a KPI falls outside the expected boundaries. Third, a recommendation system is able to provide weekly recommendations to improve the overall center performance and metrics, thus impacting in a positive manner patient satisfaction. Recommendations are based on alerts and a pre-defined rules set consisting of 52 rules, which has been designed by experts.
For the users to be able to see and understand the valuable information provided by DataCare, the Visual Analytics module provides six different dashboards which displays a summary of the current status, real-time KPIs along with predictions and expected thresholds, historic values, alerts, recommendations, and patients’ surveys results.
DataCare has been implemented and tested in a real pilot in the residential center of Aravaca (Madrid, Spain). To validate the software, patients’ satisfaction and KPI correlation were explored, obtaining the expected results. The software also led to some interesting conclusions regarding how KPIs vary depending on the context, such as the shift or the floor.
After the pilot, we worked to identify some improvements, which are left for future work. First, healthcare personnel attending patients are not identified by the system, even though the sensors used allow this identification with the use of RFID tags. By identifying personnel, the center could trace the efficiency of each employee individually. Also, information about planned tours is very limited as it only observes the visited rooms and the visit times, but no other metrics.
So far, DataCare polls the AdvantCare API REST to retrieve data, but in the near future we will update the platform so that the communication is asynchronous.
To evaluate the prediction system, we also propose to develop a self-monitoring system which evaluates the deviation between the predicted and the real series, firing an alert if this deviation goes above a threshold, as it would mean that the prediction system is failing to accurately forecast the KPI.

Acknowledgements

Special acknowledgements to WildBit Studios for the development and pilots of DataCare. This project is partially funded by the Spanish Ministry of Industry, Energy and Tourism in the “Economy and Digital Society Strategic Action” program, under reference number TSI100105-2014-62.

References

  1.  Curtwright, J.W.; Stolp-Smith, S.C.; Edell, E.S. (2000). "Strategic performance management: Development of a performance measurement system at the Mayo Clinic". Journal of Healthcare Management 45 (1): 58–68. PMID 11066953.
  2.  Griffith, J.R. (2000). "Championship management for healthcare organizations". Journal of Healthcare Management 45 (1): 17–30. PMID 11066948.
  3.  Ngai. E.W.T.; Poon, J.K.L.; Suk, F.F.C.; Ng, C.C. (2009). "Design of an RFID-based Healthcare Management System using an Information System Design Theory". Information Systems Frontiers 11 (4): 405–417. doi:10.1007/s10796-009-9154-3.
  4.  Ting, S.L.; Kwok, S.K.; Tsang, A.H.; Lee, W.B. (2011). "Critical elements and lessons learnt from the implementation of an RFID-enabled healthcare management system in a medical organization". Journal of Medical Systems 35 (4): 657–69. doi:10.1007/s10916-009-9403-5.
  5.  Jalal, A.; Kamal, S.; Kim, D. (2017). "A Depth Video-based Human Detection and Activity Recognition using Multi-features and Embedded Hidden Markov Models for Health Care Monitoring Systems".International Journal of Interactive Multimedia and Artificial Intelligence 4 (4): 54–62.doi:10.9781/ijimai.2017.447.
  6.  Ghamdi, H.A.; Alshammari, R.; Razzak, M.I. (2016). "An ontology-based system to predict hospital readmission within 30 days". International Journal of Healthcare Management 9 (4): 236–244.doi:10.1080/20479700.2016.1139768.
  7.  Bossen, C.; Danholt, P.; Ubbesen, M.B. et al. (2016). "Challenges of Data-driven Healthcare Management: New Skills and Work"19th ACM Conference on Computer-Supported Cooperative Work and Social Computing: 5.
  8.  Roberts, J.P.; Fisher, T.R.; Trowbridge, M.J.; Bent, C. (2016). "A design thinking framework for healthcare management and innovation". Healthcare 4 (1): 11–14. doi:10.1016/j.hjdsi.2015.12.002.PMID 27001093.
  9.  Basole, R.C.; Bodner, D.A.; Rouse, W.B. (2013). "Healthcare management through organizational simulation". Decision Support Systems 55 (2): 552–563. doi:10.1016/j.dss.2012.10.012.
  10.  Zeng, Q.L.; Li, D.D.; Yang, Y.B. (2013). "VIKOR method with enhanced accuracy for multiple criteria decision making in healthcare management". Journal of Medical Systems 37 (2): 9908.doi:10.1007/s10916-012-9908-1PMID 23377778.
  11.  Mohapatra, S. (2015). "Using integrated information system for patient benefits: A case study in India".International Journal of Healthcare Management 8 (4): 262–71. doi:10.1179/2047971915Y.0000000007.
  12.  Fortenberry Jr., J.L. (2015). "Internal marketing: A pathway for healthcare facilities to improve the patient experience". International Journal of Healthcare Management 9 (1): 28–33.doi:10.1179/2047971915Y.0000000014.
  13.  Minniti, M.J.; Blue, T.R.; Freed, D.; Ballen, S. (2016). "Patient-Interactive Healthcare Management, a Model for Achieving Patient Experience Excellence". Healthcare Information Management Systems. Springer. pp. 257–281. doi:10.1007/978-3-319-20765-0_16ISBN 9783319207650.
  14.  Baldominos, A.; Albacete, E.; Saez, Y.; Isasi, P. (2014). "A scalable machine learning online service for big data real-time analysis". 2014 IEEE Symposium on Computational Intelligence in Big Data.doi:10.1109/CIBD.2014.7011537.
  15.  Zaharia, M.; Chowdhury, M.; Franklin, M.J. et al. (2010). "Spark: Cluster computing with working sets".Proceedings of the 2nd USENIX Conference on Hot Topics in Cloud Computing: 10.
  16.  Zaharia, M.; Chowdhury, M.; Das, T. et al. (2012). "Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing". Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation: 2.

Notes

This presentation is faithful to the original, with only a few minor changes to presentation. Grammar has been updated for clarity. In some cases important information was missing from the references, and that information was added. The original article lists references alphabetically, but this version — by design — lists them in order of appearance.