Current interactive, ubiquitous and wearable technology has the potential to revolutionize patient care and improve quality of life by assisting people in need. Many of the sensors and tracking devices that we can easily access nowadays can be used to support a variety of people and patients, providing easier access to information. In our research we investigate a variety of ubiquitous and multimodal technology such as digital pens, augmented reality devices (Google Glass, MS HoloLens), depth cameras (MS Kinect), eye-tracking and more, to support a variety of users undergoing specific health issues or needing assistance during their every day life.

Our research in this space investigates how a variety of wearable and ubiquitous copmputing devices can enhance personal information spaces and improve the condition of both individuals in need and health professionals. We believe that many diseases can benefit of these technologies and that by working closely with users, clients and patients, we have the extraordinary opportunity to make a difference and to increase their quality of life. We exploit multimodal interactions and ubiquitous computing to enhance assistive technology in the setting of aphasia, color-blindness, bruxism, locked-in syndrome, and others. We also create technology that can help other specific populations, such as older adults, children or infants.

Multimodal and Ubiquitous Technology for Healthcare

We are investigating a variety of ubiquotous and multimodal technology such as digital pens, augmented reality glasses (Google Glass, Microsoft HoloLens), depth cameras (Microsoft Kinect), Eye-tracking, Interactive Surfaces, and more, to support a variety of users undergoing specific health issues such as aphasia, color-blindess, bruxism, Locked-in Syndrome, Autism, etc.

  • Chroma
  • Write-n-Speak
  • EyeHome
  • BendableSound
  • CocoonCam
Funding

Towards a Multimodal Paper-Digital Infrastructure for Content Sharing and Collaboration for Health Care, Education and Social Interaction
(Swiss SNF  PA00P2_142066, August 2012 – January 2013)
A Multimodal Paper-Digital Infrastructure For Health Care Applications
(Swiss SNF PA00P2_136434, August 2011 – July 2012)
Ubiquitous Computing for Assistive Technology
(Moxie Foundation, January 2016 – December 2017)
Cocoon Cam, a Wearless Smart Baby Monitor
(NSF I-Corps Teams, June 2015 – Oct 2016)

Publications

  • [PDF] E. Tanuwidjaja, D. Huynh, K. Koa, C. Nguyen, C. Shao, P. Torbett, E. Colleen, and N. Weibel, “Chroma: A Wearable Augmented-Reality Solution for Color-Blindness,” in Proceedings of Ubicomp 2014, ACM International Joint Conference on Pervasive and Ubiquitous Computing, Seattle, WA, USA, 2014, pp. 799-810.
    [Bibtex]
    @inproceedings{tanuwidjaja2014chroma,
    address = {Seattle, WA, USA},
    area = {ubicomp_health},
    author = {Tanuwidjaja, Enrico and Huynh, Derek and Koa, Kirsten and Nguyen, Calvin and Shao, Churen and Torbett, Patrick and Colleen, Emmenegger and Weibel, Nadir},
    booktitle = {Proceedings of {Ubicomp} 2014, {ACM} {International} {Joint} {Conference} on {Pervasive} and {Ubiquitous} {Computing}},
    interhash = {17c0c8d1ba6e72dd9ae7bd7c09c0652f},
    intrahash = {a2148a03b51850a563daa50de1a96fd8},
    month = sep, pages = {799--810},
    projects = {chroma},
    title = {Chroma: {A} {Wearable} {Augmented}-{Reality} {Solution} for {Color}-{Blindness}},
    year = 2014
    }
  • [PDF] M. Erhart, A. Nguyen, R. Shivaswamy, B. Anderson, E. Colleen, and N. Weibel, “Personalized Multimodal Computer Interfaces For The Motor Impaired,” in Proceedings of PervasiveHealth 2016, International Conference on Pervasive Computing Technologies for Healthcare (Poster Track), Cancun, Mexico, 2016.
    [Abstract] [Bibtex]

    Severe motor disorders such as LIS and ALS are characterized by an inability to move or communicate effectively. Though it is essential to provide assistance to these groups, motor and cognitive function within these groups varies so widely that one static design cannot serve the group as a whole. Despite this variety, eye movements and brain functions are often under conscious control and can potentially be exploited for communication. We believe that to provide the most effective communication systems for individuals with progressive neurological disorders, it will be essential to create adaptive eye and biosignal computer interfaces that dynamically fit the changing abilities of the user as inexpensively as possible.

    @inproceedings{erhart2016personalized,
    abstract = {Severe motor disorders such as LIS and ALS are characterized by an inability to move or communicate effectively. Though it is essential to provide assistance to these groups, motor and cognitive function within these groups varies so widely that one static design cannot serve the group as a whole. Despite this variety, eye movements and brain functions are often under conscious control and can potentially be exploited for communication. We believe that to provide the most effective communication systems for individuals with progressive neurological disorders, it will be essential to create adaptive eye and biosignal computer interfaces that dynamically fit the changing abilities of the user as inexpensively as possible. },
    address = {Cancun, Mexico},
    area = {ubicomp_health},
    author = {Erhart, Matthew and Nguyen, Angie and Shivaswamy, Ruchika and Anderson, Brian and Colleen, Emmenegger and Weibel, Nadir},
    booktitle = {Proceedings of {PervasiveHealth} 2016, {International} {Conference} on {Pervasive} {Computing} {Technologies} for {Healthcare} ({Poster} {Track})},
    interhash = {72a5ab952e79a47f56a0b28913e36ba2},
    intrahash = {da9690207d20378516d700f19f91352a},
    month = may, projects = {eyehome, lis},
    title = {Personalized {Multimodal} {Computer} {Interfaces} {For} {The} {Motor} {Impaired}},
    year = 2016
    }
  • [PDF] A. M. Piper, N. Weibel, and J. D. Hollan, “Write-N-Speak: Authoring Multimodal Digital-Paper Materials for Speech-Language Therapy,” Acm transactions on accessible computing (taccess), 2011.
    [Bibtex]
    @article{piper2011writenspeak,
    area = {ubicomp_health},
    author = {Piper, Anne Marie and Weibel, Nadir and Hollan, James D.},
    interhash = {d1f249784bb6d5023b5a835f6bf39e02},
    intrahash = {e2ded67b082110f3440b13141d7c6a62},
    journal = {ACM Transactions on Accessible Computing (TACCESS)},
    month = nov, projects = {paper-digital, write-n-speak, multimodal},
    title = {Write-{N}-{Speak}: {Authoring} {Multimodal} {Digital}-{Paper} {Materials} for {Speech}-{Language} {Therapy}},
    year = 2011
    }
  • [PDF] A. M. Piper, N. Weibel, and J. D. Hollan, “Introducing Multimodal Paper-Digital Interfaces for Speech-Language Therapy,” in Proc. ASSETS 2010, 12th International ACM SIGACCESS Conference on Computers and Accessibility, Orlando, FL, USA, 2010, pp. 203-210.
    [Bibtex]
    @inproceedings{piper2010introducing,
    address = {Orlando, FL, USA},
    area = {ubicomp_health},
    author = {Piper, Anne Marie and Weibel, Nadir and Hollan, James D.},
    booktitle = {Proc. {ASSETS} 2010, 12th {International} {ACM} {SIGACCESS} {Conference} on {Computers} and {Accessibility}},
    interhash = {fc43a6eae9acba668e4053d95ea721d1},
    intrahash = {f6595674c5d63ba82c2dc978715e6167},
    month = oct, note = {Best Paper Award},
    pages = {203--210},
    projects = {write-n-speak, tap-and-play},
    title = {Introducing {Multimodal} {Paper}-{Digital} {Interfaces} for {Speech}-{Language} {Therapy}},
    year = 2010
    }
  • [PDF] L. Cibrian Franceli, M. Tentori, and N. Weibel, “A Musical Interactive Surface to Support the Multi-Sensory Stimulation of Children,” in Proceedings of PervasiveHealth 2016, International Conference on Pervasive Computing Technologies for Healthcare (Poster Track), Cancun, Mexico, 2016.
    [Bibtex]
    @inproceedings{cibrianfranceli2016musical,
    address = {Cancun, Mexico},
    area = {ubicomp_health},
    author = {Cibrian Franceli, Linney and Tentori, Monica and Weibel, Nadir},
    booktitle = {Proceedings of {PervasiveHealth} 2016, {International} {Conference} on {Pervasive} {Computing} {Technologies} for {Healthcare} ({Poster} {Track})},
    interhash = {41e9bf86bd0a53b7ebd31bf906707a0d},
    intrahash = {13c914475f4fa6ebb55e7497313aad36},
    month = may, projects = {kinect, bendablesound},
    title = {A {Musical} {Interactive} {Surface} to {Support} the {Multi}-{Sensory} {Stimulation} of {Children}},
    year = 2016
    }
  • L. Cibrian Franceli, N. Weibel, and M. Tentori, “Collective Use of a Fabric-based Musical Surface to Support Early Development in Toddler Classrooms,” in Proceedings of Ubicomp 2016, ACM International Joint Conference on Pervasive and Ubiquitous Computing, Heidelberg, Germany, 2016.
    [Abstract] [Bibtex]

    Music plays a crucial role in supporting the early development of toddlers. However, the interaction with live music inside toddler classrooms is rare and limited, as both toddlers and teachers lack of musical training and rapidly disengage when using musical instruments. In this paper, we hypothesize that interactive surfaces could facilitate the use of live music inside toddler classrooms. We evaluated the impact of BendableSound, a fabric-based musical surface that enables young children to play piano sounds. We conducted a 9-weeks deployment study where twenty-two toddlers and five teachers used BendableSound during free-play activities inside their classroom. Our results show BendableSound was successfully adopted and integrated into toddler classrooms, and could positively impact cognitive, social and physical development. These results offer implications for the design of deformable surfaces and for their integration into the activities to support the early development of toddlers.

    @inproceedings{cibrian2016collective,
    abstract = {Music plays a crucial role in supporting the early development of toddlers. However, the interaction with live music inside toddler classrooms is rare and limited, as both toddlers and teachers lack of musical training and rapidly disengage when using musical instruments. In this paper, we hypothesize that interactive surfaces could facilitate the use of live music inside toddler classrooms. We evaluated the impact of BendableSound, a fabric-based musical surface that enables young children to play piano sounds. We conducted a 9-weeks deployment study where twenty-two toddlers and five teachers used BendableSound during free-play activities inside their classroom. Our results show BendableSound was successfully adopted and integrated into toddler classrooms, and could positively impact cognitive, social and physical development. These results offer implications for the design of deformable surfaces and for their integration into the activities to support the early development of toddlers.},
    address = {Heidelberg, Germany},
    area = {ubicomp_health},
    author = {Cibrian Franceli, Linney and Weibel, Nadir and Tentori, Monica},
    booktitle = {Proceedings of {Ubicomp} 2016, {ACM} {International} {Joint} {Conference} on {Pervasive} and {Ubiquitous} {Computing}},
    interhash = {527c76ca76b5a636a6fcfc80f38c6937},
    intrahash = {db2be17cc284ff6a9bf6d4e6dadf7ce4},
    month = sep, note = {In Press},
    projects = {kinect, bendablesound},
    title = {Collective {Use} of a {Fabric}-based {Musical} {Surface} to {Support} {Early} {Development} in {Toddler} {Classrooms}},
    year = 2016
    }

Information Capture and Display in Time-critical Healthcare Settings

The goal of the project is to study the introduction of digital capture and display technology during trauma resuscitation. We aim at studying information currently available on paper forms and explore mechanisms to support situation awareness captured through digital pens and visualized on large room-based displays.

  • TraumaPen
  • TraumaGlass
Funding

Introducing Digital Pen and Wall Displays for Improving Resuscitation Team Performance. (NIH R21, LM011320-01A1)
(September 2012 – August 2014)

Publications

  • [PDF] D. Kusunoki, A. Sarcevic, N. Weibel, I. Marsic, Z. Zhang, G. Tuveson, and R. Burd, “Balancing Design Tensions in the Trauma Bay: Iterative Display Design to Support Ad Hoc and Interdisciplinary Medical Teamwork,” in Proceedings of CHI 2014, ACM Conference on Human Factors in Computing Systems, Toronto, Canada, 2014, pp. 3777-3786.
    [Bibtex]
    @inproceedings{kusunoki2014balancing,
    address = {Toronto, Canada},
    area = {ubicomp_health},
    author = {Kusunoki, Diana and Sarcevic, Aleksandra and Weibel, Nadir and Marsic, Ivan and Zhang, Zhan and Tuveson, Genevieve and Burd, Randall},
    booktitle = {Proceedings of {CHI} 2014, {ACM} {Conference} on {Human} {Factors} in {Computing} {Systems}},
    interhash = {8f325e83d985526eb6f205e90476e314},
    intrahash = {7ca7a8550e80c6c9f907a5c376f92337},
    month = apr, pages = {3777--3786},
    projects = {TraumaPen},
    title = {Balancing {Design} {Tensions} in the {Trauma} {Bay}: {Iterative} {Display} {Design} to {Support} {Ad} {Hoc} and {Interdisciplinary} {Medical} {Teamwork}},
    year = 2014
    }
  • [PDF] D. Kusunoki, A. Sarcevic, N. Weibel, and B. Randall, “Opportunities for Blended Interaction in Emergency Medicine: Coupling Displays with Digital Pen Input,” in Proceedings of PervasiveHealth 2013, International Conference on Pervasive Computing Technologies for Healthcare (Poster Track), Venice, Italy, 2013, pp. 288-289.
    [Bibtex]
    @inproceedings{kusunoki2013opportunities,
    address = {Venice, Italy},
    area = {ubicomp_health},
    author = {Kusunoki, Diana and Sarcevic, Aleksandra and Weibel, Nadir and Randall, Burd},
    booktitle = {Proceedings of {PervasiveHealth} 2013, {International} {Conference} on {Pervasive} {Computing} {Technologies} for {Healthcare} ({Poster} {Track})},
    interhash = {ac571d4aa44f92e67cef4a05c39159a8},
    intrahash = {5e7e8063b04f3cffc1b982ced5d1cc91},
    month = may, pages = {288--289},
    projects = {traumapen},
    title = {Opportunities for {Blended} {Interaction} in {Emergency} {Medicine}: {Coupling} {Displays} with {Digital} {Pen} {Input}},
    year = 2013
    }
  • [PDF] A. Sarcevic, N. Weibel, J. D. Hollan, and R. Burd, “TraumaPen: A Paper-Digital Interface for Information Capture and Display in Time-Critical Medical Work,” in Proc. Pervasive Health 2012, International Conference on Pervasive Computing Technologies for Healthcare, 2012, pp. 17-24.
    [Bibtex]
    @inproceedings{sarcevic2012traumapen,
    area = {ubicomp_health},
    author = {Sarcevic, Aleksandra and Weibel, Nadir and Hollan, James D. and Burd, Randall},
    booktitle = {Proc. {Pervasive} {Health} 2012, {International} {Conference} on {Pervasive} {Computing} {Technologies} for {Healthcare}},
    interhash = {8fbe5f27f7242896720958e9a7ddd1d6},
    intrahash = {4dd488103fdcea3647d625c57f9fa97f},
    month = may, pages = {17--24},
    projects = {traumapen},
    title = {{TraumaPen}: {A} {Paper}-{Digital} {Interface} for {Information} {Capture} and {Display} in {Time}-{Critical} {Medical} {Work}},
    year = 2012
    }

Pen and Paper Language Learning

The goal of the project is to study multimodal paper-digital interactions for health care applications education and social interactions, and develop an infrastructure to support educators, end-users, therapists and health professionals during their interactions, as well as support content sharing across them.

  • Tap-and-Play
  • Audio-enhanced Paper Photos
Funding

Towards a Multimodal Paper-Digital Infrastructure for Content Sharing and Collaboration for Health Care, Education and Social Interaction
(Swiss SNF  PA00P2_142066, August 2012 – January 2013)
A Multimodal Paper-Digital Infrastructure For Health Care Applications
(Swiss SNF PA00P2_136434, August 2011 – July 2012)

Publications

  • [PDF] A. M. Piper, N. Weibel, and J. D. Hollan, “Designing Audio-Enhanced Paper Photos for Older Adult Emotional Wellbeing,” International journal of human-computer studies, 2014.
    [Bibtex]
    @article{piper2014designing,
    area = {ubicomp_health},
    author = {Piper, Anne Marie and Weibel, Nadir and Hollan, James D.},
    interhash = {d515bcd8edb9d305b4dd0d5df0532c64},
    intrahash = {d7eab607b6238991c0bdf5ad8fbcd8af},
    journal = {International Journal of Human-Computer Studies},
    month = jan, projects = {tap-and-play},
    title = {Designing {Audio}-{Enhanced} {Paper} {Photos} for {Older} {Adult} {Emotional} {Wellbeing}},
    year = 2014
    }
  • [PDF] A. M. Piper, N. Weibel, and J. D. Hollan, “Audio-Enhanced Paper Photos: Encouraging Social Interaction at Age 105,” in Proceedings of CSCW 2013, 2013.
    [Bibtex]
    @inproceedings{piper2013audioenhanced,
    area = {uboicomp_health},
    author = {Piper, Anne Marie and Weibel, Nadir and Hollan, James D.},
    booktitle = {Proceedings of {CSCW} 2013},
    interhash = {fed45d3ddfe4651ffcd0c929a0eca930},
    intrahash = {8151806f83fbb99c33901893b7c83a17},
    month = feb, projects = {tap-and-play},
    title = {Audio-{Enhanced} {Paper} {Photos}: {Encouraging} {Social} {Interaction} at {Age} 105},
    year = 2013
    }
  • [PDF] A. M. Piper, N. Weibel, and J. D. Hollan, “A Pen-Based Toolkit for Authoring Collaborative Language Activities,” in Extended Abstracts of CSCW 2012, 2012.
    [Bibtex]
    @inproceedings{piper2012penbased,
    area = {ubicomp_health},
    author = {Piper, Anne Marie and Weibel, Nadir and Hollan, James D.},
    booktitle = {Extended {Abstracts} of {CSCW} 2012},
    interhash = {55b518677c38ff3e4f7800628bfcd3aa},
    intrahash = {0f7b31c6badc1fc3090cc163e499faf5},
    month = feb, projects = {Tap-and-play, paper-digital},
    title = {A {Pen}-{Based} {Toolkit} for {Authoring} {Collaborative} {Language} {Activities}},
    year = 2012
    }
  • [PDF] A. M. Piper, N. Weibel, and J. D. Hollan, “TAP & PLAY: An End-User Toolkit for Authoring Interactive Pen and Paper Language Activities,” in Proc. CHI 2012, ACM Conference on Human Factors in Computing Systems, Austin, TX, USA, 2012.
    [Bibtex]
    @inproceedings{piper2012enduser,
    address = {Austin, TX, USA},
    area = {ubicomp_health},
    author = {Piper, Anne Marie and Weibel, Nadir and Hollan, James D.},
    booktitle = {Proc. {CHI} 2012, {ACM} {Conference} on {Human} {Factors} in {Computing} {Systems}},
    interhash = {f6a1ced3cba9ba2e44fa51775e1f8492},
    intrahash = {9a0d4b4ecf2d155f9449df4984eb7527},
    month = may, note = {Interactivity},
    projects = {tap-and-play,paper-digital},
    title = {{TAP} \& {PLAY}: {An} {End}-{User} {Toolkit} for {Authoring} {Interactive} {Pen} and {Paper} {Language} {Activities}},
    year = 2012
    }
  • [PDF] A. M. Piper, N. Weibel, and J. D. Hollan, “Introducing Multimodal Paper-Digital Interfaces for Speech-Language Therapy,” in Proc. ASSETS 2010, 12th International ACM SIGACCESS Conference on Computers and Accessibility, Orlando, FL, USA, 2010, pp. 203-210.
    [Bibtex]
    @inproceedings{piper2010introducing,
    address = {Orlando, FL, USA},
    area = {ubicomp_health},
    author = {Piper, Anne Marie and Weibel, Nadir and Hollan, James D.},
    booktitle = {Proc. {ASSETS} 2010, 12th {International} {ACM} {SIGACCESS} {Conference} on {Computers} and {Accessibility}},
    interhash = {fc43a6eae9acba668e4053d95ea721d1},
    intrahash = {f6595674c5d63ba82c2dc978715e6167},
    month = oct, note = {Best Paper Award},
    pages = {203--210},
    projects = {write-n-speak, tap-and-play},
    title = {Introducing {Multimodal} {Paper}-{Digital} {Interfaces} for {Speech}-{Language} {Therapy}},
    year = 2010
    }

Archived Projects

Publications – Multimodal and Ubiquitous Technology for Healthcare

  • D. Gasques Rodrigues, A. Jain, S. Rick, P. Suresh, S. Liu, and N. Weibel, “Exploring mixed reality in specialized surgical environments,” in Proceedings of CHI 2017 (Late Breaking), ACM Conference on Human Factors in Computing Systems, Denver (CO), USA, 2017.
    [Abstract] [Bibtex]

    Recent technology advances in both Virtual Reality and Augmented Reality are creating an opportunity for a paradigm shift in the design of human-computer interaction systems. Delving into the Reality-Virtuality Continuum, we find Mixed Reality – systems designed to augment the physical world with virtual entities that embody characteristics of real world objects. In the medical field, Mixed Reality systems can overlay real-time and spatially accurate results onto a patient’s body without the need for external screens. The complexity of these systems previously required specialized prototypes, but newly available commercial products like the Microsoft HoloLens make the technology more available. Through a combination of literature review, expert analysis, and prototyping we explore the use of Mixed Reality in this setting. From the experience of prototyping HoloSim and Patiently, two applications for augmenting medical training and education, we outline considerations for the future design and development of virtual interfaces grounded in reality.

    @inproceedings{gasquesrodrigues2017exploring,
    abstract = {Recent technology advances in both Virtual Reality and Augmented Reality are creating an opportunity for a paradigm shift in the design of human-computer interaction systems. Delving into the Reality-Virtuality Continuum, we find Mixed Reality – systems designed to augment the physical world with virtual entities that embody characteristics of real world objects. In the medical field, Mixed Reality systems can overlay real-time and spatially accurate results onto a patient’s body without the need for external screens. The complexity of these systems previously required specialized prototypes, but newly available commercial products like the Microsoft HoloLens make the technology more available. Through a combination of literature review, expert analysis, and prototyping we explore the use of Mixed Reality in this setting. From the experience of prototyping HoloSim and Patiently, two applications for augmenting medical training and education, we outline considerations for the future design and development of virtual interfaces grounded in reality.},
    address = {Denver (CO), USA},
    area = {ubicomp_health},
    author = {Gasques Rodrigues, Danilo and Jain, Ankur and Rick, Steven and Suresh, Preetham and Liu, Shangley and Weibel, Nadir},
    booktitle = {Proceedings of {CHI} 2017 {(Late Breaking)},
    {ACM} {Conference on Human Factors in Computing Systems}},
    interhash = {d1b6296994e76496ed4c1253c5fd401b},
    intrahash = {078e221281064c5f05bf58cc3172f025},
    month = may, projects = {hololens, AR},
    title = {Exploring Mixed Reality in Specialized Surgical Environments},
    year = 2017
    }
  • [PDF] M. Erhart, A. Nguyen, R. Shivaswamy, B. Anderson, E. Colleen, and N. Weibel, “Personalized Multimodal Computer Interfaces For The Motor Impaired,” in Proceedings of PervasiveHealth 2016, International Conference on Pervasive Computing Technologies for Healthcare (Poster Track), Cancun, Mexico, 2016.
    [Abstract] [Bibtex]

    Severe motor disorders such as LIS and ALS are characterized by an inability to move or communicate effectively. Though it is essential to provide assistance to these groups, motor and cognitive function within these groups varies so widely that one static design cannot serve the group as a whole. Despite this variety, eye movements and brain functions are often under conscious control and can potentially be exploited for communication. We believe that to provide the most effective communication systems for individuals with progressive neurological disorders, it will be essential to create adaptive eye and biosignal computer interfaces that dynamically fit the changing abilities of the user as inexpensively as possible.

    @inproceedings{erhart2016personalized,
    abstract = {Severe motor disorders such as LIS and ALS are characterized by an inability to move or communicate effectively. Though it is essential to provide assistance to these groups, motor and cognitive function within these groups varies so widely that one static design cannot serve the group as a whole. Despite this variety, eye movements and brain functions are often under conscious control and can potentially be exploited for communication. We believe that to provide the most effective communication systems for individuals with progressive neurological disorders, it will be essential to create adaptive eye and biosignal computer interfaces that dynamically fit the changing abilities of the user as inexpensively as possible. },
    address = {Cancun, Mexico},
    area = {ubicomp_health},
    author = {Erhart, Matthew and Nguyen, Angie and Shivaswamy, Ruchika and Anderson, Brian and Colleen, Emmenegger and Weibel, Nadir},
    booktitle = {Proceedings of {PervasiveHealth} 2016, {International} {Conference} on {Pervasive} {Computing} {Technologies} for {Healthcare} ({Poster} {Track})},
    interhash = {72a5ab952e79a47f56a0b28913e36ba2},
    intrahash = {da9690207d20378516d700f19f91352a},
    month = may, projects = {eyehome, lis},
    title = {Personalized {Multimodal} {Computer} {Interfaces} {For} {The} {Motor} {Impaired}},
    year = 2016
    }
  • [PDF] M. Hussain and N. Weibel, “Can DiCoT Improve Infection Control? A Distributed Cognition Study of Information Flow in Intensive Care,” in Proceedings of CHI 2016, ACM Conference on Human Factors in Computing Systems (Work-in-Progress), San Jose, CA, USA, 2016.
    [Bibtex]
    @inproceedings{hussain2016dicot,
    address = {San Jose, CA, USA},
    area = {ubicomp_health},
    author = {Hussain, Mustafa and Weibel, Nadir},
    booktitle = {Proceedings of {CHI} 2016, {ACM} {Conference} on {Human} {Factors} in {Computing} {Systems} ({Work}-in-{Progress})},
    interhash = {59cb7256110cb01175049eda5f7c8b63},
    intrahash = {804c133c33b307cf6e557e3366ce7d3e},
    month = may, projects = {infection_control},
    title = {Can {DiCoT} {Improve} {Infection} {Control}? {A} {Distributed} {Cognition} {Study} of {Information} {Flow} in {Intensive} {Care}},
    year = 2016
    }
  • N. Weibel and J. Favela, PervasiveHealth ’16: Proceedings of the 10th International Conference on Pervasive Computing Technologies for Healthcare, New York, NY, USA: ACM, 2016.
    [Abstract] [Bibtex]

    Pervasive Health Conference is a premier international forum with specific focus on technologies and human factors related to the use of ubiquitous computing in healthcare and for wellbeing. The overall goal of the Pervasive Health Conference is to take a multidisciplinary approach to Pervasive Healthcare Technology research and development. The Pervasive Healthcare Community is addressing a broad scope of research topics and concerns: identify and understand problems from a technological, social, medical, and legal as well as financial perspective (with a particular emphasis on understanding and supporting patients’ and practitioners’ needs); design, implementation, and evaluation of supporting hardware and software infrastructures, algorithms, services and applications; and organizational strategies that facilitate integration of Pervasive Healthcare Technology into the healthcare enterprise

    @book{weibel2016pervasivehealth,
    abstract = {Pervasive Health Conference is a premier international forum with specific focus on technologies and human factors related to the use of ubiquitous computing in healthcare and for wellbeing. The overall goal of the Pervasive Health Conference is to take a multidisciplinary approach to Pervasive Healthcare Technology research and development. The Pervasive Healthcare Community is addressing a broad scope of research topics and concerns: identify and understand problems from a technological, social, medical, and legal as well as financial perspective (with a particular emphasis on understanding and supporting patients’ and practitioners’ needs); design, implementation, and evaluation of supporting hardware and software infrastructures, algorithms, services and applications; and organizational strategies that facilitate integration of Pervasive Healthcare Technology into the healthcare enterprise},
    address = {New York, NY, USA},
    area = {ubicomp_health, pervasive_sensing},
    author = {Weibel, Nadir and Favela, Jesus},
    interhash = {49df5a2314a607c549ff1d7d56fb74a0},
    intrahash = {67ba2f457781c6247a480c3c2c8549a3},
    month = may, note = {ISBN 978-1-XXXX-XXXX-X},
    publisher = {ACM},
    title = {{PervasiveHealth} '16: {Proceedings} of the 10th {International} {Conference} on {Pervasive} {Computing} {Technologies} for {Healthcare}},
    year = 2016
    }
  • [PDF] L. Cibrian Franceli, M. Tentori, and N. Weibel, “A Musical Interactive Surface to Support the Multi-Sensory Stimulation of Children,” in Proceedings of PervasiveHealth 2016, International Conference on Pervasive Computing Technologies for Healthcare (Poster Track), Cancun, Mexico, 2016.
    [Bibtex]
    @inproceedings{cibrianfranceli2016musical,
    address = {Cancun, Mexico},
    area = {ubicomp_health},
    author = {Cibrian Franceli, Linney and Tentori, Monica and Weibel, Nadir},
    booktitle = {Proceedings of {PervasiveHealth} 2016, {International} {Conference} on {Pervasive} {Computing} {Technologies} for {Healthcare} ({Poster} {Track})},
    interhash = {41e9bf86bd0a53b7ebd31bf906707a0d},
    intrahash = {13c914475f4fa6ebb55e7497313aad36},
    month = may, projects = {kinect, bendablesound},
    title = {A {Musical} {Interactive} {Surface} to {Support} the {Multi}-{Sensory} {Stimulation} of {Children}},
    year = 2016
    }
  • [PDF] M. Hussain, J. Dewey, and N. Weibel, “Mitigating Medical Alarm Fatigue with Cognitive Heuristics,” in Proceedings of PervasiveHealth 2016, 10th International Conference on Pervasive Computing Technologies for Healthcare, Cancun, Mexico, 2016.
    [Bibtex]
    @inproceedings{hussain2016mitigating,
    address = {Cancun, Mexico},
    area = {ubicomp_health},
    author = {Hussain, Mustafa and Dewey, James and Weibel, Nadir},
    booktitle = {Proceedings of {PervasiveHealth} 2016, 10th {International} {Conference} on {Pervasive} {Computing} {Technologies} for {Healthcare}},
    interhash = {bce9383ae1badc983ca5dd24e85dab61},
    intrahash = {516a0f44d6dbb7b28d0ecebc7b2dfea7},
    month = may, note = {In Press},
    projects = {alarm_fatigue},
    title = {Mitigating {Medical} {Alarm} {Fatigue} with {Cognitive} {Heuristics}},
    year = 2016
    }
  • S. Hwang, S. Rick, E. Sayyari, D. Lenzen, and N. Weibel, “The signals of communicative efficiency and linguistic organization: findings from depth sensor skeleton tracking,” in Proceedings (Posters) of TISLR 12, 12th Theoretical Issues in Sign Language Research Conference, Melbourne, Australia, 2016.
    [Bibtex]
    @inproceedings{hwang2016signals,
    address = {Melbourne, Australia},
    area = {pervasive_sensing, ubicomp_health},
    author = {Hwang, So-One and Rick, Steven and Sayyari, Erfan and Lenzen, Dan and Weibel, Nadir},
    booktitle = {Proceedings ({Posters}) of {TISLR} 12, 12th {Theoretical} {Issues} in {Sign} {Language} {Research} {Conference}},
    interhash = {261d9d95076255248db58d346ef092a3},
    intrahash = {d03284b5ae707c41db108a93fded2d4b},
    month = jan, note = {In Press},
    projects = {gestures, sign-language},
    title = {The signals of communicative efficiency and linguistic organization: findings from depth sensor skeleton tracking},
    year = 2016
    }
  • L. Cibrian Franceli, N. Weibel, and M. Tentori, “Collective Use of a Fabric-based Musical Surface to Support Early Development in Toddler Classrooms,” in Proceedings of Ubicomp 2016, ACM International Joint Conference on Pervasive and Ubiquitous Computing, Heidelberg, Germany, 2016.
    [Abstract] [Bibtex]

    Music plays a crucial role in supporting the early development of toddlers. However, the interaction with live music inside toddler classrooms is rare and limited, as both toddlers and teachers lack of musical training and rapidly disengage when using musical instruments. In this paper, we hypothesize that interactive surfaces could facilitate the use of live music inside toddler classrooms. We evaluated the impact of BendableSound, a fabric-based musical surface that enables young children to play piano sounds. We conducted a 9-weeks deployment study where twenty-two toddlers and five teachers used BendableSound during free-play activities inside their classroom. Our results show BendableSound was successfully adopted and integrated into toddler classrooms, and could positively impact cognitive, social and physical development. These results offer implications for the design of deformable surfaces and for their integration into the activities to support the early development of toddlers.

    @inproceedings{cibrian2016collective,
    abstract = {Music plays a crucial role in supporting the early development of toddlers. However, the interaction with live music inside toddler classrooms is rare and limited, as both toddlers and teachers lack of musical training and rapidly disengage when using musical instruments. In this paper, we hypothesize that interactive surfaces could facilitate the use of live music inside toddler classrooms. We evaluated the impact of BendableSound, a fabric-based musical surface that enables young children to play piano sounds. We conducted a 9-weeks deployment study where twenty-two toddlers and five teachers used BendableSound during free-play activities inside their classroom. Our results show BendableSound was successfully adopted and integrated into toddler classrooms, and could positively impact cognitive, social and physical development. These results offer implications for the design of deformable surfaces and for their integration into the activities to support the early development of toddlers.},
    address = {Heidelberg, Germany},
    area = {ubicomp_health},
    author = {Cibrian Franceli, Linney and Weibel, Nadir and Tentori, Monica},
    booktitle = {Proceedings of {Ubicomp} 2016, {ACM} {International} {Joint} {Conference} on {Pervasive} and {Ubiquitous} {Computing}},
    interhash = {527c76ca76b5a636a6fcfc80f38c6937},
    intrahash = {db2be17cc284ff6a9bf6d4e6dadf7ce4},
    month = sep, note = {In Press},
    projects = {kinect, bendablesound},
    title = {Collective {Use} of a {Fabric}-based {Musical} {Surface} to {Support} {Early} {Development} in {Toddler} {Classrooms}},
    year = 2016
    }
  • [PDF] R. Cornejo, N. Weibel, M. Tentori, and J. Favela, “Promoting Active Aging with a paper-based SNS application,” in Proceedings of PervasiveHealth 2015, International Conference on Pervasive Computing Technologies for Healthcare, Istanbul, Turkey, 2015.
    [Bibtex]
    @inproceedings{cornejo2015promoting,
    address = {Istanbul, Turkey},
    area = {ubicomp_health},
    author = {Cornejo, Raymundo and Weibel, Nadir and Tentori, Monica and Favela, Jesús},
    booktitle = {Proceedings of {PervasiveHealth} 2015, {International} {Conference} on {Pervasive} {Computing} {Technologies} for {Healthcare}},
    interhash = {cf7f41f0d030afffa6773e27a5ae0ec4},
    intrahash = {19afca55c13e4a93445b56dd37b05afe},
    month = may, note = {In Press},
    projects = {Tlatosquetch},
    title = {Promoting {Active} {Aging} with a paper-based {SNS} application},
    year = 2015
    }
  • [PDF] E. Tanuwidjaja, D. Huynh, K. Koa, C. Nguyen, C. Shao, P. Torbett, E. Colleen, and N. Weibel, “Chroma: A Wearable Augmented-Reality Solution for Color-Blindness,” in Proceedings of Ubicomp 2014, ACM International Joint Conference on Pervasive and Ubiquitous Computing, Seattle, WA, USA, 2014, pp. 799-810.
    [Bibtex]
    @inproceedings{tanuwidjaja2014chroma,
    address = {Seattle, WA, USA},
    area = {ubicomp_health},
    author = {Tanuwidjaja, Enrico and Huynh, Derek and Koa, Kirsten and Nguyen, Calvin and Shao, Churen and Torbett, Patrick and Colleen, Emmenegger and Weibel, Nadir},
    booktitle = {Proceedings of {Ubicomp} 2014, {ACM} {International} {Joint} {Conference} on {Pervasive} and {Ubiquitous} {Computing}},
    interhash = {17c0c8d1ba6e72dd9ae7bd7c09c0652f},
    intrahash = {a2148a03b51850a563daa50de1a96fd8},
    month = sep, pages = {799--810},
    projects = {chroma},
    title = {Chroma: {A} {Wearable} {Augmented}-{Reality} {Solution} for {Color}-{Blindness}},
    year = 2014
    }
  • [PDF] G. Merchant, N. Weibel, K. Patrick, J. H. Fowler, G. J. Norman, A. Gupta, C. Servetas, K. Calfas, K. Raste, L. Pina, M. Donohue, and S. Marshall, “Click ‘Like’ to change your behavior: A mixed methods study of college students’ exposure to and engagement with Facebook content designed for weight-loss,” Journal of medical internet research, 2014.
    [Bibtex]
    @article{merchant2014click,
    area = {ubicomp_health, pervasive_sensing},
    author = {Merchant, Gina and Weibel, Nadir and Patrick, Kevin and Fowler, James H. and Norman, Greg J. and Gupta, Anjali and Servetas, Christina and Calfas, Karen and Raste, Ketaki and Pina, Laura and Donohue, Mike and Marshall, Simon},
    interhash = {996dc861e949864dae09f7dafa3fcea9},
    intrahash = {8de14708c12962d8fa44e43605ae3058},
    journal = {Journal of Medical Internet Research},
    month = may, projects = {smart, three-two-me},
    title = {Click '{Like}' to change your behavior: {A} mixed methods study of college students' exposure to and engagement with {Facebook} content designed for weight-loss},
    year = 2014
    }
  • [PDF] D. Kusunoki, A. Sarcevic, N. Weibel, I. Marsic, Z. Zhang, G. Tuveson, and R. Burd, “Balancing Design Tensions in the Trauma Bay: Iterative Display Design to Support Ad Hoc and Interdisciplinary Medical Teamwork,” in Proceedings of CHI 2014, ACM Conference on Human Factors in Computing Systems, Toronto, Canada, 2014, pp. 3777-3786.
    [Bibtex]
    @inproceedings{kusunoki2014balancing,
    address = {Toronto, Canada},
    area = {ubicomp_health},
    author = {Kusunoki, Diana and Sarcevic, Aleksandra and Weibel, Nadir and Marsic, Ivan and Zhang, Zhan and Tuveson, Genevieve and Burd, Randall},
    booktitle = {Proceedings of {CHI} 2014, {ACM} {Conference} on {Human} {Factors} in {Computing} {Systems}},
    interhash = {8f325e83d985526eb6f205e90476e314},
    intrahash = {7ca7a8550e80c6c9f907a5c376f92337},
    month = apr, pages = {3777--3786},
    projects = {TraumaPen},
    title = {Balancing {Design} {Tensions} in the {Trauma} {Bay}: {Iterative} {Display} {Design} to {Support} {Ad} {Hoc} and {Interdisciplinary} {Medical} {Teamwork}},
    year = 2014
    }
  • [PDF] A. M. Piper, N. Weibel, and J. D. Hollan, “Designing Audio-Enhanced Paper Photos for Older Adult Emotional Wellbeing,” International journal of human-computer studies, 2014.
    [Bibtex]
    @article{piper2014designing,
    area = {ubicomp_health},
    author = {Piper, Anne Marie and Weibel, Nadir and Hollan, James D.},
    interhash = {d515bcd8edb9d305b4dd0d5df0532c64},
    intrahash = {d7eab607b6238991c0bdf5ad8fbcd8af},
    journal = {International Journal of Human-Computer Studies},
    month = jan, projects = {tap-and-play},
    title = {Designing {Audio}-{Enhanced} {Paper} {Photos} for {Older} {Adult} {Emotional} {Wellbeing}},
    year = 2014
    }
  • [PDF] G. Merchant, L. Pina, M. Black, E. Bales, N. Weibel, W. Griswold, J. Fowler, and K. Patrick, “Online and face-to-face: How do ad-hoc and existing networks support weight-related behavior change in young adults?,” in Abstracts (Rapid Communication) of SBM 2014, Annual Meeting of the Society of Behavioral Medicine, Philadelphia, USA, 2014.
    [Bibtex]
    @inproceedings{merchant2014online,
    address = {Philadelphia, USA},
    area = {pervasive_sensing, ubicomp_health},
    author = {Merchant, Gina and Pina, Laura and Black, Michelle and Bales, Elizabeth and Weibel, Nadir and Griswold, William and Fowler, James and Patrick, Kevin},
    booktitle = {Abstracts ({Rapid} {Communication}) of {SBM} 2014, {Annual} {Meeting} of the {Society} of {Behavioral} {Medicine}},
    interhash = {4c6a874f02168989fc6e2fb915b0f5f8},
    intrahash = {d62b2dc557f1402e7614907cca1bfc30},
    month = apr, projects = {smart},
    title = {Online and face-to-face: {How} do ad-hoc and existing networks support weight-related behavior change in young adults?},
    year = 2014
    }
  • N. Weibel and J. D. Hollan, “Gesture and Action Recognition,” in Abstracts of ISGS 2014, International Society of Gestures Studies 6, San Diego, USA, 2014.
    [Bibtex]
    @inproceedings{weibel2014gesture,
    address = {San Diego, USA},
    area = {pervasive_sensing, ubicomp_health},
    author = {Weibel, Nadir and Hollan, James D.},
    booktitle = {Abstracts of {ISGS} 2014, {International} {Society} of {Gestures} {Studies} 6},
    interhash = {1c8cb58665055cb0eee6f772601d9b70},
    intrahash = {9a629404529a635a9bf2ee5e49489dd9},
    month = jul, note = {Panel on Sensing Technologies},
    projects = {gestures, sign-language},
    title = {Gesture and {Action} {Recognition}},
    year = 2014
    }
  • [PDF] D. Kusunoki, A. Sarcevic, N. Weibel, and B. Randall, “Opportunities for Blended Interaction in Emergency Medicine: Coupling Displays with Digital Pen Input,” in Proceedings of PervasiveHealth 2013, International Conference on Pervasive Computing Technologies for Healthcare (Poster Track), Venice, Italy, 2013, pp. 288-289.
    [Bibtex]
    @inproceedings{kusunoki2013opportunities,
    address = {Venice, Italy},
    area = {ubicomp_health},
    author = {Kusunoki, Diana and Sarcevic, Aleksandra and Weibel, Nadir and Randall, Burd},
    booktitle = {Proceedings of {PervasiveHealth} 2013, {International} {Conference} on {Pervasive} {Computing} {Technologies} for {Healthcare} ({Poster} {Track})},
    interhash = {ac571d4aa44f92e67cef4a05c39159a8},
    intrahash = {5e7e8063b04f3cffc1b982ced5d1cc91},
    month = may, pages = {288--289},
    projects = {traumapen},
    title = {Opportunities for {Blended} {Interaction} in {Emergency} {Medicine}: {Coupling} {Displays} with {Digital} {Pen} {Input}},
    year = 2013
    }
  • [PDF] A. M. Piper, N. Weibel, and J. D. Hollan, “TAP & PLAY: An End-User Toolkit for Authoring Interactive Pen and Paper Language Activities,” in Proc. CHI 2012, ACM Conference on Human Factors in Computing Systems, Austin, TX, USA, 2012.
    [Bibtex]
    @inproceedings{piper2012enduser,
    address = {Austin, TX, USA},
    area = {ubicomp_health},
    author = {Piper, Anne Marie and Weibel, Nadir and Hollan, James D.},
    booktitle = {Proc. {CHI} 2012, {ACM} {Conference} on {Human} {Factors} in {Computing} {Systems}},
    interhash = {f6a1ced3cba9ba2e44fa51775e1f8492},
    intrahash = {9a0d4b4ecf2d155f9449df4984eb7527},
    month = may, note = {Interactivity},
    projects = {tap-and-play,paper-digital},
    title = {{TAP} \& {PLAY}: {An} {End}-{User} {Toolkit} for {Authoring} {Interactive} {Pen} and {Paper} {Language} {Activities}},
    year = 2012
    }
  • [PDF] A. Sarcevic, N. Weibel, J. D. Hollan, and R. Burd, “TraumaPen: A Paper-Digital Interface for Information Capture and Display in Time-Critical Medical Work,” in Proc. Pervasive Health 2012, International Conference on Pervasive Computing Technologies for Healthcare, 2012, pp. 17-24.
    [Bibtex]
    @inproceedings{sarcevic2012traumapen,
    area = {ubicomp_health},
    author = {Sarcevic, Aleksandra and Weibel, Nadir and Hollan, James D. and Burd, Randall},
    booktitle = {Proc. {Pervasive} {Health} 2012, {International} {Conference} on {Pervasive} {Computing} {Technologies} for {Healthcare}},
    interhash = {8fbe5f27f7242896720958e9a7ddd1d6},
    intrahash = {4dd488103fdcea3647d625c57f9fa97f},
    month = may, pages = {17--24},
    projects = {traumapen},
    title = {{TraumaPen}: {A} {Paper}-{Digital} {Interface} for {Information} {Capture} and {Display} in {Time}-{Critical} {Medical} {Work}},
    year = 2012
    }
  • [PDF] A. M. Piper, N. Weibel, and J. D. Hollan, “A Pen-Based Toolkit for Authoring Collaborative Language Activities,” in Extended Abstracts of CSCW 2012, 2012.
    [Bibtex]
    @inproceedings{piper2012penbased,
    area = {ubicomp_health},
    author = {Piper, Anne Marie and Weibel, Nadir and Hollan, James D.},
    booktitle = {Extended {Abstracts} of {CSCW} 2012},
    interhash = {55b518677c38ff3e4f7800628bfcd3aa},
    intrahash = {0f7b31c6badc1fc3090cc163e499faf5},
    month = feb, projects = {Tap-and-play, paper-digital},
    title = {A {Pen}-{Based} {Toolkit} for {Authoring} {Collaborative} {Language} {Activities}},
    year = 2012
    }
  • [PDF] A. M. Piper, N. Weibel, and J. D. Hollan, “Write-N-Speak: Authoring Multimodal Digital-Paper Materials for Speech-Language Therapy,” Acm transactions on accessible computing (taccess), 2011.
    [Bibtex]
    @article{piper2011writenspeak,
    area = {ubicomp_health},
    author = {Piper, Anne Marie and Weibel, Nadir and Hollan, James D.},
    interhash = {d1f249784bb6d5023b5a835f6bf39e02},
    intrahash = {e2ded67b082110f3440b13141d7c6a62},
    journal = {ACM Transactions on Accessible Computing (TACCESS)},
    month = nov, projects = {paper-digital, write-n-speak, multimodal},
    title = {Write-{N}-{Speak}: {Authoring} {Multimodal} {Digital}-{Paper} {Materials} for {Speech}-{Language} {Therapy}},
    year = 2011
    }
  • [PDF] A. M. Piper, N. Weibel, and J. D. Hollan, “Introducing Multimodal Paper-Digital Interfaces for Speech-Language Therapy,” in Proc. ASSETS 2010, 12th International ACM SIGACCESS Conference on Computers and Accessibility, Orlando, FL, USA, 2010, pp. 203-210.
    [Bibtex]
    @inproceedings{piper2010introducing,
    address = {Orlando, FL, USA},
    area = {ubicomp_health},
    author = {Piper, Anne Marie and Weibel, Nadir and Hollan, James D.},
    booktitle = {Proc. {ASSETS} 2010, 12th {International} {ACM} {SIGACCESS} {Conference} on {Computers} and {Accessibility}},
    interhash = {fc43a6eae9acba668e4053d95ea721d1},
    intrahash = {f6595674c5d63ba82c2dc978715e6167},
    month = oct, note = {Best Paper Award},
    pages = {203--210},
    projects = {write-n-speak, tap-and-play},
    title = {Introducing {Multimodal} {Paper}-{Digital} {Interfaces} for {Speech}-{Language} {Therapy}},
    year = 2010
    }

Start typing and press Enter to search