https://www.dagstuhl.de/18441

October 28 – November 2 , 2018, Dagstuhl Seminar 18441

Data Physicalization

Organizers

Jason Alexander (Lancaster University, GB)
Petra Isenberg (INRIA Saclay – Orsay, FR)
Yvonne Jansen (CNRS-Sorbonne University – Paris, FR)
Bernice E. Rogowitz (Visual Perspectives – New York & Columbia University – New York, US)
Andrew Vande Moere (KU Leuven, BE)

For support, please contact

Dagstuhl Service Team

Documents

Dagstuhl Report, Volume 8, Issue 10 Dagstuhl Report
Aims & Scope
List of Participants
Shared Documents
DataBells [JPG]
TableOutside2 [jpg]
TableOutside1 [jpg]
d_IMG_4322 [JPG]
d_IMG_4307 [JPG]
20181031_104907 [jpg]
d_IMG_4311 [JPG]
d_IMG_4323 [JPG]
Dagstuhl's Impact: Documents available
Dagstuhl Seminar Wiki

(Use seminar number and access code to log in)

Summary

This executive summary gives a brief overview of the goals and agenda for our seminar.

Introduction

Among the earliest man-made artifacts are physical representations of semantic concepts. These "physicalizations" externalize numerical and abstract concepts, providing physical metaphors that allow us to reason, remember, and communicate. Physicalizations are created for many different purposes, or "intents." The sundial, for example, transforms shadows into a readable representation of time of day, the mercury thermometer transforms temperature into a displacement along a number line, and a scatterplot transforms the values of two variables into a form that allows the reader to interpret correlation. Our first data representations were based on natural objects, such as charcoal scraped onto walls or built from clay, or later, ink on paper. With the advent of computers, we've substituted physical representations with pixels on a computer screen. The resurgence of physicalization asks what we have lost in this transformation. Certainly, a computer-based visualization allows us to zoom an image, transform variables in real time, and to zoom through virtual computer-based world. However, these representations can sever the relationship to the natural world, depriving us of the touch, feel, and emotion that comes from interacting with real objects.

This Dagstuhl seminar brought together a diverse group of researchers and practitioners to explore the benefits and challenges of physicalization -- computer scientists trained in visualization, virtual reality and human-computer interaction; architects of virtual and augmented systems; perceptual and cognitive scientists; and artists and designers. Through interactive discussions and demonstrations, we explored physicalization, as a set of methodologies for representing data, for engaging audiences, and for artistic expression. There were no formal paper presentations. Instead, the work was done through interactive discussions, hands-on workshops, and interactive demonstrations outside the lecture hall. Figure 1 shows two examples of data physicalizations exhibited by our participants.

The Week at a Glance

Monday. After explaining various organization matters and formalities, the first day began with the physical construction of custom name badges. The hands-on session offered the first occasion to get to know each other, also by comparing the name badges themselves, then and during the whole duration of the seminar. After this session, each of the 40 participants gave a two-minute presentation of their achievements and interests in the field of physicalization. Some described their artistic creations based on data, some showed how mapping data onto physical dimensions enhanced data analysis. Others showed how scientists and artists collaborated to explain biological and physical principles through physicalization, or how principles of perception and cognition could be used to guide how data are effectively mapped onto visual dimensions. The electricity in the air was palpable; everyone realized that we were on the threshold of a new discipline. This energy drove the first deliverable for this seminar: Dagstuhl monograph, and perhaps a book, highlighting extended versions of these 40 contributions.

To allow a more focused approach towards yet unexplored research topics, the first activity focused on defining "pillars" of physicalization, crystallizing the learning and background of the different intellectual communities identified in our proposal. In break-out sessions, each group ideated around and then synthesized the most fundamental papers, examples, principles and challenges for their pillar, relative to physicalization. The Perception and Cognition Group focused on sensory processing, especially touch perception and embodied cognition, which deals with the way we learn about the world through our motor interactions with it. The Evaluation group shared their experiences in measuring human responses, and how methods might be extended to physicalization. The Design group explored artistic and design approaches to data physicalization. The Applications group identified existing and future application areas. The technology group surveyed the range of materials and devices for physicalization. In the reports-back, the group was encouraged to explore challenges and limitations for each of these core areas, to set the stage for the cross-disciplinary discussions beginning on Tuesday.

Tuesday. At the start the second day, each participant generated three questions for each of the five pillar areas. A massive exercise was undertaken wherein all these questions were organized and grouped into emergent categories. Spontaneous discussions started around the meaning and validity of the themes that emerged, as these would align the next round of thematic discussions (Figure 2). The "Design Patterns" group focused on identifying general templates for characterizing data physicalization. The "Emotion" group explored unique affordances that touching data enable. The Vis vs. Phys Group delved into the ways vision and touch were different, and what unique advantages that might enable. The "Critical" group explored the range of ethical and critical matters that could be related to physicalization practice in particular.

Wednesday. Wednesday morning was devoted to hands-on workshops where practitioners engaged small groups in interactive activities. Samuel Huron's group explored a set of physicalization examples, to identify common principles; Daniel Keefe demonstrated a virtual reality exploration of the human heart; Till Nagel, Laura Perovich, and Dietmar Offenhuber led a group into the forest to collect natural objects which they used to create physicalizations; Robert Friska provided surprising problem solving examples that drove a discussion about physical reasoning; Barbara Tversky showed examples of how physical gestures we make contribute to problem solving; Daniel Schneider led a workshop on computational embroidery, where the data are represented in yarn color and texture. By the time we piled into the bus for Trier, the large and diverse group of 40 had transformed into a dynamic community of scholars. Listening into the conversations, you could hear artists explaining how sculpture is taught in Art School, perceptual psychologists describing touch perception; and engineers revealing expertise on control systems for autonomous micro-robots.

Thursday. Thursday was the major work day. Building on the explorations of Tuesday, we divided into groups and worked on a variety of topics. One group, for example, focused on how to teach visualization and how to use data physicalization to teach other areas. Another group worked on a white paper on emotion and physicalization. Another worked on ideas for using physicalization for environmentally-situated projects. Another group focused on categorizing the critical considerations that emerged on Tuesday.

Friday. The final day aimed into transforming the progress of the past days into concrete contributions. For example, plans for a physicalization contest were discussed, ideas for the book of 40 contributions were pushed further, as well as on a special issue on physicalization for the Journal of Perceptual Imaging. Another group discussed the topic of scientific funding, among which the experience of past H2020 research proposals, and the potential of future research proposal initiatives that relate to physicalization.

Hands-on Demonstrations

The area outside the main conference room was populated with demonstrations provided by the participants. For example, Andrew Vande Moere brought a wireless, networked display that allowed participants to vote about particular topics that were shown; Volker Schweinsfurth, Daniel Schneider, and many others brought along and exhibited 3-D printed, hand-crafted, or even embroidered physicalizations. Bernice Rogowitz ran participants through several experiments around the topics of touch perception and touch/vision interactions. Section 4 details several of the hands-on experiences seminar participants and organizers could engage in; while Figure 3 shows the diversity of the physical artifacts that participants exhibited.

Summary text license
  Creative Commons BY 3.0 Unported license
  Jason Alexander, Petra Isenberg, Yvonne Jansen, Bernice E. Rogowitz, Andrew Vande Moere

Classification

  • Society / Human-computer Interaction

Keywords

  • Information visualization
  • Human-computer interaction
  • Data physicalization
  • Beyond-desktop visualization
  • Perception

Documentation

In the series Dagstuhl Reports each Dagstuhl Seminar and Dagstuhl Perspectives Workshop is documented. The seminar organizers, in cooperation with the collector, prepare a report that includes contributions from the participants' talks together with a summary of the seminar.

 

Download overview leaflet (PDF).

Publications

Furthermore, a comprehensive peer-reviewed collection of research papers can be published in the series Dagstuhl Follow-Ups.

Dagstuhl's Impact

Please inform us when a publication was published as a result from your seminar. These publications are listed in the category Dagstuhl's Impact and are presented on a special shelf on the ground floor of the library.