Nostalgia


If AI will ultimately be a reflection of ourselves, how it understand emotions we can’t describe to one another?View Web VersionRead/Hear Contributions

Abstract

Nostalgia is an installation that draws attention to the computational challenges of understanding the human emotion it refers to, and the disparities that lie in its individual and collective interpretations. Through affective computing and machine learning, the underlying system attempts to translate the components of the sentiment's qualitative makeup in quantitative terms. In Nostalgia, participants are asked to submit text-based memories, which are then used to calculate, predict and ultimately visualize relative nostalgia scores based on the aggregate of stories collected. However, given the ambiguities and complexity of human self-expression and the necessary precision of computational intelligence, Nostalgia highlights the entanglements of achieving emotional understanding between humans and machines.

Media

Overview

Nostalgia invites participants to share their stories, and in the process, engage in an inter- and intra-personal conversation about feelings of nostalgia. The installation is designed to ground our conceptual notions of nostalgia in participant interactions. First, participants are asked to enter a story or memory on a keyboard guided by a software user interface. Then, the computer tries to make sense of the story, reflecting its understanding through both a digital visualization and physical embodiment. Light-based sculptures are positioned in front of the keyboard entry pedestal, which change hue based on the nostalgic strength of participants' entries. In other words, through participant actions in the form of storytelling, the algorithmic system converts the qualitative affect of nostalgia to a quantitative digital and physical aesthetic representation. Metadata, like time and occupancy, are captured at the moment of submission to help the system predict the degree of nostalgia for future contributions. Some of the questions the installation seeks to answer are: How can we quantify feelings of nostalgia? Does our sense of nostalgia change as we gain awareness of it in real-time? Are we more likely to be nostalgic when we're around others? Are we humans so alike that we can begin to predict when and how nostalgia might arise?

When a participant submits a memory, the system computes a nostalgia score/index ranging from 0-100 based on an algorithmic model, which is driven by a machine learning algorithm that was trained with texts classified against the Southampton Nostalgia Scale coupled with IBM's Natural Language Understanding API. This nostalgia score is largely relative-the aggregate of stories submitted during the exhibition drives its weighting mechanism. As a result, its value serves as a reflection of its community of participants. Once an index has been determined, participants are able to see a visualized breakdown of the pre-defined factors that contributed to the score along with a timestamp and occupancy and virtual visitor. These components along with the written memory act as inputs into a multiple regression model, which attempts to predict how nostalgic the next contribution might be.

Many people in the Western world are familiar with the idiom "looking at the world through rose-colored glasses” (Doyle, 2001), and it has a scientific corollary known as Rosy Retrospection. This notion refers to the tendency for people to remember events and their experiences more fondly or positively than they evaluated them to be at the time of their occurrence (Mitchell, Thompson, Peterson, Cronk, 1997). It is in this vein that the work achieves its visual aesthetic referring literally to the word "rosy". Both its digital visualization and set of electro-mechanical sculptures demonstrate aspects of its computational understanding through color; stronger nostalgia scores correspond with rosier hues throughout.

References

Nostalgia Sculpture
Nostalgia Sculpture
Nostalgia UI
Nostalgia User Interface