Research Articles

The Dematerializing Interface

Author: James Miller (Professor of Communications, School of Cognitive Science, Hampshire College in Amherst)

  • The Dematerializing Interface

    Research Articles

    The Dematerializing Interface

    Author:

Abstract

‘Media’ is coming to mean not the discrete, dedicated devices of old but functionalities that are increasingly available through non-media objects. The interface remains the form of access, inviting the use of media affordances, but its design grows more natural, demanding less of the user – especially because behind the interface are intelligent information machines that are able to anticipate the user’s desires.  These conditions in turn allow people to experience greater emotional and imaginative relations with media; together they form ‘assemblages’ of embodied and extended cognition. The automobile is used as a case study of this transformation, which poses difficult challenges for a material approach to media studies.

Keywords: mediatization of the automobile, material analysis of media, interface, New media

How to Cite:

Miller, J., (2015) “The Dematerializing Interface”, Westminster Papers in Communication and Culture 10(1), 66-80. doi: https://doi.org/10.16997/wpcc.213

1959 Views

426 Downloads

3Citations

Published on
15 Sep 2015
Peer Reviewed

Patrick Joyce and Tony Bennett (2010, 7) celebrate, ‘a material turn’ in history and the social sciences, claiming it to ‘be the most important of all the recent intellectual turns.’ The earlier ones – cultural, linguistic, literary, textual – all share, as Dan Hicks and Mary Beaudry (2010, 1–2) put it, a ‘representational logic’. In contrast, materially oriented analysis examines how

the affordances of material things translate human intentions and shape human uses; human persons shape themselves in constant, active or passive interaction with a world of humanized things; and persons, too, operate in part as things in a world formed of things, texts, codes, regulations, spatial environments, institutions, frames of understanding and action, bodies, reflexive knowledges and the accumulated weight of the interaction over time of all these materials of the world (Frow 2010, 86).

Applied to media studies, a material approach attends necessarily to the physicality of media. One large-scale example is recent investigations of media buildings. Lynn Spigel examines the influence of 1950s modernism on the construction of TV network production centers in Los Angeles, which employed well-known architects to produce award-winning designs in the service of CBS’s and NBC’s corporate image. Spigel (2008, 112) says that these futuristic buildings forced audiences and sponsors alike to view nascent television as ‘a distinctly new media site.’ The Swedish Media Houses project (Ericson and Riegert 2010) studies broadcasting and digital media headquarters whose design is conceived as an expression of their claim to be a socially central institution. The project’s analyses include the 1932 BBC Broadcasting House in London, just prior to its recent massive renovation and expansion; Frank Gehry’s 2007 IAC (InterActiveCorp) building in New York City; and Rem Koolhaas’s 2012 CCTV (China Central Television) headquarters in Beijing. Aurora Wallace does something similar, focusing mainly on late-nineteenth and early-twentieth century New York City print media buildings. Like Spigel, but at an earlier historical time, Wallace (2012, 8) understands that mid-nineteenth century New York City dailies believed ‘architecture was a necessary tool of communication’ about their own importance, power and wealth.

Analysis of present-day American daily newspaper headquarters, however, would tell quite another story. Steady declines in readership and advertising have left many American newspapers with sometimes elegant buildings too expensive to operate – or whose downtown real estate value is far greater than the news they have produced for generations. Recent sales of US newspaper headquarters buildings include the Seattle Times, the Des Moines Register, the Miami Herald, the Detroit Free Press and the Detroit News, the San Jose Mercury News (Silicon Valley’s daily paper), the Philadelphia Inquirer and the Philadelphia Daily News and the Atlanta Journal-Constitution. The Boston Globe, the Los Angeles Times, Gannett and the Washington Post may all soon sell their buildings. Most famously, in 2007 the New York Times moved into a Renzo Piano-designed, $850 million, 52-story sky scraper that replaced the Times’s century old headquarters. Just two years later, in an effort to pay down accumulating debt, the Times sold nearly half of its new building, opting to pay rent with an option to buy back the 21 floors in 2019 in exchange for $225 million (Yu 2009). If there is a future for American daily newspapers, it may unfold in anonymous suburban office parks. This dramatic physical dislocation conveys an unmistakable message of one formerly dominant news medium’s demise and rather desperate attempt to find a new place - quite literally – in a digitalizing world.

The material approach to smaller scale media objects would make a similar discovery. A general understanding of modern media history could argue that media began as discrete devices, often large and immovable – some of them like early radio and television sets actually pieces of furniture. Steady technological development made media smaller, portable, personal, miniaturized and now often ecological, dispersed throughout intelligent built environments. The trend, in other words, has been from media being decidedly artifactual objects to dematerialized functionalities. While there are too many exceptions to make such a notion entirely defensible, this view does have a certain heuristic value. And yet it would seem to be turned on its head by the emerging system of new media now commonly called the internet of things. If many non-media objects come to perform media operations, is this not a reversal of the material-to-immaterial trajectory argument? When many things come to afford access to media, does the physical world then become one more or less continuous interface? If media are less and less devices of their own with special operating requirements (a dedicated location, manuals, switches and knobs, discs, etc.), is the experience of their use more like feeling warm when the heat turns on – which is nonetheless wholly dependent on the hidden and rarely considered but fundamentally material infrastructure of thermostat, furnace and energy source? In fact, the direct analogy of new media with the quiet immateriality of electricity is a common theme among recent expert predictions for the nature of ‘digital life in 2025’, according to which, ‘Information sharing over the internet will be so effortlessly interwoven into daily life that it will become invisible, flowing like electricity, often through machine intermediaries’ (Anderson and Rainie 2014, 3). Any material turn in media analysis must begin then by addressing these fundamentally changing conditions and the contradictory and even paradoxical conceptual and empirical challenges they present. As Klaus Bruhn Jensen (2013, 217) puts it, ‘digitalization has entailed a reconsideration of what a medium is, because the digital computer can reproduce or simulate all other known media.’

The argument here is that ‘media’ is coming to mean not the discrete, dedicated devices of old but functionalities that are increasingly available through non-media objects. The interface remains the form of access, inviting the use of media affordances, but its design grows more natural, demanding less of the user – especially because behind the interface are intelligent information machines that are able to anticipate the user’s desires. These conditions in turn allow people to experience greater emotional and imaginative relations with media; together they form ‘assemblages’ of embodied and extended cognition.

To make a convincing case out of all these complex claims goes well beyond the limits of this paper. Consider them instead a general perspective on new media with important implications for the study of media materiality. To help demonstrate this, the paper examines the object lesson of media-in-the-automobile. A transportation vehicle, the car has (in itself) nothing to do with media. Except that for nearly its entire history, the automobile has included media in its interior to the extent of becoming a thoroughly mediatized environment. And now cars have surpassed that stage and become a quite astounding instance of digitalization in every respect, even eliminating the need for a human driver.

The digitalized car, with its many media interfaces offering numerous functionalities through a variety of interactions – and the even greater number of invisible and automatic network exchanges outside the knowledge of driver and passengers but directly influencing their experience, perhaps presages the near-term future. This paper first locates media in material culture. Next, it explores the interface’s double purpose to offer practical access to media functionalities while also inviting unexpectedly emotional engagement with them. The paper then turns to the transformation of media and their interfaces through the distribution of media functionalities in an internet of things, among other developments. A sustained consideration of the mediatization and eventual digitalization of the automobile grounds these points. Finally, the paper concludes with several observations, drawn from the example of the car, to help guide future material analyses of media.

The tangibility of media

Interfaces and affordances

Material culture may be most significant, as Daniel Miller (2008, 279) says, because ‘much of what we are exists not through our consciousness or body, but as an exterior environment that habituates and prompts us’. While in the bustle of everyday life, objects may ‘fade out of focus,’ this serves only to ‘obscure their role’ and make them appear ‘inconsequential’, when they actually wield substantial power to shape people’s ‘behaviour and identity’. Miller adds that products have the nature of a ‘“distributed mind” which turns [people’s] agency into their effects, as influences upon the minds of others.’

Media can surely be seen in these terms. They have long been a regular feature of modern life, though their chief influence has usually been sought in the creative products that constitute their intangible ‘content.’ However, along with Miller’s stress on the neglected power of the object-world, Friedrich Kittler’s (1995) admonition that ‘there is no software’ asserts the possible primacy of media materiality. Kittler stresses that, ‘software does not exist as a machine-independent faculty.’ Which is to say, the forms of immaterial media content (music, movies, text) and therefore the experience of its consumption (imaginative stimulation, behavioural effects, informational enrichment) are strongly determined by the technologies that produce, distribute and present them for consumption. People encounter a medium’s content only in the terms of that medium’s technological materiality and through their relationship to both. Jason Farman (2012, 62–64) says this three-part formulation constitutes an interface, and that content-artifactuality-user relations in practice are inseparable. Here, for purposes of analysis, the focus is on the latter two. And the notion of interface is used more narrowly to refer to the device whose design affords quite specific relations with a given medium (and of course its content).

The concept of affordance is relevant here. Stig Hjarvard (2008), for instance, uses it in a discussion of the mediatization process, which the paper returns to below. James Gibson, whose term it is (‘the word is not to be found in any dictionary,’ he admitted (Gibson 1977, 67), said that an affordance is what the environment ‘provides or furnishes’ (1977, 68), and that ‘a way of life is a set of affordances that are utilized’ (Gibson 1977, 69). Gibson believed that an affordance is ‘uniquely suited’ to a given animal, like a human being (Gibson 1977, 79), and further that ‘an invariant variable that is commensurate with the body of the observer’ (Gibson 1977, 82) will be more readily perceived (and perhaps used) than one that is not. The anthropologist Tim Ingold (1986, 2–3, 7) adopts affordance to label the possibilities inherent in the raw materials of the natural world. Crucially, socialized humans have internalized these possibilities, and recognize, select and organize the raw materials according to their project at hand. Donald Norman means something else. A cognitive psychologist and design expert, Norman put the term into wider circulation with his 1988 book, The Psychology of Everyday Things, later retitled The Design of Everyday Things (2002). Norman distinguishes between an affordance and a perceived affordance. The former, in the case of a computer, simply refers to the capabilities of the machine; they are built in and the affordance ‘exists independently of what is visible on the screen.’ Displays on the screen, the perceived affordances, ‘advertise the affordances’ within (Norman 1999, 40). For the computer maker, ‘affordances specify the range of possible activities, but affordances are of little use if they are not visible to the users’ (Norman 1999, 41). Norman says in the preface to the 2002 edition of his book, ‘A good designer makes sure that appropriate actions are perceptible and inappropriate ones invisible’ (Norman 2002, xii).1

In Norman’s sense, then, affordance refers both to a media functionality (radio is a sound medium; it cannot display visual images) and how a medium’s design invites the use of these functionalities. Gibson and Ingold would note that the built environment, within which most modern social life occurs, is replete with material objects, including media that present themselves to persons. Individual subjectivity determines significantly what people engage with, but a given medium’s capacities – the range of its possible uses – exist independently of a person’s perception of the medium. The design of a medium, especially the ways in which its potential uses are made available to a potential user, not least in relation to the literal features of the human body, will be a decisive element in people’s adoption and use of the device.

Interface relations

In much of her work that explores relations between people and information machines, Sherry Turkle invokes Donald Winnicott’s object relations theory. Winnicott’s interest was in child development. He observed that infants form bonds with objects, which for him include humans, not least the mother, that are crucial to the child’s understanding of what is me and not-me and to establishing trust that the child’s assertion of independence involves the certainty that the object will remain reliably available when needed again. Winnicott said that the relationship itself was distinct from the child and any particular object. If successful, the relationship becomes a model for life, a fruitful psychologically transitional space where adult fantasy, play and creativity all can flourish. Winnicott’s ideas have informed Turkle’s systematic analyses of the increasingly emotional relations people have with new media (see J. Miller 2014a, 112–113). This includes her meditation on scientists’ remembered relations with treasured childhood objects – their ‘falling in love with things’ (Turkle 2008, 38) – and their significance for occupational choice and even perhaps the person’s discipline and style of scientific investigation. Turkle’s (2008, 20) chief point is that, ‘What remains is a special way of experiencing objects that recalls this early experience of deep connection. Later in life, moments of creativity during which one feels at one with the universe will draw their power from the experience of the transitional object.’ Apart from Turkle, few media researchers have drawn on this theory. Roger Silverstone (1993) is one, but his focus is on how television’s formulaic content and ritualized consumption practices contribute to feelings of personal security. A more recent example applies it astutely to consumer behaviour. Ian Woodward (2011, 380) observes that, ‘all engagements with objects are creative … always constructive in one way or another.’ And, following Winnicott, that the transitional space is one of ‘experimentation, play and imaginative action where pragmatics and imagination must work in unison. Within it, desires are materially engaged and from it, new lacks emerge.’

Object relations theory suggests that people’s engagement with the affordances designed into the physicality of media devices means far more than mere instrumental usage – a measure of user friendliness, say. Rather, people are likely to approach media by deploying lifelong orientations to things. These may include an openness to find pleasure, companionship or utility in them. They may in this relationship draw the external object into their selves, experiencing the inanimate object as being alive. Or they may feel themselves to be part of the machine, taking its perspective on the world (Alexander 2008, 6–7). In these ways, one seemingly enters the medium ‘through the interface’ (Bodker 1990). Perhaps the more natural its design, the better it might function as a transitional object, a relationship that fosters intensely felt emotion. That is, the less machine-like a media device, the less explicit the tacit knowledge required to operate it, the more that natural activity like speech, touch and gesture cause it to respond to the wishes of the media user, the richer and the more intimate the connection between media user and medium. And, to return to Woodward, the more desire is intensified for later and more regular engagements in the quest to banish the inevitable sense of incompleteness.

Dematerialization of the interface

A more natural user interface (NUI) design will invite media access without the human user having to conform so much to the requirements of media technology – mouse and keyboard, special physical placement, etc. This can be glimpsed today in products like Microsoft’s Kinect and other video game motion-controllers. But dematerialization also and perhaps chiefly implies the distribution of media functionalities. Today’s increasingly wireless environments, from home audio to GPS mapping and social media on the run, are a foretaste of what is to come. Commonplace mobile media like the smartphone and tablet are highly portable and deeply personal objects, with touch screens and natural language capabilities that minimize a sense of artificiality in their use (J. Miller 2014b). Wearable wristbands and jewellery are primary means of monitoring, recording and transmitting one’s vital signs, whether for the prosaic care of chronic medical problems or the self-tracking activities of the quantified-self movement (Viseu and Suchman 2010, Ruckenstein 2014). Radical change will come in the next steps of interface transformation.

The likelihood of an internet of things (IOT) rests on the development of ever smaller and cheaper computers and sensors and their interconnection capability. Some of these devices are nano-scale (Akyildiz and Jornet, 2010). The market research firm IDC (2014) defines the IOT as ‘a network of networks of uniquely identifiable endpoints (or “things”) that communicate without human interaction using IP connectivity – be it “locally” or globally’, and foresees a $7.1 trillion worldwide market for it in 2020. Predictions are for tens of billions of things to be connected by that year. Wired magazine labels these conditions ‘the programmable world’ and offers an example of one house in which more than 200 objects are already connected (Wasik 2013; see also Chui et al 2010). Current examples extend to ‘pop-up’ bus service, like Bridj in Boston. Riders’ locations and needs entered online determine bus routes and schedules, which ‘dynamically deploy a transit network’ of nonstop transportation (bridj.com, Seelye 2014). The Bridj model calls for increased data collection and analysis to allow real-time anticipation of travel needs related to special events and the proper sizing of buses (Johnston 2014). The IOT has become a regular subject of academic and commercial conferences. The June 2014 MIT Technology Review Digital Summit in San Francisco, for instance, whose theme was the ‘connected world,’ involved participants from numerous industries and major universities and was covered by news organizations like the Wall Street Journal, New York Times and Bloomberg (see MIT Technology Review Business Report (2014).

In an internet of things, what (and where) is a medium in the conventional sense of the term will be increasingly hard to determine. This will be further complicated by the increasing intelligence of objects and environments, not only by their connectedness or embeddedness. Two related developments that undergird smart things and spaces are machine learning and genetic programming, or evolutionary computation. Both are concerned with building devices capable of autonomously improving performance based on experience. Machine learning designs learning algorithms that find their application in a variety of present-day tasks, including speech recognition, computer vision, bio-surveillance (tracking patterns of disease outbreaks), robot control and data mining. Machine learning is one way to design software when it is too difficult for humans to do. It is also a means to customize existing software to conform to a specific use (Mitchell 2006). Genetic programming adapts Darwinian principles of natural selection to allow software, over several generations, to evolve itself to best fit the usage at hand. John Koza (2008, 185) observes that it already, ‘routinely delivers human-competitive machine intelligence for problems of automated design and can serve as an automated invention machine,’ and offers numerous examples to make his point.2

Surveying these sorts of general developments, Brian Arthur (2009, 203, 207) takes the view that new technologies ‘become potential building blocks for the construction of further new technologies. The result is a form of evolution, combinatorial evolution …’ He perceptively adds – without reference to the IOT - that, ‘technology is no longer a machine with fixed architecture carrying out a fixed function. It is a system, a network of functionalities – a metabolism of things-executing things – that can sense its environment and reconfigure its actions to execute appropriately’.

Media and the automobile

The quest to find a single, sustained heuristic example that would at least partly illustrate the dematerializing trajectory of media leads to the automobile. The car in fact is a distinctly valuable techno-socio-cultural site. From their beginnings, modern media and the automobile have shared a deeply intertwined history. The experience of auto travel, both the ways that cars have been marketed and depicted in popular culture and through the actual reports of drivers and passengers, has inescapably involved the presence of media. And recent, fairly rapid technological developments are transforming the car from a site of entertainment into a ‘computer on four wheels,’ a vehicle enhanced and increasingly controlled by digital technology.

Few human inventions have had such profound and comprehensive consequences for social life as the automobile. The impulse is to make lists cataloguing them. Tom Wolfe did that succinctly, a half century ago. Observing the Southern California custom car scene, Wolfe (1965, 79) in perhaps his first New Journalism piece said that cars ‘are freedom, style, sex, power, motion, colour – everything is right there.’ Only a few years before, moved by the newly redesigned Citroën, Roland Barthes (1972, 88) made the even grander claim that ‘cars today are almost the exact equivalent of the great Gothic cathedrals: I mean the supreme creation of an era, conceived with passion by unknown artists, and consumed in image if not in usage by a whole population which appropriates them as a purely magical object.’

Psychologists Peter Marsh and Peter Collett (1986, 25) view the car as ‘the most psychologically expressive object that has so far been devised.’ They even call the car a ‘central feature of an almost universal religion’ (Marsh and Collett 1986, 5). The car, with its promise of near total freedom of travel, embodies such Emersonian values dear to American mythology as belief in progress and individualism, according to Catherine Lutz and Anne Lutz Fernandez (2010, 15). In 1991, they say (Lutz and Fernandez 2010, 4), 7 out of 10 Americans required a car in order to live ‘the good life,’ while almost half of Americans in 2004 thought that the choice of a car reflects an individual’s personality. Findings like these lead Lutz and Fernandez (2010, 28) to assert that cars, ‘form a sense of self’ to a greater extent than other consumer goods. Widespread car ownership even came to influence the design of houses, making them ‘motorcentric’ by giving the car its own room – the garage, resulting in the reconfiguration of the ground floor and reconceiving the car as a ‘detachable room’ (Marsh and Collett 1986, 11–12). Most of these new homes for people and their cars, of course, constituted post-war suburban sprawl, which in turn fostered unprecedented lives organized around the automotive commute to and from work, shopping and school (Hayden 2003, 2004).

Media in the car

The experience of the automobile as a mobile zone of privacy, safety and pleasure that moves through public spaces with the potential for danger and boredom has a long association with in-car media. A 1930 magazine ad for a Philco car radio offered this enticement: ‘Learn the thrill of having music with your mileage – the charm of riding to entertainment – getting everything that’s going on – missing nothing. You’re never alone with a Transitone’ (Matteson 1987, 75).

In these early years, long before multiple-vehicle households were common, listening to the car radio was rarely a solo activity, but very much an extension of domestic life.3 Mid-thirties research by CBS and NBC discovered that fewer than one in ten people did so alone (Russo 2010, 172). Analysts frequently say that in-car media create a ‘cocooning’ effect. Bijsterveld and her colleagues (2014, 7) use the term ‘acoustic shielding’, noting that while the car radio protects the driver from falling asleep and ‘developing a bad temper in heavy traffic’, it also uses sound production to mask the outer world. Michael Bull’s (2001, 364) research indicates that today the automobile’s ‘auditized space’ may be one of few opportunities for people ‘to do nothing without having to appear to be doing something else,’ and so has now become prized as a solitary place. Bull (2001, 371) views ‘automobile habitation’ as offering a unique ‘sanctuary’ that is ‘enhanced through privatized listening’.

According to Justin Williams (2014, 110; see also Matteson 1987), ‘Early anecdotal evidence suggests that car audio experimentation occurred soon after the turn of the 20th century’, with Chrysler offering a factory-installed radio in 1922. Motorola (‘motor’ + ‘victrola’) built the first successful AM radio around 1930. It cost the equivalent of $1650 when an inexpensive car could be purchased for the equivalent of $9000. And the radio’s size was large, as much as two feet wide, eight inches high and 16 inches deep (Cortez 1996). The names of car radios were revealing. Crosley made a model called the Roamio and RCA later produced the Magic Brain radio, ‘free from crackle, spark and sputter – a new world of radio pleasure’ (Matteson 1987, 149). Hobbyist magazines offered instructions for DIY car radios. By the end of 1932, some 60 manufacturers were making automobile radios in the US (Matteson 1987, 112). As the radio’s physical size was reduced, designers chose to make it the stylish centerpiece of the dashboard. Williams (2014, 110) reports that the price dropped rapidly, and that in 1935 one million car radios were sold. Features like preset pushbutton tuning and foot controls appeared later in the 1930s. During the 1950s, when radios that could be removed and used as portables, car phonographs and transistor radios were all introduced, sales rose to five million annually (Cortez 1996); about 7.9 million cars were produced in 1955 (Walsh 2004). Williams (2014, 112) says that while in 1952 about half of American cars had radios, by 1980, ‘the start of a decade which saw the rapid growth of both the car audio aftermarket and hip-hop music’, the number grew to 95 per cent.

Factory-installed FM radios began appearing in American cars during the 1970s. Around the same time, Motorola offered eight-track tape players, which were soon replaced by smaller, more easily used audio cassettes. Citizens band (CB) radio, a kind of wireless point-to-point communication that others could hear, enjoyed a period of intense, somewhat counter-cultural popularity, especially among long-haul truck drivers. Compact discs featured digital recording quality, and cars in the 1990s had multiple-disc changers. Around the turn of the century, the combination of better sound insulation and improved sound reproduction technology turned cars into a ‘concert hall on wheels’ (Bijsterveld et al. 2014, 170). Subscription-based satellite radio now comes installed in the majority of American new cars. Sales of in-car consumer electronics in 2007 amounted to $10 billion (Williams 2014, 114).

The steady occupation of the automobile by infotainment technology is an instance of mediatization, which labels, as Sonia Livingstone (2009, ix) puts it, an ‘environment characterized by diverse, intersecting and still-evolving forms of multimodal, interactive, networked forms of communication’ that are ‘digitally convergent, hybridized, remediated and intertextual’ (see also Couldry and Hepp 2013, Hepp 2013, Hjarvard 2013). As ownership of cars steadily became commonplace during the pre-World War II period in the US, so too were automobiles increasingly equipped with AM radios that grew smaller, less costly, more integrated and produced better sound. The post-war era saw the rapid adoption of FM radio, better audio speakers and various formats for playing recorded music in the car. Both sets of developments mirrored such changes in media production, distribution and consumption as the dominance of commercial network radio, the LP record, high fidelity audio in the home, 1960s youth culture, alternative radio and hip-hop – along with the wholesale ‘automobilization’ of society (Thynell 2001, 59–60). For manufacturers and drivers alike, automobile travel became a unique opportunity for audio-enhanced, personalized solitude in a mobile space whose media-centric design increasingly masked its essential mechanical-transport nature. Having become a mediatized phenomenon, the car would next, and even more rapidly, become a site of what might be called digitalization.

Digitalizing the automobile

The digitalization of the car moves it beyond being a site of media consumption, albeit one with an unusually long history and dramatic cultural resonance. Digital media are now fundamental to the very conception, design, manufacture, operation and experience of the automobile. The occupants of a car are not only surrounded by audio and video media; the car itself is in constant networked interaction with the larger world for both its own operating reasons and for affording pleasure and useful information to driver and passengers. The human-digital media interface is multiple: tactile controls on the steering wheel, on the dashboard, between the seats; voice controls; wireless and wired exchanges between the car and personal media. At its extreme, the fully digitalized automobile becomes self-driving, utterly automated, leaving, in theory at least, its human occupants freedom to immerse themselves in on-board media.

A car today contains between 20 and 50 electronic control units (ECUs), or ‘computers’, depending on the car’s size. They constitute a system so complex that the wiring harness, which connects the ECUs by means of a controller area network (CAN), is one of the car’s heaviest components. Numerous sensors report information about tire pressure, fluid level and temperature, speed and so on. There is hardly a domain of automobile operation that is not digitalized. Cars continuously monitor themselves, making adjustments in response to changing conditions and conducting self-diagnoses that can be interpreted by a mechanic’s computer when repair is required. ECUs oversee engine management with respect to emissions and performance. Mechanical linkages have been replaced by drive-by-wire arrangements, such as electronic throttle controls or, in the case of hybrid cars, partially electronic braking. Automatic transmissions typically shift gears in response to electronic signals. Anti-lock braking systems (ABS) determine proper brake pressure to reduce skidding and promote optimum stopping distance. Automatic brakes sense when a car is too close to the car in front of it and reduce speed. Sometimes this is done independently of the driver’s actions. Climate control systems cool, heat and dehumidify a car’s interior, and wiper blades clear rain and snow from the windshield, both automatically responding to sensory inputs. Car doors lock and unlock and an alarm is set or deactivated with the use of keyless radio transmission. Most of these and similar activities have become so discreetly embedded and natural-seeming that today the driver scarcely takes notice.

Digital automotive enhancements continue to be introduced. The driver’s view to the rear is improved by a rear-facing video camera. Selecting a driving mode adjusts throttle response, steering assist, damper (or ride) firmness and transmission shift points. Coupling a forward-facing camera and radar-based cruise control, lane-keeping assist determines if a car is drifting outside the lines painted on roads and automatically adjusts the electronic power steering accordingly. Night-vision systems display difficult to see objects that emanate heat, like animals and people. Experimental pedestrian-recognition systems visually scan the car’s environment, reading the images for human forms night or day. ‘Intelligent drive’ systems incorporate these and other features such as parking assistance, adaptive high beam headlights and collision avoidance. One experiment finds a parking spot for a driver just setting out on his journey, incorporating his driving behaviour to calculate arrival time. Voice-activated technology permits the driver to make and receive phone calls and adjust climate control, while being read aloud incoming text messages. Wireless connectivity to a smartphone can play music stored on the phone. Apple’s CarPlay system is built around the iPhone, and is or will be available from some 20 automotive marques, ranging from Ferrari to Suzuki. Google’s competing system is the Open Automotive Alliance, and uses the Android operating system. Audi, General Motors, Honda and Hyundai are its founding members.

Nearly all American cars come equipped with an event data recorder (EDR), or black box, which the US National Highway Traffic Safety Administration has proposed making mandatory. Its purpose is said to be improved auto safety through better understanding of accidents. This small device automatically records a variety of data, including a car’s speed, throttle position, steering angle, braking, seatbelt wearing and, in the case of an accident, impact speed and airbag deployment. A similar, optional device transmits data in real time, increasingly through smartphones, to auto insurance companies that offer discounts to safe drivers (use-based insurance, or UBI).

Auto manufacturers commit substantial resources to the continuing digital transformation of the car. The Volkswagen Group of America, for example, has operated an Electronics Research Laboratory (ERL) in Silicon Valley since 1998 that employs about eighty people, including software, electrical and mechanical engineers, human factors researchers and designers. Perhaps the most dramatic step in these efforts to digitalize the automobile is the autonomous car, whose research has been sponsored in part by the Defense Advanced Research Projects Agency (DARPA), the US government agency that oversaw the invention of the internet.4 Google has been a prime mover and is building 100 examples of its design. Its current version completely eliminates even the possibility of human intervention – there is no steering wheel, brake or accelerator pedal, a truly driverless car (Markoff 2014).

The material turn in a time of media dematerialization

This paper began by observing that media are becoming less like devices and more like functionalities available in non-media objects. Such a view embraces both an internet of things and intelligent, responsive and even anticipatory built environments. In both cases, the separation between ‘media’, the person and the larger world grows less distinct, certainly in their materiality.

The account of the automobile as a media site illustrates this general claim and makes implicit chronological and conceptual claims, which may here be stated as working hypotheses:

1. Media move steadily and materially, and not necessarily predictably, into existing physical spaces. This has direct consequences for media design (and use) and the configuration of space (and the experience of it). There may be a typical sequence to this process, or at least there seems to have been one in the past. Media are first introduced to a place as unexpected material add-ons. They then become increasingly part of the space’s design. Next, media devices become less discreet, becoming media functionalities. Lastly, media, especially digital media, become fundamental infrastructural components of the space, though this may not be apparent to media users.

The case of the automobile’s mediatization and digitalization demonstrates these assertions. Clearly, the car has been and remains chiefly a transportation vehicle. But for drivers and passengers, it is nearly equally now a site of media immersion and connectivity. In the extreme case, digital media will give automobiles the autonomous agency of self-operation, utterly changing their nature and the experience of human occupants. It is unclear, however, whether the automobile is a strong instance of the more widespread development of smart environments, and so a kind of test case for an emerging, less material media world – or a peculiar outlier, unique in its mobility or for the particular history of media-in-cars.

2. The interface constitutes the material presence of a medium and the specific features that signal the medium’s functionalities and provide access to and control over them. Interface design is a continual process, subject to several forces, such as changes in the medium’s basic technology (tubes to transistors), development of materials (wood, Bakelite, vinyl, plastic, aluminum, silicon), tendencies across media that act to standardize (common volume knobs, station and channel selectors) and to differentiate unique media attributes (pushbuttons in car radios that remember stations, remote controls for home video viewing, multiple-LP record changers). In addition, interfaces are subject to changing fashions at large (radio sets as parlor furniture, then streamlined table models). The physical location of a medium may be an especially strong influence on the characteristics of its interface.

The integration of radios into the design of car dashboards appears to have occurred rather early in the life of both. Certainly, in the post-war period the availability of integrated multimedia happened quickly. The very nature of a car’s interior required it. Media needed to be accessible to the driver without being too demanding of the driver’s attention and conform to a relatively small space that included controls for other devices like heating and cooling. The material circumstances of the automobile, in other words, prompted rapid, innovative design changes in media interfaces. The interesting empirical question is whether and to what extent these features carried over into domestic and personal media. Perhaps the physical location of media and their use is an unexpectedly decisive influence on interface design in general. Might, for example, regular experience with a radio that is integrated into the material construction of one’s car interior bring about a desire for a non-automotive radio experience with a similar, media-in-the-environment feeling? Or, does it throw down a challenge for domestic and personal media designers, quite apart from consumer expectations? Just what is the pattern of influence over time in the material design of the same medium when it is used in different physical settings?

How to create media interfaces in the constrained context of a car’s interior that are intuitive, relatively undistracting and aesthetically and affectively appealing is a significant design difficulty. Current design efforts are being described increasingly as smartphone-like. An example is a small touchpad between the front seats to control the car’s multimedia system by responding to fingers’ scrolling, swiping and zooming, as well as recognizing letters, numbers and special characters to identify addresses and search the web. A few keys additionally offer access to frequently used functionalities.

3. Automobiles and media have become inseparable. History shows that this outcome was hardly predestined, resulting instead from unexpected interactions among a host of factors that have to do as much with car culture as with media design and technological capability. Today, what is daring is to produce a car without media, in order to minimize cost, like the Tata Nano city car. In some respects, serendipitously, the automobile has become an ideal material space for media. At the same time, consumer demand and clever media design may have conspired to create a genuinely dangerous situation.

Safety and interface design issues may be particularly acute in the automobile, since the underlying problem concerns the driver’s attention and information processing. Clifford Nass and his colleagues (Ophir et al. 2009, 15585) show that regular media multi-tasking fosters a cognitive style that tends to sacrifice ‘performance on the primary task’ – here, driving – ‘to let in other sources of information’ – such as GPS, email, phone calls and music. At risk is the driver’s ‘attention allocation’. Circumstances that demand media multi-tasking, perhaps most concentratedly observable in the car, may, the researchers say, lead to the general development of new forms of ‘cognitive control’ that adapts to mediatized environments. The car then not only presages near-term media developments, it creates an often experienced physical place where humans can begin to acclimate social practices and neural processes to smart environments characterized by continuous interfaces.

This is a risky transition, however. The danger posed by talking and texting while driving was recognized not long after the introduction of smartphones. In 2009–10 the New York Times published a 26-part series, “Driven to Distraction,” on these dangers, the pressures to use media nonetheless and the uneven policy response among political authorities. Werner Herzog produced in 2013, with the support of AT&T, the half-hour documentary From One Second to the Next, whose gruesome description of four accidents caused by the driver’s texting is meant to dissuade that behaviour. In response, Apple has patented technology that can disable texting and other smartphone functions when used by the driver, which may become part of its CarPlay system. This, in turn, could alter people’s social and cognitive relations to new media, influence interface design and affect expectations about the practicality of environments that demand media multi-tasking.

In the automobile, it is easy to see how media technologies can assert their socially and materially constitutive role. Just as a house becomes a home, turns into a smart home and grows into a “conscious home,” the mediatized car has become at once an essential transportation vehicle, a home-like “sanctuary” (Bull 2001, 370) from the pressures of everyday life and an always-on connection to the internet. These changes offer a dramatic test of embodied cognition, the idea that people’s tools shape their thinking and ability to act, posing dangers in the process.5 Facing such increasingly common sites of mediatization, the material turn in media studies unavoidably confronts the dematerialization of conventional media interfaces. As the architect and new media scholar William Mitchell saw it nearly a decade ago (2005, 97), into the skin of built environments will withdraw, “many of the current functions of lights, televisions and computer monitors, computing and communication devices … thermostats and interior climate control systems.” The automobile seems to bear him out. Under such conditions, what is the focus, what are the boundaries of a material media analysis?

Competing Interests

The author declares that they have no competing interests.

Notes

  1. Norman writes in the body of his book that affordance ‘refers to the perceived and actual properties of the thing, primarily those fundamental properties that determine just how the thing could possibly be used … Affordances provide strong clues to the operation of things’ (Norman 2002, 9). ‘I believe that affordances result from the mental interpretation of things, based on our past knowledge and experience applied to our perception of the things about us’ (Norman 2002, 219 fn).
  2. Evolutionary algorithms were used to design ‘the first computer-evolved antenna’ for NASA’s Space Technology 5 Mission, which launched three satellites in 2006 (Spector 2005, Hornby et al. 2011).
  3. In 2011, almost four in ten US households owned two vehicles; nearly one in five owned three or more vehicles (US Department of Energy 2013).
  4. See The Darpa Grand Challenge (2014). For a report on driving a self-driving car, see Kacher (2014).
  5. The Mobile Music Touch group at Georgia Institute of Technology has developed a wireless tactile glove whose vibrations ‘teach’ one’s hand to play an instrument (Mobile Music Touch). Learning the physical act of handwriting appears to have effects on the brain that speed up learning to read and increase information retention (Konnikova 2014).

References

1  Akyildiz, I. F.; Jornet, J. M.. (2010).  The internet of nano-things.  IEEE Wireless Communications, December 2010 : 58. DOI: http://dx.doi.org/10.1109/MWC.2010.5675779

2  Alexander, J. C.. (2008).  Iconic experience in art and life: Surface/depth beginning with Giacometti’s Standing Woman.  Theory, Culture and Society 25 (5) : 1. DOI: http://dx.doi.org/10.1177/0263276408095213

3  Anderson, J.; Rainie, L.. (2014).  Digital life in 2025.  Washington, DC: Pew Research Center. March 11 2014 available at http://www.pewinternet.org/2014/03/11/digital-life-in-2025/.

4  Arthur, W. B.. (2009).  The Nature of Technology: What It Is and How It Evolves. New York: Free Press.

5  Barthes, R.. (1972). The new Citroën In:  Mythologies. Lavers, A. (trans.),   New York: Farrar, Straus and Giroux, pp. 88.

5  Bijsterveld, K.; Cleophas, E.; Krebs, S.; Mom, G.. (2014).  Sound and Safe: A History of Listening Behind the Wheel. New York: Oxford University Press.

6  Bodker, S.. (1990).  Through the Interface: A Human Activity Approach to User Interface Design. Boca Raton, FL: CRC Press.

7  Bull, M.. (2001). Soundscapes of the car: A critical ethnography of automobile habitation In:  Miller, D. (ed.),   Car Cultures. Oxford: Berg, pp. 185.

8  Chui, M.; Löffler, M.; Roberts, R.. (2010).  The Internet of Things.  McKinsey Quarterly 2 : 1.

9  Cortez, J. P.. (1996).  Makers had to button up packaging to usher in the radio revolution.  Automotive News, June 26 1996

10  Couldry, N., Hepp, A. A. (eds.), . (2013).  Conceptualizing mediatization: Contexts, traditions, arguments.  Communication Theory 23 (3) : 191. DOI: http://dx.doi.org/10.1111/comt.12019

11  Ericson, S., Riegert, K. K. (eds.), . (2010).  Media Houses: Architecture , Media and the Production of Centrality. New York: Peter Lang.

12  Farman, J.. (2012).  Mobile Interface Theory: Embodied Space and Locative Media. New York: Routledge.

13  Frow, J.. (2010). Matter and materialism: A brief pre-history of the present In:  Bennett, T., Joyce, P. P. (eds.),   Material Powers: Cultural Studies, History and the Material Turn. New York: Routledge, pp. 25.

14  Gibson, J. J.. (1977). The theory of affordances In:  Shaw, R., Bransford, J. J. (eds.),   Perceiving, Acting and Knowing: Toward an Ecological Psychology. Hillsdale, NJ: Lawrence Erlbaum, pp. 67. PMid: 905634.

15  Hayden, D.. (2003).  Building Suburbia: Green Fields and Urban Growth, 1820–2000. New York: Pantheon.

16  Hayden, D.. (2004).  A Field Guide to Sprawl. New York: W. Norton.

17  Hepp, A.. (2013).  Tribe, K. (trans.),   Cultures of Mediatization. Cambridge: Polity.

18  Hicks, D.; Beaudry, M. C.. (2010). Introduction: Material culture studies: A reactionary view In:  Hicks, D., Beaudry, M. C. M. C. (eds.),   The Oxford Handbook of Material Culture Studies. Oxford: Oxford University Press, pp. 1. DOI: http://dx.doi.org/10.1093/oxfordhb/9780199218714.013.0001

19  Hjarvard, S.. (2013).  The Mediatization of Culture and Society. Abingdon: Routledge.

20  Hornby, G. S.; Lohn, J. D.; Linden, D. S.. (2011).  Computer-automated evolution of an X-band antenna for NASA’s Space Technology 5 Mission.  Evolutionary Computation 19 (1) : 1. DOI: http://dx.doi.org/10.1162/EVCO_a_00005 PMid:20583909.

21  IDC (International Data Corporation). (2014).  The internet of things moves beyond buzz: Worldwide market forecast to exceed $7 trillion by 2020, IDC says.  available at http://www.idc.com/getdoc.jsp?containerId=prUS24903114 (accessed 7 October 2014).

22  Ingold, T.. (1986).  The Appropriation of Nature: Essays on Human Ecology and Social Relations. Manchester: Manchester University Press.

23  Jensen, K. B.. (2013).  Definitive and sensitizing conceptualizations of mediatisation.  Communication Theory 23 (3) : 203. DOI: http://dx.doi.org/10.1111/comt.12014

24  Johnston, K.. (2014).  Data-driven bus service set to roll out.  Boston Globe, available at http://www.bostonglobe.com/business/2014/04/10/data-driven-pop-bus-service-launch-boston/yz4EjzZC9nXnl22O6JcV2I/story.html (accessed 7 October 2014).

25  Joyce, P.; Bennett, T.. (2010). Material powers: Introduction In:  Bennett, T., Joyce, P. P. (eds.),   Material Powers: Cultural Studies, History and the Material Turn. New York: Routledge, pp. 1.

26  Kacher, G.. (2014).  How to not drive.  Car, March 2014 : 82.

27  Kittler, F.. (1995).  There is no software.  ctheory.net, available at http://www.ctheory.net/articles.aspx?id=74.

28  Konnikova, M.. (2014).  What’s lost as handwriting fades.  New York Times, available at http://www.nytimes.com/2014/06/03/science/whats-lost-as-handwriting-fades.html?_r=0 (accessed 7 October 2014).

29  Koza, J. R.. (2008).  Human-competitive machine invention by means of genetic programming.  Artificial Intelligence for Engineering Design, Analysis and Manufacturing 22 : 185. DOI: http://dx.doi.org/10.1017/S0890060408000127

30  Livingstone, S.. (2009). Foreword: Coming to terms with mediatization In:  Lundby, K. (ed.),   Mediatization: Concept Changes, Consequences. New York: Berg, pp. ix.

31  Lutz, C.; Fernandez, A. L.. (2010).  Carjacked: The Culture of the Automobile and Its Effect on Our Lives. New York: Palgrave Macmillan.

32  Markoff, J.. (2014).  Google’s next phase in driverless cars: No steering wheel or brake pedals.  New York Times, available at http://www.nytimes.com/2014/05/28/technology/googles-next-phase-in-driverless-cars-no-brakes-or-steering-wheel.html?_r=0 (accessed 7 October 2014).

33  Marsh, P.; Collett, P.. (1986).  Driving Passion: The Psychology of the Car. London: Faber and Faber.

34  Matteson, D. W.. (1987).  The Auto Radio: A Romantic Genealogy. Jackson, MI: Thornridge. PMCid: PMC298962.

35  Miller, D.. (2008). Material culture In:  Bennett, T., Frow, J. J. (eds.),   The Sage Handbook of Cultural Analysis. London: Sage, pp. 271. DOI: http://dx.doi.org/10.4135/9781848608443.n14

36  Miller, J.. (2014a). Intensifying mediatization: Everyware media In:  Hepp, A., Krotz, F. F. (eds.),   Mediatized Worlds: Culture and Society in a Media Age. New York: Palgrave Macmillan, pp. 107. DOI: http://dx.doi.org/10.1057/9781137300355.0012

37  Miller, J.. (2014b).  The fourth screen: Mediatization and the smartphone.  Mobile Media and Communication 2 (2) : 209. DOI: http://dx.doi.org/10.1177/2050157914521412

38  MIT Technology Review Business Report. (2014).  The internet of things.  July/August 2014

39  Mitchell, T. M.. (2006). The discipline of machine learning In:  Pittsburgh: School of Computer Science, Carnegie Mellon University. July 2006

40  Mobile Music Touch. ().  available at http://acmelab.gatech.edu/?p=1041 (accessed 7 October 2014).

41  Norman, D. A.. (1999).  Affordance, conventions and design.  Interactions, May 1999 : 38. DOI: http://dx.doi.org/10.1145/301153.301168 available at http://dl.acm.org/citation.cfm?id=301168 (accessed 7 October 2014).

42  Norman, D. A.. (2002). The Design of Everyday Things In:  New York: Basic Books.

43  Ophir, E.; Nass, C.; Wagner, A. D.. (2009).  Cognitive control in media multitaskers.  Proceedings of the National Academy of Sciences 106 (37) : 15583. DOI: http://dx.doi.org/10.1073/pnas.0903620106 PMid: 19706386; PMCid: PMC2747164.

44  Ruckenstein, M.. (2014).  Visualized and interacted life: Personal analytics and engagements with data doubles.  Societies 4 : 68. DOI: http://dx.doi.org/10.3390/soc4010068

45  Russo, A.. (2010).  Points on the Dial: Golden Age Radio beyond the Networks. Durham, NC: Duke University Press, DOI: http://dx.doi.org/10.1215/9780822391128

46  Seelye, K. Q.. (2014).  To lure Bostonians, new bus service learns riders’ rhythms.  New York Times, available at http://www.nytimes.com/2014/06/05/us/to-lure-bostonians-new-pop-up-bus-service-learns-riders-rhythms.html (accessed 7 October 2014).

47  Silverstone, R.. (1993).  Television, ontological security and the transitional object.  Media, Culture and Society 15 (4) : 573. DOI: http://dx.doi.org/10.1177/016344393015004004

48  Spector, L.. (2005).  And now, digital evolution.  Boston Globe, available at http://www.boston.com/news/globe/editorial_opinion/oped/articles/2005/08/29/and_now_digital_evolution/ (accessed 7 October 2014).

49  Spigel, L.. (2008). Setting the stage at Television City: Modern architecture, TV studios and set design In:  TV by Design: Modern Art and the Rise of Network Television. Chicago: University of Chicago Press.

50  The Darpa Grand Challenge: Ten Years Later. (2014).  available at http://www.darpa.mil/NewsEvents/Releases/2014/03/13.aspx (accessed 7 October 2014).

51  Thynell, M.. (2001). Automobilization and motorization In:  Jones, R. J. B. (ed.),   Routledge Encyclopedia of International Political Economy. New York: Routledge, 1 pp. 59.

52  US Department of Energy. (2013).  Transportation Energy Data Book, ch. 8, “Household vehicles and characteristics,” table 8.5 “Household vehicle ownership, 1960–2011 census.”.  available at http://www-cta.ornl.gov/data/chapter8.shtml (accessed 7 October 2014).

53  Visue, A.; Suchman, L.. (2010). Wearable augmentations: Imaginaries of the informed body In:  Edwards, J., Harvey, P.; P. and Wade, P. P. (eds.),   Technologized Images, Technologized Bodies. New York: Berghahn, pp. 162.

54  Wallace, A.. (2012).  Media Capital: Architecture and Communications in New York City. Urbana: University of Illinois Press.

55  Walsh, M.. (2004).  Gender and the automobile in the United States.  available at http://www.autolife.umd.umich.edu/Gender/Walsh/G_Overview3.htm#walsh (accessed 7 October 2014).

56  Wasik, B.. (2013).  In the programmable world, all our objects will act as one.  Wired, available at http://www.wired.com/2013/05/internet-of-things-2/ (accessed 7 October 2014).

57  Williams, J. A.. (2014). Cars with the boom: Music, automobility and hip-hop “sub” cultures In:  Gopinath, S., Stanyek, J. J. (eds.),   The Oxford Handbook of Mobile Music Studies. New York: Oxford University Press, 2 pp. 109.

59  Wolfe, T.. (1965). Kandy-colored, tangerine-flake streamline baby In:  Kandy-Kolored, Tangerine-Flake Streamline Baby. New York: Farrar, Straus and Giroux, pp. 76.

58  Woodward, I.. (2011).  Towards an object-relations theory of consumption: The aesthetics of desire and the unfolding materiality of social life.  Journal of Consumer Culture 11 (3) : 366. DOI: http://dx.doi.org/10.1177/1469540511417997

59  Yu, H.; Bensinger, G.. (2009).  New York Times sells building stake for $225 million.  Bloomberg, available at http://www.bloomberg.com/apps/news?pid=newsarchive&sid=ajNcZc6SGyC8 (accessed 7 October 2014).