Data Art, an emerging art movement that is original and innovative, uses data and generative technologies to create relevant reflections on life in the 21st century. From the data they generate, I create individual, family, group, and company portraits—animated abstractions of these data—for collectors and audiences. To do so, I combine psychology, data mining, programming, and audio/video editing.
I. Data Art and Patterns
I have spent my life creating innovations that disrupt stagnation. The decision to use data as an art medium is a continuation of that project. My process begins with the search for intriguing human data, which I then mine for patterns and outliers that excite my aesthetic sensibilities. Using generative software I transform the chosen data into visuals, setting up subtle parameters, layers, and trajectories that serve my conceptual goals. Once my algorithms are applied the data take charge of the animation, color choices, camera angles, perspectives, and more. As the artist I choose the conceptual play, but the data are the actors freely interpreting and performing. The art prints cut from my videos capture catalytic instances; they are meant to stimulate curiosity about the action that created them.
Roland Barthes, a French literary theorist, philosopher, linguist, critic, and semiotician- what is an image?: Barthes says, referring to photography, that the language of the image is not merely the totality of utterances emitted, it is also the totality of utterances received. The patterns that emerge from my videos are placed there by the data and to a lesser extent programming, but the artwork would be incomplete were it not for the patterns created by the viewers. This is an augmentation of ‘what is received’ as it is an additional layer of art created by the viewer’s patterns.
The human brain is hardwired to find patterns and meaning in all things, and my artwork communicates directly to those instincts. Though we are viewing the same underlying data and the truths it contains, we will each find patterns that reflect our own interests and experiences.
In my artwork, one can see that the data and their sources are important. Using a collector’s own data, I create animations of the patterns in these data, revealing outliers that do not fit existing forms, and then exposing larger patterns that incorporate these anomalies. Viewers instinctively find their own patterns in this data-driven art, comparing and contrasting what they know about the source against their own interpretations of the abstract imagery. Viewers of this artwork also create their own outliers, which lead to new patterns, and thereby create new ways to enlarge their own view of themselves and others.
Human search for order: In the modern world that seems so disordered we humans are always driven to reach for order. This theme plays heavily in my artwork as I go from order to chaos and sometimes back to order. One of the problems I see with our being hard-wired for story is the patterns that we make in order to understand our world are also the very patterns that bind us to a limited ways of seeing it. I am exploring ways for my art to bring in the outlier data that do not fit the patterns. These data can be part of new patterns, new ways of understanding our world.
II. Sentience of Data
What do images want?: W.J.T. Mitchell, the Gaylord Donnelley Distinguished Service Professor of English and Art History at the University of Chicago, says images are not just what they mean or what they do, but what is the secret of their vitality – what do they want? I ask what do my images want and also what do these data want. This question of what data want will be discussed later when I talk about the sentience of data. Data want to show their sentience.
What is beginning to emerge in this new art form is a synthesis of humans and machines that allows us to move beyond the dualism of subconscious and conscious, of order and chaos, to a new synthesis and clarity of who we are as complete people.
I augment my skills and aesthetics with human data as a tool to help generate colors, shapes, perspectives, and camera angles. Pressing data to extremes with powerful computers and software can reveal a sentience in the data. Computers can show us who we are as they sort, merge, split, and order our data into previously unknown patterns.
Through all my various careers, including the current one as a data artist, I noticed that data can describe itself through various visual forms and sounds made from the data. In this sense I describe data as being sentient. Another level of data sentience is what W.J.T. Mitchell talks about with images wanting something from the viewer. In this same manner I can say that one’s data wants something from its owner. This want is part of what I try to bring out when creating a data portrait for a collector. Data has always had a way of seeing its world and ‘talking’ to me about it. I am trying visualize for others the sentience I see and feel in the data.
Data as Art project: I am collaborating with Paul Golding at Klio who is creating a data as art project which has philosophical underpinnings that point to David Deutsch, artificial intelligence, data as metaphor, theories about the origins of the universe, and others. One of Paul’s ideas out of David’s Constructor theory would suggest that aesthetics is not a subjective quality. This has implications for an objective set of algorithms and/or data that could not only represent, but also, augment human aesthetics.
III. Culture versus Nature, Human versus Machine
Roland Barthes: – culture versus nature: Barthes says the meaning of an image is torn between the system of culture and the system of nature.
What it means to be human: One of the first series of videos I did was those driven by the data of CERN’s Large Hadron Collider (LHC). CERN and I have similar goals in that we are trying to discover the data of life and the place of humans in the universe. My LHC artwork starts with the analysis of a small bit of CERN data and ends with a complex visual abstraction of these data.
The data were generated by a controlled collision of particles inside the LHC. These experiments “operate at the very boundaries of scientific knowledge” and produce Muons a high-energy, unstable subatomic particle. The resulting data is studied to gain a better understanding of the ordinary matter of which we, and everything we know are made. The particles created by the LHC (above) are torn between the reality of the data created and our observations and discussions of the particles based on our cultural understandings and myths of our human place in the universe. The images created by the data in my videos have a natural existence and are shaped by my own background. I attempt to show the relationships among these data and their role in shaping human existence.
Affective lens: Maryhelen Murray writes about seeing images through an “affect lens” that is an emotional response layer through which images are viewed. My emotional response to the patterns in the data is a large part of my artwork and a lens through which I build the work. As I build my own patterns on top of the actual patterns in the data, and my viewers layer their own patterns, their patterns point to their affect lenses.
My own take on the culture versus nature and human versus machine controversies is to create artwork that evokes cultural pattern making from the nature of the data that is reality and to use the machine to augment my own aesthetic. The viewers of my work bring their own cultural pattern overlays to the patterns that already exist in the data. The computer is my tool for augmenting the aesthetic of the data and patterns.
To develop my data art, I begin by extracting data from personal sources, such as mobile phones, DNA, web logs, activity logs, health monitors, government or company data.
These data are loaded into a database where I perform various statistical analyses in order to get a sense of the data, their size, averages, variances, minimum and maximum values, etc. Next, I perform data mining to discover patterns in the data. Some of the data mining is very simple, just a small extension of the statistics. In contrast, some of the data mining involves inventing complex pattern recognition algorithms. The resulting patterns are used as parameters for algorithms in visualization software.
These mined data are read into a graphics processing language. The first pass of the data is read into some simple algorithms just to get an idea of what the data look like graphically. More complex algorithms are developed as the data create colors, shapes, screen locations, and camera angles. I do program graphical shapes and animation, but ultimately, the work is driven by the data of human life. The final step in the programming is to create a movie from the individual video frames.
I add an audio component to complement and create further forms for the animation. Sometimes I create sound patterns to augment the visual patterns. Other times I use music from collaborators.
Some of my work uses the video as final assembly and some of it relies heavily on video effects that can be done in software such as After Effects and Final Cut Pro. I am not dogmatic about this. I do not care what the percentage is. It is all about what I need to do to first, communicate the sentience of the data, and two, create an aesthetic that fits my vision. I try to not get tied up in the purist view. I am all about using a computer to enhance my own and my viewer’s aesthetic. As we approach The Singularity, I do not make the machine/human distinctions that other artists do.
The work naturally appeals to intrepid collectors as well as cutting-edge technologists who are ready to leave their aesthetic mark on contemporary culture. My artwork cuts a new path in data driven, computational, and generative art at the intersection of the human and the machine.
My academic and professional background is in clinical psychology, mergers and acquisitions, and software.
I have worked as a Data Architect, Data Miner, and Data Scientist – my job was to invent pattern recognition data architectures and algorithms for private and government client. I have analyzed human behavior in all its forms from shopping habits to terrorists communication habits. The data have come from marketing, finance, weblogs, and many other sources. I looked for patterns in theft, market baskets, web activity, and many others.
The requirements of my consulting work required art as well as science, so in that sense I have always been a data artists. My main area of expertise was helping to design and build the technical infrastructure necessary for a company to change how its industry worked. This required a vision of the future industry and data architecture as well as inventing new data mining methods, so this is about art and science. Part of art is about revealing way of looking at the world that has not been done previously. In order to stay ahead of an industry, change how an industry works, or track human behavior you have to create a new vision, just as an artist does.
VI. Patents and Awards
- Innovative treatment for schizophrenic adolescents as Director, Intensive Care Unit, psychiatric facility.
- Invented real-time mergers and acquisition process and software.
- Teradata R&D Eureka Award for data architecture invention.
- Six patents for data mining big data methods.
- Google MapReduce and Hadoop based on 1st patent and now part of the Open Data Platform
- Ten+ patents listing my work as prior art.
- Commissioned fMRI portrait to be part of an experimental film for the Bronx Biennial.
- JEPricer Studio – workshop with VJ artists
- Quantified Self Meetup, Austin, TX
- “Augmenting Human Aesthetics With Self Tracking Data” – QS15 Global Conference and Expo, San Francisco
- Quantified Self Meetup, Austin, TX
VIII. Classes Taught
“Using Self Tracking Data to Augment Your Own Aesthetics” – QS15 Global Conference and Expo, San Francisco
- Klio gallery
- Artcast gallery
- JEPricer Studio
- QS15 Global Conference and Expo Art Gallery, San Francisco
- JEPricer Studio
- JEPricer Studio
X. Current Projects and Awards
- Featured Artist on Artcast, viewable on Roku, Apple TV, Google Play and at selected international hotels.
- Featured Artist on Klio.
- Honorable Mention – Austin Art Boards Awards
- Several commissioned portraits.