Data Mirror

A Visualization of Human Being Through Machine Language

Imagine how the machine sees us as a human being and how it will be different from what we see ourselves. Experimenting on the visualization of human being and stereotypes of races and identities through the machine help us to proceed to the way machine makes art and create arbitrary judgment on the physical appearance of the human. From the aspect of machine recognizes us as the human, the scenario will be represented as the simplification of our complicated figures along with the ability to make the judgment that machine is coded. In another word, different from how human visualize data information provided by the machine, which is a transformation from simpleness to intricacy, machine, on the opposite way, uses lines, dots, and numbers to represent the shape of a human, which is the conversion from intricacy to simpleness. Therefore, Data Mirror is trying to get audiences to experience the way machine visualizes human being, the opposite of human visualizes data information.

How It Works

Data Mirror will be presented as a combination of two stages, speaking with the computer and being observed by the computer. Users start with communicating with the computer, which imitates a conversation with artificial intelligence. In this stage, as people walking into the scene, where the computer is linked to both the voice and camera detector. Participants speak to the computer (voice detection) to trigger the next stage of camera detection and be able to have a projector to project the figure of the conversion of the human being and the textual information of categorizing races and identities to the big screen. The scenario is intended to arouse the resonation of my audience by having them participate in the situation of being judged arbitrarily based on their physical appearance and categorized by the stereotype. Through presenting the analysis of machine, audiences experience the futuristic sense of being materialized at a certain level of technological development.

Live Recording of the Exhibition

Voice Trigger

Data Mirror includes both hardware and software to reach the purpose of visualizing human being. For the stage of communicating with artificial intelligence, the voice trigger is coded through processing with the library of wblut to detect the volume of the voice (once the volume reached a certain level) so that can enter the next stage. In the voice detection part, the design of the platform includes a sphere composed of a different shade of blue, which is the color of a sense of scientific and artificial intelligence.

Camera Detection

The stage of detecting human races and providing the description for the categorization builds on Arduino and PixyCam, a fast vision sensor that links to the computer to track the object that it is commanded to detect. PixyCam can learn new objects when being asked to do so. In this case, I have the PixyCam to learn to identify different skin tones by rewrite the command in Arduino. After triggers the camera detection with the voice detection to determine the skin color of the person who participates in the interactive project, the figure of simplification of the human being will be projected to the big screen for both the participant and other audiences to observe. With the combination of two stages that built on two different types of sensors, Data Mirror provides the experience of the futuristic world which technology takes a significant portion of the social formation and control over the citizens to users.