Category Archives: Art

Art Music

Oscilloscope Interface Studies

June 11, 2012 – 9:38 am

Over the past year I’ve been experimenting every so often with an audio-visual performance interface based off of Lissajous Displays and the 3D Oscilloscope series by Dan Iglesia. My version uses a glove-based motion capture interface that we have here at UCSB in the Allosphere, our 3-story mutlimedia environment. Here’s what they look like:

And here are are a few screenshots of the performances. Basically the performer puts on these gloves, which control the frequencies of multiple oscillators. These are then visualized as an oscilloscope display and the resulting pixels are translated into sound. A skilled performer can access many interesting shapes like the ones below tuning the oscillators in harmonic ratios.

Permalink | Comment (0)

Art

Nebulous

May 13, 2012 – 9:26 am

This is a an animation of wave propagation mixed with reaction diffusion that I programmed in C++. I start by triggering a single red wave in the center, which sets the complex system in motion.

It works well as a metaphor for the creation of the universe because slight irregularities in the starting conditions allow unstable patterns to emerge (in this case, the trigger wave was ever so slightly off-center). By measuring the cosmic microwave background radiation (CMB), physicists have discovered that the early universe was slightly irregular. This irregularity is what allows galaxies, stars, and planets to form. If instead it were completely uniform, it would have remained in a stable state and nothing would have emerged. Similarly, this animation starts out with very symmetrical, slow-moving patterns but as time goes on these become more chaotic and complex.

Drawing inspiration from animators such as Oskar Fischinger, I set this to a classical score that I think fits quite nicely. The piece is movement 15 of “Vingt regards sur l’enfant-Jésus” (Twenty Contemplations on the Infant Jesus) by Olivier Messiaen.

Permalink | Comment (0)

Art

Talking Heads: Speech Visualizations of the Past and Present

January 1, 2012 – 9:11 pm

Last year I became interested in the possibility of comparing different politicians and public figures through computer assisted analysis of their speeches. Starting with archival videos of famous addresses, I created a small program that scans the volume level of the audio track and takes snapshots of the speakers at his/her loudest (i.e. most emphatic) moments. It then combines these snapshots into a single composite photo. The resultant images reveal otherwise hidden facial features and patterns of body language. When viewed in series they allow us to compare speakers within a much more controlled set of parameters than if we were simply to watch these videos side by side.

Last April I was fortunate enough to be invited to give a talk on this project at the Critical Themes in Media Studies conference in New York City. Unfortunately I never got around to creating a real post about the piece, however renewed interest in the topic has driven me to fix this. Below you will find image and sound examples taken from the talk. If you’re interested in using this program for your own work, the code can be found here. Over the next few weeks my close friend YuanYi Fan will be using the software to analyze candidates in the upcoming Taiwanese Presidential Election, so links will surely follow.

More examples and the code itself can be found on the Full Project Page

Benito Mussolini

[audio:/old/sound/musso.mp3|titles=Benito]

Adolf Hitler

[audio:/old/sound/hitler.mp3|titles=adolf]

Dr. Martin Luther King jr.

[audio:/old/sound/luther.mp3|titles=luther]
[audio:/old/sound/luther2.mp3|titles=luther 2]

FDR

[audio:/old/sound/fdr.mp3|titles=fdr]

JFK

LBJ

Richard Nixon

Gerald Ford

Jimmy Carter

Ronald Reagan

[audio:/old/sound/reagan.mp3|titles=reagan]

George H. W. Bush

[audio:/old/sound/hw.mp3|titles=h-dubya]

Bill Clinton

George W. Bush

[audio:/old/sound/bush.mp3|titles=bush]

Barack Obama

[audio:/old/sound/obama.mp3|titles=obama]

Permalink | Comment (1)

Art

Pop Montage

March 23, 2011 – 8:17 pm

Every day google’s hot trends website releases statistics on the 20 most quickly rising search queries. I wrote a program that downloads this information and collects pictures of each of these items, analyzes the images, crops them based on their content, and finally arranges them into a single visual composition, leaving us with a giant daily collage.

It’s sort of a way to take a snapshot of what society cares about at a particular moment in time. When viewed in sequence, it also allows you to pick out patterns in popular culture. As you can probably guess it’s pretty bleak. Basically every day there’s inevitably a new food or type of desert, a celebrity controversy, some random sexy girl of the day, a few sports players, more celebrities, something cute like “national margarita day”, and then maybe, MAYBE toward the bottom of the list something serious like a massacre in Georgia or the Defense of Marriage Act. Hopefully I’ll be able to set this up on a server so that it automatically makes a new collage every 24 hours. People could use it as a homepage to very quickly find out what’s new in the world without having to scan the news.

Image analysis, manipulation, and montage is done in Matlab. Statistical information is taken from Google Hot Trends.

March 2, 2011: