3, no 4 … nah, it’s only Three Dimensions of Visual Performance

Posted in culture & media design, performing graphics, tools on April 7, 2012 by visualraccoon

Or, how to avoid “vuzak fatigue” = the audience ignoring the visuals.

This is a followup to a discussion last summer between myself, Tim Thompson, and David Tristram. David got things started by defining the problem:

dt> The audience ignoring the visuals. This is central to my frustration with visual performance and must be solved if we are to succeed.

My response was to dig up my old PIPs metric for visual performance. I claimed that one reason audiences preferring the triggering and mixing of pre-recorded visuals (common “VJ” style), or synchronous computer generated images (algorithmic slaves, “music visualizer” style), was because the manual performers were several orders of magnitude too slow to be interesting in a purely generative schema. Compared for instance with musicians and other fast input performers.

dt> PIPS is useful but is a very narrow metric.

Well, David is right, PIPs is a very narrow metric — by itself. But, when you add two other narrow metrics, then you get … narrowness compounded? Or, if lucky, a rigid framework which is useful just because it is definable. When I got my degree in rat psychology, I learned that measureable rigid frameworks have their uses, if only to clearly define where you don’t want to go. They can also provide a place to stand from which to get a clearer view of where you do want to go.

In that spirit, I say that, yes, PIPs by itself is a sterile metric, but when you add in AG and MP, then those three axises together define a useful space for visual performance. Or in less grandiose terms, a few things to keep in mind when designing, composing for, and performing with visual instruments.

The axises are Performer Inputs per Second (PIPs) with Air Guitarabilty (AG) in a visual system that has Mistake Potential (MP).

This works as follows:

You have a visual performer initiating very frequent actions (PIPs) which gives enough temporal density to weave engaging graphical patterns in realtime, and the audience knows she’s doing it thanks to AG (Air Guitarability, the visible correlation between performer body movements and changes in the visuals), all within a conventional temporal structure so there can be flow, expectation, surprise, and mistakes (MP).

By “conventional,” I don’t necessary mean old traditions; I simply mean conventions whether new or old which establish structure for the performance. Call it dynamic visual vocabulary, call it time signatures for visuals, call it late for dinner, whatever. Just so the audience has a chance to grok the rules for the visual temporal patterns you’ll be laying down.

Oh shit, there I’ve said it, “rules.” So be it. I’m just an old fart, conservative, straight-ahead, 16 bar graphics guy, so my viewpoint is a bit conventional (literally, conventions — I like ‘em)

I think rule-breaking is great in artforms where there are established traditions to contrast with. Rule-breaking in live visual performance may be a bit premature, like making up a new language, not teaching it to anyone else, and then expecting people to appreciate the delightful ways in which you violate the syntax for extra poetic expressiveness. They won’t.

Oh yeah, and about the on-again off-again Visual Richness dimension. Originally not there, then yesterday I thought I needed it and so put it back in. But then I realized (again, apparently!) that Visual Richness is secondary, an epiphenomenon in the viewer’s perception generated by PIPs and MP. I claim that MP is only possible within a dynamic visual vocabulary of primtives, riffs, and time signatures. Such a visual system, like the music infrastructure (i.e. diatonic scale, notation, time signatures, etc), then supports the emergence of composition. And entertaining richness is simply good composition times speed. Otherwise it’s just visual noise (bad composition) or slow painting (come back when it’s done).

Finally, the excellent post by David that spawned this blog entry:


dt>
Date: Thu, 09 Jun 2011 08:44:16 -0700
From: David T
Subject: Re: "VISUAL MUSIC" a conversation

Excellent discussion fellow voyagers.

PIPS is useful but is a very narrow metric. I would posit a single mallet hit on a tubular bell performed at the correct instant can rival a Steve Vai solo. Or a haiku compared with "War and Peace". Or Cage strumming a piano harp with a feather. Or meeting someone's eyes. All summer in a day, or a moment.

The audience ignoring the visuals. This is central to my frustration with visual performance and must be solved if we are to succeed. It's the environment and expectations commonly associated with live performance that make it difficult to showcase visual performance. The solution is using an environment tailored to visual performance. We have them, key examples being movie theatres and opera.

For our smaller events, say like in Daev's garage, simple steps should be taken. Turn down the lights. Have the musicians face away from the audience and toward the screen. Have the video fall to black between compositions.

The above reveals my bias toward the artifact, not the act of creation. Ultimately, the experience of the observer is the critical event, and the main part of that happens between the screen and the observers eyes. However, personally, I am interested in visual (and musical) experiences that are not the same every time. That's why I like live music, and especially improvisational performers like the Dead. I believe live, improvisational, collaborative visual performance is exciting, beautiful, enlightening, and transformational.

Let's do some of that.

Performing graphics: Fine art or applied art?

Posted in culture & media design, performing graphics, tools on July 8, 2010 by visualraccoon

Don’t answer that question! (on advice of visual counsel)




There are certain distinctions dangerous to make. And certain questions that only solidify those dubious distinctions.

If you know that someone is using a computer to spontaneously generate images for a live audience, what exactly do you know?

Is there text?
Is there graphics?
Is there music?
Are there bar charts?

Is it for fun?
Is it for profit?
Could it be for both?

Will the material be on the final exam?

Are you enthralled or bored out of your skull?


It’s time to stop drawing permanent lines of demarcation for no purpose. They will only bite you in the butt later on.


As the raccoon once told an audience in Japan, “beware of Westerners bearing distinctions”.

Text vs Graphic
General vs Special
Group vs Individual
Beginner vs Expert
Social vs Technological

and now

Fine Art versus Applied Art


The sooner we stop trying to make these distinctions — trying to make them once and for all, permanently, applicable in every situation — and instead see them as contextual decisions of local practicality, then the sooner we can enjoy the cross-fertilization of dancing over boundaries.

Wouldn’t you like to be one of the folks boogying in the back because you were so moved by the content and the spirit of the live imagery?

The group’s ideas at the Tuesday afternoon meeting never looked so good.

For a good overview of the very fine applied art of performing graphics in service of group communication, see Lynn Kearny’s site.

And for a complete trampling under dancing feet of the dubious and dangerous fine/applied distinction, see the last chapter of Live Graphics Nightly.


Content on Visual Raccoon is licensed under a Creative Commons by-nc-sa 3.0 United States License unless otherwise indicated. Comments, both text and graphics, are property of the commenters.

VGA out for iPad SBPro, finally!

Posted in iPad on June 6, 2010 by visualraccoon

Kudos to AutoDesk — they did it right.

The image you are creating appears live on the big screen as you draw it, but the SBPro menu does *not*. The control menu only appears on the iPad for you alone to see and use.

Thanks to Rachel Smith for tipping me off that SBPro for the iPad had been updated.


Now that graphic recorders can work live using the iPad, this brings up a dilemma. If you only work full size, then at any time the group can see the entire record of the discussion. But you are limited in how small your lettering can be.

Jonny Goldstein‘s image is a good example:
(image (CC) Jonny Goldstein)



*Or* if you zoom and pan to get more detail, then while you are doing that the group will not be able to see the big picture.

This image of Rachel’s has lots more detail:
(image (CC) Rachel Smith)

But, as Rachel says, she has “concerns about sensitive persons in the audience watching my mad panning and zooming as I work,” and concludes that, “I think this is a great process for personal recording, but not yet for group work.”


So bottom line, iPad SBPro is like Zeno’s Paradox — it may never quite get there, but it keeps making progress in the right direction, and may soon be close enough for most practical purposes.

Which in the meantime leaves plenty of time for some darkhorse like vmacs for the iPad to slip in. Stay tuned!



Content on Visual Raccoon is licensed under a Creative Commons by-nc-sa 3.0 United States License unless otherwise indicated. Comments, both text and graphics, are property of the commenters.

actual iPad-based graphic recording

Posted in iPad on May 10, 2010 by visualraccoon

Good News!

Graphic recording on the iPad is here. The screen has the resolution, and SBPro has the graphic richness. That’s great, since those things are hard to change.
(image (CC) Rachel Smith)


Needs Work:

1. Live output to big screen. Not yet, but this is a solvable technical problem. Autodesk *should* be working on VGA out for SBPro right now; the capability is available to third-party apps. Meanwhile, for the examples below, neither of the practitioners featured were working in view of the group.

2. Operating SBPro fast enough for live output. Well, at least it's very close, see below for comments from the pracitioners. And, hey folks, speed is *merely* a matter of practice, right? (raccoon said cavalierly).



Examples:

More great examples, one set by Jonny Goldstein and the other set by Rachel Smith.

Rachel Smith

She describes her experience of doing visual recording on the iPad in wonderful detail on her blog.
(image and accompanying text (CC) Rachel Smith)

The above image is her representation of the keynote at the “Northern Voice 2010″ conference (sounds^H^H^H^H^H looks like a good one!). And here is a link to the rest of her visual records from the conference.

Rachel comments:

How Does It Relate to Visual Practice? Well… I wouldn’t use it (yet) for visual facilitation, where I’m interacting with a group and helping them work through something. It’s not as natural as pens and paper yet so I would be too distracted, I think. What I was doing at Northern Voice was visual recording, where I’m just listening and making notes.

Then there’s the issue of the size; when you’re doing visual practice with a group, either recording or facilitating, you want the group to be able to see what you’re doing. I have not tried projecting the iPad onto a screen while working, so I don’t know how that would work, but I’ve heard that not all apps can be projected yet [...] I think this is a great process for personal recording, but not yet for group work.

Software. I tried Autodesk SketchBook Pro ($7.99) and Adobe Ideas (free). All the notes in my Flickr stream were done with SketchBook Pro. The controls in SBPro are very easy to access while working [...] The controls in Ideas are a little harder to master and are a little too fiddly for me to use quickly while recording.



Jonny Goldstein

Jonny made “SketchNotes” of the speakers at the “140 Conference NYC 2010,” as desribed in detail on his blog. Here’s his sketch of the talk by the guy from Kodak:

(image and accompanying text (CC) Jonny Goldstein)

Jonny reported to me:

I played with it on a friends iPad for a couple of hours prior to doing these images. That’s it on the mobile app. I have used the full featured version of SB pro on a laptop for a couple of projects.

Yes, I added the not-hand written text on the first page in Photoshop after I created them in SB pro.

To get the images off the iPad, I emailed myself the files from the iPad. That is an included option in the SBPro app. You can email them to yourself with layers intact as a PSD (photoshop file), or as a flattened jpg. In order to do this, I used the iPad’s included email app.

My workflow: generally I would do my text and drawing as thin black lines on one or more layers. Then I would come in afterward and lay down thick strokes of color on a layer underneath the black lines.

Hardware: 1st generation iPad, Pogo stylus Software: SketchBook Pro App

And here is a link to his set of SketchNotes.



Content on Visual Raccoon is licensed under a Creative Commons by-nc-sa 3.0 United States License unless otherwise indicated. Comments are property of the commenters.

wall scrolling for paper hangers

Posted in paper-based, tools on April 18, 2010 by visualraccoon

Folks, I was doing the paper thing long before I ever touched a computer.

I love the smell of grape watermarkers and the feel of butcherpaper under my fingers and being able to turn and see the whole group, and simply the raw size and physicality of big paper.

In fact, back in the day, raccoon did a series of tool designs for paper-based visual performing media.

The first system was developed by using the phrase “Group Graphics” as guiding light and problem definition. It was observed that groups of designers often wrote and drew together as part of thinking about a problem. Big pads of paper on a table could not be seen by everyone in a group, flip charts on a wall were too small, and black boards did not support color, high resolution or saving of images. The solution was the “Wall Scroll,” a large sheet paper dispensing system for use by groups.


Here we see the Wall Scroll in use by David Sibbet at a meeting of the CORO fellows, San Francisco, California, September 21, 1971.

(hey, David, I’d like that prototype returned to me if you’re no longer using it 8-)


More details and description of other systems on the wall scroll page.


Content on Visual Raccoon is licensed under a Creative Commons by-nc-sa 3.0 United States License unless otherwise indicated. Comments are property of the commenters.

can dogs program?

Posted in animals do the web, cartoons on April 17, 2010 by visualraccoon



Content on Visual Raccoon is licensed under a Creative Commons by-nc-sa 3.0 United States License unless otherwise indicated. Comments are property of the commenters.

visual programming languages

Posted in animals do the web, cartoons, visual languages on April 17, 2010 by visualraccoon






Content on Visual Raccoon is licensed under a Creative Commons by-nc-sa 3.0 United States License unless otherwise indicated. Comments are property of the commenters.

Follow

Get every new post delivered to your Inbox.