quartz composer

tresor backstage, 1am, get to the final compile of here+now for the 3am performance. there is never enough time in this world, and for experimental projects on the side doubly so. the dream of just hanging out at a festival…

there’s no denying its like a flight deck of buttons, but props to vdmx’s configurability and plug-in friendliness. full playback control of both single screens and the dualhead spanning as quicktime sources, and a hardcore quartz composer patch wrapping a lot of custom openGL code, fronted by an interface builder laid out UI panel.

in barcelona on a solo d-fuse mission: particle to audio by asférico, refactored down to a dualhead screen setup. good gig: refactoring prep worked out, no nasty surprises throughout, performance felt smooth.

after a month with a heavy dose of xcode on the side, its up to newcastle clutching two fledgling applications to marry with newcastle library’s digitised photo archive, a bunch of iMacs clustered around a 1080P plasma screen, and the memories of the visiting public. it was a heavy weekend of being there with the installation by day and further coding by night, but out of this a very real and user tested photobank has been born.

as the latest manifestation of my personal practice, and something that will very likely become part of my PhD research, there is much more to say than a quick diary post can stretch to. so the full project page will come, i guess in the meantime its easiest to point the lineage to kinetxt which was - with novak - my first attempt at creating an environment where layers of interpretation are encouraged, and they in turn add up to something interesting and unexpected. photobank tries to address this in a more focussed and repeatable way, starting with a base of media archive, and ending with a flow of illustrated short verse.

at the nuts and bolts level, its a full screen photo browsing and annotation application that can be run on many computers for mass interaction by the public, which are networked to a central computer holding the photo archive and running the central display, which acts as both an attractor for the public, animating through the archive and latest annotatations, and as the writer’s tool for creating and showing mini-narratives by selecting six photos and their annotations, and handwriting short verse around them. all written as native mac osx applications using objective-c/cocoa and quartz composer.

with the standard in the bank, it was onto the experiemental performance, the world premiere of ‘particle’.

Particle explores urban conditions on an abstracted level. While projects like Undercurrent, Latitude and Surface look at city life in its social and psychogeographical dimensions, Particle zooms in on details of the urban fabric and reveals a web of rhythms, patterns and textures.

particle is also in many ways a rite of passage for me; its not often you get the chance to take an HD film and transform it into the next-generation ‘we wrote the book on vjing’ d-fuse performance. there’s a lot more work to do, especially in creating an audio-visual syncronicity in collaboration with particle’s musician matthais kispert, but we rocked it and got such a positive response. there is a video showing some excerpts of the performance here: http://vimeo.com/5787905

i’m really happy with
- the staging with an 8x3 ‘cinematic’ canvas behind us and a mesh screen in front, with that projector throwing forward through the mesh into the venue+audience. people loved the ‘holographic’ or ‘3D’ nature this gave to the performance, and i personally love how the forward throwing projector beams the dancing lines and other abstractions of the performance throughout the venue, immersing the audience in the ‘trip’.
- the twin laptop setup enabled by the dvi crossfader i created and our solid state drives. the ability to tag-team the performance really transforms things, allowing the breathing space to check pace and prepare for the next section. and within each laptop, being able to seamlessly scale from cinematic playback to ultra-noodle is so empowering as a visualist.
- the customisation of my vj tool of choice, vdmx, allowing panels dedicated to doing creative things with 4x3 and 8x3 sources within the 12x3 canvas. this was achieved with a combination of quartz composer sources i made, fronted by an experimental vdmx feature allowing you to build your own interface plugins, and backed by a set of quartz composer plug-ins i’m working on that scale to any canvas rather than working per-pixel in the source resolution.

thanks to itaú cultural for the photo

abertura was the first time i really got to throw myself into a ‘particle-esque’ performance, using the d-fuse content with the live setup i’d created. as a warm-up for são paulo, it was a great one: the music and visuals really came together to give an intense show in the relatively small space of abertura’s hall, it really gave me a confidence boost.

i captured five minutes worth from abertura’s documentary footage, and its on vimeo here: http://vimeo.com/5731407

beyond visible things like keane3D, lots of work has been going on in the background with d-fuse this past year or so. some of it pitching, some of it pushing along internal projects, and at the moment a massive commercial job under NDA: all things which don’t really get to this diary. but i’m glad to announce a little preview of something i’ve been working on a while, which is transforming d-fuse live.

as part of electrovision on saturday the 18th july at roxy bar and screen, d-fuse will be performing for the first time with their high-def laptop live setup. it will be something between a test of the setup and a preview of the performance that will become ‘particle’, so all are welcome and beta-tester feedback appreciated!

there’s much more to say about what has been developed for this setup, but in the meantime here is the blurb i wrote for electrovision:
D-Fuse present a work-in-progress viewing of their new live performance, an experimental audio-visual triptych exploring urban conditions. Having mastered an HD production process for films such as Brilliant City and Surface, they have challenged themselves to bring this back into the live arena and with the graphical sensibility they are noted for.

pictured: vdmx work-in-progress setup, with amongst other things custom quartz composer 4x3 into 12x3 layer, backed by unreleased open-gl based qc plugins, and fronted by a native vidvox control layout.

anton dropped into the qc class to show how qc can be extended by installing custom plug-ins… which naturally featured a fair bit of glitch.

it felt funny there being a quartz composer workshop, me not giving it, and the copy being beyond something even i could even have pumped-up (world exclusive! creator of the most widely viewed online video tutorial series!). but definitely a sign of progress in this world, so props to graham (centre back) and lpm. the class had a good time, and the word was spread: hopefully more interesting work will happen because of it.

this was perhaps the most inspiring moment of lpm for me. to set the background, i’ve been planning a entirely new paradigm of vj interface for years now, have a subversion repository with a project to that end, and have had many discussions with people like anton about how flightdecks-of-buttons suck and where are we in our quests to make something better. the short answer is: years in, far from anything demonstrable due to the overhead of having to write such a thing from scratch.

enter david, who was kinda freaking out about a hip-hop gig he’d been asked to do, as he wasn’t sure how to get the scratch control and ‘ting required. two hours later, he had a whole functioning gestural interface for vdmx using a tablet and the ultra-cool idea of tracing a line through a… er… control space along which pulsed the beat. a) genius b) rapid prototyped in two hours c) vdmx is cool because it can host qc, but the conceptual shift here is it works the other way round, a qc interface running in front of vdmx sending commands via open sound control.

awesome. watch the video: http://www.vimeo.com/5019365