Content

tagged: qmat

dr.spark

a new chapter starts: i am a student again, hopefully to have a doctorate in four years time. as twitterville put it, dr.spark.

Ph.D. Programme in Media and Arts Technology
An EPSRC Centre for Doctoral Training

Queen Mary University of London (QMUL) is one of the UK’s leading research universities and is located at the heart of Europe’s largest concentration of creative industries. We are launching an innovative inter-disciplinary training programme in the science and technologies that are transforming the creative sector. Our mission is to produce post-graduates who combine world-class technical and creative skills and who have a unique vision of how digital technology transforms creative possibilities and social economies.

This is a unique 4 year Ph.D. programme built around core courses in advanced research methods, interaction design and digital media processing, production and recording techniques and optional specialist modules ranging from Digital Audio Effects through Digital Rights Management to Contemporary Performance. You will work under the supervision of internationally recognised experts in: Digital Music, Digital Video, Human Interaction, Performance and Live Art, and Digital Media Law. You will also develop a working partnership with one of our strategic collaborators including: BBC, The British Film Institute, last.fm, SONY, Solid State Logic and TATE.

http://www.mat.qmul.ac.uk/

diary | 23 sep 2009 | tagged: qmat

soundtrap iv, beaconsfield

a quick retrospective post on ‘untitled piece for 300 speakers, pianola and vacuum cleaner’, the first of two really worth-it installations i’ve been to recently, this one a commission by beaconsfield. there’s lots of good stuff to read on the development blog of the piece (as well a photo to use for this post/). personally, even though it was conceived as a sound piece, the sound made no impression on me, but as a visual physical living breathing thing i was captivated. and it literally did breathe, the pianola hidden at the heart of those reclaimed speakers was fed by an ever flexing tube from vacuum cleaner outside.

diary | 01 nov 2009 | tagged: qmat

re-rite installation

second of two installations i’ve really enjoyed recently, re-rite is a multitrack recording of the philharmonia orchestra performing stravinsky’s the rite of spring, played out across 25 screens and the three floors and many rooms of the wonderfully dilapidated bargehouse. i’d have gone to see such a mediated-live-performance-with-lots-of-screens type thing anyway, and doubly so as the philharmonia partnered with friends yeast to make this (props, pulled it off to a really high standard/) but it really got under my skin: the experience was unique, beyond the goal of somehow giving the experience of being inside an orchestra on stage.

easy to explain would be the thrill of hearing a percussion crash somewhere else in the building come reverberating through while you were isolated with an entirely more delicate section of the orchestra. harder to convey would be as you explored the different rooms there was almost a touch of a haunted house rather than the known jigsaw you’d see on stage. at the heart of it is something that could only be delivered through such an installation, that wasn’t about the orchestral unit you see on stage, but was still very much about the orchestra, the music, the players. which is also why there is no photo from the installation above, just a production still i cullled from the website.

diary | 15 nov 2009 | tagged: vj · liveness · qmat

thor magnusson: thinking through technology

stand-out talk at the outside the box conference by thor magnusson, talking about making creative tools in the digital realm. ostensibly about the nature of digital music instruments, it really dug into how their design is far from a neutral act, and how in use our minds often extend to think through them.

there’s an academic paper from thor that deals with a lot of this at: http://www.ixi-audio.net/thor/EpistemicTools_OS.pdf

Through the analysis of material epistemologies it is possible to describe the digital instrument as an epistemic tool: a designed tool with such a high degree of symbolic pertinence that it becomes a system of knowledge and thinking in its own terms.

i’d be the first to admit its a much nicer way in to have the presentation before chewing on such texts directly, but its good stuff.

diary | 16 nov 2009 | tagged: qmat · research

live cinema interviews

my phd has this first year not doing phd stuff. which isn’t all bad: i have to make an “experimental documentary about a contemporary arts practice” to hone my media production skills. i think the brief was “make sure they know how to use a camera”, props to the film department at queen mary for challenging us with something a bit more interesting.

so here i am, mike’s EX3 in hand, spending a day or so running round london on a slightly gonzo mission to talk about live cinema with my practitioner peers. big thanks to chris, mike and paul for the interviews and sarah for the assistance and interested-outsider perspective. and this photo.

diary | 16 dec 2009 | tagged: live cinema documentary · vj · liveness · qmat · live cinema

christmas day = edit day

such seems my life: christmas day means a largely clear day to crack some of the live cinema documentary. not quite the idea!

diary | 25 dec 2009 | tagged: vj · live cinema documentary · qmat

vimeo staff pick!

CDM, the blog about VJing and beyond that seems to have the best signal to noise ratio, has just picked up the live cinema documentary i’ve been deep in the production of since returning, and has said some very nice things:

Utter brilliance: finally, our friend toby*spark has documented live cinema and visualism with a medium that reflects the concept. Music and video are presented as frames within frames, manipulated and placed interactively. It’s part fiction and illusion, of course, but that won’t stop you from dreaming as you watch of interactive audiovisual software that did behave fluidly.
I could say more, but just watch it. The video says it all. I hope toby and others pick up on this ideal and develop it more – both this narrative presentation, and the imaginary software it conceives.

ego massaged, what then happens: [vimeo staff pick](http://vimeo.com/channels/staffpicks#9065736)! a fairly niche documentary gets picked up and -- writing this retrospectively -- daily viewing figures go from the tens to the thousands, likes start pouring in and really positive comments appear. 

[on the writing this retrospectively theme, the next day [intellectual hero](http://itc.conversationsnetwork.org/shows/detail717.html) of mine bruce sterling [even posts about it](http://www.wired.com/beyond_the_beyond/2010/03/a-documentary-on-live-cinema/). like being touched by the hand of god!]

the world likes it!

diary | 05 feb 2010 | tagged: *spark · vj · live cinema documentary · qmat · live cinema

mat » a really touchy interface

i really like dave’s motives for this - touch control not on a flat screen, but rather a really touchy interface.

great timing with atau being on the campus on the same day as our ‘interactive digital multimedia technology’ course assessment/demo day.

diary | 15 feb 2010 | tagged: qmat

mat » invisible ping pong

with the augmented human interaction lab at their disposal, some of my media and arts technology partners made invisible ping-pong. tracking the bat position and your head, they piped in binaural (ie. positioned) sound to the headphones so you heard the ball rather than saw it. weird to play, but as atau observed, could be just the thing needed to augment the wiimote type games into the kind of natural feeling reality you need to best play the games, or wield that “bat”.

diary | 16 feb 2010 | tagged: qmat

light cycles? light rc car...

in reality, all very much a work in progress. but: if you wanted to track a radio control car around a room, and explode it remotely when it crossed its own trail, this is just how you might make the car.

diary | 17 feb 2010 | tagged: vj · physical computing · qmat · nort

mat » instrumenting audiences - 4'33"...

as part of the media and arts technology programme, a group of us have been investigating live performance in terms of the audience. its an area i have great interest in, believing that the entertainment can be an emergent property of the audience rather than something that has to be received from a singular performance/performer: eg. kinetxt. this project is more subtle than that, instead trying to tease apart what exactly makes an audience an audience and play with that. the first step is to stop thinking of an audience as a single thing. its a collection of people who at some point, hopefully, come together and somehow an audience emerges. its the interactions between the individuals that create an unstable state we call an audience…?

as our experiment, we created a mini-cabaret event and tried a few things out with our technological twists. here is keir performing john cage’s 4’33", and for once not because we suddenly needed to fill five minutes, but because we had the whole venue decked out as an audience noise feedback matrix, gently developing and becoming more overt through the piece.

diary | 26 feb 2010 | tagged: qmat · research · liveness

mat » instrumenting audiences - ...and the magic behind it

and mid-stripdown here are the audience tables, each one microphon and speaker’d up. these all turned into a lot of wires, a big multi-channel sound card, and a heroic max patch made by henrik. not a trivial task conceptually, making audience audio feed back - as in, bounce around, echo, etc. - without actually feeding back - as in, screeeeeeeeeeeeeeeeech!.

diary | 26 feb 2010 | tagged: i/o · qmat · research

me at the bbc: mythology engine

as part of the PhD programme i’m on, there is a six month placement in industry. i’m super-stoked that i’ve landed a project with the BBC that is right up my street, and could serve my ideas about live cinema very well. they wrote a great post on their r&d blog about what they’ve done so far, and springboarding from that i’ll be looking at possible futures for that kind of stuff. check out their post: http://www.bbc.co.uk/blogs/researchanddevelopment/2010/03/the-mythology-engine-represent.shtml

diary | 30 mar 2010 | tagged: qmat · research

thatcamp

to thatcamp london, an “unconference” ahead of the juggernaut that apparently is digital humanities 2010. loved the fact that for a conference organised on-line and firmly embedded in a world of twitter hashtags and multi-channel ADHD, the actual schedule was organised on the day using a giant chalkboard and people putting up their arms.

i was there for the semantic narrative / semantic web work i’m doing with the BBC, which has a lot of serious implications and opportunities for historians and whatnot, but these tweets are much more fun:

  • dancohen not to adore #thatcamp too much, but what other conference has academics, the BBC “future media” group, and comic book junkies in one room?
  • mbtimney more #doctorwho at #thatcamp! now we’re onto spitfires in space (an apt metaphor for our TEI / comic book / fanfic / narrative discussion)?

diary | 06 jul 2010 | tagged: qmat · research · bbc stories

dtc meetup

to nottingham for the ‘dtc summer school’, a meet-up of all the doctoral training centres that fall under the digital economy initiative. hosted by horizon, it meant the theme was right up my street: the lifelong contextual footprint, ie. the act of living is generating all this data/media, so what are we going to do with it?

given it was a meet-up and we’re the first generation, networking and sharing of research interests was built-in to the programme. show-and-tell, however, would have just been too conventional, so there were we with t-shirts, pens and 80 sheepish expressions. and yes, thats my shirt above, excuse the terrible photoshop shlepping of back and front. bonus twitter comment from jeremy morley: “seeing the different dtc student groups rather like the bit in shaun of the dead where shaun’s group meet an alternate group.”

lots of interesting stuff, including cool talks from matt adams of blast theory and aleks krotoski of the guardian and much more. it was a shame not to be able to participate in the “life stories” workshop, which was my interest almost verbatim, but the reason was good: my DTC MAT were hosting their own, and it was a little bit crazy: what if data were the fifth dimension? a thought experiment and some design fiction. there’s a kind of slides-made-through-the-workshop pdf attached, including the diminished-reality-3000™.

the marvels of the internet and the crowd there being what they are, there is already a series of blog posts that outlines the various talks and activities there: props to liz valentine.

diary | 16 jul 2010 | tagged: qmat · research · bbc stories | downloads: DTCSummerSchool-QMUL-SpaceTimeData-Web.pdf

bbc stories viva'd

time on the bbc stories project is up, report is written, academic viva viva’d.

couldn’t help myself but use hitchhiker’s guide to the galaxy as the example of a property crossing media. there’s a kick-ass letter douglas adams wrote to some film executive when hhg2g was in development hell that starts to open up just how different the approach and result of the different adaptions should be. however quoting it (i’m sure i read it in the salmon of doubt) would have been an indulgence too far for a 10minute whip-through, so here is me venting that one.

its a good presentation, both an interesting topic and nice slide deck, i hope to get it recorded to go with the pdfs of report and whatnot i have made and put up as a tobyz.net project page: project/bbcstories.

diary | 31 aug 2010 | tagged: qmat · bbc stories · research

art+com

i also had my media+arts technology comrades in town for the draw of transmediale itself. being in berlin, one thing on our agenda was art+com, who have pulled the trick of a) having produced some of the most inspiring work, period (a major reference of mine: computer vision tracked video mapped scenography at the opera… in 2002) and b) doing so with a productive cohesion of commercial work and academic practice. they truly are the model for ‘industrial outreach’; it’s the direction so many universities want to go in, but it seems to me still somehow industry and academia get viewed as oppositional here.

diary | 05 feb 2011 | tagged: qmat

the live in live cinema in 4,000 words

having just overhauled the ‘about the live in live cinema’ presentation for the IMAP seminar, i thought it should be quite straightforward to translate this into a 4,000 word essay – my penance for sitting in on a module from QMUL’s excellent drama department last semester. how wrong could i be, the structure to my argument turned out quite differently. all the better for it, however.

Three silhouettes, bodies poised above glowing buttons; a piercing light scanning light beams across the void of the image. ‘Rhythms + Visions: Expanded + Live’ says the text. Flipping the flyer over, the venue as School of Cinematic Arts, University of South California lends an air of authority, and finally in the body text a definition: ‘a live-cinema event’.
I was there — in fact, I am one of the silhouettes on the flyer — and the ‘live-cinema event’ shall frame the following discourse on liveness, media-based performance, and how the role of performance in a true live cinema needs to be rethought.
Walking into the School of Cinematic Arts, there was no being led into the dark of a cinema theatre, rather this would be an exploration through the outdoor spaces of the complex. Moving image works were aligned onto the architecture, and scrims echoed projections in space. Finally, a stage area. The first act starting: Scott Pagano accompanied by four musicians. For the unconventional setting thus far, this is a setup all will recognise: there is what could be termed a cinema-grade screen with performers in front, and rows of seating laid out beyond.
The musicians are playing, seemingly consumed by their instruments and keeping in check with each other. Pagano is standing, the only one twisted around to face to the screen rather than audience. In his hands, an iPad upon which — and with — he is furiously gesturing. On the screen an abstract composition unfolding, organic forms built out with photographic elements, a triumph of aesthetic. The music is instrumental and amplified, without naming a genre it’s accessible to the Los Angeles audience: guitars, keyboards, percussion. The audience seem receptive; there is a pleasing fidelity and sheen to the work.
But what here is live? But what here is cinema? These are the questions in my mind as I watch, and to which we will return.
Next a performance from the collective of which I am part, but not a piece with my direct involvement; I am still in the audience. Endless Cities by D-Fuse. It is a film in the Ruttman and Vertov tradition, a montage of urban scenes from around the world, and is accompanied by a live score: musique concrète performed from laptop with percussion accompaniment. Again it seems accessible, and in the photographic detail there is much to latch onto and be absorbed by.
It’s Live Cinema in the sense that I first heard the term: a musical accompaniment to a silent film. A montage from the kino-eye, it’s easier here to answer ‘what here is cinema’ than the Pegano piece. But I still wonder, what is really live here, and why bother?
The final performance is in many ways my creation, and so here I cannot report from the audience, but can offer my view as a performer. Which is one of immense frustration. Starting out, I am in a good position: we have an expanded staging that breaks the imagery out of the single frame, a developed aesthetic that abstracts footage in sync to the music, and the impressive shot bank of Endless Cities to pull from. It’s less the dérive and more the impressionism of a late night taxi ride. And we’ve performed it really well before. But that is precisely what is killing me by the end of this particular performance. We have performed it better before, so wouldn’t a recording of that performance have served us better? It’s a recognition that performance in this context translates entirely to the audio-visual output, for our actual performance is opaque to the audience, operating somewhere between obscure symbols on an obscured screen and twitching trackpad fingers. At which point, rather than taking the best performance so far to play back, I ask myself why not just create a master version in the studio and be done with it?
This is the terrain from which I argue. My motivation is not to categorise art or debate concepts, but to get to the heart of what a true live cinema could be.

The essay needs a revision – given the time constraints its really just a first draft – for which 'about the live in live cinema’s next outing should provide, whether that is website, journal, seminar or lecture.

diary | 03 may 2011 | tagged: live in live cinema · research · liveness · qmat · live cinema

qmedia open studios

the programme i’m part of at university – media & arts technology – is quite a leap for the department to have made. perhaps it could be characterised as they realised they had lots of technology research, but nobody around who did things with technology, so they got in some artists, hackers and whatnot in to see what would happen. but rather than create an island of ‘cool’, the plan was to embed MAT within the culture of a science and technology department. very laudable, but has been so frustrating at times: institutional intertia and so on.

qmedia open studios felt like the turning of the tide. an exhibition of work going on in under the umbrella of qmedia, it was a new way of doing things for the department, from minor victories like getting computer science to buy white art plinths and equipping a workshop as a proper hack lab, to helming conceptual shifts in how research can be linked up across the department and communicated to the public. i’m proud to have been a force behind it.

diary | 05 may 2011 | tagged: qmedia open studios · qmat · research

qmedia open studios - shots

there is a full gallery of prints and photos from the open studios up on flickr. i had camera in hand pretty much the whole time (or rather with this lovely strap) and there’s a number of shots i think that get towards the spirit of what happened. but my favourite is this quiet shot, which for me tells the whole story: kinect, custom code yet in the context of an ornate frame from an age where mirrors themselves were the cutting edge of technology. for this mirror can play with your image, reconstructing and (re)animating a shadow from skeleton positional data. its also serious research: if we can systematically manipulate how your mirror image reacts, we can learn much about human-human interaction and notions like empathy. what illusion is shattered when your technologically mediated shadow decides to pick its nose?

diary | 05 may 2011 | tagged: qmedia open studios · qmat

1

2

3

4