tagged: quartz composer

finally making something of a long-talked-about spark project: immersive and interactive visuals in a dome. hoping to start with some basic ‘chuck a ball about in the crowd’ type stuff, and get to a fully playable asteroids or missile command.
first test: can i tile small sprites in 3d space as if they were placed on a sphere? answer here: only sort-of. they are on a sphere, but they’re certainly not in neat rows like they should be, or aligned to the surface.

diary | 02 aug 2008 | tagged: *spark · quartz composer · vj · dome

gave a complete overview to quartz composer from a vjs perspective, and got some really nice feedback. photo by todd thille.

the basics

1. getting beyond quicktime clips: what qc can do for you
   ie. dancing abstract 3d a la toneburst and memo
   ie. animating text files in your vj sets
   ie. making dynamic installations

2. quartz composer 101
   your first patch
   dynamic controls
   the key idea of time
   common pitfalls

applying it and getting advanced

1. qc and vdmx
   qc as dynamic clips
   qc as filters
   qc as rendering stacks

2. shaders
   image kernels
   glsl

3. 3rd party plug-ins

diary | 24 may 2008 | tagged: *spark · quartz composer · avit-vj-network · vj · teaching · visual berlin

a kinetxt self-portrait, with the isight camera on me rather than our bullet cam on graffiti writers. more importantly, this is my contribution to the kinetxt event working, the interactive text messaging display ready to hand over to novak for tuesday’s installation / performance. huzzah!

diary | 01 mar 2008 | tagged: *spark · quartz composer · vj · kinetxt

wiimote with 2 diy ir markers + 2 bullet cameras into uncompressed quicktime stream converters -> laptop running quartz composer with 2 weeks of custom coding -> triplehead2go giving a canvas of 2400x600, 18” wide when projected.

of course, qc won’t accept the two streams simultaneously. vidvox worked it out, apple didn’t for the own tool. tsssck.

diary | 27 feb 2008 | tagged: *spark · quartz composer · vj · video-out · kinetxt · video-in

being able to code custom plug-ins is really making quartz composer so much better: not just giving the ability to make different types of ‘teh pretty’, but letting qc’s patching world do what its best at - fiddling with views - and leaving the coordination and control aspects to a dedicated lump of code, like a brain sitting in the middle of the patch.
long story short, this kinetxt installation is seeming like a case study in the object-orientated / model-view-controller way.

diary | 25 feb 2008 | tagged: *spark · quartz composer · vj · code · mac os

having worked through the hillegass cocoa book, its time to start putting that to good use. and project number one was always going to be one of the big glaring omissions in quartz composer to my mind: a means of animating a string on a per-character basis.

if you want to compete with after-effects, then you need to be able to produce the various type animations directors are used to, and you need to do so at a decent framerate. to animate say the entry of a character onto the screen, you would create the animation for one character and then iterate that operation along the string. the problem is, rendering each glyph inside the iterator is both massively expensive and massively redundant, but thats the only approach qc allows, hacks on the back of hacks apart. a much better approach would be to have a single patch that takes a string and produces a data glob of rendered characters and their sizing and spacing information, firing off just once at the beginning and feeding the result to the animation iterator: at which point you’re just moving sprites around and the gpu barely notices.

the patch is released under gplv3, and is attached below.

a massive shout to the kineme duo for leading the way with their custom plug-ins and general all-round heroic qualities. in particular their ‘structure tools’ patches were the enabler for those early text sequencing experiments.

diary | 15 feb 2008 | tagged: *spark · quartz composer · vj · code · mac os · release | downloads: SPK-StringToImageStructure-1.0.zip

system diagram: discussed, ok’d.
wiimote: check. triplehead2go: check. folder of text messages: check. custom qc patch to enable text animation: check.
blend together for kinetxt v0.00000001.

it doesn’t do much, but its a start.

diary | 15 feb 2008 | tagged: *spark · quartz composer · vj · kinetxt

hello jasmin and her superproduced content commissioned for the american shows. the (and i use the word loosely) car driving in is something to behold: a “green” monster truck, complete with rocket-launcher-esque hydrogen tanks racked up on the back.

diary | 14 nov 2007 | tagged: *spark · quartz composer · vj · vdmx · ford vj

guess what we were up to. if only leopard and reactivision would play nicely together: the qc osc receiver doesn’t seem to be receiving what it should, and its beyond me to port the tiger hacked-up plug-in to an official api leopard one. that is something that will hopefully change after christmas, when i finally embrace cocoa and the live cinema interface.

diary | 01 nov 2007 | tagged: *spark · quartz composer · vj · teaching · name · novak

straight from a marina in italy to a biscuit factory in newcastle, home of the most proper name. they had organised three days “mentoring” aka professional development funded by the region, and i was the mentor. first up was quartz composer 101. so glad we waited for leopard to debut, what a change: its actually sane now!

diary | 31 oct 2007 | tagged: *spark · quartz composer · vj · teaching · name · novak

…and this is what it was looking like when i hit the screengrab key-combo before putting the mac pro in its flight case to start its journey to frankfurt.

diary | 03 sep 2007 | tagged: *spark · quartz composer · vj · vdmx · ford vj

this picture is but a snapshot of the revolution. it really feels like that. a real let-down of the geneva motor show pre-production was the inability to translate the creative agency’s after-effects rendered text animations into the live, dynamic setup. there just was no way to implement anything vaguely sophisticated without seeing the framerate drop to near zero. structure record, something driven by video sampling and seemingly tangental to text rendering, is the key to solving that problem… and so here it is solved, as if on cue for the frankfurt motor show.

diary | 13 aug 2007 | tagged: quartz composer · vj

if the above picture means anything to you, go check the new kineme.net site. a shell script node - the universal hammer - and structure record - hello video sampler - are my two most wanted features. icing on the cake: open source.

diary | 06 aug 2007 | tagged: quartz composer · vj

as shown in the ‘pun me this’ entry, the *spark titler was used in nascent form at sheep music, and the promise to tidy-up and release as open-source software has been followed through. so, please find attached: sparktitler-v1.1.zip.

the titler’s interface allows you to take between two sets of title/subtitle, with the choice of four backgrounds: black / green / a quicktime movie or a folder of images. the output window will automatically go full-screen on the second monitor if it detects one is available at launch, otherwise it will remain a resizable conventional window.

it is released with the intention that it can be reused for other events without changing a single line of code: you can design the animation and incorporate quicktime movies in the design by editing the ‘GFX’ macro in the quartz composer patch, and its a matter of drag and drop replace the logo in the interface.

for those who wish to dig deeper and improve the whole package, the source is released under GPL. the xcode project provides an adequate shell for the patch, implemented with just two cocoa classes and an nib file complete with bindings between the qc patch and the interface window. the classes are required to tell the quartz composer patch where to find the resource directory of the application’s bundle (neccessary for any ‘image with movie’ nodes), and to subclass the output window so it is sent borderless to the second display if appropriate. features apart, there is certainly room for improvement, a ‘open file’ dialog instead of the raw text fields would be good, likewise solving the text field update issue.

if you do use it, let us know: operator@tobyz.net

diary | 30 jul 2007 | tagged: titler · release · *spark · vj · code · mac os · quartz composer | downloads: sparktitler-v1.1.zip

the latest visuals technology development to come off the *spark anvil is a mac-native titler application, made by wrapping a quartz composer patch with some fullscreen code and interface builder bindings. props to roger bolton of quartonian for the guts of the fullscreen xcode project, shared under gpl so expect to see the titler soon once it’s been tidied up.

truly came into its own during the ups and downs of the first day of the festival, where a huge rainfall threatened to wash away half the site. we could upload videos and images taken moments before, and pun the titles out till they got beyond baaaaaaaad. ‘shave yourself’ still my favourite.

diary | 20 jul 2007 | tagged: quartz composer · titler · vj · sheep music · code · mac os

showing eloi and sean my live cinema work and the state of play on macs, with vdmx, quartz composer and image kernels

diary | 12 jun 2007 | tagged: *spark · quartz composer · vj · vdmx · adventures · sónar

here is ‘re-engaging reactive graphics’ from a post or two ago, in its final projected form (or at least, one frame of one of the permutations i delivered). its on tonight too, as part of the south bank’s overture event, the re-opening of the royal festival hall. 10.30

diary | 09 jun 2007 | tagged: *spark · quartz composer · vj · photo · light surgeons

here is a prototype/demonstration of using your own image kernel in vdmx. rather than being an effect, this is an A/B mixer that means you can use vdmx in the ‘old skool’ way, by mixing together two video streams rather than rendering the whole stack of layers. it also has controls like a DJ scratch mixer, so as well as a crossfader, you’ve got a fader for each channel, and a fader curve control.

to use, make a layer or group for the A channel and another for the B channel, and a layer at the top of the stack for your output. trigger the qc patch in the output layer, and assign the A and B layers/groups to its video input drop downs.

if you open the qc patch, you’ll see the video inputs get resized to the output res, as image kernels don’t handle different sized inputs too well, and then all the inputs are fed into an image kernel, ie a little filter written specially for the graphics card. in that there is some basic maths for applying a variable crossfade curve, and a line that adds the two inputs together. take a look, its not so hard; i have far more trouble with doing things like translating the crossfader curves into a mathematical expression than with the code itself.

so take this as a starter for ten if you’re interested. attached below.

i have my own mixer now that does three channel mixing just how i want, and its really cleaned up my vdmx interface^[1] let alone the directness of the processing. sweet.

diary | 08 jun 2007 | tagged: *spark · quartz composer · vj · vdmx · release | downloads: spark-DJmixer-v3.qtz

back in the early days of visuals in brum with the most talented stef lewandowski, computers could barely hack video and so the dynamic stuff was a combination of flash and good old mixer twiddling. flash was cool for making loops, at a basic level if you had a few layers, you made them different lengths and they would loop independently pretty much always giving you a new combination with each frame… do that with a pre-rendered loop and it becomes clear you’ve only got a second or two worth of frames pretty immediately. then you could bring in text read on the fly into your graphics and allsorts.

all that pretty much got left behind when i went to the single laptop with the vdmx video based vj setup, quicktime loops or nowt. much richer, much more interesting capabilities for mixing that video, but no dynamic/generative content.

so continuing the theme of the vj platform really delivering on the mac nowadays, with dual-core/decent-gfx-chips and osx/vdmx-in-cocoa, it was nice to have a commission to make a graphic layer for the light surgeon’s contribution to the reopening of the royal festival hall, a commission where keyframing it all would be madness, and new the visual identity of the south bank centre lent itself to a generative machine.

so not quite hello flash again like the days of old, but quartz composer parsing the audio spectrum and turning that into reactive combinations of the sbc’s weave. and given the pain of editing a 4xSD wide canvas from a huge media library, its actually a shame the whole thing couldn’t have been a prototype for the innovative live setups coming into view.

diary | 06 jun 2007 | tagged: *spark · quartz composer · vj · light surgeons

today i programmed my first image kernel, another step on the journey of making custom technology to fulfil what i want to do artistically. and this one was with real, low-level code: its basically writing a shader for the graphics card, eek! actually not so hard at all, the code was pretty easy, it was the process of working out the maths required that took time to wrap my head back around.
osx is developing so well for video: you can write your image kernel in the appropriate quartz composer node, load that into a layer in the vj app vdmx, and then find all your kernel inputs natively displayed in the vj interface. so now not only do i have the exact kind of mixing i want processing at maximum efficiency, i’ve simplified my vdmx setup no-end with just one panel with all the controls, instead of a mish-mash of filters and blend modes spread around the different layers.

diary | 24 may 2007 | tagged: *spark · quartz composer · vj · vdmx