Home / Projects / Final Major Project

Final Major Project



Welcome to my Final Major Project. This project concerns itself with many forms of interactive art. Both performance, written, digital, scribbled, drawn, audio, doodled, shouted, whispered, viewed from a far, from a near and everything else that can be altered and developed, evolved and reinvented by anyone who so should chose... and more.

Please take a look at the 'reading my projects' section on the projects page for an overview of how my project should be read. Thanks!


Web Camera Motion Detection Demonstration

I've been playing around with web camera detection in Flash, in Processing, in a myriad of different 3rd party tools and even some of the professional and corporate tools. I've reinstalled a computer and wiped all my music to install Linux to see if that helped and I've tried my damned hardest to get something that's worth presentining. I just don't seem to be able to get it done.

If I were a better person then I would have created this:



All my attempts at getting a decent display going have been to no avail. It is here that I draw the line and put concentration back into my microphone project.


Microphone Detection

Opposed to the flocking birds, I have decided to try and make something that simply reacts to sound in an interesting fashion. Having spent the best part of 3 hours trying to get birds to fly away, all I was left with was a mish mash of dots flying out from the center of my screen in a very unimpressive manner.

While my microphone detection script is probably far from perfect, it is however entirely my own code. The only resource I used for this was the adobe live docs resource to get the correct classes.

In keeping with my installation theme I have made this project to be used as a digital wind mill

Photobucket

The idea behind this is to demonstrate Flash reacting to microphone volume levels and then output a visual display.

Photobucket

Whilst playing around with my creation, watching the spokes spin to the level of volume I noticed that it best responds when the microphone is gently blown upon. This gave me the idea to re-create this graphics so that it looks like a windmill, or rather more like a little wind mill. Something like a kids play toy. As seen below:

Photobucket

If the microphone were to be connected (an all weather mic that is) to a high point that caught the wind then a visual display 'should' have the spinning effect I'm after. This isn't something that would work for a demonstration within the classroom environment however, but is something that I would like to improve the project with. I could even include clouds that moved to the strength of the wind. I think this is something that I could easily update my project with should I have had more time to do so. Instead I will make these improvments hopfully for the Summer show. As the final product stands it's just not quite enough.

Photobucket


The Essay

Part of the brief that I am working towards requires me to write a 2000 word essay, relating to back to it's digital mediums. The essay can be found here at FMP Essay.
In keeping with my theme thus far I will be conducting my essay on performance arts, both digital and otherwise, concentrating on political and sociological demonstration arts.

This is both a theme I find very interesting and theme I have already read a little into. I'm hoping that doing my essay on this subject will be useful to the third year.


The Exhibition

For the exhibition (summer show) I wish to use 2 computers to display 2 different demonstrations of my work. I will display on one screen a demonstration of my web camera work and on the other a demonstration of my microphone work.

I will also use large white foam boards to mount around the outside of the 2 monitors (so the screens just poke through hole I cut into them) and on the boards I will display some background to what I've been trying to do with my time on this project.


Birds

At the sound of a clap, or higher volume noise, birds will take flight.
The plan is to use Flash to detect volume levels from a microphone and to respond to higher volumes with a defining action. One possibility is birds fleeing from the sound.

An interesting YouTube video that I found seems to show the possibilities of what can be achieved using Flash. However, I think a lot of the audio and visual detection behind this application is most likely handled by 3rd party software. It's still a nice example of the things that can be done.

In order to start with I will be looking through the usual suspects of tutorial websites to find examples on how audio detection works. I will start, as is always a good start, with Adobe Livedoc. An excellent no bullshit resource of Flash capabilities. It's no tutorial, but it's got plenty of detail about hundreds of Adobe software related topics.

Capturing sound input

The Microphone class lets your application connect to a microphone or other sound input device on the user's system and broadcast the input audio to that system's speakers or send the audio data to a remote server, such as the Flash Media Server.

Subtopics

Accessing a microphone
Routing microphone audio to local speakers
Altering microphone audio
Detecting microphone activity

Sending audio to and from a media server


Flash CS3 Documentation 

ActionScript 2.0 Language Reference > ActionScript classes > Microphone

Using a basic microphone activity detection script to generate a numeric readout in the form of a variable I should be able to link this to a function that generate's the birds.

TO BE CONTINUED


Processing and Flash

Processing has on it's side, in droves over Flash, hardware interaction capabilities and potential live installation usage. Of course it does, thats it's exact purpose. However, and this really is a point I'm trying to make by ignoring the beta flag that Processing has over it, Flash is by far the most compatible application for a Windows based system and for web based application on all OS's. Well of course it is, that's what it was designed to do. For a project like this, where I initially intended to make a more installation orientated piece, Processing is the obvious choice. Flash is still very much capable of pulling off a lot of what Processing 'can' do with half the effort required. While both languages that Flash and Processing use, Flash still retains a much more inclusive and tidier approach to code driven design. Certainly a move the Macrodobe has made with Flash is a move away from this towards a much more unified language that looks much more familiar to the more code intensive programming of other C based languages, including Processing. From what I can tell it's Flash trying to re-asert itself as the dominent 'professional' rich media content in light of the approaching of Microsoft's Silverlight, which promises also, to have a massive impact in the way media is presented online.
On a more installation note, which is what I'm trying to concentrate heaviest on, Processing manages to show it's greatest strengths. Performing with excellent resource demands on the system on which it's running and allowing for professional end hardware interaction.

Linux

Because of the limitations from working with Processing and Windows I decided I would try working with Linux as another supported operating system that I can access from home.
I work from an Asus A7c laptop which I purchased last year to replace my steadily dieing Evesham desktop. However, the desktop still remains with no working monitor or motherboard fan. I bought a new monitor from a charity warehouse for £7, installed Ubuntu Linux and risked the enevetable melt down of my motherboard. Linux is an excellent platform, providing you chose the right distribution and give it some time to grow on you. It is the best way to resurrect an old system with it's much improved performance over Windows, but it really isn't the most user friendly option. Despite Ubuntu aiming for easier general public use.

Installing Ubuntu was a cinch, installation of graphics drivers is not so easy. In fact installing graphics drivers for my card (Radeon 9800 pro) took me a good 2 hours trying to figure the inner errors and workings of Linux to still no avail.

Processing does work on Linux, and it works well. The default drivers that help power Ubuntu do allow for openGL support and so Processing is able to render quite happily. QuickTime libraries fail to open, as do most Java libraries. I'm sure this can corrected, and I really have tried myself, but to get these programs correctly working with Linux I need to have a greater basic understanding of how Linux works. Restricted as I am at the moment to simple console commands and the poor following of tutorials. sudo gedit /etc/X11/blah.whatever

Open Source

I've used Linux many times before, mostly using live CD's for troubleshooting when Windows hits the fan. Using Linux constructively for my work I find it too time consuming on the console commands and refusal to self install a lot of material and programs. One of the reasons I keep coming back to Linux though as an operating system is my love of open source development. There are even builds of Ubuntu specifically tailored to include unconditionally ONLY open source software.
The open source community is one of the fastest growing social trends, allowing the massive collabrative effort of many people to build industry standard applications entirely allowing for the reuse and recycling of source code and binaries by anyone who should so chose. This method of development allows for great beta testing, upgrading, tailored features within the program and the garentee of no hidden spyware. It is an essential step towards a more open and friendly online society. Linux of course being the corner stone of the open source community and a monolith of what can be achieved using this philosophy of creation.

As a side note; Ubuntu was good, I think as far as Linux builds go there are better out there. The first distribution I used was the infamous 'RedCap', which although still one of the leading server builds is a bit 'advanced' user for me. Linspire is a good option for a more software compatible build but I think Suse Linux will be my next stop.


I Love My Processing pt 1.

I don't like Processing, because Processing doesn't like me.
Or rather, Processing doesn't like Windows. Processing draws heavily on various QuickTime libraries for a lot of things, especially video capture. Due to the limitations of my operating system, I shall forth with no longer pay attention to video capture under Windows using Processing. Instead I shall be looking closer at the audio capabilities of Processing, and in particular I will be looking at microphone detection.

I will also be returning to Flash in order that I explore some of the comparisons between it and Processing in relation to compatibility, ease of use and their ability to play with and detect hardware.


[RE-READ] A Different Approach to The Project

During this project it has become obvious that I am enjoying the research a lot more than working heavily towards a final, single piece of work. Finding it a lot easier and more interesting to read about what people have been making, how they have made it and where it is these works can be found. Instead, I propose that I create a collection of tests, examples with supporting code and resources. Instead of just cutting my work load in half I will create for myself, and others, the starting of a massive collection of information on varying digital arts subjects. The very nature of it being a wiki means that it can be improved exponentially by countless anonymous users. Or just over the course of this project and the following year by myself so that it might be stumbled across by people after resources for their own interests and projects.

I hope this will grow into a site that people may well return too, but in all likelyhood that is an approach best left for blogs. Instead I would imagine, if possible to enter onto search engines (which I think it is), a site that is found when people are using search engines to find related articles of interest.
I will want to create some sort of presentation for the end of the project that summerises what I have found during my research for display purposes. This is what I will be calling my final outcome.
At this stage, what I imagine it to be, is some interactive examples of work with information on related projects.


Arts Council Funding

Audio/Visual displays are used in a variety of different places and people pay varying amounts of money to have them in their venue. Whether it be a club, where they want a audio reactive display or a restaurant, where they may want something that simply sets a mood for the place with some nice passive colours. What ever the case may be, people do pay money to have digital installations. As can be seen with Troika, where they made some installation pieces for British Air, digital installations can be a great way to show off a companies modernity.
Some of my favourite AV displays are found in clubs. Visual backings that react to the music being played add a great deal of atmosphere to an environment such as this.

Other sources of income for the installation artist is found with arts council funding. Building great works on money funded to artists by the council is a great way to make a name for anyone just starting out, and there's plenty money there to be had if you've got the drive to get it.

Derived from the arts council website:

  • Grants for the arts
    We fund arts activities that benefit people in England, or that help artists and arts organisations. If you have an idea for something you want to do with the arts, find out more about Grants for the arts, our main open application funding programme.

  • Regular funding for organisations
    We regularly fund around 880 arts organisations on a three-year basis, investing £350million per annum by 2010/11. Our support helps bring high quality work to a wide range of people - as both audience and participants.

    As can be seen, £350 million is a lot of money. Arts council funding is also growing in the number of funded artists and the amounts being funded to these artists each year.


  • Flash Motion Detection and Fire

    A friend of mine (Mex Death Whore) showed me a website, a link I've lost unfortuently, whereby someone had used Flash and a webcam to mimic fire leaping from places where motion is detected. The idea was that it make you look like 'Ghost Rider' as this was a promo for the new film, don't see it (trust me, Nicholas Cage is a moron and can only be accreddited to a handful of films. He does not deserve the acclaim he receives. However, if you do fancy seeing our Nick then watch 'Leaving Las Vegas' or 'Face Off'. They are much better, well Face Off is quite fun. Oh, he was good in 'Raising Arrizona').

    Anyway, you could load the website and allow Flash access to your webcam so that it might burst your face into a fury of flames when you moved. I lost the website, but being intrigued about the code I went and had a look for it. One of my favourite website's that I look at when I need idea's for projects in Flash ir UltraShock and it's on that very website that I found the code.

    Seen below is an image of me capture using the same system (or at least one very much like it). For the UltraShcok page, see here.

    Photobucket

    The designs I sketched out can be seen below. It wasn't an idea I fancied taking too far as it's not all that impressive for anyone who knows anything about Flash. It's also been done before, just not as an installation. I'd feel bad if I just ripped the code.

    Photobucket


    True 3D Projection

    Impressive 3D technology that allows for large, clear 3D displays for installation. This seems to be a technology that has been picked up in large for commercial use by the automobile industry for use in exhibitions and showcases.

    3D Glasses

    While looking through my playlist of YouTube video's I also came across a good example of 3D via 3D glasses. This isn't something new to me or to you, I assume, but it is a technology that I'd love to be able to render into the 3D colour's from a live feed. This sort of technology, although old now, is still fun to look at. If I could render from a live feed I'm sure I could do some really wicked things. Of course my work is trying to look at digital installation that Mr. Joe Generic could enjoy in passing, this isn't a technology that most people walk round with the glasses you need stuffed in their pockets.
    The video I found that worked best with the glasses I had at hand can be seen below. The glasses I used were freebe glasses I got with a packet of Aquafresh. Supposedly I'm to look at their website using them, but for the life of me I can't find where it is their 3D website is located.


    FMP Brainstorm

    I've decided to make up a brainstorm using FreeMind, a great open source tool for creating mind maps that can be exported as HTML/PDF/JPEG/PNG/DHTML/XHTML and so forth. Due to the limitations of this Wiki the brainstorms will be displayed as PNG's so that all the detail can be captured. If I'd embedded the HTML then it'd only display as a basic text 'tree' of my brainstorm, losing all layout etc.

    Photobucket

    I realise this is something that I should have created towards the very start of my project. I was wanting to get more background research done before I started brainstorms, giving me some sort of starting point for my thinking. It's also something that I find quite hard, brainstorming that is, and as a result don't do it very often. Or in any great detail or importance to my work, which is wrong I know. However, due to the FreeMind software it's a lot easier to keep on adding idea's to the brainstorm. Because of the important that some of this software plays in my research, design and creation I have decided to start a 'software' page for the Wiki. There you'll find branching pages for open source projects and software, as well as the more industry standard software. I'll try to include links to project pages and resource pages.


    Messa Di Voce

    YouTube description - "Messa di Voce (2003: Golan Levin, Zachary Lieberman, Jaap Blonk, and Joan La Barbara) augments the speech, shouts and songs produced by a pair of vocalists with real-time interactive visualizations. The project touches on themes of abstract communication, synaesthetic relationships, cartoon language, and writing and scoring systems, within the context of a sophisticated, playful, and virtuosic audiovisual narrative. Custom software transforms every vocal nuance into correspondingly complex, subtly differentiated and highly expressive graphics graphics.

     

    This is an interesting project that I feel demonstrates a great way to get more than just your finger tips interacting with computers. I really like the idea of using these methods to create interactive art. Obviously for interactive works such as these, Processing would be the best program to use.

    Creating interactive installation displays is great idea, such as Troika made for the childrens wards. Indeed like most of the digital installation artists that I've researched into, the main premise behind their work is to create a more full bodied experience. The use of computers, the keyboard and the mouse, is limited increadibly by the current forms of interaction. Only recently have we seen a massive increase in the amount of more inclusive interation with computers. A fine example of this is the Nintendo Wii. A game console that works on more physically demmanding interfacing devices in order to work. Prior to that, the iToy from Sony (assuming it was their original idea), a device that let's you interact with the computer via the motion detecting camera that you could mount to the top of a Playstation(2?). I remember playing on one of those a long time ago, back when they first came out, which would have been maybe 4+ years ago. It was a great step towards new modes of interaction, but Sony didn't do it well in opinion and the games released for it were sloppy arcade style things. Because of the way of the iToy worked I thought it was too sloppy and didn't do the concept any justice. Of course, it had been done before by a few people. 

    Myron W. Krueger
    One of the pioneers of this, a Mr. Myron W. Krueger, has been accreddited to have been oen of the first to dabble in digital interactive arts. In fact Myron Krueger himself tried to make a computer game. He called it "Ants Alive" and it was in essence a 'whack a mole' game of standing on ants with your feet. The game screen was a massive video projection of a floor with ants crawling over it. Your job was to try and stand on them by dancing around like a mad man on the touch sensitive floor. From the video you'll agree it was sluggish and a bit dull, but the concept was good. Which I think is what he was really going for.


    Jewish Politics

    This interesting project tracks white light across a room, finds the coordinates and drops objects onto a screen in the correct positions whilst simultaniously sending data to a CPS (central processing unit, of course... thanks Google define!) so that noises are played alongside the visuals to create a strange sort of music. It's worth having a look at, although the video is fairly low res and the website is pretty awful. Have a gander here.


    Full Body Drum Machine

    This is an idea that myself, and a friend, discussed making together. The premise of this idea is that a motion detecting Processing sketch would capture the movemet of a person standing infront of a white backdrop, then translate that movement into 'hitTests' with a virtual grid over the area. Motion detected in certain area's of this grid would result in 'hits' and thus play a drum beat (or any sound for that matter). The scale of tones/pitches would be varient across the grid so that lighter noises would occure on the left, harder sounds on the right.

    This would be a great way to get people to interact more aggresively with the work, rather than having it as a backdrop. However, this approach would be no good for an installation piece in either (as example) a restaurant or hotel foyer. This is something more suited to a childrens play area, in maybe a shopping plaza?

    INSERT PICTURE

    While this would be a great notion, and in the most part I think achievable, this is a project best left for now in favour of less required involvement in the picture. For instance; I would prefer my work to be enjoyed without 'much' required input from the user. A more 'ambient' piece, etc.


    New Park Bench

    Based again on the 'New Hyde Park' idea the idea behind this one is much simpler, requireing a single tape machine.
    I really like the idea of working with changing how people view the world around them. I like how the art becomes the people, even though they don't know it. For this to work I would place a tape machine under a park bench, having it play noises much like the machines in 'New Hyde Park' would.

    Theres too many obvious flaws in this idea, the biggest being that people would simply take the machine.

    More text under image:

    Photobucket

    As a side note, the drawings on the right hand side of the page are some idea's I had based around a lecture we had on criminal obedience within prissons using a system developed to give prisoners the feeling they were at all times being watched, thus resulting in less disobedience.
    My concept drawings aren't much to go on for a fully fledged project, but the idea of causing people to feel nervous because they are being watched is still a good one. Maybe I'll come back to this at a later date.


    Tamarin

    Whilst surfing around, looking for things and bits, I came across 'Tamarin'. This is an open source collaborative effort between Mozilla and Adobe to create a unified scripting language that will aid in the development of rich interactive media on the internet. The aim is the merge the coding languages used by so many that are all based on the ECMAScript into a single more unified language that is both where Mozilla would like to take their efforts and where ActionScript is already heading.

    I'm very pleased that a large company, like Adobe, has been responsible and clever enough to release this project under an open source license, allowing the code to be freely available for download and manipulation at by anyone.

    If you would like to read more about Tamarin then please click here. If you'd like more information about Tamarin in respects to Flash then click here.


    Troika

    This design group, showed first to me by Anna Beth, create high end print, digital, interactive and installation commissioned art, please have a look at their website here. Work that they have created includes:

    'All the Time in the World'
    Photobucket
    A fantastic clock that displays the time around different parts of the world, with the London GMT time fixed fast and large in the center. This was commissioned by British Airways and is located at the entrance to their viewing gallery and waiting lounge.
    I really like this as it features a calm aesthetic, with the idea and design fitting beautifully with British Airways color scheme and of course it fits well into being a world clock at an airport.

    ...as well as...

    'Cloud'
    Photobucket
    This was another sculpture commissioned by British Airways and I feel Troika's own words describe the project best:

    "In response, we created ‘Cloud’, a five meter long digital sculpture whose surface is covered with 4638 flip-dots that can be individually addressed by a computer to animate the entire skin of the sculpture. Flip-dots were conventionally used in the 70s and 80s to create signs in train-stations and airports. We were fascinated by their materiality, by the way they physically flip from one side to the other. The sound they generate is also instantly reminiscent of travel, and we therefore decided to explore their aesthetic potential in ‘Cloud’.

    By audibly flipping between black and silver, the flip-dots create mesmerising waves as they chase across the surface of ‘Cloud’. Reflecting its surrounding colours, the mechanical mass is transformed into an organic form that appears to come alive, shimmering and flirting with the onlookers that pass by from both above and below."

     

     




    Shadow Monsters

    This is such an amazing project. Please PLEASE click here to see the website and please PLEASE do watch the little video if this is something you've not seen before!

    Photobucket

    This is a project created for fun. It looks like it was great fun to make and even better fun to play with. Using video capture and Processing to display peoples hand puppets as fully fledged little monsters, birds and critters with a full range of sounds to match.

    Photobucket

    I would have no idea where to start with a project such as this. At a guess; silhouettes of hands are analyzed for shapes such as mouths, necks, heads and the like so that shapes can be added to the silhouettes to make them all the more monster like. In addition to this the designers have made it so that when you open your silhouettes mouth a noise is played dependent on how the program determines your monster should look and thus how it would sound also. It's hard to explain but it is really really cool. I think if anything, THIS is the project that I've found so far in my research that I would aspire to make! Nice website too...


    Lights, Camera's, Windows AND Video Capture?

    Just found an article on how to get Processing working with a camera on a PC. It's something to do with the drivers not being compatible with QuickTime 7 and QuickTime 7 not liking particular cameras... or something. Anyway, documentation for Windows Vista and Processing is near none existent and so trial and error ensues.

    It would seem after reinstalling Java, Quicktime (3 different versions of) and finally WinVDIG I have finally gotten Processing to acknowledge the existence of my camera. However, I can't for the life of me work out how to set my Logitech camera as the default input device rather than the camera built into my laptop and the camera that my laptop thinks it has, but blaitently doesn't.

    After playing around some more I have found that I can retrieve a device list and thus select the correct camera from the three. This works fine for the basic camera input. The code I used to retrieve the camera list is as follows, added code in red highlights:

    import processing.video.*;
    Capture cam;
    void setup() {
    size(320, 240);
    String[] devices = Capture.list();
    println(devices);
    cam = new Capture(this, 320, 240, devices[2]);
    }
    void draw() {
    if (cam.available() == true) {
    cam.read();
    image(cam, 160, 100);
    }
    }


    The new code works as follows:

    • String[] devices = Capture.list();

    Generate list of possible capture devices.

    • println(devices);

    Display device list in the console. Which reads as:

    [0] "ASUS WebCam, 1.3M, USB2.0, FF-WDM"
    [1] "AVerMedia BDA Analog Capture-WDM"
    [2] "QuickCam-WDM"

    • cam = new Capture(this, 320, 240, devices[2]);

    Define which device it is I wish to use in the properties of the 'new Capture'. In this case it's device 2, the list starting as it does at 0.


    The problem is that this code doesn't work with the example projects in Processing that use "Capture video;", instead of "Capture cam;". I have no idea why this is. From my limited knowledge of Processing it would appear that the "Capture cam;" and "Capture video;" are simply variable names, but do seem to be the major defining difference between the code. "Capture video;" gives me an error message when I try to apply the same method of selecting the web cam as I do with "Capture cam;".

    Now, I'm not so sure all this is all right. The VDIG (video digitizer), WinVDIG, that I use to get video capture from a USB camera on Windows won't itself display any video capture. I can't work out how to get it to select a specific camera device, so it may well be that it's doing the same as Processing and simply trying to take control of a camera that is either not working or simply not there. However, it would seem there's quite a lot of fuss about the video capture on Windows using Processing and it would turn out that one of the versions of VDIG works a lot better than the others, version being something I never checked or was even made aware of as an issue when first installing VDIG. So I'll attempt the better version, uninstalling the previous one and reinstalling the new (going on assumption it's the wrong version, despite the poor design not showing ANY version number ANYWHERE within the program).

    .

    ..

    ...

    a little time later on...

    Ok, so after reinstalling I realize I did have the right version and there is a way to switch which device it uses. The device capture can be switched to my proper camera, but despite the camera lighting it's little LED up as if to say it's being used, there still isn't any video capture being displayed via the VDIG. WinVDIG is pretty awful, and I'm not wholly surprised it doesn't display anything. I am hoping however, that it's not the cause of the problems with Processing as it did certainly allow at least one method of capture to work since installing it... even if it's not the method I want to use! Maybe I'll try JMyron...?

    JMyron

    The description:

    "Myron is the cross-platform, cross-language, open source, video capture and computer vision plugin. One core C++ object gets cross-compiled as a handful of high level language "wrapper" libraries. The wrapper for Java and Processing is called JMyron. The wrapper for Macromedia Director is called WebCamXtra. The aim of the project is to keep computer vision free and easy for the new media education and arts community."

    I'm told installing this might help.


    SetPixel

    I've come across an interesting site called "SetPixel". This website is literally a WordPress blog of articles, written by artists who love to play with digital interactive arts. Everything on this website is a good example of projects I would love to make. My favorite of the projects they've been involved with is their interactive digital waterfall wall. This installation was commissioned by a childrens hospital ward to be an incentive for children to get up and actively play with something beautiful, calming and therapeutic. Made using Processing, this interactive display allows people to move in front of the color changing wall that shimmers like water while a camera picks up their movement and manipulates the water effect as if to create ripples in the locations relevent to where people are standing and moving.

    Photobucket

    Although the original designs were to use high definition plasma screens the budget wouldn't allow for it. I do think however the use of these 3x3 LED blocks works quite well, giving as it does a mosaic feel. The lighting of the room around the wall reflects the color of the screen, even when the screen itself changes color (which is does every so often). A nice little video can be found on the website, it's worth watching.
    For the SetPixel page for this project click here.

    Another very interesting project that SetPixel have conducted was in eye movement and gaze. The aim was to create an interactive display that contains images manipulated by the users eye movement.

    Photobucket

    The user would look into an antique viewfinder and some clever code would track the movement of the eye, pin pointing where the users gaze was landing on an LCD screen that would in turn display an image that, as you can see in the above image, would deteriorate, recreate , entirely adjust and generally move to the movement of the eye. It's hard to explain, and I think SetPixel do it more justice in it's description that I do, so I strongly suggest you visit the project page located here. It's also definitely worth checking out the two video's on the page to get a better idea of how it works.

    SetPixel, Neave and I

    Now I was thinking to myself; it's easy to detect movement using Flash / Processing and it's even easy to detect specific colors. If I was to have someone look into a darkened box that contained a web cam and a very small red LED, both pointing at the viewers face (eye's to be exact) then processing, or whatever platform I used, could detect the glint of the red LED that would inevitably shine brightly in the pupil of the eye. I could then detect the movement and direction of the eye's allowing me to manipulate an image. Something that springs to mind is one of my favorite digital Flash artists, Paul Neave's, 'imagination' Flash project, which can be seen here (and in the image below, description beneath image).

    Photobucket

    This funny little thing detects the movement and direction of the users cursor on the page and creates these cool squiggly lines that fly off in the direction the mouse moves, whilst changing color and generally looking quite interesting.
    If I were to link the movement of someones eye's to something like this, replacing the movement and location of the cursor with that of the eyes coordinates, then the user would be effectively painting and creating with their gaze, much like SetPixel's project. I think my approach would be more confusing for the user, and thus more interesting, as it makes it near impossible for the user to fix their gaze on any one part of it. A good example of this would be when you try and look at the blobs and dots in your vision that the eye fluids create. I'm sure, like me, everyone has tried to fix their sight on these dots and blobs and found it both amusing and impossible.

    This isn't something I plan on making right now, it's just an idea that struck me as a good. I think the detection of eye movement is something best left until I hit the third year!


    Your Being Followed

    On of my first ideas was based on the idea of using feedback from a camera on a time lapse capture + projector to give the appearence of people being 'followed'.

    After a long time playing with the feedback of a webcamera + monitor, actually getting a steady feedback like I was after here is seemingly near impossible. I'd love to try this again on a large projector + web cam but I think ultimately it's an idea I'd rather not persue too much futher.

    Photobucket


    Your an Advert

    I'd love to play with simply projecting messages and adverts onto people as they walk past in the street. Covering shoppers in the logo's of big name brands. My intention was hopfully to draw peoples attention to just how many tags and logo's they carry about on themselves. Logo's that represent idea's, people and company's that bare no relation to the person carrying them about. Many people happily wear the name of Nike on their tops, never considering just what it is they are helping to advertise. It would be nice to work a political theme into my work, but on the whole as soon as you do that you look like a moron. Unless you do it well.

    Photobucket


    Playing With Flash Motion Detection

    I wanted to have a look at web cam detection. Having spent a good few hours trying my hardest to get processing working on my computer I have decided to give up and work with Flash. Processing is best used in conjunction with a Mac, something I do not have. While Processing itself works, the Quicktime + Java requirements don't seem to work so well. Initially the camera worked fine with Processing straight from my computer. However, a day later and now nothing works. I've tried rolling back my computer to an earlier time, reinstalling the Java platform, reinstalling QuickTime, trying older/newer versions of Processing (including Alpha releases) and even stealing my housemates monitor to try and use with my monitorless other PC to get Processing working with the camera. I give up, I need a Mac.

    It's a shame really. I was wanting to try and steer clear of Flash but with the deadline looming ever closer I think I'd rather get somewhere with Flash, rather than nowhere with Processing.

    So Flash....

    Firstly I started looking at a tutorial by Guy Watson, who is the managing director of FlashGuru LTD. His tutorial can be found here, on the main Adobe development website.

    This tutorial has been written for use with Flash 8 and AS 2.0. I'd love to work with AS 3.0, but for now I'd rather stick to 2.0. Versions 2.0 and 3.0 of AS differ by not much, 3.0 being the move towards a more Java orientated language. However, the differences between the two versions is mind bogglingly annoying to work with in my opinion. I find so many 'little things' different between the two that working in an environment that annoys me with it's subtle but noticeable differences is just a little too annoying. I am not in the market to be researching into the new 3.0 language anyway and I'd rather work with the new abilities of Flash 8 whilst sticking with 2.0 for now. If I find I can migrate any work over to the new version without too much hassle then I may well do so later on. On that note, the similarities of all the C based languages such as Java, AS + the Processing language (which is just called Processing? I suppose) means that once I can find out 'how' I make something I don't think it'd take too much work to recreate that project in another format. Processing is the way forward, I see that. Flash for now though!

    Back to the tutorial... it's is all about accessing users camera's with Flash and then furthermore to that the author tries to create a good 'code efficient' and 'resource efficient' way of detecting movement. He bases his idea's off of Processing projects. Projects such as those made by SetPixel, who I'll cover in another post.
    The code he uses is fairly straight forward, easily read with his informative code narration.

    A demonstration of where he started and where he ended up:


    His first Attempt leaves him with fairly resource intensive code for a very poor quality picture. This image is of me shaking my head slightly. It's hard to see the edges of my face, but quality shouldn't be something I'm too concerned with.

    In his words: "In my first attempt at this experiment I actually wrote some code that looped through every pixel in the current snapshot ("now") and checked for changes in the brightness of the pixel since the last snapshot ("before"). If the change in brightness of that pixel was greater than a constant tolerance value, then you can assume that there was movement in that pixel."




    His final attempt (not having the in between attempts to show you) is a much improved system. He uses some much faster code and some built in blending modes in order to capture movement. This method checks for variations between the Bitmap data that is generated using blending modes. Blending modes are basically Bitmap snap shots that are blending together by Flash. You can, apparently, separate these snap shots (or generate your own) to detect the differences between them.


    This is me moving my head...


    The Wiki


    It's working. I really like how my research can be pulled together and kept updated. The Zoho Wiki interface is well layed out and, although somewhat buggy in places, hasn't given me any major problems as of yet. Despite it's 'beta' status.

    A couple things that are annoying me at the moment are; that the wiki editor doesn't seem to work with the very latest beta build of Firefox as it doesn't allow me to scroll properly. And secondly this means I have to stick to IE in order to edit the pages.

    So far I've been using Photobucket for the image hosting as it remains my favourite image hosting website with the easiest and best image uploading of them all.All the images used on this page are just inserted using the embed code from photobucket and then using the 'insert HTML' feature on the tool bar.
    However, since this isn't a blogging system there isn't a way for me to put media onto this page without ALL of it having to be loaded every time someones loads the page. If this were a blog, then at least I could set it to show only the last so many posts, thus saving the user from unnecessary loading. Since I'll be needing to show video's as well as images I will be linking to a lot of media, rather than embedding. I think for certain things that I want anyone who views this page to pay special attention too, I'll embed youtube videos (for example).

    Photobucket


    Too Many Talking

    The idea behind this comes from one of my previous ideas whereby speakers are placed along a path in Hyde Park, the idea can be found a couple posts down and is called "New Hyde Park".
    Rather than this being a new concept entirely, I'd rather think of it as a continuation of the "New Hyde Park" idea.

    The plan:
    Along a corridor in the college I would hook a laptop up to a couple speakers (or more if I could) and make a sound file that plays entirely different sounds through the left and right stereo channels. You can see a quick layout plan in the below image. The corridor I used as an example is the corridor with the DDM studio and library on it.

    I wanted to convey a feeling of confusion. It's an idea that comes from my own poor hearing. I find it very hard to listen to conversations while there are other conversations going on in the background, this causes a severe sense of confusion, and hopefully I could portray that same feeling to others. I would use short clips of speach, both English and otherwise, and then allow them to play for only a handful of seconds each. The idea is that the speach is interesting, but ultimately it cannot be followed. For instance; a clip would play a man talking about an interesting news article, something that would be of interest to art students and lecturers, and hopfully passers by will be interested. As they start to listen though, another sound file will cut in over the top and make it too hard to hear what the previous one was saying. While the previous sound file fades out, and the new one in, I think people will start to listen to the new sound file. This of course would also cut out about half way through the interesting part with another sound coming in over the top of it.
    There would be a few speakers, each going with it's own pattern of sound files, spaced out down the corridor (mounted on the walls perhaps).

    This could be achieved by making a duel channel (or even 5.1/6.1 surround, if I could get my surround working with my laptop. Which I can't) audio file and simply play that on repeat using a standard media player. Another, more preferable choice, would be to drum up the sound files and let Flash randomly chose which ones to play and use some AS to control which channel the sound is played out of along with controling the fading out. However, given that I have little knowledge in how audio through Flash works I think it would be easier for the same effect if I just made the sound files using Audacity.

    Photobucket


    Processing

    It's pretty powerful. Just starting to really look at the potential projects that can be conducted with it.

    Some of the idea's I've had are (sketches coming soon):

    • The Music Man

    This is just an idea, but I do quite like it. Using a camera to detect movement and dividing the detection area into a grid I think I could create an interesting interactive full body drum, thing. For instance; if a camera was to be pointed at a blank wall and then to have a person stand in front of that wall I could detect his movement and use processing to play out sounds based on where the movement was detected. So if a movement was detected to the far left of the area being monitored it could play a higher pitched drum beat, a lower pitched beat if the movement was on the right hand side and so forth.
    If the area of detection was broken into a grid of, let's say, 6 x 6, then having 36 different sounds ranging in tone would mean a person moving his hand of arm past those certain area's could create sounds.

    An interesting website I found. This artist used processing to create a music video for a Radiohead track. The video can be seen below:

    Weird Fishes: Arpeggi from flight404 on Vimeo.

    I really like this, it demonstrates the raw power of Processing. Whilst also demonstrating his insanity as he mapped out every vocal + bass beat in the video to give it that extra 'pow' factor as it reacts to the music, a feat that took him 6 hours of work. Sometimes I wish I was more mad in an eccentric direction.


    New Hyde Park

    I wanted to change the way an area is percieved, the way the environment around us is looked at and taken in, using a variety of different sounds that contradict or help others to re-evaluate their situation.

    In this idea I would place speakers (in the form of cassette players) along a path in Hyde Park. Placing maybe 3 or 4 devices in different places along the path. The sort of sounds I envisioned playing were that of birds being scared away from the trees, and gunfire. The idea would be to make people look around them for the source of the noise, or better yet; trick people into being unsure as to whether what they heard was a natural (or rather, real) sound.

    Photobucket


    Guerilla Girls

    I've never been much a fan of the "GG's". Although I agree with the notion of equal rights of course and much of what I've read into feminist ideals I agree with also, I just don't think it's all about the activism for them anymore. At the beginning (this is based on my limited knowledge of their movement so please check for yourself) it was a sincere attempt to draw attention to the Feminist cause through a less depressing stance. Since then however it is my feeling that it's lost it's way a bit and they are more concerned with the public hype that they create about themselves, the guerilla girls. Even though they state that they draw attention not to their identities but instead to their ideals through the masking of their faces I still think from what I've read they are more interested in talking about themselves, rather than their activism.



    The Guerilla Art Kit

    I came across this book written by artist 'Keri Smith' whilst looking for other material by her. This book has gained some reasonable acclaim and reviews and so I've created a Wiki page so that I can keep it's location handy. The Wiki page can be seen here.



    Potty Art Project

    I really like the idea of playing with the notion of art developed within a toilet. To that end I wish to turn the idea into a short project. Because this is somewhat a deviation from the Final Major Project I have decided to turn it into a connecting project, but a separate project in it's own right. You can view the Final Major Project page here.

    toiletGraffiti

    While this is going to be developed in essence as a separate project as much as it will have it's own project page, I will be using it as a demonstration of my research into guerilla art and as such shall be submitting and referencing it in my Final Major Project.


    First thoughts about end product

    Primarily I will need to start linking my research more heavily in the direction of using digital images and audio to start planning my final product.
    My primary thoughts on the project at this stage were towards using speakers in public areas to attempt to alter public perception of the space around them. Playing noises and sounds that created different tensions and behavior in people who listened to them. Sound that changed the way that people would interact with their surroundings.
    Looking at the web camera as a means to play heavily with both images generated by a computer and take in real time live action, a mans face let's say, and then manipulating the image along the way makes this look like the most obvious starting point.

    Deciding to work with the camera I decided I needed to get one setup for my laptop in order to start playing with the images properly. Due to the fact my wallet isn't quite as fat as I should have liked, I went with a fairly cheap option. A little LogiTech QuickCam, took bloody 3 attempts to get one that worked with my computer!
    It's a fairly good camera with a reasonable resolution and decent refresh rate. However, those aren't things that should cause much problem even if they were quite low refresh and resolutions as much of the work I intend to do won't be to use the camera to send out images that people will see. Rather it's just an input device that I can use in conjunction with a program such as processing to create my digital image for viewing.


    Guerilla Arts Journal

    note

    I came across a forum that people post images of street and performance guerilla art to. The webpage can be viewed here. There's also little stories up there, such as:

    PostIt Notes

    "at my job, we have these bulletin boards in the elevator where the office staff post bulletins and job related articles and other mind-numbing crap like that. i started tacking little notes up there. i use company paper and sticky stuff. some people started responding.

    i posted one to my boyfriend that said,

    "i love making out with you in the elevator"

    i stuck it to the board and someone ripped it off before he could see it.
    i posted another one that said, "i love you", which he got.


    if i post anything obviously political or 'offensive' it gets torn down immediately.

    other things stay up a little longer. like when i draw pictures on the actual work bulletins.

    other people have joined in, i just hope that they dont install cameras in the elevator because that would take all the fun out of everything."


    I really like this idea. Leaving images and articles that can be replied to, updated and improved is a wonderful idea. Having evolving art through the use of strangers. I'd to play with this idea of creating art that evolves beyond your original designs, doing so all by itself (so to speak). Once the art has been started and others join in the art extends to not only this evolving single piece, but instead it is now all the people who have updated it and improved it, altered and confused it's original meaning.

    Potty Art

    One of the things I've always admired in an odd way is the drawings on toilets. You'll find these doodles, notes, cursing statements and adverts written all over toilet doors, walls and mirrors right the way through the country and all over the world. This is one of the greatest forms of art in my opinion. These items are some of the most honest and grounded art that can be found, stating exactly what people want to write or draw without the ruthless glare of the public critique. This anonymous art is also in many cases evolving art. I first really started noticing this in the context of art when first starting the second year of this course in the new Blenheim Walk building. In the mens toilets of the ground floor in the building you'll often find many interesting doodles that people have drawn onto the doors of the cubicles. The interesting thing is that other people reply to these doodles and messages. I've seen entire conversations forming between people all written onto the back of a toilet door. Drawings of people are given extra props in the image, text and even entirely new meanings.
    The best part of this is that when I visit the toilet I always make sure I chose the same toilet cubicle, just so that I can read up on any new developments in the on going saga of this potty art. Conversations forming, art evolving, messages read and people's toilet experience affected. Then at the end of the day, weeks, term or year the toilets will be scrubbed clean ready for a new ambush of peoples creativity while sitting on the potty.




    Flickr Guerilla Art

    I found an excellent Flickr bank of guerilla art. It's worth checking out as there is some really nice stuff up on there to be seen. Although there is a lot of art up on this Flickr link, what is there has been obviously uploaded from personal collections of images that have been snapped as and when these items have been found. The nice thing is it's not the grand images that I find in library books but instead just simple art that's been left by simple enthusiasts.




    Guerilla Art


    Firstly I wanted to have a look into guerilla art. I find the idea of creating art for arts sake the most appealing to me. Furthermore the creation of art with the idea that someone somewhere will find something you've created and you've no issue in taking no credit for this art. It's always nice to be recognized for the things you've done, in some cases however it's nicer to remain as the art and not as the person who created the art. It's only when your identity is concealed fully I feel that the art speaks for itself and not for the artist.

    I found an article on a website blog called "how to be a guerilla artist". The following is taken from that very article.
    Original page can be view here.

    This article has been written by artist "Keri Smith":

    how to be a guerilla artist


    March 08, 2004

    Guerilla art is a fun and insidious way of sharing your vision with the world. It is a method of art making which entails leaving anonymous art pieces in public places. It can be done for a variety of reasons, to make a statement, to share your ideas, to send out good karma, or just for fun. My current fascination with it stems from a belief in the importance of making art without attachment to the outcome. To do something that has nothing to do with making money, or listening to the ego.

    My first experience with being a guerilla artist was in my first year of art school in a class taught by conceptual artist Shirley Yanover. One of our assignments was to create some form of graffiti in a public place (we were allowed to choose the were and how). We went out in groups of four, (two lookouts, and two painters), and proceeded to make our mark on various blank walls across the city. The experience made me terrified and exhilarated at the same time. I wrote quotes from various authors along the bottoms of buildings, on phone booths, and on the sidewalks. I remember the feeling of daring as we sprinted away from unsuspecting police officers.

    Now I am not necessarily advocating that you do anything illegal or potentially life threatening. But there is something wonderfully sneaky about leaving some form of art in public places. I like knowing that at some point in time someone might receive a little surprise in the form of a random message from a stranger, or a doodle in an unexpected place. I remember there used to be an artist in Toronto who would bolt text books and old phone books to various things. It became a personal quest of mine to find them all, and I always felt so excited when a new one showed up just under my nose. Experiment with your own ideas.


    Possible Formats

    1. Sidewalk chalk
    2. Sticker art
    3. Flyers/posters (see "make a flyer of your day" at http://www.learningtoloveyoumore.com./
    4. Journals (pass it on)
    5. Zines
    6. Object leave behinds (money, gifts, junk)
    7. Notes (slogans)
    8. Graffiti
    9. Book inserts (library)
    10. Book leave behinds (bookcrossing.com)
    11. Letters (possibly love letters to strangers)
    12. The age old 'message in a bottle', or a balloon. Or if you are really adventurous you might be drawn to carrier pigeons.

    Potential Ideas for subject matter

    -any form of artwork (drawings, collage, doodles, paintings)
    -recipes
    -photos
    -good luck charms
    -fortunes
    -quotes
    -variations on a theme
    -many guerilla artist are politically motivated and find that being anonymous allows them to be more controversial or extreme with their message. Popular with activists.

    Further reading:
    guerillart.org

    The original guerilla girls

    Mysterious figures show up on a campus.

    Potato: Guerilla Art

    Jeff Claassen



    Initial Thoughts

    Until now a lot of the projects that I have been creating have had strong routing in a career, business and corporate direction. Having to constantly relate the work your doing back to how it can be used in finding work after college, gaining recognition for your work in order to make money and justifying yourself in a lot of cases solely on how others may view your work in relation to wanting to fund it. I find this focus on finance daunting and uninteresting. Art isn't something that I like to think of in relation to money, however much it is required to create art in many cases I still think the first and foremost aspect to good art is that it is enjoyable to make and enjoyable to view/interact with. Due to this I have decided to base my Final Major Project around less finance-centric art. Areas that I will be concentrating heavily on are; performance art, graffiti, demonstration arts, guerilla arts, interactive arts and in particular those relating to instillation art. However, money isn't something that can be ignored and to that end I will be researching into council arts funding and work relating to the projects that I am doing.

    I would like to create a project based around the idea of interactive art, however more specifically I'd like to research into forms of interactive performance arts, basing my project around that. I think looking into the idea's behind public performance art would be a great first step.


    Why Wiki?

    Please refer to the Wiki page entitled "Why Wiki". The reasons behind using a Wiki to create research for my project needs to be explained. It has special relevance to this project!


    Initial Project Summery:

    While this is the original project summery that I submitted, there are alterations that I have made to it. Alterations are highlighted with square brackets [ ].

    BRIEF
    (be concise)
    For this project I wish to research into and create forms of visual and audio performance. Concentrating heavily on alternative and none invasive forms of both public and private protest, graffiti and demonstration art [within my research].

    PROCESSES / TECHNOLOGIES INVOLVED
    (eg. Video Production / Stop Motion Animation / CSS Encoding / Second Life )
    Creating visuals for use with digital projectors. Using software such as Premier and Final Cut.
    Audio manipulation and image manipulation using software ranging from Garage Band and Sound Forge for the audio to Gimp, Photoshop and Paint.NET for the imagery.
    [Processing, Flash]

    RESOURCES REQUIRED
    (eg. video projector / digital SLR / webspace)
    Video projector / Midi deck / MP3 recorder [/ web camera] as examples.


    FINAL EXHIBITION FORMAT
    (eg. DVD / Website / Time based Installation )
    DVD presentation showcase of recordings taken from the public and private performances, also featuring the reactions of those watching/hearing and interacting with it.

    [I have decided that a better form of demonstration would be a live demonstration.]



    Resources

    This is where I store links, articles, notes, maybe a picture or two and my occasional indecipherable tangent rant that I get the impression I may want to look on at a later date! It's not essential reading, but it might contain a few useful tidbits or interesting odds and sods. :)

    Websites:
    ShadowMonsters - that's VERY cool
    Processing
    Neave
    Photobucket
    Myron WebcamXtra - camera capture for digital artists (sourceforge)
    SetPixel
    Troika
    MVMT - great installation works
    Flight404
    Radiohead animated video contest - Flight404 made a video for this

    Forum topics:
    Flash 8, scripted camera
    Motion detection w/o JMyron - could provide useful reference
    Articles on VDIG apps and alternatives - on processing forum

    Articles:
    Detect and locate webcam motion in Flash 8
    Processing sudden motion library
    Lights, camera, ActionScript 3.0! - READ THIS
    Video tracking working in processing- using JMyron, WinVDIG + QuickTime all together
    Reference library for video capture in Processing

    Videos:
    Flight404 Video's

    Downloads:
    QuickTime
    WinVDIG - 4 versions (including 1.0.1)

    Images:

    Tutorials + Examples:
    Brightness tracking in Processing- like examples bundled with Processing

    Books -  Wiki page

    Notes:
    moving past a display, tracking the motion AND direction of a person which create a 'wind' that blows digital grass that is projected via an OHP.

                O
       -->   /|\|   -->
             /  |
               / \
    / / / / / / /| / / / / /

    Other:


    Post a comment

    Your Name or E-mail ID (mandatory)

     

    Note: Your comment will be published after approval of the owner.




     RSS of this page

    Not all the images found within this Wiki are of my own creation, all other content is copyrighted to myself, Jak.O 2008. If you wish to use any part of this Wiki then please contact me first through Zoho. If you have any comments, suggestions or have found media on my website that you would like to know more about then please do not hesitate to contact me. This Wiki has been created for the sole purpose of serving me during my time at college as a research and reference point. I have no intention of using any of this information for the express purpose of making money. However, if you think that there is material here that is in breach of anothers copyright then PLEASE let me know as I will be only too happy to correct this. Thank you.