Ziggy Cross

ASSIGNMENT 4 REFLECTION

My final Max evolution has arrived! In this assignment, I have delved further into programming logic, computer vision, and video effects, as seen in my three studies respectively.

For assignment 4, I have spent a lot of time polishing my works, so that they have a very presentable and user-friendly feeling to them, meaning you don’t need to know anything about Max to use them.

I think the most challenging aspect of this assignment has been figuring out how to sustain interaction for the required amount of time. I think my most successful attempt at this was my Study 7 project, which was the webcam slider puzzle. This was a very difficult puzzle that looked very easy, which meant that people would put a lot of time into solving it thinking they were just around the corner from the solution (even though this often wasn’t the case). I have probably spent over an hour in different attempts to solve that puzzle, and I have only been able to do it once. However, there is a bit of a trick to it, which users might be able to figure out after putting a bit of time into it.

The other two studies I think can hold attention for the required 5-7 minutes as well, however, there is nothing about them which requires the user to put in a lot of time, they are generally just quite fun to play around with. The particle system has one or two settings which the user can try out that will create different results, but most of the enjoyment comes from trying to get the particles to make specific shapes. Ultimately the particle system isn’t where I’d like it to be, but technical and scope limitations would make it unreasonable to attempt to get it to an ideal state.

The other study, study 9, I think was a nice little sentimental work, recreating my first work as my final one. I thought it was kind of fun to experiment with video effects without really having a goal in this one. I was really happy with how the 3CCD / VHS effect came out (the one that creates the blue and red lines around things. Realistically, there are better and more accurate ways to do this effect, but I’m pretty happy with the stylistic elements of the one I have created.

I think one of the most valuable skills I learnt through this assignment was how to use the cv.jit libraries effectively. I ended up trying a lot of different objects from this package when working on my Study 8 project. The one I settled on was the cv.jit.track object, which uses the webcam’s optical flow to track a point in space along the webcam’s two-dimensional plane, this returns an xy co-ordinate based on the tracked pixel’s position. I found that cv.jit is a very powerful tool, however, it can often be a little hard to implement the outputted data into other systems the way that you would like.

I’m finally starting to get comfortable working in Max, the learning curve seems pretty steep, but I think I’m finally over the hardest part. I’m not having to spend as much time troubleshooting, whereas in previous studies I would spend hours troubleshooting and then realising something wasn’t triggering properly because of the right -> left reading system or something small and Max specific like that.

I’ve learnt a lot about using Max for creating interactive media projects this semester, having never used this software previously. I now feel comfortable prototyping ideas and then developing them into a finished project, including executable application files for use on computers without Max installed. I’ve very much enjoyed learning this completely new realm of skills, and I think my newfound knowledge of Max and interactive media will come into great use for future creative projects, especially the more ‘out there’ ones.

Download the Max Patches here

MAX INTERACTIVE STUDY 9

The final study! For this one I wanted to take my interactive content full circle, reimagining my very first creation in Max, which was a system where the user had to press a series of keys to hear a song. This was done to portray listening as an intentional experience, however I always had hoped of setting this up so that interaction with a particular object would trigger a prerecorded audio track of that object, and that when several objects where interacted with (i.e: a guitar, drums, keyboard, microphone) all their audio tracks would sync up to create a song. Basically, I thought it might be fun to recreate rock band with less difficulty and real instruments.

Because planning to use real instruments was probably overscoping a little bit, I decided to take things digital, and use some loops in Ableton Live, all created to be in the same key. I’m by no means a master of music or Ableton, so they don’t sound awesome but they more act as placeholders to show the potential of the work.

I updated the system so that each audio track would be triggered by a different key on the keyboard, in this case: A, F, J and ; . In an attempt to add some longevity to the interaction I prevented all audio tracks from being played at the same time, meaning the user will spend a bit more time experimenting with different combinations and in some sense, building a song. In addition to this I also updated the little colour visualiser I created in the original one to work with the user’s webcam feed. This time adding some cool glitch effects and colour effects which work in time with the beat of the audio.

Download the Max Patch here

MAX INTERACTIVE STUDY 8

Study 8! This study was an evolution of my major project from assignment 3. The major issue with the submitted project for that assignment, Particle Playground V1.0, was that there was very limited user interaction with the piece. I attempted to solve that in various ways but ultimately ended coming up short of what I was hoping to achieve.

I had hoped on using the optical flow of the user’s webcam to move particles in a field, similar to tides, with particles ebbing and flowing around the user’s movement. This proved to be much too complex for Max’s somewhat low-level visual programming system, and would probably be more suited to other software such as Touch Designer which use a more high-level system. While Max has its benefits, it is not as intuitive for some of the more complex tasks.

Instead of the optical flow system outlined above, I compromised by using the optical flow point tracking system included in the cv.jit libraries. From this, I could select any point, track it, then parse it’s xy data through to the particle system’s force fields. This allowed me to add some level of visual control, albeit much more control than was presented in the first version of this project.

I believe that through the creation of this project I learnt the importance of iterative working, constantly improving a project until you have a result you are happy with. I also learnt the importance of backing up your projects with multiple versions, after my final version got corrupted and I had to recreate the whole project from V1.0 again.

 

Download the Max Patch here

MAX INTERACTIVE STUDY 7

The slider puzzle! For this one I took inspiration from Jeremy’s “Annoying Game” from Assignment 3, I wanted to create a similar puzzle with more limitations to further sustain the user interaction. I ended up making quite a difficult puzzle that I still struggle to solve.

I used a series of gswitch and gswitch2 objects to route signals between scissors and glue objects. This enabled me to control the movements of tiles quite easily, by just grabbing out two target entries in a list and swapping their index.

The concept of the puzzle is deceptively simple, however, in effect, it is somewhat like a Rubik’s cube, as making a movement in one area will disrupt other areas which you may have already solved. This is often unexpected by the user of the puzzle, which will lead to a lot of frustration from the realisation that what they would like to do (and believe they should be able to do) will only make things worse.

From my testing so far, people will often spend upwards of 10 minutes attempting to solve this puzzle before giving up. I think it’s fair to say that this project sustains the user’s attention for quite a decent amount of time.

Download the Max Patch here

Leave a Reply

Your email address will not be published. Required fields are marked *