Holly McGratten LIVING IN THE FUTURE OF DIGITAL MEDIA

INTERACTIONS IN MEDIA

> PROJECTIONS <

"ProjectionMapping <--> VideoMapping <--> SpatialAugmentedReality"

Projection mapping is an interactive programming used to turn objects "into a display surface for video projection". These objects and surfaces can be from landscapes such as buildings to theatrical stage productions on set. The projections allow for warping and masks the projected image to make it fit perfectly on irregularly shaped screens or platforms for the projections.

Projection mapping is already effectively used in fields such as science, music, theatre and advertising campaigns worldwide.

The first practical model of this technology was by Disney in 1969. Taking place on a haunted theme ride attraction the mapping was essentially a set of pre-filmed character head-shots which were projected onto physical busts of their faces. Timing was key in this projection as it had to fit in time with the ride - and also to create an effected scare.

WHAT IS VJING? VJing is the stage design live triggering and manipulation of visual content (or simply, DJing with images). It creates live, reactive visual projections which connect to the intensity of the environment, crowd and ambiance. When paired with bespoke motion design and content creation, audiences can be transported to other worlds...

ALREADY IN THE REAL WORLD: Audiovisual Performance, Art Installation, Scenography and Motion Art, Large Scale Projections on Architecture, Window Display and Store Design

see below for example of projection mapping as an art installation (from 3.40):

Projection mapping is a fascinating and creative way to transform the platform of presentations and an effective to connect virtual reality to the physical world

I enjoy the trompe-l'oeil effects projection mapping brings to its environment. Even if a 17th century artist would probably consider it cheating, projection mapping still holds an excellent amount of creative skill, intricate technical planning and immaculate detail.

HeavyM. During the workshop we interacted with this software. Founded in 2014 Digital Essence is a french startup specialised in interactive systems using video projection. It has a sound reactive feature, allowing users to interact and become part of their projections. This would be extremely beneficial for users such as performers or advertisers who rely on this aspect of attention and precision.

The most well known, and perhaps now cliche, is the count down projections for big, public events such as New Year's Eve in London. Huge companies have already used projection mapping as a presentational method as a way to sell. LG and Porsche are two examples who have captivated their audience with making their technology come alive and transform their product.

What the future can hold with this is the possibility of pushing the product and audience boundary in the sense that they will be able to control what happens in the presentation or to the technology. With using the sound reactive feature, as seen on HeavyM, music performances, especially electronic, will be transformed visually.

The FUTURE of projection mapping would be useful and effective in large, touristy, areas such as airports or train stations where navigation is essential. Colour coding and patterning would categorise directions and also prevent confusion like with over-done signage. It could be put on a timer for when a popular hour or urgent message or direction is needed by the public for example if there is a last call for boarding a plane or if there is a platform alteration at a train station. This would also save stress and time.

> Virtual Environments: VR and AR AND BEYOND <

Virtual Environments - An explanation of what it is and its roots, its applications in areas such as gaming, architecture, archaeological research, medicine and commerce.

Virtual Reality (VR) is a way of creating a 3D virtual environment that you can then explore and interact with - "shutting you out front the real world". VR has mainly been used to strengthen the gaming experience however the 360 degrees feature is now being adapted for TV, film and recording moving images. For example filming your paint-balling or skiing experience in order to watch it later. For Steiber, once people try VR the experience is irresistibly compelling.

“The technology is so good that when you immerse yourself, your visual system, auditory system, and your motor system – your hands – and you can move around in a 3D space, your brain actually thinks you’re on Mount Everest. These experiences that were only available to the few are now available to everyone.” -

Augmented Reality (AR) is a technology that "superimposes a computer-generated image on a user's view of the real world, thus providing a composite view." AR takes an existing picture and blends new information into it. Augmentation is conventionally in real-time and in semantic context with environmental elements, such as sports scores on TV during a match. With the help of advanced AR technology (e.g. adding computer vision and object recognition) the information about the surrounding real world of the user becomes interactive and digitally manipulable. Information about the environment and its objects is overlaid on the real world

Stanley G Weinbaum described something like virtual reality in a short story called Pygmalion’s Spectacles -

“But listen – a movie that gives one sight and sound. Suppose now I add taste, smell, even touch, if your interest is taken by the story. Suppose I make it so that you are in the story, you speak to the shadows, and the shadows reply, and instead of being on a screen, the story is all about you, and you are in it. Would that be to make real a dream?”

What real-world application could you see this technology/tool being used for? - talk about VR ABBEY ROAD and scan in NME article

Aurisma - include exampled from app. This was a good app to get a basic grip on virtual reality and I was quite creative with it however it was difficult and technically laggy and the animations weren't of great quality so improvements are to be made - but the idea and creativity is fun!

VIVE. This was a really great piece of technology. It brings you into it's world completely. The graphics were fantastically hypnotic and the play and experiments were infinite.

Me in my own world.

The future for VIVE? The simulation possibilities are where it's strengths lie. This could be from learning to drive, to military training in a war-zone. Introducing a 4D element to enhance the simulation reality would be a successful development and training point to give a finessed, distinct real-life quality to it.

In terms of accessing it's demographic, AR is stronger that virtual due to the smartphones that the majority of the world now posses or will do very soon. This means that mobile and app developers (like Aurasma) will be popular and successful in the near future and will be developed more to aid and enhance our lives.

“When people ask whether virtual reality will be a real thing or just the next 3D, what I always say is ‘take a headset, walk outside and the next person you meet, put it on them and see what the reaction is’,” Chris Milk says (co-founder of virtual-reality storytelling app Vrse)

The Yellow Line in NFL Sports was one of the first commercial applications of augmented reality technology (seen in televised american football games).

The future for AR? Unlimited. As it is heavily based on visually manipulating the the actual environment, it could be used for selling websites, such as eBay or Amazon, where sellers could go further than uploading a simple image and text description and create the feeling that you are with this product and can see the angles, shadows and textures that you are looking for. It would also prevent misleading or incorrect selling.

Ikea have already created an augmented reality catalogue, connecting the consumer to the product:

> Connecting Two Worlds: INTERACTIVITY VIA MICROCONTROLLERS <

Raspberry PI, A Logic Game, Arduino Sound Synth and Leap Grid Zone Drone.

A micro-controller is a small, inexpensive computer, usually used for sensing input from the real world and controlling devices based on that input. It is created from a series of interface modules that allow the user to connect sensors, motors, lights, MIDI devices with little or no electronics work.

Using micro-controller's are a really great way to get to grips with the practical side of how connections like these facilitate objects. I like the way they have really simplified it via the use of magnetic connections and despite its younger target audience, they don't feel like toys!

LittleBits is a platform of easy-to-use electronic building blocks for creating inventions large and small. Uses a snap together feature with small magnets for prototyping and learning by trial and error targeting it's young demographic.

"put the power of electronics in the hands of everyone, and to break down complex technologies so that anyone can build, prototype, and invent" - LittleBits

I could see this technology being used in elaborate light systems such as huge, organised christmas decorations and events. They could also be used in costumes Arduino - outfits and costumes e.g a cloud

They could also be used in the context of energy saving such as during the night via the use of pressure pads which identity where light is needed. For example when someone walks down a corridor the pressure causes a chain reaction in lighting up the corridor. They detect pressure so will also go off after a certain time of weight inactivity.

This could also lead to using the pressure sensor in a doormat which will be used in replacement of pressing a doorbell. The door mat feature could also be used for wheelchair users who prefer to be hand free. The door would open opposite the way to where you are standing/where the pressure is.

Made with Adobe Slate

Make your words and images move.

Get Slate

Report Abuse

If you feel that this video content violates the Adobe Terms of Use, you may report this content by filling out this quick form.

To report a Copyright Violation, please follow Section 17 in the Terms of Use.