Screen

The screen shows two different videos, one shows a live feed from a performer on stage. The other shows an edited compilation of extracts from the archival footage .

Live Camera Feed: Audio Score The camera points inside the piano and follows the performer’s hand movements according to pre-recorded verbal instructions delivered via headphones. These instructions for handheld camera include:

‘follow left’ – follow the left hand of the performer ‘follow right’ – follow the right hand of the performer ‘be still’ – keep the camera still ‘zoom to close-up’ ‘zoom to wide shot’ ‘blur’ - unfocus the image ‘focus’ – focus the image ‘handheld’ - create a shaky hand held motion

I am interested in the concept of ‘trace’ and how the archival footage can be transformed through retracing. Here the camera is tracing the pianist movements who is in a sense tracing the archival video.

Edited extracts from the archival video are projected on a large screen next to the piano (a standard in-house projection). The video is different from the video score but uses some shared content. It is also synchronised to the video score so a 1 to 1 relationship is made between the archival video projection and the performer. Sometimes they have of a more contrapuntal relationship and other times the audio-visual have no distinct or deliberate sync points or relationships in time where the projected archival video cuts to scenes showing the cartography practices in the 1960s.

ARCHIVAL FOOTAGE - Mapping Australia (1966)

Discovering Archival Footage As A Score

The archival footage used in this piece was made in 1966 by the Australian Commonwealth Film Unit Production for the Department of National Development (“Internet Archive” 1966). The video shows methods used by cartographers in Australia at the time and advertises Australia for foreign mining interests. I used fragments from the video as score material, such as a scene where a man moves his pencil around on a map in an arbitrary way, a rock-pick hitting hard rock in the search for minerals in the earth, and terrain lines being drawn on plastic surface. The Indigenous Australian perspective on land and culture is not represented nor is there any acknowledgement of Aboriginal land rights, so this politically motivated me put the work together.

My political response to the archival footage became the framework, which led me to make decisions on how to represent the video, the map, and the piano. This led me to rethink how the piano can be mapped, not just by its notes, register or strings, but by thinking of other methods like through visual or tactile things like colour, lines, shapes, contours, surface textures and spatial dimensions within the piano. By rethinking how the piano is represented it helped to open up how it was used, notated, listened to and perceived.

There is a tradition of geographical research (e.g. Gould and White 1974) which sets out from the premise that we are all cartographers in our daily lives, and that we use our bodies as the surveyor uses his instruments, to register a sensory input from multiple points of observation, which is then processed by our intelligence into an image which we carry around with us, like a map in our heads, wherever we go. (Ingold, 1993 p. 124)

VIDEO SCORE

How The Video Functions As A Musical Score

Sections from an archival video (Mapping Australia, 1966) are cut up into sequences for the performer to act out, for instance, mimicking the movement of a person’s hand from the video. Text instructions are overlaid on the video that inform where on the piano to perform the gesture and with which object, such as a mallet or bamboo. The video score is displayed on a laptop inside the piano, which the performer reads during the performance.

As video material for the purposes of a score, the archival footage contains clear close-up scenes of people working with maps, tracing lines, close-ups of moving lines, pencils moving across the terrains of maps. A performer can imitate this by tracing its movements on to the surface of the instrument.

The archival film footage is used as the basis for the score. A direct relationship is made between the position of the line on the screen and the line to be drawn in the piano. The footage is therefore cut up and moved around in the frame and the performer follows it. My video editing choices were determined by practice videos I made earlier, documenting my experiences working with the piano. So I knew arranging the archival video a certain way would lead to a particular aural outcome. This led me to arrange the video as I would a musical composition.

The footage of lines being drawn on maps was ideal to ask a performer to follow. It was more versatile than other video content I worked with. It meant I could give instructions to the performer and there was more agreement about the identification and function of the line; the start and end point, its movement, its position in the frame. It also has visual representations of a past, present and future, so the performer could somewhat predict the next move. The lines were clear and the shots were long. This also meant I could time-stretch them over long periods of time and manipulate the footage and compose with the movements of the lines. It also has visual cues to indicate that a gesture is about to be made, such as a shot where a rock-pick is raised into the air before it strikes, and when it does strike the performer has to strike the piano with a mallet at the same time. This reminded me of a conductor waving a baton in the air to indicate the up coming down beat.

Political Choices As Compositional Process

I was initially drawn to the low end of the piano. I was fascinated by the rich, full-bodied sounds that were produced. My earlier practice videos I filmed reflect this tendency. This is seen in a video entitled single gestures with resonance, containing a collage of ideas surrounding this notion. This is one video among many videos I made leading up to the final work.

Later I decided to resist the urge to work mainly in the low-end section of the piano. Because I was seeing the piano as a representation of the map of Australia I did not want to prioritise just one area. From political perspective I attached to the work it seemed narrow-minded to do this and this narrow-mindedness is something I disliked about the archival video. Instead I chose to distribute the activity somewhat evenly around the piano. This forced me to go against my intuition and explore new ideas. The first section of the piece starts in Zone 13 and begins with a wooden mallet on the metal frame. Sections of the video are sped up and slowed down to control the pace of each gesture as a transformation of sonic material. The images are also flipped and moved around to change its direction and position. I treated video fragments in motivic ways akin to musical permutations, transforming them through transposition, inversion and retrograde.

[http://danielportelli.com.au/wp-content/uploads/2014/05/output_NBMRQ5.gif] A motif in the video score where the pianist has to follow the man’s pencil

Video As Notational Instructions

The video score comes with three instructional videos, which are to be used to learn about the relationship between the video score content and how to apply it to the piano. The instructional videos are given to the performer as part of a website containing all the performance materials I have discussed in this paper. The instructional videos (shown below) are presented as score instructions on a website and the performer must become familiar with it to understand the mechanics of the video score. This method was effective in communicating unique methods I developed myself in an effiecent way. The three videos explain how to read the video score, along with video examples of me doing a demonstration on the piano.

For ‘Wooden Mallet – Pencil On Map’ the instructions to be acted upon in response to the video score is: Make contact with piano using the wooden mallet when the man’s pencil touches the map. Copy the movement of the pencil and hand orientation as it moves along the map as well as its position in the frame of the video. Alternate between the two or do one or the other.

For ‘Rubber Mallet On Stress Bars – Rock Pick Hitting Rock’ the instruction to be acted upon in response to the video score is: Hit the centre stress bar with rubber mallet when the rock pick hits the hard rock and cracks.

For ‘Bamboo On Strings – Map Engraving’ the instructions to be acted upon in response to the video score is: The bamboo touches the strings when the map engraver touches the surface.Copy the movements of the engraver.

PAPER SCORE

Study Score

Actions in the video are reduced down to lines in a ‘study score’ I made (see below) and turned into functional musical data to be interpreted by the performer. The ‘study score’ is something I developed to accompany the video score. It is a notation of instructional details drawn from the video score and put on paper into a timeline sequence. The lines on the score show the direction, shape and relative spacing of each video gesture. By using the ‘study score’ the performer can have an overview of the macrostructure and get a sense of the ordering of sequences and how long tools are used for. Which is difficult to see in a video when there are moment to moment events.

‘Study Score’ – Mapping Australia (2014) – Page 1

CARTOGRAPHY

Cartography, Philosophy And The Use of Lines in Composition

The process for developing the piano instructions and use of tools has a relationship to the cartographic engraving practices in the 1960s, which used light to create precise terrain lines. The video screen displaying the video score in my work is transference from light to physicality, where the topography process is from physical to light:

The plastic sheets are taken one at a time and placed on a light table, where a soft light shines up through a white plastic surface. This illumination from below makes the lines of the map manuscript visible through the scribecoat. An engraver carefully cuts away the scribecoat along the lines and areas that are to be a certain colour on the finished map. For example, one sheet will have all the lines for rivers, lakes, and other bodies of water that are to be blue.

(“Topographical Maps,” website)

I am interested in the reductionism that occurs as a result of the line, and the philosophical inquiries that can be drawn from that; such as turning a river into a functional representation, for example as a blue line, versus experiencing and sensing a river for qualities such as the sense of tranquility that occurs through being amongst the constant presence of a flowing stream, listening, sensing and contemplating its fluidity, its mirroring surface, its texture, its motion, its life-giving properties, its cultural or sacred significance, or religious symbolism. So in this piano performance, the map, the score and the video are all representations of something else and mediators of reality. There is also a distancing going on where there is no clear or immediate way of understanding all the elements in the piece. In other words, it is allusive. The non-grid like structure of the piece gives a sense of flowing sounds, with unstable metric divisions. The surfaces and textures of the piano and the tools used are important features when listening to the piece. I was trying to create a multi-sensory experience based on the archival video.

Archival Footage: Political Reading Applied To The Piano

In the context of the documentary, it appears as if the cartographer’s role of objectively representing the landscape is analogous to the government’s disconnection to the people and culture. I was interested in applying this perspective to the piano. In my work, there is a misrepresentation of the piano, as if the piano’s history and its conventions have been disregarded. A sense of loss is also in the archival video through the process of trying to quantify something as complex as the natural world. So, in the performance, the performer quantifies the movements of a select number of fragments from the archival video. The piano also has analogous connections to landscape, a map, and to the cartographers’ mapping practices.

The Piano

Practical Aspects: Zones, Topography and its Political Associations The piano is broken up into 13 different zones, much like how land is divided into areas. The piano is not divided up by its notes or corresponding strings, but by space. Dividing lines are drawn based on visual aspects such as where the stress bars are or where the bridge starts, to determine the separation of zones. The composition was therefore constructed based on the physical properties of the instrument.

On the surface this can be compared to the history of the land divisions on the map of Australia. The following map shows the aboriginal languages, clans, groups of people and dialects across Australia. [http://www.yale.edu/gsp/colonial/Aboriginal_Australia_Map.jpg] Here is a time line of events showing the formation of more recent colonies/states and mainland territories. [http://en.wikipedia.org/wiki/States_and_territories_of_Australia#mediaviewer/File:Australia_history.gif] And here are the divisions I made on the piano for my piece.

The video score instructs which zones to perform in and the performer must move there and perform an action they see on screen. The video on screen is to be scaled to the relative size of the zone. The instruction is to imagine that the video screen is stretched and morphed to the shape of that given zone.

[https://www.dropbox.com/s/6ml7crx224t0qin/Morphing%20screen%20animation%20mapping%20australia.mov?dl=0]

The exact proportions are to be estimated. The jagged terrain lines in the video are traced onto the rough and unstable surface of the piano strings sonically activating the particular zone.

Conceptual Piano Keyboard Note Choice

There are also sections where piano fragments on the keyboard are played in Zone 9, at timecodes: 1’00”, 1’14”, 2’23”, 2’28”, 3’48” in the video score. Preparations inside the piano do not affect the timbre in the middle register, so the performer plays small fragments in this region. The notes and rhythms are a distilled reworking of music by the late Australian composer Robert Hughes, used in the archival footage. The music has been transcribed and notes and phrases have been removed leaving behind only a trace like a rubbed out line or a fading of the driving lyrical trajectory of the music. The duration of where notes fall remains the same as the original as music isolated from the original video. It is also reappropriated to new arrangements of footage, and visual stimuli.

Audio on Earphones

Audio from the archival footage plays through earphones, which sit in between the strings.

Performer

Performers Perspective There was some uncertainty from the pianist Tamara as to whether or not the engraver was actually touching the surface at a particular point, or whether the man’s pencil was touching the map. These were differences of opinion that are the result of working with a medium like video, which differs to the identification of a line and how it is used in tablature notation. Tamara discusses further about working with video as a score in an interview after our studio recording. Tamara explains:

In the piece (Mapping Australia), you can’t just by memory create the sounds of what’s on the screen, you actually have to really look at the screen because you have to do it at exactly the same time and that means there’s a lot of precision involved so that's the hardest part about it. You know, even if you were counting in a piece or you’re in a certain tempo there’s a tiny bit of leeway there, you can have a tiny bit of rubato or ease into something. But in this case you can’t.

(Cislowska, 2014, Audio Interview)

The rigidity of time described here along with the independent left and right hand movements, and the eyes needing to dart from one place to another made things difficult for Tamara (or any performer). A solution we came up with was to be economical with the tools. For instance, we found a rubber mallet, which doubled up as a wooden mallet on the reverse end. We also decided to keep all notated elements in one place so the performer’s head remains in one position.

TOOLS

Tools and Sound Worlds

The traces of the engraving process in the archival video are performed with varying tools such as: an electric fan, shredded bamboo, and rubber and wooden mallets.

Bamboo

I came across a bamboo wok cleaner at a Chinese supermarket in Haymarket, Sydney. The bamboo is shredded and makes a crispy, crackling, grinding sound. The sound world of the bamboo relates to a scene in the performance video where a tree is constantly falling and rising back up again. Here the performer acts like a Foley artist as the crackling of the bamboo relates to the crackling bark from the tree. This happens in real-time but the performer cannot see the tree so at times it seems disconnected. The performer twists and turns the bamboo on top of a piece of paper, which lies across the low strings, rattling against the strings when struck. The result is a rich timbral world with a dynamic percussive quality as it jolts, stutters and rolls around the sections of the piano.

Electric Fan

An electric fan with soft nylon string attach to each blade creates a soft sustaining resonance. The fan slowly glides over and sonically unveils each string, and sections, of the piano, such as high tinny sounds beyond the bridge and around the tuning pegs.

Wooden Mallet

A wooden mallet scrapes and grinds over the strings, the metal plate and wooden case of the piano. Its rough surface creates varying sounds depending on the angle it is held and the location it is played. The instructions in the score for the use of the wooden mallet are: “Let the weight of the mallet determine the pressure on the piano and its strings rather than applying additional pressure”. The performer is also to copy the man’s hand orientation shown in the video score.

Rubber Mallet

A rubber mallet is used to strike the central stress bars on the piano. The sharp attack causes the metal plate to vibrate suddenly producing an after glow of overtones from the strings. Here the performer is hitting the stress bar at the same time a man in the video is hitting hard rock with a rock-pick, which is a process for harvesting minerals from the land. Although these tools may seem damaging to some piano enthusiasts, a lot of care taken not to harm the instrument.

Lapel Microphone

Use of Electronics: Lapel Microphone

The performer also has a small-capsuled lapel microphone attached to their left hand. Text instructions on the screen indicate when to wave the mic over the current sound being made. The original audio from the archival video plays through earphones placed inside the piano and is amplified by the lapel mic.

The earphones are amplified when the performer waves a lapel microphone (DPA 4061) over them at different rates. The signal from the lapel microphones are amplified and played through the loudspeakers.

Lapel Microphone: Score Instructions The performer has six lapel microphone movement instructions which are displayed as text in the video score:

  1. Follow (follow where the other hand is moving and the sound it is creating).

  2. Off (take mic away).

  3. Wave l Fast Object (wave mic quickly towards and away from the object making sound).

  4. Wave 2 Slow Object (wave mic slowly towards and away from the object making sound).

  5. Wave 1 Fast Earphones (wave mic quickly towards and away from the earphones).

  6. Wave 2 Slow Earphones (wave mic slowly towards and away from the earphones).

A precise notation of what ‘fast’ and ‘slow’ means is provided to the performer. This is seen below as a score, which the performer becomes familiar with. 1 is ‘fast’ and 2 is the ‘slow’ movements by the left hand:

Lapel Microphone: Conceptual Relationship

The audio is cut up through this live physical movement. This process adds to the work through the play between close miking and the acoustic sound. Conceptually, an analogy was drawn between the waving of the lapel mic and the hovering of the planes that fly over and survey the land that are in the original archival video but does not feature in the performance video. Therefore this relates to the cartography practices more generally. An aural relationship to this concept is also present when the electric fan sounds like the propellers on a plane when it makes contact with the paper.

Experimentation Of Tools, Video as Process

In the process of creating the work I made a series of video recordings of my explorations on the piano. Here I could play around with various objects and explore the regions of the piano with these implements. These ideas were documented as videos so I could refer back to them during the later stages of the compositional process. I was doing this before I found the archival footage. I compiled these videos on a website and it became part of the poetic impetus for my musical ideas. These recordings were like meditations using shapes and movements repeated over and over in different permutations with varying tools. The shapes I explored were:

I wrote in my process diary at this time: “the inside of the piano is a terrain. The strings are a body awoken through a drama of surface tensions and colouring through materials”. This reflects a particular way of seeing the instrument that allowed me to work from my own discoveries rather than drawing from methods of other composers. When discovering the archival footage my ideas fell into place. I made sure to choose my own tools used inside the piano. I chose tools that I thought sound interesting to me. Because of the conceptual focus in this work I wanted to complement it with a sound world that was interesting to me.