Research and inspiration 27/03/2018

Discovered the artist Amulets this week. He works with cassettes, players, tape loops and effects , creating woozy soundscapes and atmospheres from these simple sources. Of particular interest is the physical aspect of what he does, manipulating the sounds and machines in real time.

Also reading The Oxford Handbook of Interactive Audio, with a view to developing a more theoretical approach to the sound that will be part of my final installation.

Currently experimenting with combining simple tones to make chords / walls of sound, using this for reference: Frequencies for equal-tempered scale, A4 = 440 Hz

Panned version.

Mono version.

Also read this piece recently on FACT – The Sound of Fear, which mentioned the Ghost Tape Number 10, which was unpacked in this podcast a while ago. An interesting example of using sound to play on people’s cultural preconceptions.

During the Vietnam conflict, US troops played a soundtrack known as Ghost Tape Number 10 against the soldiers of the National Liberation Front. Used as part of Operation Wandering Soul, the unsettling tape collage tapped into Vietnamese beliefs that ancestors not buried in their homeland roam without rest in the afterlife. This spooky mix of voice, sound and music was intended to haunt Vietnamese soldiers and encourage them to abandon their cause.

Quite intrigued by this visualisation of sound in space via AR. Discovered this while reading about the Weird Type AR app.

I have also been investigating a few options for networking and interacting with the objects that will be the 3D models in the installation.

One is X BEE – apparently “the Digi XBee3 Series offers design freedom with easy-to-add functionality and flexible wireless connectivity.”

Another is the Google’s Project SOLI, a sensor which recognises hand gestures.

And finally, a MIDI controller ring, The Wave, as featured on TechCrunch.

Sadly the last two will not be available for a few months yet.

Processed stories: 2. Made Little Idea

Second text created using Markov chain text generation. Again, the text is in the order it was generated, although some slight edits have been made to give the text a bit more flow and ‘sense’.

Made little idea where he was
connect the bothersome sounds of the Earth
only family
had aged in the Desert,
a location on,
announcing the lens,
much less of the horse,
scans the space of whom,
announcing around the music,
waiting like electricity,
and intense, despite simple,

was being much like those back home.

 

Reported quite signals.
As he turned the cottage
whomever was great,

but maybe we’re not quiet.

 

To be honest, they too had seen the nature
wandered
not only more lush
and was unable to make the journey
back to the camera

shows not only family.

 

Looking back
their artists tried
the object details

tenderly.

 

These people live
significant mountains,
much like spider life,
that’s existence

quite done with wandering after all.

 

Being from and surprises the edges.

 

Even as a small life here,
as he looks closely,
careful to ignore
the leaf presents itself,
at first, as he thinks, as she named Kathy,

in honour of the sounds of the object.

 

Families gathered
spirit beautiful,
announcing she is assigned the airport,

sparsely, tendency, finally around the screen.

 

These people live a small listen
to take the creative commune
complex understanding

much less of the object.

 

Under closely, which finally that.

 

A web of careful
to connect is assigned

the artist’s ranch.

 

When they all listen.

 

A kindred spoil the communicating
back down is taken in a row behind

the council would change us all.

 

Or at the flickering moon shots,
the camera shows Beachtown USA,
situated near others

the moon landings.

 

Taken.

 

A kindred spirit beautiful,
and screen searching
signed the dial
view of decided
that is the pictures from memory

and the small life deciphering the stars.

 

As the lens near the Golden Gate Bridge

come riding horses.

 

Some before.

 

A celebration and spirit
behind the sound of the base

the contact with wandering travel.

 

The lens near other
means camera when the moon.

They travel.

 

Hopeful to think
she thinks,

object is so near as macro.

 

The live a similar kind,
was a pretty good idea while they knew it
was concert
have signal

would do the pictures from the lens.

 

Looking at this
was taken in by the concert

have begun.

 

Sat on his

heard the same from.

As he once again see scans them.

 

However, he had it.
They create as them.
However, he looks closely, careful to ignore they made.
With safety being near othered

occasionally the Earth.

 

The lens,
as only that there to find the lens.
Looking at thinks,

she notices that finally.

 

A web of carefully during its travels across space

mission for survival.

 

Even as we can tell,
static, waiting to pass.

Before static, waiting the home rest.

 

The city that’s existening
back down,
announcing the moon landing wasn’t enough,
because life wandered
was his headquarters, tunes,
looking for signal would come

time has passed.

 

More stop outside of the creative commune
inhabitants, the lab; an hour.
She glances up momentarily at the violins,

much; it was, but they weren’t enough the map.

 

An experience
up momentarily at a secret astronaut
analysed and scattered
mounted on the was

some time to listen is.

 

Looking at some sound so much;
it was unable to make the create

a sort of us.

 

Hopefully measured veins branch through others
and he decided the collects
antique photos of they weren’t enough,

because life.

 

Maybe was unable to take in the moon.
The sounds they knew the parlour.

They played from memory and the edges.

 

An easier time.
Before will be a fanfare.
A kind, was off to ride
collects antique photograph shows
not so much like electricity,

and the bother means came naturally, tenderly.

 

The sound of the same from the subject.
Unfortunately, tendency to be honest, they trail.
Where he wasn’t enough
other life, general
leave this cue to ride towards home,

and sounding like spider legs.

 

An expedition is.
Out in the Sun
a little idea
where to follow the map and in had it.
The grainy black and white screen.
Another life.
She had food and was being much like the journey
back to the photos of the city

the rider closely.

 

Families gather place.
Gazing in
stopped, tuned, rode again.
It was near to reach it,

communicating against the stars.

 

Lens near other side of time
to connect the screen.
They knew it took some sound.
Occasionally too
had seen this horse,
she tunes,
once again see

scanning their artists travel.

 

Being and expedition is sentimentarily
at a newly acquired piece mounted.
They all smile into her colleagues.
She adjusts the home
side of the commune
and takes it to his her –
she notices sound made little,

he came named.

 

Many have since suggested the decided that reminds they made.
 Without the craft the newly-acquired family

 

Narrative workshop 19/03/2018

On 19th March I conducted a 3 hour workshop with my fellow Interactive Digital Media colleagues to explore ideas of narrative for What Goes Around.

To kick off the session, each participant told a story about and item they had brought to the workshop that had a personal significance.

FM3 Buddah Machine
FM3 Buddah Machine

The object I chose was the FM3 Buddah Machine purchased at Sonar Festival a few years back.

Kat chose a piece of jewellery given to her by her ex and that belonged to his mother.

Kat Jewelry
Kat Jewelry

And KP brought along his drone that has traveled around the world with him, and has provided many images for his Instagram feed.

KP Drone
KP Drone

Next, we each chose five random images from print outs of photographs originally sent into space on the Voyager probe in 1977. The task was to write a story based on the sequence of five images.

Richard’s story, based on these images:

My 5 images
My 5 images
My 5 images
My 5 images

(The text of this story can be read here.)

Kat’s story, based on these images:

Kat's 5 images
Kat’s 5 images

KP’s story, based on these images:

KP's 5 images
KP’s 5 images

As you can hear above, each of us read out our stories.

The final task was to combine the two each of the images originally chosen with two new images each, totaling 12 images. These were then arranged collaboratively into another story, as you can see in the following images.

This week’s research and inspiration

Feedback. Am used to creating this physically with amp and sound input device (guitar or microphone), but can the same effect be created with a sensor and digital audio output?

Interesting Fast Co piece “about new, video-generating AI that’s dissolving the line between fact and fiction.”
https://www.fastcodesign.com/90162494/the-war-on-whats-real

OSMO
Saw a talk from Rachel Wingfield of Loop who showed video of OSMO – http://loop.ph/portfolio/osmo-ted2015/ – “an experiment in totally transforming a public space into a place of wonder and tranquility.” My favourite detail about this is that the whole ‘space’ folds up to the size of a suitcase, apparently. Oh, and that it was originally set up under the A13 flyover in Canning Town, London.

Some articles about generative (product) design.

The Alien Style of Deep Learning Generative Design
https://medium.com/intuitionmachine/the-alien-look-of-deep-learning-generative-design-5c5f871f7d10

Autodesk Project Dreamcatcher
https://autodeskresearch.com/projects/dreamcatcher

NASA’s Evolved Antenna, an aerial designed by an automatic computer design program using an evolutionary algorithm. In 2006.
https://en.wikipedia.org/wiki/Evolved_antenna

Audio:
Planning to go through some of the ‘homework’ on Modular Curiosity to get my head around VCV Rack:
https://www.youtube.com/channel/UCnZEv3hADF9ELOIwUNu6RVg

And discovered this Mica Levy piece today, Delete Beach, which inspired lots of ideas for narrative/s for What Goes Around...

Updated Arduino random play MP3s

With excellent assistance from the Arduino forum, I now have a working version of the circuit to play a random MP3 file each time the distance sensor is triggered. It doesn’t play a few of the files when they are triggered, but this has been tested elsewhere and the code works, so I need to investigate the files themselves, it seems.

And here’s the code used.

#include <SoftwareSerial.h>

#define ARDUINO_RX 5  //should connect to TX of the Serial MP3 Player module
#define ARDUINO_TX 6  //connect to RX of the module

#define trigPin 13  //for the distance module
#define echoPin 12

SoftwareSerial mySerial(ARDUINO_RX, ARDUINO_TX);//init the serial protocol, tell to myserial wich pins are TX and RX

////////////////////////////////////////////////////////////////////////////////////
//all the commands needed in the datasheet(http://geekmatic.in.ua/pdf/Catalex_MP3_board.pdf)
uint8_t Send_buf[8] = {0} ;//The MP3 player undestands orders in a 8 int string
//0X7E FF 06 command 00 00 00 EF;(if command =01 next song order)
#define NEXT_SONG 0X01
#define PREV_SONG 0X02

#define CMD_PLAY_W_INDEX 0X03 //DATA IS REQUIRED (number of song)

#define VOLUME_UP_ONE 0X04
#define VOLUME_DOWN_ONE 0X05
#define CMD_SET_VOLUME 0X06//DATA IS REQUIRED (number of volume from 0 up to 30(0x1E))
#define SET_DAC 0X17
#define CMD_PLAY_WITHVOLUME 0X22 //data is needed  0x7E 06 22 00 xx yy EF;(xx volume)(yy number of song)

#define CMD_SEL_DEV 0X09 //SELECT STORAGE DEVICE, DATA IS REQUIRED
#define DEV_TF 0X02 //HELLO,IM THE DATA REQUIRED

#define SLEEP_MODE_START 0X0A
#define SLEEP_MODE_WAKEUP 0X0B

#define CMD_RESET 0X0C//CHIP RESET
#define CMD_PLAY 0X0D //RESUME PLAYBACK
#define CMD_PAUSE 0X0E //PLAYBACK IS PAUSED

#define CMD_PLAY_WITHFOLDER 0X0F//DATA IS NEEDED, 0x7E 06 0F 00 01 02 EF;(play the song with the directory \01\002xxxxxx.mp3

#define STOP_PLAY 0X16

#define PLAY_FOLDER 0X17// data is needed 0x7E 06 17 00 01 XX EF;(play the 01 folder)(value xx we dont care)

#define SET_CYCLEPLAY 0X19//data is needed 00 start; 01 close

#define SET_DAC 0X17//data is needed 00 start DAC OUTPUT;01 DAC no output
////////////////////////////////////////////////////////////////////////////////////

void setup() {
  Serial.begin(9600);  //Start our Serial coms for serial monitor in our pc
  mySerial.begin(9600);  //Start our Serial coms for THE MP3
  delay(500);  //Wait chip initialization is complete
  sendCommand(CMD_SEL_DEV, DEV_TF);  //select the TF card
  delay(200);  //wait for 200ms
  pinMode(trigPin, OUTPUT);
  pinMode(echoPin, INPUT);
  randomSeed(analogRead(A0));
}

void loop() {
  if (measureDistance(trigPin, echoPin) < 10) {
    int randTrackNo;
    randTrackNo = random(1, 9);
    sendCommand(0x03, randTrackNo);
    Serial.print("Playing track:");
    Serial.println(randTrackNo);
    delay(1000);  //wait to avoid errors
  }
  delay(300);
}

void sendCommand(int8_t command, int16_t dat) {
  delay(20);
  Send_buf[0] = 0x7e; //starting byte
  Send_buf[1] = 0xff; //version
  Send_buf[2] = 0x06; //the number of bytes of the command without starting byte and ending byte
  Send_buf[3] = command; //
  Send_buf[4] = 0x00;  //0x00 = no feedback, 0x01 = feedback
  Send_buf[5] = (int8_t)(dat >> 8);  //datah
  Send_buf[6] = (int8_t)(dat);  //datal
  Send_buf[7] = 0xef;  //ending byte
  for (uint8_t i = 0; i < 8; i++) {
    mySerial.write(Send_buf[i]) ;  //send bit to serial mp3
    Serial.print(Send_buf[i], HEX);  //send bit to serial monitor in pc
    Serial.print(" ");
  }
  Serial.println();
}

long measureDistance(int trigger, int echo) {
  long duration, distance;

  digitalWrite(trigger, LOW);  //PULSE ___|---|___
  delayMicroseconds(2);
  digitalWrite(trigger, HIGH);
  delayMicroseconds(10);
  digitalWrite(trigger, LOW);

  duration = pulseIn(echo, HIGH);
  distance = (duration / 2) / 29.1;
  Serial.print("distance: ");
  Serial.println(distance);
  return distance;
}

What Goes Around sketches – February 2018

Some sketches to visualise the What Goes Around objects that may feature in the final installation. From spacecraft to insekts [sic], these are initial drawings of what may have been sent back to us from space.