The Visual Interaction Group at CVC investigates graphic and tangible low cost interfaces, to browse, interact, add metadata, and publish digital cultural collections.
The research theme into tangible interaction in digital collections began with a series of artworks by Dan Norton presented at WIRKT.
These artworks are graphic interfaces used in museums and art gallery installations and in live performance. They generate compositions from digital collections. Web versions of the artworks can be viewed below (require desktop/laptop):
- The Tomorrows Project – A digitised collection of celluloid from the Scottish Screen Archive;
- ablab_version – Multiple collections. This version includes film monologues, animated audiovisual loops, a collection from a mobile phone; and the aforementioned Tomorrows Project. Shown in Made in Britain
- Xixa – Video collection from the RCUK Xixa Arts Residency, Spain.
- Williamson’s Generator – Writings, audio, and video from the Shetland Islands, for the New Shetland Museum Archive, Scotland.
Memory Fields – Touch screen console in the Library of Sant Cugat, Spain.
The console accesses two collections: Spanish Civil War propaganda posters, and contemporary audio field recordings from Catalonia, Spain. It mixes sound and image and generates collage. The user can annotate and publish the results online @memoryfields
Work with the Joan Brossa Foundation and MACBA (Barcelona), to work with an unpublished collection of visual poems by the Catalan poet Joan Brossa. Brossa worked on the collection with colleagues like Joan Miro and Antoni Tapies.
@BrossaInedit is a touch screen interface for the public to publish the unpublished offline collection. Users view, add metadata, and publish the artworks. Each artwork contains metadata showing where the work was published, date time stamp, and user’s personal comments. The archive can be viewed via Twitter @BrossaInedit
The console represented Spain at the European Parliament in Generation Code , and was in Mobile Week Barcelona 2017 , and was in Library Living Lab, Barcelona, Spain, as a part of the 16th National Festival of Poetry.
Visual interaction with digital content using computer cameras for eye and head-tracking. Research in visual and technical development, using public installations in open arenas for citizen feedback.
Head Box (see video) uses visual triggers to access artifacts from the endangered archives project, EAP209: A survey on surviving dongjing archives in Jianshui, Tonghai and Mengzi. The material was developed at British Library Labs.
A web version can be viewed here (requires desktop or tablet, with camera). Note: web version does not work perfectly ! :
- Left / Right: work correctly;
- Up/Down: delicate! sometimes works;
- Centre button (grey circle for reloading library); Does not work. Use mouse !
Integrating phases 3 and 4: Digital Primitives & Joan Brossa
Interaction with @BrossaInedit previously involved a series of hand gestures using a tactile screen. These gestures are now translated as tangible interaction with plastic objects using an infrared sensor (LeapMotion™ device).
The prototype develops an approach using objects, which evoke very simplified manipulation patterns. We use children’s toys. These can be mapped as predictable hand gesture.
The result moves away from expensive and fragile equipment (touch screen), and looks at the use of low cost, robust elements (plastic shapes and IR sensor), to develop potentially none-touch consoles for interaction with public viewing screens and digitized cultural collections.