Tag Archives: audio

Audio archives and searching (Part II)

enabling search within video is one of the projects at CSAIL web.sls.csail.mit.edu/lectures/

See “Lecture Browser: Enabling Search within Video”

See also http://www.technologyreview.com/communications/37354/

Could this be used to find things in an audio archive after selecting their visual equivalent in a phone? Could this be used with Google apps such as http://www.google.com/insidesearch/

In earlier academic literature there has been some previous research I know of in the area such as talkminer TalkMiner: A Search Engine for Online Lecture Video” url: http://talkminer.com/

There is also a more general article on such search engines here http://websearch.about.com/b/2012/02/08/use-talkminer-to-find-video-lectures-on-any-subject.htm

Could the above be combined with new interactive videos such as TED talks?

http://www.educatorstechnology.com/2012/04/ted-ed-turns-videos-into-interactive.html

Could the navigation peripherals be more physical, such as Siftables?

http://www.ted.com/talks/david_merrill_demos_siftables_the_smart_blocks.html

Would they be on new display options such as

http://www.ted.com/talks/mike_matas.html

Notes on Audio, Radio Archives and Digital Humanities Research

1. High performance audio computing

a. HPC http://www.dinigroup.com/

b. The Imperative for High-Performance Audio Computing
http://lac.linuxaudio.org/2009/cdm/Friday/09_ffitch/09.pdf

c. High Performance Computing Center Stuttgart has expertise in Audio-Videoconferencing
http://www.fasilis.eu/facilities/high-performance-computing

2. Augmented reality via sound, Tourist Soundscapes, projected urban surfaces (Media Scape)

a. Augmented reality and audio see esp Volkswagen http://econsultancy.com/uk/blog/9842-seven-awesome-augmented-reality-campaigns

b. Toozla: augmented reality AUDIO browser http://www.augmentedplanet.com/2009/12/the-worlds-first-audio-augmented-reality-browser/

c. Historic visual tour could have matching audio

“Augmented Reality Sightseeing” historic photos and 3D model superimposed of Berlin Wall.

a. Art and audio: Medea is a sound journey around the Black Sea:
http://soundwalkcollective.com/index.php?/progress/black-sea/

b. Soundscapes and archives http://www.catpaisatge.net/dossiers/psonors/eng/arxius.php

c. Google project glass AR released for cyclists, what about audio?
http://www.gizmag.com/google-x-augmented-reality/22072/

d. Projection in a panorama surround cinema with multiple scenes and spatial audio (split conversations) “Eavesdrop” by iCinema UNSW

http://www.icinema.unsw.edu.au/projects/eavesdrop/project-overview/

3. EVENTS THAT COULD SHOWCASE AUDIO-AR/3D PROJECTS

a. MEDIASPACE http://www.urbanmediaspace.dk/multimediehuset, MEDIA ARCHITECTURE BIENNALE 2012 http://www.digitalurbanliving.dk/news/events/mabiennale.php

b. Possible to showcase with 3D heritage conferences at UNESCO Paris? http://www.unesco.org/new/en/communication-and-information/access-to-knowledge/archives/audiovisual-archives/

4. HTML5 interface design and audio

a. HTML video editing, what functions can be done with audio mixing? For example, you have different radio tracks that can be mixed via a webpage, see http://evelyn-interactive.searchingforabby.com/

b. Can archives be integrated with editing applications on tablets and smart phones? (http://bbclistener.com/, http://www.thisamericanlife.org/listen)

5. Spatial audio and virtual environments eg OPEN SIM, Wonderland, Unity, Blender, procedural audio.

a. http://www.presciencelab.org/VA/
The goal of virtualized audio is to permit listeners and performers to inject themselves into a shared virtual acoustic space-to let a listener hear what a performer would sound like in his room or in a virtual performance space of his choosing. The listener(s) and performers, recorded or live, are able to move about the shared space at will, the system maintaining the illusion that the performers are in shared performance venue-a guitarist appears to be sitting at your conference table strumming softly.

b. Open Wonderland and Open Sim promised to be virtual worlds with spatialized audio that could work as virtual conferencing tools, Combine with 3D virtual worlds for teleconferencing, providing streaming located radio in VEs for teleconferencing, http://elearnmag.acm.org/archive.cfm?aid=2206888

6. Combine NUI, Soundscapes and urban design

a. Nordic + Natural User Interfaces (NUI): http://www.nuiteq.com/

b. Natural User Interfaces for a Radio Web archive? Pick the icons and move them on the screen, they play as you collect them.
For example: http://interactivemultimediatechnology.blogspot.com/2012/05/nuiteqs-latest-multitouch-showreel.html (Swedish http://www.nuiteq.com/)

c. Could it be used with archaeology projects. For example, virtual reality reconstructions and archaeoacoustics (http://article.wn.com/view/2012/04/24/Archaeoacoustics_reconstructs_the_sound_of_Stonehenge/).

d. There is also audio archaeology (http://www.nytimes.com/2000/12/03/magazine/audio-archaeology-eavesdropping-on-history.html?pagewanted=all&src=pm).

e. In a similar vein, there are good practice guidelines for archaeology audio archives(http://guides.archaeologydataservice.ac.uk/g2gp/Audio_1)

7. Archive-PR and profiling

a. Is there research being done on what examples can best showcase LARM to a wider audience? What new research tools are required for net radio, etc?
Example: http://www.audiencedialogue.net/pmlr3.html

AND http://www.widepr.com/press_release/10673/internet_radio_new_business_models_will_define_growth.html

AND http://marketing.about.com/od/publicrelation1/a/massmediapr.htm

b. Crowd tagging to increase profile and to study user behaviour (could be applied to radio archives?)
Indianapolis Museum of Art Tag tours http://www.imamuseum.org/page/collection-tags

c. What are the issues in RADIO ARCHIVE RESEARCH? http://www.iasa-web.org/selection/selection-radio-sound-archives-problem-documentation

8. Audio-video intelligent searching (DARIAH?)

a. For our contribution to DARIAH we need indexing tools and search tools ways of creating interactive video and audio content.

9. RADIO and GEOVISUALIZATION

a. Could audio detection tools reveal recording location?

b. Pronunciation database retrieval, idiolects (CLARIN_NeDiMAH, DARIAH?). Update apparently already done. Hmm, but with ORBIS like data? (http://orbis.stanford.edu/)

Note to self:

· In passing, 3D sound http://www.studio360.org/2011/apr/29/adventures-3d-sound/

·  Note to self: where is that French video showing accurate 3D recording of sound that they added to virtual objects?

· Retrieving sounds via voice and movement detection (“Skyrim voice detection” the game engine can be used to create free standing levels). Medieval and pseudo Viking content is already built into the game.

)