What’s around Me? Spatialized Audio Augmented Reality for Blind Users with a Smartphone

1. Blattner, M., Sumikawa, D., Greenberg, R.: Earcons and icons: Their structure and common design principles. Human-Computer Interaction 4(1), 11–44 (1989)

   Article  Google Scholar 

2. El-Shimy, D., Grond, F., Olmos, A., Cooperstock, J.R.: Eyes-free environmental awareness for navigation. Springer Journal on Multimodal User Interfaces, Special Issue on Interactive Sonification (2011) (in press)

   Google Scholar 

3. Gaver, W.: Auditory Icons: Using Sound in Computer Interfaces. Human-Computer Interaction 2(2), 167–177 (1986)

   Article  Google Scholar 

4. Golledge, R.G., Klatzky, R.L., Loomis, J.M., Speigle, J., Tietz, J.: A geographical information system for a GPS based personal guidance system. International Journal of Geographical Information Science 12(7), 727–749 (1998)

   Article  Google Scholar 

5. Golledge, R.G., Loomis, J.M., Klatzky, R.L., Flury, A., Yang, X.L.: Designing a personal guidance system to aid navigation without sight: Progress on the GIS component. Int. J. of Geographical Information Science 5(4), 373–395 (1991)

   Article  Google Scholar 

6. Helal, A.S., Moore, S.E., Ramachandran, B.: Drishti: An integrated navigation system for visually impaired and disabled. In: ISWC 2001 Proceedings of the 5th IEEE International Symposium on Wearable Computers (4514203), p. 149. IEEE Computer Society (2001)

   Google Scholar 

7. Klatzky, R., Marston, J., Giudice, N., Golledge, R., Loomis, J.: Cognitive load of navigating without vision when guided by virtual sound versus spatial language. Journal of Experimental Psychology. Applied 12(4), 223–232 (2006)

   Article  Google Scholar 

8. Linell, M.: Comparison between two 3d-sound engines of the accuracy in determining the position of a source. Master’s thesis, Luleå U. of Technology (2011)

   Google Scholar 

9. Mariette, N.: From Backpack to Handheld: The Recent Trajectory of Personal Location Aware Spatial Audio. Media-Space Journal 1(1) (2008)

   Google Scholar 

10. McGookin, D., Gibbs, M., Nivala, A.-M., Brewster, S.: Initial Development of a PDA Mobility Aid for Visually Impaired People. In: Baranauskas, C., Abascal, J., Barbosa, S.D.J. (eds.) INTERACT 2007. LNCS, vol. 4663, pp. 665–668. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

11. Petrie, H., Johnson, V., Strothotte, T., Raab, A., Fritz, S., Michel, R.: MOBIC: Designing a Travel Aid for Blind and Elderly People. Journal of Navigation 49(01), 45–52 (1996)

    Article  Google Scholar 

12. Petrie, H., Johnson, V., Strothotte, T., Raab, A., Michel, R., Reichert, L., Schalt, A.: MoBIC: An Aid to Increase the Independent Mobility of Blind Travellers. British Journal of Visual Impairment 15(2), 63–66 (1997)

    Article  Google Scholar 

13. Ran, L., Helal, S., Moore, S.: Drishti: an integrated indoor/outdoor blind navigation system and service. In: Proceedings of the Second IEEE Annual Conference on Pervasive Computing and Communications, pp. 23–30 (2004)

    Google Scholar 

14. Roentgen, U.R., Gelderblom, G.J., Soede, M., de Witte, L.P.: Inventory of electronic mobility aids for persons with visual impairments: A literature review. Journal of Visual Impairment & Blindness 102(11), 23 (2008)

    Google Scholar 

15. Stewart, J., Bauman, S., Escobar, M., Hilden, J., Bihani, K., Newman, M.W.: Accessible contextual information for urban orientation. In: Proceedings of the 10th International Conference on Ubiquitous Computing, pp. 332–335. ACM (2008)

    Google Scholar 

16. Su, J., Rosenzweig, A., Goel, A., de Lara, E., Truong, K.N.: Timbremap: enabling the visually-impaired to use maps on touch-enabled devices. In: Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services, pp. 17–26. ACM (2010)

    Google Scholar 

17. Sundareswaran, V., Wang, K., Chen, S., Behringer, R., McGee, J., Tam, C., Zahorik, P.: 3D audio augmented reality: implementation and experiments. In: Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 296–297 (2003)

    Google Scholar 

18. Vazquez-Alvarez, Y., Brewster, S.: Investigating background & foreground interactions using spatial audio cues. In: Extended Abstracts CHI 2009, p. 3823 (2009)

    Google Scholar 

19. Völkel, T., Kühn, R., Weber, G.: Mobility Impaired Pedestrians Are Not Cars: Requirements for the Annotation of Geographical Data. In: Miesenberger, K., Klaus, J., Zagler, W.L., Karshmer, A.I. (eds.) ICCHP 2008. LNCS, vol. 5105, pp. 1085–1092. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

20. Walker, B.N., Lindsay, J.: Navigation performance in a virtual environment with bonephones. In: Proceedings of the International Conference on Auditory Display (ICAD 2005), vol. 3(3), pp. 1–26 (2005)

    Google Scholar 

21. Walker, B.N., Nance, A., Lindsay, J.: Spearcons: Speech-based earcons improve navigation performance in auditory menus. In: Proceedings of the International Conference on Auditory Display, London, UK, pp. 63–68 (2006)

    Google Scholar 

22. Walker, B.N., Stanley, R.: Thresholds of audibility for bone-conduction headsets. In: International Conference on Auditory Display, Limerick, Ireland, pp. 218–222 (2005)

    Google Scholar 

23. Wilson, J., Walker, B., Lindsay, J., Cambias, C., Dellaert, F.: SWAN: System for Wearable Audio Navigation. In: 2007 11th IEEE International Symposium on Wearable Computers, pp. 1–8 (October 2007)

    Google Scholar 

24. Zandbergen, P., Barbeau, S.: Positional Accuracy of Assisted GPS Data from High-Sensitivity GPS-enabled Mobile Phones. J. of Navigation 64(03), 381 (2011)

    Article  Google Scholar 

25. Zhao, H., Plaisant, C., Shneiderman, B., Duraiswami, R.: Sonification of geo-referenced data for auditory information seeking: Design principle and pilot study. In: Proceedings of ICAD 2004-Tenth Meeting of the International Conference on Auditory Display (2004)

    Google Scholar 

Download references