Category Archives: Architecture

How do you create past-ness through place?

I remember walking though Berlin once. I didn’t know the exact history of where I was but I could ‘feel’ it. That night I researched where I had been and the associated events. I was right, I had been in very ‘dark’ places which now just appeared to be civic areas.
My little blog post isn’t about Berlin though. It is about those places you visit where you feel there is ‘history’ there, a past-ness.
Totally subjective, misguided? Perhaps. But I am sure I am not the only one who occasionally encounters this sensation.
And if some or many people encounter this experience, how can we also encounter it in virtual worlds? Or is that impossible? I was wondering if I could find thoughts on this from exhibition designers, amusement park builders, neo-ancient architects.
I know E.G. Asplund of Sweden (1885-1940)  used techniques to make the buildings seem older but I’ll also have to find others.
So much to think upon.

PhD Scholarships-Cultural Heritage & Visualisation

There are 2 PhD scholarships now open at Curtin University, for students interested in 3D models of heritage sites, community participation, heritage issues and preservation of the 3D models themselves:

http://scholarships.curtin.edu.au/scholarships/scholarship.cfm?id=2782.0

 

Book in preparation “Organic Design in Twentieth-Century Nordic Architecture”

Yes I know I don’t normally write in architectural history (any more) but this research gave me a great deal of insight into place design and virtual space non-place design. Even though the first draft is not due to August next year, I’d just like to thank Routledge for allowing me the chance to publish in this area.

I wrote this book because I realised there was very little of critical import on what organic really means (it is often used as a compliment or a criticism without an explanation). I did not know why Nordic architects seldom featured in global architectural history books and yet those who visited their buildings were in such admiration. Indeed I also wanted to explore how Nordic architects could incorporate modernism without turning their backs on earlier styles and traditions, for they were seldom either modernist or postmodernist.

The Broad Theme/ back cover:

Can a communicable and thus useful definition of ‘Organic Architecture’ be made? In this book I say yes, there is both a practical and therefore useful definition of ‘Organic Architecture’ if we view it as an attempt to thematically unify the built environment through the allegorical expression of on-going interaction between the designer and the forces of flux and change in the real world.

I have focused on the works and writings of major twentieth-century architects of Nordic countries structured around three major premises:

  • The most prominent architects of the four major Nordic countries were influenced by similar principles.
  • The works of these prominent architects can be seen as evolving from several major ideas traceable thought their buildings.
  • From the ideology of their writings these architects made explicit claims as to the existence of such ideas in their work.

3D models: Advanced challenges, UCLA

Daisy-O’lice I. Williams, University of Oregon, presents to the insitute on day 1, 20 June 2016, UCLA.

I was very fortunate to be invited to the NEH-funded Advanced Challenges in Theory and Practice in 3D Modeling of Cultural Heritage Sites Institute, hosted at University of Massachusetts in 2015 and University of California Los Angeles (UCLA) 20-23 June 2016.
Some points I noticed reoccurring over the four days (and which I also added to the #neh3D twitter stream) were:

  1. People are still inventing the wheel when it comes to interaction in virtual environments. But you all knew that anyway.
  2. There is still a gap between educators and libraries who just want to get projects made, students engaged, and assets saved and those who talk about the big metadata / ontology questions. Nobody apart from Piotr used CIDOC-CRM for example and as he and I agreed, there needs to be more useful examples for archaeologists and architects.
  3. We still need an open source augmented reality platform: Content providers will try to lock you in to their own devices (http://www.pcworld.idg.com.au/article/602484/google-building-its-own-smartphone-report-says/) and AR software is commercial, risky and when the AR company disappears so does your augmented reality project! To add insult to injury many AR software apps store you models offline or in a secure cloud so you cannot directly access them even though you made them.[I have just heard of ARGON, will have to investigate].
  4. There is no suitable 3D model+scholarly journal, the editor in chief of Digital Applications in Archaeology and Cultural Heritage, Bernard Frischer, admitted their 3D solution was not yet a fully usable solution plus Elsevier say they own the model. Actually, I think the ownership of the scholarly content is as much an issue as the lack of a suitable 3D viewer. Other journals that may offer similar issues but 3D model potential are http://intarch.ac.uk/ (“All our content is open access”) and ACM Journal on Computing and Cultural Heritage (JOCCH). However at the workshop one of the founders of SCALAR expressed interest in exploring 3D for SCALAR so hopefully something eventuates with this working party.

Many thanks to Alyson Gill (UMass) and Lisa Snyder (UCLA) for the opportunity to hear about US developments and the really cool CULTURAL HERITAGE MARKUP LANGUAGE CIDOC_CRM project that Piotr Kuroczyński (Herder Institute Germany) presented.

The Spatial Nature of Archives

if we entertain the notion of a book as being distinct from text in an ‘universal’ library (http://firstmonday.org/ojs/index.php/fm/article/view/3237/3416) and if we consider that early libraries could be spatially memorable forms of archives and churches to be early examples of walk-through books..

Refer The_Gothic_Cathedral_An_Immersive_Information_Visualization_Space

This has changed
http://www.e-flux.com/journal/entering-the-flow-museum-between-archive-and-gesamtkunstwerk/
“However, the relationship between internet and museum radically changes if we begin to understand the museum not as a storage place for artworks, but rather as a stage for the flow of art events..And on the internet, the museum functions as a blog. So the contemporary museum does not present universal art history, but rather its own history—as a chain of events staged by the museum itself. But most importantly: the internet relates to the museum in the mode of documentation, not in the mode of reproduction. Of course, the museums’ permanent collections can be reproduced on the internet, but the museum’s activities can only be recorded.”

Could it be possible that the spatial and physical even architectural organization and appearance of an archive could actually help organize, assist retrievability of the stored collection? I am sure research has been done on this throughout history, but knowing where to start is the question!

NB Please note I am not asking about archives of spatial data, I am asking if there are archives that were themselves physically, platially, spatially organized.

Post-doctoral contract offer : Collaborative mapping and geovisualisation of spatio-historical data sets

The MAP research unit offers a post-doctoral position for a period of 12 months starting on June 1st 2016. The position profile is related to the field of geovisualisation, but in an application to spatio-historical data sets, and in the context of a citizen science exploratory project.

The MAP unit, funded by CNRS (French National Centre for Scientific Research) and by the French Ministry for Culture, conducts interdisciplinary research activities focusing on the integration of computer science methodologies, formalisms and tools to applications fields like heritage architecture, history and archaeology, spatio-temporal dynamics (www.map.cnrs.fr).

The team is in charge of an exploratory research programme entitled Territographie (www.map.cnrs.fr/territographie), a programme the aim of which is to weigh the potential impact of the citizen science approach in the study of the so-called minor heritage (i.e. collections encompassing tools for agriculture, old occupations, unlisted edifices, etc.).
The team wishes to develop and test a customizable collaborative mapping solution, intended for use in collecting information as well as in browsing/selecting information.

You will find attached two PDF documents (one in French, one in English) presenting the details of the offer : context , mission, skills required , conditions, application procedures.

Contact:

Livio De Luca
Directeur de Recherche au CNRS
Directeur de l’UMR CNRS/MCC MAP _ Modèles et simulations pour l’Architecture et le Patrimoine
http://www.map.cnrs.fr

Email: livio.deluca

postDoctoralPosition_territographie.pdf

offrePostDoc_territographie.pdf

Call for Book Chapters: “Place and the Virtual”

I am seeking 8-12 chapters for an edited book on “Place and the Virtual”. Proposed chapters can be on

  1. Definitions, main concepts, historical interpretations.
  2. Critical reviews of virtual places (theoretical or individual existing or past or future examples).
  3. Investigations into the similarities dissonances and differences between real places and virtual places.
  4. Applications of theories in other fields to the design or criticism of virtuality and place.
  5. Implications of related technologies, social trends, issues and applications.

Typical book chapter length: 5,000–8,000 words

Current Status of Proposal: The book proposal will be sent to the below editors for review when I have approximately 8-12 chapter abstracts.
Submission format: by email or attached word or RTF (rich text format) document, approximately 300-500 words.
Deadline for chapter abstracts: Still considering applications.

Email your abstract to: erik DOT champion AT Curtin DOT edu DOT au

Proposed to be part of a new planned Bloomsbury Books Series: Thinking Place, Series Editors Jessica Dubow and Jeff Malpas.Please distribute to interested parties.

Teotihuacán

NB The feathered serpent (Quetzalcóatl) and Tláloc (a sort of lizard) entwine the human mountain (the temple) which in the Temple of the Moon (not the larger Temple of the Sun) hold a cave, symbolising fertility (and I assume, creation).

The two thousand year old murals and frescos are fascinating, the sinuous shape near the mouths indicate (flowery) speech:

My thanks to INAH for inviting me to Mexico and to fascinating archaeological sites such as Teotihuacan (INAH:in Spanish) and Xochicalco (see the solar hexagonal shaped overhead solar tunnel as per the below!)

MINECRAFT VR/3D/3D python programming tutorials

MODELS/TERRAIN

We are looking at creating a projected/tracked 3D environment of Perth and Curtin for Curtin Library’s makerspace using Digital Elevation Models (DEM) from sites like

  1. http://vterrain.org/Locations/au/ e.g. http://www.simmersionholdings.com/customers/stories/city-of-perth.html
  2. Then, import into minecraft: https://www.youtube.com/watch?v=tJf2_pQo0dQ
  3. Or from Google Earth: https://www.youtube.com/watch?v=Wha2m4_CPoo

Python

We are looking at creating Python for archaeologists & historians in Minecraft:

Minecraft in a high end game engine and vice versa

Minecraft projection

Minecraft & Oculus & gear

Minecraft in 3D?

https://forums.geforce.com/default/topic/492117/3d-vision/minecraft-does-minecraft-work-in-3d-/

Out soon: My book “Critical Gaming: Interactive History & Virtual Heritage”

Review:

If you would like to review the book please check out this page for contact details: https://www.ashgate.com/default.aspx?page=2253 …

Critical Gaming: Interactive History and Virtual Heritage

Purchase:

The book will be available via http://www.ashgate.com/isbn/9781472422910

or Amazon: http://www.amazon.com/Critical-Gaming-Interactive-Heritage-Humanities/dp/1472422929

This book explains how designing, playing and modifying computer games, and understanding the theory behind them, can strengthen the area of digital humanities. This book aims to help digital humanities scholars understand both the issues and also advantages of game design, as well as encouraging them to extend the field of computer game studies, particularly in their teaching and research in the field of virtual heritage.By looking at re-occurring issues in the design, playtesting and interface of serious games and game-based learning for cultural heritage and interactive history, this book highlights the importance of visualisation and self-learning in game studies and how this can intersect with digital humanities. It also asks whether such theoretical concepts can be applied to practical learning situations. It will be of particular interest to those who wish to investigate how games and virtual environments can be used in teaching and research to critique issues and topics in the humanities, particularly in virtual heritage and interactive history. Contents: Introduction; Digital humanities and the limits of text; Game-based learning and the digital humanities; Virtual reality; Game-based history and historical simulations; Virtual heritage and digital culture; Worlds, roles and rituals; Joysticks of death, violence and morality; Intelligent agents, drama and cinematic narrative; Biofeedback, space and place; Applying critical thinking and critical play; Index.

Phenomenology and Place

I wrote the below as an email to a small* group of writers/philosophers/academics I’ve found really helpful in my own thinking on phenomenology and place.
I won’t write their names (indeed, I have not even given them any time to respond yet) but I thought I would share my [redacted] email to them in case a reader here

  1. Totally disagrees with my premises and can help me improve them and/or..
  2. Believes they would have something worthy and useful to write in a potential book chapter on the topic.

Dear [insert your favorite live phenomenologist name here]…

For many years I have tried to understand place in virtual environments, how to understand how people experience it, and how to discover and communicate if there are elements of place missing from virtual environments and how to address that through criticism and through design.
My personal interest is in history and heritage (and cultural presence for archaeology simulations) but the problem is wider, and deeper than just virtual places.

I still feel that a possible help and a major problem comes from discussions of phenomenology, namely these:

  1. The role of phenomenology in philosophy is avoided by many philosophers (at least it was a problematic term when I wanted to study it in a philosophy department).
  2. Many outside philosophy use the word without clarifying or helping to clarify where and how it is best used and understood and its limitations (if any).
  3. Many of these papers lack critical analytical reflection and especially are not amenable to extrapolation beyond either the self or calls to authority (authority here usually means dead phenomenologists who are invoked for areas they never actually wrote about directly or perhaps for new discoveries that did not even exist in their time).
  4. In the Presence research area of virtual environment evaluation this is particularly evident yet the laboratory control conditions for Presence evaluations and their extremely generic yet vague questionnaires. Here phenomenology or some related ethnographic method could and should have an important role to play but because of its stigma (not helped by papers which haven’t always been the best examples of phenomenology) virtual environments (virtual reality environments, games, architectural simulations, virtual worlds) lack many of the rich interesting and engaging aspects and potential of place.

Sorry for the longish intro. My suggestion in brief, is probably an edited book: that compiles, describes and especially clarifies major techniques, conditions and limitations of phenomenology and how they could be used or adapted or critiqued for place design (and by extension, for virtual environments). The audience: I’d hope more for an audience of place interested designers and academics than philosophers per se.

*There were more people I had in mind to write to, but will extend the circle if I get a good response from the initial correspondents.

Uploaded some older papers: Virtual Places, and The Limits of Realism

Virtual Places
Article. From: Encyclopedia of virtual communities and technologies, 2006, Idea Group Reference

Communities identify and are identified by not just the clothes they wear or by the language they speak, or even by the way they greet each other. Communities are often identified by where their activities take place, how they use spaces to construct meanings, and the traces left by their social interactions. These “trigger” regions are thus not just points in space; they are also landmarks, havens, homes, ruins, or hells. Communities, then, are identified and identify with or against, not just space but place. For places do not just organize space; they orient,
identity, and animate the bodies, minds, and feelings of both inhabitants and visitors.

The Limits of Realism in Architectural Visualisation
Conference paper.
FOR: LIMITS XXIst annual conference of the Society of Architectural Historians Australia and New Zealand Melbourne, Australia (SAHANZ) 26–29 September, 2004 website: http://sahanz04.tce.rmit.edu.au/
ABSTRACT
In March 2004 the eminent scholar Professor Marco Frascari presented an informal seminar at the University of Melbourne in which he argued computer reconstructions of architecture were far too exact and thus too limited in conveying the mood and atmosphere of architecture. With all due respect to Professor Frascari, this paper will argue the converse: that recent developments in interactive technology offer new and exciting ways of conveying ‘lived’ and experientially deepened notions of architectural placemaking. Using current research findings in virtual presence studies, archaeological theory and site reports, as well as usability evaluations; this paper will examine the above issues in relation to a recently created and evaluated virtual reconstruction of a Mesoamerican cityLIMITS XXIst annual conference of the Society of Architectural Historians Australia and New Zealand Melbourne, Australia (SAHANZ) 26–29 September, 2004

abstract: Motion Control For Remote Archaeological Presentations

My abstract for 21 May talk at the Digital Heritage 3D representation conference at Moesgaard Museum Aarhus Denmark

Title: Motion Control For Remote Archaeological Presentations

Displaying research data between archaeologists or to the general public is usually through linear presentations, timed or stepped through by a presenter. Through the use of motion tracking and gestures being tracked by a camera sensor, presenters can provide a more engaging experience to their audience, as they won’t have to rely on prepared static media, timing, or a mouse. While low-cost camera tracking allow participants to have their gestures, movements, and group behaviour fed into the virtual environment, either directly (the presenter is streamed) or indirectly (a character represents the presenter).

Using an 8 metre wide curved display (Figure 1) that can feature several on-screen panes at once, the audience can view the presenter next to a digital environment, with slides or movies or other presentation media triggered by the presenter’s hand or arm pointing at specific objects (Figure 2). An alternative is for a character inside the digital environment mirroring the body gestures of the presenter; where the virtual character points will trigger slides or other media that relates to the highlighted 3D objects in the digital scene.

Acknowledgement: I would like to thank iVEC summer intern Samuel Warnock for kicking off the prototype development for me and Zigfu for allowing us access to their SDK.

Figure 1. Screenshot of stereo curved screen at the HIVE, Curtin University.

Figure 2. Screenshot of prototype and pointing mechanism at the HIVE, Curtin University.

Kinect SDK 2 FINGER TRACKING (etc) for Desktops & Large Screens (VR)

We are trying to create some applications/extensions that allow people to interact naturally with 3D built environments on a desktop by pointing at or walking up to objects in the digital environment:

or a large surround screen (figure below is of the Curtin HIVE):

using a Kinect (SDK 1 or 2) for tracking. Ideally we will be able to:

  1. Green screen narrator into a 3D environment (background removal).
  2. Control an avatar in the virtual environment using speaker’s gestures.
  3. Trigger slides and movies inside a UNITY environment via speaker finger-pointing Ideally the speaker could also change the chronology of built scene with gestures (or voice), could alter components or aspects of buildings, move or replace parts or components of the environment. Possibly also use Leap SDK (improved).
  4. Better employ the curved screen so that participants can communicate with each other.

We can have a virtual/tracked hand point to objects creating an interactive slide presentation to the side of the Unity environment. As objects are pointed at information appears in a camera window/pane next to the 3D digital environment, or, these info windows are triggered on approach.

A commercial solution to Kinect tracking for use inside Unity environments is http://zigfu.com/ but they only appear to be working with SDK 1. Which is a bit of a problem, to rephrase:

Problem: All solutions seem to be Kinect SDK 1 and SDK 2 only appears to work on Windows 8. We use Windows 7 and Mac OS X (10.10.1).

So if anyone can help me please reply/email or comment on this post.

And for those doing similar things, here are some links I found on creating Kinect-tracked environments:

KINECT SDK 1
Kinect with MS-SDK is a set of Kinect examples, utilizing three major scripts and test models. It demonstrates how to use Kinect-controlled avatars or Kinect-detected gestures in your own Unity projects. This asset uses the Kinect SDK/Runtime provided by Microsoft. URL: http://rfilkov.com/2013/12/16/kinect-with-ms-sdk/
And here is “one more thing”: A great Unity-package for designers and developers using Playmaker, created by my friend Jonathan O’Duffy from HitLab Australia and his team of talented students. It contains many ready-to-use Playmaker actions for Kinect and a lot of example scenes. The package integrates seamlessly with ‘Kinect with MS-SDK’ and ‘KinectExtras with MsSDK’-packages.

NB
KinectExtras for Kinect v2 is part of the “Kinect v2 with MS-SDK“. This package here and “Kinect with MS-SDK” are for Kinect v1 only.

BACKGROUND REMOVAL (leaves just player)
rfilkov.wordpress.com/2013/12/17/kinectextras-with-mssdk/

FINGER TRACKING (Not good on current Kinect for various reasons)

  1. http://www.ar-tracking.com/products/interaction-devices/fingertracking/
  2. Not sure if SDK 1 but FingerTracker is a Processing library that does real-time finger-tracking from depth images: http://makematics.com/code/FingerTracker/
  3. Finger tracking for interaction in augmented environments: Finger tracking for interaction in augmented environments OR https://www.ims.tuwien.ac.at/publications/tr-1882-00e.pdf by K Dorfmüller-Ulhaas – a finger tracker that allows gestural interaction and is sim- ple, cheap, fast … is based on a marked glove, a stereoscopic tracking system and a kinematic 3-d …
  4. Video of “Finger tracking with Kinect SDK” see https://www.youtube.com/watch?v=rrUW-Z3fHkk
  5. Finger tracking using Java http://www.java2s.com/Open-Source/CSharp_Free_Code/Xbox/Download_Finger_Tracking_with_Kinect_SDK_for_XBOX.htm
  6. Microsoft can do it: http://www.engadget.com/2014/10/08/kinect-for-windows-finger-tracking/ Might need to contact them though for info

HAND TRACKING FOR USE WITH AN OCULUS RIFT
http://nimblevr.com/ For use with rift
Download nimble VR http://nimblevr.com/download.html Win 8 required but has mac binaries

Advanced Challenges in Theory and Practice in 3D Modeling of Cultural Heritage Sites, Arkansas 2015 and Los Angeles 2016

The NEH Advanced Topics in the Digital Humanities Summer Institute, “Advanced Challenges in Theory and Practice in 3D Modeling of Cultural Heritage Sites,” was recommended for funding by the National Endowment for the Humanities. The principle investigators are Associate Professor Alyson Gil and Dr Lisa Snyder.
I will be a guest lecturer, the first 1 week workshop will be hosted at the Arkansas State University around 8-14 June 2015, the 2nd event, a 3 day symposium, will be hosted at UCLA, (Los Angeles), 6-9 June 2016.

Summary: A one week institute with a follow up workshop held over two summers, hosted by Arkansas State University and the University of California, Los Angeles, to consider the theoretical and ethical issues associated with three dimensional modeling of cultural heritage sites and objects.

Guest Lecturers include:
Diane Favro UCLA
Bernie Frischer Indiana University
Chris Johanson UCLA
Maurizio Forte Duke University
Ruth Hawkins Arkansas State University
Angel Nieves Hamilton College
John Clarke University of Texas at Austin
Erik Champion, Curtin University (am I the only one from outside of the States?)

 

February 2014 talks in California

Update: http://events.berkeley.edu/index.php/calendar/sn/arf.html?event_ID=74777&date=2014-02-11

Schedule of my visit to the San Francisco Bay Area:

1) Monday 10 February, 2014. 4pm-6.00pm. Kroeber Hall, Gifford Room.

Title: What is Virtual Heritage?

Virtual heritage could be viewed as a hybrid marriage of Virtual Reality and cultural heritage. Stone and Ojika (2000) defined it as

“[It is]…the use of computer-based interactive technologies to record, preserve, or recreate artifacts, sites and actors of historic, artistic, religious, and cultural significance and to deliver the results openly to a global audience in such a way as to provide formative educational experiences through electronic manipulations of time and space.”

The above is an interesting definition but I wish to modify it slightly, for it does not explicitly cover the preservation, communication and dissemination of beliefs, rituals, and other cultural behaviours and activities. We also need to consider authenticity of reproduction, scholastic rigor, and sensitivity to the needs of both audience and to the needs of the shareholders of the original and remaining content. No doubt this is due to the many issues in the presentation of culture. One is the definition of culture itself, the second issue is to understand how culture is transmitted, and the third is how to transmit the local situated cultural knowledge to people from another culture. In the case of virtual heritage, a fourth also arises, exactly how could this specific cultural knowledge be transmitted digitally?

Although I personally believe that fundamental issues of culture, place and inhabitation are still to be successfully addressed (Champion, 2014); computer games offer interesting opportunities to the audience, designer, and critic. They are no longer single player, shallow interfaces. They are turning into multivalent, multi-dimensional, user-directed collaborative virtual worlds. Commercial games are often bundled with world creation technology and network capability that is threatening to overtake the creation and presentation displays of expensive and complex specialist VR systems. In this talk I will not suggest that computer games are revolutionary, only that they are potentially changing the way we think, act, communicate, and feel.

 References

Stone, Robert J., & Takeo, Ojika. (2000). Virtual Heritage: What Next? . Multimedia, IEEE, 7(2), 73–74.

Champion, E. (2014). History and Heritage in Virtual Worlds. In M. Grimshaw (Ed.), The Oxford Handbook of Virtuality. Oxford: Oxford University Press.

2) Tuesday 11 February 10.30-12.30pm. 2224 Piedmont Avenue, MACTiA lab (room 12)

Informal Workshop/Brainstorm/Discussion with Dr. Erik Champion: Games – serious or otherwise – for and about archaeology and cultural heritage

Please feel free to drop in to this workshop and brainstorming session where archaeologists with Erik Champion will work through some ideas and plans for the design of computer games that are based in data of archaeological research and cultural heritage management and the interpretations of the past.

Starting point: Champion, Erik (2011) Playing with the Past. Springer, London.

3)Wednesday 12 February, 2014. 12noon-1pm. Archaeological Research Facility Lunchtime series: 2251 Building, Room 101.

Title: Heritage Via Games and Game Mods

In this informal talk, I will discuss classroom experiences (both good and bad) gleaned from teaching game design, especially work by students to develop serious games using historical events or mythological happenings.

My central argument is that despite apparent initial barriers, both students and teachers (and academics in general) can learn from the actual process of game design, and from watching people play. Theorists learn about the entangled issues of game design, the politics of user testing, and the designer fallacy (I designed the game, I know how best to experience it, if the audience can’t work it out there is something wrong with them, not the design). Students, in turn, can begin to understand (perhaps) how theory, good theory, can help open eyes, inspire new design and turn description into prescription. There are of course even more dilemmas and difficulties for visualizing and interacting with history and with heritage, and with moving from easily accessible commercial games and open source games, to larger Virtual Reality centres, planetariums and museums, but it has been done, with some significant successes.

This talk will touch on and move past projects mentioned in the following and free to download book: Champion, Erik (Ed.). (2012). Game Mods: Design, Theory and Criticism. Pittsburgh: ETC Press. URL: http://press.etc.cmu.edu/content/game-mods

Off-campus

4) Thursday 13 February, 2014. 12noon. Modeling, Virtual Environments and Simulation (MOVES) Institute, Naval Postgraduate School, Monterey.

TITLE:  Cultural Heritage and Surround Displays, VR and Games for the Humanities OR Immersive Digital Humanities: When The Motion Tracker is Mightier Than The Pen

How are scholars using surround displays, stereographics, gaming technologies and new peripherals to disseminate new ways of viewing, interacting with, and understanding humanities content, and in particular, cultural heritage? Which issues in cultural heritage and interacting with historical content need to be kept in mind by VR experts when working with humanities scholars? And are there key concepts and research developments in the VR field that humanities scholars should be more aware of? Or are the fields of interaction design and (digital) humanities converging?

NB Public talk but guests have to be pre-approved as it is at the Naval Postgraduate School.

modding games for AI related research, bots, and portraying character behaviours

Here is an abridged answer I just gave to an architectural academic who is interested in using games and game modding and AI (bots) in consideration was something like 3DVIDIA/Virtools, Unity or Unreal.
I hope this is of use to others or if my sourced information is out of date or inaccurate please comment below the post!

I am no AI expert although I too have an AI project I wish to develop: I don’t know 3DVIDIA, I do know Unreal (UT) used to have AI research projects, I don’t know if UDK has easily available AI projects but UDK does look good.
Overall Unity is probably the easiest and their  asset store has many content packs and scripts and avatars for purchase (including for AI) and it runs on Mac and PC and quite well on older machines.
You may not need the Professional version, I am not sure.

An introductory summary of difference for level design: http://www.worldofleveldesign.com/categories/level_design_tutorials/what-level-editor-game-engine-should-you-use-how-to-choose.php
A game engine comparison is here: http://fragileearthstudios.com/2011/10/24/comparing-cryengine-and-unreal-and-unity-too/

For heritage settings I have been told UDK (http://www.worldofleveldesign.com/categories/udk/ue3-vs-udk-vs-ut3.php) is very good but I have yet to use it.
Of interest to you: there are tutorials for UDK bots
http://www.worldofleveldesign.com/categories/wold-members-tutorials/petebottomley/udk-01-how-to-spawn-bots-in-kismet.php
https://sites.google.com/site/tessaleetutorials/home/udk-custom-enemy
UDK AI Director:

and project at http://draxov.com/design/ai-director-research/
Free tool: http://www.moddb.com/forum/thread/create-bot-ai-with-pogamut-in-udk-ut2004-ue2-or-defcon
http://www.blackfootstudios.com/forums/index.php?showtopic=5898

UNITY AI research
Wandering AI http://answers.unity3d.com/questions/432027/wandering-ai.html
Robot AI from Mecanim example http://forum.unity3d.com/threads/166633-Mecanim-quot-AI-quot-Free-Sources
AI programming


AI applications (basic overview) http://unitygems.com/ai-applications/
Tutorials in Unity and Basic AI http://devsbuild.it/resources/type/article/unity-basic-artificial-intelligence-part-1

Alternative:
A side project might be to review the new SIMS4 and Sims Societies.
http://tesalliance.org/forums/index.php?/topic/6547-new-artificial-intelligence-mod/

On a more urban design and cinematographic level, one used to be able to link Simcities and the SIMS2 avatars but I have not heard of related urban design or BIM research.
We are also going to look into Skyrim the Crysis/CryTek engine, which may be too powerful / complex for your needs.
I personally will also look into, the earlier version, Oblivion, had very simple scripting tools for avatar interaction and also had good modding tools (but it was not multiplayer, at least not officially).
Skyrim (Creation kit) has built in habits for NPCs, which I believe can be modded/affected, new buildings/settings can be added relatively easily.
http://tesalliance.org/forums/index.php?/topic/6547-new-artificial-intelligence-mod/

SUMMARY
For ease of use, most designers and researchers seem to be using Unity, but UDK (free download for PC) may have some benefits if you find similar AI projects.
If you want to show behaviours and don’t mind or can replace medieval settings, Skyrim may suffice.
For path finding UDK may be good, Unity can do all of it but if you can’t find prebuilt software in the Unity story, you may need to build it from scratch.
Overall, Unity is probably easiest, there plenty of presets/modules, and scripting can be in JavaScript or Python or C# etc. And MiddleVR seems a good for fit for connecting Unity to VR devices and for stereo projection (a video tutorial is here).

Visiting Fellows to work with me at Curtin University in Visualisation, 2013

I am very happy to announce that two Visting Fellows and two Early Career Visiting Fellows will work with me in October and November on various projects.

They are (and please note, dates are provisional):

Visiting Fellows

 

Nov 4-27: Dr Jeffrey Jacobson, http://www.publicvr.org

To provide examples of interactive and immersive environments featuring architecture and archaeology of the ancient world, to run inside Curtin’s new visualisation facility, iDome, Stereo Wall, and/or possibly the Wedge. Upload and run public VR 3D models inside UNITY on the iDome. These are the Virtual Egyptian Temple, Living Forest, Theater District of Pompeii. Prototype ancient heritage sites to run on the 0.5 CAVE (actually it is a Wedge). Design and pilot evaluation environment for potential use in humanities subjects, including history, and the visualisation undergraduate degree.

Nov 16-Dec 16: Dr Rob H. Warren, Canada, http://blog.muninn-project.org
Link 3D models in virtual environments (Unity real-time engine) to the archival databases to create a specific pilot of a World War 1 simulation using accurate historic geo-data, weather data, astronomical data, and historical records. Design and pilot evaluation environment for potential use in humanities subjects, including history, and the visualisation undergraduate degree. Link to colleagues in New Zealand and Canada to discuss potential research collaborations

Early Career Visiting Fellows

Nov 4-11: Andrew Dekker, University of Queensland http://itee.uq.edu.au/~dekker/ OR http://uq.academia.edu/AndrewDekker

We will work together on the following project: Camera tracking and biofeedback for indirect interaction with virtual environments. This project will connect biofeedback devices and camera tracking devices with equipment in the Curtin Data Visualisation Facility (CDVF) and provide a research platform to evaluate how biofeedback can be a meaningful interaction component for virtual environments, especially for augmenting socially believable agents, and to enrich the apparent “life” and “atmosphere” of digitally created architectural environments.

Nov 18-25: Dr Hafizur Rahman, Bangladesh http://bdheritage.info and http://ttclc.net

Create a streamlined 3D model data and 3D virtual environment workflow, analyse and comparing different image modelling tools, and explain how their optimal deployment for community web portals of digitalised cultural heritage.

Acquiring 3D models for artifacts is always expensive, as it typically requires a 3D laser scanner and relevant training. However, 3D modeling of small artifacts is possible to produce with photographs using low cost software such as 3D Som Pro (http://www.3dsom.com/). This software can produce 3D wire mesh and baked images for rendering, which can later be use as a source for augmented reality application for interactive public display. Free AR Toolkit /BuildAR can be used here for making this interactive display for museums/heritage institutes and interested community groups who currently lack high end technological resources and related skills.

We will also compare the above to insight 3D (http://insight3d.sourceforge.net/), which is free and open source. We will produce schematic workflows, incorporating Blender 3D for modeling and we will consider alternatives such as Google SketchUp.

Prototyping for Ownership Workshop at Media Architecture Biennale

On 15 November i.e. yesterday, I attended the “Prototyping for Ownership” workshop, run by

Klaus Birk (Media Design, DHBW & Information Environments, UAL London)
Roman Grasy (Intuity Media Lab). >Their company is based in Germany.

This slideshow requires JavaScript.

The workshop had 2 groups. Our group of between 5-9 people (it varied!) spent the day choosing little pictures, noting down ideas to them, on creating media architecture on problems close to us. There was a Kinect and VVV (runs nicely with Kinect), augmented reality trackers, a 360 degree mouse, and a macbook pro with after affects (you can guess what I ended up doing).

Some of my ideas are in the slide show above.

My group chose my idea of a giant phonogram set into a square, people would run around tracks or grooves of the phonogram, which would start tracks of music, their speed and rhythm would be tracked, affecting the music, and gestures could affect the timbre. Small orchestral pits in the corners of the square would allow sound editing via mechanical or visual (projected) buttons. Also there would be exercise levers that would control the music just like dials on a sound editing desk (may attach sketch later). Shells or pipes in the side streets would faintly play current or past performances, to draw people to the square. We also thought of a catch the light or animated sprites game, that would be derived from the spinning carousal-musical tracks, on the surrounding urban facades, and there could be small lasers inside the tracks, broken by the shadows of the dancers.

There is also a video of us dancing to the start stop Fat Boy Slim track while being rotated. Too embarrassing to add here, to be honest. So I hope they don’t choose this video part of the prototype to show at the Biennale! (Edit: Klaus has, oh well, I am stuck in the office so if it is shown today I won’t know about it).

Part of our kinect interface for the “anti travelator” or “magic urban roundabout” prototype is below, it worked, you step into the light (the magic circle) and the music turns on, you step out, it stops. Ideally it would record your height and changing y position to change tracks in the music and pitch. Truly a magic circle!

NB the twitter handle for the conference is @MABiennale website address is http://mab12.mediaarchitecture.org/

It also runs on Saturday at Godsbanen, Aarhus (great venue for this sort of thing).