Immersive Technologies & Platforms
Task 1: Virtual Museum in FrameVR.
Virtual Museum of JWM Turner British Artist
Introduction:
Virtual Reality (VR), Augmented Reality (AR), and Extended Reality are immersive technologies that have completely changed how we interact with objects in our digital environments. VR spawns new, entirely virtual environments, while AR overlays and anchors digital elements to the real world and XR put them all together and more to form hybrid experiences. It is now broadly used for educational, artistic, and storytelling purposes to provide more engaging user experiences.
I Choosed Virtual Museum of J.W.M. Turner using FrameVR Due to its accessibility and intuitive interface, FrameVR is an excellent fit for these projects. As argued by Immersive Journalism as Storytelling (Uskali et al., 2021), this is important in swathes of emerging media because immersive platforms make cultural content engaging and reachable to different audiences.
Project Overview
Turner: The Late Seascapes, 1840–1851 is a free online exhibition that virtually arranges J.W.M. Turner’s great paintings in space and time through thematic rooms thematically organized to explore aspects of his life’s work. Historical and artistic context is provided with descriptions situated beside the paintings creating an informative, immersive experience.Turner: The Late Seascapes, 1840–1851 is a free online exhibition that virtually arranges J.W.M. Turner’s great paintings in space and time through thematic rooms thematically organized to explore aspects of his life’s work.
Historical and artistic context is provided with descriptions situated beside the paintings creating an informative, immersive experience.Turner: The Late Seascapes, 1840–1851 is a free online exhibition that virtually arranges J.W.M. Turner’s great paintings in space and time through thematic rooms thematically organized to explore aspects of his life’s work. Historical and artistic context is provided with descriptions situated beside the paintings creating an informative, immersive experience.
The museum is composed of three main sections.
- Landscapes and Nature: Brightly lit room with calming instrumental music projecting onto the screen a range of paintings like Petworth House from the Lake (Turner, c. 1828)
- Maritime Art: Turner, the Fighting Temeraire (1839) in dramatic settings with background classical music, Wreck of a Transport Ship(Turner, 1810)
- Abstract Works: Features experiments such as Rain, Steam, and Speed – The Great Western Railway (Turner, 1844) in a low-lit room with subdued background sounds.
- Bosch Garden of Earthly Delights Triptych also for vs theme.
- Upcoming Chess Model: Add visualizations in Ex-Voto Buoi to visualize information.
- Starry Night Diamond Painting – The Scream – Edvard Munch, and Van Gogh Afrikaside, painting without a face.
One description is provided for each painting and 3D details further flesh out the environment. The music of each paragraph corresponds to a background.
Challenges I faced:
How I solved them: UI and Layout: The rest of this is UI and layout for me. I solved that one by using all the room labels as much as possible from my text.
Description Insertion: This involved creating the right information descriptions, which had to be researched and well-constituted to fit into the museum’s layout.
How I solved them:
Some of the original assets I created were high-resolution images of Turner paintings, a mock up museum layout, 3D models, and their descriptions, including animation. Google Arts and Culture has some paintings with accurate visuals, which helps a lot when you use them to search for documentaries.
Things I learned:
This project showed the huge potential of immersive technology for reimagining cultural experiences. You have a beautiful interactive experience that compliments Turner’s art while supplementing your knowledge. As noted by Uskali et al. According to Earley (2021), immersive storytelling is beneficial for accessibility and user engagement.
Conclusion:
- Balancing Design with Usability High-quality visuals must be well-executed for one to use it.
- The Importance of Context: Adding descriptions next to artwork not only improved the ride but allowed more comprehension.
Task 1 Refrences
• Turner: The Late Seascapes, 1840–1851 is a free online exhibition that virtually arranges J.W.M. Turner’s great paintings in space and time through thematic rooms thematically organized to explore aspects of his life’s work. Historical and artistic context is provided with descriptions situated beside the paintings creating an informative, immersive experience.
• Google Arts and Culture (n.d.) Rain, Steam, and Speed – The Great Western Railway. Available at: https://artsandculture.google.com/asset/rain-steam-and-speed-the-great-western-railwayjoseph-mallord-william-turner/SAH4wpo4nUwV-w (Accessed: 24 November 2024).
• Google Arts and Culture (n.d.) The Wreck of a Transport Ship. Available at: https://artsandculture.google.com/asset/the-wreck-of-a-transport-ship-j-m-wturner/KwH0nPxsPbDnIA(Accessed: 24 November 2024).
• Google Arts and Culture (n.d.) Chichester Canal. Available at: https://artsandculture.google.com/asset/chichester-canal-joseph-mallord-williamturner/kwHz-KNrwV3OCw(Accessed: 24 November 2024).
• Google Arts and Culture (n.d.) The Burning of the Houses of Lords and Commons. Available at: https://artsandculture.google.com/asset/the-burning-of-the-houses-of-lords-and-commonsoctober-16-1834-joseph-mallord-william-turner/EQHnA8zXMBEnXw (Accessed: 24 November 2024).
• Sketchfab (2022) Bosch Garden of Earthly Delights. Available at: https://sketchfab.com/3dmodels/bosch-garden-of-earthly-delights-triptych08bf75da4b194399bd80b8eb0ab9141b (Accessed: 24 November 2024).
• Sketchfab (2022) Chess Model. Available at: https://sketchfab.com/3d-models/chess-model-1eee09fc36a814ae6a7c683e0b38ab4ac (Accessed: 24 November 2024).
• Sketchfab (2022) Ex-Voto Buoi. Available at: https://sketchfab.com/3d-models/ex-voto-buoib4c52f4e8c014a34b14016175cf9930e (Accessed: 24 November 2024).
• Sketchfab (2022) Starry Night Diamond Painting. Available at: https://sketchfab.com/3dmodels/starry-night-diamond-painting-a1ce7de04d614446902f513e7d5d34c5 (Accessed: 24 November 2024).
• Sketchfab (2022) The Scream – Edvard Munch. Available at: https://sketchfab.com/3dmodels/the-scream-edvard-munch-animated-6ca4f534992546f692a35dfe22bcc0a4 (Accessed: 24 November 2024).
• Sketchfab (2022) Van Gogh’s Unknown Afrika Painting. Available at: https://sketchfab.com/3dmodels/van-goghs-unknown-afrika-painting-e457402d4b2e4681b5a5f88b747aea4a (Accessed: 24 November 2024).
• Uskali, T., Gynnild, A., Jones, S., and Sirkkunen, E. (2021) Immersive Journalism as Storytelling: Ethics, Production, and Design. Routledge. Available at: https://doiorg.hull.idm.oclc.org/10.4324/9780429437748(Accessed: 24 November 2024).
Task 2: Vincent Van Gogh’s Painting in AR
AR Project of Vincent Van Gogh's Starry Night Reflection Document
An Augmented Reality (AR) Experience in Adobe Aero Based on Vincent van Gogh´s Starry Night. To do so, we broke down the painting into 4 layers with the idea of each layer building on the one before it to give a deeper and more interactive sense of understanding as well as storytelling. The method besides enabling users to view the painting from various angles provided a deeper story thanks to an audio tour.
Project overview:
1- Design and Concept
The AR experience was divided into 4 Layers:
Layer 1: The Ground – This final section focuses on the structures and the landscape below.
Level 2: The Cypress Tree — A large silhouette upon which the night sky is strikingly contrasted.
Layer 3: Horizon – far hills, a town with a church steeple makes for a quiet, predictable backdrop.
Layer 4: The Sky — Swirling stars and crescent moons that establish the dynamic composition of the painting.
All those surfaces were spaced apart at different levels. As a single piece of art, they were awesome but, when viewed from the side, the layers jumped out the spear and you got a 3D vibe to it.
2- Why did I create it?
I visited the Van Gogh Immersive Art Museum, which is in the heart of York City. So, as an admirer of art, I thought, why not give it a try as it also aligns perfectly with the boundaries of the described fields of culture and arts by Dr Yang. My inspiration is this museum, and I created it to give it a try as this will be targeting educational and cultural perspectives.
3- Challenges I faced
- Adobe Aero: It’s my first time using Adobe Aero, and at one point, I found myself in a difficult situation.
- Storytelling: Telling my story and what the artwork represents, as Paula Scher said, “It took me a few seconds to draw it, but it took me 34 years to learn how to draw it in a few seconds.”
- AR + Audio: I used Eleven Labs to transform the text into an audio component congruent with users navigating through the artwork.
4- How I solved them
- Layer Placement: I did my best to make the layers look like they were part of a smooth whole from the front but had depth from the side.
- The Audio Synchronization: Syncing the audio with the interactive experience was a complicated process as it needed to feel natural and flow with user movement when exploring the painting.
Things I learned
This project taught me the magic of AR in storytelling and art. How to use Adobe Aero properly and produce the desired output by using minimal techniques and enhancing user experience Moreover, In the project, Layers allowed me to provide a multimodal interaction with Starry Night —something you could not do with traditional methods.
5- Conclusion:
- Methodolog: Layering the art enabled a more immersive and participatory process.
- Balancing Interactivity & Narrative: It is crucial to maintain the interactivity that digital art offers without letting technology take over from the narrative, which should be central to any work.
YouTube Link & Adobe Aero QR Code:
References:
- Gogh, V. van (1889). The Starry Night – Vincent Van Gogh. [online] Google Arts & Culture. Available at:https://artsandculture.google.com/asset/the-starry-nightvincent-van-gogh/bgEuwDxel93-Pg?hl=en.
- pik, F. (2022). Free Vector | Hand Drawn Van Gogh Painting Illustration. [online] Freepik. Available at: https://www.freepik.com/free-vector/hand-drawn-van-goghpaintingillustration_30638406.htm#fromView=image_search&page=1&position=0&uuid=9 a3e7aac-79b8-454e-b8fd-f0584987766b [Accessed 11 Dec. 2024].
- The (2020). Paula Scher. [online] Pinterest. Available at: https://uk.pinterest.com/pin/inspirational-quotes-by-paula-scher-233342824432578555/ [Accessed 11 Dec. 2024].
- Van Gogh – The Immersive Experience. (n.d.). Van Gogh Exhibition – The Immersive Experience – York St. Mary’s. [online] Available at: https://www.vangoghexpo.co.uk/york/.