Process

Embarking on a comprehensive journey from ideation to the culmination of our project, we navigated through distinct stages with meticulous documentation. Our initial ideation phase emerged from group discussions, converging on the theme of exploring urbanization's impact on nature. Thorough background research ensued, laying the foundation for a proposal focused on soundscapes within parks near construction sites. Planning for data collection involved delineating key objectives and using a vast selection of data collection methods, point-to-cloud, and sound recordings that leads to generative visuals through a simulation.

Subsequently, we ventured into the field, selecting specific parks, recording sound data, and refining our concept based on the nuances uncovered.

The transition from contemplating 3D-printed objects to p5js animations marked a pivotal shift in our artefact design, incorporating common park objects modeled in Blender using the Point-To-Cloud data. Integration with p5js is a key to the interactive simulation using the sound-recorded data through the development of dynamic animations enriched the project. The Blender scene creation phase was mainly modeled after the code which entailed importing models, adding textures, and aligning frames meticulously.

The culmination was the final documentation and presentation, revealing the intricate interplay between nature and urbanization through an innovative outdoor exhibition that has an interactive augmentative reality simulation. This challenging yet rewarding journey underscored the fusion of art, technology, and environmental consciousness in our project. A more in-depth exploration of the 3 different elements of the artefact will be explored.

Background & Proposal

In the urban landscape, the interaction between nature and urban is both fascinating and concerning for our team. The constant harm of nature through our urban lifestyle into the natural world prompts us to consider the silent pleas from nature, often overlooked in our collective awareness.

A contemporary example that brings context into this proposal is the construction of the cross-island line which affects a lot of natural environments such as forests and also parks. The irony of these construction sites is the use of imagery of nature on the construction barricades, ironically mimicking the environment they disrupt.

This relationship prompts an important message that we are developing economically, through the construction of new spaces which lead to the destruction of the nature we inhabit and we need for survival to inhabit and live on.

Proposed Objective

Our proposed objectives had a threefold focus on the complex relationship between urbanization and nature. Firstly, we aimed to highlight the unsettling impact of urbanization on the peaceful nature of natural spaces, specifically addressing disruptions caused by construction and noise pollution.

Secondly, we delved into the intricate soundscape of nature, analyzing audio data to understand the strained relationship between nature and urbanization. Simultaneously, we explored a narrative of nature acting back and reclaiming urban spaces, creating a symbolic representation. These objectives aimed to illuminate the nuanced dynamics between nature and urbanization through an innovative exhibition that visualizes nature's cries reacting to real-time sound data of the noise pollution around us.

Proposed Approach

To achieve our goals, we strategically planned data collection, emphasizing the soundscapes of parks near construction sites. We utilized advanced tools like Scaniverse for detailed scans and p5js for interactive sound-reactive animations, highlighting our commitment to a dynamic representation of the nature-urbanization relationship.

Our use of these technologies aimed to capture our objectives' essence, fostering awareness and contemplation on the coexistence of these elements in the urban landscape. Integrating cutting-edge tools was crucial for a nuanced and impactful exploration. What ties the artefact together is a literal proposal for an exhibition and installation that prompts people to come down and experience the artefact that evokes emotions and hopefully environmental awareness.

Point-To-Cloud Scans.

Data Collection

For our project, the data collection process was the first step to the 3 part artefact. Selecting four parks situated near new MRT construction sites, we strategically recorded sound data at 8 different points, each 50 meters away from the construction sites. This spatial distribution allowed us to observe how the soundscape changed progressively, offering a nuanced understanding of the impact of urbanization on the tranquility of these natural spaces, highlighting the noise pollution aspect.

This contributes and relates to the first part of the artefact, which is the generative visuals created using p5js that reacts to noise polluting sounds in a natural space meant for recreation and peace. The visuals are abstracted using the concept of point-to-cloud data utilizing the Scaniverse app,

by conducting detailed scans of each location, producing a comprehensive visual representation that supplemented our auditory data. This scans are then developed and then adapted into the generative visuals. We embraced a holistic approach, incorporating additional layers of data and information to deepen our exploration.

From capturing the ambient sounds near construction sites to delving into the quieter realms further away, our recordings sought to encapsulate the diverse auditory environments within these parks. These recordings, coupled with detailed scans, formed the backbone of our project, enabling us to unravel the intricate relationship between nature and urbanization in a comprehensive and nuanced manner.

Link to spreadsheet

Interactive Code and AR Component Process

Artefact

Our artefact is an immersive representation of the dynamic relationship between nature and urbanization through soundscapes. We transitioned to a p5js-based interactive experience that reacts to sound. The artefact comprises 3D models of common park elements—lamp, pavement, wall, and bench—embedded within a Blender scene. These models are intricately textured to mirror the natural and constructed elements captured in our scans and to create a alternative reality by using these common urban landscape we are used to.

The ideation process involved contemplating the most representative park objects and their significance in the urban-nature dichotomy. We decided on a lamp, pavement, wall, and bench, chosen for their ubiquity and potential to evoke the essence of both nature and urbanization. The models were meticulously crafted in Blender, ensuring they mirrored our scanned counterparts while incorporating natural textures and distortions for a thought-provoking impact.

The interactive component, driven by p5js, took form through the initial guidance from our lecturer Andreas. The challenge was to create animations that react dynamically to sound values. This involved importing the 3D models into p5js, adjusting code parameters, and synchronizing the animations with the nuanced soundscapes we recorded. The final amalgamation of sound-reactive animations and 3D models creates a captivating visual and auditory experience that is replicated and modeled in the augmented reality experience to create an artistic simulation.

Throughout the process, documentation played a crucial role. Detailed notes, images, and video recordings chronicled the evolution of our artefact. This documentation not only served as a record of our creative journey but also facilitated a deeper understanding of the intricate nuances within our project. The artefact, thus, stands as a testament to explore and convey the complex dynamics between nature and urbanization in a novel and engaging manner.

    Outdoor Installation Component Process

Installation

Tying all components of the artefact together with the outdoor installation as the main attraction. Using textures from the Point-To-Cloud data we collected to create this shelter-like installation. It is inspired by the existing shelters in park, a seashell inspired dome like shelter will be installed at benches nearer to construction to amplify the sounds of the cause of nature’s unheard cries.

Why a seashell? Well, it is a resonant cavity, amplifying some sound frequencies in ambient noise and attenuating others. This will amplify the surrounding noise, turning our sound data into real life data so that the interactive generative visual can react to it to create an immersive simulation of augmented reality (refer to below picture).
Read more on seashells as resonant cavities

Conclusion

In conclusion, our project successfully navigated the complexities of exploring the dynamic relationship between nature and urbanization through soundscapes. What worked well was our collective effort in refining the concept, conducting thorough data collection, and integrating diverse skills into the creation of the artefact. The shift from a 3D-printed object to a p5js animation reacting to sound values allowed for more dynamic and interactive storytelling.

However, challenges arose in the coding phase, specifically in integrating 3D models into p5js and making them react to sound effectively. This required additional support and collaboration with our lecturer. Communication within the group posed occasional difficulties, impacting the decision-making process and creating moments of frustration. Despite challenges, the project was a valuable learning experience, highlighting the intricate balance required in merging artistic expression, technological implementation, and environmental awareness.