Sereniscape

Immersive VR and sound designed to transport you to pure serenity.

Inspiration

Sereniscape emerged as a spinoff of the Lifesaver project, aiming to address mental health challenges in a unique and innovative way. While studying abroad in Barcelona, I collaborated with Haneen, who had developed the initial concept of a VR scape to help individuals in distress. I wanted to contribute by integrating sound design into the experience, making it fully immersive and engaging. Together, we set out to create a virtual reality environment that could provide users with a calming escape and a tool to help ground them during intense mental health episodes.

Problem:

Mental health crises such as anxiety, depression, psychosis, and insomnia often require immediate intervention to calm individuals and help them regain control. Issues like drug-induced psychosis are especially complex, as patients can experience altered mental states where overstimulation and irrational behavior may lead to dangerous situations. Similarly, insomnia can leave individuals feeling trapped in a cycle of exhaustion and mental unrest. Traditional methods of calming patients or inducing rest may not always be effective. There is a critical need for innovative, non-invasive solutions to soothe individuals, reorient them, and restore a sense of calm during these challenging moments.

Solution:

Haneen’s idea was to create a VR scape to provide a peaceful, controlled environment for users. To support this vision, I introduced the idea of sound design as a core element. By crafting an immersive soundscape, the experience could address both auditory and visual senses, enhancing its overall impact. The addition of carefully designed audio would help users feel grounded and present, making the VR scape more effective in calming their mental state and bringing them back to a place of stability.

My Role:

  1. Researcher: Investigated cognitive issues such as anxiety, insomnia, and psychosis, and explored how sound frequencies influence mental states like calmness and sleep.

  2. Sound Designer: Created a binaural beat using 532 Hz tones, combined with a meditative track and natural water sounds to produce a calming soundscape.

  3. Developer: Filmed 360° nature footage using an Insta360 camera and collected audio samples of running water to integrate into the VR environment.

  4. Prototyping Troubleshooter: Adapted the VR concept into an AR demo for the Apple Vision Pro after encountering technical challenges.

Conceptualization

Research:

Our research began with an exploration of the cognitive and mental health issues that the VR scape could address, including anxiety, insomnia, and psychosis. We then investigated the relationship between sound frequencies and mental states, focusing on how different sound waves could promote calmness, relaxation, or sleepiness. Gamma, beta, and delta soundwaves became central to our exploration:

  • Gamma Waves (25-100 Hz): Associated with heightened cognitive functioning and focus.

  • Beta Waves (12-25 Hz): Linked to alertness but also to anxiety when overactive.

  • Delta Waves (0.5-4 Hz): Known for their connection to deep sleep and relaxation.

Brain wave types and their associated mental states

Diagram showing how binaural beats work, which we created for Sereniscape

We also delved into spiritual sound healing practices and discovered the concept of binaural beats, which involve playing two slightly different frequencies in each ear. This creates the perception of a third “beat” frequency that can influence brain activity. Binaural beats have been shown to help with relaxation, focus, and sleep, making them a perfect fit for Sereniscape.

Check out this footage we captured with the 360° camera!

Development

Design & Development:

To create the visual component of Sereniscape, we filmed a 360° video of a natural setting using an Insta360 camera. This footage was designed to visually immerse users in a calming environment. We also collected audio samples of running water from a river to enhance the authenticity of the experience. However, we encountered technical challenges when attempting to implement the 360° video into the Apple Vision Pro. As a workaround, we pivoted to simulating the experience using a preset demo on the Apple Vision Pro, which allowed us to showcase the core elements of Serenescape in an alternate format.

Clip of the stream we recorded to enhance the binaural beat with immersive sound effects

Tone generation settings for one of the binaural beat frequencies

For the auditory component, I created a binaural beat using Audacity. I selected a central frequency of 532 Hz and generated tones that were 4 Hz apart—528 Hz for one ear and 536 Hz for the other. This binaural beat was layered with a meditative track and the recorded river sounds to produce a complete and immersive auditory experience. The carefully crafted soundscape played a key role in enhancing the calming nature of Serenescape, providing users with a soothing auditory journey.

Breakdown of the audio track created in Audacity for Serenescape

Outcome

Sereniscape was presented at the Beyond Boundaries design conference, where it received positive feedback from participants. One user even stayed immersed in the experience for 20 minutes, describing it as calming and soothing. This feedback validated our approach and highlighted the potential for Sereniscape as a tool for addressing mental health challenges. Moving forward, we aim to fully integrate the VR scape into the Apple Vision Pro to deliver a more interactive and seamless experience. The conference marked an important milestone for Sereniscape, showcasing its potential to make a meaningful impact in mental health care.

Apple Vision Pro VR visual paired with the immersive soundtrack

Figma prototype of the AR features, including design elements like the breathing guide animation and the soundtrack

Dani, Haneen, and Jerrod experiencing Sereniscape firsthand at the Beyond Boundaries Design Conference! [Photos by Nikita Rao]