Context
This was a client project where I worked as a freelance creative and technical designer, tasked with developing a series of innovative digital exhibits for the Canadian Warplane Heritage Museum.
The Challenge
The key challenge was developing custom voice synthesis capabilities to reconstruct youthful-sounding vocal profiles from audio recordings of elderly WWII veterans, enabling interactive metahuman experiences that captured their authentic identities and emotional depth.
How It Was Built
We developed novel approaches combining advanced frequency modulation techniques with predictive modeling to precisely regulate vocal components like pitch, timbre, and formants. This allowed us to capture the inflective and emotional richness of youthful voices, while preserving each speaker's unique vocal fingerprint, despite limited training data. We also pioneered new methods for generating realistic facial animations from low-quality source images.
The team achieved groundbreaking scientific advancements in voice synthesis and facial reconstruction, establishing foundational methods that bridge gaps in these fields and enable capabilities previously thought unfeasible.
Outcome
The resulting digital experiences, including an immersive dome, interactive portrait portals, and a curated cinema, provide visitors with a deeply impactful and empowering exploration of Canada's aviation history and its role in preserving democratic values.
Why It Belongs Here
This project represents a pioneering application of cutting-edge technologies to create transformative educational experiences that honor the sacrifices and legacies of those who fought for freedom.