Making Freedom Fly
Freelance Creative & Technical Designer · 2023

Making Freedom Fly

Immersive WWII stories through cutting-edge technology
Role
Freelance Creative & Technical Designer
Year
2023
Stack
Nvidia RTX 4090Custom open-weight LLMs and AI modelsLoRAs and workflows using ComfyUI and GradioBlenderDaVinci ResolveDAWs
This was a client project where I worked as a freelance creative and technical designer, tasked with developing a series of innovative digital exhibits for the Canadian Warplane Heritage Museum.
The key challenge was developing custom voice synthesis capabilities to reconstruct youthful-sounding vocal profiles from audio recordings of elderly WWII veterans, enabling interactive metahuman experiences that captured their authentic identities and emotional depth.
We developed novel approaches combining advanced frequency modulation techniques with predictive modeling to precisely regulate vocal components like pitch, timbre, and formants. This allowed us to capture the inflective and emotional richness of youthful voices, while preserving each speaker's unique vocal fingerprint, despite limited training data. We also pioneered new methods for generating realistic facial animations from low-quality source images.

The team achieved groundbreaking scientific advancements in voice synthesis and facial reconstruction, establishing foundational methods that bridge gaps in these fields and enable capabilities previously thought unfeasible.

The resulting digital experiences, including an immersive dome, interactive portrait portals, and a curated cinema, provide visitors with a deeply impactful and empowering exploration of Canada's aviation history and its role in preserving democratic values.
This project represents a pioneering application of cutting-edge technologies to create transformative educational experiences that honor the sacrifices and legacies of those who fought for freedom.