Projects
A selection of creative projects I have been involved in.
09 projects · books · apps · sound
Time Off
BookA practical guide to building your rest ethic and finding success without the stress, co-written with John Fitch and illustrated by Mariya Suzuki. An international bestseller, featured in Fast Company, Financial Times, Thrive Global, Entrepreneur Magazine, and other publications. The book has been translated into over 5 languages, and we have also released a companion app, featuring a 62-day course that helps you gradually build your rest ethic in a structured way.
Yudemon
App · HRVI founded Yudemon with the goal to integrate generative soundscapes and music, based on real-time biodata, into meditation, HRV biofeedback training, and immersive experiences. Its main offering is an HRV biofeedback app, and every user’s practice also grows their “Heartwork” – a generative piece of living art that is entirely unique to them, created from the biodata of their sessions.
A Heartwork – generative art grown from the biodata of a user’s sessions. ApexFlow
Racing × HRVApexFlow is a racing analytics platform that fuses telemetry with HRV data – what the car was doing, lap by lap, alongside what the driver’s body was doing. It grew out of Yudemon and my own obsession with (sim) racing, and is currently in public beta.
Track Heatmaps in ApexFlow – physiology and telemetry on track position. NeuralFunk
AI × SoundNeuralFunk is an experiment in using deep learning for sound design. It is an experimental track entirely made from samples that were synthesized by neural networks. It is not music made by AI, but music made using AI as a tool for exploring new ways of creative expression. NeuralFunk got accepted to the NeurIPS Workshop on Machine Learning for Creativity and Design 2018.
Cover of NeuralFunk. Design by Alvaro Arregui (Nuevo.Studio) SampleVAE
AI × SoundSampleVAE is a multi-purpose tool for sound design and music production. The deep learning-based tool allows for various types of new sample generation, as well as sound classification, and searching for similar samples in an existing sample library. As technical partner and one of the facilitators of the MUTEK.JP AI Music Lab 2019, this was one of the tools explored by the artists in the lab.
Presenting SampleVAE during my public talk at the Mutek AI Music Lab 2019 at EDGEof in Tokyo. Neural Beatbox
Qosmo · AI × MusicRhythm is one of the most ancient means of human communication. Neural Beatbox enables anyone to collectively create beats and rhythms using their own sounds. As an installation, the piece was exhibited at the Barbican Centre in London as part of the exhibition AI: More than Human.
Screenshot of Neural Beatbox. Design by Alvaro Arregui (Nuevo.Studio) Vocal Detection for Pioneer DJ
Qosmo · AI × MusicIn my role as Principal Researcher at Qosmo, I developed and implemented a deep learning based vocal detection algorithm that can automatically find the locations of all the vocals in a track. Pioneer DJ, the world’s leading manufacturer of DJing technology, integrated this algorithm into their rekordbox software.
Image of Pioneer DJ’s rekordbox software. Sleep Tracking
Study · Quantified SelfIn this study published in Better Humans, I analysed the results of tracking my sleep (with an Oura ring), caffeine intake, exercise, and alcohol consumption over several months. In a nutshell: Alcohol is terrible for my sleep, caffeine does not have as bad an effect as I had feared, and exercise was inconclusive (except not exercising too close to bed time).
One of the plots from my study, linking sleep latency (in seconds) with blood caffeine concentration. The Variational Autoencoder as a Two-Player Game
AI × WritingIn this three part article series, which I created in collaboration with my illustrator friend Kittyzilla, I try to make the basic ideas behind VAEs and their application to natural language processing (NLP) as accessible as possible, as well as encourage people already familiar with them to view them from a new perspective. Specifically, I invite the reader to imagine the VAE as a collaborative game played by two players.
Illustration by Kittyzilla.