Now it appears Sony's next move is to develop AI-powered game soundtracks that react to how you play, or to your emotions, and change the music accordingly. .

The 'Dynamic Music Creation in Gaming' patent was first discovered by Game Rant, and while it doesn't specifically mention the PlayStation 5, it has all the hallmarks of a feature that Sony is considering for the forthcoming console.

In the patent, Sony's engineers describe how they plan to use machine learning to analyze how different 'musical components' like rhythm, melody and harmony map to specific emotions, and then create different emotional variants to musical scores that will trigger specific feelings in gamers as they play. .

Then, these motifs will be coded to play based on Sony's data on what the player is feeling, or should be feeling, in a given moment.

For example, on the PS5, Sony could take the overworld music from Assassin's Creed Valhalla and reduce the tempo and percussion for a calmer ambience if the player has stopped moving for a while, up the tension if they've locked onto a target, or add some soulful violin if a beloved character appears.

Many of today's video games already adjust their music based on players' actions or events in-game, but not with this level of subtlety and personalization.

Sony wants to adjust the soundtrack based on who you are, listing out categories like "young, old, male, female, introvert, [and] extrovert." But the patent explores how their musical system could go well beyond such basic descriptors!

Imagine if you have died multiple times to a tough boss, and the PS5 could sense your elevated heart rate, interpret this as frustration, and adjust the soundtrack to play something more soothing.