I have found the location of the background music files for Windows Photo.

Please be sure to look over the licensing agreement as I am unsure if these files can be used with other programs:
https://www.microsoft.com/en-us/legal/copyright/permissions

Here is the location:

C:\Program Files\WindowsApps\Microsoft.Windows.Photos.DLC.Main_2021.39122.10110.0_x64__8wekyb3d8bbwe\Assets\Create

For some reason I could not browse to C:\Program Files\WidnowsApps I kept getting a security error but if you copy and paste the above location it worked for me

The files that say PREVIEW at the end are the longer version of the sound clip. For Example:

C:\Program Files\WindowsApps\Microsoft.Windows.Photos.DLC.Main_2021.39122.10110.0_x64__8wekyb3d8bbwe\Assets\Create\ModularMusic\8Bit_01\music_8Bit_01_PREVIEW_00.wma