Shuffle doesn't work with Amazon Music

I'm new to Bluesound. I am primarily using Amazon Music by going into BluOs > Amazon Music > My Music > Tracks. Then when I'm on the list of tracks, I hit the shuffle button. However, this seems to have no effect. The list of tracks is played in a linear fashion.

Do I need to add the complete list of tracks to a playlist to get this to work?