I have this same issue in my S22 and newly bought S24. I'm not seeing the Spotify or Samsung Music icon in the status bar. But I do see it on my lock screen and notification screen. I do have my notifications allowed for the app.
Please see screenshot.
Status bar when Spotify is playing
Notification screen when Spotify is playing
SSpotify notification permissions.
