To delete offline music, tap on the 3 dots within the offline music item you want to remove and select Delete Offline Content.
While this action will delete the station from your device, the music item will still exist in the app.