Native Audio Block: prevent/disable download file in GeneratePress

Hey there

I need some native Gutenberg audio blocks on a GP website.
When I add them it automatically adds them properly and they look good.
But I want to disable the ability to download the audio file. By default everyone can download the audio file.

I can´t hide the download link with css since it´s just one big <audio> element within a <figure> tag.
Does the native audio block has styling from the GP theme?
Do you know of a possibility how to prevent the user to download the audio from a native audio block?

Or is this just some bad thinking/implementation from the Gutenberg team?

Thanks in advance for taking your time
Michael