Remove On Mouse Over Product Zoom, but leave Magnifier Icon

Hello! I used the following snippet to disable the default on mouse over zoom on a product, but I'd like to leave the magnifier icon untouched... Is this possible?

add_action( 'wp', 'tu_remove_wc_zoom', 20 );
function tu_remove_wc_zoom() {
    remove_theme_support( 'wc-product-gallery-zoom' );
}