It’s hard to tell without being able to do see the GTmetrix, Google Lighthouse and Webpagetest.org results.
Site optimization is a grueling process. It’s difficult to give a definite “fix-all” setting as not all sites are the same.
I believe Litespeed cache should be workable but you have to try different settings. Try different configurations(disabling/enabling things) and see which gives the best result.