You can probably keep using it, you just need to remember to clear the caching every time you make a change to the site (update a plugin or theme etc..).
How much impact a caching plugin makes on a site really depends on the server. I tend to stay away from the plugins and lean more towards server caching when possible.