I was using query loop widget in the sidebar until recently, it was the one causing a high load on my server. When I remove the query loop widget, my server’s load is back to normal.
I’m wondering why it happens only recently. I was using W3 Total Cache and they work fine before.