There are a lot of optimization methods:
WordPress Optimization WordPress Codex
I think a lot of high traffic sites are powered by WP. If you compare with Joomla, just check the response headers

(they thread the browser to load a page every time, modified or not)