There isn't much data involved with call history. Just lines of text that are rendered in the dialer UI. Honestly, clearing your call history would be less valuable than deleting a single MP3 from your memory or uninstalling an app.
If you're looking for ways to speed up your phone, start by uninstalling apps or games you haven't used in awhile!