dalvik would require a reboot, i imagine it just wipes cache part, it will rebuild itself as you go, just a cache. I use one sometimes called cache cleaner ng or something like that. It was on a 2,1 rom and i stole it. Honestly i almost always do it in recovery, i only started using the cache cleaner on the 3.0 sense rom because rebooting was always a risk

.