Settings>Applications>Manage Applications
Press on the name of the app you want to uninstall, press the uninstall button.

 

There are some apps you cannot delete.

Also, are you talking about deleting apps? Or deleting shortcuts on the home screens? Because for that, you just press and hold and once the trash can comes up, just drag it there.