Some really useful tutorials on this website including a quick guide and tools for setting up a WordPress CMS on you local machine:

This is the main site: http://sixrevisions.com/ and this is the post on how to download and install WordPress locally:

http://sixrevisions.com/tutorials/web-development-tutorials/using-xampp-for-local-wordpress-theme-development/