All you games you own on Steam are tied to your account. You can install. remove, re-install, install on another computer just fine. Don't worry about your games.
Besides, just picking up and moving your games to a new computer will not work. Most games have entries in the computer registry that get filed in on installation. Without those, your game will not run.
As for your game saves, some of them are stored on the Steam Servers, but some of them stay on your hard drive, so you'd want to back those up.
I'm not on my home computer, so I can't fully verify, but I believed they are mostly stored in (If you are on Windows 7, if not, it's probably a similar location):
C:\Documents and Settings\<Your User>\Local Settings\Application Data\<Game Studio Name>\<Game Name>
These are also hidden files, so be sure to set your folder settings to view them. You also might want to check on a per-game basis. Some might store it elsewhere, like in a saved games folder in My Documents or in their SteamApps folder under the Steam Directory. (if you simply wanted to know where your games are located, it's in the Steam directory, under steamapps.)