What's the cleanest way to uninstall a game from Steam?

Library, right click the game, Manage > Uninstall. That's it for the install itself. It usually leaves your save files behind though, either in Documents or in AppData, so if you want it fully gone search for the game's name there. If the game uses Steam Cloud your saves come back when you reinstall, so don't worry about losing those.