There are a couple of reasons for cooling the wort quickly, which depending on the style you are brewing may affect the taste or not.
Firstly the rapid cooling helps those proteins left after the "hot break" to precipiate out forming the "cold break", these proteins are not affected by slow cooling.
Secondly, during the boil DMS (dimethyl sulphide) is produces but is constantly being driven off by the boil, with slow cooling DMS is still being produced in the hot wort but not being driven off. DMS can give you a cooked vegetable flavour. So by cooling the wort quickly, you want to get below 60C as quick as possible in at least 10 minutes, you are eliminating the possible off flavours. This is important when making lagers and also when using pilsner malt.
As regards getting a clear beer, good brewing practice and the use of Irish Moss or similar should achieve this.