Sorry I seem to be replying to two threads and am not sure what has been said, so sorry for any redundancies. I would recommend a simple shoe cover if the cold is due to wind going through your shoes. For colder weather, there are neoprene booties shoe covers that work very well in blocking wind and providing some insulation for your feet.
For Kushan's problem of heating up, I use an insulated vest and arm warmers--double arm warmers when it's cold. I might start out with a shell, but as I warm up on a climb, I will remove the shell and have the option of pulling down the arm warmers to cool down further. If you don't own or want bicycling-specific gear like arm warmers, I would use a long sleeve shirt with a vest and roll up the sleeves if it gets hot. The vest keeps the core warm, but being able to unzip the vest and a bicycling jersey or 1/4 zip long sleeve shirt will allow you to vent further if you get hot. With these strategies, I don't get sweaty at all, except for my back to some extent, but it's not uncomfortable for me. These strategies work fine to keep me dry unless it's raining--ugh!
Good luck!
Toshi in Oakland (well, it gets in the 40s here in the mornings)