I much prefer Gold, but, I have some lovely bags with Silver and Gunmetal, which I think is very cool.
If if I love the bag, the color of the hardware, alone, isn't likely to make a difference. If the hardware seems poorly done, or the color is really off, that's another story.