You can remove rust from most metals with minimal scratching by folding/crumpling a small sheet of aluminum foil, wetting it slightly, and scrubbing the rusted surface.  This works well for chrome, but many "chrome" surfaces are now actually made of plastic — so be sure it’s metal before you start rubbing.