I took the top of the washer off. Wire brushed off the rust, primed and painted the top of the washer with appliance paint. Installed the new bleach cap and dispenser with some silicone. Then reassembled the top of the washer.
I like the new cap because it sets on top of the washer and not down a bit so the bleach will puddle and get trapped under the cap where it would rust.