Lighter springs will reduce the felt pull weight, but they won't make the action smoother. Some people have good results with reliability with lighter springs, though if I were you I would have to do a LOT of testing to trust a spring configuration that is softer than factory. I personally would not mess with it.
Is it a new 640? When I first got my 642 (NIB), the trigger was stiff and gritty. After 1,000 or so trigger pulls, I cleaned out and re-oiled the internals. It is now as smooth as my other S&Ws, though the pull is still a little heavier. But I'm fine with that. Low pull weight isn't the be all, end all. My Springfield 1911 Mil-Spec had a terribly rough trigger with a jerky release. The pull weight was probably around 5 lbs, but I couldn't achieve better than a 6" group at 7 yards with a junky trigger like that. OTH, I can achieve one hole groups at the same distance with a smooth DA trigger at 10 lbs or more. It just takes some getting used to.
With the lower mass of a J Frame's hammer, stiff springs are a tradeoff to insure reliability to ignite all factory primers/loads.