LED's are pretty sensitive to high voltages, so I wouldn't replace a 4.5V set with a 7.4V set. You can get lithium AAA batteries that can be used as straight replacements, and will last significantly longer than alkaline batteries.
Mike W.
(published on 02/20/2015)