Just because Victoria's Secret got out of swim doesn't mean there's not a big opportunity year-round.