We investigate the effect of equilibrium and nonequilibrium localized vibrations on the excitation energy transfer efficiency of the Fenna-Matthews-Olson complex. By means of numerically exact real-time path-integral simulations of the transfer dynamics we find that equilibrium vibrations do not enhance coherence times. On the other hand, nonequilibrium vibrations induce prolonged coherence times and increased transfer efficiency. By quantifying the transfer dynamics in terms of a non-Markovianity measure based on the time evolution of the trace distance of two quantum states we find, in all cases, a monotonic decrease of the trace distance with increasing time which implies that the exciton transfer follows a Markovian dynamics.