U.S. officials told Peru they aren't planning to stop former Peruvian President Toledo from traveling to Israel, a source said.