Perez tried to pass the Ferrari around the outside but their wheels made contact, the Red Bull pitched into the air and on to the run-off with sidepod damage while Leclerc continued.
The Mexican got his car back to the pits and stayed in it for a long while before getting out, hitting the steering wheel in frustration.
Perez will remain second in the championship standings after starting the race with a 39-point advantage over Mercedes's Lewis Hamilton.
Red Bull and Max Verstappen have already won both championships.