Fix brain fade in join-removal patch: a pushed-down clause in the outer join's

restrict list is not just something to ignore, it's actually grounds to
abandon the optimization entirely.  Per bug #5255 from Matteo Beccati.