Only pass the -L* portions of LDFLAGS to the Python build environment.

Other flags can have unpredictable effects when Python uses different
commands to build than we do.