Fix unportable use of isxdigit() with char (rather than unsigned char)

argument, per warnings from buildfarm member pika.  Also clean up code
formatting a trifle.