Building a Standards Converter

[ppppenguin]

Indeed it won't hurt to ground them. Until you decide to do some experimental work that needs another pin. I suppose you could clip out the relevant pin(s) on the headers and solder wire(s) to the FPGA board.