Should I recommend this grille to be sealed on the supply plenum in a small utility room with gas furnace and hot water tank.
yes…if it is within 10 feet of them.
Only if it is a return vent you stated supply
Exactly…
I agree it only needs to be sealed if it’s on the return duct (which it doesn’t appear it is).