So i looked around a bit and it seems the only way to change the default JVM args is to modify the "HARDCODED" values in the testrunner.bat.
It'd be nice to have this as an argument especially min, max heap and permgen args as an additional parameter in this list (first point)
This will help in controlling this from Jenkins-ant