This can be done.

Use the .java.policy file in the user-home directory with following contents:

grant {
   permission java.awt.AWTPermission "showWindowWithoutWarningBanner";
};