SUMMARY
Basic comprobations when Network settings changes are not applied during a job
ISSUE
If IP changes are not applied on a job execution, ensure that Test and Failover checkboxes are enabled on the IP configuration window:
3.x versions
Of course, before starting a job (Run test) "Power on" option for the VM should be enabled.