> Computation limitations in test environment?

Hello,

I was wondering what the limitations are for the test environment, i.e. GPU/CPU memory and run time?

Additionally, how are submissions that exceed computing environment limitations counted in the competition? Will an OOM submission count as one of our validation/test submissions, or are only successfully finished submissions counted?

Thank you,
Morgan

Posted by: morgandaly @ Sept. 29, 2022, 7:08 p.m.

Hi,
thank you for your question! In the validation and test phases there are 30 and 45 minute compute limits, respectively. This is to prevent submissions hogging the system or being stuck in an infinite loop. Only submissions without errors flagged by the system count towards your total number of submissions.

If your submission legitimately takes longer than the set limit, we can work with you, but since you will be deploying a trained model for inference, we expect that the set time limits are sufficient.

GPU will be available during validation and test phases.

Posted by: kdrukker @ Sept. 29, 2022, 7:19 p.m.

I see, thank you!

And what about CPU/GPU memory limits?

Posted by: morgandaly @ Sept. 29, 2022, 7:36 p.m.

The specs are as follows

Azure VM Name vCPU RAM (GB) Temp Storage SSD (GB) GPU GPU Memory (GB) Max uncached disk throughput: IOPS/MBps Max NICs
Standard_NC6s_v3 6 112 736 1 16 20000/200 4

Sorry, formatting was lost when copying/pasting. This info has been added back to 'Challenge Details', where it was accidentally dropped.

Posted by: kdrukker @ Sept. 29, 2022, 8:27 p.m.
Post in this thread