Results

Jobs Table

Contains the following fields:

• Team : The team name you selected.

• Execution Timestamp : When your submission was received by the test and evaluation server and added to the input queue.

• Job Status : “None” if there is no active job on the server. Otherwise it will indicate the jobs status from the queue manager. or “Ok”. File status will show “Multiple Files Shared” if you share multiple files with the same name with the Vlincs Drive Account.

• File Status : “None” if no files are shared with the Vlincs Drive Account. Ok” if one file per server is found. “Multiple Files Shared” if there are multiple files shared with the Vlincs Drive Account.

• File Timestamp : The timestamp of the file received from your team email which caused a job to be created, entering your submission into the work queue. This timestamp might change if you changed the file while your job was in the input queue.

• Time until Next Execution : How long before your next submission will be eligible for entry into the work queue.

Results Table

This table shows the single submission with the lowest Cross Entropy score per team and contains the following fields:

• Team : The team name you selected.

• iou_IDF1 : Your IOU (intersection over union) based IDF1 score

• iou_HOTA : Your IOU (intersection over union) based HOTA score

• latlong_IDF1 : Your latitude/longitude based IDF1 score

• latlong_HOTA : Your latitude/longitude based HOTA score

• Runtime (s) : Your submission wall runtime in seconds.

• Submission Timestamp : When the submission was recieved on the server.

• File Timestamp : The Google Drive file modified date of the container executed on the server.

• Parsing Errors : Any errors which stem from parsing your output results files.

• Launch Errors : Any errors which stem from running your container.

Error Codes

The leaderboard has a section at the bottom indicating all the errors the test and evaluation server can encounter when running your container.