TrojAI Leaderboards

Click Here to Join the Competition!

Using machine learning, an artificial intelligence (AI) is trained on data, learns relationships in that data, and then is deployed to the world to operate on new data. The problem is that an adversary that can disrupt the training pipeline can insert Trojan behaviors into the AI. TrojAI’s goal is to detect Trojans hidden in trained AI models. This page is a leaderboard of how well different Trojan detectors work against a population of AIs with and without Trojans. Read more about the problem, see the full submission documentation, or get started with a free minimal example.

Submission container names must use the following format: "<Leaderboard Name>_<Data Split>_<Container Name>.simg"

Reload page to update tables. Content is pushed every 10 minutes. Timestamps are presented in UTC.

Last modified:

Evaluation Server Status

Nodes: idle; running; down.
Accepting Submissions:

Smoke Test Server Status

Nodes: idle; running; down.
Accepting Submissions:


Round 10 leaderboard for object detection August 2022.

Each AI is trained to perform Object Detection either using a single stage (SSD), or a two stage detector (Faster-RCNN). For those AIs that have been attacked, the presence of the pattern will cause the AI to reliably produce the wrong extractive answer. The Round 10 Training Data Download consists of 144 reference AIs (exactly 50% are poisoned) with example input data. More info here.

Missing Zebra Evasion Trigger

Example poisoned image, where the green evasion trigger on the zebra causes the box to dissapear. This image is drawn from COCO (image 117897.jpg).

train: The train dataset that is distributed with each round.
test: The test dataset that is sequestered/hidden, used for evaluation. Submissions here should be fully realized with complete schema and parameters.
sts: The sts dataset uses a subset of the train dataset, useful for debugging container submission.
holdout: The holdout dataset that is sequestered/hidden, used for holdout evaluation.
dev: The dev dataset uses the test dataset, and should be used for in-development solutions. Schemas must be valid, but do not need to be complete. Results do not count towards the program.

Required filename format: "object-detection-aug2022_train_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-aug2022, train: 144
Execution timeout (hh:mm:ss): 1 day, 12:00:00

Teams/Jobs

Team Submission Timestamp Type Job Status File Status General Status File Timestamp Time until next execution
Perspecta 2022-09-21T13:10:04 performer None None Ok 2022-09-21T13:01:18 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI 2022-09-23T05:40:05 performer None None Ok 2022-09-23T05:32:01 0 d, 0 h, 0 m, 0 s
DRAFFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
PL-GIFT 2023-02-14T16:50:07 performer None None Ok 2023-02-14T16:49:12 0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers 2023-07-23T03:30:11 performer None None Ok 2023-07-23T03:23:45 0 d, 0 h, 0 m, 0 s
Perspecta-IUB 2022-09-20T19:20:07 performer None None Ok 2022-09-20T19:16:36 0 d, 0 h, 0 m, 0 s
ARM-UCSD 2022-10-06T22:50:10 performer None None Ok 2022-10-06T22:41:58 0 d, 0 h, 0 m, 0 s
ARM 2022-10-03T07:30:13 performer None None Ok 2022-10-03T07:25:28 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU performer None None Ok None 0 d, 0 h, 0 m, 0 s
ARM-UMBC performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-1 performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-2 performer None None Ok None 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU performer None None Ok None 0 d, 0 h, 0 m, 0 s
trojai-example 2022-09-16T20:09:40 public None None Ok 2022-09-16T20:05:28 0 d, 0 h, 0 m, 0 s
IceTorch public None None Ok None 0 d, 0 h, 0 m, 0 s
trojaicy public None None Ok None 0 d, 0 h, 0 m, 0 s
Hector public None None Ok None 0 d, 0 h, 0 m, 0 s
Cassandra-XF public None None Ok None 0 d, 0 h, 0 m, 0 s
gooddefense public None None Ok None 0 d, 0 h, 0 m, 0 s
cyberinfrastructure public None None Ok None 0 d, 0 h, 0 m, 0 s
glaros public None None Ok None 0 d, 0 h, 0 m, 0 s
Ultraman public None None Ok None 0 d, 0 h, 0 m, 0 s
BackSec public None None Ok None 0 d, 0 h, 0 m, 0 s
Palladium public None None Ok None 0 d, 0 h, 0 m, 0 s
IIECAS public None None Ok None 0 d, 0 h, 0 m, 0 s
NSEC public None None Ok None 0 d, 0 h, 0 m, 0 s
UMBCb 2022-10-17T18:40:21 performer None None Ok 2022-10-17T18:34:26 0 d, 0 h, 0 m, 0 s
PASS public None None Ok None 0 d, 0 h, 0 m, 0 s
DS3TwoSixZero public None None Ok None 0 d, 0 h, 0 m, 0 s
dongdong4fei public None None Ok None 0 d, 0 h, 0 m, 0 s

Best Results based on Cross Entropy

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
trojai-example 0.96655 0.15787 0.32514 0.52537 2592.99 2022-09-16T20:09:40 2022-09-16T20:05:28 Rev1 None None
TrinitySRITrojAI 0.1878 0.04885 0.04729 0.9864 16587.61 2022-09-23T05:40:05 2022-09-23T05:32:01 Rev1 None None
Perspecta-PurdueRutgers 0.11633 0.07236 0.02431 0.98495 35208.11 2023-07-11T14:10:09 2023-07-11T14:08:09 Rev1 None None
PL-GIFT 0.11853 0.03474 0.0244 0.99605 1949.06 2023-02-14T16:50:07 2023-02-14T16:49:12 Rev1 None None
Perspecta 0.30791 0.06677 0.09363 0.93962 55923.26 2022-09-21T13:10:04 2022-09-21T13:01:18 Rev1 None None
Perspecta-IUB 0.28794 0.06866 0.09122 0.94956 4631.59 2022-09-20T19:20:07 2022-09-20T19:16:36 Rev1 None None
ARM 0.44716 0.0774 0.151 0.8751 2595.77 2022-10-03T05:20:13 2022-10-03T05:16:26 Rev1 None None
ARM-UCSD 0.41538 0.0547 0.13453 0.89612 19482.57 2022-10-06T22:50:10 2022-10-06T22:41:58 Rev1 None None
UMBCb 0.31604 0.04107 0.08516 0.97357 1956.02 2022-10-17T18:40:21 2022-10-17T18:34:26 Rev1 :Container File Missing: None

All Results

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
trojai-example 0.96655 0.15787 0.32514 0.52537 2592.99 2022-09-16T20:09:40 2022-09-16T20:05:28 Rev1 None None
TrinitySRITrojAI 0.1878 0.04885 0.04729 0.9864 16587.61 2022-09-23T05:40:05 2022-09-23T05:32:01 Rev1 None None
Perspecta-PurdueRutgers 0.11633 0.07236 0.02431 0.98495 35208.11 2023-07-11T14:10:09 2023-07-11T14:08:09 Rev1 None None
Perspecta-PurdueRutgers 0.16639 0.05898 0.03222 0.97222 33575.19 2023-07-12T17:50:10 2023-07-12T17:44:13 Rev1 None None
Perspecta-PurdueRutgers 0.29205 0.05908 0.07222 0.95833 31588.69 2023-07-23T03:30:11 2023-07-23T03:23:45 Rev1 None None
PL-GIFT 0.11853 0.03474 0.0244 0.99605 1949.06 2023-02-14T16:50:07 2023-02-14T16:49:12 Rev1 None None
Perspecta 0.69068 0.00482 0.24883 0.50694 5997.8 2022-09-19T21:40:04 2022-09-19T21:31:36 Rev1 :Result Parse: None
Perspecta 0.69315 0.0 0.25 0.5 875.54 2022-09-20T16:00:04 2022-09-20T15:52:03 Rev1 None None
Perspecta 0.30791 0.06677 0.09363 0.93962 55923.26 2022-09-21T13:10:04 2022-09-21T13:01:18 Rev1 None None
Perspecta-IUB 0.28794 0.06866 0.09122 0.94956 4631.59 2022-09-20T19:20:07 2022-09-20T19:16:36 Rev1 None None
ARM 0.44716 0.0774 0.151 0.8751 2595.77 2022-10-03T05:20:13 2022-10-03T05:16:26 Rev1 None None
ARM 0.51654 0.0708 0.17471 0.89082 2593.42 2022-10-03T07:30:13 2022-10-03T07:25:28 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 382.63 2022-09-19T19:10:07 2022-09-19T17:19:37 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 557.98 2022-09-19T23:30:07 2022-09-19T23:25:37 Rev1 None None
ARM-UCSD 0.68683 0.00891 0.24721 0.51379 400.63 2022-09-19T23:50:34 2022-09-19T23:45:52 Rev1 None None
ARM-UCSD 0.69889 0.02001 0.25175 0.50675 395.63 2022-09-20T03:50:07 2022-09-20T03:48:06 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 818.28 2022-09-20T16:10:04 2022-09-20T16:03:08 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 288.51 2022-09-20T16:30:28 2022-09-20T16:22:56 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-20T23:40:07 2022-09-20T23:32:15 Rev1 :Executed File Update::Info File Missing::Log File Missing::Container File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-20T23:50:07 2022-09-20T23:32:15 Rev1 :Executed File Update::Info File Missing::Log File Missing::Container File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T00:00:07 2022-09-20T23:32:15 Rev1 :Executed File Update::Info File Missing::Log File Missing::Container File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T00:10:07 2022-09-20T23:32:15 Rev1 :Executed File Update::Info File Missing::Log File Missing::Container File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T00:20:07 2022-09-20T23:32:15 Rev1 :Executed File Update::Info File Missing::Log File Missing::Container File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T00:30:08 2022-09-20T23:32:15 Rev1 :Executed File Update::Info File Missing::Log File Missing::Container File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T00:40:07 2022-09-20T23:32:15 Rev1 :Executed File Update::Info File Missing::Log File Missing::Container File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T00:50:07 2022-09-20T23:32:15 Rev1 :Executed File Update::Info File Missing::Log File Missing::Container File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T01:00:07 2022-09-20T23:32:15 Rev1 :Executed File Update::Info File Missing::Log File Missing::Container File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T01:10:06 2022-09-20T23:32:15 Rev1 :Executed File Update::Info File Missing::Log File Missing::Container File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T01:20:07 2022-09-20T23:32:15 Rev1 :Executed File Update::Info File Missing::Log File Missing::Container File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T01:30:07 2022-09-20T23:32:15 Rev1 :Executed File Update::Info File Missing::Log File Missing::Container File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T01:40:06 2022-09-20T23:32:15 Rev1 :Executed File Update::Info File Missing::Log File Missing::Container File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T01:50:06 2022-09-20T23:32:15 Rev1 :Info File Missing::Log File Missing::Container File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T02:00:06 2022-09-20T23:32:15 Rev1 :Executed File Update::Info File Missing::Log File Missing::Container File Missing: None
ARM-UCSD 0.56854 0.08995 0.19865 0.78173 9436.56 2022-09-21T02:10:07 2022-09-20T23:32:15 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 1153.95 2022-10-04T04:20:09 2022-10-04T04:13:30 Rev1 None None
ARM-UCSD 0.41538 0.0547 0.13453 0.89612 19482.57 2022-10-06T22:50:10 2022-10-06T22:41:58 Rev1 None None
UMBCb 0.31604 0.04107 0.08516 0.97357 1956.02 2022-10-17T18:40:21 2022-10-17T18:34:26 Rev1 :Container File Missing: None

Required filename format: "object-detection-aug2022_test_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-aug2022, test: 144
Execution timeout (hh:mm:ss): 1 day, 12:00:00

Teams/Jobs

Team Submission Timestamp Type Job Status File Status General Status File Timestamp Time until next execution
Perspecta 2022-09-20T20:00:03 performer None None Ok 2022-09-20T19:53:19 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI 2022-09-23T05:40:05 performer None None Ok 2022-09-23T05:32:01 0 d, 0 h, 0 m, 0 s
DRAFFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
PL-GIFT 2023-02-14T16:50:07 performer None None Ok 2023-02-14T16:49:12 0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers 2023-07-23T03:30:11 performer None Ok Ok 2023-07-23T03:23:45 0 d, 0 h, 0 m, 0 s
Perspecta-IUB 2022-09-20T19:20:07 performer None None Ok 2022-09-20T19:16:36 0 d, 0 h, 0 m, 0 s
ARM-UCSD 2022-11-08T00:40:10 performer None None Ok 2022-11-08T00:37:39 0 d, 0 h, 0 m, 0 s
ARM 2022-10-03T07:30:13 performer None Ok Ok 2022-10-03T07:25:28 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU performer None None Ok None 0 d, 0 h, 0 m, 0 s
ARM-UMBC performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-1 performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-2 performer None None Ok None 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU performer None None Ok None 0 d, 0 h, 0 m, 0 s
trojai-example 2022-09-20T18:30:09 public None None Ok 2022-09-20T18:27:57 0 d, 0 h, 0 m, 0 s
IceTorch public None None Ok None 0 d, 0 h, 0 m, 0 s
trojaicy public None None Ok None 0 d, 0 h, 0 m, 0 s
Hector public None None Ok None 0 d, 0 h, 0 m, 0 s
Cassandra-XF public None None Ok None 0 d, 0 h, 0 m, 0 s
gooddefense public None None Ok None 0 d, 0 h, 0 m, 0 s
cyberinfrastructure public None None Ok None 0 d, 0 h, 0 m, 0 s
glaros public None None Ok None 0 d, 0 h, 0 m, 0 s
Ultraman public None None Ok None 0 d, 0 h, 0 m, 0 s
BackSec public None None Ok None 0 d, 0 h, 0 m, 0 s
Palladium public None None Ok None 0 d, 0 h, 0 m, 0 s
IIECAS public None None Ok None 0 d, 0 h, 0 m, 0 s
NSEC public None None Ok None 0 d, 0 h, 0 m, 0 s
UMBCb 2022-10-17T18:40:21 performer None None Ok 2022-10-17T18:34:26 0 d, 0 h, 0 m, 0 s
PASS public None None Ok None 0 d, 0 h, 0 m, 0 s
DS3TwoSixZero public None None Ok None 0 d, 0 h, 0 m, 0 s
dongdong4fei public None None Ok None 0 d, 0 h, 0 m, 0 s

Best Results based on Cross Entropy

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
trojai-example 0.69315 0.0 0.25 0.5 2022-09-20T18:30:09 2022-09-20T18:27:57 Rev1 :Info File Missing: None
TrinitySRITrojAI 0.39378 0.08799 0.12842 0.89902 6019.45 2022-09-09T20:00:01 2022-09-09T19:54:15 Rev1 :Executed File Update::Log File Missing: None
ICSI-2 0.33308 0.08907 0.104 0.93808 662.89 2022-09-02T10:10:01 2022-09-02T10:03:39 Rev1 :Executed File Update::Log File Missing: None
Perspecta-PurdueRutgers 0.16787 0.09226 0.04146 0.96335 20369.45 2022-08-21T20:10:01 2022-08-21T20:01:40 Rev1 :Executed File Update::Log File Missing: None
PL-GIFT 0.37038 0.0686 0.11748 0.92033 541.24 2022-09-08T18:20:02 2022-09-08T18:17:57 Rev1 :Executed File Update::Log File Missing: None
Perspecta 0.38825 0.08085 0.12527 0.8914 55313.35 2022-09-20T20:00:03 2022-09-20T19:53:19 Rev1 None None
TrinitySRITrojAI-SBU 0.44974 0.06643 0.14299 0.87953 1181.78 2022-09-04T19:40:01 2022-09-04T15:36:46 Rev1 :Executed File Update::Log File Missing: None
Perspecta-IUB 0.34531 0.0922 0.10788 0.92708 983.53 2022-09-02T05:00:01 2022-09-02T04:52:07 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI-BostonU 0.44557 0.07967 0.14031 0.88349 11213.55 2022-08-23T14:30:01 2022-08-23T14:21:31 Rev1 :Executed File Update::Log File Missing: None
ARM 0.62867 0.37593 0.15467 0.85957 2596.3 2022-10-03T06:20:13 2022-10-03T06:18:21 Rev1 None None
ARM-UCSD 0.46467 0.05577 0.15539 0.85552 19518.63 2022-10-06T22:50:10 2022-10-06T22:41:58 Rev1 None None
UMBCb 0.46014 0.06258 0.14668 0.87973 1947.54 2022-10-17T18:40:21 2022-10-17T18:34:26 Rev1 None None

All Results

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
trojai-example 1.14219 0.20328 0.35385 0.47666 909.16 2022-07-28T01:30:07 2022-07-28T01:30:03 Rev1 :Executed File Update::Log File Missing: None
trojai-example 0.95963 0.14719 0.32745 0.48563 2591.05 2022-09-16T20:09:40 2022-09-16T20:05:28 Rev1 None None
trojai-example 0.69315 0.0 0.25 0.5 2022-09-20T18:30:09 2022-09-20T18:27:57 Rev1 :Info File Missing: None
TrinitySRITrojAI 0.44557 0.07967 0.14031 0.88349 11072.36 2022-07-28T03:50:01 2022-07-28T03:46:36 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI 0.45826 0.14674 0.13468 0.88754 11567.63 2022-08-01T20:00:01 2022-08-01T19:51:21 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI 0.49569 0.0984 0.16507 0.83362 1261.47 2022-08-08T23:10:01 2022-08-08T23:08:01 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI 0.43343 0.06755 0.14125 0.86921 3937.95 2022-08-11T06:50:02 2022-08-11T06:41:58 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI 0.40207 0.10005 0.13224 0.90075 3942.27 2022-08-27T06:00:01 2022-08-27T05:58:46 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 2022-09-06T22:50:01 2022-09-06T22:45:07 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
TrinitySRITrojAI 0.40557 0.10773 0.13063 0.89911 3927.8 2022-09-07T04:50:02 2022-09-07T04:34:50 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI 0.39378 0.08799 0.12842 0.89902 6019.45 2022-09-09T20:00:01 2022-09-09T19:54:15 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 2022-09-20T18:20:04 2022-09-20T18:15:08 Rev1 :Info File Missing: None
TrinitySRITrojAI 0.40958 0.0964 0.13166 0.89361 16610.22 2022-09-23T05:40:05 2022-09-23T05:32:01 Rev1 None None
ICSI-2 0.48919 0.06161 0.16241 0.85031 535.05 2022-07-28T21:00:02 2022-07-28T20:56:51 Rev1 :Executed File Update::Log File Missing: :Container Parameters (jsonschema checker):
ICSI-2 0.45518 0.0958 0.14463 0.86381 532.58 2022-07-29T23:20:01 2022-07-29T23:12:21 Rev1 :Executed File Update::Log File Missing: None
ICSI-2 0.4023 0.0761 0.12481 0.90451 569.74 2022-08-03T03:20:01 2022-08-03T03:17:09 Rev1 :Executed File Update::Log File Missing: None
ICSI-2 0.38275 0.07356 0.11598 0.91532 569.39 2022-08-05T00:40:01 2022-08-05T00:39:34 Rev1 :Executed File Update::Log File Missing: None
ICSI-2 0.36983 0.07443 0.11192 0.92882 590.89 2022-08-09T01:00:01 2022-08-09T00:52:50 Rev1 :Executed File Update::Log File Missing: None
ICSI-2 0.34072 0.08762 0.10681 0.93779 573.48 2022-08-09T07:00:02 2022-08-09T05:59:27 Rev1 :Executed File Update::Log File Missing: None
ICSI-2 0.49614 0.20392 0.12848 0.92631 586.74 2022-08-09T23:50:01 2022-08-09T23:47:56 Rev1 :Executed File Update::Log File Missing: None
ICSI-2 0.34129 0.09577 0.10844 0.9376 603.02 2022-08-10T22:50:02 2022-08-10T22:12:01 Rev1 :Executed File Update::Log File Missing: None
ICSI-2 0.34132 0.08756 0.10686 0.93779 588.8 2022-08-11T05:30:02 2022-08-11T05:29:28 Rev1 :Executed File Update::Log File Missing: None
ICSI-2 0.34523 0.09544 0.10873 0.9376 594.7 2022-08-11T21:30:01 2022-08-11T21:22:33 Rev1 :Executed File Update::Log File Missing: None
ICSI-2 0.35496 0.08273 0.11088 0.92429 1185.1 2022-08-16T14:50:01 2022-08-16T14:49:40 Rev1 :Executed File Update::Log File Missing: None
ICSI-2 0.33536 0.089 0.105 0.93808 593.21 2022-08-22T23:50:01 2022-08-22T23:41:20 Rev1 :Executed File Update::Log File Missing: None
ICSI-2 0.33536 0.089 0.105 0.93808 594.83 2022-08-23T05:50:01 2022-08-23T00:03:15 Rev1 :Executed File Update::Log File Missing: None
ICSI-2 0.3406 0.08354 0.10502 0.93412 591.03 2022-08-23T11:50:01 2022-08-23T07:14:37 Rev1 :Executed File Update::Log File Missing: None
ICSI-2 0.33308 0.08907 0.104 0.93808 662.89 2022-09-02T10:10:01 2022-09-02T10:03:39 Rev1 :Executed File Update::Log File Missing: None
Perspecta-PurdueRutgers 0.24686 0.08555 0.05968 0.94049 20556.45 2022-07-29T01:00:02 2022-07-29T00:52:14 Rev1 :Executed File Update::Log File Missing: None
Perspecta-PurdueRutgers 0.23909 0.08514 0.05642 0.94126 20181.37 2022-08-19T23:20:01 2022-08-19T23:13:07 Rev1 :Executed File Update::Log File Missing: None
Perspecta-PurdueRutgers 0.24568 0.09897 0.05347 0.92612 20670.17 2022-08-20T21:40:02 2022-08-20T21:32:11 Rev1 :Executed File Update::Log File Missing: None
Perspecta-PurdueRutgers 0.16787 0.09226 0.04146 0.96335 20369.45 2022-08-21T20:10:01 2022-08-21T20:01:40 Rev1 :Executed File Update::Log File Missing: None
Perspecta-PurdueRutgers 0.16787 0.09226 0.04146 0.96335 33883.17 2023-07-11T14:10:09 2023-07-11T14:08:09 Rev1 None None
Perspecta-PurdueRutgers 0.21217 0.07718 0.04889 0.95139 32870.19 2023-07-12T17:50:10 2023-07-12T17:44:13 Rev1 None None
Perspecta-PurdueRutgers 0.32845 0.07137 0.08611 0.93403 31618.44 2023-07-23T03:30:11 2023-07-23T03:23:45 Rev1 None None
PL-GIFT 0.69315 0.0 0.25 0.5 242.71 2022-07-29T20:00:02 2022-07-29T19:44:36 Rev1 :Executed File Update::Log File Missing: None
PL-GIFT 3.21884 1.36132 0.23092 0.74894 2887.89 2022-07-30T02:00:02 2022-07-29T22:41:27 Rev1 :Executed File Update::Log File Missing: None
PL-GIFT 0.38316 0.08957 0.12258 0.90992 2654.61 2022-08-09T03:50:01 2022-08-09T03:42:13 Rev1 :Executed File Update::Log File Missing: :Container Parameters (jsonschema checker):
PL-GIFT 0.42492 0.11866 0.13435 0.88657 2498.94 2022-08-20T16:30:02 2022-08-20T16:24:23 Rev1 :Executed File Update::Log File Missing: :Container Parameters (jsonschema checker):
PL-GIFT 0.57207 0.16016 0.17005 0.82147 974.33 2022-08-25T23:20:01 2022-08-25T23:12:14 Rev1 :Executed File Update::Log File Missing: :Container Parameters (jsonschema checker):
PL-GIFT 0.4778 0.12937 0.15503 0.8968 1925.54 2022-09-03T16:20:02 2022-09-03T16:16:06 Rev1 :Executed File Update::Log File Missing: :Container Parameters (jsonschema checker):
PL-GIFT 0.4987 0.07674 0.17538 0.88262 1914.04 2022-09-03T22:20:02 2022-09-03T18:33:34 Rev1 :Executed File Update::Log File Missing: :Container Parameters (jsonschema checker):
PL-GIFT 0.38923 0.07448 0.12435 0.91223 517.53 2022-09-07T20:40:02 2022-09-07T20:32:17 Rev1 :Executed File Update::Log File Missing: None
PL-GIFT 0.37038 0.0686 0.11748 0.92033 541.24 2022-09-08T18:20:02 2022-09-08T18:17:57 Rev1 :Executed File Update::Log File Missing: None
PL-GIFT 0.38372 0.06729 0.12096 0.91995 544.48 2022-09-09T00:20:02 2022-09-08T23:46:27 Rev1 :Executed File Update::Log File Missing: None
PL-GIFT 0.45717 0.13378 0.13766 0.87375 1948.1 2023-02-14T16:50:07 2023-02-14T16:49:12 Rev1 None None
Perspecta 0.66321 0.02806 0.23535 0.61333 17442.4 2022-08-09T13:10:01 2022-08-09T13:04:43 Rev1 :Executed File Update::Log File Missing: :Container Parameters (jsonschema checker):
Perspecta 0.6087 0.06574 0.20903 0.70737 24040.01 2022-08-30T00:40:02 2022-08-30T00:36:36 Rev1 :Executed File Update::Log File Missing: :Container Parameters (jsonschema checker):
Perspecta 0.57544 0.06812 0.19543 0.7689 24217.35 2022-08-31T03:00:02 2022-08-31T02:55:12 Rev1 :Executed File Update::Log File Missing: None
Perspecta 0.51267 0.08891 0.16341 0.79784 18676.66 2022-09-02T17:00:02 2022-09-02T16:59:06 Rev1 :Executed File Update::Log File Missing: None
Perspecta 0.48061 0.07919 0.15509 0.83671 20922.93 2022-09-05T06:40:01 2022-09-05T06:32:24 Rev1 :Executed File Update::Log File Missing: None
Perspecta 0.46803 0.07267 0.15087 0.84674 21076.29 2022-09-07T23:40:01 2022-09-07T23:39:31 Rev1 :Executed File Update::Log File Missing: None
Perspecta 0.42916 0.08665 0.14171 0.84076 21315.05 2022-09-08T13:00:01 2022-09-08T12:57:41 Rev1 :Executed File Update::Log File Missing: None
Perspecta 0.40836 0.07876 0.13245 0.87867 21297.73 2022-09-08T23:40:02 2022-09-08T23:32:13 Rev1 :Executed File Update::Log File Missing: None
Perspecta 1.71484 0.38792 0.34274 0.72203 21329.54 2022-09-09T19:00:01 2022-09-09T18:53:06 Rev1 :Executed File Update::Log File Missing: None
Perspecta 0.69315 0.0 0.25 0.5 569.95 2022-09-19T21:40:04 2022-09-19T21:31:36 Rev1 None None
Perspecta 0.68092 0.0138 0.24509 0.52064 1137.85 2022-09-20T16:00:04 2022-09-20T15:52:03 Rev1 None None
Perspecta 0.69315 0.0 0.25 0.5 2022-09-20T17:40:03 2022-09-20T17:31:14 Rev1 :Info File Missing: None
Perspecta 0.38825 0.08085 0.12527 0.8914 55313.35 2022-09-20T20:00:03 2022-09-20T19:53:19 Rev1 None None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 242.85 2022-08-11T00:50:02 2022-08-11T00:42:03 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI-SBU 0.69018 0.02699 0.24895 0.55449 968.17 2022-08-11T16:30:01 2022-08-11T16:24:12 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI-SBU 0.6859 0.05438 0.2487 0.84742 984.51 2022-08-19T01:40:02 2022-08-19T01:31:42 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 146.31 2022-09-02T02:30:01 2022-09-02T02:20:55 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 146.3 2022-09-02T16:00:01 2022-09-02T15:58:50 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI-SBU 0.49163 0.05391 0.1645 0.8559 999.98 2022-09-02T23:50:02 2022-09-02T23:49:32 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI-SBU 0.48748 0.06064 0.16207 0.85774 542.07 2022-09-03T16:40:02 2022-09-03T16:32:39 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 1000.01 2022-09-03T22:50:01 2022-09-03T17:58:57 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 997.4 2022-09-04T13:40:01 2022-09-04T13:32:50 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI-SBU 0.44974 0.06643 0.14299 0.87953 1181.78 2022-09-04T19:40:01 2022-09-04T15:36:46 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI-SBU 0.46014 0.06258 0.14668 0.87973 696.25 2022-09-05T04:20:01 2022-09-05T04:10:52 Rev1 :Executed File Update::Log File Missing: None
Perspecta-IUB 0.69315 0.0 0.25 0.5 2022-08-20T12:50:01 2022-08-20T05:20:27 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
Perspecta-IUB 0.69315 0.0 0.25 0.5 242.65 2022-08-20T18:50:01 2022-08-20T14:09:27 Rev1 :Executed File Update::Log File Missing: :Container Parameters (jsonschema checker):
Perspecta-IUB 0.38398 0.07422 0.12311 0.91291 943.14 2022-08-21T01:10:01 2022-08-21T01:09:36 Rev1 :Executed File Update::Log File Missing: None
Perspecta-IUB 0.38489 0.07559 0.12368 0.9076 1155.3 2022-08-21T07:10:02 2022-08-21T04:43:25 Rev1 :Executed File Update::Log File Missing: None
Perspecta-IUB 0.38368 0.08351 0.12466 0.90538 1157.16 2022-08-21T13:20:01 2022-08-21T10:35:53 Rev1 :Executed File Update::Log File Missing: None
Perspecta-IUB 0.38151 0.09405 0.12178 0.91358 1107.12 2022-08-21T19:20:02 2022-08-21T16:09:32 Rev1 :Executed File Update::Log File Missing: None
Perspecta-IUB 1.70346 0.88386 0.16209 0.8749 1110.03 2022-08-22T01:30:01 2022-08-21T21:31:52 Rev1 :Executed File Update::Log File Missing: None
Perspecta-IUB 1.2325 0.81994 0.1274 0.89352 1108.13 2022-08-22T07:30:02 2022-08-22T03:47:24 Rev1 :Executed File Update::Log File Missing: None
Perspecta-IUB 0.38299 0.07476 0.12332 0.91387 1104.07 2022-08-22T15:50:01 2022-08-22T15:44:02 Rev1 :Executed File Update::Log File Missing: None
Perspecta-IUB 0.38345 0.09579 0.12526 0.90847 915.39 2022-08-22T21:50:01 2022-08-22T17:33:07 Rev1 :Executed File Update::Log File Missing: None
Perspecta-IUB 0.7091 0.52659 0.12237 0.90693 1106.19 2022-08-23T03:50:02 2022-08-23T03:43:11 Rev1 :Executed File Update::Log File Missing: None
Perspecta-IUB 0.5462 0.37943 0.12211 0.90789 1103.9 2022-08-23T15:40:01 2022-08-23T15:36:57 Rev1 :Executed File Update::Log File Missing: None
Perspecta-IUB 0.46154 0.14162 0.14309 0.89265 982.75 2022-09-01T21:00:02 2022-09-01T20:53:07 Rev1 :Executed File Update::Log File Missing: None
Perspecta-IUB 0.34531 0.0922 0.10788 0.92708 983.53 2022-09-02T05:00:01 2022-09-02T04:52:07 Rev1 :Executed File Update::Log File Missing: None
Perspecta-IUB 0.3471 0.08301 0.10943 0.92593 980.65 2022-09-02T11:00:02 2022-09-02T05:24:14 Rev1 :Executed File Update::Log File Missing: None
Perspecta-IUB 0.37432 0.11724 0.11518 0.91358 956.17 2022-09-02T17:00:02 2022-09-02T14:32:45 Rev1 :Executed File Update::Log File Missing: None
Perspecta-IUB 0.37834 0.12218 0.11548 0.91657 1021.11 2022-09-03T00:30:02 2022-09-03T00:23:40 Rev1 :Executed File Update::Log File Missing: None
Perspecta-IUB 0.35561 0.09127 0.11384 0.92216 1633.86 2022-09-03T06:30:02 2022-09-03T04:12:11 Rev1 :Executed File Update::Log File Missing: None
Perspecta-IUB 0.35561 0.09127 0.11384 0.92216 4625.08 2022-09-20T19:20:07 2022-09-20T19:16:36 Rev1 None None
TrinitySRITrojAI-BostonU 0.84611 0.09268 0.31589 0.5 11503.52 2022-08-22T16:30:01 2022-08-22T15:15:13 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI-BostonU 0.84545 0.09245 0.31564 0.5 12486.37 2022-08-23T00:10:02 2022-08-22T23:53:29 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI-BostonU 1.51843 0.27506 0.42086 0.6034 11137.86 2022-08-23T06:20:02 2022-08-23T04:01:32 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI-BostonU 0.44557 0.07967 0.14031 0.88349 11213.55 2022-08-23T14:30:01 2022-08-23T14:21:31 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI-BostonU 0.49831 0.10303 0.15791 0.84414 11119.38 2022-08-23T20:30:01 2022-08-23T17:55:58 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI-BostonU 0.49946 0.04878 0.16172 0.86535 11116.17 2022-08-24T02:30:01 2022-08-24T00:09:32 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI-BostonU 0.44557 0.07967 0.14031 0.88349 11469.17 2022-08-24T15:50:02 2022-08-24T15:42:02 Rev1 :Executed File Update::Log File Missing: None
TrinitySRITrojAI-BostonU 0.44557 0.07967 0.14031 0.88349 11790.8 2022-08-25T14:00:01 2022-08-25T13:50:19 Rev1 :Executed File Update::Log File Missing: None
ARM 0.69315 0.0 0.25 0.5 868.0 2022-08-23T07:50:01 2022-08-23T09:18:28 Rev1 :Executed File Update::Log File Missing: None
ARM 0.81852 0.08419 0.30396 0.46672 868.19 2022-08-23T19:20:01 2022-08-23T19:19:22 Rev1 :Executed File Update::Log File Missing: None
ARM 0.87806 0.37656 0.26375 0.8342 870.05 2022-08-24T01:20:02 2022-08-23T20:13:57 Rev1 :Executed File Update::Log File Missing: None
ARM 0.69315 0.0 0.25 0.5 868.06 2022-09-06T03:10:02 2022-09-06T03:02:06 Rev1 :Executed File Update::Log File Missing: None
ARM 0.90598 0.37697 0.27668 0.83227 867.9 2022-09-06T09:20:01 2022-09-06T06:40:56 Rev1 :Executed File Update::Log File Missing: None
ARM 0.67795 0.37716 0.17678 0.81395 868.02 2022-09-06T16:10:01 2022-09-06T16:04:10 Rev1 :Executed File Update::Log File Missing: None
ARM 0.62867 0.37593 0.15467 0.85957 2596.3 2022-10-03T06:20:13 2022-10-03T06:18:21 Rev1 None None
ARM 0.71323 0.37262 0.18769 0.87249 2597.16 2022-10-03T07:30:13 2022-10-03T07:25:28 Rev1 None None
ARM-UCSD 0.52751 0.09885 0.18077 0.81375 3439.11 2022-09-02T06:10:01 2022-09-02T06:02:30 Rev1 :Executed File Update::Log File Missing: None
ARM-UCSD 0.56404 0.10495 0.19593 0.77951 3452.26 2022-09-02T21:10:02 2022-09-02T21:35:08 Rev1 :Executed File Update::Log File Missing: None
ARM-UCSD 0.55948 0.09147 0.19342 0.76399 3440.33 2022-09-03T06:00:01 2022-09-03T05:55:52 Rev1 :Executed File Update::Log File Missing: None
ARM-UCSD 0.69054 0.00509 0.24878 0.50694 8959.98 2022-09-19T19:10:07 2022-09-19T17:19:37 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 708.34 2022-09-19T23:30:08 2022-09-19T23:25:22 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 712.03 2022-09-19T23:50:35 2022-09-19T23:45:47 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 650.04 2022-09-20T03:50:08 2022-09-20T03:48:13 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 615.03 2022-09-20T16:30:29 2022-09-20T16:23:30 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-20T22:20:07 2022-09-20T22:14:55 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-20T22:30:07 2022-09-20T22:14:55 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-20T22:40:07 2022-09-20T22:14:55 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-20T22:50:07 2022-09-20T22:14:55 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-20T23:00:07 2022-09-20T22:14:55 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-20T23:10:07 2022-09-20T23:08:46 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-20T23:20:07 2022-09-20T23:08:46 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-20T23:30:06 2022-09-20T23:08:46 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-20T23:40:08 2022-09-20T23:08:46 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-20T23:50:08 2022-09-20T23:08:46 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T00:00:08 2022-09-20T23:08:46 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T00:10:08 2022-09-20T23:08:46 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T00:20:08 2022-09-20T23:08:46 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T00:30:09 2022-09-20T23:08:46 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T00:40:08 2022-09-20T23:08:46 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T00:50:08 2022-09-20T23:08:46 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T01:00:08 2022-09-20T23:08:46 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T01:10:07 2022-09-20T23:08:46 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T01:20:08 2022-09-20T23:08:46 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T01:30:08 2022-09-20T23:08:46 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T01:40:07 2022-09-20T23:08:46 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T01:50:07 2022-09-20T23:08:46 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-21T02:00:08 2022-09-20T23:08:46 Rev1 :Executed File Update::Info File Missing::Log File Missing: None
ARM-UCSD 0.62893 0.09361 0.22448 0.70804 9334.92 2022-09-21T02:10:08 2022-09-20T23:08:46 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 1155.89 2022-10-04T04:20:10 2022-10-04T04:13:40 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 1154.27 2022-10-04T23:10:10 2022-10-04T23:07:45 Rev1 None None
ARM-UCSD 0.46467 0.05577 0.15539 0.85552 19518.63 2022-10-06T22:50:10 2022-10-06T22:41:58 Rev1 None None
ARM-UCSD 0.66841 0.0274 0.23736 0.63677 34424.14 2022-11-02T05:40:11 2022-11-02T05:35:09 Rev1 None :Container Parameters (jsonschema checker):
ARM-UCSD 0.48031 0.0513 0.16388 0.82128 34260.63 2022-11-08T00:40:10 2022-11-08T00:37:39 Rev1 None :Container Parameters (jsonschema checker):
UMBCb 0.69315 0.0 0.25 0.5 865.64 2022-10-16T21:00:23 2022-10-16T20:57:55 Rev1 None None
UMBCb 0.46014 0.06258 0.14668 0.87973 1947.54 2022-10-17T18:40:21 2022-10-17T18:34:26 Rev1 None None

Required filename format: "object-detection-aug2022_sts_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-aug2022, sts: 10
Execution timeout (hh:mm:ss): 2:30:00

Teams/Jobs

Team Submission Timestamp Type Job Status File Status General Status File Timestamp Time until next execution
Perspecta 2022-09-20T16:20:03 performer None None Ok 2022-09-20T16:15:49 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI 2022-09-22T23:30:05 performer None None Ok 2022-09-22T23:24:44 0 d, 0 h, 0 m, 0 s
DRAFFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
PL-GIFT 2023-02-14T16:20:07 performer None None Ok 2023-02-14T16:17:22 0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers 2023-07-11T03:10:11 performer None None Ok 2023-07-11T03:00:58 0 d, 0 h, 0 m, 0 s
Perspecta-IUB performer None None Ok None 0 d, 0 h, 0 m, 0 s
ARM-UCSD 2022-11-08T00:40:11 performer None None Ok 2022-11-08T00:37:31 0 d, 0 h, 0 m, 0 s
ARM performer None None Ok None 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU performer None None Ok None 0 d, 0 h, 0 m, 0 s
ARM-UMBC performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-1 performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-2 performer None None Ok None 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU performer None None Ok None 0 d, 0 h, 0 m, 0 s
trojai-example 2022-10-05T15:10:17 public None None Ok 2022-10-05T14:59:32 0 d, 0 h, 0 m, 0 s
IceTorch public None None Ok None 0 d, 0 h, 0 m, 0 s
trojaicy public None None Ok None 0 d, 0 h, 0 m, 0 s
Hector public None None Ok None 0 d, 0 h, 0 m, 0 s
Cassandra-XF public None None Ok None 0 d, 0 h, 0 m, 0 s
gooddefense public None None Ok None 0 d, 0 h, 0 m, 0 s
cyberinfrastructure public None None Ok None 0 d, 0 h, 0 m, 0 s
glaros public None None Ok None 0 d, 0 h, 0 m, 0 s
Ultraman public None None Ok None 0 d, 0 h, 0 m, 0 s
BackSec public None None Ok None 0 d, 0 h, 0 m, 0 s
Palladium public None None Ok None 0 d, 0 h, 0 m, 0 s
IIECAS public None None Ok None 0 d, 0 h, 0 m, 0 s
NSEC public None None Ok None 0 d, 0 h, 0 m, 0 s
UMBCb 2022-10-17T18:20:22 performer None None Ok 2022-10-17T18:16:50 0 d, 0 h, 0 m, 0 s
PASS public None None Ok None 0 d, 0 h, 0 m, 0 s
DS3TwoSixZero public None None Ok None 0 d, 0 h, 0 m, 0 s
dongdong4fei public None None Ok None 0 d, 0 h, 0 m, 0 s

Best Results based on Cross Entropy

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
trojai-example 0.51567 0.25566 0.17866 0.83333 180.51 2022-10-05T15:10:17 2022-10-05T14:59:32 Rev1 None None
TrinitySRITrojAI 0.29559 0.27212 0.0956 0.95833 1180.67 2022-09-22T23:30:05 2022-09-22T23:24:44 Rev1 None None
Perspecta-PurdueRutgers 0.40105 0.67933 0.09634 0.875 2887.14 2023-07-11T03:10:11 2023-07-11T03:00:58 Rev1 None None
PL-GIFT 0.14231 0.05954 0.02343 1.0 134.51 2023-02-14T16:20:07 2023-02-14T16:17:22 Rev1 None None
Perspecta 0.59455 0.133 0.21041 0.6875 1144.68 2022-09-20T16:20:03 2022-09-20T16:15:49 Rev1 None None
ARM-UCSD 0.42054 0.15442 0.1275 1.0 1502.36 2022-10-06T22:50:11 2022-10-06T22:41:50 Rev1 None None
UMBCb 0.43737 0.21442 0.14229 0.83333 135.39 2022-10-17T18:20:22 2022-10-17T18:16:50 Rev1 None None

All Results

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
trojai-example 0.69315 0.0 0.25 0.5 0.55 2022-09-16T16:49:12 2022-09-16T16:28:58 Rev1 :Container File Missing: :Copy Out:
trojai-example 0.69315 0.0 0.25 0.5 50.15 2022-09-16T18:15:25 2022-09-16T16:28:58 Rev1 None None
trojai-example 0.69315 0.0 0.25 0.5 50.16 2022-09-16T18:41:59 2022-09-16T16:28:58 Rev1 None None
trojai-example 0.69315 0.0 0.25 0.5 50.15 2022-09-16T18:55:49 2022-09-16T16:28:58 Rev1 None None
trojai-example 0.69315 0.0 0.25 0.5 2022-09-16T19:31:19 2022-09-16T16:28:58 Rev1 :Executed File Update::Info File Missing::Container File Missing: None
trojai-example 0.69315 0.0 0.25 0.5 131.51 2022-09-16T19:33:25 2022-09-16T16:28:58 Rev1 None None
trojai-example 1.24928 0.79595 0.38884 0.52083 179.93 2022-09-16T19:39:51 2022-09-16T16:28:58 Rev1 None None
trojai-example 0.85088 0.56821 0.27957 0.625 180.06 2022-09-16T19:53:23 2022-09-16T16:28:58 Rev1 None None
trojai-example 0.9125 0.55567 0.30594 0.58333 179.98 2022-09-16T20:13:46 2022-09-16T16:28:58 Rev1 None None
trojai-example 0.87033 0.39561 0.32378 0.5 179.9 2022-09-20T18:30:10 2022-09-20T18:27:48 Rev1 None None
trojai-example 0.63804 0.42147 0.21279 0.70833 181.61 2022-10-05T14:20:19 2022-10-05T14:14:26 Rev1 :Container File Missing: None
trojai-example 1.59808 0.6812 0.52814 0.08333 180.31 2022-10-05T14:50:16 2022-10-05T14:41:53 Rev1 :Container File Missing: None
trojai-example 0.51567 0.25566 0.17866 0.83333 180.51 2022-10-05T15:10:17 2022-10-05T14:59:32 Rev1 None None
TrinitySRITrojAI 0.29559 0.27212 0.0956 0.95833 1180.67 2022-09-22T23:30:05 2022-09-22T23:24:44 Rev1 None None
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 2023-07-11T01:30:11 2023-07-11T01:29:30 Rev1 :No Results::Missing Results::Container File Missing: :Container Parameters (jsonschema checker):
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 2023-07-11T02:10:11 2023-07-11T02:08:26 Rev1 :No Results::Missing Results::Container File Missing: :Container Parameters (jsonschema checker):
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 2023-07-11T02:40:10 2023-07-11T02:34:26 Rev1 :No Results::Missing Results::Container File Missing: :Schema Header:
Perspecta-PurdueRutgers 0.40105 0.67933 0.09634 0.875 2887.14 2023-07-11T03:10:11 2023-07-11T03:00:58 Rev1 None None
PL-GIFT 0.69315 0.0 0.25 0.5 2023-01-25T14:40:10 2023-01-25T14:32:44 Rev1 :No Results::Container File Missing: :Container Parameters (jsonschema checker):
PL-GIFT 0.69315 0.0 0.25 0.5 2023-02-02T23:50:08 2023-02-02T23:49:18 Rev1 :No Results::Container File Missing: :Container Parameters (learned parameters)::Container Parameters (jsonschema checker):
PL-GIFT 0.69315 0.0 0.25 0.5 2023-02-10T15:50:07 2023-02-10T15:45:32 Rev1 :No Results::Container File Missing: :Container Parameters (learned parameters):
PL-GIFT 0.69315 0.0 0.25 0.5 71.66 2023-02-10T16:50:08 2023-02-10T16:48:51 Rev1 :No Results: None
PL-GIFT 0.69315 0.0 0.25 0.5 100.31 2023-02-10T18:20:07 2023-02-10T18:17:02 Rev1 :No Results: None
PL-GIFT 0.69315 0.0 0.25 0.5 144.0 2023-02-10T19:40:06 2023-02-10T19:35:33 Rev1 :No Results: None
PL-GIFT 0.14231 0.05954 0.02343 1.0 134.51 2023-02-14T16:20:07 2023-02-14T16:17:22 Rev1 None None
Perspecta 0.86773 0.77126 0.24779 0.625 1800.55 2022-09-19T19:10:03 2022-09-19T13:43:43 Rev1 None :Timeout:
Perspecta 0.59455 0.133 0.21041 0.6875 1144.68 2022-09-20T16:20:03 2022-09-20T16:15:49 Rev1 None None
ARM-UCSD 0.51516 0.28617 0.16466 0.79167 650.68 2022-09-19T23:40:06 2022-09-19T23:30:09 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-09-20T00:00:53 2022-09-19T23:45:42 Rev1 :Info File Missing::Container File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 392.48 2022-09-20T16:30:30 2022-09-20T16:27:42 Rev1 None None
ARM-UCSD 0.46552 0.16004 0.14563 0.97917 649.66 2022-09-20T17:50:06 2022-09-20T17:43:39 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 79.93 2022-10-05T20:20:10 2022-10-05T20:16:53 Rev1 None None
ARM-UCSD 0.42054 0.15442 0.1275 1.0 1502.36 2022-10-06T22:50:11 2022-10-06T22:41:50 Rev1 None None
ARM-UCSD 0.6713 0.09389 0.23895 0.45833 2690.42 2022-11-02T05:40:12 2022-11-02T05:35:19 Rev1 None :Container Parameters (jsonschema checker):
ARM-UCSD 0.46868 0.15856 0.14981 0.9375 2724.25 2022-11-08T00:40:11 2022-11-08T00:37:31 Rev1 None :Container Parameters (jsonschema checker):
UMBCb 0.69315 0.0 0.25 0.5 60.27 2022-10-17T14:50:22 2022-10-17T14:46:23 Rev1 None None
UMBCb 0.69315 0.0 0.25 0.5 60.01 2022-10-17T16:20:21 2022-10-17T16:16:54 Rev1 None None
UMBCb 0.69315 0.0 0.25 0.5 60.11 2022-10-17T17:10:22 2022-10-17T17:02:12 Rev1 None None
UMBCb 0.43737 0.21442 0.14229 0.83333 135.39 2022-10-17T18:20:22 2022-10-17T18:16:50 Rev1 None None

Required filename format: "object-detection-aug2022_holdout_<Submission Name>.simg"
Accepting submissions: False
Number of models in object-detection-aug2022, holdout: 144
Execution timeout (hh:mm:ss): 1 day, 12:00:00

Teams/Jobs

Team Submission Timestamp Type Job Status File Status General Status File Timestamp Time until next execution
Perspecta performer None None Ok 2022-09-20T19:53:19 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI performer None None Ok 2022-09-23T05:32:01 0 d, 0 h, 0 m, 0 s
DRAFFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
PL-GIFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers performer None None Ok None 0 d, 0 h, 0 m, 0 s
Perspecta-IUB performer None None Ok 2022-09-20T19:16:36 0 d, 0 h, 0 m, 0 s
ARM-UCSD performer None None Ok None 0 d, 0 h, 0 m, 0 s
ARM performer None None Ok None 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU performer None None Ok None 0 d, 0 h, 0 m, 0 s
ARM-UMBC performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-1 performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-2 performer None None Ok None 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU performer None None Ok None 0 d, 0 h, 0 m, 0 s
trojai-example public None None Ok None 0 d, 0 h, 0 m, 0 s
IceTorch public None None Ok None 0 d, 0 h, 0 m, 0 s
trojaicy public None None Ok None 0 d, 0 h, 0 m, 0 s
Hector public None None Ok None 0 d, 0 h, 0 m, 0 s
Cassandra-XF public None None Ok None 0 d, 0 h, 0 m, 0 s
gooddefense public None None Ok None 0 d, 0 h, 0 m, 0 s
cyberinfrastructure public None None Ok None 0 d, 0 h, 0 m, 0 s
glaros public None None Ok None 0 d, 0 h, 0 m, 0 s
Ultraman public None None Ok None 0 d, 0 h, 0 m, 0 s
BackSec public None None Ok None 0 d, 0 h, 0 m, 0 s
Palladium public None None Ok None 0 d, 0 h, 0 m, 0 s
IIECAS public None None Ok None 0 d, 0 h, 0 m, 0 s
NSEC public None None Ok None 0 d, 0 h, 0 m, 0 s
UMBCb performer None None Ok None 0 d, 0 h, 0 m, 0 s
PASS public None None Ok None 0 d, 0 h, 0 m, 0 s
DS3TwoSixZero public None None Ok None 0 d, 0 h, 0 m, 0 s
dongdong4fei public None None Ok None 0 d, 0 h, 0 m, 0 s

Best Results based on Cross Entropy

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
TrinitySRITrojAI 0.34193 0.09211 0.11231 0.92785 9247.52 2022-08-27T06:00:01 2022-08-27T05:58:46 Rev1 :Executed File Update: :Cleanup:
ICSI-2 0.33164 0.09464 0.10578 0.9457 1665.71 2022-08-23T05:50:01 2022-08-23T00:03:15 Rev1 :Executed File Update: None
Perspecta-PurdueRutgers 0.29129 0.13131 0.07822 0.92033 51374.46 2022-08-21T20:10:01 2022-08-21T20:01:40 Rev1 :Executed File Update: None
PL-GIFT 0.35137 0.06594 0.11234 0.92921 1521.68 2022-09-09T00:20:02 2022-09-08T23:46:27 Rev1 :Executed File Update: None
Perspecta 0.3146 0.07024 0.09687 0.93403 53539.44 2022-09-20T20:00:03 2022-09-20T19:53:19 Rev1 None :Cleanup:
TrinitySRITrojAI-SBU 0.38251 0.05547 0.11542 0.93287 3312.27 2022-09-04T19:40:01 2022-09-04T15:36:46 Rev1 :Executed File Update: None
Perspecta-IUB 0.33807 0.07182 0.11561 0.92024 2800.66 2022-09-02T11:00:02 2022-09-02T05:24:14 Rev1 :Executed File Update: None
TrinitySRITrojAI-BostonU 0.46373 0.07871 0.15107 0.86121 4846.82 2022-08-25T14:00:01 2022-08-25T13:50:19 Rev1 :Executed File Update: None

All Results

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
TrinitySRITrojAI 0.46254 0.07874 0.15057 0.86265 5302.79 2022-07-28T03:50:01 2022-07-28T03:46:36 Rev1 :Executed File Update: :Cleanup:
TrinitySRITrojAI 0.55614 0.16702 0.16426 0.84606 4994.49 2022-08-01T20:00:01 2022-08-01T19:51:21 Rev1 :Executed File Update: :Cleanup:
TrinitySRITrojAI 0.39268 0.08522 0.12732 0.90181 3501.73 2022-08-08T23:10:01 2022-08-08T23:08:01 Rev1 :Executed File Update: :Cleanup:
TrinitySRITrojAI 0.38327 0.06971 0.11866 0.9158 9072.04 2022-08-11T06:50:02 2022-08-11T06:41:58 Rev1 :Executed File Update: :Cleanup:
TrinitySRITrojAI 0.34193 0.09211 0.11231 0.92785 9247.52 2022-08-27T06:00:01 2022-08-27T05:58:46 Rev1 :Executed File Update: :Cleanup:
TrinitySRITrojAI 0.37083 0.10742 0.11905 0.9239 9210.02 2022-09-07T04:50:02 2022-09-07T04:34:50 Rev1 :Executed File Update: :Cleanup:
TrinitySRITrojAI 0.38787 0.10167 0.12221 0.89988 15769.88 2022-09-09T20:00:01 2022-09-09T19:54:15 Rev1 :Executed File Update: :Cleanup:
TrinitySRITrojAI 0.38999 0.10317 0.12272 0.90866 15906.08 2022-09-23T05:40:05 2022-09-23T05:32:01 Rev1 None :Cleanup:
ICSI-2 0.48649 0.06557 0.1607 0.894 1524.68 2022-07-28T21:00:02 2022-07-28T20:56:51 Rev1 :Executed File Update: :Container Parameters (jsonschema checker):
ICSI-2 0.40334 0.08355 0.12805 0.9076 1624.97 2022-07-29T23:20:01 2022-07-29T23:12:21 Rev1 :Executed File Update: None
ICSI-2 0.38377 0.07245 0.1197 0.92747 1590.65 2022-08-03T03:20:01 2022-08-03T03:17:09 Rev1 :Executed File Update: None
ICSI-2 0.37457 0.07378 0.11572 0.92853 1637.77 2022-08-05T00:40:01 2022-08-05T00:39:34 Rev1 :Executed File Update: None
ICSI-2 0.35959 0.07624 0.11021 0.93895 1733.94 2022-08-09T01:00:01 2022-08-09T00:52:50 Rev1 :Executed File Update: None
ICSI-2 0.34165 0.09282 0.10993 0.94358 1646.77 2022-08-09T07:00:02 2022-08-09T05:59:27 Rev1 :Executed File Update: None
ICSI-2 0.52083 0.21233 0.13648 0.92978 1772.23 2022-08-09T23:50:01 2022-08-09T23:47:56 Rev1 :Executed File Update: None
ICSI-2 0.34975 0.10279 0.11354 0.93981 1681.95 2022-08-10T22:50:02 2022-08-10T22:12:01 Rev1 :Executed File Update: None
ICSI-2 0.34379 0.09267 0.11025 0.9428 1637.77 2022-08-11T05:30:02 2022-08-11T05:29:28 Rev1 :Executed File Update: None
ICSI-2 0.35473 0.10238 0.11388 0.93818 1765.15 2022-08-11T21:30:01 2022-08-11T21:22:33 Rev1 :Executed File Update: None
ICSI-2 0.34055 0.08735 0.1068 0.93972 2086.22 2022-08-16T14:50:01 2022-08-16T14:49:40 Rev1 :Executed File Update: None
ICSI-2 0.34224 0.09618 0.11019 0.94252 1689.84 2022-08-22T23:50:01 2022-08-22T23:41:20 Rev1 :Executed File Update: None
ICSI-2 0.33164 0.09464 0.10578 0.9457 1665.71 2022-08-23T05:50:01 2022-08-23T00:03:15 Rev1 :Executed File Update: None
ICSI-2 0.34175 0.08927 0.10837 0.94232 1775.17 2022-08-23T11:50:01 2022-08-23T07:14:37 Rev1 :Executed File Update: None
ICSI-2 0.33198 0.09391 0.10664 0.94599 1934.52 2022-09-02T10:10:01 2022-09-02T10:03:39 Rev1 :Executed File Update: None
Perspecta-PurdueRutgers 0.35093 0.11059 0.09703 0.87789 52594.69 2022-07-29T01:00:02 2022-07-29T00:52:14 Rev1 :Executed File Update: None
Perspecta-PurdueRutgers 0.34166 0.11264 0.09257 0.87539 52752.66 2022-08-19T23:20:01 2022-08-19T23:13:07 Rev1 :Executed File Update: None
Perspecta-PurdueRutgers 0.32377 0.11454 0.08314 0.87558 52821.91 2022-08-20T21:40:02 2022-08-20T21:32:11 Rev1 :Executed File Update: None
Perspecta-PurdueRutgers 0.29129 0.13131 0.07822 0.92033 51374.46 2022-08-21T20:10:01 2022-08-21T20:01:40 Rev1 :Executed File Update: None
PL-GIFT 0.37879 0.10794 0.1179 0.91204 2495.98 2022-08-09T03:50:01 2022-08-09T03:42:13 Rev1 :Executed File Update: :Container Parameters (jsonschema checker)::Cleanup:
PL-GIFT 0.44755 0.13221 0.13604 0.89159 2489.37 2022-08-20T16:30:02 2022-08-20T16:24:23 Rev1 :Executed File Update: :Container Parameters (jsonschema checker)::Cleanup:
PL-GIFT 0.46114 0.13969 0.14312 0.90191 2440.2 2022-09-03T16:20:02 2022-09-03T16:16:06 Rev1 :Executed File Update: :Container Parameters (jsonschema checker)::Cleanup:
PL-GIFT 0.49975 0.12266 0.16015 0.88185 2352.8 2022-09-03T22:20:02 2022-09-03T18:33:34 Rev1 :Executed File Update: :Container Parameters (jsonschema checker):
PL-GIFT 0.38056 0.07568 0.12486 0.91435 1423.4 2022-09-07T20:40:02 2022-09-07T20:32:17 Rev1 :Executed File Update: None
PL-GIFT 0.35618 0.06955 0.11671 0.91744 1506.59 2022-09-08T18:20:02 2022-09-08T18:17:57 Rev1 :Executed File Update: None
PL-GIFT 0.35137 0.06594 0.11234 0.92921 1521.68 2022-09-09T00:20:02 2022-09-08T23:46:27 Rev1 :Executed File Update: None
Perspecta 0.41019 0.07279 0.1261 0.87307 51947.72 2022-09-05T06:40:01 2022-09-05T06:32:24 Rev1 :Executed File Update: :Cleanup:
Perspecta 0.39859 0.06019 0.12254 0.91001 53091.01 2022-09-07T23:40:01 2022-09-07T23:39:31 Rev1 :Executed File Update: :Cleanup:
Perspecta 0.37932 0.07821 0.12492 0.88069 53263.27 2022-09-08T13:00:01 2022-09-08T12:57:41 Rev1 :Executed File Update: :Cleanup:
Perspecta 0.31846 0.0604 0.0964 0.93682 54015.82 2022-09-08T23:40:02 2022-09-08T23:32:13 Rev1 :Executed File Update: :Cleanup:
Perspecta 0.3146 0.07024 0.09687 0.93403 53539.44 2022-09-20T20:00:03 2022-09-20T19:53:19 Rev1 None :Cleanup:
TrinitySRITrojAI-SBU 0.47247 0.05356 0.15479 0.9103 2877.61 2022-09-02T23:50:02 2022-09-02T23:49:32 Rev1 :Executed File Update: None
TrinitySRITrojAI-SBU 0.48047 0.06418 0.15882 0.89323 1566.92 2022-09-03T16:40:02 2022-09-03T16:32:39 Rev1 :Executed File Update: None
TrinitySRITrojAI-SBU 0.38251 0.05547 0.11542 0.93287 3312.27 2022-09-04T19:40:01 2022-09-04T15:36:46 Rev1 :Executed File Update: None
TrinitySRITrojAI-SBU 0.41837 0.06148 0.12781 0.90856 1913.21 2022-09-05T04:20:01 2022-09-05T04:10:52 Rev1 :Executed File Update: None
Perspecta-IUB 0.39707 0.07793 0.13217 0.89728 2724.53 2022-08-21T01:10:01 2022-08-21T01:09:36 Rev1 :Executed File Update: None
Perspecta-IUB 0.39766 0.07717 0.13371 0.89448 3329.47 2022-08-21T07:10:02 2022-08-21T04:43:25 Rev1 :Executed File Update: None
Perspecta-IUB 0.39908 0.0848 0.1358 0.89448 3300.45 2022-08-21T13:20:01 2022-08-21T10:35:53 Rev1 :Executed File Update: None
Perspecta-IUB 0.39354 0.0924 0.13299 0.90008 3196.38 2022-08-21T19:20:02 2022-08-21T16:09:32 Rev1 :Executed File Update: None
Perspecta-IUB 0.39662 0.07565 0.13317 0.89497 3135.08 2022-08-22T15:50:01 2022-08-22T15:44:02 Rev1 :Executed File Update: None
Perspecta-IUB 0.40333 0.10126 0.13752 0.89757 2585.21 2022-08-22T21:50:01 2022-08-22T17:33:07 Rev1 :Executed File Update: None
Perspecta-IUB 0.47426 0.14006 0.15223 0.89159 2808.51 2022-09-01T21:00:02 2022-09-01T20:53:07 Rev1 :Executed File Update: None
Perspecta-IUB 0.34869 0.07776 0.12052 0.9159 2847.77 2022-09-02T05:00:01 2022-09-02T04:52:07 Rev1 :Executed File Update: None
Perspecta-IUB 0.33807 0.07182 0.11561 0.92024 2800.66 2022-09-02T11:00:02 2022-09-02T05:24:14 Rev1 :Executed File Update: None
Perspecta-IUB 0.38533 0.10376 0.13302 0.90992 2797.7 2022-09-02T17:00:02 2022-09-02T14:32:45 Rev1 :Executed File Update: None
Perspecta-IUB 0.38954 0.10647 0.13406 0.90924 2883.67 2022-09-03T00:30:02 2022-09-03T00:23:40 Rev1 :Executed File Update: None
Perspecta-IUB 0.3635 0.0833 0.12673 0.9102 4471.47 2022-09-03T06:30:02 2022-09-03T04:12:11 Rev1 :Executed File Update: None
Perspecta-IUB 0.36022 0.08343 0.12573 0.91252 4553.35 2022-09-20T19:20:07 2022-09-20T19:16:36 Rev1 None None
TrinitySRITrojAI-BostonU 0.46472 0.07862 0.15138 0.86034 4904.72 2022-08-23T14:30:01 2022-08-23T14:21:31 Rev1 :Executed File Update: None
TrinitySRITrojAI-BostonU 0.49977 0.09807 0.16339 0.83922 4879.33 2022-08-23T20:30:01 2022-08-23T17:55:58 Rev1 :Executed File Update: None
TrinitySRITrojAI-BostonU 0.50821 0.05585 0.16422 0.85774 4924.92 2022-08-24T02:30:01 2022-08-24T00:09:32 Rev1 :Executed File Update: None
TrinitySRITrojAI-BostonU 0.46531 0.07855 0.15148 0.86053 4919.53 2022-08-24T15:50:02 2022-08-24T15:42:02 Rev1 :Executed File Update: None
TrinitySRITrojAI-BostonU 0.46373 0.07871 0.15107 0.86121 4846.82 2022-08-25T14:00:01 2022-08-25T13:50:19 Rev1 :Executed File Update: None

Required filename format: "object-detection-aug2022_dev_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-aug2022, dev: 144
Execution timeout (hh:mm:ss): 1 day, 0:00:00

Teams/Jobs

Team Submission Timestamp Type Job Status File Status General Status File Timestamp Time until next execution
Perspecta performer None None Ok None 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI performer None None Ok None 0 d, 0 h, 0 m, 0 s
DRAFFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
PL-GIFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers performer None None Ok None 0 d, 0 h, 0 m, 0 s
Perspecta-IUB performer None None Ok None 0 d, 0 h, 0 m, 0 s
ARM-UCSD performer None None Ok None 0 d, 0 h, 0 m, 0 s
ARM performer None None Ok None 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU performer None None Ok None 0 d, 0 h, 0 m, 0 s
ARM-UMBC performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-1 performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-2 performer None None Ok None 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU performer None None Ok None 0 d, 0 h, 0 m, 0 s
trojai-example public None None Ok None 0 d, 0 h, 0 m, 0 s
IceTorch public None None Ok None 0 d, 0 h, 0 m, 0 s
trojaicy public None None Ok None 0 d, 0 h, 0 m, 0 s
Hector public None None Ok None 0 d, 0 h, 0 m, 0 s
Cassandra-XF public None None Ok None 0 d, 0 h, 0 m, 0 s
gooddefense public None None Ok None 0 d, 0 h, 0 m, 0 s
cyberinfrastructure public None None Ok None 0 d, 0 h, 0 m, 0 s
glaros public None None Ok None 0 d, 0 h, 0 m, 0 s
Ultraman public None None Ok None 0 d, 0 h, 0 m, 0 s
BackSec public None None Ok None 0 d, 0 h, 0 m, 0 s
Palladium public None None Ok None 0 d, 0 h, 0 m, 0 s
IIECAS public None None Ok None 0 d, 0 h, 0 m, 0 s
NSEC public None None Ok None 0 d, 0 h, 0 m, 0 s
UMBCb performer None None Ok None 0 d, 0 h, 0 m, 0 s
PASS public None None Ok None 0 d, 0 h, 0 m, 0 s
DS3TwoSixZero public None None Ok None 0 d, 0 h, 0 m, 0 s
dongdong4fei public None None Ok None 0 d, 0 h, 0 m, 0 s

Best Results based on Cross Entropy

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors

All Results

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors

Round 11 leaderboard for image classification September 2022.

Each AI is trained to perform image classification. For those AIs that have been attacked, the presence of the trigger pattern will cause the AI to reliably produce the wrong prediction. The Round 11 Training Data Download consists of 288 reference AIs (exactly 50% are poisoned) with example input data. More info here.

Polygon Trigger on Street Sign

Example poisoned image, where the purple polygon trigger on the street sign causes misclassification.

train: The train dataset that is distributed with each round.
test: The test dataset that is sequestered/hidden, used for evaluation. Submissions here should be fully realized with complete schema and parameters.
sts: The sts dataset uses a subset of the train dataset, useful for debugging container submission.
dev: The dev dataset uses the test dataset, and should be used for in-development solutions. Schemas must be valid, but do not need to be complete. Results do not count towards the program.

Required filename format: "image-classification-sep2022_train_<Submission Name>.simg"
Accepting submissions: True
Number of models in image-classification-sep2022, train: 288
Execution timeout (hh:mm:ss): 2 days, 0:00:00

Teams/Jobs

Team Submission Timestamp Type Job Status File Status General Status File Timestamp Time until next execution
Perspecta 2022-12-16T20:20:05 performer None None Ok 2022-12-16T20:11:50 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI 2023-02-11T00:50:06 performer None None Ok 2023-02-11T00:41:33 0 d, 0 h, 0 m, 0 s
DRAFFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
PL-GIFT 2022-12-20T19:08:06 performer None None Ok 2022-12-20T18:19:32 0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers 2023-02-14T15:40:09 performer None None Ok 2023-02-14T15:35:48 0 d, 0 h, 0 m, 0 s
Perspecta-IUB 2022-10-15T04:00:30 performer None None Ok 2022-10-14T21:09:47 0 d, 0 h, 0 m, 0 s
ARM-UCSD 2022-12-13T20:02:37 performer None None Ok 2022-12-13T18:42:57 0 d, 0 h, 0 m, 0 s
ARM 2023-04-04T18:00:16 performer None None Ok 2023-04-04T18:00:08 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU 2022-12-14T22:01:34 performer None None Ok 2022-12-14T21:06:01 0 d, 0 h, 0 m, 0 s
ARM-UMBC performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-1 performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-2 2022-12-15T07:10:21 performer None None Ok 2022-12-15T07:07:27 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU 2023-01-20T21:40:24 performer None None Ok 2023-01-20T21:31:11 0 d, 0 h, 0 m, 0 s
trojai-example 2022-09-21T17:30:13 public None None Ok 2022-09-21T17:28:50 0 d, 0 h, 0 m, 0 s
IceTorch public None None Ok None 0 d, 0 h, 0 m, 0 s
trojaicy public None None Ok None 0 d, 0 h, 0 m, 0 s
Hector public None None Ok None 0 d, 0 h, 0 m, 0 s
Cassandra-XF public None None Ok None 0 d, 0 h, 0 m, 0 s
gooddefense public None None Ok None 0 d, 0 h, 0 m, 0 s
cyberinfrastructure public None None Ok None 0 d, 0 h, 0 m, 0 s
glaros public None None Ok None 0 d, 0 h, 0 m, 0 s
Ultraman public None None Ok None 0 d, 0 h, 0 m, 0 s
BackSec public None None Ok None 0 d, 0 h, 0 m, 0 s
Palladium public None None Ok None 0 d, 0 h, 0 m, 0 s
IIECAS 2022-12-01T15:01:55 public None None Ok 2022-12-01T13:44:48 0 d, 0 h, 0 m, 0 s
NSEC public None None Ok None 0 d, 0 h, 0 m, 0 s
UMBCb 2022-11-04T14:43:29 performer None None Ok 2022-11-03T20:20:40 0 d, 0 h, 0 m, 0 s
PASS public None None Ok None 0 d, 0 h, 0 m, 0 s
DS3TwoSixZero public None None Ok None 0 d, 0 h, 0 m, 0 s
dongdong4fei public None None Ok None 0 d, 0 h, 0 m, 0 s

Best Results based on Cross Entropy

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.00676 0.00086 0.0001 1.0 2981.53 2022-12-15T22:10:05 2022-12-15T21:55:42 Rev1 None None
TrinitySRITrojAI 0.26087 0.03077 0.0695 0.98257 19119.35 2023-02-11T00:50:06 2023-02-11T00:41:33 Rev1 None None
PL-GIFT 0.0119 0.001 0.00021 1.0 2596.85 2022-12-15T15:50:08 2022-12-15T15:46:42 Rev1 None None
Perspecta-PurdueRutgers 0.0059 0.00281 0.00056 1.0 4245.64 2023-02-12T22:30:08 2023-02-12T22:25:15 Rev1 None None
Perspecta-IUB 0.01537 0.0062 0.00234 1.0 42205.08 2022-10-08T02:30:09 2022-10-08T02:23:53 Rev1 None None
ARM-UCSD 0.45631 0.09297 0.13778 0.84028 5883.57 2022-10-07T18:20:09 2022-10-07T18:15:51 Rev1 None None
ARM 0.36728 0.059 0.11325 0.92089 2487.37 2023-04-04T18:00:16 2023-04-04T18:00:08 Rev1 None None
TrinitySRITrojAI-SBU 0.12277 0.00989 0.01743 1.0 3874.3 2022-12-14T22:01:34 2022-12-14T21:06:01 Rev1 None None
ICSI-2 0.01882 0.00204 0.00064 1.0 3748.12 2022-11-14T23:30:19 2022-11-14T23:23:54 Rev1 None None
TrinitySRITrojAI-BostonU 0.27732 0.09457 0.07082 0.94637 5473.0 2022-12-06T22:10:22 2022-12-06T22:08:09 Rev1 None None
trojai-example 0.95798 0.09962 0.32408 0.47912 3412.55 2022-09-21T17:30:13 2022-09-21T17:28:50 Rev1 None None
IIECAS 0.69315 0.0 0.25 0.5 14666.41 2022-11-29T02:30:30 2022-11-29T02:30:04 Rev1 :No Results: None
UMBCb 0.49955 0.02726 0.16128 0.89157 3656.39 2022-10-31T19:10:23 2022-10-31T19:00:37 Rev1 None None

All Results

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.6652 0.04391 0.23816 0.64374 2984.18 2022-10-13T03:30:03 2022-10-13T03:20:12 Rev1 None None
Perspecta 0.80193 0.1474 0.237 0.70083 2855.94 2022-10-18T05:20:03 2022-10-18T05:11:57 Rev1 :Container File Missing: None
Perspecta 1.33425 0.17995 0.38552 0.50388 2720.75 2022-10-18T17:30:03 2022-10-18T17:23:07 Rev1 :Container File Missing: None
Perspecta 0.65184 0.04655 0.23064 0.65635 2715.51 2022-10-19T00:00:04 2022-10-18T23:56:57 Rev1 :Container File Missing: None
Perspecta 0.62086 0.04185 0.21855 0.69739 2720.72 2022-10-19T18:10:04 2022-10-19T18:02:05 Rev1 :Container File Missing: None
Perspecta 0.62212 0.04065 0.21871 0.69307 2697.39 2022-10-19T21:00:04 2022-10-19T20:53:59 Rev1 :Container File Missing: None
Perspecta 0.59835 0.04744 0.20777 0.74074 2698.45 2022-10-19T23:40:03 2022-10-19T23:33:06 Rev1 :Container File Missing: None
Perspecta 0.21427 0.05219 0.06112 0.97234 2831.66 2022-10-26T14:40:04 2022-10-26T14:32:03 Rev1 :Container File Missing: None
Perspecta 0.12382 0.03737 0.02857 0.9919 2773.57 2022-10-27T00:50:03 2022-10-27T00:44:13 Rev1 :Container File Missing: None
Perspecta 0.26149 0.12254 0.04851 0.96945 2764.53 2022-10-27T04:20:03 2022-10-27T04:15:11 Rev1 :Container File Missing: None
Perspecta 0.18326 0.04828 0.05197 0.9816 2785.87 2022-10-27T15:40:04 2022-10-27T15:38:34 Rev1 :Container File Missing: None
Perspecta 0.09854 0.03075 0.02451 0.99785 2762.58 2022-10-28T23:30:03 2022-10-28T23:22:21 Rev1 :Container File Missing: None
Perspecta 0.11793 0.03488 0.03162 0.99696 2807.55 2022-11-02T18:04:43 2022-11-02T17:56:09 Rev1 None None
Perspecta 0.11007 0.03466 0.02755 0.99614 2864.94 2022-11-07T21:10:05 2022-11-07T21:04:58 Rev1 None None
Perspecta 0.09311 0.03294 0.02288 0.99725 2842.02 2022-11-15T04:00:04 2022-11-15T03:50:54 Rev1 None None
Perspecta 0.07973 0.0299 0.02103 0.99916 2874.05 2022-11-16T01:20:04 2022-11-16T01:16:33 Rev1 None None
Perspecta 0.05764 0.01556 0.01155 1.0 2874.81 2022-11-16T19:00:04 2022-11-16T18:58:52 Rev1 None None
Perspecta 0.09848 0.03445 0.02498 0.99749 2866.06 2022-11-16T21:10:04 2022-11-16T21:09:20 Rev1 None None
Perspecta 0.10029 0.01762 0.0194 1.0 2884.42 2022-11-17T22:30:04 2022-11-17T22:23:07 Rev1 None None
Perspecta 0.09066 0.03062 0.02072 0.99904 2881.75 2022-11-22T05:20:04 2022-11-22T05:17:14 Rev1 None None
Perspecta 0.10967 0.03244 0.02618 0.99508 2700.33 2022-11-22T07:30:04 2022-11-22T07:22:56 Rev1 None None
Perspecta 0.06669 0.01045 0.00978 1.0 14760.75 2022-11-29T07:40:04 2022-11-29T07:38:19 Rev1 None None
Perspecta 0.08064 0.02369 0.01815 0.99959 14762.07 2022-11-29T15:50:05 2022-11-29T15:43:06 Rev1 None None
Perspecta 0.06829 0.02055 0.01398 1.0 14762.68 2022-11-30T20:00:04 2022-11-30T19:50:09 Rev1 None None
Perspecta 0.08309 0.00683 0.00886 1.0 14907.68 2022-12-01T05:20:04 2022-12-01T05:16:29 Rev1 None None
Perspecta 0.08545 0.00708 0.00926 1.0 15082.17 2022-12-01T16:50:09 2022-12-01T16:48:02 Rev1 None None
Perspecta 0.08545 0.00708 0.00926 1.0 3681.39 2022-12-04T00:00:05 2022-12-02T03:25:52 Rev1 None None
Perspecta 0.08577 0.00682 0.00912 1.0 4218.69 2022-12-05T20:20:04 2022-12-05T20:15:11 Rev1 None None
Perspecta 0.07317 0.00588 0.00686 1.0 3549.95 2022-12-06T22:20:04 2022-12-06T22:10:11 Rev1 None None
Perspecta 0.06083 0.00526 0.00506 1.0 3550.17 2022-12-07T17:00:04 2022-12-07T16:55:59 Rev1 None None
Perspecta 0.06199 0.0053 0.00519 1.0 3540.36 2022-12-08T16:00:05 2022-12-08T15:58:05 Rev1 None None
Perspecta 0.07189 0.00577 0.00661 1.0 3559.78 2022-12-13T04:50:05 2022-12-13T04:43:43 Rev1 None None
Perspecta 0.07189 0.00577 0.00661 1.0 3790.52 2022-12-13T06:40:04 2022-12-13T06:33:35 Rev1 None None
Perspecta 0.05412 0.00591 0.00463 1.0 3838.64 2022-12-13T16:00:04 2022-12-13T15:56:25 Rev1 None None
Perspecta 0.69315 0.0 0.25 0.5 2022-12-13T21:50:05 2022-12-13T20:15:00 Rev1 :No Results::Info File Missing::Container File Missing: None
Perspecta 0.69315 0.0 0.25 0.5 2022-12-14T00:40:04 2022-12-14T00:39:29 Rev1 :No Results::Info File Missing::Container File Missing: None
Perspecta 0.15641 0.0192 0.03243 0.99932 3869.33 2022-12-14T17:30:05 2022-12-14T17:24:00 Rev1 None None
Perspecta 0.07129 0.00614 0.00674 1.0 3795.97 2022-12-14T19:00:05 2022-12-14T18:55:54 Rev1 None None
Perspecta 0.06694 0.00561 0.00592 1.0 3547.04 2022-12-15T01:20:05 2022-12-15T01:18:57 Rev1 None None
Perspecta 0.00711 0.00099 0.00012 1.0 2981.85 2022-12-15T06:20:04 2022-12-15T06:11:21 Rev1 None None
Perspecta 0.00676 0.00086 0.0001 1.0 2981.53 2022-12-15T22:10:05 2022-12-15T21:55:42 Rev1 None None
Perspecta 0.00827 0.00154 0.00023 1.0 2981.53 2022-12-16T15:10:05 2022-12-16T15:00:48 Rev1 None None
Perspecta 0.00683 0.00104 0.00012 1.0 2983.06 2022-12-16T20:20:05 2022-12-16T20:11:50 Rev1 None None
TrinitySRITrojAI 0.32043 0.02606 0.08708 0.9809 9235.16 2022-09-30T20:50:05 2022-09-30T20:43:42 Rev1 None None
TrinitySRITrojAI 0.54917 0.02553 0.18469 0.85156 9342.89 2022-10-07T08:40:06 2022-10-07T08:37:36 Rev1 None None
TrinitySRITrojAI 0.49442 0.05732 0.16598 0.81554 25912.92 2022-10-08T05:20:06 2022-10-08T05:19:38 Rev1 None None
TrinitySRITrojAI 0.47598 0.05011 0.16215 0.81542 58631.5 2022-10-17T08:50:06 2022-10-17T08:43:17 Rev1 :Container File Missing: None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 2511.06 2022-11-17T18:50:05 2022-11-17T18:40:23 Rev1 :No Results: None
TrinitySRITrojAI 0.58453 0.05725 0.19929 0.76078 64127.18 2022-11-18T00:00:55 2022-11-17T23:59:38 Rev1 None None
TrinitySRITrojAI 0.50605 0.07226 0.16571 0.83341 115875.25 2022-12-13T01:10:06 2022-12-13T01:04:46 Rev1 None None
TrinitySRITrojAI 0.33744 0.05843 0.10514 0.92361 170469.96 2023-01-18T17:20:06 2023-01-18T17:13:22 Rev1 None None
TrinitySRITrojAI 0.26087 0.03077 0.0695 0.98257 19119.35 2023-02-11T00:50:06 2023-02-11T00:41:33 Rev1 None None
PL-GIFT 0.05384 0.00709 0.00561 1.0 1936.0 2022-09-23T22:10:06 2022-09-23T22:01:36 Rev1 None None
PL-GIFT 0.69315 0.0 0.25 0.5 2022-10-12T15:10:08 2022-10-12T15:01:57 Rev1 :Info File Missing::Container File Missing: None
PL-GIFT 0.06802 0.00735 0.00743 1.0 15352.97 2022-10-13T12:00:07 2022-10-13T11:55:39 Rev1 None None
PL-GIFT 0.05165 0.01306 0.00939 1.0 1922.36 2022-10-14T18:20:08 2022-10-14T18:18:21 Rev1 None None
PL-GIFT 0.05165 0.01306 0.00939 1.0 1914.95 2022-10-15T05:10:18 2022-10-15T01:10:08 Rev1 None None
PL-GIFT 0.04584 0.01273 0.00858 1.0 2499.8 2022-10-25T23:40:07 2022-10-25T23:31:47 Rev1 :Container File Missing: None
PL-GIFT 0.10749 0.02444 0.02664 0.99993 2016.56 2022-11-04T23:30:07 2022-11-04T23:20:37 Rev1 None None
PL-GIFT 0.03642 0.01337 0.00779 0.99983 2499.44 2022-11-07T17:10:08 2022-11-07T17:10:02 Rev1 None None
PL-GIFT 0.1386 0.0348 0.03823 0.9891 2483.46 2022-11-09T23:10:08 2022-11-09T23:03:07 Rev1 None None
PL-GIFT 0.02219 0.00408 0.00143 1.0 2494.6 2022-11-11T19:20:07 2022-11-11T19:19:08 Rev1 None None
PL-GIFT 0.02552 0.0107 0.00512 1.0 2494.44 2022-11-11T23:10:07 2022-11-11T23:09:05 Rev1 None None
PL-GIFT 0.69315 0.0 0.25 0.5 2022-11-15T17:40:09 2022-11-15T17:33:52 Rev1 :No Results::Info File Missing::Container File Missing: None
PL-GIFT 0.69315 0.0 0.25 0.5 2022-11-15T20:20:45 2022-11-15T20:17:08 Rev1 :No Results::Info File Missing::Container File Missing: None
PL-GIFT 0.06478 0.02366 0.01772 0.99995 2465.8 2022-11-15T23:50:08 2022-11-15T23:45:59 Rev1 None None
PL-GIFT 0.0119 0.001 0.00021 1.0 2596.85 2022-12-15T15:50:08 2022-12-15T15:46:42 Rev1 None None
PL-GIFT 0.0119 0.001 0.00021 1.0 2682.49 2022-12-20T19:08:06 2022-12-20T18:19:32 Rev1 None None
Perspecta-PurdueRutgers 0.3668 0.08189 0.10528 0.88129 100934.45 2022-10-03T08:20:08 2022-10-03T08:18:13 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.39643 0.08497 0.11582 0.871 101643.48 2022-10-04T22:40:07 2022-10-04T22:39:49 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.39643 0.08497 0.11582 0.871 101635.92 2022-10-06T23:30:22 2022-10-05T19:54:06 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.43815 0.08725 0.13387 0.87461 66302.31 2022-10-14T10:00:08 2022-10-14T09:52:56 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.46545 0.09003 0.14429 0.86574 126878.95 2022-10-15T15:20:09 2022-10-15T15:12:56 Rev1 :Container File Missing: :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.25688 0.07209 0.06897 0.9396 76308.23 2022-10-18T06:50:22 2022-10-18T06:41:35 Rev1 :Container File Missing: :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.29374 0.06724 0.07936 0.92559 78379.77 2022-10-24T01:40:09 2022-10-24T01:34:56 Rev1 :Container File Missing: :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.43148 0.02807 0.13377 0.92836 2981.71 2022-11-04T15:20:09 2022-11-04T15:17:23 Rev1 None None
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.91194 2022-11-04T20:40:10 2022-11-04T20:30:10 Rev1 :No Results::Info File Missing::Container File Missing: None
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.9362 2022-11-06T21:00:08 2022-11-06T20:52:56 Rev1 :No Results::Info File Missing::Container File Missing: None
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 2022-11-08T19:40:09 2022-11-08T19:33:41 Rev1 :No Results::Info File Missing::Container File Missing: None
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 2022-11-11T17:20:08 2022-11-11T17:17:24 Rev1 :No Results::Info File Missing::Container File Missing: None
Perspecta-PurdueRutgers 0.43884 0.06778 0.14517 0.87389 2567.7 2022-11-15T23:30:10 2022-11-15T23:21:05 Rev1 None None
Perspecta-PurdueRutgers 0.93707 0.45288 0.14834 0.85335 2553.35 2022-11-16T05:00:08 2022-11-16T04:53:47 Rev1 None None
Perspecta-PurdueRutgers 0.45463 0.06882 0.14889 0.86601 2549.1 2022-11-16T16:40:09 2022-11-16T16:36:52 Rev1 None None
Perspecta-PurdueRutgers 0.43417 0.07036 0.14703 0.86601 2561.35 2022-11-17T02:00:07 2022-11-17T01:55:49 Rev1 None None
Perspecta-PurdueRutgers 0.43178 0.07048 0.14644 0.86601 2502.94 2022-11-17T03:10:07 2022-11-17T03:09:26 Rev1 None None
Perspecta-PurdueRutgers 0.41234 0.06165 0.14182 0.86789 2556.15 2022-11-17T04:41:19 2022-11-17T04:34:55 Rev1 None None
Perspecta-PurdueRutgers 0.43116 0.04782 0.14813 0.85214 2508.91 2022-11-19T00:30:08 2022-11-18T21:26:33 Rev1 None None
Perspecta-PurdueRutgers 0.42961 0.04791 0.14768 0.85214 2506.02 2022-11-19T02:01:15 2022-11-19T01:55:52 Rev1 None None
Perspecta-PurdueRutgers 0.43561 0.04748 0.14917 0.85214 2519.24 2022-11-19T04:20:08 2022-11-19T04:10:44 Rev1 None None
Perspecta-PurdueRutgers 2.2046 0.73973 0.19988 0.79514 2655.9 2022-12-10T03:50:08 2022-12-10T03:46:14 Rev1 None None
Perspecta-PurdueRutgers 0.42526 0.04278 0.14598 0.85581 2648.54 2022-12-10T15:24:54 2022-12-10T14:40:50 Rev1 None None
Perspecta-PurdueRutgers 0.32271 0.04188 0.11464 0.90806 2492.82 2022-12-11T16:40:09 2022-12-11T16:38:53 Rev1 None None
Perspecta-PurdueRutgers 0.34056 0.0408 0.1184 0.90803 2491.88 2022-12-11T18:00:08 2022-12-11T18:00:18 Rev1 None None
Perspecta-PurdueRutgers 0.30558 0.0381 0.10536 0.92704 2981.12 2022-12-11T21:50:09 2022-12-11T21:45:59 Rev1 None None
Perspecta-PurdueRutgers 0.27909 0.03636 0.09492 0.94444 2496.9 2022-12-12T04:00:08 2022-12-12T03:53:37 Rev1 None None
Perspecta-PurdueRutgers 0.34297 0.03023 0.10271 0.94444 2495.89 2022-12-12T06:20:08 2022-12-12T06:15:01 Rev1 None None
Perspecta-PurdueRutgers 0.49666 0.03487 0.17468 0.76365 2497.62 2022-12-12T21:50:09 2022-12-12T21:09:20 Rev1 None None
Perspecta-PurdueRutgers 0.18362 0.1916 0.02894 0.98905 4302.94 2023-02-06T02:00:08 2023-02-06T01:57:01 Rev1 None None
Perspecta-PurdueRutgers 0.48216 0.03681 0.17301 0.76157 3335.57 2023-02-09T21:20:10 2023-02-09T21:15:24 Rev1 None None
Perspecta-PurdueRutgers 0.48547 0.03766 0.17372 0.76374 3390.32 2023-02-09T22:30:10 2023-02-09T22:27:54 Rev1 None None
Perspecta-PurdueRutgers 0.46307 0.0376 0.16676 0.77778 3176.61 2023-02-12T02:30:09 2023-02-12T02:29:10 Rev1 None None
Perspecta-PurdueRutgers 0.46556 0.03723 0.167 0.77778 3641.39 2023-02-12T04:10:09 2023-02-12T04:02:07 Rev1 None None
Perspecta-PurdueRutgers 0.0059 0.00281 0.00056 1.0 4245.64 2023-02-12T22:30:08 2023-02-12T22:25:15 Rev1 None None
Perspecta-PurdueRutgers 0.02781 0.01691 0.00747 0.99986 4209.3 2023-02-13T00:40:09 2023-02-13T00:38:47 Rev1 None None
Perspecta-PurdueRutgers 0.02801 0.01691 0.00749 0.99986 4242.56 2023-02-14T15:40:09 2023-02-14T15:35:48 Rev1 None None
Perspecta-IUB 0.24616 0.0205 0.06302 1.0 49831.94 2022-10-06T23:40:09 2022-10-06T23:35:08 Rev1 None None
Perspecta-IUB 0.23145 0.01981 0.0576 0.99995 41884.97 2022-10-07T14:00:09 2022-10-07T03:35:32 Rev1 None None
Perspecta-IUB 0.01537 0.0062 0.00234 1.0 42205.08 2022-10-08T02:30:09 2022-10-08T02:23:53 Rev1 None None
Perspecta-IUB 0.02305 0.01443 0.00543 0.99981 41364.65 2022-10-08T12:40:31 2022-10-08T04:37:48 Rev1 None None
Perspecta-IUB 0.33401 0.00656 0.08135 0.99995 41703.38 2022-10-08T21:40:30 2022-10-08T18:08:16 Rev1 None None
Perspecta-IUB 0.3314 0.00559 0.08016 1.0 41492.89 2022-10-09T06:30:35 2022-10-08T23:24:10 Rev1 None None
Perspecta-IUB 0.22543 0.01824 0.05413 1.0 42087.76 2022-10-09T17:40:08 2022-10-09T17:30:28 Rev1 None None
Perspecta-IUB 0.16931 0.0255 0.04101 0.99443 44000.76 2022-10-10T02:30:33 2022-10-09T22:35:57 Rev1 None None
Perspecta-IUB 0.10872 0.02994 0.03099 0.9947 42151.94 2022-10-10T15:20:09 2022-10-10T15:11:15 Rev1 None None
Perspecta-IUB 0.12328 0.02697 0.03342 0.9953 5536.52 2022-10-11T00:10:31 2022-10-10T18:15:05 Rev1 None None
Perspecta-IUB 0.18142 0.02512 0.04338 0.99429 5557.0 2022-10-11T02:20:08 2022-10-11T02:13:19 Rev1 None None
Perspecta-IUB 0.16654 0.0229 0.0383 0.9972 6644.42 2022-10-11T03:40:31 2022-10-11T03:02:15 Rev1 None None
Perspecta-IUB 0.17701 0.02285 0.04105 0.99713 6695.53 2022-10-11T17:40:09 2022-10-11T17:23:06 Rev1 None None
Perspecta-IUB 0.69315 0.0 0.25 0.5 2022-10-11T19:20:09 2022-10-11T19:13:18 Rev1 :Info File Missing::Container File Missing: None
Perspecta-IUB 0.20619 0.018 0.0461 0.99988 54700.54 2022-10-12T21:00:20 2022-10-12T18:57:51 Rev1 None None
Perspecta-IUB 0.2183 0.01802 0.05042 0.99995 53655.09 2022-10-13T09:40:24 2022-10-12T23:53:26 Rev1 None None
Perspecta-IUB 0.21104 0.01674 0.04715 1.0 54386.04 2022-10-14T01:50:10 2022-10-13T23:08:43 Rev1 None None
Perspecta-IUB 0.2008 0.01702 0.04374 1.0 54506.62 2022-10-14T13:20:33 2022-10-14T06:51:18 Rev1 None None
Perspecta-IUB 0.19169 0.01818 0.04159 0.9999 54738.46 2022-10-15T04:00:30 2022-10-14T21:09:47 Rev1 None None
ARM-UCSD 0.55305 0.079 0.18167 0.79167 5683.8 2022-10-07T06:10:11 2022-10-07T06:05:34 Rev1 None None
ARM-UCSD 0.45631 0.09297 0.13778 0.84028 5883.57 2022-10-07T18:20:09 2022-10-07T18:15:51 Rev1 None None
ARM-UCSD 0.60889 0.10666 0.19333 0.77083 32650.77 2022-10-12T21:00:21 2022-10-11T23:57:30 Rev1 None None
ARM-UCSD 1.20397 0.12688 0.41 0.5 3367.51 2022-11-01T16:10:12 2022-11-01T16:04:02 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-12-13T18:50:13 2022-12-13T18:42:57 Rev1 :No Results::Info File Missing::Container File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-12-13T18:50:14 2022-12-13T18:50:47 Rev1 :No Results::Info File Missing::Container File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-12-13T20:02:37 2022-12-13T18:42:57 Rev1 :Executed File Update::No Results::Info File Missing::Container File Missing: None
ARM 0.69315 0.0 0.25 0.5 1829.04 2022-10-03T07:00:12 2022-10-03T06:55:39 Rev1 None None
ARM 0.69315 0.0 0.25 0.5 2936.19 2022-10-04T18:40:14 2022-10-04T18:31:54 Rev1 None None
ARM 0.69315 0.0 0.25 0.5 3178.67 2022-10-12T21:40:11 2022-10-12T21:36:43 Rev1 None None
ARM 0.64633 0.01447 0.22789 0.66112 3180.82 2022-10-17T18:20:10 2022-10-17T18:11:32 Rev1 :Container File Missing: None
ARM 0.69315 0.0 0.25 0.5 2695.53 2022-11-01T05:50:13 2022-11-01T06:58:02 Rev1 None None
ARM 0.69315 0.0 0.25 0.5 2702.23 2022-11-01T19:20:12 2022-11-01T19:16:09 Rev1 None None
ARM 0.52828 0.04556 0.17645 0.8255 4134.8 2022-11-01T21:10:13 2022-11-01T21:08:20 Rev1 None None
ARM 0.69315 0.0 0.25 0.5 2700.2 2022-11-02T00:10:51 2022-11-01T19:16:09 Rev1 None None
ARM 0.59672 0.02598 0.20403 0.78106 14892.7 2022-11-28T05:10:15 2022-11-28T05:03:33 Rev1 None None
ARM 0.36728 0.059 0.11325 0.92089 2487.37 2023-04-04T18:00:16 2023-04-04T18:00:08 Rev1 None None
TrinitySRITrojAI-SBU 0.2078 0.03321 0.06981 0.99841 14851.38 2022-11-29T18:50:17 2022-11-29T18:45:10 Rev1 None None
TrinitySRITrojAI-SBU 0.14241 0.02393 0.04022 1.0 3079.61 2022-12-12T23:41:20 2022-12-12T23:38:50 Rev1 None None
TrinitySRITrojAI-SBU 0.16352 0.01118 0.02766 1.0 3290.81 2022-12-13T02:50:17 2022-12-13T02:45:02 Rev1 None None
TrinitySRITrojAI-SBU 0.16017 0.01098 0.02667 1.0 3582.24 2022-12-13T16:52:58 2022-12-13T16:44:35 Rev1 None None
TrinitySRITrojAI-SBU 0.12277 0.00989 0.01743 1.0 3874.3 2022-12-14T22:01:34 2022-12-14T21:06:01 Rev1 None None
ICSI-2 0.10749 0.00514 0.01166 1.0 6585.41 2022-09-26T03:50:13 2022-09-26T03:43:51 Rev1 None None
ICSI-2 0.44762 0.04697 0.15718 0.84279 3512.36 2022-10-03T02:00:14 2022-10-03T01:59:58 Rev1 None None
ICSI-2 0.05754 0.00475 0.00447 1.0 3426.85 2022-10-04T04:50:25 2022-10-04T04:43:13 Rev1 None None
ICSI-2 0.05952 0.00476 0.00468 1.0 4259.7 2022-10-10T09:10:15 2022-10-10T09:09:08 Rev1 None None
ICSI-2 0.05835 0.00673 0.00583 1.0 3935.69 2022-10-11T20:20:14 2022-10-11T20:11:37 Rev1 None None
ICSI-2 0.08364 0.01985 0.01835 0.99867 4349.12 2022-10-13T01:30:13 2022-10-13T01:30:01 Rev1 None None
ICSI-2 0.13076 0.02471 0.03505 0.99542 3984.43 2022-10-14T01:50:16 2022-10-13T20:29:39 Rev1 None None
ICSI-2 0.16264 0.02676 0.04563 0.9947 3960.36 2022-10-14T23:20:22 2022-10-14T23:17:14 Rev1 None None
ICSI-2 0.1081 0.02084 0.02548 0.99853 3952.7 2022-10-15T21:00:12 2022-10-15T20:53:16 Rev1 None None
ICSI-2 0.17996 0.06299 0.05036 0.98563 3959.79 2022-10-16T05:40:13 2022-10-16T05:34:41 Rev1 None None
ICSI-2 0.0405 0.00575 0.00349 1.0 4134.71 2022-10-25T21:20:13 2022-10-25T21:15:59 Rev1 :Container File Missing: None
ICSI-2 0.04095 0.00654 0.00403 1.0 4612.87 2022-10-26T06:40:13 2022-10-26T06:40:02 Rev1 :Container File Missing: None
ICSI-2 0.03098 0.00397 0.00195 1.0 3758.06 2022-11-09T18:50:18 2022-11-09T18:48:31 Rev1 None None
ICSI-2 0.01882 0.00204 0.00064 1.0 3748.12 2022-11-14T23:30:19 2022-11-14T23:23:54 Rev1 None None
ICSI-2 0.01882 0.00204 0.00064 1.0 3749.14 2022-11-15T03:20:58 2022-11-15T03:15:09 Rev1 None None
ICSI-2 0.69315 0.0 0.25 0.5 2022-11-22T11:00:19 2022-11-22T10:58:01 Rev1 :No Results::Info File Missing::Container File Missing: None
ICSI-2 0.69315 0.0 0.25 0.5 2022-11-23T00:30:20 2022-11-23T00:27:50 Rev1 :No Results::Info File Missing::Container File Missing: None
ICSI-2 0.0626 0.01323 0.01152 1.0 84630.15 2022-11-23T23:10:19 2022-11-23T23:07:52 Rev1 None None
ICSI-2 0.69315 0.0 0.25 0.5 2022-12-13T06:22:17 2022-12-13T06:17:44 Rev1 :No Results::Info File Missing::Container File Missing: None
ICSI-2 0.69315 0.0 0.25 0.5 2022-12-14T05:20:20 2022-12-14T05:19:51 Rev1 :No Results::Info File Missing::Container File Missing: None
ICSI-2 0.04395 0.01095 0.00711 0.99995 7244.01 2022-12-15T07:10:21 2022-12-15T07:07:27 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 1539.44 2022-10-18T15:20:15 2022-10-18T15:11:05 Rev1 :Container File Missing: None
TrinitySRITrojAI-BostonU 0.60027 0.02818 0.20945 0.68981 4557.63 2022-10-29T07:10:14 2022-10-29T07:05:21 Rev1 :Container File Missing: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2022-10-31T20:10:16 2022-10-31T20:01:29 Rev1 :Executed File Update::Info File Missing::Container File Missing: None
TrinitySRITrojAI-BostonU 0.56018 0.05892 0.18865 0.81862 9466.89 2022-10-31T22:10:15 2022-10-31T22:07:23 Rev1 :Log File Missing: None
TrinitySRITrojAI-BostonU 0.56018 0.05892 0.18865 0.81862 9545.42 2022-11-01T08:30:53 2022-11-01T08:15:11 Rev1 None None
TrinitySRITrojAI-BostonU 0.69325 0.00164 0.25005 0.5 9534.94 2022-11-01T21:20:48 2022-11-01T21:13:17 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 8e-05 0.25 0.5 9745.25 2022-11-02T02:00:18 2022-11-02T01:53:52 Rev1 None None
TrinitySRITrojAI-BostonU 0.79041 0.06774 0.28707 0.56855 9477.14 2022-11-02T07:10:20 2022-11-02T07:04:36 Rev1 None None
TrinitySRITrojAI-BostonU 0.80599 0.06542 0.29317 0.5244 9565.26 2022-11-02T18:30:21 2022-11-02T18:13:50 Rev1 None None
TrinitySRITrojAI-BostonU 0.56018 0.05892 0.18865 0.81862 9509.69 2022-11-03T03:40:21 2022-11-03T03:36:00 Rev1 None None
TrinitySRITrojAI-BostonU 0.56018 0.05892 0.18865 0.81862 9603.86 2022-11-06T20:04:14 2022-11-06T16:40:19 Rev1 None None
TrinitySRITrojAI-BostonU 0.56018 0.05892 0.18865 0.81862 9661.45 2022-11-07T23:21:17 2022-11-07T22:00:00 Rev1 None None
TrinitySRITrojAI-BostonU 0.56018 0.05892 0.18865 0.81862 9682.3 2022-11-15T17:00:27 2022-11-15T16:57:31 Rev1 None None
TrinitySRITrojAI-BostonU 0.60361 0.02366 0.20746 0.77361 9525.36 2022-11-15T19:51:44 2022-11-15T17:57:00 Rev1 None None
TrinitySRITrojAI-BostonU 2.3362 0.27657 0.48692 0.49653 5481.1 2022-12-05T20:01:37 2022-12-05T19:44:51 Rev1 None None
TrinitySRITrojAI-BostonU 0.27732 0.09457 0.07082 0.94637 5473.0 2022-12-06T22:10:22 2022-12-06T22:08:09 Rev1 None None
TrinitySRITrojAI-BostonU 0.76753 0.52443 0.02778 0.94809 3033.72 2022-12-10T01:10:22 2022-12-10T01:04:54 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 1806.56 2022-12-13T18:10:18 2022-12-13T18:03:31 Rev1 :No Results: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2020.68 2023-01-20T21:40:24 2023-01-20T21:31:11 Rev1 :No Results: None
trojai-example 0.95798 0.09962 0.32408 0.47912 3412.55 2022-09-21T17:30:13 2022-09-21T17:28:50 Rev1 None None
IIECAS 12.3764 1.58693 0.44792 0.11073 7560.93 2022-11-17T12:30:29 2022-11-17T12:21:16 Rev1 None None
IIECAS 1.09716 0.12628 0.37111 0.54861 116013.04 2022-11-18T12:20:26 2022-11-18T12:12:28 Rev1 None None
IIECAS 1.00561 0.1248 0.33778 0.59028 64116.48 2022-11-27T14:00:30 2022-11-27T13:58:29 Rev1 None None
IIECAS 0.69315 0.0 0.25 0.5 14666.41 2022-11-29T02:30:30 2022-11-29T02:30:04 Rev1 :No Results: None
IIECAS 1.02087 0.12511 0.34333 0.58333 66585.78 2022-11-30T04:11:19 2022-11-30T02:21:07 Rev1 None None
IIECAS 0.88354 0.12137 0.29333 0.64583 75608.21 2022-12-01T15:01:55 2022-12-01T13:44:48 Rev1 None None
UMBCb 0.49955 0.02726 0.16128 0.89157 3656.39 2022-10-31T19:10:23 2022-10-31T19:00:37 Rev1 None None
UMBCb 7.91988 1.34209 0.40696 0.53742 5067.91 2022-11-04T14:43:29 2022-11-03T20:20:40 Rev1 None None

Required filename format: "image-classification-sep2022_test_<Submission Name>.simg"
Accepting submissions: True
Number of models in image-classification-sep2022, test: 216
Execution timeout (hh:mm:ss): 1 day, 12:00:00

Teams/Jobs

Team Submission Timestamp Type Job Status File Status General Status File Timestamp Time until next execution
Perspecta 2022-12-16T20:20:05 performer None None Ok 2022-12-16T20:11:50 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI 2023-02-11T00:50:06 performer None None Ok 2023-02-11T00:41:33 0 d, 0 h, 0 m, 0 s
DRAFFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
PL-GIFT 2022-12-20T19:08:06 performer None None Ok 2022-12-20T18:19:32 0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers 2023-02-14T15:40:09 performer None None Ok 2023-02-14T15:35:48 0 d, 0 h, 0 m, 0 s
Perspecta-IUB 2022-12-13T20:00:08 performer None None Ok 2022-12-13T19:50:40 0 d, 0 h, 0 m, 0 s
ARM-UCSD performer None None Ok 2023-03-27T02:09:28 0 d, 0 h, 0 m, 0 s
ARM 2023-04-04T18:00:16 performer None Ok Ok 2023-04-04T18:00:08 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU performer None None Ok 2023-01-07T21:22:48 0 d, 0 h, 0 m, 0 s
ARM-UMBC performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-1 performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-2 2022-12-15T07:10:21 performer None None Ok 2022-12-15T07:07:27 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU 2023-01-20T21:40:25 performer None None Ok 2023-01-20T21:34:01 0 d, 0 h, 0 m, 0 s
trojai-example 2022-09-21T17:30:13 public None None Ok 2022-09-21T17:28:50 0 d, 0 h, 0 m, 0 s
IceTorch public None None Ok None 0 d, 0 h, 0 m, 0 s
trojaicy public None None Ok None 0 d, 0 h, 0 m, 0 s
Hector public None None Ok None 0 d, 0 h, 0 m, 0 s
Cassandra-XF public None None Ok None 0 d, 0 h, 0 m, 0 s
gooddefense public None None Ok None 0 d, 0 h, 0 m, 0 s
cyberinfrastructure public None None Ok None 0 d, 0 h, 0 m, 0 s
glaros public None None Ok None 0 d, 0 h, 0 m, 0 s
Ultraman public None None Ok None 0 d, 0 h, 0 m, 0 s
BackSec public None None Ok None 0 d, 0 h, 0 m, 0 s
Palladium public None None Ok None 0 d, 0 h, 0 m, 0 s
IIECAS 2022-12-04T00:00:31 public None None Ok 2022-12-02T08:08:27 0 d, 0 h, 0 m, 0 s
NSEC public None None Ok None 0 d, 0 h, 0 m, 0 s
UMBCb 2022-11-04T14:43:29 performer None None Ok 2022-11-03T20:20:40 0 d, 0 h, 0 m, 0 s
PASS public None None Ok None 0 d, 0 h, 0 m, 0 s
DS3TwoSixZero public None None Ok None 0 d, 0 h, 0 m, 0 s
dongdong4fei public None None Ok None 0 d, 0 h, 0 m, 0 s

Best Results based on Cross Entropy

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.26094 0.06715 0.07978 0.96871 2235.86 2022-12-16T15:10:05 2022-12-16T15:00:48 Rev1 None None
TrinitySRITrojAI 0.41344 0.06866 0.13081 0.90141 14132.81 2023-02-11T00:50:06 2023-02-11T00:41:33 Rev1 None None
PL-GIFT 0.21259 0.06967 0.06595 0.97878 1883.08 2022-11-15T17:40:09 2022-11-15T17:33:52 Rev1 None None
Perspecta-PurdueRutgers 0.29024 0.06101 0.09191 0.9567 3163.07 2023-02-13T00:40:09 2023-02-13T00:38:47 Rev1 None None
Perspecta-IUB 0.37543 0.09072 0.11553 0.92678 3170.51 2022-11-18T18:45:04 2022-11-18T17:16:35 Rev1 None :Container Parameters (jsonschema checker):
ARM-UCSD 0.54277 0.11701 0.16926 0.80093 4421.76 2022-10-07T18:20:09 2022-10-07T18:15:51 Rev1 None None
ARM 0.63044 0.05541 0.2192 0.71348 3099.07 2022-11-01T21:10:13 2022-11-01T21:08:20 Rev1 None None
TrinitySRITrojAI-SBU 0.65073 0.0963 0.22046 0.74198 2946.61 2022-12-14T22:01:34 2022-12-14T21:06:01 Rev1 None None
ICSI-2 0.30211 0.07784 0.08909 0.94487 64458.08 2022-12-13T06:22:17 2022-12-13T06:17:44 Rev1 None None
TrinitySRITrojAI-BostonU 0.69214 0.04466 0.24685 0.58312 3412.87 2022-10-29T07:10:15 2022-10-29T07:06:28 Rev1 None None
trojai-example 0.84173 0.10527 0.28669 0.53477 2543.89 2022-09-21T17:30:13 2022-09-21T17:28:50 Rev1 None None
IIECAS 0.69315 0.0 0.25 0.5 2022-11-27T12:10:30 2022-11-27T12:07:55 Rev1 :No Results::Info File Missing: None
UMBCb 0.69034 0.0512 0.245 0.6178 2662.31 2022-10-31T19:10:23 2022-10-31T19:00:37 Rev1 None None

All Results

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.69585 0.00687 0.2513 0.49537 129603.31 2022-10-03T20:40:03 2022-10-03T20:31:27 Rev1 None :Timeout:
Perspecta 0.71976 0.08286 0.24824 0.62731 2181.47 2022-10-13T03:30:03 2022-10-13T03:20:12 Rev1 None None
Perspecta 0.91329 0.24076 0.23932 0.69217 2143.86 2022-10-18T05:20:03 2022-10-18T05:11:57 Rev1 None None
Perspecta 1.76118 0.32537 0.41468 0.42074 2071.51 2022-10-18T17:30:03 2022-10-18T17:23:07 Rev1 None None
Perspecta 0.73769 0.10956 0.24833 0.63953 2035.15 2022-10-19T00:00:04 2022-10-18T23:56:57 Rev1 None None
Perspecta 0.68774 0.09754 0.22978 0.6788 2036.43 2022-10-19T18:10:04 2022-10-19T18:02:05 Rev1 None None
Perspecta 0.6845 0.08769 0.23123 0.67357 2034.36 2022-10-19T21:00:04 2022-10-19T20:53:59 Rev1 None None
Perspecta 0.64453 0.07715 0.21921 0.72308 2026.29 2022-10-19T23:40:03 2022-10-19T23:33:06 Rev1 None None
Perspecta 0.75607 0.16437 0.21981 0.76097 2114.58 2022-10-26T14:40:04 2022-10-26T14:32:03 Rev1 None None
Perspecta 0.8982 0.23516 0.21884 0.77761 2085.55 2022-10-27T00:50:03 2022-10-27T00:44:13 Rev1 None None
Perspecta 1.02657 0.33428 0.2214 0.77516 2079.53 2022-10-27T04:20:03 2022-10-27T04:15:11 Rev1 None None
Perspecta 0.59227 0.09079 0.2 0.77756 2091.55 2022-10-27T15:40:04 2022-10-27T15:38:34 Rev1 None None
Perspecta 0.4583 0.0657 0.15224 0.86081 2074.57 2022-10-28T23:30:03 2022-10-28T23:22:21 Rev1 None None
Perspecta 0.47358 0.06943 0.15484 0.85678 2156.95 2022-11-02T18:04:43 2022-11-02T17:56:09 Rev1 None None
Perspecta 0.38893 0.06678 0.12453 0.90415 2150.32 2022-11-07T21:10:05 2022-11-07T21:04:58 Rev1 None None
Perspecta 0.38314 0.07537 0.1232 0.90222 2121.85 2022-11-15T04:00:04 2022-11-15T03:50:54 Rev1 None None
Perspecta 0.41223 0.07331 0.13351 0.89069 2152.8 2022-11-16T01:20:04 2022-11-16T01:16:33 Rev1 None None
Perspecta 0.37649 0.14735 0.09713 0.9459 2156.74 2022-11-16T19:00:04 2022-11-16T18:58:52 Rev1 None None
Perspecta 0.37985 0.07276 0.12031 0.90578 2150.64 2022-11-16T21:10:04 2022-11-16T21:09:20 Rev1 None None
Perspecta 0.46206 0.15627 0.11401 0.90758 2062.49 2022-11-17T22:30:04 2022-11-17T22:23:07 Rev1 None None
Perspecta 0.36412 0.06779 0.11863 0.91615 2159.55 2022-11-22T05:20:04 2022-11-22T05:17:14 Rev1 None None
Perspecta 0.38556 0.06515 0.12332 0.90505 2025.27 2022-11-22T07:30:04 2022-11-22T07:22:56 Rev1 None None
Perspecta 0.39845 0.08336 0.12282 0.90959 11071.45 2022-11-29T07:40:04 2022-11-29T07:38:19 Rev1 None None
Perspecta 0.3428 0.09285 0.09818 0.93514 11069.68 2022-11-29T15:50:05 2022-11-29T15:43:06 Rev1 None None
Perspecta 0.34504 0.07069 0.10928 0.92953 11066.84 2022-11-30T20:00:04 2022-11-30T19:50:09 Rev1 None None
Perspecta 0.40367 0.03316 0.12032 0.95786 11174.79 2022-12-01T05:20:04 2022-12-01T05:16:29 Rev1 None None
Perspecta 0.35539 0.04517 0.10568 0.94796 11316.39 2022-12-01T16:50:09 2022-12-01T16:48:02 Rev1 None None
Perspecta 0.35539 0.04517 0.10568 0.94796 2852.21 2022-12-04T00:00:05 2022-12-02T03:25:52 Rev1 None None
Perspecta 0.35996 0.04682 0.10803 0.94629 3102.78 2022-12-05T20:20:04 2022-12-05T20:15:11 Rev1 None None
Perspecta 0.34827 0.0418 0.1006 0.95812 2660.45 2022-12-06T22:20:04 2022-12-06T22:10:11 Rev1 None None
Perspecta 0.35484 0.04106 0.10395 0.95735 2660.4 2022-12-07T17:00:04 2022-12-07T16:55:59 Rev1 None None
Perspecta 0.33966 0.03792 0.09768 0.96498 2657.4 2022-12-08T16:00:05 2022-12-08T15:58:05 Rev1 None None
Perspecta 0.33086 0.03901 0.09407 0.96708 2664.42 2022-12-13T04:50:05 2022-12-13T04:43:43 Rev1 None None
Perspecta 0.33086 0.03901 0.09407 0.96708 2762.67 2022-12-13T06:40:04 2022-12-13T06:33:35 Rev1 None None
Perspecta 0.3631 0.05388 0.11265 0.93077 2874.84 2022-12-13T16:00:04 2022-12-13T15:56:25 Rev1 None None
Perspecta 0.3631 0.05388 0.11265 0.93077 2851.43 2022-12-13T21:50:05 2022-12-13T20:15:00 Rev1 None None
Perspecta 0.48632 0.19063 0.1108 0.92751 2231.26 2022-12-14T00:40:04 2022-12-14T00:39:29 Rev1 None None
Perspecta 0.35368 0.03905 0.10232 0.96755 2748.27 2022-12-14T17:30:05 2022-12-14T17:24:00 Rev1 None None
Perspecta 0.32702 0.04166 0.09419 0.97171 2853.9 2022-12-14T19:00:05 2022-12-14T18:55:54 Rev1 None None
Perspecta 0.32516 0.04197 0.09337 0.96584 2664.63 2022-12-15T01:20:05 2022-12-15T01:18:57 Rev1 None None
Perspecta 0.27356 0.06142 0.08648 0.96588 2236.15 2022-12-15T06:20:04 2022-12-15T06:11:21 Rev1 None None
Perspecta 0.29586 0.07533 0.09327 0.95898 2234.05 2022-12-15T22:10:05 2022-12-15T21:55:42 Rev1 None None
Perspecta 0.26094 0.06715 0.07978 0.96871 2235.86 2022-12-16T15:10:05 2022-12-16T15:00:48 Rev1 None None
Perspecta 0.26191 0.06434 0.08036 0.96614 2238.65 2022-12-16T20:20:05 2022-12-16T20:11:50 Rev1 None None
TrinitySRITrojAI 0.707 0.0916 0.23573 0.68639 6866.14 2022-09-30T06:30:06 2022-09-30T06:24:28 Rev1 None :Cleanup::Cleanup:
TrinitySRITrojAI 0.75205 0.11422 0.24401 0.68266 6865.44 2022-09-30T20:50:05 2022-09-30T20:43:42 Rev1 None None
TrinitySRITrojAI 0.73967 0.06156 0.26013 0.59821 7017.93 2022-10-07T08:40:06 2022-10-07T08:37:36 Rev1 None None
TrinitySRITrojAI 0.59141 0.08373 0.19756 0.76595 19243.69 2022-10-08T05:20:06 2022-10-08T05:19:38 Rev1 None None
TrinitySRITrojAI 0.4992 0.0595 0.16927 0.81297 43071.42 2022-10-17T08:50:06 2022-10-17T08:43:17 Rev1 None None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 1813.63 2022-11-16T01:40:06 2022-11-16T01:35:44 Rev1 :No Results: None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 1887.99 2022-11-16T07:00:06 2022-11-16T06:59:01 Rev1 :No Results: None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 1816.96 2022-11-17T05:40:05 2022-11-17T05:33:04 Rev1 :No Results: None
TrinitySRITrojAI 0.6194 0.06721 0.2151 0.72741 48083.46 2022-11-18T00:00:55 2022-11-17T23:59:38 Rev1 None None
TrinitySRITrojAI 0.59988 0.09643 0.19629 0.78202 85772.44 2022-12-13T01:10:06 2022-12-13T01:04:46 Rev1 None None
TrinitySRITrojAI 0.48639 0.10252 0.14782 0.85794 127683.11 2023-01-18T17:20:06 2023-01-18T17:13:22 Rev1 None None
TrinitySRITrojAI 0.41344 0.06866 0.13081 0.90141 14132.81 2023-02-11T00:50:06 2023-02-11T00:41:33 Rev1 None None
PL-GIFT 0.57702 0.07557 0.19379 0.78074 1429.5 2022-09-23T22:10:06 2022-09-23T22:01:36 Rev1 None None
PL-GIFT 0.46674 0.05664 0.16051 0.84709 2038.31 2022-09-30T01:00:06 2022-09-30T00:56:52 Rev1 None :Cleanup::Cleanup:
PL-GIFT 0.50873 0.10565 0.15658 0.85142 11566.66 2022-10-12T15:10:08 2022-10-12T15:01:57 Rev1 None None
PL-GIFT 0.34255 0.07196 0.109 0.93236 1419.24 2022-10-14T18:20:08 2022-10-14T18:18:21 Rev1 None None
PL-GIFT 0.7001 0.04798 0.24546 0.64489 4271.0 2022-10-20T22:00:07 2022-10-20T21:55:07 Rev1 None :Container Parameters (jsonschema checker):
PL-GIFT 0.32598 0.07557 0.10175 0.9411 1863.26 2022-10-25T23:40:07 2022-10-25T23:31:47 Rev1 None None
PL-GIFT 0.33886 0.09336 0.09653 0.94959 1516.36 2022-11-04T23:30:07 2022-11-04T23:20:37 Rev1 None None
PL-GIFT 0.3101 0.09115 0.09195 0.94029 1875.68 2022-11-07T17:10:08 2022-11-07T17:10:02 Rev1 None None
PL-GIFT 0.36153 0.08622 0.1082 0.91487 1871.2 2022-11-09T23:10:08 2022-11-09T23:03:07 Rev1 None None
PL-GIFT 0.36958 0.09961 0.11224 0.92571 1874.25 2022-11-11T19:20:07 2022-11-11T19:19:08 Rev1 None None
PL-GIFT 0.22401 0.07489 0.07151 0.97467 1870.67 2022-11-11T23:10:07 2022-11-11T23:09:05 Rev1 None None
PL-GIFT 0.21259 0.06967 0.06595 0.97878 1883.08 2022-11-15T17:40:09 2022-11-15T17:33:52 Rev1 None None
PL-GIFT 0.37087 0.11213 0.10117 0.91397 1872.44 2022-11-15T20:20:45 2022-11-15T20:17:08 Rev1 None None
PL-GIFT 0.26396 0.07679 0.08149 0.96579 1866.32 2022-11-15T23:50:08 2022-11-15T23:45:59 Rev1 None None
PL-GIFT 0.23528 0.10282 0.06366 0.96965 1949.04 2022-12-15T15:50:08 2022-12-15T15:46:42 Rev1 None None
PL-GIFT 0.23425 0.10239 0.06347 0.96961 2010.96 2022-12-20T19:08:06 2022-12-20T18:19:32 Rev1 None None
Perspecta-PurdueRutgers 0.44105 0.10542 0.13222 0.84722 72513.96 2022-10-03T08:20:08 2022-10-03T08:18:13 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.42974 0.10225 0.12829 0.85742 73585.52 2022-10-04T22:40:07 2022-10-04T22:39:49 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.49211 0.10619 0.15434 0.85322 47542.29 2022-10-14T10:00:08 2022-10-14T09:52:56 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.51457 0.11011 0.16168 0.83479 98129.1 2022-10-15T15:20:09 2022-10-15T15:12:56 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.36284 0.10839 0.10061 0.89489 61710.03 2022-10-18T06:50:22 2022-10-18T06:41:35 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.33742 0.08619 0.09471 0.90008 61248.41 2022-10-24T01:40:09 2022-10-24T01:34:56 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.35812 0.07447 0.10628 0.90771 129603.41 2022-11-01T17:50:09 2022-11-01T17:42:36 Rev1 None :Container Parameters (learned parameters)::Timeout:
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 2022-11-03T13:10:09 2022-11-03T13:07:21 Rev1 :Info File Missing: None
Perspecta-PurdueRutgers 0.65449 0.02534 0.23147 0.63773 2236.2 2022-11-04T15:20:09 2022-11-04T15:17:23 Rev1 None None
Perspecta-PurdueRutgers 0.31039 0.07938 0.0853 0.91615 121209.15 2022-11-04T20:40:10 2022-11-04T20:30:10 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.58752 0.03242 0.20052 0.76432 1778.7 2022-11-06T21:00:08 2022-11-06T20:52:56 Rev1 None None
Perspecta-PurdueRutgers 0.30179 0.08706 0.08387 0.91615 118130.14 2022-11-08T19:40:09 2022-11-08T19:33:41 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.67805 0.01868 0.24277 0.5796 1782.61 2022-11-11T17:20:08 2022-11-11T17:17:24 Rev1 None None
Perspecta-PurdueRutgers 0.56947 0.07318 0.19096 0.78562 1920.95 2022-11-15T23:30:10 2022-11-15T23:21:05 Rev1 None None
Perspecta-PurdueRutgers 0.76088 0.35207 0.185 0.80153 1914.11 2022-11-16T05:00:08 2022-11-16T04:53:47 Rev1 None None
Perspecta-PurdueRutgers 0.57369 0.07366 0.19305 0.78888 1924.87 2022-11-16T16:40:09 2022-11-16T16:36:52 Rev1 None None
Perspecta-PurdueRutgers 0.56123 0.07512 0.19141 0.78888 1914.21 2022-11-17T02:00:07 2022-11-17T01:55:49 Rev1 None None
Perspecta-PurdueRutgers 0.5424 0.07689 0.18724 0.78888 1877.95 2022-11-17T03:10:07 2022-11-17T03:09:26 Rev1 None None
Perspecta-PurdueRutgers 0.89219 0.42945 0.18875 0.76415 1889.69 2022-11-17T04:41:19 2022-11-17T04:34:55 Rev1 None None
Perspecta-PurdueRutgers 0.50568 0.04985 0.17495 0.81083 1879.76 2022-11-19T00:30:08 2022-11-18T21:26:33 Rev1 None None
Perspecta-PurdueRutgers 0.623 0.25074 0.17604 0.8074 1883.73 2022-11-19T02:01:15 2022-11-19T01:55:52 Rev1 None None
Perspecta-PurdueRutgers 0.52693 0.04722 0.18031 0.81083 1885.74 2022-11-19T04:20:08 2022-11-19T04:10:44 Rev1 None None
Perspecta-PurdueRutgers 2.56759 0.93838 0.24419 0.69543 1993.41 2022-12-10T03:50:08 2022-12-10T03:46:14 Rev1 None None
Perspecta-PurdueRutgers 0.5276 0.04848 0.18499 0.77962 2001.14 2022-12-10T15:24:54 2022-12-10T14:40:50 Rev1 None None
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 505.41 2022-12-11T05:00:08 2022-12-11T04:58:39 Rev1 :No Results: None
Perspecta-PurdueRutgers 0.73057 0.34979 0.17542 0.80624 1864.96 2022-12-11T16:40:09 2022-12-11T16:38:53 Rev1 None None
Perspecta-PurdueRutgers 0.52362 0.04142 0.17835 0.81799 1871.02 2022-12-11T18:00:08 2022-12-11T18:00:18 Rev1 None None
Perspecta-PurdueRutgers 0.77337 0.34835 0.1873 0.79012 2235.95 2022-12-11T21:50:09 2022-12-11T21:45:59 Rev1 None None
Perspecta-PurdueRutgers 0.62858 0.24905 0.17664 0.81602 1872.44 2022-12-12T04:00:08 2022-12-12T03:53:37 Rev1 None None
Perspecta-PurdueRutgers 0.53599 0.03722 0.17948 0.8176 1871.43 2022-12-12T06:20:08 2022-12-12T06:15:01 Rev1 None None
Perspecta-PurdueRutgers 0.83918 0.34713 0.21355 0.68424 1986.49 2022-12-12T21:50:09 2022-12-12T21:09:20 Rev1 None None
Perspecta-PurdueRutgers 0.75168 0.42941 0.13487 0.90312 3218.84 2023-02-06T02:00:08 2023-02-06T01:57:01 Rev1 None None
Perspecta-PurdueRutgers 0.56717 0.04059 0.20211 0.68724 2499.87 2023-02-09T21:20:10 2023-02-09T21:15:24 Rev1 None None
Perspecta-PurdueRutgers 0.56355 0.03529 0.1968 0.7368 2618.25 2023-02-09T22:30:10 2023-02-09T22:27:54 Rev1 None None
Perspecta-PurdueRutgers 0.54627 0.04517 0.1937 0.71815 2382.63 2023-02-12T02:30:09 2023-02-12T02:29:10 Rev1 None None
Perspecta-PurdueRutgers 0.56671 0.04855 0.20142 0.70478 2795.0 2023-02-12T04:10:09 2023-02-12T04:02:07 Rev1 None None
Perspecta-PurdueRutgers 0.81423 0.49722 0.11825 0.91774 3221.81 2023-02-12T22:30:08 2023-02-12T22:25:15 Rev1 None None
Perspecta-PurdueRutgers 0.29024 0.06101 0.09191 0.9567 3163.07 2023-02-13T00:40:09 2023-02-13T00:38:47 Rev1 None None
Perspecta-PurdueRutgers 0.45266 0.26014 0.10473 0.94132 3183.51 2023-02-14T15:40:09 2023-02-14T15:35:48 Rev1 None None
Perspecta-IUB 0.69315 0.0 0.25 0.5 1450.22 2022-10-05T22:40:09 2022-10-05T22:38:17 Rev1 None None
Perspecta-IUB 0.45452 0.05118 0.15329 0.887 37485.16 2022-10-06T23:40:09 2022-10-06T23:35:08 Rev1 None None
Perspecta-IUB 0.48582 0.05713 0.1648 0.84701 31197.94 2022-10-07T14:00:09 2022-10-07T03:35:32 Rev1 None None
Perspecta-IUB 0.48491 0.10831 0.15727 0.87757 31816.89 2022-10-08T02:30:09 2022-10-08T02:23:53 Rev1 None None
Perspecta-IUB 0.5696 0.1248 0.17848 0.84546 31353.94 2022-10-08T12:40:31 2022-10-08T04:37:48 Rev1 None None
Perspecta-IUB 0.56846 0.0265 0.1904 0.84512 31110.88 2022-10-08T21:40:30 2022-10-08T18:08:16 Rev1 None None
Perspecta-IUB 0.5535 0.02455 0.183 0.87646 31280.68 2022-10-09T06:30:35 2022-10-08T23:24:10 Rev1 None None
Perspecta-IUB 0.46086 0.05045 0.15486 0.87903 31302.38 2022-10-09T17:40:08 2022-10-09T17:30:28 Rev1 None None
Perspecta-IUB 0.4776 0.09831 0.14941 0.8657 33452.88 2022-10-10T02:30:33 2022-10-09T22:35:57 Rev1 None None
Perspecta-IUB 0.77317 0.28022 0.16866 0.85434 31590.83 2022-10-10T15:20:09 2022-10-10T15:11:15 Rev1 None None
Perspecta-IUB 0.60741 0.18245 0.16066 0.85721 4179.16 2022-10-11T00:10:31 2022-10-10T18:15:05 Rev1 None None
Perspecta-IUB 0.46348 0.08648 0.14714 0.86737 4180.82 2022-10-11T02:20:08 2022-10-11T02:13:19 Rev1 None None
Perspecta-IUB 0.44146 0.07907 0.14309 0.87534 4997.51 2022-10-11T03:40:31 2022-10-11T03:02:15 Rev1 None None
Perspecta-IUB 0.69315 0.0 0.25 0.5 2022-10-11T05:10:33 2022-10-11T04:00:25 Rev1 :Info File Missing: None
Perspecta-IUB 0.4397 0.07606 0.14243 0.87603 4984.81 2022-10-11T17:40:09 2022-10-11T17:23:06 Rev1 None None
Perspecta-IUB 0.46103 0.04889 0.15507 0.88387 44245.22 2022-10-11T19:20:09 2022-10-11T19:13:18 Rev1 None None
Perspecta-IUB 0.69315 0.0 0.25 0.5 2022-10-12T15:20:09 2022-10-12T15:10:37 Rev1 :Executed File Update::Info File Missing: None
Perspecta-IUB 0.69315 0.0 0.25 0.5 2022-10-12T19:00:09 2022-10-12T18:57:51 Rev1 :Executed File Update::Info File Missing: None
Perspecta-IUB 0.42076 0.04954 0.1379 0.89206 45067.73 2022-10-12T21:00:20 2022-10-12T18:57:51 Rev1 None None
Perspecta-IUB 0.42745 0.04739 0.14082 0.89716 41399.1 2022-10-13T09:40:24 2022-10-12T23:53:26 Rev1 None None
Perspecta-IUB 0.42878 0.04669 0.141 0.89819 40730.59 2022-10-14T01:50:10 2022-10-13T23:08:43 Rev1 None None
Perspecta-IUB 0.42214 0.04923 0.13825 0.8936 40755.44 2022-10-14T13:20:33 2022-10-14T06:51:18 Rev1 None None
Perspecta-IUB 0.42 0.05403 0.13757 0.88833 40810.27 2022-10-15T04:00:30 2022-10-14T21:09:47 Rev1 None None
Perspecta-IUB 0.42 0.05403 0.13757 0.88833 41123.91 2022-11-15T17:10:08 2022-11-15T17:08:10 Rev1 None None
Perspecta-IUB 0.65895 0.23166 0.13675 0.8879 4441.04 2022-11-17T03:50:45 2022-11-17T03:48:28 Rev1 None :Container Parameters (jsonschema checker):
Perspecta-IUB 0.66235 0.10598 0.21817 0.74271 2593.28 2022-11-17T22:10:09 2022-11-17T22:03:12 Rev1 None :Container Parameters (jsonschema checker):
Perspecta-IUB 0.50003 0.07657 0.16996 0.82472 2955.83 2022-11-18T04:20:09 2022-11-18T04:17:39 Rev1 None :Container Parameters (jsonschema checker):
Perspecta-IUB 0.50283 0.13492 0.14662 0.90548 2954.72 2022-11-18T05:30:08 2022-11-18T05:26:14 Rev1 None :Container Parameters (jsonschema checker):
Perspecta-IUB 0.37543 0.09072 0.11553 0.92678 3170.51 2022-11-18T18:45:04 2022-11-18T17:16:35 Rev1 None :Container Parameters (jsonschema checker):
Perspecta-IUB 0.37543 0.09072 0.11553 0.92678 3377.86 2022-12-13T20:00:08 2022-12-13T19:50:40 Rev1 None :Container Parameters (jsonschema checker):
ARM-UCSD 0.69315 0.0 0.25 0.5 1804.24 2022-10-06T22:20:09 2022-10-06T22:16:03 Rev1 None None
ARM-UCSD 0.5556 0.09155 0.18259 0.79012 4257.3 2022-10-07T06:10:11 2022-10-07T06:05:34 Rev1 None None
ARM-UCSD 0.54277 0.11701 0.16926 0.80093 4421.76 2022-10-07T18:20:09 2022-10-07T18:15:51 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 2022-10-12T13:32:35 2022-10-11T23:57:30 Rev1 :Info File Missing: None
ARM-UCSD 0.7157 0.13125 0.23222 0.72222 24636.71 2022-10-12T21:00:21 2022-10-11T23:57:30 Rev1 None None
ARM-UCSD 0.7157 0.13125 0.23222 0.72222 8961.43 2022-10-13T04:00:20 2022-10-12T21:28:41 Rev1 None None
ARM-UCSD 1.20397 0.14651 0.41 0.5 2546.13 2022-11-01T15:40:11 2022-11-01T15:33:06 Rev1 None None
ARM-UCSD 1.20397 0.14651 0.41 0.5 2514.79 2022-11-01T20:30:11 2022-11-01T20:20:14 Rev1 None None
ARM-UCSD 1.03396 0.11645 0.37355 0.5 2500.81 2022-12-13T18:50:14 2022-12-13T18:50:47 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 2023-03-27T02:10:14 2023-03-27T02:09:28 Rev1 :No Results::Missing Results: :Container Parameters (jsonschema checker):
ARM 0.69315 0.0 0.25 0.5 1375.72 2022-10-03T07:30:14 2022-10-03T07:26:20 Rev1 None None
ARM 0.66913 0.0129 0.23838 0.60237 2388.62 2022-10-17T18:20:10 2022-10-17T18:11:32 Rev1 None None
ARM 0.63044 0.05541 0.2192 0.71348 3099.07 2022-11-01T21:10:13 2022-11-01T21:08:20 Rev1 None None
ARM 0.65914 0.03107 0.23323 0.65835 11174.49 2022-11-28T05:10:15 2022-11-28T05:03:33 Rev1 None None
ARM 0.69315 0.0 0.25 0.5 2023-03-28T04:40:17 2023-03-28T04:36:44 Rev1 :No Results::Missing Results::Info File Missing: None
ARM 0.64336 0.14314 0.18768 0.80783 1840.77 2023-04-04T18:00:16 2023-04-04T18:00:08 Rev1 None None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 938.16 2022-11-29T05:21:12 2022-11-29T05:13:35 Rev1 :No Results: None
TrinitySRITrojAI-SBU 1.22432 0.23004 0.33275 0.5691 11107.06 2022-11-29T18:50:17 2022-11-29T18:45:10 Rev1 None None
TrinitySRITrojAI-SBU 1.3413 0.2806 0.31737 0.59967 2309.73 2022-12-12T23:41:20 2022-12-12T23:38:50 Rev1 None None
TrinitySRITrojAI-SBU 0.75486 0.08725 0.26725 0.62453 2380.48 2022-12-13T02:50:17 2022-12-13T02:45:02 Rev1 None None
TrinitySRITrojAI-SBU 0.76206 0.08831 0.26994 0.62269 2608.54 2022-12-13T16:52:58 2022-12-13T16:44:35 Rev1 None None
TrinitySRITrojAI-SBU 0.65073 0.0963 0.22046 0.74198 2946.61 2022-12-14T22:01:34 2022-12-14T21:06:01 Rev1 None None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 2023-01-07T21:30:19 2023-01-07T21:22:48 Rev1 :No Results: :Schema Header:
ICSI-2 0.49894 0.07109 0.16271 0.83989 4954.9 2022-09-26T03:50:14 2022-09-26T03:42:55 Rev1 None None
ICSI-2 0.64325 0.08268 0.22344 0.72441 2686.94 2022-10-03T02:00:15 2022-10-03T01:59:22 Rev1 None None
ICSI-2 0.4133 0.06463 0.13373 0.89725 2529.52 2022-10-04T04:50:26 2022-10-04T04:43:23 Rev1 None None
ICSI-2 0.69315 0.0 0.25 0.5 2022-10-10T08:40:16 2022-10-10T08:34:46 Rev1 :Info File Missing: None
ICSI-2 0.40322 0.06265 0.12774 0.90261 3186.55 2022-10-10T09:10:15 2022-10-10T09:09:08 Rev1 None None
ICSI-2 0.39858 0.06644 0.12588 0.90689 2980.6 2022-10-11T20:20:14 2022-10-11T20:11:37 Rev1 None None
ICSI-2 0.43494 0.09453 0.13357 0.89965 3297.06 2022-10-13T01:30:13 2022-10-13T01:30:01 Rev1 None None
ICSI-2 0.46428 0.07177 0.15497 0.85978 2988.68 2022-10-14T01:50:16 2022-10-13T20:29:39 Rev1 None None
ICSI-2 0.45526 0.06498 0.1525 0.86368 2967.65 2022-10-14T23:20:22 2022-10-14T23:17:14 Rev1 None None
ICSI-2 0.48321 0.08619 0.15631 0.86441 2977.13 2022-10-15T21:00:12 2022-10-15T20:53:16 Rev1 None None
ICSI-2 0.63939 0.1329 0.19874 0.83025 2980.11 2022-10-16T05:40:13 2022-10-16T05:34:41 Rev1 None None
ICSI-2 0.39105 0.07074 0.12407 0.90822 3098.31 2022-10-25T21:20:13 2022-10-25T21:15:59 Rev1 None None
ICSI-2 0.41841 0.0842 0.13041 0.89973 3468.91 2022-10-26T06:40:13 2022-10-26T06:40:02 Rev1 None None
ICSI-2 0.3635 0.07566 0.11306 0.92138 2818.3 2022-11-09T18:50:18 2022-11-09T18:48:31 Rev1 None None
ICSI-2 0.36325 0.08031 0.11263 0.92245 2808.91 2022-11-14T23:30:19 2022-11-14T23:23:54 Rev1 None None
ICSI-2 0.36325 0.08031 0.11263 0.92245 2807.1 2022-11-15T03:20:58 2022-11-15T03:15:09 Rev1 None None
ICSI-2 0.34572 0.07765 0.10591 0.93128 35217.68 2022-11-22T11:00:19 2022-11-22T10:58:01 Rev1 None None
ICSI-2 0.36183 0.08154 0.11309 0.9198 11242.62 2022-11-23T00:30:20 2022-11-23T00:27:50 Rev1 None None
ICSI-2 0.31188 0.07664 0.09225 0.94072 63796.16 2022-11-23T23:10:19 2022-11-23T23:07:52 Rev1 None None
ICSI-2 0.69315 0.0 0.25 0.5 2022-12-04T23:50:19 2022-12-04T23:44:26 Rev1 :No Results::Info File Missing: None
ICSI-2 0.30211 0.07784 0.08909 0.94487 64458.08 2022-12-13T06:22:17 2022-12-13T06:17:44 Rev1 None None
ICSI-2 0.30877 0.07495 0.09598 0.94414 12486.03 2022-12-14T05:20:20 2022-12-14T05:19:51 Rev1 None None
ICSI-2 0.30926 0.08427 0.09255 0.94402 5444.1 2022-12-15T07:10:21 2022-12-15T07:07:27 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 1158.38 2022-10-18T00:00:15 2022-10-17T23:55:05 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 1154.16 2022-10-18T00:30:24 2022-10-18T00:05:51 Rev1 None None
TrinitySRITrojAI-BostonU 0.69214 0.04466 0.24685 0.58312 3412.87 2022-10-29T07:10:15 2022-10-29T07:06:28 Rev1 None None
TrinitySRITrojAI-BostonU 0.82041 0.0869 0.29204 0.5643 7086.8 2022-10-31T20:10:17 2022-10-31T20:01:29 Rev1 None None
TrinitySRITrojAI-BostonU 0.82041 0.0869 0.29204 0.5643 7123.09 2022-11-01T08:30:54 2022-11-01T08:15:26 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0001 0.25 0.5 7314.69 2022-11-02T02:00:19 2022-11-02T01:50:55 Rev1 None None
TrinitySRITrojAI-BostonU 0.89365 0.0825 0.32826 0.46039 7091.41 2022-11-02T06:20:20 2022-11-02T06:13:15 Rev1 None None
TrinitySRITrojAI-BostonU 0.98433 0.10842 0.34387 0.42627 7154.62 2022-11-02T18:30:22 2022-11-02T18:13:38 Rev1 None None
TrinitySRITrojAI-BostonU 0.82041 0.0869 0.29204 0.5643 7104.33 2022-11-03T05:50:21 2022-11-03T05:47:16 Rev1 None None
TrinitySRITrojAI-BostonU 0.82041 0.0869 0.29204 0.5643 7228.94 2022-11-06T20:04:15 2022-11-06T16:40:24 Rev1 None None
TrinitySRITrojAI-BostonU 0.82041 0.0869 0.29204 0.5643 7160.91 2022-11-07T23:21:18 2022-11-07T22:00:09 Rev1 None None
TrinitySRITrojAI-BostonU 0.82041 0.0869 0.29204 0.5643 7218.55 2022-11-15T17:30:58 2022-11-15T17:25:55 Rev1 None None
TrinitySRITrojAI-BostonU 0.72758 0.04424 0.26281 0.53935 7197.8 2022-11-15T19:40:51 2022-11-15T17:50:14 Rev1 None None
TrinitySRITrojAI-BostonU 1.32033 0.21143 0.36734 0.52002 4105.88 2022-12-07T02:10:22 2022-12-07T02:06:33 Rev1 None None
TrinitySRITrojAI-BostonU 5.3727 1.45838 0.19444 0.69792 2280.68 2022-12-10T05:10:21 2022-12-10T05:05:16 Rev1 None None
TrinitySRITrojAI-BostonU 5.3727 1.45838 0.19444 0.69792 2281.83 2022-12-10T08:00:22 2022-12-10T07:39:41 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 1274.19 2022-12-13T17:20:18 2022-12-13T17:15:18 Rev1 :No Results: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 1262.56 2022-12-14T03:33:15 2022-12-14T03:24:35 Rev1 :No Results: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 1523.75 2023-01-20T21:40:25 2023-01-20T21:34:01 Rev1 :No Results: None
trojai-example 0.84173 0.10527 0.28669 0.53477 2543.89 2022-09-21T17:30:13 2022-09-21T17:28:50 Rev1 None None
IIECAS 12.28046 1.83104 0.44444 0.11111 5691.78 2022-11-17T12:30:29 2022-11-17T12:21:16 Rev1 None None
IIECAS 1.04122 0.1449 0.35074 0.57407 72411.13 2022-11-18T12:20:26 2022-11-18T12:12:28 Rev1 None None
IIECAS 0.69315 0.0 0.25 0.5 2022-11-27T12:10:30 2022-11-27T12:07:55 Rev1 :No Results::Info File Missing: None
IIECAS 0.99035 0.14372 0.33222 0.59722 45830.48 2022-11-27T14:00:30 2022-11-27T13:58:29 Rev1 None None
IIECAS 0.69315 0.0 0.25 0.5 11044.76 2022-11-28T05:21:14 2022-11-28T05:18:08 Rev1 :No Results: None
IIECAS 0.69315 0.0 0.25 0.5 11001.31 2022-11-28T09:30:30 2022-11-28T09:28:15 Rev1 :No Results: None
IIECAS 0.69315 0.0 0.25 0.5 10999.59 2022-11-28T14:20:30 2022-11-28T14:16:37 Rev1 :No Results: None
IIECAS 0.90898 0.14113 0.30259 0.63426 45553.76 2022-11-29T02:30:30 2022-11-29T02:30:04 Rev1 None None
IIECAS 0.90898 0.14113 0.30259 0.63426 45545.31 2022-11-29T15:21:30 2022-11-29T02:59:18 Rev1 None None
IIECAS 0.98018 0.14344 0.32852 0.60185 47294.07 2022-11-30T04:11:19 2022-11-30T02:21:07 Rev1 None None
IIECAS 0.69315 0.0 0.25 0.5 10998.42 2022-12-01T06:20:28 2022-12-01T06:14:21 Rev1 :No Results: None
IIECAS 0.69315 0.0 0.25 0.5 11001.18 2022-12-01T11:50:30 2022-12-01T11:44:58 Rev1 :No Results: None
IIECAS 0.77673 0.13498 0.25444 0.69444 54445.88 2022-12-01T15:01:55 2022-12-01T13:44:48 Rev1 None None
IIECAS 0.69315 0.0 0.25 0.5 1424.47 2022-12-04T00:00:31 2022-12-02T08:08:27 Rev1 :No Results: :Container Parameters (jsonschema checker):
UMBCb 0.69034 0.0512 0.245 0.6178 2662.31 2022-10-31T19:10:23 2022-10-31T19:00:37 Rev1 None None
UMBCb 7.60792 1.52536 0.39033 0.55856 3799.12 2022-11-04T14:43:29 2022-11-03T20:20:40 Rev1 None None

Required filename format: "image-classification-sep2022_sts_<Submission Name>.simg"
Accepting submissions: True
Number of models in image-classification-sep2022, sts: 10
Execution timeout (hh:mm:ss): 1:40:00

Teams/Jobs

Team Submission Timestamp Type Job Status File Status General Status File Timestamp Time until next execution
Perspecta 2022-12-29T21:00:04 performer None None Ok 2022-12-29T20:51:10 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI 2023-02-10T23:50:06 performer None None Ok 2023-02-10T23:47:23 0 d, 0 h, 0 m, 0 s
DRAFFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
PL-GIFT performer None None Ok 2023-01-24T21:07:09 0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers 2022-12-11T16:20:08 performer None None Ok 2022-12-11T16:12:25 0 d, 0 h, 0 m, 0 s
Perspecta-IUB 2022-10-12T13:32:33 performer None None Ok 2022-10-12T00:48:36 0 d, 0 h, 0 m, 0 s
ARM-UCSD 2023-03-27T20:10:14 performer None None Ok 2023-03-27T20:06:37 0 d, 0 h, 0 m, 0 s
ARM 2023-04-04T18:00:17 performer None Ok Ok 2023-04-04T17:59:46 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU performer None None Ok 2023-01-10T02:25:33 0 d, 0 h, 0 m, 0 s
ARM-UMBC performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-1 performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-2 2022-12-15T06:50:20 performer None None Ok 2022-12-15T06:48:01 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU 2022-11-03T05:50:22 performer None None Ok 2022-11-03T05:47:16 0 d, 0 h, 0 m, 0 s
trojai-example 2022-12-08T16:40:24 public None None Ok 2022-12-08T16:39:11 0 d, 0 h, 0 m, 0 s
IceTorch public None None Ok None 0 d, 0 h, 0 m, 0 s
trojaicy public None None Ok None 0 d, 0 h, 0 m, 0 s
Hector public None None Ok None 0 d, 0 h, 0 m, 0 s
Cassandra-XF public None None Ok None 0 d, 0 h, 0 m, 0 s
gooddefense public None None Ok None 0 d, 0 h, 0 m, 0 s
cyberinfrastructure public None None Ok None 0 d, 0 h, 0 m, 0 s
glaros public None None Ok None 0 d, 0 h, 0 m, 0 s
Ultraman public None None Ok None 0 d, 0 h, 0 m, 0 s
BackSec public None None Ok None 0 d, 0 h, 0 m, 0 s
Palladium public None None Ok None 0 d, 0 h, 0 m, 0 s
IIECAS 2022-11-28T14:20:31 public None None Ok 2022-11-28T14:16:24 0 d, 0 h, 0 m, 0 s
NSEC public None None Ok None 0 d, 0 h, 0 m, 0 s
UMBCb 2022-11-02T20:10:30 performer None None Ok 2022-11-02T17:11:22 0 d, 0 h, 0 m, 0 s
PASS public None None Ok None 0 d, 0 h, 0 m, 0 s
DS3TwoSixZero public None None Ok None 0 d, 0 h, 0 m, 0 s
dongdong4fei public None None Ok None 0 d, 0 h, 0 m, 0 s

Best Results based on Cross Entropy

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.06565 0.037 0.00662 1.0 122.01 2022-12-08T15:20:06 2022-12-08T15:12:57 Rev1 None None
TrinitySRITrojAI 0.11639 0.07195 0.01964 1.0 555.68 2023-02-10T23:50:06 2023-02-10T23:47:23 Rev1 None None
PL-GIFT 0.01059 0.00101 0.00011 1.0 95.76 2022-12-20T19:08:08 2022-12-20T18:08:44 Rev1 None None
Perspecta-PurdueRutgers 0.08373 0.01642 0.007 1.0 1659.9 2022-10-18T05:40:08 2022-10-18T05:33:54 Rev1 :Container File Missing: :Container Parameters (learned parameters):
Perspecta-IUB 0.00234 0.00083 1e-05 1.0 1435.5 2022-10-08T01:50:08 2022-10-08T01:41:26 Rev1 None None
ARM-UCSD 0.22292 0.14573 0.058 1.0 198.3 2022-10-07T06:10:12 2022-10-07T06:05:52 Rev1 None None
ARM 0.17945 0.03395 0.02873 1.0 142.38 2022-11-28T05:10:16 2022-11-28T05:03:08 Rev1 None None
TrinitySRITrojAI-SBU 0.26883 0.15055 0.07945 1.0 104.31 2022-12-12T22:00:17 2022-12-12T21:56:41 Rev1 None None
ICSI-2 0.01681 0.01354 0.00072 1.0 126.82 2022-11-14T23:30:20 2022-11-14T23:24:02 Rev1 None None
TrinitySRITrojAI-BostonU 0.26979 0.10317 0.06495 1.0 319.35 2022-10-31T20:10:18 2022-10-31T20:01:29 Rev1 None None
trojai-example 0.55684 0.24684 0.19247 0.79167 152.1 2022-09-30T17:00:19 2022-09-30T16:59:47 Rev1 None None
IIECAS 0.51681 0.16695 0.178 0.79167 462.64 2022-11-26T14:20:30 2022-11-26T14:18:48 Rev1 None None
UMBCb 0.588 0.1539 0.20394 0.70833 133.11 2022-10-31T18:40:25 2022-10-31T18:31:33 Rev1 :Container File Missing: None

All Results

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.66583 0.05079 0.23676 0.58333 6000.62 2022-10-03T18:30:04 2022-10-03T18:28:21 Rev1 None :Timeout:
Perspecta 0.47751 0.17169 0.15468 0.91667 519.7 2022-10-13T02:50:04 2022-10-13T02:49:18 Rev1 None None
Perspecta 0.39355 0.18202 0.12011 0.91667 92.7 2022-10-18T05:00:04 2022-10-18T04:51:17 Rev1 :Container File Missing: None
Perspecta 0.88063 0.37914 0.33177 0.66667 94.64 2022-10-18T14:20:04 2022-10-18T14:14:36 Rev1 :Container File Missing: None
Perspecta 0.08808 0.04512 0.01099 1.0 93.74 2022-10-26T14:20:04 2022-10-26T14:12:49 Rev1 :Container File Missing: None
Perspecta 0.12029 0.09595 0.02479 1.0 92.77 2022-10-27T00:30:05 2022-10-27T00:25:51 Rev1 :Container File Missing: None
Perspecta 0.10195 0.07925 0.0193 1.0 94.71 2022-10-27T15:20:05 2022-10-27T15:11:54 Rev1 :Container File Missing: None
Perspecta 0.16894 0.19425 0.05365 1.0 93.41 2022-10-28T23:10:03 2022-10-28T23:02:30 Rev1 :Container File Missing: None
Perspecta 0.25789 0.30528 0.09238 1.0 93.69 2022-11-02T17:10:04 2022-11-02T17:09:08 Rev1 None None
Perspecta 0.12036 0.10149 0.02734 1.0 93.71 2022-11-07T20:10:07 2022-11-07T20:06:40 Rev1 None None
Perspecta 0.09413 0.1256 0.02667 1.0 93.68 2022-11-15T03:10:04 2022-11-15T03:04:49 Rev1 None None
Perspecta 0.13628 0.18049 0.04508 1.0 96.86 2022-11-16T00:50:04 2022-11-16T00:43:48 Rev1 None None
Perspecta 0.07444 0.09283 0.01784 1.0 95.47 2022-11-16T18:20:03 2022-11-16T18:17:56 Rev1 None None
Perspecta 0.12297 0.12806 0.03305 1.0 92.44 2022-11-16T20:50:05 2022-11-16T20:47:39 Rev1 None None
Perspecta 0.15885 0.10778 0.03503 1.0 94.5 2022-11-17T22:10:04 2022-11-17T22:02:11 Rev1 None None
Perspecta 0.11923 0.1495 0.03465 1.0 100.55 2022-11-22T05:00:05 2022-11-22T04:56:07 Rev1 None None
Perspecta 0.12935 0.16694 0.04025 1.0 92.72 2022-11-22T05:30:04 2022-11-22T05:24:42 Rev1 None None
Perspecta 0.0846 0.05546 0.0122 1.0 96.52 2022-11-29T07:20:05 2022-11-29T07:17:16 Rev1 None None
Perspecta 0.08018 0.0691 0.01422 1.0 98.28 2022-11-29T15:20:04 2022-11-29T15:18:03 Rev1 None None
Perspecta 0.07122 0.07771 0.01429 1.0 94.51 2022-11-30T19:20:04 2022-11-30T19:13:22 Rev1 None None
Perspecta 0.69315 0.0 0.25 0.5 97.79 2022-12-01T01:20:05 2022-12-01T01:12:44 Rev1 :No Results: None
Perspecta 0.09387 0.03818 0.01072 1.0 105.72 2022-12-01T04:40:04 2022-12-01T04:38:18 Rev1 None None
Perspecta 0.08 0.04113 0.00897 1.0 122.14 2022-12-01T16:20:07 2022-12-01T16:12:07 Rev1 None None
Perspecta 0.09746 0.05234 0.01311 1.0 142.81 2022-12-05T19:37:27 2022-12-05T19:32:11 Rev1 None None
Perspecta 0.0804 0.04556 0.00973 1.0 122.07 2022-12-06T19:53:37 2022-12-06T17:25:00 Rev1 None None
Perspecta 0.06891 0.04168 0.00761 1.0 122.03 2022-12-07T16:30:04 2022-12-07T16:23:06 Rev1 None None
Perspecta 0.06565 0.037 0.00662 1.0 122.01 2022-12-08T15:20:06 2022-12-08T15:12:57 Rev1 None None
Perspecta 0.69315 0.0 0.25 0.5 102.28 2022-12-12T23:30:05 2022-12-12T23:25:36 Rev1 :No Results: None
Perspecta 0.69315 0.0 0.25 0.5 102.23 2022-12-13T01:10:05 2022-12-13T01:08:33 Rev1 :No Results: None
Perspecta 0.07696 0.03918 0.00826 1.0 122.11 2022-12-13T04:20:04 2022-12-13T04:16:56 Rev1 None None
Perspecta 0.07696 0.03918 0.00826 1.0 122.17 2022-12-13T06:10:05 2022-12-13T06:08:55 Rev1 None None
Perspecta 0.0832 0.04986 0.01063 1.0 123.75 2022-12-14T18:10:05 2022-12-14T18:03:57 Rev1 None None
Perspecta 0.69315 0.0 0.25 0.5 27.63 2022-12-29T21:00:04 2022-12-29T20:51:10 Rev1 :No Results: None
TrinitySRITrojAI 0.43286 0.13095 0.13538 1.0 1064.99 2022-10-08T04:50:07 2022-10-08T04:47:28 Rev1 None None
TrinitySRITrojAI 0.36564 0.15694 0.11009 0.91667 2438.18 2022-10-17T07:20:06 2022-10-17T07:15:57 Rev1 None None
TrinitySRITrojAI 0.49685 0.17761 0.16473 0.85417 2142.53 2022-11-15T19:00:07 2022-11-15T18:55:12 Rev1 None None
TrinitySRITrojAI 0.39175 0.16235 0.11944 0.95833 2148.7 2022-11-17T04:40:05 2022-11-17T04:37:15 Rev1 None None
TrinitySRITrojAI 0.35719 0.19217 0.10852 0.95833 3772.73 2022-12-12T22:50:06 2022-12-12T22:43:48 Rev1 None None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 2023-01-18T05:20:06 2023-01-18T05:16:05 Rev1 :No Results::Container File Missing: :Schema Header:
TrinitySRITrojAI 0.20767 0.09136 0.04596 1.0 6169.61 2023-01-18T06:30:06 2023-01-18T06:26:27 Rev1 None None
TrinitySRITrojAI 0.11639 0.07195 0.01964 1.0 555.68 2023-02-10T23:50:06 2023-02-10T23:47:23 Rev1 None None
PL-GIFT 0.69315 0.0 0.25 0.5 65.03 2022-09-22T19:30:06 2022-09-22T19:28:35 Rev1 None None
PL-GIFT 0.69315 0.0 0.25 0.5 61.17 2022-09-23T19:40:06 2022-09-23T19:31:46 Rev1 None None
PL-GIFT 0.03577 0.0293 0.00308 1.0 63.61 2022-09-23T21:50:07 2022-09-23T21:43:37 Rev1 None None
PL-GIFT 0.05908 0.04643 0.00768 1.0 94.48 2022-09-29T22:50:07 2022-09-29T22:42:10 Rev1 None :Cleanup::Cleanup:
PL-GIFT 0.69315 0.0 0.25 0.5 107.02 2022-10-11T17:40:08 2022-10-11T17:40:00 Rev1 None None
PL-GIFT 0.69315 0.0 0.25 0.5 103.15 2022-10-11T21:30:08 2022-10-11T21:29:03 Rev1 None None
PL-GIFT 0.69315 0.0 0.25 0.5 98.72 2022-10-12T13:32:16 2022-10-12T01:33:00 Rev1 None None
PL-GIFT 0.05288 0.04288 0.00634 1.0 107.91 2022-10-12T14:50:08 2022-10-12T14:41:11 Rev1 None None
PL-GIFT 0.1197 0.15674 0.0362 1.0 67.56 2022-10-14T18:00:08 2022-10-14T17:56:35 Rev1 None None
PL-GIFT 0.69315 0.0 0.25 0.5 22.11 2022-10-18T00:40:08 2022-10-18T00:32:10 Rev1 :Container File Missing: :Container Parameters (jsonschema checker):
PL-GIFT 0.69315 0.0 0.25 0.5 72.29 2022-10-18T16:20:08 2022-10-18T16:16:16 Rev1 :Container File Missing: :Container Parameters (jsonschema checker):
PL-GIFT 0.69315 0.0 0.25 0.5 72.51 2022-10-18T18:30:08 2022-10-18T18:24:03 Rev1 :Container File Missing: :Container Parameters (jsonschema checker):
PL-GIFT 0.69315 0.0 0.25 0.5 72.44 2022-10-18T19:10:07 2022-10-18T19:00:59 Rev1 :Container File Missing: :Container Parameters (jsonschema checker):
PL-GIFT 0.69315 0.0 0.25 0.5 1355.03 2022-10-18T20:00:07 2022-10-18T19:51:07 Rev1 :Container File Missing: :Container Parameters (jsonschema checker):
PL-GIFT 0.69315 0.0 0.25 0.5 1354.69 2022-10-18T22:30:07 2022-10-18T22:21:19 Rev1 :Container File Missing: :Container Parameters (jsonschema checker):
PL-GIFT 0.1197 0.15674 0.0362 1.0 67.49 2022-10-19T15:40:07 2022-10-19T15:35:59 Rev1 :Container File Missing: None
PL-GIFT 0.69315 0.0 0.25 0.5 1352.16 2022-10-19T17:00:07 2022-10-19T16:55:18 Rev1 :Container File Missing: :Container Parameters (jsonschema checker):
PL-GIFT 0.69315 0.0 0.25 0.5 187.16 2022-10-20T20:20:07 2022-10-20T20:12:41 Rev1 :Container File Missing: :Container Parameters (jsonschema checker):
PL-GIFT 0.67108 0.08147 0.23929 0.70833 213.22 2022-10-20T21:40:07 2022-10-20T21:30:51 Rev1 :Container File Missing: :Container Parameters (jsonschema checker):
PL-GIFT 0.10691 0.15583 0.03417 1.0 83.18 2022-10-25T23:20:07 2022-10-25T23:14:49 Rev1 :Container File Missing: None
PL-GIFT 0.20959 0.21446 0.06896 1.0 74.75 2022-11-04T22:10:08 2022-11-04T22:07:34 Rev1 None None
PL-GIFT 0.08938 0.13006 0.02676 1.0 83.82 2022-11-07T16:40:07 2022-11-07T16:31:25 Rev1 None None
PL-GIFT 0.29009 0.32496 0.10695 1.0 83.85 2022-11-09T22:50:07 2022-11-09T22:49:06 Rev1 None None
PL-GIFT 0.05746 0.06468 0.01012 1.0 83.73 2022-11-11T19:00:07 2022-11-11T18:50:19 Rev1 None None
PL-GIFT 0.07544 0.12159 0.02363 1.0 83.9 2022-11-11T22:50:08 2022-11-11T22:44:14 Rev1 None None
PL-GIFT 0.08143 0.13207 0.02647 1.0 83.08 2022-11-15T17:20:14 2022-11-15T17:13:41 Rev1 None None
PL-GIFT 0.07852 0.10764 0.02078 1.0 83.69 2022-11-15T18:10:08 2022-11-15T18:03:02 Rev1 None None
PL-GIFT 0.1361 0.21533 0.0487 1.0 84.33 2022-11-15T20:40:07 2022-11-15T20:35:27 Rev1 None None
PL-GIFT 0.0106 0.00102 0.00011 1.0 86.7 2022-12-15T15:30:07 2022-12-15T15:24:46 Rev1 None None
PL-GIFT 0.01059 0.00101 0.00011 1.0 95.76 2022-12-20T19:08:08 2022-12-20T18:08:44 Rev1 None None
PL-GIFT 0.69315 0.0 0.25 0.5 2023-01-24T21:10:09 2023-01-24T21:07:09 Rev1 :No Results::Container File Missing: :Container Parameters (jsonschema checker):
Perspecta-PurdueRutgers 0.10536 0.0 0.01 1.0 3276.01 2022-10-03T07:10:08 2022-10-03T07:03:26 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.11108 0.01063 0.01125 1.0 3335.9 2022-10-04T21:30:08 2022-10-04T21:24:00 Rev1 :Container File Missing: :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.67775 0.37314 0.234 0.79167 2474.85 2022-10-14T05:30:09 2022-10-14T05:29:02 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.45803 0.17848 0.154 1.0 1074.43 2022-10-14T07:40:09 2022-10-14T07:39:48 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.10536 0.0 0.01 1.0 1702.59 2022-10-14T09:10:08 2022-10-14T09:04:24 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 2022-10-15T06:00:07 2022-10-15T05:57:13 Rev1 :Executed File Update::Info File Missing::Container File Missing: None
Perspecta-PurdueRutgers 0.3308 0.40751 0.09125 0.89583 3134.32 2022-10-15T20:50:09 2022-10-15T20:47:36 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.08373 0.01642 0.007 1.0 1659.9 2022-10-18T05:40:08 2022-10-18T05:33:54 Rev1 :Container File Missing: :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.10983 0.00339 0.01084 1.0 1640.69 2022-10-24T00:50:09 2022-10-24T00:41:14 Rev1 :Container File Missing: :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.10983 0.00339 0.01084 1.0 5220.01 2022-11-01T05:50:09 2022-11-01T03:51:19 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.10983 0.00339 0.01084 1.0 3818.45 2022-11-01T16:10:09 2022-11-01T16:06:40 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 42.5 2022-11-03T15:50:09 2022-11-03T15:49:58 Rev1 None None
Perspecta-PurdueRutgers 0.37625 0.11831 0.10675 1.0 114.68 2022-11-04T14:43:05 2022-11-03T23:08:36 Rev1 None None
Perspecta-PurdueRutgers 0.10983 0.00339 0.01084 1.0 2991.91 2022-11-04T19:00:09 2022-11-04T18:57:28 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 52.54 2022-11-05T17:30:09 2022-11-05T17:28:49 Rev1 :No Results: None
Perspecta-PurdueRutgers 0.34248 0.13594 0.09605 1.0 90.7 2022-11-06T20:40:09 2022-11-06T20:39:23 Rev1 None None
Perspecta-PurdueRutgers 0.09044 0.01981 0.00826 1.0 2974.03 2022-11-08T18:20:14 2022-11-08T18:16:08 Rev1 None :Container Parameters (learned parameters):
Perspecta-PurdueRutgers 0.55049 0.09903 0.18139 1.0 87.67 2022-11-11T16:50:10 2022-11-11T16:44:02 Rev1 None None
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 2022-11-15T21:50:09 2022-11-15T21:40:30 Rev1 :Executed File Update::No Results::Info File Missing::Container File Missing: None
Perspecta-PurdueRutgers 0.19949 0.15463 0.05531 1.0 95.73 2022-11-15T22:31:19 2022-11-15T22:23:56 Rev1 None None
Perspecta-PurdueRutgers 0.61681 0.0716 0.21225 0.875 92.64 2022-11-16T04:00:09 2022-11-16T03:51:01 Rev1 None None
Perspecta-PurdueRutgers 0.23014 0.19935 0.08043 1.0 92.42 2022-11-16T04:40:09 2022-11-16T04:31:04 Rev1 None None
Perspecta-PurdueRutgers 0.24011 0.15465 0.0673 1.0 92.62 2022-11-16T16:20:09 2022-11-16T16:12:58 Rev1 None None
Perspecta-PurdueRutgers 0.21181 0.16604 0.06443 1.0 92.39 2022-11-17T01:40:07 2022-11-17T01:38:36 Rev1 None None
Perspecta-PurdueRutgers 0.17007 0.16432 0.05278 1.0 92.32 2022-11-17T02:40:43 2022-11-17T02:39:46 Rev1 None None
Perspecta-PurdueRutgers 0.17672 0.16277 0.05366 1.0 92.7 2022-11-17T04:30:07 2022-11-17T04:20:21 Rev1 None None
Perspecta-PurdueRutgers 0.26568 0.18452 0.08569 1.0 98.04 2022-12-10T03:30:08 2022-12-10T03:28:47 Rev1 None None
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 89.75 2022-12-11T14:40:09 2022-12-11T14:38:45 Rev1 :No Results: None
Perspecta-PurdueRutgers 0.13863 0.17185 0.05 1.0 91.78 2022-12-11T16:20:08 2022-12-11T16:12:25 Rev1 None None
Perspecta-IUB 0.69315 0.0 0.25 0.5 66.27 2022-10-05T23:20:09 2022-10-05T23:19:25 Rev1 None None
Perspecta-IUB 0.69315 0.0 0.25 0.5 67.69 2022-10-06T01:10:09 2022-10-06T01:00:54 Rev1 None None
Perspecta-IUB 1.03784 0.81466 0.29067 0.5 152.31 2022-10-06T03:00:10 2022-10-06T02:56:53 Rev1 None None
Perspecta-IUB 0.69315 0.0 0.25 0.5 68.57 2022-10-06T04:20:09 2022-10-06T04:16:53 Rev1 None None
Perspecta-IUB 0.69315 0.0 0.25 0.5 71.76 2022-10-06T19:00:10 2022-10-06T18:58:43 Rev1 None None
Perspecta-IUB 0.69315 0.0 0.25 0.5 1405.4 2022-10-06T21:20:09 2022-10-06T21:11:45 Rev1 None None
Perspecta-IUB 0.17421 0.13729 0.048 1.0 1712.78 2022-10-06T22:50:09 2022-10-06T22:48:40 Rev1 None None
Perspecta-IUB 0.15665 0.1255 0.04211 1.0 1436.15 2022-10-07T02:50:09 2022-10-07T02:42:56 Rev1 None None
Perspecta-IUB 0.69315 0.0 0.25 0.5 2022-10-07T22:10:08 2022-10-07T22:10:00 Rev1 :Executed File Update::Info File Missing::Container File Missing: None
Perspecta-IUB 0.00234 0.00083 1e-05 1.0 1435.5 2022-10-08T01:50:08 2022-10-08T01:41:26 Rev1 None None
Perspecta-IUB 0.00787 0.0107 0.00034 1.0 1417.67 2022-10-08T02:30:10 2022-10-08T02:24:02 Rev1 None None
Perspecta-IUB 0.21078 0.19553 0.06301 1.0 1501.1 2022-10-09T22:00:09 2022-10-09T21:56:39 Rev1 None None
Perspecta-IUB 0.18093 0.24366 0.064 1.0 1441.74 2022-10-09T23:50:09 2022-10-09T23:46:26 Rev1 None None
Perspecta-IUB 0.1863 0.22723 0.06502 1.0 187.45 2022-10-10T18:00:09 2022-10-10T17:51:55 Rev1 None None
Perspecta-IUB 0.19405 0.13466 0.05351 1.0 1694.97 2022-10-11T17:50:23 2022-10-11T17:45:12 Rev1 None None
Perspecta-IUB 0.19251 0.1391 0.0523 1.0 2007.69 2022-10-12T13:32:33 2022-10-12T00:48:36 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 51.85 2022-10-06T19:30:10 2022-10-06T19:25:14 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 61.97 2022-10-06T21:20:10 2022-10-06T21:16:26 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 82.39 2022-10-06T22:20:10 2022-10-06T22:16:36 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 82.34 2022-10-07T05:50:10 2022-10-07T05:43:25 Rev1 None None
ARM-UCSD 0.22292 0.14573 0.058 1.0 198.3 2022-10-07T06:10:12 2022-10-07T06:05:52 Rev1 None None
ARM-UCSD 0.32508 0.40856 0.09 0.91667 201.95 2022-10-07T18:20:10 2022-10-07T18:15:40 Rev1 None None
ARM-UCSD 0.32508 0.40856 0.09 0.91667 415.03 2022-10-12T13:32:36 2022-10-11T23:57:26 Rev1 None None
ARM-UCSD 1.2086 0.53028 0.44385 0.5 109.17 2022-12-13T18:50:15 2022-12-13T18:43:24 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 2023-03-27T02:10:15 2023-03-27T02:08:59 Rev1 :No Results::Missing Results::Container File Missing: :Container Parameters (jsonschema checker):
ARM-UCSD 0.69315 0.0 0.25 0.5 60.05 2023-03-27T20:10:14 2023-03-27T20:06:37 Rev1 :No Results::Missing Results: None
ARM 0.69315 0.0 0.25 0.5 130.58 2022-10-17T19:00:10 2022-10-17T18:54:57 Rev1 None None
ARM 0.67295 0.33496 0.22489 0.83333 154.87 2022-10-17T20:29:59 2022-10-17T20:00:13 Rev1 :Container File Missing: None
ARM 0.60843 0.30525 0.19867 0.83333 142.27 2022-11-01T05:50:14 2022-11-01T06:52:33 Rev1 None None
ARM 0.60843 0.30525 0.19867 0.83333 142.27 2022-11-01T18:20:13 2022-11-01T18:00:29 Rev1 None None
ARM 0.60843 0.30525 0.19867 0.83333 142.02 2022-11-01T20:50:13 2022-11-01T20:40:16 Rev1 None None
ARM 0.69315 0.0 0.25 0.5 124.73 2022-11-28T04:40:17 2022-11-28T04:39:02 Rev1 :No Results: None
ARM 0.17945 0.03395 0.02873 1.0 142.38 2022-11-28T05:10:16 2022-11-28T05:03:08 Rev1 None None
ARM 0.69315 0.0 0.25 0.5 2023-03-28T04:40:19 2023-03-28T04:14:49 Rev1 :No Results::Missing Results::Info File Missing::Container File Missing: None
ARM 0.69315 0.0 0.25 0.5 2023-03-28T05:30:17 2023-03-28T05:22:48 Rev1 :No Results::Missing Results::Info File Missing::Container File Missing: None
ARM 0.69315 0.0 0.25 0.5 2023-04-01T00:20:17 2023-04-01T00:14:59 Rev1 :No Results::Missing Results::Container File Missing: :Container Parameters (jsonschema checker):
ARM 0.69315 0.0 0.25 0.5 2023-04-04T17:20:16 2023-04-04T17:16:33 Rev1 :No Results::Missing Results::Container File Missing: :Schema Header:
ARM 0.44259 0.31323 0.14193 0.91667 80.53 2023-04-04T18:00:17 2023-04-04T17:59:46 Rev1 None None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 98.59 2022-10-21T01:30:12 2022-10-21T01:22:39 Rev1 :Container File Missing: None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 98.57 2022-10-21T02:30:12 2022-10-21T02:26:54 Rev1 :Container File Missing: None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 98.6 2022-10-21T03:10:11 2022-10-21T03:08:37 Rev1 :Container File Missing: None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 98.35 2022-10-31T21:30:12 2022-10-31T21:14:17 Rev1 None None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 98.61 2022-11-01T16:30:56 2022-11-01T16:26:24 Rev1 None None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 97.6 2022-11-01T18:20:14 2022-11-01T17:53:57 Rev1 None None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 98.6 2022-11-01T19:00:14 2022-11-01T18:56:14 Rev1 None None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 132.7 2022-11-01T19:30:13 2022-11-01T19:22:07 Rev1 None None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 109.62 2022-11-01T22:10:14 2022-11-01T22:03:34 Rev1 None None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 112.62 2022-11-29T02:30:17 2022-11-29T02:28:33 Rev1 :No Results: None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 42.27 2022-11-29T03:31:13 2022-11-29T03:08:42 Rev1 :No Results: None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 42.05 2022-11-29T04:10:17 2022-11-29T04:01:50 Rev1 :No Results: None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 42.36 2022-11-29T04:40:17 2022-11-29T04:33:20 Rev1 :No Results: None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 42.02 2022-11-29T05:10:17 2022-11-29T05:01:48 Rev1 :No Results: None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 107.51 2022-11-29T05:41:01 2022-11-29T05:36:40 Rev1 :Result Parse::No Results: None
TrinitySRITrojAI-SBU 0.3605 0.18267 0.12165 1.0 113.01 2022-11-29T18:30:17 2022-11-29T18:27:38 Rev1 None None
TrinitySRITrojAI-SBU 0.26883 0.15055 0.07945 1.0 104.31 2022-12-12T22:00:17 2022-12-12T21:56:41 Rev1 None None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 2023-01-08T19:00:19 2023-01-08T18:55:02 Rev1 :No Results::Container File Missing: :Schema Header:
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 2023-01-10T02:30:21 2023-01-10T02:25:33 Rev1 :No Results::Container File Missing: :Schema Header:
ICSI-2 0.10425 0.02226 0.01071 1.0 215.83 2022-09-26T03:30:13 2022-09-26T03:21:28 Rev1 None None
ICSI-2 0.40206 0.252 0.13958 1.0 114.13 2022-10-03T02:50:23 2022-10-03T02:41:48 Rev1 None None
ICSI-2 0.05906 0.02135 0.00423 1.0 109.83 2022-10-04T04:30:12 2022-10-04T04:29:58 Rev1 None None
ICSI-2 0.06352 0.02138 0.00473 1.0 137.33 2022-10-10T08:20:15 2022-10-10T08:18:51 Rev1 None None
ICSI-2 0.04803 0.0323 0.00445 1.0 139.15 2022-10-11T20:20:15 2022-10-11T20:10:41 Rev1 None None
ICSI-2 0.17217 0.20058 0.05687 1.0 165.56 2022-10-13T01:30:14 2022-10-13T01:29:31 Rev1 None None
ICSI-2 0.14005 0.14438 0.04125 1.0 143.38 2022-10-14T01:50:17 2022-10-13T20:29:28 Rev1 None None
ICSI-2 0.15442 0.16011 0.04867 1.0 137.59 2022-10-14T23:20:23 2022-10-14T23:17:41 Rev1 None None
ICSI-2 0.12037 0.12021 0.03196 1.0 137.37 2022-10-15T21:00:13 2022-10-15T20:53:40 Rev1 None None
ICSI-2 0.03534 0.02349 0.00244 1.0 136.26 2022-10-16T05:40:14 2022-10-16T05:35:09 Rev1 None None
ICSI-2 0.04256 0.03763 0.00458 1.0 138.34 2022-10-25T21:10:14 2022-10-25T21:10:02 Rev1 :Container File Missing: None
ICSI-2 0.03431 0.03022 0.0031 1.0 174.26 2022-10-26T06:40:14 2022-10-26T06:39:30 Rev1 :Container File Missing: None
ICSI-2 0.02791 0.02287 0.00197 1.0 130.53 2022-11-09T18:50:19 2022-11-09T18:47:04 Rev1 None None
ICSI-2 0.01681 0.01354 0.00072 1.0 126.82 2022-11-14T23:30:20 2022-11-14T23:24:02 Rev1 None None
ICSI-2 0.04539 0.04701 0.00633 1.0 1028.83 2022-11-22T10:20:19 2022-11-22T10:19:46 Rev1 None None
ICSI-2 0.03404 0.0326 0.0034 1.0 411.35 2022-11-23T00:30:21 2022-11-23T00:27:22 Rev1 None None
ICSI-2 0.04264 0.04659 0.00602 1.0 2105.16 2022-11-23T23:10:20 2022-11-23T23:08:22 Rev1 None None
ICSI-2 0.24397 0.1877 0.08067 0.95833 6000.69 2022-12-04T00:00:21 2022-12-02T02:30:32 Rev1 None :Timeout:
ICSI-2 0.28665 0.206 0.10043 0.9375 6000.68 2022-12-12T21:50:19 2022-12-12T21:47:31 Rev1 None :Timeout:
ICSI-2 0.01813 0.0144 0.00082 1.0 1817.93 2022-12-13T03:30:17 2022-12-13T03:26:21 Rev1 None None
ICSI-2 0.69315 0.0 0.25 0.5 1560.34 2022-12-13T22:40:19 2022-12-13T22:31:02 Rev1 :No Results: None
ICSI-2 0.69315 0.0 0.25 0.5 1664.1 2022-12-14T03:00:21 2022-12-14T03:00:17 Rev1 :No Results: None
ICSI-2 0.01768 0.01459 0.00082 1.0 537.34 2022-12-14T04:40:20 2022-12-14T04:38:18 Rev1 None None
ICSI-2 0.02053 0.02098 0.00142 1.0 191.91 2022-12-15T06:50:20 2022-12-15T06:48:01 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 52.38 2022-10-28T19:30:15 2022-10-28T19:27:45 Rev1 :Container File Missing: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 52.33 2022-10-29T05:10:15 2022-10-28T21:13:14 Rev1 :Container File Missing: None
TrinitySRITrojAI-BostonU 0.49047 0.12879 0.15734 1.0 224.28 2022-10-29T06:50:15 2022-10-29T06:43:21 Rev1 :Container File Missing: None
TrinitySRITrojAI-BostonU 0.26979 0.10317 0.06495 1.0 319.35 2022-10-31T20:10:18 2022-10-31T20:01:29 Rev1 None None
TrinitySRITrojAI-BostonU 0.693 0.00044 0.24993 0.5 328.73 2022-11-02T02:10:19 2022-11-02T02:00:29 Rev1 None None
TrinitySRITrojAI-BostonU 0.31027 0.02827 0.07185 1.0 315.39 2022-11-02T06:30:54 2022-11-02T06:29:02 Rev1 None None
TrinitySRITrojAI-BostonU 0.31027 0.02827 0.07185 1.0 320.59 2022-11-02T19:00:21 2022-11-02T18:56:27 Rev1 None None
TrinitySRITrojAI-BostonU 0.26979 0.10317 0.06495 1.0 325.11 2022-11-03T05:50:22 2022-11-03T05:47:16 Rev1 None None
trojai-example 1.25867 0.63594 0.4195 0.375 131.05 2022-09-21T17:40:14 2022-09-21T17:39:18 Rev1 None None
trojai-example 0.69315 0.0 0.25 0.5 0.01 2022-09-27T16:50:18 2022-09-27T16:44:39 Rev1 :Container File Missing: :Execute::Copy Out:
trojai-example 0.98262 0.52056 0.35336 0.54167 130.01 2022-09-27T17:10:18 2022-09-27T17:02:51 Rev1 None None
trojai-example 0.69315 0.0 0.25 0.5 2022-09-28T18:00:18 2022-09-28T18:00:05 Rev1 :Info File Missing::Container File Missing: None
trojai-example 0.65689 0.22961 0.23136 0.66667 132.28 2022-09-28T18:20:18 2022-09-28T18:16:11 Rev1 None None
trojai-example 0.9352 0.3863 0.34494 0.47917 152.02 2022-09-28T19:10:18 2022-09-28T19:00:39 Rev1 None None
trojai-example 0.61578 0.27849 0.2172 0.75 155.32 2022-09-28T21:20:18 2022-09-28T21:11:57 Rev1 None None
trojai-example 0.55684 0.24684 0.19247 0.79167 152.1 2022-09-30T17:00:19 2022-09-30T16:59:47 Rev1 None None
trojai-example 1.07807 0.47955 0.38411 0.33333 152.1 2022-10-19T13:30:19 2022-10-19T13:28:02 Rev1 :Container File Missing: None
trojai-example 0.5584 0.20861 0.19462 0.8125 82.58 2022-12-07T19:48:42 2022-12-07T19:48:07 Rev1 None None
trojai-example 1.47047 0.69626 0.48868 0.3125 82.51 2022-12-08T16:40:24 2022-12-08T16:39:11 Rev1 None None
IIECAS 0.69315 0.0 0.25 0.5 61.07 2022-11-17T04:50:26 2022-11-17T05:03:38 Rev1 :No Results: None
IIECAS 8.42794 7.79351 0.35 0.5 240.68 2022-11-17T07:50:28 2022-11-17T07:49:03 Rev1 None None
IIECAS 13.81552 8.56295 0.5 0.16667 247.73 2022-11-17T11:50:28 2022-11-17T11:46:34 Rev1 None None
IIECAS 1.20397 0.68093 0.41 0.58333 392.51 2022-11-18T05:00:26 2022-11-18T04:59:14 Rev1 None None
IIECAS 0.69315 0.0 0.25 0.5 59.03 2022-11-18T08:00:26 2022-11-18T07:53:01 Rev1 :No Results: None
IIECAS 0.69315 0.0 0.25 0.5 59.97 2022-11-18T09:50:27 2022-11-18T09:45:38 Rev1 :No Results: None
IIECAS 1.20397 0.68093 0.41 0.58333 3416.16 2022-11-18T11:00:28 2022-11-18T10:52:48 Rev1 None None
IIECAS 0.57559 0.14573 0.202 0.75 404.2 2022-11-23T10:00:30 2022-11-23T09:58:26 Rev1 None None
IIECAS 0.57559 0.14573 0.202 0.75 424.99 2022-11-23T13:30:30 2022-11-23T13:24:16 Rev1 None None
IIECAS 0.69315 0.0 0.25 0.5 2022-11-23T14:00:30 2022-11-23T13:50:58 Rev1 :No Results::Info File Missing::Container File Missing: None
IIECAS 0.57559 0.14573 0.202 0.75 412.25 2022-11-23T16:10:30 2022-11-23T16:10:06 Rev1 None None
IIECAS 0.57559 0.14573 0.202 0.75 426.15 2022-11-23T17:50:30 2022-11-23T17:47:26 Rev1 None None
IIECAS 0.57559 0.14573 0.202 0.75 513.69 2022-11-24T04:40:29 2022-11-24T04:31:39 Rev1 None None
IIECAS 0.69315 0.0 0.25 0.5 2022-11-24T12:00:30 2022-11-24T11:55:02 Rev1 :No Results::Info File Missing::Container File Missing: None
IIECAS 0.57559 0.14573 0.202 0.75 496.63 2022-11-24T12:40:29 2022-11-24T12:34:38 Rev1 None None
IIECAS 0.57559 0.14573 0.202 0.75 459.27 2022-11-24T17:10:30 2022-11-24T17:05:42 Rev1 None None
IIECAS 0.69315 0.0 0.25 0.5 92.23 2022-11-26T08:10:30 2022-11-26T08:06:40 Rev1 :No Results: None
IIECAS 0.69315 0.0 0.25 0.5 2022-11-26T09:30:30 2022-11-26T09:28:44 Rev1 :No Results::Info File Missing::Container File Missing: None
IIECAS 0.69315 0.0 0.25 0.5 2022-11-26T10:30:30 2022-11-26T10:21:12 Rev1 :No Results::Info File Missing::Container File Missing: None
IIECAS 0.69315 0.0 0.25 0.5 91.97 2022-11-26T11:20:30 2022-11-26T11:12:32 Rev1 :No Results: None
IIECAS 0.57559 0.14573 0.202 0.75 464.97 2022-11-26T12:30:32 2022-11-26T12:28:44 Rev1 None None
IIECAS 0.51681 0.16695 0.178 0.79167 462.64 2022-11-26T14:20:30 2022-11-26T14:18:48 Rev1 None None
IIECAS 0.69315 0.0 0.25 0.5 2022-11-26T15:30:29 2022-11-26T15:30:17 Rev1 :No Results::Info File Missing::Container File Missing: None
IIECAS 0.51681 0.16695 0.178 0.79167 511.03 2022-11-26T16:30:29 2022-11-26T16:25:20 Rev1 None None
IIECAS 0.51681 0.16695 0.178 0.79167 1429.5 2022-11-27T03:30:29 2022-11-27T03:29:03 Rev1 None None
IIECAS 0.54481 0.54474 0.17 0.75 2576.02 2022-11-27T06:40:36 2022-11-27T06:39:55 Rev1 None None
IIECAS 0.54481 0.54474 0.17 0.75 1896.66 2022-11-27T11:10:28 2022-11-27T11:02:27 Rev1 None None
IIECAS 0.54481 0.54474 0.17 0.75 1830.4 2022-11-28T14:20:31 2022-11-28T14:16:24 Rev1 None None
UMBCb 0.588 0.1539 0.20394 0.70833 133.11 2022-10-31T18:40:25 2022-10-31T18:31:33 Rev1 :Container File Missing: None
UMBCb 7.89749 6.54432 0.53367 0.58333 193.37 2022-11-02T20:10:30 2022-11-02T17:11:22 Rev1 None None

Required filename format: "image-classification-sep2022_dev_<Submission Name>.simg"
Accepting submissions: True
Number of models in image-classification-sep2022, dev: 216
Execution timeout (hh:mm:ss): 1 day, 12:00:00

Teams/Jobs

Team Submission Timestamp Type Job Status File Status General Status File Timestamp Time until next execution
Perspecta performer None None Ok None 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI performer None None Ok None 0 d, 0 h, 0 m, 0 s
DRAFFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
PL-GIFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers performer None None Ok None 0 d, 0 h, 0 m, 0 s
Perspecta-IUB performer None None Ok None 0 d, 0 h, 0 m, 0 s
ARM-UCSD performer None None Ok None 0 d, 0 h, 0 m, 0 s
ARM performer None None Ok None 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU performer None None Ok None 0 d, 0 h, 0 m, 0 s
ARM-UMBC performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-1 performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-2 performer None None Ok None 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU performer None None Ok None 0 d, 0 h, 0 m, 0 s
trojai-example public None None Ok None 0 d, 0 h, 0 m, 0 s
IceTorch public None None Ok None 0 d, 0 h, 0 m, 0 s
trojaicy public None None Ok None 0 d, 0 h, 0 m, 0 s
Hector public None None Ok None 0 d, 0 h, 0 m, 0 s
Cassandra-XF public None None Ok None 0 d, 0 h, 0 m, 0 s
gooddefense public None None Ok None 0 d, 0 h, 0 m, 0 s
cyberinfrastructure public None None Ok None 0 d, 0 h, 0 m, 0 s
glaros public None None Ok None 0 d, 0 h, 0 m, 0 s
Ultraman public None None Ok None 0 d, 0 h, 0 m, 0 s
BackSec public None None Ok None 0 d, 0 h, 0 m, 0 s
Palladium public None None Ok None 0 d, 0 h, 0 m, 0 s
IIECAS public None None Ok None 0 d, 0 h, 0 m, 0 s
NSEC public None None Ok None 0 d, 0 h, 0 m, 0 s
UMBCb performer None None Ok None 0 d, 0 h, 0 m, 0 s
PASS public None None Ok None 0 d, 0 h, 0 m, 0 s
DS3TwoSixZero public None None Ok None 0 d, 0 h, 0 m, 0 s
dongdong4fei public None None Ok None 0 d, 0 h, 0 m, 0 s

Best Results based on Cross Entropy

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors

All Results

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors

Round 12 leaderboard for cyber PDF December 2022.

Each AI is trained to scan a feature vector, corresponding to a PDF file, to determine whether the PDF contains malware. For those AIs that have been attacked, the presence of a trigger watermark on a malware feature vector will cause the AI to reliably misclassify the PDF as benign. The Round 12 Training Data Download consists of 120 reference AIs (exactly 50% are poisoned) with example input data. More info here.

PDF file icon

train: The train dataset that is distributed with each round.
test: The test dataset that is sequestered/hidden, used for evaluation. Submissions here should be fully realized with complete schema and parameters.
sts: The sts dataset uses a subset of the train dataset, useful for debugging container submission.
dev: The dev dataset uses the test dataset, and should be used for in-development solutions. Schemas must be valid, but do not need to be complete. Results do not count towards the program.

Required filename format: "cyber-pdf-dec2022_train_<Submission Name>.simg"
Accepting submissions: True
Number of models in cyber-pdf-dec2022, train: 120
Execution timeout (hh:mm:ss): 20:00:00

Teams/Jobs

Team Submission Timestamp Type Job Status File Status General Status File Timestamp Time until next execution
Perspecta 2023-03-07T18:10:05 performer None None Ok 2023-03-07T18:08:26 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI 2023-03-17T21:50:06 performer None None Ok 2023-03-17T21:49:35 0 d, 0 h, 0 m, 0 s
DRAFFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
PL-GIFT 2023-02-27T19:30:07 performer None None Ok 2023-02-27T19:26:23 0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers 2023-01-20T02:50:10 performer None None Ok 2023-01-20T02:47:02 0 d, 0 h, 0 m, 0 s
Perspecta-IUB 2023-02-22T03:40:59 performer None None Ok 2023-02-22T03:35:07 0 d, 0 h, 0 m, 0 s
ARM-UCSD 2023-03-28T03:01:04 performer None None Ok 2023-03-28T02:54:42 0 d, 0 h, 0 m, 0 s
ARM 2023-03-07T18:40:21 performer None None Ok 2023-03-07T18:32:05 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU 2023-03-08T01:30:24 performer None None Ok 2023-03-08T01:29:04 0 d, 0 h, 0 m, 0 s
ARM-UMBC performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-1 performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-2 2023-02-22T21:20:23 performer None None Ok 2023-02-22T21:15:18 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU 2023-03-14T19:30:27 performer None None Ok 2023-03-14T19:29:08 0 d, 0 h, 0 m, 0 s
trojai-example 2022-12-17T01:19:20 public None None Ok 2022-12-17T01:15:03 0 d, 0 h, 0 m, 0 s
IceTorch public None None Ok None 0 d, 0 h, 0 m, 0 s
trojaicy public None None Ok None 0 d, 0 h, 0 m, 0 s
Hector public None None Ok None 0 d, 0 h, 0 m, 0 s
Cassandra-XF public None None Ok None 0 d, 0 h, 0 m, 0 s
gooddefense public None None Ok None 0 d, 0 h, 0 m, 0 s
cyberinfrastructure public None None Ok None 0 d, 0 h, 0 m, 0 s
glaros public None None Ok None 0 d, 0 h, 0 m, 0 s
Ultraman public None None Ok None 0 d, 0 h, 0 m, 0 s
BackSec public None None Ok None 0 d, 0 h, 0 m, 0 s
Palladium public None None Ok None 0 d, 0 h, 0 m, 0 s
IIECAS public None None Ok None 0 d, 0 h, 0 m, 0 s
NSEC public None None Ok None 0 d, 0 h, 0 m, 0 s
UMBCb 2023-04-17T18:00:32 performer None None Ok 2023-04-17T17:56:18 0 d, 0 h, 0 m, 0 s
PASS public None None Ok None 0 d, 0 h, 0 m, 0 s
DS3TwoSixZero public None None Ok None 0 d, 0 h, 0 m, 0 s
dongdong4fei public None None Ok None 0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.08691 0.01185 0.00899 1.0 1718.63 2023-01-18T15:30:05 2023-01-18T15:24:47 Rev1 None None
TrinitySRITrojAI 0.11302 0.00962 0.01326 1.0 2367.42 2023-01-05T20:00:06 2023-01-05T19:57:36 Rev1 None None
PL-GIFT 0.0 0.0 0.0 1.0 1562.98 2022-12-22T01:00:08 2022-12-22T00:58:23 Rev1 None None
Perspecta-PurdueRutgers 0.08418 0.00985 0.00865 1.0 722.61 2023-01-09T17:00:10 2023-01-09T16:54:11 Rev1 None None
Perspecta-IUB 0.20625 0.01009 0.03635 1.0 721.12 2022-12-22T04:20:09 2022-12-22T04:15:36 Rev1 None None
ARM-UCSD 0.0 0.0 0.0 1.0 655.81 2023-01-30T07:40:18 2023-01-30T07:31:28 Rev1 None None
ARM 0.15302 0.0222 0.02839 1.0 842.55 2023-01-27T21:51:08 2023-01-27T21:41:02 Rev1 None None
TrinitySRITrojAI-SBU 0.0633 0.01153 0.00666 1.0 1682.83 2023-02-21T21:45:10 2023-02-21T21:39:55 Rev1 None None
ICSI-2 0.01037 0.00055 0.00012 1.0 612.68 2023-01-06T06:50:21 2023-01-06T06:46:27 Rev1 None None
TrinitySRITrojAI-BostonU 0.00437 0.0006 3e-05 1.0 1710.5 2023-01-19T07:10:23 2023-01-19T07:01:26 Rev1 None None
trojai-example 0.77147 0.07322 0.28477 0.49125 721.8 2022-12-17T01:19:20 2022-12-17T01:15:03 Rev1 None None
UMBCb 0.2495 0.00287 0.04887 1.0 221.23 2023-03-16T15:00:32 2023-03-16T14:58:32 Rev1 None None

All Results

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.00566 0.00088 6e-05 1.0 1201.9 2023-01-03T21:50:04 2023-01-03T21:43:42 Rev1 None None
Perspecta 0.09663 0.04114 0.02333 0.99792 1562.53 2023-01-04T18:50:05 2023-01-04T18:42:32 Rev1 None None
Perspecta 0.07677 0.03949 0.01958 1.0 1562.64 2023-01-05T15:40:05 2023-01-05T15:36:11 Rev1 None None
Perspecta 0.04925 0.02419 0.00961 1.0 1562.64 2023-01-10T18:10:05 2023-01-10T18:08:25 Rev1 None None
Perspecta 0.05131 0.02596 0.01055 1.0 1562.78 2023-01-11T15:40:05 2023-01-11T15:35:21 Rev1 None None
Perspecta 0.00565 0.00078 5e-05 1.0 1562.67 2023-01-11T20:00:05 2023-01-11T19:50:59 Rev1 None None
Perspecta 0.06015 0.01046 0.00596 1.0 1562.6 2023-01-12T19:50:05 2023-01-12T19:44:09 Rev1 None None
Perspecta 0.01071 0.00063 0.00013 1.0 1562.57 2023-01-12T22:30:05 2023-01-12T22:29:31 Rev1 None None
Perspecta 0.05129 0.0 0.0025 1.0 1562.81 2023-01-13T15:40:05 2023-01-13T15:37:07 Rev1 None None
Perspecta 0.06344 0.00735 0.00493 1.0 1562.57 2023-01-13T18:30:05 2023-01-13T18:21:16 Rev1 None None
Perspecta 0.09009 0.01279 0.01006 1.0 1668.75 2023-01-16T22:00:04 2023-01-16T21:56:54 Rev1 None None
Perspecta 0.08158 0.00643 0.00698 1.0 1672.29 2023-01-17T14:10:05 2023-01-17T14:01:07 Rev1 None None
Perspecta 0.08691 0.01185 0.00899 1.0 1718.63 2023-01-18T15:30:05 2023-01-18T15:24:47 Rev1 None None
Perspecta 0.08613 0.0109 0.00864 1.0 1727.69 2023-01-31T00:40:04 2023-01-31T00:34:29 Rev1 None None
Perspecta 0.07257 0.0 0.0049 1.0 1722.39 2023-01-31T02:10:04 2023-01-31T02:02:09 Rev1 None None
Perspecta 0.07834 0.00415 0.00604 1.0 1719.75 2023-02-01T00:50:04 2023-02-01T00:48:19 Rev1 None None
Perspecta 0.07257 0.0 0.0049 1.0 1716.14 2023-02-07T18:40:04 2023-02-07T18:38:40 Rev1 None None
Perspecta 0.08122 0.00356 0.00638 1.0 1727.89 2023-02-21T19:02:53 2023-02-21T19:02:33 Rev1 None None
Perspecta 0.05129 0.0 0.0025 1.0 1725.91 2023-03-03T15:40:04 2023-03-03T15:38:40 Rev1 None None
Perspecta 0.05129 0.0 0.0025 1.0 1730.16 2023-03-07T18:10:05 2023-03-07T18:08:26 Rev1 None None
TrinitySRITrojAI 0.40031 0.11624 0.12841 0.91986 2473.48 2022-12-20T00:20:06 2022-12-20T00:14:31 Rev1 None None
TrinitySRITrojAI 0.96107 0.2947 0.24786 0.92444 2924.04 2022-12-20T16:27:12 2022-12-20T16:20:56 Rev1 None None
TrinitySRITrojAI 0.11302 0.00962 0.01326 1.0 2367.42 2023-01-05T20:00:06 2023-01-05T19:57:36 Rev1 None None
TrinitySRITrojAI 0.07875 0.02078 0.01399 1.0 2118.8 2023-02-03T04:20:06 2023-02-03T04:13:58 Rev1 None None
TrinitySRITrojAI 0.16295 0.03327 0.03636 0.99833 1682.85 2023-02-10T23:50:07 2023-02-10T23:47:16 Rev1 None None
TrinitySRITrojAI 0.226 0.04563 0.05496 0.98833 557.39 2023-03-17T21:50:06 2023-03-17T21:49:35 Rev1 None None
PL-GIFT 0.0 0.0 0.0 1.0 1562.98 2022-12-22T01:00:08 2022-12-22T00:58:23 Rev1 None None
PL-GIFT 0.161 0.12046 0.04345 0.98375 1562.55 2023-01-11T03:50:09 2023-01-11T03:46:57 Rev1 None None
PL-GIFT 0.00051 0.0004 1e-05 1.0 1564.37 2023-01-14T03:30:08 2023-01-14T03:23:08 Rev1 None None
PL-GIFT 0.00063 0.00021 0.0 1.0 1562.68 2023-01-16T19:00:08 2023-01-16T18:57:00 Rev1 None None
PL-GIFT 0.00166 0.0003 1e-05 1.0 1563.03 2023-01-17T16:50:08 2023-01-17T16:49:35 Rev1 None None
PL-GIFT 0.00198 0.00035 1e-05 1.0 1562.7 2023-01-17T18:10:09 2023-01-17T18:06:04 Rev1 None None
PL-GIFT 0.00561 0.00099 6e-05 1.0 1562.76 2023-01-18T15:50:08 2023-01-18T15:47:42 Rev1 None None
PL-GIFT 0.02576 0.00458 0.00125 1.0 1564.05 2023-01-18T17:10:09 2023-01-18T17:03:24 Rev1 None None
PL-GIFT 0.01362 0.0049 0.00077 1.0 1562.68 2023-01-19T17:10:08 2023-01-19T17:01:45 Rev1 None None
PL-GIFT 0.00608 0.00107 7e-05 1.0 1562.82 2023-01-19T20:30:08 2023-01-19T20:28:23 Rev1 None None
PL-GIFT 0.01005 0.0 0.0001 1.0 1562.65 2023-01-27T20:50:08 2023-01-27T20:46:49 Rev1 None None
PL-GIFT 0.02697 0.00483 0.00138 1.0 1562.53 2023-02-06T22:50:08 2023-02-06T22:46:39 Rev1 None None
PL-GIFT 0.01583 0.00283 0.00049 1.0 1562.55 2023-02-07T02:10:07 2023-02-07T02:04:27 Rev1 None None
PL-GIFT 13.81552 2.47191 0.5 0.0 1562.53 2023-02-07T23:50:07 2023-02-07T23:45:48 Rev1 None None
PL-GIFT 0.02695 0.00482 0.00138 1.0 1562.59 2023-02-08T02:40:07 2023-02-08T02:30:58 Rev1 None None
PL-GIFT 0.02288 0.00409 0.001 1.0 1564.66 2023-02-14T23:10:07 2023-02-14T23:09:55 Rev1 None None
PL-GIFT 0.01582 0.00283 0.00048 1.0 1562.59 2023-02-27T19:30:07 2023-02-27T19:26:23 Rev1 None None
Perspecta-PurdueRutgers 0.19999 0.01898 0.03814 1.0 721.17 2023-01-09T04:30:10 2023-01-09T04:29:12 Rev1 None None
Perspecta-PurdueRutgers 0.08418 0.00985 0.00865 1.0 722.61 2023-01-09T17:00:10 2023-01-09T16:54:11 Rev1 None None
Perspecta-PurdueRutgers 0.51244 0.0778 0.17082 0.86194 1007.33 2023-01-09T18:30:10 2023-01-09T18:20:49 Rev1 None None
Perspecta-PurdueRutgers 0.06007 0.00858 0.00521 1.0 1681.38 2023-01-11T21:10:09 2023-01-11T21:05:12 Rev1 None None
Perspecta-PurdueRutgers 0.0 0.0 0.0 1.0 1681.42 2023-01-12T04:10:09 2023-01-12T04:09:29 Rev1 None None
Perspecta-PurdueRutgers 0.04568 0.00703 0.00326 1.0 1680.51 2023-01-12T15:30:11 2023-01-12T15:22:35 Rev1 None None
Perspecta-PurdueRutgers 0.04169 0.00746 0.0032 1.0 1681.5 2023-01-12T18:40:10 2023-01-12T18:39:26 Rev1 None None
Perspecta-PurdueRutgers 0.09833 0.01098 0.0114 1.0 1679.49 2023-01-17T16:00:10 2023-01-17T15:50:39 Rev1 None None
Perspecta-PurdueRutgers 0.04253 0.0069 0.00297 1.0 1682.51 2023-01-19T19:30:09 2023-01-19T19:23:56 Rev1 None None
Perspecta-PurdueRutgers 0.05973 0.00909 0.00536 1.0 1679.51 2023-01-20T02:00:10 2023-01-20T01:57:56 Rev1 None None
Perspecta-PurdueRutgers 0.05973 0.00909 0.00536 1.0 1682.45 2023-01-20T02:50:10 2023-01-20T02:47:02 Rev1 None None
Perspecta-IUB 0.20625 0.01009 0.03635 1.0 721.12 2022-12-22T04:20:09 2022-12-22T04:15:36 Rev1 None None
Perspecta-IUB 0.6908 0.01302 0.24883 0.55069 721.13 2022-12-22T06:10:09 2022-12-22T06:02:15 Rev1 None None
Perspecta-IUB 0.20235 0.01001 0.03515 1.0 721.14 2022-12-22T15:30:08 2022-12-22T15:26:57 Rev1 None None
Perspecta-IUB 0.20625 0.01009 0.03635 1.0 721.13 2022-12-22T16:20:10 2022-12-22T16:17:06 Rev1 None None
Perspecta-IUB 0.20807 0.01127 0.03724 1.0 721.07 2022-12-22T17:00:53 2022-12-22T16:59:47 Rev1 None None
Perspecta-IUB 0.20986 0.01052 0.03753 1.0 721.14 2022-12-22T21:20:10 2022-12-22T21:16:13 Rev1 None None
Perspecta-IUB 0.19326 0.02506 0.04072 1.0 721.12 2022-12-22T22:00:46 2022-12-22T22:00:27 Rev1 None None
Perspecta-IUB 0.20196 0.0271 0.04472 1.0 721.12 2022-12-23T00:00:09 2022-12-22T23:56:50 Rev1 None None
Perspecta-IUB 0.20583 0.04457 0.05257 0.98917 721.28 2022-12-26T22:00:10 2022-12-26T21:53:57 Rev1 None None
Perspecta-IUB 0.16279 0.08496 0.05168 0.98514 721.32 2023-01-08T22:00:10 2023-01-08T22:00:02 Rev1 None None
Perspecta-IUB 0.13407 0.08799 0.04131 0.99333 721.35 2023-01-08T22:30:10 2023-01-08T22:23:34 Rev1 None None
Perspecta-IUB 0.24641 0.10146 0.07292 0.95958 721.37 2023-01-09T06:10:11 2023-01-09T06:07:56 Rev1 None None
Perspecta-IUB 0.22933 0.09522 0.06568 0.96875 721.31 2023-01-09T07:00:11 2023-01-09T06:50:44 Rev1 None None
Perspecta-IUB 0.21047 0.0438 0.05351 0.98889 721.32 2023-01-09T15:00:11 2023-01-09T14:57:44 Rev1 None None
Perspecta-IUB 0.12591 0.0324 0.02836 0.99806 721.34 2023-01-10T05:20:11 2023-01-10T05:18:47 Rev1 None None
Perspecta-IUB 0.03346 0.01571 0.00518 1.0 721.31 2023-01-10T05:42:37 2023-01-10T05:40:51 Rev1 None None
Perspecta-IUB 0.0 0.0 0.0 1.0 721.47 2023-01-13T05:00:10 2023-01-13T04:54:04 Rev1 None None
Perspecta-IUB 0.0 0.0 0.0 1.0 721.47 2023-01-13T05:50:10 2023-01-13T05:46:18 Rev1 None None
Perspecta-IUB 0.0 0.0 0.0 1.0 721.33 2023-01-13T14:10:10 2023-01-13T14:05:18 Rev1 None None
Perspecta-IUB 0.05129 0.0 0.0025 1.0 721.24 2023-01-13T14:51:42 2023-01-13T14:45:01 Rev1 None None
Perspecta-IUB 0.05129 0.0 0.0025 1.0 721.31 2023-01-13T16:00:10 2023-01-13T15:55:46 Rev1 None None
Perspecta-IUB 0.03355 0.013 0.00501 1.0 1682.46 2023-02-22T02:20:11 2023-02-22T02:19:45 Rev1 None None
Perspecta-IUB 0.14775 0.05817 0.04285 0.98944 721.42 2023-02-22T03:40:59 2023-02-22T03:35:07 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 890.81 2023-01-28T07:33:12 2023-01-28T07:27:58 Rev1 None None
ARM-UCSD 0.0 0.0 0.0 1.0 655.81 2023-01-30T07:40:18 2023-01-30T07:31:28 Rev1 None None
ARM-UCSD 9e-05 2e-05 0.0 1.0 721.34 2023-02-22T04:50:17 2023-02-22T04:43:46 Rev1 None None
ARM-UCSD 9e-05 2e-05 0.0 1.0 721.37 2023-02-28T00:50:18 2023-02-28T00:48:03 Rev1 None None
ARM-UCSD 0.09682 0.02563 0.01862 0.99972 721.39 2023-03-01T22:20:17 2023-03-01T22:16:53 Rev1 None None
ARM-UCSD 10.13138 2.3824 0.36667 0.26667 1202.68 2023-03-01T23:20:17 2023-03-01T23:15:35 Rev1 None None
ARM-UCSD 11.74319 2.44394 0.425 0.4125 1209.77 2023-03-02T00:50:17 2023-03-02T00:45:54 Rev1 None None
ARM-UCSD 0.0 0.0 0.0 1.0 806.72 2023-03-20T19:20:17 2023-03-20T19:18:10 Rev1 None None
ARM-UCSD 0.0 0.0 0.0 1.0 818.59 2023-03-20T23:10:18 2023-03-20T23:00:14 Rev1 None None
ARM-UCSD 0.0 0.0 0.0 1.0 766.44 2023-03-26T00:40:18 2023-03-26T00:39:36 Rev1 None None
ARM-UCSD 11.74319 2.44394 0.425 0.15 759.9 2023-03-28T02:41:06 2023-03-28T02:34:06 Rev1 None None
ARM-UCSD 0.0 0.0 0.0 1.0 747.16 2023-03-28T03:01:04 2023-03-28T02:54:42 Rev1 None None
ARM 0.15302 0.0222 0.02839 1.0 842.55 2023-01-27T21:51:08 2023-01-27T21:41:02 Rev1 None None
ARM 0.38659 0.04736 0.11528 0.95097 1682.95 2023-01-30T05:42:16 2023-01-30T05:31:46 Rev1 None None
ARM 0.29844 0.03951 0.08059 0.99069 1684.29 2023-02-07T05:40:22 2023-02-07T05:33:21 Rev1 None None
ARM 0.13365 0.06718 0.0367 0.99194 2644.53 2023-02-21T19:40:22 2023-02-21T19:33:03 Rev1 None None
ARM 0.10772 0.05816 0.03051 0.99389 2641.24 2023-02-28T20:00:23 2023-02-28T19:51:20 Rev1 None None
ARM 0.05756 0.04348 0.02068 0.99806 1803.03 2023-03-02T03:10:22 2023-03-02T03:05:28 Rev1 None None
ARM 0.06836 0.03774 0.01752 0.99833 1904.95 2023-03-02T04:20:22 2023-03-02T04:14:42 Rev1 None None
ARM 0.25592 0.44957 0.01709 0.98278 1902.02 2023-03-07T15:20:21 2023-03-07T15:15:51 Rev1 None None
ARM 0.06702 0.03601 0.01759 0.99847 2040.37 2023-03-07T18:40:21 2023-03-07T18:32:05 Rev1 None None
TrinitySRITrojAI-SBU 0.32367 0.05743 0.0937 0.95972 1683.09 2023-02-12T03:10:22 2023-02-12T03:09:37 Rev1 None None
TrinitySRITrojAI-SBU 0.32043 0.02285 0.07871 0.99764 1683.08 2023-02-21T20:51:11 2023-02-21T20:45:45 Rev1 None None
TrinitySRITrojAI-SBU 0.0633 0.01153 0.00666 1.0 1682.83 2023-02-21T21:45:10 2023-02-21T21:39:55 Rev1 None None
TrinitySRITrojAI-SBU 0.09722 0.00952 0.01051 1.0 1683.16 2023-02-22T08:30:21 2023-02-22T08:22:01 Rev1 None None
TrinitySRITrojAI-SBU 0.19435 0.01943 0.03643 1.0 1682.86 2023-02-22T21:30:22 2023-02-22T21:23:20 Rev1 None None
TrinitySRITrojAI-SBU 0.09953 0.01387 0.0128 1.0 1682.81 2023-02-23T00:40:25 2023-02-23T00:32:53 Rev1 None None
TrinitySRITrojAI-SBU 0.14249 0.01152 0.01996 1.0 1682.92 2023-02-23T01:30:22 2023-02-23T01:28:02 Rev1 None None
TrinitySRITrojAI-SBU 0.29397 0.05918 0.08506 0.95972 1682.96 2023-03-07T03:10:24 2023-03-07T03:02:38 Rev1 None None
TrinitySRITrojAI-SBU 0.06283 0.00882 0.00552 1.0 1682.67 2023-03-07T04:30:24 2023-03-07T04:27:23 Rev1 None None
TrinitySRITrojAI-SBU 0.2252 0.02376 0.04684 0.99944 1683.0 2023-03-07T05:30:24 2023-03-07T05:28:18 Rev1 None None
TrinitySRITrojAI-SBU 0.30069 0.03687 0.07441 0.98889 1682.98 2023-03-07T06:51:33 2023-03-07T06:40:38 Rev1 None None
TrinitySRITrojAI-SBU 0.22655 0.03401 0.05349 0.995 1689.24 2023-03-07T08:01:18 2023-03-07T07:56:48 Rev1 None None
TrinitySRITrojAI-SBU 0.11293 0.01364 0.01489 1.0 1682.81 2023-03-07T08:50:24 2023-03-07T08:47:24 Rev1 None None
TrinitySRITrojAI-SBU 0.18769 0.01839 0.03453 1.0 1682.82 2023-03-07T10:01:40 2023-03-07T09:57:13 Rev1 None None
TrinitySRITrojAI-SBU 0.14087 0.01034 0.01917 1.0 1685.06 2023-03-07T11:11:11 2023-03-07T11:10:38 Rev1 None None
TrinitySRITrojAI-SBU 0.13944 0.01112 0.01913 1.0 1682.67 2023-03-07T22:00:24 2023-03-07T21:57:04 Rev1 None None
TrinitySRITrojAI-SBU 0.14928 0.01101 0.02132 1.0 1682.81 2023-03-07T23:40:24 2023-03-07T23:34:50 Rev1 None None
TrinitySRITrojAI-SBU 0.18521 0.0227 0.03535 1.0 1683.27 2023-03-08T00:30:24 2023-03-08T00:25:31 Rev1 None None
TrinitySRITrojAI-SBU 0.07252 0.01547 0.00926 1.0 1682.83 2023-03-08T01:30:24 2023-03-08T01:29:04 Rev1 None None
ICSI-2 0.26168 0.02563 0.06025 0.99944 618.7 2023-01-06T02:00:21 2023-01-06T01:59:12 Rev1 None None
ICSI-2 0.01037 0.00055 0.00012 1.0 612.68 2023-01-06T06:50:21 2023-01-06T06:46:27 Rev1 None None
ICSI-2 0.00391 0.00034 2e-05 1.0 613.68 2023-01-07T01:40:20 2023-01-07T01:37:42 Rev1 None None
ICSI-2 0.01889 0.00137 0.00041 1.0 608.6 2023-01-12T03:30:21 2023-01-12T03:24:00 Rev1 None None
ICSI-2 0.02352 0.00201 0.00066 1.0 629.75 2023-01-16T04:50:20 2023-01-16T04:46:56 Rev1 None None
ICSI-2 0.00408 0.00035 2e-05 1.0 607.66 2023-01-17T05:30:22 2023-01-17T05:23:27 Rev1 None None
ICSI-2 0.00351 0.0003 2e-05 1.0 637.71 2023-01-18T07:30:20 2023-01-18T07:27:46 Rev1 None None
ICSI-2 0.01139 0.00135 0.00018 1.0 672.88 2023-01-18T20:30:22 2023-01-18T20:25:15 Rev1 None None
ICSI-2 0.02222 0.00854 0.00213 1.0 678.84 2023-01-20T01:00:21 2023-01-20T00:52:25 Rev1 None None
ICSI-2 0.00165 0.00033 1e-05 1.0 654.87 2023-01-20T09:50:22 2023-01-20T09:49:07 Rev1 None None
ICSI-2 0.00375 0.00032 2e-05 1.0 642.7 2023-01-20T23:50:23 2023-01-20T23:46:33 Rev1 None None
ICSI-2 0.00317 0.00027 1e-05 1.0 625.65 2023-01-21T00:50:22 2023-01-21T00:47:15 Rev1 None None
ICSI-2 0.003 0.00023 1e-05 1.0 605.66 2023-01-26T00:40:27 2023-01-26T00:33:56 Rev1 None None
ICSI-2 0.00803 0.00032 7e-05 1.0 611.67 2023-02-02T07:10:27 2023-02-02T07:09:51 Rev1 None None
ICSI-2 0.00471 0.00052 3e-05 1.0 715.98 2023-02-02T22:50:25 2023-02-02T22:43:31 Rev1 None None
ICSI-2 0.00657 0.00031 5e-05 1.0 606.65 2023-02-03T00:40:26 2023-02-03T00:34:11 Rev1 None None
ICSI-2 0.0001 1e-05 0.0 1.0 632.68 2023-02-03T04:50:24 2023-02-03T04:46:00 Rev1 None None
ICSI-2 0.00028 2e-05 0.0 1.0 623.75 2023-02-03T08:20:25 2023-02-03T08:17:49 Rev1 None None
ICSI-2 0.00023 1e-05 0.0 1.0 697.89 2023-02-03T08:50:25 2023-02-03T08:47:45 Rev1 None None
ICSI-2 9e-05 1e-05 0.0 1.0 607.69 2023-02-04T03:31:32 2023-02-04T03:26:43 Rev1 None None
ICSI-2 0.0001 1e-05 0.0 1.0 704.94 2023-02-04T04:11:39 2023-02-04T04:00:33 Rev1 None None
ICSI-2 0.12531 0.09315 0.03218 0.98583 1562.38 2023-02-08T06:40:24 2023-02-08T06:30:48 Rev1 None None
ICSI-2 0.04147 0.0157 0.00645 1.0 1561.47 2023-02-08T22:10:24 2023-02-08T22:00:53 Rev1 None None
ICSI-2 0.18679 0.15107 0.03952 0.96694 1562.2 2023-02-08T23:50:24 2023-02-08T23:48:19 Rev1 None None
ICSI-2 0.0283 0.02025 0.00694 0.99972 1562.41 2023-02-09T03:40:24 2023-02-09T03:40:10 Rev1 None None
ICSI-2 1e-05 0.0 0.0 1.0 721.04 2023-02-09T07:50:23 2023-02-09T07:44:42 Rev1 None None
ICSI-2 0.00021 1e-05 0.0 1.0 719.0 2023-02-09T09:00:24 2023-02-09T08:51:22 Rev1 None None
ICSI-2 0.00046 3e-05 0.0 1.0 719.99 2023-02-09T09:30:25 2023-02-09T09:28:46 Rev1 None None
ICSI-2 0.07169 0.02548 0.01416 0.99972 1562.46 2023-02-09T20:20:24 2023-02-09T20:11:03 Rev1 None None
ICSI-2 0.05554 0.02041 0.01005 1.0 1562.4 2023-02-09T23:40:25 2023-02-09T23:31:08 Rev1 None None
ICSI-2 0.02645 0.01761 0.00608 1.0 1562.49 2023-02-10T03:40:24 2023-02-10T03:32:32 Rev1 None None
ICSI-2 1e-05 0.0 0.0 1.0 721.02 2023-02-10T07:20:24 2023-02-10T07:19:01 Rev1 None None
ICSI-2 0.0 0.0 0.0 1.0 721.16 2023-02-21T18:50:26 2023-02-17T10:52:34 Rev1 None None
ICSI-2 0.0 0.0 0.0 1.0 721.05 2023-02-22T21:20:23 2023-02-22T21:15:18 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-01-09T08:20:25 2023-01-09T08:12:23 Rev1 :No Results::Container File Missing: :Schema Header:
TrinitySRITrojAI-BostonU 0.89862 0.12701 0.31655 0.46444 722.32 2023-01-09T21:20:24 2023-01-09T21:11:22 Rev1 None None
TrinitySRITrojAI-BostonU 0.88214 0.12442 0.31617 0.49472 723.24 2023-01-09T22:20:23 2023-01-09T22:11:42 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-01-10T23:10:23 2023-01-10T23:00:29 Rev1 :No Results::Info File Missing::Container File Missing: None
TrinitySRITrojAI-BostonU 1.67313 0.30168 0.45623 0.40917 736.3 2023-01-11T07:10:23 2023-01-11T07:02:55 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 721.67 2023-01-18T22:00:24 2023-01-18T21:59:10 Rev1 :No Results: None
TrinitySRITrojAI-BostonU 0.13604 0.08263 0.03629 0.98806 934.03 2023-01-18T22:50:23 2023-01-18T22:43:10 Rev1 None None
TrinitySRITrojAI-BostonU 0.00437 0.0006 3e-05 1.0 1710.5 2023-01-19T07:10:23 2023-01-19T07:01:26 Rev1 None None
TrinitySRITrojAI-BostonU 0.01719 0.00203 0.00041 1.0 1002.86 2023-01-19T09:00:23 2023-01-19T08:57:52 Rev1 None None
TrinitySRITrojAI-BostonU 0.0001 2e-05 0.0 0.76667 940.17 2023-01-19T22:00:24 2023-01-19T21:57:39 Rev1 None None
TrinitySRITrojAI-BostonU 0.0001 2e-05 0.0 0.76667 1531.13 2023-01-20T03:10:23 2023-01-20T03:09:28 Rev1 None None
TrinitySRITrojAI-BostonU 0.6118 0.02796 0.21047 0.84208 840.01 2023-01-20T06:10:25 2023-01-20T06:06:33 Rev1 None None
TrinitySRITrojAI-BostonU 0.58119 0.03005 0.1966 0.84542 840.21 2023-01-20T07:11:22 2023-01-20T07:05:16 Rev1 None None
TrinitySRITrojAI-BostonU 0.73502 0.09406 0.26806 0.66583 841.14 2023-01-20T08:50:25 2023-01-20T08:50:16 Rev1 None None
TrinitySRITrojAI-BostonU 0.67146 0.05411 0.23825 0.65681 841.22 2023-01-20T19:40:24 2023-01-20T19:32:24 Rev1 None None
TrinitySRITrojAI-BostonU 0.67146 0.05411 0.23825 0.65681 841.17 2023-01-20T22:51:26 2023-01-20T22:41:49 Rev1 None None
TrinitySRITrojAI-BostonU 0.73502 0.09406 0.26806 0.66583 841.07 2023-01-21T02:00:24 2023-01-21T01:55:45 Rev1 None None
TrinitySRITrojAI-BostonU 0.73502 0.09406 0.26806 0.66583 837.09 2023-01-21T04:20:25 2023-01-21T04:17:19 Rev1 None None
TrinitySRITrojAI-BostonU 0.00531 0.00047 3e-05 1.0 841.78 2023-01-21T05:50:25 2023-01-21T05:42:51 Rev1 None None
TrinitySRITrojAI-BostonU 0.00405 0.00036 2e-05 1.0 961.43 2023-01-21T07:30:25 2023-01-21T07:21:45 Rev1 None None
TrinitySRITrojAI-BostonU 0.0046 0.0004 3e-05 1.0 886.08 2023-01-21T13:20:25 2023-01-21T13:10:29 Rev1 None None
TrinitySRITrojAI-BostonU 0.00405 0.00036 2e-05 1.0 960.3 2023-01-21T14:01:03 2023-01-21T07:21:45 Rev1 None None
TrinitySRITrojAI-BostonU 0.02604 0.00115 0.0007 1.0 841.41 2023-02-03T15:50:28 2023-02-03T15:42:50 Rev1 None None
TrinitySRITrojAI-BostonU 0.00405 0.00036 2e-05 1.0 961.42 2023-02-03T16:31:26 2023-01-21T07:21:45 Rev1 None None
TrinitySRITrojAI-BostonU 0.00637 0.00218 0.00018 1.0 841.28 2023-02-04T22:50:27 2023-02-04T22:41:06 Rev1 None None
TrinitySRITrojAI-BostonU 0.00405 0.00036 2e-05 1.0 961.41 2023-02-04T23:31:34 2023-01-21T07:21:45 Rev1 None None
TrinitySRITrojAI-BostonU 0.16275 0.02864 0.03504 1.0 840.15 2023-02-05T19:30:28 2023-02-05T19:21:11 Rev1 None None
TrinitySRITrojAI-BostonU 0.00405 0.00036 2e-05 1.0 961.46 2023-02-05T20:11:36 2023-01-21T07:21:45 Rev1 None None
TrinitySRITrojAI-BostonU 0.08278 0.00884 0.0081 1.0 841.39 2023-02-06T01:20:28 2023-02-06T01:19:03 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-02-06T02:01:50 2023-01-21T07:21:45 Rev1 :No Results::Info File Missing::Container File Missing: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-02-06T06:40:25 2023-02-06T06:34:02 Rev1 :No Results::Info File Missing::Container File Missing: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-02-06T07:03:10 2023-01-21T07:21:45 Rev1 :No Results::Info File Missing::Container File Missing: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-02-06T08:40:27 2023-02-06T08:34:41 Rev1 :No Results::Info File Missing::Container File Missing: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-02-06T09:02:14 2023-01-21T07:21:45 Rev1 :Executed File Update::No Results::Info File Missing::Log File Missing::Container File Missing: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-02-06T09:11:33 2023-02-06T09:08:22 Rev1 :No Results::Info File Missing::Container File Missing: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-02-06T10:03:01 2023-01-21T07:21:45 Rev1 :Executed File Update::No Results::Info File Missing::Log File Missing::Container File Missing: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-02-06T16:10:28 2023-02-06T16:03:10 Rev1 :No Results::Info File Missing::Container File Missing: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-02-06T16:43:24 2023-01-21T07:21:45 Rev1 :Executed File Update::No Results::Info File Missing::Log File Missing::Container File Missing: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-02-06T17:00:28 2023-02-06T17:00:01 Rev1 :No Results::Info File Missing::Container File Missing: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-02-06T17:42:07 2023-01-21T07:21:45 Rev1 :Executed File Update::No Results::Info File Missing::Log File Missing::Container File Missing: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-02-06T18:20:28 2023-02-06T18:15:08 Rev1 :No Results::Info File Missing::Log File Missing::Container File Missing: None
TrinitySRITrojAI-BostonU 0.00115 9e-05 0.0 1.0 841.3 2023-02-07T06:40:27 2023-02-07T06:33:34 Rev1 None None
TrinitySRITrojAI-BostonU 0.00471 0.00034 3e-05 1.0 1322.14 2023-02-07T18:10:26 2023-02-07T18:07:02 Rev1 None None
TrinitySRITrojAI-BostonU 0.0058 0.00044 4e-05 1.0 938.36 2023-02-23T16:40:26 2023-02-23T16:35:32 Rev1 None None
TrinitySRITrojAI-BostonU 0.00019 2e-05 0.0 1.0 309.67 2023-03-14T19:30:27 2023-03-14T19:29:08 Rev1 None None
trojai-example 0.77147 0.07322 0.28477 0.49125 721.8 2022-12-17T01:19:20 2022-12-17T01:15:03 Rev1 None None
UMBCb 0.27248 0.02632 0.06398 0.99833 1202.11 2023-01-25T20:30:39 2023-01-25T20:23:10 Rev1 None None
UMBCb 0.42281 0.02459 0.12137 0.98819 220.51 2023-03-15T17:10:33 2023-03-15T17:03:06 Rev1 None None
UMBCb 0.2495 0.00287 0.04887 1.0 221.23 2023-03-16T15:00:32 2023-03-16T14:58:32 Rev1 None None
UMBCb 0.56317 0.01949 0.18616 0.94361 224.0 2023-03-22T20:30:35 2023-03-22T20:22:04 Rev1 None None
UMBCb 0.33799 0.17334 0.08132 0.94375 224.05 2023-04-17T18:00:32 2023-04-17T17:56:18 Rev1 None None

Required filename format: "cyber-pdf-dec2022_test_<Submission Name>.simg"
Accepting submissions: True
Number of models in cyber-pdf-dec2022, test: 120
Execution timeout (hh:mm:ss): 20:00:00

Teams/Jobs

Team Submission Timestamp Type Job Status File Status General Status File Timestamp Time until next execution
Perspecta 2023-03-07T18:10:05 performer None None Ok 2023-03-07T18:08:26 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI 2023-03-17T21:50:06 performer None None Ok 2023-03-17T21:49:35 0 d, 0 h, 0 m, 0 s
DRAFFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
PL-GIFT performer None None Ok 2023-03-10T19:42:56 0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers 2023-01-20T02:50:10 performer None None Ok 2023-01-20T02:47:02 0 d, 0 h, 0 m, 0 s
Perspecta-IUB 2023-02-22T03:40:59 performer None None Ok 2023-02-22T03:35:07 0 d, 0 h, 0 m, 0 s
ARM-UCSD 2023-03-28T04:20:16 performer None None Ok 2023-03-28T04:19:36 0 d, 0 h, 0 m, 0 s
ARM 2023-03-07T18:40:21 performer None Ok Ok 2023-03-07T18:32:05 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU 2023-03-08T01:30:24 performer None None Ok 2023-03-08T01:29:04 0 d, 0 h, 0 m, 0 s
ARM-UMBC performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-1 performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-2 2023-02-22T21:20:23 performer None None Ok 2023-02-22T21:15:18 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU 2023-03-14T19:30:27 performer None None Ok 2023-03-14T19:29:08 0 d, 0 h, 0 m, 0 s
trojai-example public None None Ok 2023-03-10T01:59:38 0 d, 0 h, 0 m, 0 s
IceTorch public None None Ok None 0 d, 0 h, 0 m, 0 s
trojaicy public None None Ok None 0 d, 0 h, 0 m, 0 s
Hector public None None Ok None 0 d, 0 h, 0 m, 0 s
Cassandra-XF public None None Ok None 0 d, 0 h, 0 m, 0 s
gooddefense public None None Ok None 0 d, 0 h, 0 m, 0 s
cyberinfrastructure public None None Ok None 0 d, 0 h, 0 m, 0 s
glaros public None None Ok None 0 d, 0 h, 0 m, 0 s
Ultraman public None None Ok None 0 d, 0 h, 0 m, 0 s
BackSec public None None Ok None 0 d, 0 h, 0 m, 0 s
Palladium public None None Ok None 0 d, 0 h, 0 m, 0 s
IIECAS public None None Ok None 0 d, 0 h, 0 m, 0 s
NSEC public None None Ok None 0 d, 0 h, 0 m, 0 s
UMBCb 2023-04-17T18:00:32 performer None None Ok 2023-04-17T17:56:18 0 d, 0 h, 0 m, 0 s
PASS public None None Ok None 0 d, 0 h, 0 m, 0 s
DS3TwoSixZero 2023-01-25T18:00:43 public None None Ok 2023-01-25T17:59:21 0 d, 0 h, 0 m, 0 s
dongdong4fei public None None Ok None 0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.24803 0.08159 0.07077 0.97153 1727.18 2023-03-07T18:10:05 2023-03-07T18:08:26 Rev1 None None
TrinitySRITrojAI 0.38909 0.09694 0.12763 0.90778 1682.7 2023-02-10T23:50:07 2023-02-10T23:47:16 Rev1 None None
PL-GIFT 0.19827 0.12362 0.05236 0.97694 1562.63 2023-01-19T20:30:08 2023-01-19T20:28:23 Rev1 None None
Perspecta-PurdueRutgers 0.24399 0.03977 0.06413 0.99208 1682.44 2023-01-19T19:30:09 2023-01-19T19:23:56 Rev1 None None
Perspecta-IUB 0.43505 0.03073 0.12971 0.97806 721.47 2023-01-13T05:50:10 2023-01-13T05:46:18 Rev1 None None
ARM-UCSD 0.32994 0.09614 0.10488 0.9325 721.38 2023-03-01T22:20:17 2023-03-01T22:16:53 Rev1 None None
ARM 0.18463 0.07603 0.05568 0.98153 1903.02 2023-03-02T04:20:22 2023-03-02T04:14:42 Rev1 None None
TrinitySRITrojAI-SBU 0.33386 0.11125 0.10128 0.92806 1682.81 2023-02-21T21:45:10 2023-02-21T21:39:55 Rev1 None None
ICSI-2 0.14978 0.06346 0.04387 0.98667 726.13 2023-02-21T18:50:26 2023-02-17T10:52:34 Rev1 None None
TrinitySRITrojAI-BostonU 0.48617 0.02492 0.15124 0.99069 960.39 2023-01-21T07:20:24 2023-01-21T07:18:14 Rev1 None None
trojai-example 0.71866 0.08293 0.25641 0.60208 722.81 2023-01-25T20:00:36 2023-01-25T19:58:01 Rev1 None :Schema Header:
UMBCb 0.66859 0.0518 0.2377 0.63653 218.36 2023-03-16T15:00:32 2023-03-16T14:58:32 Rev1 None None
DS3TwoSixZero 0.69315 0.0 0.25 0.5 2023-01-25T14:00:43 2023-01-25T13:52:46 Rev1 :No Results::Info File Missing: None

All Results

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.72374 0.07243 0.26029 0.56694 1203.97 2023-01-03T21:50:04 2023-01-03T21:43:42 Rev1 None None
Perspecta 0.29508 0.09189 0.09126 0.94 1562.6 2023-01-04T18:50:05 2023-01-04T18:42:32 Rev1 None None
Perspecta 0.346 0.10052 0.11404 0.92236 1562.62 2023-01-05T15:40:05 2023-01-05T15:36:11 Rev1 None None
Perspecta 0.31321 0.11506 0.09281 0.93889 1562.68 2023-01-10T18:10:05 2023-01-10T18:08:25 Rev1 None None
Perspecta 0.3152 0.10639 0.09642 0.93486 1562.71 2023-01-11T15:40:05 2023-01-11T15:35:21 Rev1 None None
Perspecta 0.29114 0.12942 0.08111 0.95111 1562.57 2023-01-11T20:00:05 2023-01-11T19:50:59 Rev1 None None
Perspecta 0.29694 0.10173 0.08431 0.94806 1562.68 2023-01-12T19:50:05 2023-01-12T19:44:09 Rev1 None None
Perspecta 0.30506 0.12784 0.08745 0.94431 1562.68 2023-01-12T22:30:05 2023-01-12T22:29:31 Rev1 None None
Perspecta 0.27719 0.09862 0.08009 0.94611 1562.68 2023-01-13T15:40:05 2023-01-13T15:37:07 Rev1 None None
Perspecta 0.27505 0.08933 0.07641 0.95111 1562.64 2023-01-13T18:30:05 2023-01-13T18:21:16 Rev1 None None
Perspecta 0.27252 0.08201 0.07475 0.95819 1670.49 2023-01-16T22:00:04 2023-01-16T21:56:54 Rev1 None None
Perspecta 0.29227 0.08136 0.08384 0.95403 1669.33 2023-01-17T14:10:05 2023-01-17T14:01:07 Rev1 None None
Perspecta 0.25285 0.07943 0.06889 0.96 1722.89 2023-01-18T15:30:05 2023-01-18T15:24:47 Rev1 None None
Perspecta 0.24794 0.07786 0.06691 0.96667 1724.52 2023-01-31T00:40:04 2023-01-31T00:34:29 Rev1 None None
Perspecta 0.24753 0.08012 0.06752 0.9625 1719.99 2023-01-31T02:10:04 2023-01-31T02:02:09 Rev1 None None
Perspecta 0.24961 0.07433 0.06558 0.96333 1727.71 2023-02-01T00:50:04 2023-02-01T00:48:19 Rev1 None None
Perspecta 0.24331 0.08094 0.06451 0.95958 1717.35 2023-02-07T18:40:04 2023-02-07T18:38:40 Rev1 None None
Perspecta 0.28507 0.06364 0.07717 0.96542 1723.15 2023-02-21T19:02:53 2023-02-21T19:02:33 Rev1 None None
Perspecta 0.25412 0.09835 0.06989 0.95431 1723.01 2023-03-03T15:40:04 2023-03-03T15:38:40 Rev1 None None
Perspecta 0.24803 0.08159 0.07077 0.97153 1727.18 2023-03-07T18:10:05 2023-03-07T18:08:26 Rev1 None None
TrinitySRITrojAI 0.46693 0.13112 0.14883 0.88389 2478.77 2022-12-20T00:20:06 2022-12-20T00:14:31 Rev1 None None
TrinitySRITrojAI 1.06991 0.28863 0.29005 0.87736 2908.78 2022-12-20T16:27:12 2022-12-20T16:20:56 Rev1 None None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 2022-12-20T19:08:05 2022-12-20T19:00:38 Rev1 :No Results::Info File Missing: None
TrinitySRITrojAI 0.41554 0.1265 0.12764 0.89847 2368.69 2023-01-05T20:00:06 2023-01-05T19:57:36 Rev1 None None
TrinitySRITrojAI 0.49752 0.19396 0.13208 0.87722 2121.55 2023-02-03T04:20:06 2023-02-03T04:13:58 Rev1 None None
TrinitySRITrojAI 0.38909 0.09694 0.12763 0.90778 1682.7 2023-02-10T23:50:07 2023-02-10T23:47:16 Rev1 None None
TrinitySRITrojAI 0.42017 0.09819 0.13497 0.90028 578.9 2023-03-17T21:50:06 2023-03-17T21:49:35 Rev1 None None
PL-GIFT 0.29848 0.07758 0.10036 0.93972 1562.85 2022-12-22T01:00:08 2022-12-22T00:58:23 Rev1 None None
PL-GIFT 0.98134 0.78035 0.10221 0.92306 1562.56 2023-01-11T03:50:09 2023-01-11T03:46:57 Rev1 None None
PL-GIFT 0.38554 0.45699 0.05246 0.97431 1562.67 2023-01-14T03:30:08 2023-01-14T03:23:08 Rev1 None None
PL-GIFT 0.21011 0.14324 0.05154 0.97486 1562.69 2023-01-16T19:00:08 2023-01-16T18:57:00 Rev1 None None
PL-GIFT 0.38794 0.45912 0.05067 0.96514 1562.69 2023-01-17T16:50:08 2023-01-17T16:49:35 Rev1 None None
PL-GIFT 0.20446 0.13166 0.05235 0.97542 1562.64 2023-01-17T18:10:09 2023-01-17T18:06:04 Rev1 None None
PL-GIFT 0.18979 0.11538 0.05137 0.97681 1562.78 2023-01-18T15:50:08 2023-01-18T15:47:42 Rev1 None None
PL-GIFT 0.21197 0.11751 0.05577 0.9625 1562.72 2023-01-18T17:10:09 2023-01-18T17:03:24 Rev1 None None
PL-GIFT 0.26548 0.11429 0.0842 0.95389 1562.88 2023-01-19T17:10:08 2023-01-19T17:01:45 Rev1 None None
PL-GIFT 0.19827 0.12362 0.05236 0.97694 1562.63 2023-01-19T20:30:08 2023-01-19T20:28:23 Rev1 None None
PL-GIFT 0.46956 0.24665 0.0981 0.9 1565.09 2023-01-27T20:50:08 2023-01-27T20:46:49 Rev1 None None
PL-GIFT 0.37927 0.45432 0.04779 0.96056 1563.65 2023-02-06T22:50:08 2023-02-06T22:46:39 Rev1 None None
PL-GIFT 0.40494 0.45541 0.05843 0.95889 1562.55 2023-02-07T02:10:07 2023-02-07T02:04:27 Rev1 None None
PL-GIFT 13.81552 2.47191 0.5 0.0 1562.54 2023-02-07T23:50:07 2023-02-07T23:45:48 Rev1 None None
PL-GIFT 0.47618 0.46439 0.07718 0.92806 1562.48 2023-02-08T02:40:07 2023-02-08T02:30:58 Rev1 None None
PL-GIFT 0.4776 0.4641 0.07836 0.92708 1562.58 2023-02-14T23:10:07 2023-02-14T23:09:55 Rev1 None None
PL-GIFT 0.50913 0.46946 0.08441 0.92528 1562.59 2023-02-27T19:30:07 2023-02-27T19:26:23 Rev1 None None
PL-GIFT 0.69315 0.0 0.25 0.5 2023-03-10T23:40:08 2023-03-10T19:42:56 Rev1 :No Results: :Container Parameters (jsonschema checker):
Perspecta-PurdueRutgers 0.79835 0.08865 0.29499 0.49208 721.19 2023-01-09T04:30:10 2023-01-09T04:29:12 Rev1 None None
Perspecta-PurdueRutgers 0.88069 0.12824 0.31729 0.49222 721.18 2023-01-09T17:00:10 2023-01-09T16:54:11 Rev1 None None
Perspecta-PurdueRutgers 1.03911 0.14509 0.37172 0.43556 1005.23 2023-01-09T18:30:10 2023-01-09T18:20:49 Rev1 None None
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 2023-01-11T04:40:09 2023-01-11T04:37:04 Rev1 :No Results: :Container Parameters (jsonschema checker):
Perspecta-PurdueRutgers 0.29205 0.04776 0.0822 0.97431 1680.55 2023-01-11T21:10:09 2023-01-11T21:05:12 Rev1 None None
Perspecta-PurdueRutgers 2.7631 1.48315 0.1 0.83778 1681.46 2023-01-12T04:10:09 2023-01-12T04:09:29 Rev1 None None
Perspecta-PurdueRutgers 0.24422 0.04607 0.06461 0.98639 1680.42 2023-01-12T15:30:11 2023-01-12T15:22:35 Rev1 None None
Perspecta-PurdueRutgers 0.14693 0.08905 0.03847 0.95833 1680.45 2023-01-12T18:40:10 2023-01-12T18:39:26 Rev1 None None
Perspecta-PurdueRutgers 0.35276 0.05991 0.10775 0.93458 1681.46 2023-01-17T16:00:10 2023-01-17T15:50:39 Rev1 None None
Perspecta-PurdueRutgers 0.24399 0.03977 0.06413 0.99208 1682.44 2023-01-19T19:30:09 2023-01-19T19:23:56 Rev1 None None
Perspecta-PurdueRutgers 0.26835 0.05463 0.07783 0.97333 1678.43 2023-01-20T02:00:10 2023-01-20T01:57:56 Rev1 None None
Perspecta-PurdueRutgers 0.26835 0.05463 0.07783 0.97333 1682.51 2023-01-20T02:50:10 2023-01-20T02:47:02 Rev1 None None
Perspecta-IUB 0.68263 0.03081 0.24468 0.59472 722.16 2022-12-22T04:20:09 2022-12-22T04:15:36 Rev1 None None
Perspecta-IUB 0.69594 0.01211 0.25139 0.49431 721.1 2022-12-22T06:10:09 2022-12-22T06:02:15 Rev1 None None
Perspecta-IUB 0.69244 0.02866 0.24957 0.55014 721.14 2022-12-22T15:30:08 2022-12-22T15:26:57 Rev1 None None
Perspecta-IUB 0.68263 0.03081 0.24468 0.59472 722.61 2022-12-22T16:20:10 2022-12-22T16:17:06 Rev1 None None
Perspecta-IUB 0.70219 0.03344 0.25437 0.50972 721.06 2022-12-22T17:00:53 2022-12-22T16:59:47 Rev1 None None
Perspecta-IUB 0.70479 0.03269 0.25544 0.52583 721.12 2022-12-22T21:20:10 2022-12-22T21:16:13 Rev1 None None
Perspecta-IUB 1.14085 0.21664 0.36223 0.45667 721.15 2022-12-22T22:00:46 2022-12-22T22:00:27 Rev1 None None
Perspecta-IUB 0.69315 0.0 0.25 0.5 2022-12-22T22:50:09 2022-12-22T22:49:45 Rev1 :No Results::Info File Missing: None
Perspecta-IUB 1.21276 0.21291 0.38335 0.42736 721.17 2022-12-23T00:00:09 2022-12-22T23:56:50 Rev1 None None
Perspecta-IUB 0.69315 0.0 0.25 0.5 721.1 2022-12-26T05:30:09 2022-12-26T05:22:29 Rev1 :No Results: None
Perspecta-IUB 0.69315 0.0 0.25 0.5 720.02 2022-12-26T15:40:10 2022-12-26T15:35:17 Rev1 :No Results: None
Perspecta-IUB 0.69315 0.0 0.25 0.5 720.01 2022-12-26T20:10:09 2022-12-26T20:01:18 Rev1 :No Results: None
Perspecta-IUB 0.48499 0.08365 0.1608 0.84306 721.29 2022-12-26T22:00:10 2022-12-26T21:53:57 Rev1 None None
Perspecta-IUB 0.69315 0.0 0.25 0.5 2023-01-04T22:20:10 2023-01-04T22:15:40 Rev1 :No Results: :Schema Header:
Perspecta-IUB 0.69315 0.0 0.25 0.5 2023-01-05T00:50:09 2023-01-05T00:48:17 Rev1 :No Results: :Schema Header:
Perspecta-IUB 0.69315 0.0 0.25 0.5 2023-01-08T05:30:09 2023-01-08T05:26:15 Rev1 :No Results: :Schema Header:
Perspecta-IUB 0.69315 0.0 0.25 0.5 2023-01-08T06:20:09 2023-01-08T06:11:09 Rev1 :No Results: :Schema Header:
Perspecta-IUB 0.69315 0.0 0.25 0.5 2023-01-08T07:10:10 2023-01-08T07:02:34 Rev1 :No Results: :Container Parameters (jsonschema checker)::Schema Header:
Perspecta-IUB 1.53245 0.32701 0.42063 0.44944 721.34 2023-01-08T22:00:10 2023-01-08T22:00:02 Rev1 None None
Perspecta-IUB 1.3411 0.31132 0.3782 0.50486 727.36 2023-01-08T22:30:10 2023-01-08T22:23:34 Rev1 None None
Perspecta-IUB 1.1525 0.23471 0.35092 0.51778 721.36 2023-01-09T06:10:11 2023-01-09T06:07:56 Rev1 None None
Perspecta-IUB 1.12677 0.203 0.36252 0.4525 721.35 2023-01-09T07:00:11 2023-01-09T06:50:44 Rev1 None None
Perspecta-IUB 0.48616 0.08171 0.1611 0.84361 721.28 2023-01-09T15:00:11 2023-01-09T14:57:44 Rev1 None None
Perspecta-IUB 0.29245 0.06881 0.08705 0.95736 721.2 2023-01-10T05:20:11 2023-01-10T05:18:47 Rev1 None None
Perspecta-IUB 0.22701 0.08594 0.0653 0.96847 721.17 2023-01-10T05:42:37 2023-01-10T05:40:51 Rev1 None None
Perspecta-IUB 0.69315 0.0 0.25 0.5 721.33 2023-01-13T04:10:11 2023-01-13T04:01:54 Rev1 :No Results: None
Perspecta-IUB 0.69315 0.0 0.25 0.5 721.3 2023-01-13T04:32:06 2023-01-13T04:22:57 Rev1 :No Results: None
Perspecta-IUB 0.40597 0.03456 0.11885 0.97625 721.5 2023-01-13T05:00:10 2023-01-13T04:54:04 Rev1 None None
Perspecta-IUB 0.43505 0.03073 0.12971 0.97806 721.47 2023-01-13T05:50:10 2023-01-13T05:46:18 Rev1 None None
Perspecta-IUB 0.69315 0.0 0.25 0.5 721.35 2023-01-13T06:11:19 2023-01-13T05:56:56 Rev1 :No Results: None
Perspecta-IUB 0.26968 0.16843 0.07472 0.96403 721.39 2023-01-13T14:10:10 2023-01-13T14:05:18 Rev1 None None
Perspecta-IUB 0.33854 0.13285 0.10193 0.94736 721.26 2023-01-13T14:51:42 2023-01-13T14:45:01 Rev1 None None
Perspecta-IUB 0.26843 0.10493 0.08073 0.96194 721.39 2023-01-13T16:00:10 2023-01-13T15:55:46 Rev1 None None
Perspecta-IUB 0.26843 0.10493 0.08073 0.96194 726.33 2023-01-13T16:30:11 2023-01-13T16:22:20 Rev1 None None
Perspecta-IUB 0.69315 0.0 0.25 0.5 2023-01-24T18:00:17 2023-01-21T21:17:43 Rev1 :No Results: :Container Parameters (jsonschema checker)::Schema Header:
Perspecta-IUB 0.69315 0.0 0.25 0.5 2023-01-24T20:00:13 2023-01-24T19:53:49 Rev1 :No Results: :Schema Header:
Perspecta-IUB 0.69315 0.0 0.25 0.5 2023-02-16T07:00:11 2023-02-16T06:53:43 Rev1 :No Results: :Container Parameters (jsonschema checker)::Schema Header:
Perspecta-IUB 0.69315 0.0 0.25 0.5 2023-02-21T18:50:11 2023-02-16T19:06:57 Rev1 :No Results: :Schema Header:
Perspecta-IUB 0.69315 0.0 0.25 0.5 2023-02-21T20:20:10 2023-02-21T20:16:25 Rev1 :No Results: :Schema Header:
Perspecta-IUB 0.69315 0.0 0.25 0.5 2023-02-21T20:32:06 2023-02-21T20:24:52 Rev1 :No Results: :Schema Header:
Perspecta-IUB 0.69315 0.0 0.25 0.5 2023-02-21T23:00:11 2023-02-21T22:53:10 Rev1 :No Results: :Schema Header:
Perspecta-IUB 0.69315 0.0 0.25 0.5 404.44 2023-02-22T01:20:11 2023-02-22T01:14:47 Rev1 :No Results: None
Perspecta-IUB 0.25884 0.13882 0.07039 0.97236 1682.46 2023-02-22T02:20:11 2023-02-22T02:19:45 Rev1 None None
Perspecta-IUB 1.13477 0.26529 0.34799 0.51694 721.39 2023-02-22T03:40:59 2023-02-22T03:35:07 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 2023-01-24T19:00:20 2023-01-24T18:58:23 Rev1 :No Results: :Schema Header:
ARM-UCSD 0.69315 0.0 0.25 0.5 2023-01-27T22:01:05 2023-01-27T21:51:18 Rev1 :No Results: :Schema Header:
ARM-UCSD 0.69315 0.0 0.25 0.5 891.81 2023-01-28T07:33:12 2023-01-28T07:27:58 Rev1 None None
ARM-UCSD 6.02738 1.47401 0.47249 0.53597 673.83 2023-01-30T07:40:18 2023-01-30T07:31:28 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 721.32 2023-02-21T18:50:18 2023-02-16T17:42:42 Rev1 :No Results: None
ARM-UCSD 0.69315 0.0 0.25 0.5 721.41 2023-02-21T20:32:13 2023-02-21T20:26:33 Rev1 :Result Parse::No Results: None
ARM-UCSD 0.69315 0.0 0.25 0.5 721.38 2023-02-21T21:10:17 2023-02-21T21:07:22 Rev1 :No Results: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2023-02-21T22:00:16 2023-02-21T21:53:29 Rev1 :No Results: :Schema Header:
ARM-UCSD 0.69315 0.0 0.25 0.5 721.38 2023-02-22T04:10:18 2023-02-22T04:09:27 Rev1 :No Results: None
ARM-UCSD 0.88369 0.46271 0.11091 0.89472 724.35 2023-02-22T04:50:17 2023-02-22T04:43:46 Rev1 None None
ARM-UCSD 0.88369 0.46271 0.11091 0.89472 721.36 2023-02-28T00:50:18 2023-02-28T00:48:03 Rev1 None None
ARM-UCSD 0.32994 0.09614 0.10488 0.9325 721.38 2023-03-01T22:20:17 2023-03-01T22:16:53 Rev1 None None
ARM-UCSD 12.66423 2.46331 0.45833 0.15972 1204.59 2023-03-01T23:20:17 2023-03-01T23:15:35 Rev1 None None
ARM-UCSD 9.4406 2.3447 0.34167 0.47556 1206.63 2023-03-02T00:50:17 2023-03-02T00:45:54 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 2023-03-20T18:00:17 2023-03-20T17:54:08 Rev1 :No Results: :Container Parameters (jsonschema checker):
ARM-UCSD 2.7631 1.48315 0.1 0.84653 818.43 2023-03-20T19:20:17 2023-03-20T19:18:10 Rev1 None None
ARM-UCSD 2.7631 1.48315 0.1 0.84653 839.75 2023-03-20T23:10:18 2023-03-20T23:00:14 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 450.66 2023-03-24T23:10:16 2023-03-24T23:07:19 Rev1 :No Results::Missing Results: None
ARM-UCSD 3.68414 1.68058 0.13333 0.825 767.29 2023-03-26T00:40:18 2023-03-26T00:39:36 Rev1 None None
ARM-UCSD 13.12475 2.46882 0.475 0.06611 749.46 2023-03-28T02:41:06 2023-03-28T02:34:06 Rev1 None None
ARM-UCSD 2.99336 1.53654 0.10833 0.85556 760.26 2023-03-28T03:01:04 2023-03-28T02:54:42 Rev1 None None
ARM-UCSD 2.99336 1.53654 0.10833 0.85556 748.7 2023-03-28T03:50:15 2023-03-28T03:42:29 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 221.49 2023-03-28T04:20:16 2023-03-28T04:19:36 Rev1 :No Results::Missing Results: None
ARM 0.62026 0.0759 0.2167 0.71347 1682.92 2023-01-30T05:42:16 2023-01-30T05:31:46 Rev1 None None
ARM 0.4323 0.05613 0.13551 0.92069 1684.35 2023-02-07T05:40:22 2023-02-07T05:33:21 Rev1 None None
ARM 0.69315 0.0 0.25 0.5 808.0 2023-02-07T07:30:21 2023-02-07T07:21:55 Rev1 :No Results: None
ARM 0.69315 0.0 0.25 0.5 804.07 2023-02-07T08:52:22 2023-02-07T08:43:09 Rev1 :No Results: None
ARM 0.26805 0.09077 0.08846 0.95333 2649.37 2023-02-21T19:40:22 2023-02-21T19:33:03 Rev1 None None
ARM 0.19922 0.07307 0.06169 0.97611 2644.32 2023-02-28T20:00:23 2023-02-28T19:51:20 Rev1 None None
ARM 0.58205 0.63231 0.05713 0.95694 1802.97 2023-03-02T03:10:22 2023-03-02T03:05:28 Rev1 None None
ARM 0.18463 0.07603 0.05568 0.98153 1903.02 2023-03-02T04:20:22 2023-03-02T04:14:42 Rev1 None None
ARM 1.03475 0.88594 0.07241 0.92542 1900.12 2023-03-07T15:20:21 2023-03-07T15:15:51 Rev1 None None
ARM 0.19389 0.08087 0.05872 0.97833 2040.26 2023-03-07T18:40:21 2023-03-07T18:32:05 Rev1 None None
TrinitySRITrojAI-SBU 0.44231 0.08923 0.14152 0.87722 1682.79 2023-02-12T03:10:22 2023-02-12T03:09:37 Rev1 None None
TrinitySRITrojAI-SBU 0.52048 0.06598 0.16871 0.82472 1683.11 2023-02-21T20:51:11 2023-02-21T20:45:45 Rev1 None None
TrinitySRITrojAI-SBU 0.33386 0.11125 0.10128 0.92806 1682.81 2023-02-21T21:45:10 2023-02-21T21:39:55 Rev1 None None
TrinitySRITrojAI-SBU 0.40936 0.1111 0.12186 0.88903 1682.81 2023-02-22T08:30:21 2023-02-22T08:22:01 Rev1 None None
TrinitySRITrojAI-SBU 0.41487 0.09098 0.12656 0.88931 1684.06 2023-02-22T21:30:22 2023-02-22T21:23:20 Rev1 None None
TrinitySRITrojAI-SBU 0.49748 0.15181 0.14534 0.84194 1682.82 2023-02-23T00:40:25 2023-02-23T00:32:53 Rev1 None None
TrinitySRITrojAI-SBU 0.42233 0.10675 0.13111 0.89236 1682.8 2023-02-23T01:30:22 2023-02-23T01:28:02 Rev1 None None
TrinitySRITrojAI-SBU 0.41052 0.07983 0.13501 0.88764 1682.98 2023-03-07T03:10:24 2023-03-07T03:02:38 Rev1 None None
TrinitySRITrojAI-SBU 0.36867 0.12521 0.11111 0.91653 1682.95 2023-03-07T04:30:24 2023-03-07T04:27:23 Rev1 None None
TrinitySRITrojAI-SBU 0.42617 0.08238 0.13299 0.88847 1682.94 2023-03-07T05:30:24 2023-03-07T05:28:18 Rev1 None None
TrinitySRITrojAI-SBU 0.48938 0.07834 0.15611 0.87542 1682.76 2023-03-07T06:51:33 2023-03-07T06:40:38 Rev1 None None
TrinitySRITrojAI-SBU 0.40384 0.08414 0.12773 0.90264 1695.05 2023-03-07T08:01:18 2023-03-07T07:56:48 Rev1 None None
TrinitySRITrojAI-SBU 0.43446 0.11063 0.13715 0.87931 1682.63 2023-03-07T08:50:24 2023-03-07T08:47:24 Rev1 None None
TrinitySRITrojAI-SBU 0.45159 0.10238 0.1361 0.87181 1682.63 2023-03-07T10:01:40 2023-03-07T09:57:13 Rev1 None None
TrinitySRITrojAI-SBU 0.45183 0.11508 0.14198 0.87208 1690.0 2023-03-07T11:11:11 2023-03-07T11:10:38 Rev1 None None
TrinitySRITrojAI-SBU 0.47719 0.11797 0.1514 0.84681 1683.13 2023-03-07T22:00:24 2023-03-07T21:57:04 Rev1 None None
TrinitySRITrojAI-SBU 0.41051 0.10438 0.12456 0.88708 1682.99 2023-03-07T23:40:24 2023-03-07T23:34:50 Rev1 None None
TrinitySRITrojAI-SBU 0.45128 0.11133 0.1357 0.85764 1682.81 2023-03-08T00:30:24 2023-03-08T00:25:31 Rev1 None None
TrinitySRITrojAI-SBU 0.38533 0.11717 0.12085 0.90403 1682.72 2023-03-08T01:30:24 2023-03-08T01:29:04 Rev1 None None
ICSI-2 0.49301 0.07532 0.16352 0.845 615.75 2023-01-06T02:00:21 2023-01-06T01:59:12 Rev1 None None
ICSI-2 0.49665 0.10753 0.16082 0.85278 610.68 2023-01-06T06:50:21 2023-01-06T06:46:27 Rev1 None None
ICSI-2 0.26685 0.10338 0.07591 0.95306 608.69 2023-01-07T01:40:20 2023-01-07T01:37:42 Rev1 None None
ICSI-2 0.51188 0.13631 0.16517 0.84583 604.66 2023-01-12T03:30:21 2023-01-12T03:24:00 Rev1 None None
ICSI-2 0.29234 0.07215 0.08944 0.95333 625.81 2023-01-16T04:50:20 2023-01-16T04:46:56 Rev1 None None
ICSI-2 0.32812 0.1145 0.10246 0.93639 617.71 2023-01-17T05:30:22 2023-01-17T05:23:27 Rev1 None None
ICSI-2 0.27823 0.08774 0.08222 0.95014 668.77 2023-01-18T07:30:20 2023-01-18T07:27:46 Rev1 None None
ICSI-2 0.30344 0.10133 0.09633 0.94875 675.87 2023-01-18T20:30:22 2023-01-18T20:25:15 Rev1 None None
ICSI-2 0.41383 0.19721 0.10364 0.91708 680.77 2023-01-20T01:00:21 2023-01-20T00:52:25 Rev1 None None
ICSI-2 0.28219 0.12809 0.07606 0.94847 665.77 2023-01-20T09:50:22 2023-01-20T09:49:07 Rev1 None None
ICSI-2 0.27648 0.10897 0.07877 0.95194 629.64 2023-01-20T23:50:23 2023-01-20T23:46:33 Rev1 None None
ICSI-2 0.27064 0.10972 0.07737 0.95611 635.72 2023-01-21T00:50:22 2023-01-21T00:47:15 Rev1 None None
ICSI-2 0.69315 0.0 0.25 0.5 2023-01-24T18:00:29 2023-01-23T23:49:23 Rev1 :No Results::Info File Missing: None
ICSI-2 0.33948 0.12738 0.105 0.93528 605.66 2023-01-26T00:40:27 2023-01-26T00:33:56 Rev1 None None
ICSI-2 0.27954 0.04119 0.07348 0.98639 613.74 2023-02-02T07:10:27 2023-02-02T07:09:51 Rev1 None None
ICSI-2 0.34099 0.12236 0.10785 0.93542 719.02 2023-02-02T22:50:25 2023-02-02T22:43:31 Rev1 None None
ICSI-2 0.27764 0.05084 0.07725 0.97125 612.67 2023-02-03T00:40:26 2023-02-03T00:34:11 Rev1 None None
ICSI-2 0.18734 0.07189 0.05534 0.9775 634.59 2023-02-03T04:50:24 2023-02-03T04:46:00 Rev1 None None
ICSI-2 0.19982 0.06818 0.05916 0.97597 611.66 2023-02-03T08:20:25 2023-02-03T08:17:49 Rev1 None None
ICSI-2 0.19086 0.0641 0.05391 0.98014 699.93 2023-02-03T08:50:25 2023-02-03T08:47:45 Rev1 None None
ICSI-2 0.69315 0.0 0.25 0.5 2023-02-04T02:30:25 2023-02-04T02:23:03 Rev1 :No Results: :Container Parameters (learned parameters):
ICSI-2 0.69315 0.0 0.25 0.5 2023-02-04T03:10:25 2023-02-04T03:08:54 Rev1 :Executed File Update::No Results::Info File Missing: None
ICSI-2 0.1823 0.08497 0.05335 0.98083 614.75 2023-02-04T03:31:32 2023-02-04T03:26:43 Rev1 None None
ICSI-2 0.17857 0.08039 0.05305 0.97847 698.96 2023-02-04T04:11:39 2023-02-04T04:00:33 Rev1 None None
ICSI-2 1.18884 0.36802 0.27589 0.73653 1562.33 2023-02-08T06:40:24 2023-02-08T06:30:48 Rev1 None None
ICSI-2 0.72948 0.23127 0.20231 0.81611 1562.44 2023-02-08T22:10:24 2023-02-08T22:00:53 Rev1 None None
ICSI-2 1.01936 0.31608 0.24449 0.76806 1562.3 2023-02-08T23:50:24 2023-02-08T23:48:19 Rev1 None None
ICSI-2 0.7067 0.23835 0.19415 0.8475 1562.46 2023-02-09T03:40:24 2023-02-09T03:40:10 Rev1 None None
ICSI-2 0.15709 0.07718 0.04453 0.98458 719.92 2023-02-09T07:50:23 2023-02-09T07:44:42 Rev1 None None
ICSI-2 0.17708 0.05352 0.04903 0.985 721.03 2023-02-09T09:00:24 2023-02-09T08:51:22 Rev1 None None
ICSI-2 0.1871 0.05956 0.05374 0.98028 720.97 2023-02-09T09:30:25 2023-02-09T09:28:46 Rev1 None None
ICSI-2 0.49306 0.13794 0.15846 0.87181 1562.39 2023-02-09T20:20:24 2023-02-09T20:11:03 Rev1 None None
ICSI-2 0.56697 0.20394 0.15742 0.85694 1562.47 2023-02-09T23:40:25 2023-02-09T23:31:08 Rev1 None None
ICSI-2 0.53269 0.20594 0.14948 0.88208 1562.45 2023-02-10T03:40:24 2023-02-10T03:32:32 Rev1 None None
ICSI-2 0.18185 0.09196 0.05576 0.98028 719.99 2023-02-10T07:20:24 2023-02-10T07:19:01 Rev1 None None
ICSI-2 0.14978 0.06346 0.04387 0.98667 726.13 2023-02-21T18:50:26 2023-02-17T10:52:34 Rev1 None None
ICSI-2 0.18629 0.09844 0.05206 0.97889 720.07 2023-02-22T21:20:23 2023-02-22T21:15:18 Rev1 None None
TrinitySRITrojAI-BostonU 0.80762 0.11196 0.29113 0.54611 721.94 2023-01-09T21:20:24 2023-01-09T21:11:22 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 721.0 2023-01-10T23:10:24 2023-01-10T23:04:14 Rev1 :No Results: None
TrinitySRITrojAI-BostonU 1.47387 0.27746 0.42017 0.51167 735.29 2023-01-11T07:10:24 2023-01-11T07:03:44 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-01-18T17:21:25 2023-01-18T17:14:01 Rev1 :No Results: :Container Parameters (jsonschema checker):
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 724.74 2023-01-18T21:30:23 2023-01-18T21:25:02 Rev1 :No Results: None
TrinitySRITrojAI-BostonU 0.74203 0.19316 0.22358 0.74181 928.05 2023-01-18T22:50:23 2023-01-18T22:43:10 Rev1 None None
TrinitySRITrojAI-BostonU 0.61373 0.15568 0.19898 0.79569 1702.94 2023-01-19T07:10:23 2023-01-19T07:01:26 Rev1 None None
TrinitySRITrojAI-BostonU 0.69566 0.15989 0.22734 0.73806 992.84 2023-01-19T09:00:23 2023-01-19T08:57:52 Rev1 None None
TrinitySRITrojAI-BostonU 0.69566 0.15989 0.22734 0.73806 1001.6 2023-01-19T19:00:25 2023-01-19T18:59:17 Rev1 None None
TrinitySRITrojAI-BostonU 0.69566 0.15989 0.22734 0.73806 1005.22 2023-01-19T19:31:04 2023-01-19T19:08:22 Rev1 None None
TrinitySRITrojAI-BostonU 0.59597 0.08809 0.20673 0.70222 942.45 2023-01-19T22:00:24 2023-01-19T21:57:39 Rev1 None None
TrinitySRITrojAI-BostonU 0.59597 0.08809 0.20673 0.70222 1520.73 2023-01-20T03:10:23 2023-01-20T03:09:28 Rev1 None None
TrinitySRITrojAI-BostonU 0.65272 0.02894 0.23041 0.7025 839.08 2023-01-20T06:10:25 2023-01-20T06:06:33 Rev1 None None
TrinitySRITrojAI-BostonU 0.6693 0.05518 0.23693 0.64806 840.22 2023-01-20T19:40:25 2023-01-20T19:32:24 Rev1 None None
TrinitySRITrojAI-BostonU 0.96865 0.44916 0.27339 0.65 846.25 2023-01-20T22:40:24 2023-01-20T22:39:06 Rev1 None None
TrinitySRITrojAI-BostonU 0.48528 0.02668 0.15118 0.97792 841.85 2023-01-21T05:50:25 2023-01-21T05:42:51 Rev1 None None
TrinitySRITrojAI-BostonU 0.48617 0.02492 0.15124 0.99069 960.39 2023-01-21T07:20:24 2023-01-21T07:18:14 Rev1 None None
TrinitySRITrojAI-BostonU 0.47891 0.02672 0.14835 0.98472 878.06 2023-01-21T13:20:25 2023-01-21T13:10:29 Rev1 None None
TrinitySRITrojAI-BostonU 0.39926 0.04078 0.11774 0.96542 841.39 2023-02-03T15:50:28 2023-02-03T15:42:50 Rev1 None None
TrinitySRITrojAI-BostonU 0.35014 0.05037 0.10349 0.95986 841.27 2023-02-04T22:50:27 2023-02-04T22:41:06 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-02-05T07:20:27 2023-02-05T07:19:07 Rev1 :No Results: :Container Parameters (jsonschema checker):
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-02-05T15:10:28 2023-02-05T15:00:39 Rev1 :No Results: :Container Parameters (jsonschema checker):
TrinitySRITrojAI-BostonU 0.54182 0.06954 0.18542 0.7875 837.13 2023-02-05T19:30:28 2023-02-05T19:21:11 Rev1 None None
TrinitySRITrojAI-BostonU 0.43849 0.04544 0.13569 0.93319 841.32 2023-02-06T01:20:28 2023-02-06T01:19:03 Rev1 None None
TrinitySRITrojAI-BostonU 0.47364 0.02749 0.14615 0.98222 964.06 2023-02-06T06:40:25 2023-02-06T06:34:02 Rev1 None None
TrinitySRITrojAI-BostonU 0.47746 0.02739 0.1479 0.98444 961.67 2023-02-06T07:20:26 2023-02-06T07:12:04 Rev1 None None
TrinitySRITrojAI-BostonU 0.48149 0.02751 0.14971 0.98181 961.73 2023-02-06T07:41:14 2023-02-06T07:22:15 Rev1 None None
TrinitySRITrojAI-BostonU 0.48431 0.02799 0.15062 0.96722 841.51 2023-02-06T08:40:27 2023-02-06T08:34:41 Rev1 None None
TrinitySRITrojAI-BostonU 0.48617 0.02492 0.15124 0.99069 959.41 2023-02-06T09:11:33 2023-02-06T09:08:22 Rev1 None None
TrinitySRITrojAI-BostonU 0.48792 0.02502 0.15212 0.98917 961.62 2023-02-06T16:10:28 2023-02-06T16:03:10 Rev1 None None
TrinitySRITrojAI-BostonU 0.48617 0.02492 0.15124 0.99069 960.41 2023-02-06T17:00:28 2023-02-06T17:00:01 Rev1 None None
TrinitySRITrojAI-BostonU 0.47815 0.02695 0.14808 0.98403 963.23 2023-02-06T18:20:28 2023-02-06T18:15:08 Rev1 None None
TrinitySRITrojAI-BostonU 0.34548 0.05241 0.10225 0.96153 846.3 2023-02-07T06:40:27 2023-02-07T06:33:34 Rev1 None None
TrinitySRITrojAI-BostonU 0.47983 0.02604 0.14871 0.98986 1322.31 2023-02-07T18:10:26 2023-02-07T18:07:02 Rev1 None None
TrinitySRITrojAI-BostonU 0.5032 0.0249 0.15902 0.97875 932.3 2023-02-23T16:40:26 2023-02-23T16:35:32 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-03-14T04:30:28 2023-03-14T04:28:06 Rev1 :No Results: :Container Parameters (jsonschema checker):
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-03-14T17:40:26 2023-03-14T17:35:30 Rev1 :No Results: :Schema Header:
TrinitySRITrojAI-BostonU 0.4916 0.02772 0.15428 0.97028 311.6 2023-03-14T19:30:27 2023-03-14T19:29:08 Rev1 None None
trojai-example 0.85962 0.09977 0.31471 0.45181 721.78 2022-12-17T01:19:20 2022-12-17T01:15:03 Rev1 None None
trojai-example 0.71866 0.08293 0.25641 0.60208 722.81 2023-01-25T20:00:36 2023-01-25T19:58:01 Rev1 None :Schema Header:
trojai-example 0.78104 0.08617 0.28725 0.53972 267.17 2023-03-09T16:57:17 2023-03-09T16:56:57 Rev1 None :Container Parameters (jsonschema checker)::Schema Header:
trojai-example 0.69315 0.0 0.25 0.5 2023-03-09T17:42:42 2023-03-09T17:42:05 Rev1 :No Results::Info File Missing: None
trojai-example 0.69315 0.0 0.25 0.5 2023-03-09T18:11:39 2023-03-09T18:10:09 Rev1 :No Results::Info File Missing: None
trojai-example 0.82094 0.09288 0.30323 0.45069 265.98 2023-03-10T02:00:28 2023-03-10T01:59:38 Rev1 None :Container Parameters (jsonschema checker)::Schema Header::Execute:
UMBCb 0.7519 0.0577 0.2766 0.48278 1202.12 2023-01-25T20:30:39 2023-01-25T20:23:10 Rev1 None None
UMBCb 0.69315 0.0 0.25 0.5 240.8 2023-03-06T16:10:36 2023-03-06T16:08:50 Rev1 :No Results: None
UMBCb 0.69424 0.01833 0.25054 0.52097 216.68 2023-03-15T17:10:33 2023-03-15T17:03:06 Rev1 None None
UMBCb 0.66859 0.0518 0.2377 0.63653 218.36 2023-03-16T15:00:32 2023-03-16T14:58:32 Rev1 None None
UMBCb 0.68037 0.02249 0.24371 0.59694 224.87 2023-03-22T20:30:35 2023-03-22T20:22:04 Rev1 None None
UMBCb 1.28286 0.28283 0.35978 0.52639 221.53 2023-04-17T18:00:32 2023-04-17T17:56:18 Rev1 None None
DS3TwoSixZero 0.69315 0.0 0.25 0.5 2023-01-25T14:00:43 2023-01-25T13:52:46 Rev1 :No Results::Info File Missing: None
DS3TwoSixZero 0.69315 0.0 0.25 0.5 2023-01-25T18:00:43 2023-01-25T17:59:21 Rev1 :No Results::Info File Missing: None

Required filename format: "cyber-pdf-dec2022_sts_<Submission Name>.simg"
Accepting submissions: True
Number of models in cyber-pdf-dec2022, sts: 14
Execution timeout (hh:mm:ss): 2:20:00

Teams/Jobs

Team Submission Timestamp Type Job Status File Status General Status File Timestamp Time until next execution
Perspecta 2023-03-07T17:40:05 performer None None Ok 2023-03-07T17:39:22 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI 2023-03-17T19:30:07 performer None None Ok 2023-03-17T19:29:09 0 d, 0 h, 0 m, 0 s
DRAFFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
PL-GIFT 2023-03-14T18:20:08 performer None None Ok 2023-03-14T18:13:46 0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers 2023-01-17T15:20:10 performer None None Ok 2023-01-17T15:18:30 0 d, 0 h, 0 m, 0 s
Perspecta-IUB performer None None Ok None 0 d, 0 h, 0 m, 0 s
ARM-UCSD 2023-03-25T22:40:17 performer None None Ok 2023-03-25T22:38:11 0 d, 0 h, 0 m, 0 s
ARM 2023-02-28T19:30:23 performer None Ok Ok 2023-02-28T19:26:27 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU 2023-02-21T18:50:24 performer None None Ok 2023-02-18T22:52:46 0 d, 0 h, 0 m, 0 s
ARM-UMBC performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-1 performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-2 2023-02-08T06:10:25 performer None None Ok 2023-02-08T06:06:03 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU 2023-01-21T04:20:26 performer None None Ok 2023-01-21T04:10:39 0 d, 0 h, 0 m, 0 s
trojai-example public None Ok Ok 2023-03-10T03:04:39 0 d, 0 h, 0 m, 0 s
IceTorch public None None Ok None 0 d, 0 h, 0 m, 0 s
trojaicy public None None Ok None 0 d, 0 h, 0 m, 0 s
Hector public None None Ok None 0 d, 0 h, 0 m, 0 s
Cassandra-XF public None None Ok None 0 d, 0 h, 0 m, 0 s
gooddefense public None None Ok None 0 d, 0 h, 0 m, 0 s
cyberinfrastructure public None None Ok None 0 d, 0 h, 0 m, 0 s
glaros public None None Ok None 0 d, 0 h, 0 m, 0 s
Ultraman public None None Ok None 0 d, 0 h, 0 m, 0 s
BackSec public None None Ok None 0 d, 0 h, 0 m, 0 s
Palladium public None None Ok None 0 d, 0 h, 0 m, 0 s
IIECAS public None None Ok None 0 d, 0 h, 0 m, 0 s
NSEC public None None Ok None 0 d, 0 h, 0 m, 0 s
UMBCb 2023-04-14T21:10:36 performer None None Ok 2023-04-14T21:03:12 0 d, 0 h, 0 m, 0 s
PASS public None None Ok None 0 d, 0 h, 0 m, 0 s
DS3TwoSixZero public None None Ok None 0 d, 0 h, 0 m, 0 s
dongdong4fei public None None Ok None 0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.0074 0.00285 8e-05 1.0 140.12 2023-01-03T21:00:05 2023-01-03T20:57:10 Rev1 None None
TrinitySRITrojAI 0.6507 0.6584 0.19262 1.0 294.92 2022-12-22T16:20:07 2022-12-22T16:13:47 Rev1 None None
PL-GIFT 0.0 0.0 0.0 1.0 182.64 2022-12-22T00:40:17 2022-12-22T00:37:17 Rev1 None None
Perspecta-PurdueRutgers 0.20394 0.05149 0.03912 1.0 83.99 2023-01-09T04:10:09 2023-01-09T04:07:25 Rev1 None None
ARM-UCSD 0.0 0.0 0.0 1.0 77.76 2023-01-30T06:20:18 2023-01-30T06:12:44 Rev1 None None
ARM 0.16732 0.09274 0.03691 1.0 98.63 2023-01-27T21:21:16 2023-01-27T21:14:47 Rev1 None None
TrinitySRITrojAI-SBU 0.31599 0.12962 0.08773 1.0 196.47 2023-02-12T02:50:22 2023-02-12T02:40:25 Rev1 None None
ICSI-2 0.01161 0.00185 0.00015 1.0 72.67 2023-01-06T06:30:22 2023-01-06T06:23:20 Rev1 None None
TrinitySRITrojAI-BostonU 0.02344 0.00812 0.00076 1.0 107.79 2023-01-18T22:21:17 2023-01-18T22:10:35 Rev1 None None
trojai-example 0.65417 0.13356 0.2303 0.74444 37.25 2023-03-09T16:46:08 2023-03-09T16:39:47 Rev1 :Container File Missing: :Container Parameters (jsonschema checker)::Schema Header:
UMBCb 0.23266 0.05237 0.04723 1.0 140.27 2023-01-25T19:10:40 2023-01-25T19:05:14 Rev1 None None

All Results

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.69315 0.0 0.25 0.5 28.22 2022-12-29T21:50:05 2022-12-29T21:49:46 Rev1 :No Results: None
Perspecta 0.69315 0.0 0.25 0.5 28.23 2023-01-03T16:10:05 2022-12-30T16:32:28 Rev1 :No Results: None
Perspecta 0.69315 0.0 0.25 0.5 29.22 2023-01-03T16:30:04 2023-01-03T16:24:07 Rev1 :No Results: None
Perspecta 0.69315 0.0 0.25 0.5 2023-01-03T19:50:04 2023-01-03T19:40:08 Rev1 :No Results::Container File Missing: :Schema Header:
Perspecta 0.0074 0.00285 8e-05 1.0 140.12 2023-01-03T21:00:05 2023-01-03T20:57:10 Rev1 None None
Perspecta 0.0651 0.05606 0.01143 1.0 182.26 2023-01-04T18:20:05 2023-01-04T18:12:53 Rev1 None None
Perspecta 0.07542 0.06928 0.016 1.0 182.28 2023-01-05T15:10:05 2023-01-05T15:05:55 Rev1 None None
Perspecta 0.03242 0.02374 0.00273 1.0 182.36 2023-01-10T17:50:05 2023-01-10T17:41:20 Rev1 None None
Perspecta 0.04296 0.03272 0.00478 1.0 182.47 2023-01-11T15:10:05 2023-01-11T15:03:41 Rev1 None None
Perspecta 0.00441 0.00179 3e-05 1.0 182.34 2023-01-11T19:30:04 2023-01-11T19:25:26 Rev1 None None
Perspecta 0.05242 0.02764 0.00489 1.0 182.3 2023-01-12T19:20:04 2023-01-12T19:15:43 Rev1 None None
Perspecta 0.01084 0.00104 0.00012 1.0 182.35 2023-01-12T22:10:04 2023-01-12T22:06:52 Rev1 None None
Perspecta 0.09958 0.03642 0.0119 1.0 193.23 2023-01-16T21:30:04 2023-01-16T21:22:16 Rev1 None None
Perspecta 0.0773 0.00743 0.00568 1.0 194.0 2023-01-16T22:40:06 2023-01-16T22:36:19 Rev1 None None
Perspecta 0.08393 0.01547 0.0071 1.0 201.28 2023-01-31T00:10:04 2023-01-31T00:00:51 Rev1 None None
Perspecta 0.07257 0.0 0.0049 1.0 199.33 2023-01-31T00:40:05 2023-01-31T00:34:50 Rev1 None None
Perspecta 0.07964 0.00843 0.00606 1.0 200.83 2023-02-01T00:00:05 2023-01-31T23:50:08 Rev1 None None
Perspecta 0.08183 0.00977 0.00643 1.0 203.95 2023-02-21T18:50:05 2023-02-20T21:59:09 Rev1 None None
Perspecta 0.05129 0.0 0.0025 1.0 201.46 2023-03-03T15:20:04 2023-03-03T15:18:25 Rev1 None None
Perspecta 0.05129 0.0 0.0025 1.0 200.71 2023-03-07T17:40:05 2023-03-07T17:39:22 Rev1 None None
TrinitySRITrojAI 0.52767 0.58092 0.14346 0.85556 289.36 2022-12-19T23:50:07 2022-12-19T23:49:40 Rev1 None None
TrinitySRITrojAI 0.55578 0.61437 0.16021 0.93333 297.05 2022-12-22T06:40:07 2022-12-22T06:32:44 Rev1 None None
TrinitySRITrojAI 0.6507 0.6584 0.19262 1.0 294.92 2022-12-22T16:20:07 2022-12-22T16:13:47 Rev1 None None
TrinitySRITrojAI 0.6507 0.6584 0.19262 1.0 295.35 2022-12-28T07:20:07 2022-12-28T07:12:59 Rev1 None None
TrinitySRITrojAI 0.59494 0.65509 0.16369 0.94444 272.11 2023-01-05T04:50:07 2023-01-05T04:41:56 Rev1 None None
TrinitySRITrojAI 0.58657 0.74341 0.13839 0.86667 267.04 2023-01-05T07:00:07 2023-01-05T06:54:44 Rev1 None None
TrinitySRITrojAI 0.63407 0.93263 0.12648 0.94444 275.17 2023-01-05T17:50:06 2023-01-05T17:45:51 Rev1 None None
TrinitySRITrojAI 0.08962 0.01203 0.00774 1.0 276.65 2023-01-05T19:00:07 2023-01-05T18:52:48 Rev1 None None
TrinitySRITrojAI 0.06536 0.03302 0.00708 1.0 247.69 2023-02-03T03:40:06 2023-02-03T03:38:18 Rev1 None None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 83.85 2023-02-10T20:50:06 2023-02-10T20:40:08 Rev1 :No Results: None
TrinitySRITrojAI 0.15704 0.10844 0.03564 1.0 196.23 2023-02-10T23:30:06 2023-02-10T23:29:47 Rev1 None None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 2023-03-16T23:40:07 2023-03-16T23:34:36 Rev1 :No Results::Container File Missing: :Container Parameters (jsonschema checker):
TrinitySRITrojAI 0.18756 0.07479 0.03716 1.0 78.33 2023-03-17T19:30:07 2023-03-17T19:29:09 Rev1 None None
PL-GIFT 0.0 0.0 0.0 1.0 182.64 2022-12-22T00:40:17 2022-12-22T00:37:17 Rev1 None None
PL-GIFT 0.27073 0.49594 0.06808 0.95556 182.24 2023-01-11T03:30:08 2023-01-11T03:25:27 Rev1 None None
PL-GIFT 0.00039 0.00074 0.0 1.0 182.42 2023-01-14T03:00:08 2023-01-14T02:58:40 Rev1 None None
PL-GIFT 0.00032 0.00023 0.0 1.0 182.42 2023-01-16T18:40:08 2023-01-16T18:32:32 Rev1 None None
PL-GIFT 0.00118 0.00083 0.0 1.0 182.41 2023-01-17T16:30:09 2023-01-17T16:27:17 Rev1 None None
PL-GIFT 0.00395 0.00278 4e-05 1.0 182.48 2023-01-18T15:50:09 2023-01-18T15:47:08 Rev1 None None
PL-GIFT 0.01834 0.01289 0.00089 1.0 182.43 2023-01-18T17:10:10 2023-01-18T17:02:57 Rev1 None None
PL-GIFT 0.00724 0.00509 0.00014 1.0 182.68 2023-01-19T17:10:09 2023-01-19T17:01:21 Rev1 None None
PL-GIFT 0.00429 0.00302 5e-05 1.0 182.62 2023-01-19T20:30:09 2023-01-19T20:27:46 Rev1 None None
PL-GIFT 0.01005 0.0 0.0001 1.0 182.34 2023-01-27T20:50:09 2023-01-27T20:46:19 Rev1 None None
PL-GIFT 9.86823 6.93534 0.35714 0.0 182.27 2023-02-07T22:40:07 2023-02-07T22:36:21 Rev1 None None
PL-GIFT 0.01925 0.01353 0.00098 1.0 182.27 2023-02-08T02:40:08 2023-02-08T02:30:17 Rev1 None None
PL-GIFT 0.01634 0.01148 0.00071 1.0 182.22 2023-02-14T23:10:08 2023-02-14T23:09:31 Rev1 None None
PL-GIFT 0.0113 0.00794 0.00035 1.0 182.29 2023-02-27T19:30:08 2023-02-27T19:26:01 Rev1 None None
PL-GIFT 0.69315 0.0 0.25 0.5 2023-03-10T23:40:09 2023-03-10T19:43:04 Rev1 :No Results::Container File Missing: :Container Parameters (jsonschema checker):
PL-GIFT 9.86823 6.93534 0.35714 0.0 62.44 2023-03-14T18:20:08 2023-03-14T18:13:46 Rev1 None None
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 2023-01-09T02:50:09 2023-01-09T02:44:38 Rev1 :No Results::Container File Missing: :Schema Header:
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 2023-01-09T03:30:09 2023-01-09T03:27:05 Rev1 :No Results::Container File Missing: :Schema Header:
Perspecta-PurdueRutgers 0.20394 0.05149 0.03912 1.0 83.99 2023-01-09T04:10:09 2023-01-09T04:07:25 Rev1 None None
Perspecta-PurdueRutgers 0.07864 0.01978 0.00685 1.0 83.98 2023-01-09T16:30:10 2023-01-09T16:26:31 Rev1 None None
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 2023-01-11T05:20:09 2023-01-11T05:11:14 Rev1 :No Results::Container File Missing: :Container Parameters (jsonschema checker):
Perspecta-PurdueRutgers 0.10796 0.03548 0.01358 1.0 192.93 2023-01-17T15:20:10 2023-01-17T15:18:30 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 2023-01-24T19:00:21 2023-01-24T18:57:40 Rev1 :No Results::Container File Missing: :Schema Header:
ARM-UCSD 0.69315 0.0 0.25 0.5 2023-01-27T21:51:03 2023-01-27T21:50:37 Rev1 :No Results::Container File Missing: :Schema Header:
ARM-UCSD 0.69315 0.0 0.25 0.5 84.36 2023-01-27T22:30:18 2023-01-27T22:22:57 Rev1 :No Results: None
ARM-UCSD 0.69315 0.0 0.25 0.5 84.37 2023-01-28T00:10:18 2023-01-28T00:06:30 Rev1 :No Results: None
ARM-UCSD 0.69315 0.0 0.25 0.5 97.87 2023-01-28T01:00:18 2023-01-28T00:59:34 Rev1 :No Results: None
ARM-UCSD 0.69315 0.0 0.25 0.5 102.74 2023-01-28T07:20:17 2023-01-28T07:12:33 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 2023-01-30T05:30:17 2023-01-30T05:25:17 Rev1 :No Results::Container File Missing: :Schema Header:
ARM-UCSD 0.0 0.0 0.0 1.0 77.76 2023-01-30T06:20:18 2023-01-30T06:12:44 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 84.06 2023-02-21T18:50:19 2023-02-16T17:42:51 Rev1 :No Results: None
ARM-UCSD 0.69315 0.0 0.25 0.5 84.14 2023-02-21T20:32:14 2023-02-21T20:26:06 Rev1 :Result Parse::No Results: None
ARM-UCSD 0.69315 0.0 0.25 0.5 84.06 2023-02-21T21:10:18 2023-02-21T21:06:56 Rev1 :No Results: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2023-02-21T21:38:14 2023-02-21T21:36:32 Rev1 :No Results::Container File Missing: :Schema Header:
ARM-UCSD 0.69315 0.0 0.25 0.5 84.12 2023-02-22T04:10:19 2023-02-22T04:07:51 Rev1 :No Results: None
ARM-UCSD 7e-05 2e-05 0.0 1.0 84.24 2023-02-22T04:50:18 2023-02-22T04:43:21 Rev1 None None
ARM-UCSD 7e-05 2e-05 0.0 1.0 84.09 2023-02-28T00:50:19 2023-02-28T00:48:27 Rev1 None None
ARM-UCSD 0.12153 0.05434 0.01982 1.0 84.11 2023-03-01T22:20:18 2023-03-01T22:17:24 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 2023-03-20T18:50:18 2023-03-20T18:42:43 Rev1 :No Results::Container File Missing: :Container Parameters (jsonschema checker):
ARM-UCSD 0.69315 0.0 0.25 0.5 55.47 2023-03-25T05:30:20 2023-03-25T05:27:51 Rev1 :No Results::Missing Results: None
ARM-UCSD 0.0 0.0 0.0 1.0 94.06 2023-03-25T22:40:17 2023-03-25T22:38:11 Rev1 None None
ARM 0.69315 0.0 0.25 0.5 2023-01-24T18:00:27 2023-01-23T10:46:35 Rev1 :No Results::Container File Missing: :Schema Header:
ARM 0.69315 0.0 0.25 0.5 2023-01-24T23:50:24 2023-01-24T23:43:55 Rev1 :No Results::Container File Missing: :Schema Header:
ARM 0.69315 0.0 0.25 0.5 2023-01-27T02:10:23 2023-01-27T02:05:01 Rev1 :No Results::Container File Missing: :Schema Header:
ARM 0.69315 0.0 0.25 0.5 2023-01-27T02:40:23 2023-01-27T02:34:35 Rev1 :No Results::Container File Missing: :Schema Header:
ARM 0.69315 0.0 0.25 0.5 2023-01-27T03:20:24 2023-01-27T03:14:21 Rev1 :No Results::Container File Missing: :Schema Header:
ARM 0.69315 0.0 0.25 0.5 2023-01-27T04:00:25 2023-01-27T03:51:27 Rev1 :No Results::Container File Missing: :Schema Header:
ARM 0.69315 0.0 0.25 0.5 2023-01-27T04:50:23 2023-01-27T04:42:10 Rev1 :No Results::Container File Missing: :Schema Header:
ARM 0.16732 0.09274 0.03691 1.0 98.63 2023-01-27T21:21:16 2023-01-27T21:14:47 Rev1 None None
ARM 0.37493 0.12957 0.1126 1.0 196.52 2023-01-30T05:42:17 2023-01-30T05:31:36 Rev1 None None
ARM 0.3356 0.12868 0.09741 1.0 197.72 2023-02-07T05:40:23 2023-02-07T05:32:36 Rev1 None None
ARM 0.69315 0.0 0.25 0.5 95.74 2023-02-07T07:30:22 2023-02-07T07:21:17 Rev1 :No Results: None
ARM 0.69315 0.0 0.25 0.5 92.79 2023-02-07T08:40:21 2023-02-07T08:37:06 Rev1 :No Results: None
ARM 0.69315 0.0 0.25 0.5 137.89 2023-02-07T09:11:10 2023-02-07T09:05:18 Rev1 :No Results: None
ARM 0.1607 0.11085 0.04313 1.0 308.23 2023-02-21T18:50:23 2023-02-21T05:59:48 Rev1 None None
ARM 0.13145 0.1155 0.03541 1.0 307.49 2023-02-28T19:30:23 2023-02-28T19:26:27 Rev1 None None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 2023-01-10T03:20:20 2023-01-10T03:10:53 Rev1 :No Results::Container File Missing: :Schema Header:
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 2023-01-10T03:50:20 2023-01-10T03:42:35 Rev1 :No Results::Container File Missing: :Schema Header:
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 2023-01-10T16:30:22 2023-01-10T16:22:55 Rev1 :No Results::Container File Missing: :Schema Header:
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 2023-01-10T18:20:20 2023-01-10T18:13:59 Rev1 :No Results::Container File Missing: :Schema Header:
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 2023-01-24T20:00:26 2023-01-24T20:00:05 Rev1 :No Results::Container File Missing: :Schema Header:
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 2023-01-24T21:00:24 2023-01-24T20:53:02 Rev1 :No Results::Container File Missing: :Schema Header:
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 83.82 2023-02-11T18:00:23 2023-02-11T17:53:02 Rev1 :No Results: None
TrinitySRITrojAI-SBU 0.31599 0.12962 0.08773 1.0 196.47 2023-02-12T02:50:22 2023-02-12T02:40:25 Rev1 None None
TrinitySRITrojAI-SBU 0.3123 0.04871 0.0744 1.0 196.59 2023-02-21T18:50:24 2023-02-18T22:52:46 Rev1 None None
ICSI-2 0.28827 0.05615 0.0666 1.0 71.68 2023-01-06T01:40:23 2023-01-06T01:36:21 Rev1 None None
ICSI-2 0.01161 0.00185 0.00015 1.0 72.67 2023-01-06T06:30:22 2023-01-06T06:23:20 Rev1 None None
ICSI-2 0.00335 0.00096 1e-05 1.0 70.67 2023-01-07T01:20:20 2023-01-07T01:16:24 Rev1 None None
ICSI-2 0.0183 0.00442 0.0004 1.0 71.63 2023-01-12T03:10:21 2023-01-12T03:08:34 Rev1 None None
ICSI-2 0.02045 0.00558 0.00051 1.0 71.64 2023-01-16T04:30:20 2023-01-16T04:26:04 Rev1 None None
ICSI-2 0.00384 0.00098 2e-05 1.0 75.71 2023-01-17T05:30:23 2023-01-17T05:22:56 Rev1 None None
ICSI-2 0.00323 0.00092 1e-05 1.0 73.68 2023-01-18T07:30:21 2023-01-18T07:27:07 Rev1 None None
ICSI-2 0.00828 0.0035 0.00011 1.0 83.8 2023-01-18T20:30:23 2023-01-18T20:24:39 Rev1 None None
ICSI-2 0.0271 0.02035 0.00204 1.0 78.8 2023-01-20T00:30:22 2023-01-20T00:26:12 Rev1 None None
ICSI-2 0.00137 0.00077 0.0 1.0 76.67 2023-01-20T09:50:24 2023-01-20T09:48:37 Rev1 None None
ICSI-2 0.00321 0.00087 1e-05 1.0 74.71 2023-01-20T23:50:24 2023-01-20T23:45:58 Rev1 None None
ICSI-2 0.00264 0.00072 1e-05 1.0 82.84 2023-01-21T00:50:23 2023-01-21T00:46:45 Rev1 None None
ICSI-2 0.00312 0.00075 1e-05 1.0 72.65 2023-01-24T18:00:30 2023-01-23T23:50:04 Rev1 None None
ICSI-2 9e-05 2e-05 0.0 1.0 80.68 2023-02-04T03:22:36 2023-02-04T03:17:26 Rev1 None None
ICSI-2 0.10654 0.08397 0.02516 1.0 182.1 2023-02-08T06:10:25 2023-02-08T06:06:03 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-01-08T20:30:24 2023-01-08T20:21:39 Rev1 :No Results::Container File Missing: :Schema Header:
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-01-09T07:41:07 2023-01-09T07:34:31 Rev1 :No Results::Container File Missing: :Schema Header:
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-01-09T16:00:26 2023-01-09T15:51:29 Rev1 :No Results::Info File Missing::Container File Missing: None
TrinitySRITrojAI-BostonU 1.11693 0.49996 0.37776 0.55556 84.54 2023-01-09T20:30:25 2023-01-09T20:24:37 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-01-18T17:31:08 2023-01-18T17:23:01 Rev1 :No Results::Container File Missing: :Container Parameters (jsonschema checker):
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 84.49 2023-01-18T21:30:24 2023-01-18T21:25:02 Rev1 :No Results: None
TrinitySRITrojAI-BostonU 0.02344 0.00812 0.00076 1.0 107.79 2023-01-18T22:21:17 2023-01-18T22:10:35 Rev1 None None
TrinitySRITrojAI-BostonU 0.00278 0.00076 1e-05 1.0 198.3 2023-01-19T06:40:25 2023-01-19T06:30:43 Rev1 None None
TrinitySRITrojAI-BostonU 0.66776 0.19367 0.23619 0.47778 97.81 2023-01-20T07:00:25 2023-01-20T06:55:45 Rev1 None None
TrinitySRITrojAI-BostonU 0.90898 0.59206 0.29409 0.57778 97.91 2023-01-21T04:20:26 2023-01-21T04:10:39 Rev1 None None
trojai-example 0.69315 0.0 0.25 0.5 83.84 2022-12-16T22:03:11 2022-12-16T21:52:31 Rev1 :No Results: None
trojai-example 0.69315 0.0 0.25 0.5 83.84 2022-12-16T22:18:49 2022-12-16T22:13:13 Rev1 :No Results: None
trojai-example 0.69315 0.0 0.25 0.5 84.4 2022-12-16T23:59:49 2022-12-16T23:57:10 Rev1 :No Results: None
trojai-example 0.69315 0.0 0.25 0.5 84.44 2022-12-17T00:16:04 2022-12-17T00:15:27 Rev1 :No Results: None
trojai-example 0.69315 0.0 0.25 0.5 84.33 2022-12-17T00:43:36 2022-12-17T00:25:02 Rev1 :No Results: None
trojai-example 0.81007 0.21121 0.3027 0.48889 87.39 2022-12-17T01:07:36 2022-12-17T01:05:14 Rev1 None None
trojai-example 0.89348 0.2549 0.33755 0.56667 84.47 2022-12-28T17:06:41 2022-12-28T17:05:41 Rev1 None :Schema Header::Schema Header::Schema Header::Schema Header::Schema Header:
trojai-example 0.69315 0.0 0.25 0.5 2022-12-28T17:15:14 2022-12-28T17:12:29 Rev1 :No Results::Container File Missing: :Schema Header::Schema Header::Schema Header::Schema Header::Schema Header:
trojai-example 0.8806 0.27187 0.32699 0.47778 84.46 2023-01-25T19:40:36 2023-01-25T19:38:14 Rev1 None :Schema Header:
trojai-example 0.69315 0.0 0.25 0.5 2023-03-09T16:17:14 2023-03-09T16:16:50 Rev1 :No Results::Info File Missing::Container File Missing: None
trojai-example 0.69315 0.0 0.25 0.5 2023-03-09T16:34:14 2023-03-09T16:32:46 Rev1 :No Results::Info File Missing::Container File Missing: None
trojai-example 0.65417 0.13356 0.2303 0.74444 37.25 2023-03-09T16:46:08 2023-03-09T16:39:47 Rev1 :Container File Missing: :Container Parameters (jsonschema checker)::Schema Header:
trojai-example 0.69315 0.0 0.25 0.5 2023-03-10T00:17:34 2023-03-10T00:14:20 Rev1 :No Results::Info File Missing::Container File Missing: None
trojai-example 0.69315 0.0 0.25 0.5 2023-03-10T00:35:00 2023-03-10T00:28:34 Rev1 :No Results::Info File Missing::Container File Missing: None
trojai-example 0.69315 0.0 0.25 0.5 2023-03-10T00:52:10 2023-03-10T00:44:59 Rev1 :No Results::Info File Missing::Container File Missing: None
trojai-example 0.74083 0.16554 0.26851 0.66667 36.81 2023-03-10T01:11:12 2023-03-10T01:09:29 Rev1 :Container File Missing: :Container Parameters (jsonschema checker)::Schema Header:
trojai-example 0.69315 0.0 0.25 0.5 0.61 2023-03-10T01:23:11 2023-03-10T01:22:54 Rev1 :No Results::Container File Missing: :Container Parameters (jsonschema checker)::Schema Header::Execute:
trojai-example 0.74864 0.16179 0.27309 0.5 34.4 2023-03-10T01:30:04 2023-03-10T01:28:53 Rev1 :Container File Missing: :Container Parameters (jsonschema checker)::Schema Header::Execute:
trojai-example 0.65533 0.18376 0.23213 0.62222 34.36 2023-03-10T01:43:42 2023-03-10T01:42:46 Rev1 None :Container Parameters (jsonschema checker)::Schema Header::Execute:
trojai-example 0.64748 0.14578 0.22829 0.67778 40.73 2023-03-10T03:05:08 2023-03-10T03:04:39 Rev1 None :Container Parameters (jsonschema checker)::Schema Header::Execute:
UMBCb 0.69315 0.0 0.25 0.5 2023-01-24T18:00:44 2023-01-22T17:38:34 Rev1 :No Results::Container File Missing: :Schema Header:
UMBCb 0.69315 0.0 0.25 0.5 2023-01-24T20:50:39 2023-01-24T20:50:29 Rev1 :No Results::Info File Missing::Container File Missing: None
UMBCb 0.23266 0.05237 0.04723 1.0 140.27 2023-01-25T19:10:40 2023-01-25T19:05:14 Rev1 None None
UMBCb 0.69315 0.0 0.25 0.5 28.19 2023-03-01T20:30:37 2023-03-01T20:29:28 Rev1 :No Results: None
UMBCb 1.26502 0.00973 0.51514 -0.0 83.85 2023-03-08T19:30:35 2023-03-08T19:27:41 Rev1 None None
UMBCb 0.69315 0.0 0.25 0.5 2023-03-10T23:40:35 2023-03-09T17:11:47 Rev1 :No Results::Container File Missing: :Container Parameters (jsonschema checker):
UMBCb 0.46666 0.08 0.14213 0.95556 31.68 2023-03-15T16:30:33 2023-03-15T16:28:09 Rev1 None None
UMBCb 0.24771 0.00953 0.04829 1.0 28.39 2023-03-15T22:30:31 2023-03-15T22:28:34 Rev1 None None
UMBCb 0.57962 0.06762 0.1944 0.86667 30.46 2023-03-21T20:30:33 2023-03-21T20:23:38 Rev1 None None
UMBCb 0.37068 0.37261 0.1215 0.95556 28.35 2023-04-14T21:10:36 2023-04-14T21:03:12 Rev1 None None

Required filename format: "cyber-pdf-dec2022_dev_<Submission Name>.simg"
Accepting submissions: True
Number of models in cyber-pdf-dec2022, dev: 120
Execution timeout (hh:mm:ss): 20:00:00

Teams/Jobs

Team Submission Timestamp Type Job Status File Status General Status File Timestamp Time until next execution
Perspecta performer None None Ok None 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI performer None None Ok None 0 d, 0 h, 0 m, 0 s
DRAFFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
PL-GIFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers performer None None Ok None 0 d, 0 h, 0 m, 0 s
Perspecta-IUB performer None None Ok None 0 d, 0 h, 0 m, 0 s
ARM-UCSD performer None None Ok None 0 d, 0 h, 0 m, 0 s
ARM performer None None Ok None 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU performer None None Ok None 0 d, 0 h, 0 m, 0 s
ARM-UMBC performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-1 performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-2 performer None None Ok None 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU performer None None Ok None 0 d, 0 h, 0 m, 0 s
trojai-example public None None Ok None 0 d, 0 h, 0 m, 0 s
IceTorch public None None Ok None 0 d, 0 h, 0 m, 0 s
trojaicy public None None Ok None 0 d, 0 h, 0 m, 0 s
Hector public None None Ok None 0 d, 0 h, 0 m, 0 s
Cassandra-XF public None None Ok None 0 d, 0 h, 0 m, 0 s
gooddefense public None None Ok None 0 d, 0 h, 0 m, 0 s
cyberinfrastructure public None None Ok None 0 d, 0 h, 0 m, 0 s
glaros public None None Ok None 0 d, 0 h, 0 m, 0 s
Ultraman public None None Ok None 0 d, 0 h, 0 m, 0 s
BackSec public None None Ok None 0 d, 0 h, 0 m, 0 s
Palladium public None None Ok None 0 d, 0 h, 0 m, 0 s
IIECAS public None None Ok None 0 d, 0 h, 0 m, 0 s
NSEC public None None Ok None 0 d, 0 h, 0 m, 0 s
UMBCb performer None None Ok None 0 d, 0 h, 0 m, 0 s
PASS public None None Ok None 0 d, 0 h, 0 m, 0 s
DS3TwoSixZero public None None Ok None 0 d, 0 h, 0 m, 0 s
dongdong4fei public None None Ok None 0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors

All Results

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors

Round 13 leaderboard for object detection Feb 2023.

Each AI is trained to perform Object Detection using a single stage (SSD), a two stage detector (Faster-RCNN), or a transformer based detector (DETR). For those AIs that have been attacked, the presence of the pattern will cause the AI to reliably produce the wrong prediction. The Training Data Download consists of 128 reference AIs with example input data. More info here.

DOTA_v2 arial image dataset with Localization Trigger altering the traffic circle box.

DOTA_v2 arial image dataset with Localization Trigger altering the traffic circle box.

train: The train dataset that is distributed with each round.
test: The test dataset that is sequestered/hidden, used for evaluation. Submissions here should be fully realized with complete schema and parameters.
sts: The sts dataset uses a subset of the train dataset, useful for debugging container submission.
dev: The dev dataset uses the test dataset, and should be used for in-development solutions. Schemas must be valid, but do not need to be complete. Results do not count towards the program.

Required filename format: "object-detection-feb2023_train_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-feb2023, train: 121
Execution timeout (hh:mm:ss): 3 days, 6:00:00

Teams/Jobs

Team Submission Timestamp Type Job Status File Status General Status File Timestamp Time until next execution
Perspecta 2023-06-24T00:30:05 performer None None Ok 2023-06-24T00:26:43 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI 2023-07-11T07:00:07 performer None None Ok 2023-07-11T06:54:38 0 d, 0 h, 0 m, 0 s
DRAFFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
PL-GIFT 2023-07-25T16:00:09 performer None None Ok 2023-07-25T15:58:39 0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers 2023-07-20T05:30:11 performer None None Ok 2023-07-20T05:28:43 0 d, 0 h, 0 m, 0 s
Perspecta-IUB 2023-05-02T19:00:10 performer None None Ok 2023-05-02T18:57:35 0 d, 0 h, 0 m, 0 s
ARM-UCSD 2023-06-21T01:40:17 performer None None Ok 2023-06-21T01:31:31 0 d, 0 h, 0 m, 0 s
ARM 2023-06-13T04:50:26 performer None None Ok 2023-06-13T04:48:44 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU 2023-05-02T02:00:22 performer None None Ok 2023-05-02T01:51:13 0 d, 0 h, 0 m, 0 s
ARM-UMBC performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-1 performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-2 2023-06-26T08:10:27 performer None None Ok 2023-06-26T08:04:02 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU 2023-06-27T15:00:28 performer None None Ok 2023-06-27T14:54:13 0 d, 0 h, 0 m, 0 s
trojai-example public None None Ok None 0 d, 0 h, 0 m, 0 s
IceTorch public None None Ok None 0 d, 0 h, 0 m, 0 s
trojaicy public None None Ok None 0 d, 0 h, 0 m, 0 s
Hector public None None Ok None 0 d, 0 h, 0 m, 0 s
Cassandra-XF public None None Ok None 0 d, 0 h, 0 m, 0 s
gooddefense public None None Ok None 0 d, 0 h, 0 m, 0 s
cyberinfrastructure public None None Ok None 0 d, 0 h, 0 m, 0 s
glaros public None None Ok None 0 d, 0 h, 0 m, 0 s
Ultraman public None None Ok None 0 d, 0 h, 0 m, 0 s
BackSec public None None Ok None 0 d, 0 h, 0 m, 0 s
Palladium public None None Ok None 0 d, 0 h, 0 m, 0 s
IIECAS public None None Ok None 0 d, 0 h, 0 m, 0 s
NSEC public None None Ok None 0 d, 0 h, 0 m, 0 s
UMBCb performer None None Ok None 0 d, 0 h, 0 m, 0 s
PASS public None None Ok None 0 d, 0 h, 0 m, 0 s
DS3TwoSixZero public None None Ok None 0 d, 0 h, 0 m, 0 s
dongdong4fei public None None Ok None 0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.80483 0.07536 0.30157 0.45395 33303.86 2023-06-24T00:30:05 2023-06-24T00:26:43 Rev1 None None
TrinitySRITrojAI 0.28761 0.05663 0.0818 0.96697 92227.87 2023-07-08T23:30:06 2023-07-08T23:27:02 Rev1 None None
PL-GIFT 0.16676 0.03033 0.03932 1.0 1057.28 2023-07-07T18:20:08 2023-07-07T18:14:04 Rev1 None None
Perspecta-PurdueRutgers 0.14331 0.09346 0.03713 0.97711 1521.31 2023-03-13T23:20:09 2023-03-13T23:18:11 Rev1 None None
Perspecta-IUB 0.07305 0.038 0.0197 0.99698 2215.09 2023-03-25T18:30:10 2023-03-25T18:27:11 Rev1 None None
ARM-UCSD 0.31089 0.07493 0.09475 0.95504 1239.94 2023-06-21T01:40:17 2023-06-21T01:31:31 Rev1 None None
ARM 0.12239 0.03039 0.02449 0.99918 1444.37 2023-06-13T04:50:26 2023-06-13T04:48:44 Rev1 None None
TrinitySRITrojAI-SBU 0.33446 0.02658 0.08495 0.99027 1013.31 2023-05-02T02:00:22 2023-05-02T01:51:13 Rev1 None None
ICSI-2 0.04741 0.01036 0.00455 1.0 94363.48 2023-06-12T03:00:28 2023-06-12T02:54:36 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-04-09T19:30:25 2023-04-09T19:21:50 Rev1 :Container File Missing: :Schema Header:

All Results

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.80483 0.07536 0.30157 0.45395 33303.86 2023-06-24T00:30:05 2023-06-24T00:26:43 Rev1 None None
TrinitySRITrojAI 0.58792 0.025 0.19946 0.88857 6042.11 2023-03-25T00:30:07 2023-03-25T00:26:35 Rev1 None None
TrinitySRITrojAI 0.64293 0.04626 0.22676 0.75027 34800.23 2023-04-18T19:40:10 2023-04-18T19:32:02 Rev1 None None
TrinitySRITrojAI 0.63268 0.02677 0.22133 0.7463 88552.91 2023-04-25T07:50:06 2023-04-25T07:40:28 Rev1 None None
TrinitySRITrojAI 0.70876 0.13495 0.23539 0.71395 34243.13 2023-06-02T21:20:06 2023-06-02T21:10:40 Rev1 None None
TrinitySRITrojAI 0.53035 0.05058 0.17758 0.86061 121525.57 2023-06-07T05:40:07 2023-06-07T05:39:47 Rev1 None None
TrinitySRITrojAI 0.42571 0.05134 0.12837 0.9253 38987.68 2023-06-26T21:00:07 2023-06-26T20:57:43 Rev1 None None
TrinitySRITrojAI 0.28761 0.05663 0.0818 0.96697 92227.87 2023-07-08T23:30:06 2023-07-08T23:27:02 Rev1 None None
TrinitySRITrojAI 0.38822 0.06367 0.11591 0.92941 39812.77 2023-07-11T07:00:07 2023-07-11T06:54:38 Rev1 None None
PL-GIFT 0.44931 0.06064 0.13678 0.88953 1049.86 2023-04-27T22:20:13 2023-04-27T22:19:31 Rev1 None None
PL-GIFT 0.59777 0.09902 0.20478 0.69093 2409.43 2023-05-11T06:50:06 2023-05-11T06:45:25 Rev1 None None
PL-GIFT 0.16676 0.03033 0.03932 1.0 1057.28 2023-07-07T18:20:08 2023-07-07T18:14:04 Rev1 None None
PL-GIFT 0.06873 0.02022 0.01339 1.0 1192.92 2023-07-09T18:00:07 2023-07-09T17:56:47 Rev1 None None
PL-GIFT 0.12238 0.0287 0.02737 1.0 1238.63 2023-07-09T20:10:07 2023-07-09T20:00:57 Rev1 None None
PL-GIFT 0.11539 0.02478 0.02334 1.0 1186.23 2023-07-09T23:20:07 2023-07-09T23:14:58 Rev1 None None
PL-GIFT 0.0942 0.02213 0.01806 1.0 1213.12 2023-07-10T17:30:08 2023-07-10T17:22:01 Rev1 None None
PL-GIFT 0.01694 0.00586 0.00123 1.0 1140.14 2023-07-10T19:10:08 2023-07-10T19:02:59 Rev1 None None
PL-GIFT 0.11566 0.02762 0.02535 1.0 1074.6 2023-07-10T22:30:08 2023-07-10T22:29:31 Rev1 None None
PL-GIFT 0.1048 0.02667 0.02311 1.0 1168.15 2023-07-12T22:40:07 2023-07-12T22:40:04 Rev1 None None
PL-GIFT 0.3457 0.03488 0.09878 1.0 78911.58 2023-07-14T23:20:08 2023-07-14T23:17:11 Rev1 None None
PL-GIFT 0.2795 0.02962 0.06999 0.9989 142510.69 2023-07-18T20:20:10 2023-07-18T20:10:35 Rev1 None None
PL-GIFT 0.47324 0.04797 0.15279 0.90447 143280.68 2023-07-25T16:00:09 2023-07-25T15:58:39 Rev1 None None
Perspecta-PurdueRutgers 0.14331 0.09346 0.03713 0.97711 1521.31 2023-03-13T23:20:09 2023-03-13T23:18:11 Rev1 None None
Perspecta-PurdueRutgers 0.52293 0.14911 0.15293 0.8162 54241.01 2023-05-20T06:30:10 2023-05-20T06:27:01 Rev1 None None
Perspecta-PurdueRutgers 0.52293 0.14911 0.15293 0.8162 55374.42 2023-05-29T05:10:09 2023-05-29T05:00:42 Rev1 None None
Perspecta-PurdueRutgers 0.46465 0.13359 0.14147 0.81195 55009.21 2023-06-11T17:50:10 2023-06-11T17:40:16 Rev1 None None
Perspecta-PurdueRutgers 0.69549 0.46623 0.1426 0.86458 57419.61 2023-07-12T00:20:10 2023-07-12T00:19:44 Rev1 None None
Perspecta-PurdueRutgers 0.69549 0.46623 0.1426 0.86458 57595.33 2023-07-15T06:40:10 2023-07-15T06:33:56 Rev1 None None
Perspecta-PurdueRutgers 1.13257 0.76907 0.15249 0.84128 54787.45 2023-07-17T19:20:12 2023-07-17T19:15:00 Rev1 None None
Perspecta-PurdueRutgers 1.55671 0.97681 0.1567 0.80441 54847.82 2023-07-20T05:30:11 2023-07-20T05:28:43 Rev1 None None
Perspecta-IUB 0.07305 0.038 0.0197 0.99698 2215.09 2023-03-25T18:30:10 2023-03-25T18:27:11 Rev1 None None
Perspecta-IUB 0.2197 0.08925 0.06484 0.98479 1971.36 2023-03-27T20:10:11 2023-03-27T20:09:38 Rev1 None None
Perspecta-IUB 0.2347 0.05477 0.07012 0.98506 1655.38 2023-03-29T03:00:11 2023-03-29T02:57:04 Rev1 None None
Perspecta-IUB 0.34856 0.05517 0.11082 0.94435 6867.78 2023-03-29T20:50:10 2023-03-29T20:50:03 Rev1 None None
Perspecta-IUB 0.34856 0.05517 0.11082 0.94435 6725.45 2023-05-02T19:00:10 2023-05-02T18:57:35 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 485.79 2023-05-17T22:50:17 2023-05-17T22:49:27 Rev1 :Missing Results: None
ARM-UCSD 0.5205 0.04816 0.18026 0.75822 521.93 2023-06-05T23:40:17 2023-06-05T23:33:29 Rev1 None None
ARM-UCSD 0.31089 0.07493 0.09475 0.95504 1239.94 2023-06-21T01:40:17 2023-06-21T01:31:31 Rev1 None None
ARM 0.15563 0.03911 0.03868 0.99548 1942.35 2023-05-16T12:10:24 2023-05-16T12:04:17 Rev1 None None
ARM 0.12146 0.03303 0.02506 0.99904 1332.64 2023-05-16T16:50:24 2023-05-16T16:44:18 Rev1 None None
ARM 0.12239 0.03039 0.02449 0.99918 1444.37 2023-06-13T04:50:26 2023-06-13T04:48:44 Rev1 None None
TrinitySRITrojAI-SBU 0.56428 0.03863 0.18872 0.84581 1028.38 2023-04-04T05:30:19 2023-04-04T05:22:12 Rev1 None None
TrinitySRITrojAI-SBU 0.55265 0.03907 0.18384 0.85485 1010.28 2023-04-18T19:42:50 2023-04-18T19:40:00 Rev1 None None
TrinitySRITrojAI-SBU 0.3976 0.03061 0.11308 0.98177 673.55 2023-04-18T23:50:24 2023-04-18T23:45:56 Rev1 None None
TrinitySRITrojAI-SBU 0.33446 0.02658 0.08495 0.99027 1013.31 2023-05-02T02:00:22 2023-05-02T01:51:13 Rev1 None None
ICSI-2 0.43245 0.0486 0.13363 0.93695 742.6 2023-03-15T22:10:24 2023-03-15T22:00:30 Rev1 None None
ICSI-2 0.26257 0.07974 0.0726 0.96203 879.15 2023-03-31T10:30:21 2023-03-31T10:21:51 Rev1 None None
ICSI-2 0.1736 0.09726 0.04306 0.97026 887.76 2023-04-07T03:10:23 2023-04-07T03:04:19 Rev1 None None
ICSI-2 0.294 0.07303 0.08151 0.95806 853.13 2023-04-08T02:00:23 2023-04-08T01:52:38 Rev1 None None
ICSI-2 0.23231 0.06364 0.06151 0.97697 1007.49 2023-04-19T01:40:29 2023-04-19T01:40:12 Rev1 None None
ICSI-2 0.22221 0.06141 0.05717 0.9804 17844.11 2023-05-06T01:10:24 2023-05-06T01:08:30 Rev1 None None
ICSI-2 0.23087 0.05649 0.0564 0.97766 3744.01 2023-05-12T10:00:24 2023-05-12T09:57:07 Rev1 None None
ICSI-2 0.17839 0.02967 0.03594 0.99767 56061.37 2023-05-22T19:52:00 2023-05-22T19:48:12 Rev1 None None
ICSI-2 0.1718 0.02812 0.03372 0.99836 112057.34 2023-05-28T23:00:28 2023-05-28T22:54:01 Rev1 None None
ICSI-2 0.16238 0.02867 0.03152 0.99849 94211.9 2023-06-05T22:50:28 2023-06-05T22:41:55 Rev1 None None
ICSI-2 0.04741 0.01036 0.00455 1.0 94363.48 2023-06-12T03:00:28 2023-06-12T02:54:36 Rev1 None None
ICSI-2 0.17533 0.02278 0.03103 0.99986 93584.12 2023-06-26T08:10:27 2023-06-26T08:04:02 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-04-09T19:30:25 2023-04-09T19:21:50 Rev1 :Container File Missing: :Schema Header:
TrinitySRITrojAI-BostonU 0.70183 0.03606 0.25421 0.5 914.59 2023-04-10T22:20:24 2023-04-10T22:13:48 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-06-06T21:40:28 2023-06-06T21:34:52 Rev1 :No Results::Missing Results::Container File Missing: :Schema Header:
TrinitySRITrojAI-BostonU 0.70398 0.01785 0.25539 0.5 644.37 2023-06-11T05:50:30 2023-06-11T05:49:46 Rev1 None None
TrinitySRITrojAI-BostonU 0.70183 0.03606 0.25421 0.5 1971.91 2023-06-11T21:00:30 2023-06-11T20:53:10 Rev1 None None
TrinitySRITrojAI-BostonU 0.70398 0.01785 0.25539 0.5 703.53 2023-06-13T09:20:30 2023-06-13T09:15:37 Rev1 None None
TrinitySRITrojAI-BostonU 0.70398 0.01785 0.25539 0.5 2261.79 2023-06-13T21:30:31 2023-06-13T21:24:31 Rev1 None None
TrinitySRITrojAI-BostonU 0.70398 0.01785 0.25539 0.5 2280.26 2023-06-14T00:20:31 2023-06-14T00:14:35 Rev1 None None
TrinitySRITrojAI-BostonU 0.70398 0.01785 0.25539 0.5 2280.96 2023-06-14T07:20:31 2023-06-14T07:14:39 Rev1 None None
TrinitySRITrojAI-BostonU 0.70398 0.01785 0.25539 0.5 2190.35 2023-06-14T14:50:32 2023-06-14T14:45:31 Rev1 None None
TrinitySRITrojAI-BostonU 0.70398 0.01785 0.25539 0.5 752.05 2023-06-23T00:00:30 2023-06-22T23:52:22 Rev1 None None
TrinitySRITrojAI-BostonU 0.69146 0.00936 0.24916 0.5 4751.11 2023-06-27T15:00:28 2023-06-27T14:54:13 Rev1 None None

Required filename format: "object-detection-feb2023_test_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-feb2023, test: 185
Execution timeout (hh:mm:ss): 5 days, 8:00:00

Teams/Jobs

Team Submission Timestamp Type Job Status File Status General Status File Timestamp Time until next execution
Perspecta 2023-07-11T00:00:05 performer None None Ok 2023-07-10T23:56:23 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI 2023-07-11T07:00:07 performer None None Ok 2023-07-11T06:54:38 0 d, 0 h, 0 m, 0 s
DRAFFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
PL-GIFT 2023-07-25T16:00:09 performer None None Ok 2023-07-25T15:58:39 0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers 2023-07-20T05:30:11 performer None Ok Ok 2023-07-20T05:28:43 0 d, 0 h, 0 m, 0 s
Perspecta-IUB 2023-06-27T19:10:10 performer None None Ok 2023-06-27T19:03:38 0 d, 0 h, 0 m, 0 s
ARM-UCSD 2023-06-21T01:40:17 performer None None Ok 2023-06-21T01:31:31 0 d, 0 h, 0 m, 0 s
ARM 2023-06-13T04:50:26 performer None Ok Ok 2023-06-13T04:48:44 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU 2023-05-02T02:00:22 performer None None Ok 2023-05-02T01:51:13 0 d, 0 h, 0 m, 0 s
ARM-UMBC performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-1 performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-2 2023-07-11T02:00:28 performer None None Ok 2023-07-11T01:56:07 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU 2023-06-27T15:00:28 performer None None Ok 2023-06-27T14:54:13 0 d, 0 h, 0 m, 0 s
trojai-example 2023-03-13T15:10:31 public None None Ok 2023-03-13T15:03:50 0 d, 0 h, 0 m, 0 s
IceTorch public None None Ok None 0 d, 0 h, 0 m, 0 s
trojaicy public None None Ok None 0 d, 0 h, 0 m, 0 s
Hector public None None Ok None 0 d, 0 h, 0 m, 0 s
Cassandra-XF public None None Ok None 0 d, 0 h, 0 m, 0 s
gooddefense public None None Ok None 0 d, 0 h, 0 m, 0 s
cyberinfrastructure public None None Ok None 0 d, 0 h, 0 m, 0 s
glaros public None None Ok None 0 d, 0 h, 0 m, 0 s
Ultraman public None None Ok None 0 d, 0 h, 0 m, 0 s
BackSec public None None Ok None 0 d, 0 h, 0 m, 0 s
Palladium public None None Ok None 0 d, 0 h, 0 m, 0 s
IIECAS public None None Ok None 0 d, 0 h, 0 m, 0 s
NSEC public None None Ok None 0 d, 0 h, 0 m, 0 s
UMBCb performer None None Ok None 0 d, 0 h, 0 m, 0 s
PASS public None None Ok None 0 d, 0 h, 0 m, 0 s
DS3TwoSixZero public None None Ok None 0 d, 0 h, 0 m, 0 s
dongdong4fei public None None Ok None 0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.66901 0.04582 0.23789 0.63294 3714.45 2023-06-27T17:50:05 2023-06-27T17:41:31 Rev1 :Missing Results: None
TrinitySRITrojAI 0.58517 0.07475 0.19933 0.76324 50021.37 2023-07-11T07:00:07 2023-07-11T06:54:38 Rev1 None None
PL-GIFT 0.6747 0.06768 0.23394 0.66588 103715.42 2023-07-14T23:20:08 2023-07-14T23:17:11 Rev1 None None
Perspecta-PurdueRutgers 0.28314 0.08543 0.07977 0.92647 79699.53 2023-07-20T05:30:11 2023-07-20T05:28:43 Rev1 None None
Perspecta-IUB 2.11938 0.63165 0.29264 0.63835 3088.39 2023-03-27T20:10:11 2023-03-27T20:09:38 Rev1 None None
ARM-UCSD 0.93411 0.16792 0.2931 0.63641 1895.26 2023-06-21T01:40:17 2023-06-21T01:31:31 Rev1 None None
ARM 1.03628 0.20235 0.29674 0.69388 2107.0 2023-06-13T04:50:26 2023-06-13T04:48:44 Rev1 None None
TrinitySRITrojAI-SBU 0.73799 0.06395 0.26705 0.55753 1500.88 2023-05-02T02:00:22 2023-05-02T01:51:13 Rev1 None None
ICSI-2 0.79481 0.17951 0.22635 0.74606 123545.29 2023-06-12T03:00:28 2023-06-12T02:54:36 Rev1 None None
TrinitySRITrojAI-BostonU 0.68447 0.0128 0.24619 0.52353 2041.22 2023-04-24T14:10:28 2023-04-22T11:38:05 Rev1 None None
trojai-example 0.96553 0.12902 0.33804 0.50588 1149.63 2023-03-10T22:41:58 2023-03-10T22:40:44 Rev1 None :Schema Header:

All Results

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.85628 0.10729 0.29425 0.48676 3760.58 2023-04-04T06:50:05 2023-04-04T06:46:51 Rev1 None None
Perspecta 0.69315 0.0 0.25 0.5 1458.84 2023-04-18T06:50:06 2023-04-18T06:41:56 Rev1 None None
Perspecta 0.70322 0.03718 0.25335 0.54094 3403.78 2023-04-18T15:10:07 2023-04-18T15:08:18 Rev1 None None
Perspecta 0.68488 0.03458 0.24553 0.57765 4379.48 2023-04-28T17:40:05 2023-04-28T17:33:27 Rev1 None None
Perspecta 0.67461 0.04314 0.24035 0.62588 4376.16 2023-04-29T03:40:05 2023-04-29T03:39:59 Rev1 None None
Perspecta 0.73681 0.06073 0.26946 0.52412 40057.86 2023-06-24T00:30:05 2023-06-24T00:26:43 Rev1 None None
Perspecta 0.66901 0.04582 0.23789 0.63294 3714.45 2023-06-27T17:50:05 2023-06-27T17:41:31 Rev1 :Missing Results: None
Perspecta 0.66443 0.04559 0.23573 0.62847 1861.58 2023-07-11T00:00:05 2023-07-10T23:56:23 Rev1 :Missing Results: None
TrinitySRITrojAI 0.782 0.06766 0.28295 0.50535 8221.66 2023-03-25T00:30:07 2023-03-25T00:26:35 Rev1 None None
TrinitySRITrojAI 0.73832 0.04847 0.27013 0.50959 50605.8 2023-04-18T19:40:10 2023-04-18T19:32:02 Rev1 None None
TrinitySRITrojAI 0.74802 0.05977 0.26871 0.53871 94737.94 2023-04-25T07:50:06 2023-04-25T07:40:28 Rev1 None None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 1045.57 2023-05-16T16:10:06 2023-05-16T16:06:20 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 2023-05-26T18:00:06 2023-05-26T17:51:22 Rev1 :No Results::Missing Results::Info File Missing: None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 273.28 2023-06-01T07:20:06 2023-06-01T07:13:14 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.84728 0.10419 0.29888 0.55453 55218.93 2023-06-02T21:20:06 2023-06-02T21:10:40 Rev1 None None
TrinitySRITrojAI 0.65772 0.04184 0.23633 0.60194 170288.26 2023-06-07T05:40:07 2023-06-07T05:39:47 Rev1 None None
TrinitySRITrojAI 0.59497 0.05576 0.20457 0.75318 48983.67 2023-06-26T21:00:07 2023-06-26T20:57:43 Rev1 None None
TrinitySRITrojAI 0.73985 0.13193 0.24269 0.70759 113623.26 2023-07-08T23:30:06 2023-07-08T23:27:02 Rev1 None None
TrinitySRITrojAI 0.58517 0.07475 0.19933 0.76324 50021.37 2023-07-11T07:00:07 2023-07-11T06:54:38 Rev1 None None
PL-GIFT 0.70689 0.06132 0.25544 0.60382 1546.41 2023-04-27T22:20:13 2023-04-27T22:19:31 Rev1 None None
PL-GIFT 0.86455 0.11637 0.30106 0.57476 3475.73 2023-05-11T06:50:06 2023-05-11T06:45:25 Rev1 None None
PL-GIFT 6.28303 1.59088 0.37611 0.42512 137288.38 2023-06-27T18:20:52 2023-06-27T18:17:58 Rev1 :Missing Results: None
PL-GIFT 0.64791 0.03093 0.23011 0.63488 1608.66 2023-07-07T18:20:08 2023-07-07T18:14:04 Rev1 None None
PL-GIFT 0.69315 0.0 0.25 0.5 2023-07-08T17:00:08 2023-07-08T16:58:45 Rev1 :No Results::Missing Results: :Container Parameters (metaparameters)::Container Parameters (metaparameters schema):
PL-GIFT 0.97445 0.40475 0.25058 0.57365 1718.47 2023-07-09T18:00:07 2023-07-09T17:56:47 Rev1 None None
PL-GIFT 0.64914 0.03412 0.23184 0.60365 1863.48 2023-07-09T20:10:07 2023-07-09T20:00:57 Rev1 None None
PL-GIFT 0.64536 0.0316 0.23016 0.58641 1827.77 2023-07-09T23:20:07 2023-07-09T23:14:58 Rev1 None None
PL-GIFT 0.7319 0.07514 0.25564 0.58294 1735.73 2023-07-10T17:30:08 2023-07-10T17:22:01 Rev1 None None
PL-GIFT 0.87341 0.29549 0.26587 0.59188 1754.85 2023-07-10T19:10:08 2023-07-10T19:02:59 Rev1 None None
PL-GIFT 0.64213 0.0293 0.22828 0.616 1727.3 2023-07-10T22:30:08 2023-07-10T22:29:31 Rev1 None None
PL-GIFT 0.644 0.03345 0.23086 0.61994 1759.37 2023-07-12T22:40:07 2023-07-12T22:40:04 Rev1 None None
PL-GIFT 0.6747 0.06768 0.23394 0.66588 103715.42 2023-07-14T23:20:08 2023-07-14T23:17:11 Rev1 None None
PL-GIFT 0.67902 0.06397 0.24158 0.64029 193584.83 2023-07-18T20:20:10 2023-07-18T20:10:35 Rev1 None None
PL-GIFT 0.70632 0.0564 0.25471 0.57206 188393.05 2023-07-25T16:00:09 2023-07-25T15:58:39 Rev1 None None
Perspecta-PurdueRutgers 0.49376 0.09943 0.14978 0.85147 73898.53 2023-05-20T06:30:10 2023-05-20T06:27:01 Rev1 None None
Perspecta-PurdueRutgers 0.46868 0.09453 0.14143 0.86535 75716.78 2023-05-29T05:10:09 2023-05-29T05:00:42 Rev1 None None
Perspecta-PurdueRutgers 0.41534 0.08223 0.12831 0.87729 78407.19 2023-06-10T08:20:10 2023-06-10T08:19:31 Rev1 :Missing Results: None
Perspecta-PurdueRutgers 0.30574 0.08178 0.08322 0.92429 78295.74 2023-06-11T17:50:10 2023-06-11T17:40:16 Rev1 None None
Perspecta-PurdueRutgers 0.3838 0.09183 0.11632 0.88535 82448.92 2023-07-10T14:40:11 2023-07-10T14:35:18 Rev1 :Missing Results: None
Perspecta-PurdueRutgers 0.30891 0.0925 0.08866 0.92035 82900.95 2023-07-12T00:20:10 2023-07-12T00:19:44 Rev1 None None
Perspecta-PurdueRutgers 0.30891 0.0925 0.08866 0.92035 81533.7 2023-07-15T06:40:10 2023-07-15T06:33:56 Rev1 None None
Perspecta-PurdueRutgers 0.39044 0.08405 0.12161 0.88365 79262.11 2023-07-16T16:10:12 2023-07-16T16:00:48 Rev1 :Missing Results: None
Perspecta-PurdueRutgers 0.41833 0.30072 0.08081 0.92165 78248.52 2023-07-17T19:20:12 2023-07-17T19:15:00 Rev1 None None
Perspecta-PurdueRutgers 0.28314 0.08543 0.07977 0.92647 79699.53 2023-07-20T05:30:11 2023-07-20T05:28:43 Rev1 None None
Perspecta-IUB 0.69315 0.0 0.25 0.5 2023-03-25T15:50:11 2023-03-25T15:46:48 Rev1 None :Schema Header:
Perspecta-IUB 1.67989 0.42697 0.31374 0.63306 3470.85 2023-03-25T18:30:10 2023-03-25T18:27:11 Rev1 None None
Perspecta-IUB 2.11938 0.63165 0.29264 0.63835 3088.39 2023-03-27T20:10:11 2023-03-27T20:09:38 Rev1 None None
Perspecta-IUB 1.17077 0.28654 0.29032 0.55406 2530.22 2023-03-28T01:50:11 2023-03-28T01:41:16 Rev1 None None
Perspecta-IUB 1.46808 0.3249 0.33534 0.57447 2556.06 2023-03-29T03:00:11 2023-03-29T02:57:04 Rev1 None None
Perspecta-IUB 1.27651 0.26722 0.31383 0.53088 10960.17 2023-03-29T20:50:10 2023-03-29T20:50:03 Rev1 None None
Perspecta-IUB 1.27651 0.26722 0.31383 0.53088 10878.02 2023-05-02T19:00:10 2023-05-02T18:57:35 Rev1 None None
Perspecta-IUB 1.27651 0.26722 0.31383 0.53088 10463.62 2023-06-27T19:10:10 2023-06-27T19:03:38 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 2023-05-30T17:00:18 2023-05-30T16:56:16 Rev1 :Executed File Update::No Results::Missing Results::Info File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 769.68 2023-06-05T20:40:15 2023-06-05T20:37:29 Rev1 :Missing Results: None
ARM-UCSD 0.93411 0.16792 0.2931 0.63641 1895.26 2023-06-21T01:40:17 2023-06-21T01:31:31 Rev1 None None
ARM 0.96557 0.18772 0.28498 0.68 3027.23 2023-05-16T12:10:24 2023-05-16T12:04:17 Rev1 None None
ARM 0.95802 0.18412 0.28818 0.68771 2046.45 2023-05-16T16:50:24 2023-05-16T16:44:18 Rev1 None None
ARM 1.03628 0.20235 0.29674 0.69388 2107.0 2023-06-13T04:50:26 2023-06-13T04:48:44 Rev1 None None
TrinitySRITrojAI-SBU 0.71798 0.0412 0.26142 0.52729 1562.78 2023-04-04T05:30:19 2023-04-04T05:22:12 Rev1 None None
TrinitySRITrojAI-SBU 0.72078 0.0413 0.26258 0.52665 1500.18 2023-04-18T19:42:50 2023-04-18T19:40:00 Rev1 None None
TrinitySRITrojAI-SBU 0.74799 0.05432 0.27292 0.52112 1001.52 2023-04-18T23:50:24 2023-04-18T23:45:56 Rev1 None None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 1155.27 2023-05-01T23:30:21 2023-05-01T23:29:59 Rev1 None None
TrinitySRITrojAI-SBU 0.73799 0.06395 0.26705 0.55753 1500.88 2023-05-02T02:00:22 2023-05-02T01:51:13 Rev1 None None
ICSI-2 0.74203 0.0577 0.26893 0.53606 1227.35 2023-03-15T22:10:24 2023-03-15T22:00:30 Rev1 None None
ICSI-2 1.11274 0.16968 0.35806 0.52959 1268.21 2023-04-07T03:10:23 2023-04-07T03:04:19 Rev1 None None
ICSI-2 0.76633 0.08519 0.27614 0.59471 1242.31 2023-04-08T02:00:23 2023-04-08T01:52:38 Rev1 None None
ICSI-2 0.81266 0.09468 0.29202 0.56506 1488.52 2023-04-19T01:40:29 2023-04-19T01:40:12 Rev1 None None
ICSI-2 0.69315 0.0 0.25 0.5 2023-05-06T00:00:24 2023-05-05T23:54:12 Rev1 None :Container Parameters (jsonschema checker):
ICSI-2 0.84182 0.11469 0.29269 0.59035 26957.79 2023-05-06T01:10:24 2023-05-06T01:08:30 Rev1 None None
ICSI-2 0.84182 0.11469 0.29269 0.59035 27036.49 2023-05-06T08:51:40 2023-05-06T01:10:41 Rev1 None None
ICSI-2 0.71755 0.11121 0.24326 0.68682 5555.79 2023-05-12T10:00:24 2023-05-12T09:57:07 Rev1 None None
ICSI-2 0.68036 0.11046 0.2277 0.71729 71364.42 2023-05-22T19:52:00 2023-05-22T19:48:12 Rev1 None None
ICSI-2 0.70131 0.11025 0.23821 0.69706 142969.0 2023-05-28T23:00:28 2023-05-28T22:54:01 Rev1 None None
ICSI-2 0.67516 0.11452 0.22487 0.72271 122210.48 2023-06-05T22:50:28 2023-06-05T22:41:55 Rev1 None None
ICSI-2 0.79481 0.17951 0.22635 0.74606 123545.29 2023-06-12T03:00:28 2023-06-12T02:54:36 Rev1 None None
ICSI-2 0.64145 0.07582 0.22393 0.72194 122411.86 2023-06-26T08:10:27 2023-06-26T08:04:02 Rev1 None None
ICSI-2 0.69315 0.0 0.25 0.5 84571.92 2023-07-11T02:00:28 2023-07-11T01:56:07 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI-BostonU 0.69712 0.02912 0.25189 0.5 1397.03 2023-04-17T14:40:28 2023-04-17T14:36:14 Rev1 None None
TrinitySRITrojAI-BostonU 0.69712 0.02912 0.25189 0.5 1417.2 2023-04-17T15:20:26 2023-04-17T15:15:17 Rev1 None None
TrinitySRITrojAI-BostonU 0.68447 0.0128 0.24619 0.52353 2041.22 2023-04-24T14:10:28 2023-04-22T11:38:05 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-06-05T21:20:30 2023-06-05T21:11:53 Rev1 :No Results::Missing Results: :Schema Header:
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-06-05T22:40:31 2023-06-05T22:33:00 Rev1 :No Results::Missing Results: :Schema Header:
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-06-05T23:30:26 2023-06-05T23:23:42 Rev1 :No Results::Missing Results: :Schema Header:
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-06-06T01:00:28 2023-06-06T00:58:33 Rev1 :No Results::Missing Results: :Schema Header:
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-06-06T20:50:29 2023-06-06T20:47:10 Rev1 :No Results::Missing Results: :Schema Header:
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-06-06T23:10:29 2023-06-06T23:09:30 Rev1 :No Results::Missing Results::Info File Missing: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 309.91 2023-06-07T08:50:29 2023-06-07T08:49:16 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI-BostonU 0.68955 0.00988 0.2482 0.50588 6652.32 2023-06-10T06:00:31 2023-06-10T05:58:26 Rev1 :Missing Results: None
TrinitySRITrojAI-BostonU 0.68955 0.00988 0.2482 0.50588 6383.11 2023-06-10T22:00:31 2023-06-10T21:51:48 Rev1 :Missing Results: None
TrinitySRITrojAI-BostonU 0.70631 0.01441 0.25655 0.5 944.23 2023-06-11T05:50:30 2023-06-11T05:49:46 Rev1 None None
TrinitySRITrojAI-BostonU 0.69712 0.02912 0.25189 0.5 2711.25 2023-06-11T21:00:30 2023-06-11T20:53:10 Rev1 None None
TrinitySRITrojAI-BostonU 0.70598 0.01394 0.25639 0.49471 5005.38 2023-06-12T22:50:30 2023-06-12T22:42:52 Rev1 :Missing Results: None
TrinitySRITrojAI-BostonU 0.70598 0.01394 0.25639 0.49471 4829.4 2023-06-13T04:40:30 2023-06-13T04:34:39 Rev1 :Missing Results: None
TrinitySRITrojAI-BostonU 0.70682 0.01437 0.25681 0.49412 3149.17 2023-06-13T07:10:30 2023-06-13T07:09:11 Rev1 :Missing Results: None
TrinitySRITrojAI-BostonU 0.70631 0.01441 0.25655 0.5 1065.67 2023-06-13T09:20:30 2023-06-13T09:15:37 Rev1 None None
TrinitySRITrojAI-BostonU 0.70682 0.01437 0.25681 0.49412 3047.44 2023-06-13T17:50:31 2023-06-13T17:48:54 Rev1 :Missing Results: None
TrinitySRITrojAI-BostonU 0.70631 0.01441 0.25655 0.5 3052.41 2023-06-13T21:30:31 2023-06-13T21:24:31 Rev1 None None
TrinitySRITrojAI-BostonU 0.70631 0.01441 0.25655 0.5 3157.96 2023-06-14T00:20:31 2023-06-14T00:14:35 Rev1 None None
TrinitySRITrojAI-BostonU 0.70631 0.01441 0.25655 0.5 3141.87 2023-06-14T07:20:31 2023-06-14T07:14:39 Rev1 None None
TrinitySRITrojAI-BostonU 0.70682 0.01437 0.25681 0.49412 3112.14 2023-06-14T10:40:31 2023-06-14T10:36:11 Rev1 :Missing Results: None
TrinitySRITrojAI-BostonU 0.70631 0.01441 0.25655 0.5 3100.72 2023-06-14T14:50:32 2023-06-14T14:45:31 Rev1 None None
TrinitySRITrojAI-BostonU 0.70631 0.01441 0.25655 0.5 1183.47 2023-06-23T00:00:30 2023-06-22T23:52:22 Rev1 None None
TrinitySRITrojAI-BostonU 0.69028 0.00755 0.24857 0.5 6598.71 2023-06-27T15:00:28 2023-06-27T14:54:13 Rev1 None None
trojai-example 0.69315 0.0 0.25 0.5 2023-03-10T22:24:54 2023-03-10T22:24:44 Rev1 :Executed File Update::Info File Missing: None
trojai-example 0.96553 0.12902 0.33804 0.50588 1149.63 2023-03-10T22:41:58 2023-03-10T22:40:44 Rev1 None :Schema Header:
trojai-example 0.96553 0.12902 0.33804 0.50588 1141.83 2023-03-13T15:10:31 2023-03-13T15:03:50 Rev1 None :Schema Header:

Required filename format: "object-detection-feb2023_sts_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-feb2023, sts: 10
Execution timeout (hh:mm:ss): 6:40:00

Teams/Jobs

Team Submission Timestamp Type Job Status File Status General Status File Timestamp Time until next execution
Perspecta 2023-07-10T23:40:05 performer None None Ok 2023-07-10T23:30:44 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI 2023-07-11T05:20:07 performer None None Ok 2023-07-11T05:16:06 0 d, 0 h, 0 m, 0 s
DRAFFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
PL-GIFT 2023-07-12T22:40:08 performer None None Ok 2023-07-12T22:39:15 0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers 2023-07-11T20:30:10 performer None None Ok 2023-07-11T20:27:32 0 d, 0 h, 0 m, 0 s
Perspecta-IUB performer None None Ok None 0 d, 0 h, 0 m, 0 s
ARM-UCSD 2023-06-21T01:40:18 performer None None Ok 2023-06-21T01:32:02 0 d, 0 h, 0 m, 0 s
ARM 2023-05-16T11:50:24 performer None None Ok 2023-05-16T11:47:01 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU 2023-04-18T20:40:22 performer None None Ok 2023-04-18T20:30:49 0 d, 0 h, 0 m, 0 s
ARM-UMBC performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-1 performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-2 2023-03-15T21:40:24 performer None None Ok 2023-03-15T21:33:13 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU 2023-06-11T05:50:31 performer None None Ok 2023-06-11T05:40:44 0 d, 0 h, 0 m, 0 s
trojai-example 2023-03-14T17:00:30 public None None Ok 2023-03-14T16:59:37 0 d, 0 h, 0 m, 0 s
IceTorch public None None Ok None 0 d, 0 h, 0 m, 0 s
trojaicy public None None Ok None 0 d, 0 h, 0 m, 0 s
Hector public None None Ok None 0 d, 0 h, 0 m, 0 s
Cassandra-XF public None None Ok None 0 d, 0 h, 0 m, 0 s
gooddefense public None None Ok None 0 d, 0 h, 0 m, 0 s
cyberinfrastructure public None None Ok None 0 d, 0 h, 0 m, 0 s
glaros public None None Ok None 0 d, 0 h, 0 m, 0 s
Ultraman public None None Ok None 0 d, 0 h, 0 m, 0 s
BackSec public None None Ok None 0 d, 0 h, 0 m, 0 s
Palladium public None None Ok None 0 d, 0 h, 0 m, 0 s
IIECAS public None None Ok None 0 d, 0 h, 0 m, 0 s
NSEC public None None Ok None 0 d, 0 h, 0 m, 0 s
UMBCb performer None None Ok None 0 d, 0 h, 0 m, 0 s
PASS public None None Ok None 0 d, 0 h, 0 m, 0 s
DS3TwoSixZero public None None Ok None 0 d, 0 h, 0 m, 0 s
dongdong4fei public None None Ok None 0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.40128 0.11164 0.11474 0.9375 460.16 2023-04-29T02:40:05 2023-04-29T02:34:42 Rev1 None None
TrinitySRITrojAI 0.36223 0.11185 0.10238 1.0 1166.17 2023-05-22T19:20:06 2023-05-22T19:11:07 Rev1 None None
PL-GIFT 0.23772 0.08649 0.05348 1.0 94.83 2023-07-07T18:20:09 2023-07-07T18:13:30 Rev1 None None
Perspecta-PurdueRutgers 0.36078 0.42647 0.10162 0.96875 5178.94 2023-03-21T20:30:10 2023-03-21T20:28:14 Rev1 None None
ARM-UCSD 0.11142 0.05462 0.01631 1.0 101.71 2023-06-21T01:40:18 2023-06-21T01:32:02 Rev1 None None
ARM 0.18488 0.14572 0.04748 1.0 150.92 2023-05-16T11:50:24 2023-05-16T11:47:01 Rev1 None None
TrinitySRITrojAI-SBU 0.44791 0.07471 0.13352 1.0 53.28 2023-04-18T20:40:22 2023-04-18T20:30:49 Rev1 None None
ICSI-2 0.22077 0.09074 0.04841 1.0 75.99 2023-03-15T21:40:24 2023-03-15T21:33:13 Rev1 None None
TrinitySRITrojAI-BostonU 0.65531 0.04044 0.23114 0.65625 292.48 2023-06-08T10:40:30 2023-06-08T10:39:39 Rev1 :Missing Results: None
trojai-example 0.5532 0.36346 0.18464 0.5625 62.34 2023-03-10T03:26:39 2023-03-10T03:17:14 Rev1 None :Schema Header::Execute:

All Results

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.69315 0.0 0.25 0.5 2023-04-04T03:30:06 2023-04-04T03:28:06 Rev1 :Container File Missing: :Schema Header:
Perspecta 0.54939 0.24798 0.19794 0.59375 269.85 2023-04-04T04:30:05 2023-04-04T04:25:39 Rev1 None None
Perspecta 0.69315 0.0 0.25 0.5 2023-04-04T05:40:05 2023-04-04T05:30:42 Rev1 :Executed File Update::Info File Missing::Container File Missing: None
Perspecta 0.69315 0.0 0.25 0.5 101.79 2023-04-18T07:50:06 2023-04-18T07:45:06 Rev1 None None
Perspecta 0.55499 0.08682 0.184 0.90625 246.32 2023-04-18T14:10:09 2023-04-18T14:03:44 Rev1 None None
Perspecta 0.69315 0.0 0.25 0.5 99.35 2023-04-28T04:20:05 2023-04-28T04:15:52 Rev1 None None
Perspecta 0.69315 0.0 0.25 0.5 50.33 2023-04-28T15:00:05 2023-04-28T14:55:00 Rev1 None None
Perspecta 0.53183 0.12625 0.17543 0.8125 450.72 2023-04-28T16:40:05 2023-04-28T16:32:05 Rev1 None None
Perspecta 0.53183 0.12625 0.17543 0.8125 450.52 2023-04-28T19:20:06 2023-04-28T19:11:32 Rev1 None None
Perspecta 0.40128 0.11164 0.11474 0.9375 460.16 2023-04-29T02:40:05 2023-04-29T02:34:42 Rev1 None None
Perspecta 0.57599 0.16278 0.194 0.5625 2875.45 2023-06-23T17:40:06 2023-06-23T17:39:45 Rev1 :Missing Results: None
Perspecta 0.69559 0.25728 0.25 0.5625 3490.22 2023-06-23T22:50:06 2023-06-23T22:41:56 Rev1 None None
Perspecta 0.52613 0.21006 0.17 0.875 365.06 2023-06-27T17:20:05 2023-06-27T17:17:41 Rev1 None None
Perspecta 0.52613 0.21006 0.17 0.5 159.36 2023-07-10T20:50:05 2023-07-10T20:40:39 Rev1 None None
Perspecta 0.52613 0.21006 0.17 0.5 165.35 2023-07-10T23:40:05 2023-07-10T23:30:44 Rev1 None None
TrinitySRITrojAI 0.68236 0.01416 0.24461 0.59375 6000.69 2023-03-24T00:40:07 2023-03-24T00:30:19 Rev1 None :Timeout:
TrinitySRITrojAI 0.61687 0.04086 0.21215 0.875 597.85 2023-03-24T22:00:07 2023-03-24T21:59:32 Rev1 None None
TrinitySRITrojAI 0.818 0.18012 0.30845 0.71875 2617.08 2023-04-18T18:20:08 2023-04-18T18:19:21 Rev1 None None
TrinitySRITrojAI 0.7568 0.16221 0.27944 0.625 210.7 2023-04-25T01:00:06 2023-04-25T00:58:54 Rev1 None None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 86.17 2023-05-16T02:30:13 2023-05-14T22:34:28 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.64599 0.20082 0.22597 0.34375 6662.7 2023-05-16T06:50:08 2023-05-16T06:49:06 Rev1 None None
TrinitySRITrojAI 0.64595 0.20059 0.22596 0.34375 6797.19 2023-05-18T01:00:06 2023-05-18T00:54:34 Rev1 None None
TrinitySRITrojAI 0.6478 0.19788 0.22673 0.375 7226.4 2023-05-20T00:10:07 2023-05-20T00:08:21 Rev1 None None
TrinitySRITrojAI 0.36223 0.11185 0.10238 1.0 1166.17 2023-05-22T19:20:06 2023-05-22T19:11:07 Rev1 None None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 172.89 2023-05-25T06:00:06 2023-05-25T05:53:33 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.44809 0.37335 0.14757 1.0 13841.74 2023-05-26T02:40:07 2023-05-26T02:32:36 Rev1 None None
TrinitySRITrojAI 0.71038 0.39821 0.24705 1.0 23854.84 2023-05-31T17:40:07 2023-05-31T17:38:36 Rev1 None None
TrinitySRITrojAI 0.44191 0.15177 0.13794 0.9375 3267.54 2023-06-01T05:40:07 2023-06-01T05:36:11 Rev1 None None
TrinitySRITrojAI 0.53922 0.31945 0.1728 0.875 3236.07 2023-06-01T19:20:06 2023-06-01T19:14:49 Rev1 None None
TrinitySRITrojAI 0.47139 0.0761 0.14359 1.0 11172.93 2023-06-05T05:50:06 2023-06-05T05:45:08 Rev1 None None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 2023-06-20T16:10:10 2023-06-17T00:51:10 Rev1 :No Results::Missing Results::Container File Missing: :Schema Header:
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 61.5 2023-06-21T21:50:07 2023-06-21T21:48:43 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.29722 0.05929 0.06924 1.0 3995.86 2023-06-26T19:10:06 2023-06-26T19:08:10 Rev1 None None
TrinitySRITrojAI 0.18046 0.08331 0.03562 1.0 9333.0 2023-07-08T19:20:06 2023-07-08T19:15:49 Rev1 None None
TrinitySRITrojAI 0.2244 0.05577 0.04384 1.0 4760.33 2023-07-11T05:20:07 2023-07-11T05:16:06 Rev1 None None
PL-GIFT 0.57642 0.12551 0.19973 0.8125 39.17 2023-03-20T22:10:08 2023-03-20T22:00:14 Rev1 None None
PL-GIFT 0.69315 0.0 0.25 0.5 10.4 2023-03-22T19:50:08 2023-03-22T19:46:00 Rev1 None None
PL-GIFT 0.58463 0.13219 0.20354 0.8125 49.92 2023-03-22T21:10:09 2023-03-22T21:07:55 Rev1 None None
PL-GIFT 0.48042 0.16416 0.16387 0.8125 92.42 2023-04-27T16:30:06 2023-04-27T16:24:42 Rev1 None None
PL-GIFT 0.44995 0.20035 0.14138 0.84375 88.55 2023-04-27T21:30:07 2023-04-27T21:20:32 Rev1 None None
PL-GIFT 0.39597 0.18974 0.11382 0.75 211.44 2023-05-11T06:50:08 2023-05-11T06:44:54 Rev1 None None
PL-GIFT 0.54545 0.15862 0.18128 0.71875 9465.34 2023-06-27T18:20:53 2023-06-27T18:19:22 Rev1 :Missing Results: None
PL-GIFT 0.23772 0.08649 0.05348 1.0 94.83 2023-07-07T18:20:09 2023-07-07T18:13:30 Rev1 None None
PL-GIFT 0.17024 0.0764 0.034 1.0 101.69 2023-07-08T17:00:09 2023-07-08T16:58:14 Rev1 None None
PL-GIFT 0.17024 0.0764 0.034 1.0 102.86 2023-07-09T18:00:08 2023-07-09T17:56:55 Rev1 None None
PL-GIFT 0.20616 0.11653 0.05033 1.0 107.36 2023-07-09T20:10:08 2023-07-09T20:00:30 Rev1 None None
PL-GIFT 0.14377 0.06998 0.02567 1.0 106.37 2023-07-09T23:20:08 2023-07-09T23:15:05 Rev1 None None
PL-GIFT 0.11111 0.0514 0.01603 1.0 99.88 2023-07-10T17:30:09 2023-07-10T17:22:14 Rev1 None None
PL-GIFT 0.02475 0.01879 0.00144 1.0 108.75 2023-07-10T19:10:09 2023-07-10T19:03:08 Rev1 None None
PL-GIFT 0.14886 0.06029 0.02485 1.0 102.18 2023-07-10T22:30:09 2023-07-10T22:29:42 Rev1 None None
PL-GIFT 0.14318 0.08676 0.02998 1.0 102.25 2023-07-12T22:40:08 2023-07-12T22:39:15 Rev1 None None
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 2739.11 2023-03-21T07:40:11 2023-03-21T07:32:00 Rev1 None None
Perspecta-PurdueRutgers 0.36078 0.42647 0.10162 0.96875 5178.94 2023-03-21T20:30:10 2023-03-21T20:28:14 Rev1 None None
Perspecta-PurdueRutgers 0.27485 0.23811 0.08029 0.90625 6995.83 2023-03-29T21:20:09 2023-03-29T21:11:06 Rev1 None None
Perspecta-PurdueRutgers 0.27485 0.23811 0.08029 0.90625 7934.57 2023-04-04T05:30:08 2023-04-04T05:20:39 Rev1 None None
Perspecta-PurdueRutgers 0.38366 0.28097 0.12628 0.84375 7099.89 2023-04-13T17:50:10 2023-04-13T17:49:53 Rev1 None None
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 2023-05-31T03:50:09 2023-05-31T03:42:49 Rev1 :Executed File Update::No Results::Missing Results::Info File Missing::Container File Missing: None
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 63.39 2023-07-10T06:50:09 2023-07-10T06:42:19 Rev1 :No Results::Missing Results: None
Perspecta-PurdueRutgers 0.33432 0.28669 0.09332 0.75 7506.16 2023-07-10T09:10:10 2023-07-10T09:06:06 Rev1 None None
Perspecta-PurdueRutgers 0.63637 0.60505 0.18224 0.6875 7500.43 2023-07-11T20:30:10 2023-07-11T20:27:32 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 2023-05-16T02:30:24 2023-05-15T20:25:25 Rev1 :No Results::Missing Results::Info File Missing::Container File Missing: None
ARM-UCSD 0.69315 0.0 0.25 0.5 2023-05-16T20:40:59 2023-05-16T20:31:03 Rev1 :No Results::Missing Results::Container File Missing: :Schema Header:
ARM-UCSD 0.69315 0.0 0.25 0.5 39.79 2023-05-17T22:50:18 2023-05-17T22:47:12 Rev1 :Missing Results: None
ARM-UCSD 0.69315 0.0 0.25 0.5 41.16 2023-05-30T18:40:18 2023-05-30T18:38:16 Rev1 :Missing Results: None
ARM-UCSD 0.69315 0.0 0.25 0.5 42.12 2023-06-05T19:41:28 2023-06-05T19:35:42 Rev1 :Missing Results: None
ARM-UCSD 0.60373 0.11338 0.21017 0.625 42.2 2023-06-05T23:10:17 2023-06-05T23:04:05 Rev1 None None
ARM-UCSD 0.60373 0.11338 0.21017 0.625 45.16 2023-06-06T20:00:16 2023-06-06T19:57:59 Rev1 None None
ARM-UCSD 0.60373 0.11338 0.21017 0.625 49.21 2023-06-20T22:30:17 2023-06-20T22:21:16 Rev1 None None
ARM-UCSD 0.11142 0.05462 0.01631 1.0 101.71 2023-06-21T01:40:18 2023-06-21T01:32:02 Rev1 None None
ARM 0.69315 0.0 0.25 0.5 22.37 2023-05-16T10:50:24 2023-05-16T10:40:59 Rev1 :No Results::Missing Results: None
ARM 0.69315 0.0 0.25 0.5 115.82 2023-05-16T11:20:24 2023-05-16T11:17:49 Rev1 :No Results::Missing Results: None
ARM 0.18488 0.14572 0.04748 1.0 150.92 2023-05-16T11:50:24 2023-05-16T11:47:01 Rev1 None None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 2023-03-28T00:40:23 2023-03-28T00:35:33 Rev1 :Info File Missing::Container File Missing: None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 2023-03-28T01:00:23 2023-03-28T00:59:09 Rev1 :Info File Missing::Container File Missing: None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 2023-03-28T01:30:24 2023-03-28T01:21:57 Rev1 :Container File Missing: :Container Parameters (jsonschema checker)::Schema Header:
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 2023-03-28T02:10:21 2023-03-28T02:00:33 Rev1 :Container File Missing: :Container Parameters (jsonschema checker):
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 2023-04-04T00:30:20 2023-04-04T00:28:27 Rev1 :Container File Missing: :Schema Header:
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 2023-04-04T01:10:21 2023-04-04T01:03:11 Rev1 :Container File Missing: :Container Parameters (jsonschema checker):
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 2023-04-04T02:00:20 2023-04-04T01:55:46 Rev1 :Container File Missing: :Container Parameters (jsonschema checker):
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 11.61 2023-04-04T03:00:20 2023-04-04T03:00:01 Rev1 None None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 36.38 2023-04-04T03:30:21 2023-04-04T03:23:46 Rev1 None None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 78.28 2023-04-04T04:00:20 2023-04-04T03:59:19 Rev1 :Result Parse: None
TrinitySRITrojAI-SBU 0.5517 0.07862 0.18149 0.90625 82.22 2023-04-04T05:00:21 2023-04-04T04:54:16 Rev1 None None
TrinitySRITrojAI-SBU 0.54535 0.08546 0.17901 0.90625 77.32 2023-04-18T19:30:24 2023-04-18T19:22:07 Rev1 None None
TrinitySRITrojAI-SBU 0.44791 0.07471 0.13352 1.0 53.28 2023-04-18T20:40:22 2023-04-18T20:30:49 Rev1 None None
ICSI-2 0.69315 0.0 0.25 0.5 2023-03-15T19:10:24 2023-03-15T19:08:38 Rev1 :Container File Missing: :Container Parameters (jsonschema checker):
ICSI-2 0.22077 0.09074 0.04841 1.0 75.99 2023-03-15T21:40:24 2023-03-15T21:33:13 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 17.97 2023-06-07T10:50:31 2023-06-07T10:44:53 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 102.29 2023-06-08T00:00:30 2023-06-07T23:55:59 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 99.88 2023-06-08T02:30:31 2023-06-08T02:22:14 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 99.36 2023-06-08T08:10:30 2023-06-08T08:06:44 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI-BostonU 0.65531 0.04044 0.23114 0.65625 292.48 2023-06-08T10:40:30 2023-06-08T10:39:39 Rev1 :Missing Results: None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 65.92 2023-06-08T17:00:31 2023-06-08T16:56:06 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI-BostonU 0.65531 0.04044 0.23114 0.65625 281.3 2023-06-08T19:00:32 2023-06-08T18:55:22 Rev1 :Missing Results: None
TrinitySRITrojAI-BostonU 0.65412 0.03422 0.23051 0.5 471.36 2023-06-10T04:50:31 2023-06-10T04:44:50 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-06-11T01:40:29 2023-06-11T01:35:39 Rev1 :No Results::Missing Results::Info File Missing::Container File Missing: None
TrinitySRITrojAI-BostonU 0.75837 0.04975 0.2825 0.5 54.08 2023-06-11T05:50:31 2023-06-11T05:40:44 Rev1 None None
trojai-example 0.69315 0.0 0.25 0.5 9.78 2023-03-10T03:11:19 2023-03-10T03:09:52 Rev1 None :Schema Header::Copy in::Execute:
trojai-example 0.5532 0.36346 0.18464 0.5625 62.34 2023-03-10T03:26:39 2023-03-10T03:17:14 Rev1 None :Schema Header::Execute:
trojai-example 0.69315 0.0 0.25 0.5 0.57 2023-03-10T03:48:12 2023-03-10T03:46:40 Rev1 :Container File Missing: :Schema Header::Execute::Copy Out:
trojai-example 0.5532 0.36346 0.18464 0.5625 63.42 2023-03-10T03:54:10 2023-03-10T03:53:07 Rev1 None :Schema Header:
trojai-example 0.5532 0.36346 0.18464 0.5625 64.08 2023-03-10T04:16:17 2023-03-10T04:14:57 Rev1 None :Schema Header:
trojai-example 0.69315 0.0 0.25 0.5 2023-03-10T16:45:35 2023-03-10T16:43:14 Rev1 :Info File Missing::Container File Missing: None
trojai-example 0.69315 0.0 0.25 0.5 12.69 2023-03-10T17:19:19 2023-03-10T17:17:19 Rev1 None :Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example 0.69315 0.0 0.25 0.5 9.65 2023-03-10T17:32:36 2023-03-10T17:31:29 Rev1 None :Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example 0.69315 0.0 0.25 0.5 9.62 2023-03-10T18:03:44 2023-03-10T17:59:57 Rev1 None :Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example 0.69315 0.0 0.25 0.5 9.66 2023-03-10T18:20:22 2023-03-10T18:17:24 Rev1 None :Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example 0.69315 0.0 0.25 0.5 9.69 2023-03-10T18:26:52 2023-03-10T18:25:43 Rev1 None :Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example 0.69315 0.0 0.25 0.5 9.68 2023-03-10T18:31:22 2023-03-10T18:30:24 Rev1 None :Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example 0.69315 0.0 0.25 0.5 9.61 2023-03-10T18:48:53 2023-03-10T18:46:14 Rev1 None :Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example 0.5532 0.36346 0.18464 0.5625 63.5 2023-03-10T19:33:16 2023-03-10T19:32:14 Rev1 None :Schema Header:
trojai-example 0.5532 0.36346 0.18464 0.5625 63.85 2023-03-10T20:07:38 2023-03-10T20:06:09 Rev1 None :Schema Header:
trojai-example 0.69315 0.0 0.25 0.5 2023-03-10T21:46:15 2023-03-10T21:45:24 Rev1 :Executed File Update::Info File Missing::Container File Missing: None
trojai-example 0.5532 0.36346 0.18464 0.5625 63.86 2023-03-10T21:59:23 2023-03-10T21:53:01 Rev1 None :Schema Header:
trojai-example 0.5532 0.36346 0.18464 0.5625 70.33 2023-03-10T22:35:04 2023-03-10T22:33:52 Rev1 None :Schema Header:
trojai-example 0.52632 0.49397 0.1664 0.5 83.99 2023-03-14T17:00:30 2023-03-14T16:59:37 Rev1 None :Schema Header:

Required filename format: "object-detection-feb2023_dev_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-feb2023, dev: 185
Execution timeout (hh:mm:ss): 5 days, 8:00:00

Teams/Jobs

Team Submission Timestamp Type Job Status File Status General Status File Timestamp Time until next execution
Perspecta performer None None Ok None 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI 2023-06-05T06:30:06 performer None None Ok 2023-06-05T06:25:25 0 d, 0 h, 0 m, 0 s
DRAFFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
PL-GIFT 2023-07-08T17:30:09 performer None None Ok 2023-07-08T17:21:21 0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers 2023-07-09T20:30:08 performer None None Ok 2023-07-09T20:25:00 0 d, 0 h, 0 m, 0 s
Perspecta-IUB 2023-03-25T20:00:10 performer None None Ok 2023-03-25T19:53:28 0 d, 0 h, 0 m, 0 s
ARM-UCSD 2023-06-05T19:41:29 performer None None Ok 2023-06-05T19:35:08 0 d, 0 h, 0 m, 0 s
ARM performer None None Ok None 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU performer None None Ok None 0 d, 0 h, 0 m, 0 s
ARM-UMBC performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-1 performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-2 2023-05-28T18:20:28 performer None None Ok 2023-05-28T18:11:34 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU 2023-06-27T07:20:27 performer None None Ok 2023-06-27T07:17:15 0 d, 0 h, 0 m, 0 s
trojai-example 2023-06-02T13:33:39 public None None Ok 2023-06-02T13:30:39 0 d, 0 h, 0 m, 0 s
IceTorch public None None Ok None 0 d, 0 h, 0 m, 0 s
trojaicy public None None Ok None 0 d, 0 h, 0 m, 0 s
Hector public None None Ok None 0 d, 0 h, 0 m, 0 s
Cassandra-XF public None None Ok None 0 d, 0 h, 0 m, 0 s
gooddefense public None None Ok None 0 d, 0 h, 0 m, 0 s
cyberinfrastructure public None None Ok None 0 d, 0 h, 0 m, 0 s
glaros public None None Ok None 0 d, 0 h, 0 m, 0 s
Ultraman public None None Ok None 0 d, 0 h, 0 m, 0 s
BackSec public None None Ok None 0 d, 0 h, 0 m, 0 s
Palladium public None None Ok None 0 d, 0 h, 0 m, 0 s
IIECAS public None None Ok None 0 d, 0 h, 0 m, 0 s
NSEC public None None Ok None 0 d, 0 h, 0 m, 0 s
UMBCb performer None None Ok None 0 d, 0 h, 0 m, 0 s
PASS public None None Ok None 0 d, 0 h, 0 m, 0 s
DS3TwoSixZero public None None Ok None 0 d, 0 h, 0 m, 0 s
dongdong4fei public None None Ok None 0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
TrinitySRITrojAI 0.65689 0.04443 0.23594 0.60976 168541.96 2023-06-05T06:30:06 2023-06-05T06:25:25 Rev1 None None
PL-GIFT 0.70689 0.06132 0.25544 0.60382 1464.72 2023-04-27T21:41:58 2023-04-27T21:32:48 Rev1 None None
Perspecta-PurdueRutgers 0.36033 0.03079 0.1013 0.95718 214.45 2023-03-24T05:10:09 2023-03-24T05:00:39 Rev1 None None
Perspecta-IUB 1.68364 0.42673 0.31509 0.63006 3437.12 2023-03-25T20:00:10 2023-03-25T19:53:28 Rev1 None None
ARM-UCSD 0.85038 0.13357 0.27261 0.55424 677.76 2023-06-05T19:41:29 2023-06-05T19:35:08 Rev1 None None
ICSI-2 0.72548 0.11367 0.246 0.69241 5750.91 2023-05-11T09:10:23 2023-05-11T09:08:35 Rev1 None None
TrinitySRITrojAI-BostonU 0.70631 0.01441 0.25655 0.5 1040.08 2023-06-22T03:40:30 2023-06-22T03:32:03 Rev1 None None
trojai-example 0.86477 0.11619 0.29668 0.56353 57033.52 2023-06-01T20:22:06 2023-06-01T20:18:52 Rev1 None None

All Results

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
TrinitySRITrojAI 0.71324 0.02902 0.25918 0.49612 2592.87 2023-04-25T01:30:06 2023-04-25T01:22:30 Rev1 None None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 1070.48 2023-05-16T19:20:06 2023-05-16T19:19:34 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 1065.65 2023-05-17T22:00:06 2023-05-17T21:59:21 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 1081.26 2023-05-18T00:00:06 2023-05-17T23:59:01 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.69698 0.0055 0.25192 0.5 1229.49 2023-05-18T05:40:07 2023-05-18T05:30:08 Rev1 None None
TrinitySRITrojAI 0.69698 0.0055 0.25192 0.5 1218.49 2023-05-18T15:30:06 2023-05-18T15:29:08 Rev1 None None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 1050.59 2023-05-18T19:00:06 2023-05-18T18:50:12 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.69698 0.0055 0.25192 0.5 1215.51 2023-05-18T23:20:06 2023-05-18T23:19:08 Rev1 None None
TrinitySRITrojAI 0.69698 0.0055 0.25192 0.5 1551.49 2023-05-19T05:20:06 2023-05-19T05:16:04 Rev1 None None
TrinitySRITrojAI 0.69698 0.0055 0.25192 0.5 1527.84 2023-05-19T07:00:06 2023-05-19T06:58:57 Rev1 None None
TrinitySRITrojAI 0.69698 0.0055 0.25192 0.5 1625.55 2023-05-19T19:40:07 2023-05-19T19:14:56 Rev1 None None
TrinitySRITrojAI 0.69698 0.0055 0.25192 0.5 1971.26 2023-05-19T21:50:06 2023-05-19T21:43:53 Rev1 None None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 1041.03 2023-05-20T03:50:06 2023-05-20T03:42:22 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 1069.73 2023-05-20T07:10:07 2023-05-20T07:02:55 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 1053.52 2023-05-22T20:10:06 2023-05-22T20:06:13 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 1044.75 2023-05-22T23:40:07 2023-05-22T23:33:54 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.695 0.00292 0.25092 0.5 1595.61 2023-05-23T04:30:06 2023-05-23T04:23:58 Rev1 None None
TrinitySRITrojAI 1.05912 0.15561 0.34585 0.54582 49025.67 2023-05-23T06:40:06 2023-05-23T06:35:34 Rev1 None None
TrinitySRITrojAI 1.04264 0.15464 0.33941 0.55429 50016.76 2023-05-23T22:20:06 2023-05-23T22:17:47 Rev1 None None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 1184.09 2023-05-24T18:20:06 2023-05-24T18:19:26 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 258.59 2023-06-01T17:30:06 2023-06-01T17:28:50 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 197.61 2023-06-01T17:50:06 2023-06-01T17:49:31 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 184.49 2023-06-01T19:00:06 2023-06-01T18:57:02 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 179.17 2023-06-01T19:40:07 2023-06-01T19:32:45 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.82297 0.09679 0.29359 0.56871 58509.37 2023-06-01T20:21:39 2023-06-01T20:18:48 Rev1 None None
TrinitySRITrojAI 0.65689 0.04443 0.23594 0.60976 168541.96 2023-06-05T06:30:06 2023-06-05T06:25:25 Rev1 None None
PL-GIFT 0.78213 0.08581 0.27569 0.57635 793.7 2023-03-20T22:10:09 2023-03-20T22:00:44 Rev1 None None
PL-GIFT 0.7185 0.04267 0.26037 0.54376 869.19 2023-03-22T22:00:09 2023-03-22T21:26:43 Rev1 None None
PL-GIFT 0.75596 0.07638 0.26741 0.55429 861.91 2023-03-23T21:30:08 2023-03-23T21:29:39 Rev1 None None
PL-GIFT 0.6892 0.02465 0.24825 0.53494 1524.88 2023-04-27T16:30:07 2023-04-27T16:25:12 Rev1 None None
PL-GIFT 0.70689 0.06132 0.25544 0.60382 1464.72 2023-04-27T21:41:58 2023-04-27T21:32:48 Rev1 None None
PL-GIFT 0.69315 0.0 0.25 0.5 2023-06-27T17:40:08 2023-06-27T17:35:04 Rev1 :No Results::Missing Results: :Schema Header:
PL-GIFT 0.97445 0.40475 0.25058 0.57365 1608.18 2023-07-08T17:30:09 2023-07-08T17:21:21 Rev1 None None
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 2023-03-13T21:00:09 2023-03-13T20:52:31 Rev1 None :Container Parameters (jsonschema checker):
Perspecta-PurdueRutgers 0.76273 0.09013 0.2766 0.601 2258.87 2023-03-13T21:40:09 2023-03-13T21:31:36 Rev1 None None
Perspecta-PurdueRutgers 0.76186 0.07406 0.27566 0.53312 2030.89 2023-03-14T00:40:09 2023-03-14T00:39:49 Rev1 None None
Perspecta-PurdueRutgers 0.71262 0.1214 0.23405 0.70624 64653.47 2023-03-21T23:20:10 2023-03-21T23:15:40 Rev1 None None
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 2023-03-24T04:00:10 2023-03-24T03:51:10 Rev1 :Info File Missing: None
Perspecta-PurdueRutgers 0.36033 0.03079 0.1013 0.95718 214.45 2023-03-24T05:10:09 2023-03-24T05:00:39 Rev1 None None
Perspecta-PurdueRutgers 1.07704 0.13848 0.37476 0.51647 212.4 2023-03-24T20:50:08 2023-03-24T20:42:02 Rev1 None None
Perspecta-PurdueRutgers 1.02737 0.14175 0.35288 0.48353 212.03 2023-03-24T21:50:08 2023-03-24T21:43:49 Rev1 None None
Perspecta-PurdueRutgers 0.62779 0.09184 0.20966 0.73647 79068.7 2023-03-30T00:10:10 2023-03-30T00:05:47 Rev1 None None
Perspecta-PurdueRutgers 10.46103 1.90913 0.42925 0.49571 861.7 2023-03-31T02:40:09 2023-03-31T02:34:12 Rev1 None None
Perspecta-PurdueRutgers 0.61634 0.09532 0.20267 0.74947 92425.34 2023-04-04T08:00:09 2023-04-04T07:58:33 Rev1 None None
Perspecta-PurdueRutgers 0.71426 0.03652 0.2592 0.49176 8401.41 2023-04-05T19:50:09 2023-04-05T19:42:39 Rev1 None None
Perspecta-PurdueRutgers 0.71426 0.03652 0.2592 0.49176 8268.32 2023-04-05T23:50:09 2023-04-05T23:43:53 Rev1 None None
Perspecta-PurdueRutgers 0.71426 0.03652 0.2592 0.49176 8188.28 2023-04-06T02:50:10 2023-04-06T02:46:51 Rev1 None None
Perspecta-PurdueRutgers 0.88735 0.11393 0.3032 0.49035 9296.45 2023-04-06T05:20:10 2023-04-06T05:18:58 Rev1 None None
Perspecta-PurdueRutgers 0.70969 0.03743 0.25698 0.50565 8035.62 2023-04-06T16:20:09 2023-04-06T16:16:31 Rev1 None None
Perspecta-PurdueRutgers 0.71426 0.03652 0.2592 0.49176 8290.77 2023-04-06T19:20:09 2023-04-06T19:16:45 Rev1 None None
Perspecta-PurdueRutgers 0.71426 0.03652 0.2592 0.49176 9380.46 2023-04-06T22:20:09 2023-04-06T22:18:04 Rev1 None None
Perspecta-PurdueRutgers 0.7291 0.06203 0.26179 0.55094 4191.93 2023-04-07T03:20:10 2023-04-07T03:14:11 Rev1 None None
Perspecta-PurdueRutgers 0.71426 0.03652 0.2592 0.49176 9541.76 2023-04-07T05:20:09 2023-04-07T05:10:10 Rev1 None None
Perspecta-PurdueRutgers 0.72141 0.03744 0.26233 0.48282 11260.97 2023-04-07T18:40:09 2023-04-07T18:37:38 Rev1 None None
Perspecta-PurdueRutgers 0.75256 0.04229 0.2757 0.452 9971.55 2023-04-08T05:40:09 2023-04-08T05:37:46 Rev1 None None
Perspecta-PurdueRutgers 0.73027 0.03948 0.26604 0.47718 8938.11 2023-04-08T21:20:10 2023-04-08T21:18:01 Rev1 None None
Perspecta-PurdueRutgers 0.74284 0.03993 0.27169 0.456 8119.29 2023-04-09T00:50:10 2023-04-09T00:44:47 Rev1 None None
Perspecta-PurdueRutgers 0.71426 0.03652 0.2592 0.49176 9189.56 2023-04-10T03:10:10 2023-04-10T03:05:27 Rev1 None None
Perspecta-PurdueRutgers 0.71426 0.03652 0.2592 0.49176 9202.37 2023-04-10T07:20:10 2023-04-10T07:15:33 Rev1 None None
Perspecta-PurdueRutgers 0.70319 0.05827 0.25071 0.56765 4581.52 2023-04-10T18:40:10 2023-04-10T18:35:21 Rev1 None None
Perspecta-PurdueRutgers 0.6842 0.01551 0.24709 0.514 2812.51 2023-04-10T21:50:09 2023-04-10T21:44:52 Rev1 None None
Perspecta-PurdueRutgers 0.69549 0.0221 0.2511 0.50988 3063.68 2023-04-11T00:30:09 2023-04-11T00:27:23 Rev1 None None
Perspecta-PurdueRutgers 0.81702 0.09865 0.27939 0.51118 47538.9 2023-04-11T03:10:10 2023-04-11T03:05:31 Rev1 None None
Perspecta-PurdueRutgers 0.91641 0.13687 0.30482 0.54482 7324.16 2023-04-11T17:40:09 2023-04-11T17:37:13 Rev1 None None
Perspecta-PurdueRutgers 0.84491 0.13092 0.28158 0.58976 5975.92 2023-04-11T22:10:09 2023-04-11T22:05:41 Rev1 None None
Perspecta-PurdueRutgers 0.78347 0.09661 0.26687 0.53765 21576.28 2023-04-12T02:40:09 2023-04-12T02:33:09 Rev1 None None
Perspecta-PurdueRutgers 0.80704 0.11543 0.27351 0.58235 44536.74 2023-04-12T21:00:10 2023-04-12T20:52:33 Rev1 None None
Perspecta-PurdueRutgers 10.46894 1.90839 0.43265 0.49412 213.04 2023-04-13T15:50:13 2023-04-13T15:48:03 Rev1 None None
Perspecta-PurdueRutgers 0.56556 0.0899 0.18167 0.803 78173.69 2023-04-13T18:00:10 2023-04-13T17:52:16 Rev1 None None
Perspecta-PurdueRutgers 0.69852 0.02939 0.25169 0.49412 1460.15 2023-04-17T20:50:09 2023-04-17T20:46:14 Rev1 None None
Perspecta-PurdueRutgers 0.69335 0.0171 0.24977 0.49341 1405.05 2023-04-17T21:40:09 2023-04-17T21:34:54 Rev1 None None
Perspecta-PurdueRutgers 0.65101 0.02957 0.23227 0.57588 1353.2 2023-04-17T23:30:11 2023-04-17T23:22:30 Rev1 None None
Perspecta-PurdueRutgers 0.7099 0.03031 0.25833 0.49929 1400.3 2023-04-18T00:40:12 2023-04-18T00:34:31 Rev1 None None
Perspecta-PurdueRutgers 0.65971 0.03433 0.2353 0.57165 1392.9 2023-04-18T02:00:10 2023-04-18T01:52:26 Rev1 None None
Perspecta-PurdueRutgers 0.75093 0.07333 0.26338 0.52112 1813.96 2023-04-24T15:10:09 2023-04-24T15:07:14 Rev1 None None
Perspecta-PurdueRutgers 0.74519 0.06049 0.26676 0.50588 1037.8 2023-04-24T16:20:09 2023-04-24T16:15:36 Rev1 None None
Perspecta-PurdueRutgers 1.03925 0.14379 0.35508 0.49412 1034.73 2023-04-24T19:50:08 2023-04-24T19:40:38 Rev1 None None
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 1099.94 2023-04-25T18:00:10 2023-04-25T17:54:51 Rev1 None None
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 1040.48 2023-04-25T19:20:09 2023-04-25T19:11:36 Rev1 None None
Perspecta-PurdueRutgers 0.92396 0.09213 0.34502 0.50212 1117.77 2023-04-25T21:00:09 2023-04-25T20:59:42 Rev1 None None
Perspecta-PurdueRutgers 0.70628 0.02787 0.25508 0.50212 1113.84 2023-04-25T23:50:08 2023-04-25T23:48:13 Rev1 None None
Perspecta-PurdueRutgers 1.17342 0.14608 0.40435 0.50276 1039.76 2023-04-26T01:00:08 2023-04-26T00:57:47 Rev1 None None
Perspecta-PurdueRutgers 1.1764 0.14692 0.40558 0.50282 1028.49 2023-04-26T02:40:08 2023-04-26T02:34:47 Rev1 None None
Perspecta-PurdueRutgers 1.17586 0.14676 0.40535 0.50159 1029.2 2023-04-26T03:40:08 2023-04-26T03:36:03 Rev1 None None
Perspecta-PurdueRutgers 1.17468 0.1467 0.40484 0.50259 1030.07 2023-04-26T04:20:08 2023-04-26T04:16:19 Rev1 None None
Perspecta-PurdueRutgers 1.27576 0.16731 0.42717 0.50876 1035.7 2023-04-26T14:30:08 2023-04-26T14:21:43 Rev1 None None
Perspecta-PurdueRutgers 0.61757 0.04466 0.21757 0.64029 1673.54 2023-04-26T16:20:08 2023-04-26T16:11:06 Rev1 None None
Perspecta-PurdueRutgers 0.47289 0.09267 0.1446 0.86094 79621.25 2023-04-26T19:10:09 2023-04-26T19:08:42 Rev1 None None
Perspecta-PurdueRutgers 0.7484 0.06911 0.26311 0.49424 1333.32 2023-04-27T20:00:10 2023-04-27T19:50:42 Rev1 None None
Perspecta-PurdueRutgers 0.59382 0.03748 0.20892 0.66 1677.07 2023-04-27T21:20:07 2023-04-27T21:10:12 Rev1 None None
Perspecta-PurdueRutgers 0.81183 0.12596 0.27491 0.59741 13936.57 2023-04-28T00:20:10 2023-04-28T00:17:20 Rev1 None None
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 1048.41 2023-05-24T05:20:10 2023-05-24T05:16:45 Rev1 :No Results::Missing Results: None
Perspecta-PurdueRutgers 0.68951 0.00711 0.24865 0.50588 2141.16 2023-05-28T06:10:09 2023-05-28T06:03:50 Rev1 :Missing Results: None
Perspecta-PurdueRutgers 0.94161 0.12105 0.31185 0.45 7783.67 2023-05-29T05:30:09 2023-05-29T05:29:32 Rev1 :Missing Results: None
Perspecta-PurdueRutgers 0.93284 0.29369 0.28217 0.49118 9647.44 2023-05-31T04:30:09 2023-05-31T04:23:17 Rev1 None None
Perspecta-PurdueRutgers 0.69315 0.0 0.25 0.5 242.2 2023-06-01T05:30:09 2023-06-01T05:23:30 Rev1 :No Results::Missing Results: None
Perspecta-PurdueRutgers 0.76419 0.08434 0.26709 0.52847 8793.88 2023-06-01T07:20:10 2023-06-01T07:14:08 Rev1 None None
Perspecta-PurdueRutgers 0.8622 0.1176 0.28621 0.51494 9632.11 2023-06-02T05:50:09 2023-06-02T05:48:16 Rev1 None None
Perspecta-PurdueRutgers 0.73497 0.04102 0.26792 0.47553 5640.25 2023-06-02T19:00:10 2023-06-02T18:58:57 Rev1 None None
Perspecta-PurdueRutgers 0.7363 0.08112 0.25501 0.54012 5892.15 2023-06-03T03:00:10 2023-06-03T02:58:40 Rev1 None None
Perspecta-PurdueRutgers 0.7526 0.07728 0.26109 0.51447 5366.44 2023-06-03T06:10:09 2023-06-03T06:01:31 Rev1 None None
Perspecta-PurdueRutgers 0.73086 0.03739 0.26512 0.47941 5372.56 2023-06-03T08:20:10 2023-06-03T08:11:58 Rev1 None None
Perspecta-PurdueRutgers 0.70872 0.03249 0.25496 0.50265 4141.48 2023-06-03T22:10:10 2023-06-03T22:05:18 Rev1 None None
Perspecta-PurdueRutgers 0.93395 0.29396 0.27999 0.49106 9355.21 2023-06-04T00:00:10 2023-06-03T23:59:13 Rev1 None None
Perspecta-PurdueRutgers 0.7273 0.0878 0.24872 0.58118 9380.49 2023-06-04T04:20:10 2023-06-04T04:19:45 Rev1 None None
Perspecta-PurdueRutgers 0.87529 0.28675 0.26885 0.47118 5072.88 2023-06-04T07:40:10 2023-06-04T07:38:36 Rev1 None None
Perspecta-PurdueRutgers 1.16989 0.14566 0.40265 0.50588 699.47 2023-06-04T20:40:10 2023-06-04T20:31:25 Rev1 :Missing Results: None
Perspecta-PurdueRutgers 0.70746 0.08656 0.24094 0.60118 9370.91 2023-06-04T23:20:10 2023-06-04T23:14:39 Rev1 None None
Perspecta-PurdueRutgers 1.18552 0.15042 0.40804 0.51024 2227.43 2023-06-05T03:50:10 2023-06-05T03:42:35 Rev1 :Missing Results: None
Perspecta-PurdueRutgers 1.85338 0.26478 0.47128 0.50694 778.52 2023-06-05T07:00:09 2023-06-05T06:54:38 Rev1 None None
Perspecta-PurdueRutgers 1.83702 0.26363 0.4655 0.50465 723.19 2023-06-05T19:20:09 2023-06-05T19:19:01 Rev1 None None
Perspecta-PurdueRutgers 1.52936 0.22958 0.45331 0.51171 2487.53 2023-06-05T20:20:12 2023-06-05T20:10:46 Rev1 None None
Perspecta-PurdueRutgers 1.06796 0.15288 0.36276 0.49824 955.3 2023-06-05T21:30:11 2023-06-05T21:26:54 Rev1 None None
Perspecta-PurdueRutgers 1.06603 0.15311 0.36227 0.50765 1014.6 2023-06-05T23:40:10 2023-06-05T23:34:32 Rev1 None None
Perspecta-PurdueRutgers 1.28148 0.17142 0.42568 0.50982 2513.58 2023-06-06T00:20:09 2023-06-06T00:16:52 Rev1 None None
Perspecta-PurdueRutgers 0.72129 0.06636 0.25519 0.54824 1184.72 2023-06-06T01:20:10 2023-06-06T01:15:54 Rev1 None None
Perspecta-PurdueRutgers 1.37377 0.20019 0.43067 0.50694 2299.67 2023-06-06T02:20:09 2023-06-06T02:10:54 Rev1 None None
Perspecta-PurdueRutgers 0.72129 0.06636 0.25519 0.54824 2280.35 2023-06-06T03:50:09 2023-06-06T03:40:49 Rev1 None None
Perspecta-PurdueRutgers 0.74218 0.07953 0.25868 0.53988 9700.94 2023-06-06T05:00:10 2023-06-06T04:50:25 Rev1 None None
Perspecta-PurdueRutgers 0.7374 0.0759 0.25838 0.53824 9670.71 2023-06-06T15:40:10 2023-06-06T15:36:43 Rev1 None None
Perspecta-PurdueRutgers 1.88515 0.26454 0.47965 0.49741 2580.95 2023-06-06T19:50:09 2023-06-06T19:47:54 Rev1 None None
Perspecta-PurdueRutgers 0.75025 0.04319 0.27267 0.48547 1365.68 2023-06-06T20:50:09 2023-06-06T20:46:42 Rev1 None None
Perspecta-PurdueRutgers 0.70941 0.06452 0.25086 0.55882 2570.64 2023-06-06T21:30:09 2023-06-06T21:29:44 Rev1 None None
Perspecta-PurdueRutgers 0.73317 0.06811 0.25951 0.53765 1352.75 2023-06-06T22:50:10 2023-06-06T22:48:00 Rev1 None None
Perspecta-PurdueRutgers 0.73317 0.06811 0.25951 0.53918 1352.99 2023-06-07T00:10:09 2023-06-07T00:01:36 Rev1 None None
Perspecta-PurdueRutgers 1.8773 0.26394 0.47807 0.49753 2555.31 2023-06-07T00:50:10 2023-06-07T00:45:08 Rev1 None None
Perspecta-PurdueRutgers 0.78067 0.0743 0.27681 0.50294 2574.62 2023-06-07T02:10:09 2023-06-07T02:02:58 Rev1 None None
Perspecta-PurdueRutgers 1.8768 0.26409 0.47767 0.49818 2558.21 2023-06-07T04:10:09 2023-06-07T04:08:17 Rev1 None None
Perspecta-PurdueRutgers 0.79133 0.08955 0.27363 0.51294 9484.59 2023-06-07T05:31:36 2023-06-07T05:21:35 Rev1 None None
Perspecta-PurdueRutgers 0.74181 0.07815 0.25914 0.53965 9761.62 2023-06-07T18:00:10 2023-06-07T17:05:21 Rev1 None None
Perspecta-PurdueRutgers 1.88261 0.26641 0.47659 0.50259 2561.39 2023-06-07T21:10:10 2023-06-07T21:09:30 Rev1 None None
Perspecta-PurdueRutgers 1.90746 0.26906 0.48181 0.50388 1371.21 2023-06-07T22:20:10 2023-06-07T22:19:23 Rev1 None None
Perspecta-PurdueRutgers 0.60252 0.04159 0.21195 0.65565 4159.91 2023-06-08T00:00:10 2023-06-07T23:51:10 Rev1 None None
Perspecta-PurdueRutgers 0.62671 0.03138 0.22 0.64029 1367.75 2023-06-09T18:50:11 2023-06-09T18:47:43 Rev1 None None
Perspecta-PurdueRutgers 0.76048 0.04694 0.27568 0.43212 1424.34 2023-07-07T19:01:34 2023-07-07T18:51:18 Rev1 :Result Parse::Missing Results: None
Perspecta-PurdueRutgers 0.69785 0.0259 0.25294 0.51582 1967.79 2023-07-07T20:00:10 2023-07-07T19:56:00 Rev1 None None
Perspecta-PurdueRutgers 0.83706 0.29111 0.25257 0.56141 3433.84 2023-07-07T21:30:11 2023-07-07T21:22:57 Rev1 None None
Perspecta-PurdueRutgers 0.81294 0.10418 0.27354 0.51453 3837.95 2023-07-07T23:00:11 2023-07-07T22:54:50 Rev1 None None
Perspecta-PurdueRutgers 0.64133 0.05061 0.22622 0.62059 6325.77 2023-07-08T01:20:11 2023-07-08T01:16:22 Rev1 None None
Perspecta-PurdueRutgers 0.77317 0.04764 0.28138 0.42659 1251.87 2023-07-08T03:30:11 2023-07-08T03:23:07 Rev1 None None
Perspecta-PurdueRutgers 0.78167 0.05022 0.28435 0.41765 1249.76 2023-07-08T04:50:10 2023-07-08T04:42:51 Rev1 None None
Perspecta-PurdueRutgers 0.63847 0.04705 0.22555 0.62106 6861.24 2023-07-08T14:10:10 2023-07-08T14:03:21 Rev1 None None
Perspecta-PurdueRutgers 0.8721 0.12611 0.29055 0.52235 29452.12 2023-07-09T05:40:09 2023-07-09T05:39:32 Rev1 None None
Perspecta-PurdueRutgers 0.72925 0.03767 0.26479 0.46947 3156.61 2023-07-09T14:50:09 2023-07-09T14:47:27 Rev1 :Result Parse::Missing Results: None
Perspecta-PurdueRutgers 0.76797 0.07562 0.27162 0.51412 3127.18 2023-07-09T16:40:09 2023-07-09T16:38:59 Rev1 None None
Perspecta-PurdueRutgers 0.6057 0.04126 0.21324 0.65235 4142.18 2023-07-09T18:11:18 2023-07-09T18:04:06 Rev1 None None
Perspecta-PurdueRutgers 0.60175 0.03723 0.21211 0.65306 4078.9 2023-07-09T20:30:08 2023-07-09T20:25:00 Rev1 None None
Perspecta-IUB 0.69315 0.0 0.25 0.5 2023-03-25T17:50:11 2023-03-25T17:41:42 Rev1 None :Schema Header:
Perspecta-IUB 1.68364 0.42673 0.31509 0.63006 3437.12 2023-03-25T20:00:10 2023-03-25T19:53:28 Rev1 None None
ARM-UCSD 0.69315 0.0 0.25 0.5 2023-05-16T02:30:26 2023-05-15T20:25:36 Rev1 :No Results::Missing Results: :Container Parameters (metaparameters schema)::Container Parameters (learned parameters)::Container Parameters (jsonschema checker)::Schema Header:
ARM-UCSD 0.69315 0.0 0.25 0.5 2023-05-16T20:31:03 2023-05-16T20:30:55 Rev1 :No Results::Missing Results: :Schema Header:
ARM-UCSD 0.69315 0.0 0.25 0.5 674.76 2023-05-17T20:10:17 2023-05-17T20:09:05 Rev1 :Missing Results: None
ARM-UCSD 0.69315 0.0 0.25 0.5 709.14 2023-05-30T18:50:18 2023-05-30T18:43:00 Rev1 :Missing Results: None
ARM-UCSD 0.85038 0.13357 0.27261 0.55424 677.76 2023-06-05T19:41:29 2023-06-05T19:35:08 Rev1 None None
ICSI-2 0.79614 0.09319 0.28521 0.57018 1385.2 2023-03-29T09:50:21 2023-03-29T09:44:57 Rev1 None None
ICSI-2 0.77977 0.07985 0.28031 0.55524 1297.02 2023-03-30T00:50:21 2023-03-30T00:47:40 Rev1 None None
ICSI-2 1.08003 0.17012 0.34107 0.53694 1238.59 2023-03-31T09:20:23 2023-03-31T09:16:52 Rev1 None None
ICSI-2 0.84919 0.10497 0.30205 0.55553 1235.14 2023-03-31T11:40:22 2023-03-31T11:37:45 Rev1 None None
ICSI-2 1.07166 0.16199 0.34875 0.51424 1219.04 2023-04-03T07:40:22 2023-04-03T07:36:45 Rev1 None None
ICSI-2 1.10249 0.16228 0.36162 0.53047 1210.23 2023-04-06T03:20:22 2023-04-06T03:16:04 Rev1 None None
ICSI-2 1.12122 0.16934 0.36192 0.51876 1166.33 2023-04-06T11:20:24 2023-04-06T11:13:31 Rev1 None None
ICSI-2 0.82636 0.08503 0.30107 0.53653 1120.23 2023-04-08T03:40:24 2023-04-08T03:39:54 Rev1 None None
ICSI-2 1.70792 0.41999 0.36528 0.51147 1202.51 2023-04-11T09:50:22 2023-04-11T09:41:18 Rev1 None None
ICSI-2 0.80876 0.09847 0.28436 0.55918 1159.54 2023-04-12T02:30:22 2023-04-12T02:24:58 Rev1 None None
ICSI-2 0.79693 0.09664 0.28477 0.58959 1513.21 2023-04-14T10:10:23 2023-04-14T10:00:26 Rev1 None None
ICSI-2 0.7437 0.06344 0.26687 0.54912 1511.85 2023-04-17T10:40:29 2023-04-17T10:39:32 Rev1 None None
ICSI-2 0.8882 0.13356 0.29149 0.56176 1449.16 2023-04-19T00:41:32 2023-04-19T00:36:25 Rev1 None None
ICSI-2 0.82762 0.08392 0.30251 0.52088 935.48 2023-04-25T07:20:23 2023-04-25T07:11:41 Rev1 None None
ICSI-2 0.79094 0.08622 0.28643 0.56571 1105.16 2023-04-27T07:10:22 2023-04-27T07:10:13 Rev1 None None
ICSI-2 0.81796 0.0845 0.29715 0.52094 1418.67 2023-04-27T08:50:22 2023-04-27T08:43:11 Rev1 None None
ICSI-2 0.86474 0.0922 0.31491 0.50576 973.24 2023-04-27T11:02:34 2023-04-27T11:01:24 Rev1 None None
ICSI-2 0.80211 0.08793 0.28943 0.55306 1461.85 2023-04-28T19:30:24 2023-04-28T19:26:40 Rev1 None None
ICSI-2 0.84584 0.0945 0.30678 0.51841 959.44 2023-04-28T20:10:24 2023-04-28T20:08:10 Rev1 None None
ICSI-2 0.81249 0.08639 0.2949 0.53635 1226.31 2023-04-30T10:50:23 2023-04-30T10:40:47 Rev1 None None
ICSI-2 0.82219 0.09056 0.29719 0.53747 974.4 2023-05-02T02:50:24 2023-05-02T02:47:23 Rev1 None None
ICSI-2 0.80942 0.08628 0.29387 0.53959 1135.95 2023-05-02T04:50:24 2023-05-02T04:40:42 Rev1 None None
ICSI-2 0.793 0.08483 0.28705 0.55153 1051.61 2023-05-02T07:00:24 2023-05-02T06:58:33 Rev1 None None
ICSI-2 1.14392 0.22595 0.33482 0.537 1019.33 2023-05-02T09:00:24 2023-05-02T08:54:20 Rev1 None None
ICSI-2 1.05672 0.2193 0.30698 0.55182 988.53 2023-05-02T11:50:24 2023-05-02T11:47:41 Rev1 None None
ICSI-2 0.77563 0.05931 0.28627 0.47982 28104.16 2023-05-04T13:30:24 2023-05-04T13:27:27 Rev1 None None
ICSI-2 0.92876 0.13012 0.32085 0.56112 26770.4 2023-05-05T03:10:24 2023-05-05T03:06:29 Rev1 None None
ICSI-2 0.82082 0.10694 0.28741 0.57071 41654.06 2023-05-07T08:40:24 2023-05-07T08:38:10 Rev1 None None
ICSI-2 0.92219 0.12609 0.32227 0.55753 35835.26 2023-05-09T00:50:23 2023-05-09T00:49:08 Rev1 None None
ICSI-2 0.87267 0.12024 0.30298 0.56541 11104.45 2023-05-10T12:00:24 2023-05-10T11:57:24 Rev1 None None
ICSI-2 0.72548 0.11367 0.246 0.69241 5750.91 2023-05-11T09:10:23 2023-05-11T09:08:35 Rev1 None None
ICSI-2 0.71609 0.10734 0.24525 0.68735 5467.14 2023-05-12T03:50:23 2023-05-12T03:41:42 Rev1 None None
ICSI-2 0.91402 0.13132 0.31552 0.62129 71508.08 2023-05-28T18:20:28 2023-05-28T18:11:34 Rev1 None None
TrinitySRITrojAI-BostonU 0.70682 0.01437 0.25681 0.49412 4747.73 2023-06-20T16:10:35 2023-06-15T05:42:36 Rev1 :Missing Results: None
TrinitySRITrojAI-BostonU 0.70682 0.01437 0.25681 0.49412 2979.85 2023-06-21T00:50:30 2023-06-21T00:46:16 Rev1 :Missing Results: None
TrinitySRITrojAI-BostonU 0.70682 0.01437 0.25681 0.49412 2976.02 2023-06-21T15:40:30 2023-06-21T15:33:06 Rev1 :Missing Results: None
TrinitySRITrojAI-BostonU 0.70682 0.01437 0.25681 0.49412 2975.8 2023-06-21T18:50:29 2023-06-21T18:47:27 Rev1 :Missing Results: None
TrinitySRITrojAI-BostonU 0.70682 0.01437 0.25681 0.49412 2975.72 2023-06-21T22:10:30 2023-06-21T22:05:00 Rev1 :Missing Results: None
TrinitySRITrojAI-BostonU 0.70631 0.01441 0.25655 0.5 1040.08 2023-06-22T03:40:30 2023-06-22T03:32:03 Rev1 None None
TrinitySRITrojAI-BostonU 0.70631 0.01441 0.25655 0.5 1044.86 2023-06-22T17:50:30 2023-06-22T17:46:31 Rev1 None None
TrinitySRITrojAI-BostonU 0.70631 0.01441 0.25655 0.5 1038.59 2023-06-22T20:40:30 2023-06-22T20:32:07 Rev1 None None
TrinitySRITrojAI-BostonU 0.70631 0.01441 0.25655 0.5 1038.43 2023-06-22T23:00:30 2023-06-22T22:52:12 Rev1 None None
TrinitySRITrojAI-BostonU 0.70631 0.01441 0.25655 0.5 1136.02 2023-06-23T01:20:30 2023-06-23T01:10:50 Rev1 None None
TrinitySRITrojAI-BostonU 0.70682 0.01437 0.25681 0.49412 3077.54 2023-06-23T09:20:30 2023-06-23T09:10:42 Rev1 :Missing Results: None
TrinitySRITrojAI-BostonU 0.70631 0.01441 0.25655 0.5 3136.97 2023-06-24T00:20:32 2023-06-24T00:16:53 Rev1 None None
TrinitySRITrojAI-BostonU 0.70631 0.01441 0.25655 0.5 3092.71 2023-06-25T09:00:30 2023-06-25T08:53:12 Rev1 None None
TrinitySRITrojAI-BostonU 0.70631 0.01441 0.25655 0.5 4249.8 2023-06-26T00:00:30 2023-06-25T23:55:09 Rev1 None None
TrinitySRITrojAI-BostonU 0.70631 0.01441 0.25655 0.5 4272.44 2023-06-26T04:00:30 2023-06-26T03:54:54 Rev1 None None
TrinitySRITrojAI-BostonU 0.70631 0.01441 0.25655 0.5 5900.84 2023-06-26T08:50:28 2023-06-26T08:49:53 Rev1 None None
TrinitySRITrojAI-BostonU 0.70631 0.01441 0.25655 0.5 5850.48 2023-06-26T14:00:28 2023-06-26T13:54:04 Rev1 None None
TrinitySRITrojAI-BostonU 0.70631 0.01441 0.25655 0.5 6437.51 2023-06-26T22:50:28 2023-06-26T22:47:09 Rev1 None None
TrinitySRITrojAI-BostonU 0.69028 0.00755 0.24857 0.5 6501.26 2023-06-27T07:20:27 2023-06-27T07:17:15 Rev1 None None
trojai-example 0.86477 0.11619 0.29668 0.56353 57033.52 2023-06-01T20:22:06 2023-06-01T20:18:52 Rev1 None None
trojai-example 0.85976 0.1096 0.30076 0.55629 53065.8 2023-06-02T13:33:39 2023-06-02T13:30:39 Rev1 None None

Round 14 leaderboard for MiniGrid Reinforcement Learning Lavaworld Agents July 2023.

Each AI is trained to get to the green square. For those AIs that have been attacked, the presence of the trigger will cause the Agent to head into the lava.

Clean RL Agent Behavior Poisoned RL Agent Behavior

Example behavior of clean and poisoned RL agents.

train: The train dataset that is distributed with each round.
test: The test dataset that is sequestered/hidden, used for evaluation. Submissions here should be fully realized with complete schema and parameters.
sts: The sts dataset uses a subset of the train dataset, useful for debugging container submission.
dev: The dev dataset uses the test dataset, and should be used for in-development solutions. Schemas must be valid, but do not need to be complete. Results do not count towards the program.

Required filename format: "rl-lavaworld-jul2023_train_<Submission Name>.simg"
Accepting submissions: True
Number of models in rl-lavaworld-jul2023, train: 238
Execution timeout (hh:mm:ss): 1 day, 15:40:00

Teams/Jobs

Team Submission Timestamp Type Job Status File Status General Status File Timestamp Time until next execution
Perspecta 2023-08-22T18:50:06 performer None None Ok 2023-08-22T18:44:19 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI 2023-09-27T17:10:09 performer None None Ok 2023-09-27T17:08:17 0 d, 0 h, 0 m, 0 s
DRAFFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
PL-GIFT 2023-07-31T15:01:13 performer None None Ok 2023-07-31T14:54:48 0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers 2023-07-21T14:50:16 performer None None Ok 2023-07-20T20:50:25 0 d, 0 h, 0 m, 0 s
Perspecta-IUB 2023-08-08T05:00:13 performer None None Ok 2023-08-08T04:58:40 0 d, 0 h, 0 m, 0 s
ARM-UCSD 2023-08-23T04:30:21 performer None None Ok 2023-08-23T04:22:10 0 d, 0 h, 0 m, 0 s
ARM 2023-08-22T01:50:27 performer None None Ok 2023-08-22T01:43:38 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU 2023-08-24T00:50:32 performer None None Ok 2023-08-24T00:45:52 0 d, 0 h, 0 m, 0 s
ARM-UMBC performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-1 performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-2 2023-08-22T05:30:32 performer None None Ok 2023-08-22T05:30:00 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU 2023-09-05T20:30:33 performer None None Ok 2023-09-05T20:26:42 0 d, 0 h, 0 m, 0 s
trojai-example public None None Ok None 0 d, 0 h, 0 m, 0 s
IceTorch public None None Ok None 0 d, 0 h, 0 m, 0 s
trojaicy public None None Ok None 0 d, 0 h, 0 m, 0 s
Hector public None None Ok None 0 d, 0 h, 0 m, 0 s
Cassandra-XF public None None Ok None 0 d, 0 h, 0 m, 0 s
gooddefense public None None Ok None 0 d, 0 h, 0 m, 0 s
cyberinfrastructure public None None Ok None 0 d, 0 h, 0 m, 0 s
glaros public None None Ok None 0 d, 0 h, 0 m, 0 s
Ultraman public None None Ok None 0 d, 0 h, 0 m, 0 s
BackSec public None None Ok None 0 d, 0 h, 0 m, 0 s
Palladium public None None Ok None 0 d, 0 h, 0 m, 0 s
IIECAS public None None Ok None 0 d, 0 h, 0 m, 0 s
NSEC public None None Ok None 0 d, 0 h, 0 m, 0 s
UMBCb 2023-08-22T04:30:44 performer None None Ok 2023-08-22T04:23:04 0 d, 0 h, 0 m, 0 s
PASS public None None Ok None 0 d, 0 h, 0 m, 0 s
DS3TwoSixZero public None None Ok None 0 d, 0 h, 0 m, 0 s
dongdong4fei public None None Ok None 0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.05592 0.00541 0.00434 1.0 641.4 2023-07-20T05:20:06 2023-07-20T05:14:53 Rev1 None None
TrinitySRITrojAI 0.0003 0.00014 0.0 1.0 561.27 2023-07-15T18:30:06 2023-07-15T18:22:43 Rev1 None None
PL-GIFT 0.01237 0.0009 0.0002 1.0 686.39 2023-07-14T22:20:08 2023-07-14T22:14:26 Rev1 None None
Perspecta-PurdueRutgers 0.0491 0.00529 0.00362 1.0 712.09 2023-07-21T14:50:16 2023-07-20T20:50:25 Rev1 None None
Perspecta-IUB 0.01005 0.0 0.0001 1.0 711.1 2023-07-25T03:50:15 2023-07-25T03:45:04 Rev1 None None
ARM-UCSD 0.30076 0.01965 0.07571 1.0 1169.46 2023-08-23T04:30:21 2023-08-23T04:22:10 Rev1 None None
ARM 0.00354 0.00302 0.00047 1.0 526.61 2023-08-21T21:20:28 2023-08-21T21:15:14 Rev1 None None
TrinitySRITrojAI-SBU 0.16352 0.03169 0.03508 0.99442 1441.02 2023-07-25T17:20:30 2023-07-25T17:14:49 Rev1 None None
ICSI-2 0.05605 0.00409 0.00367 1.0 606.35 2023-08-07T04:30:32 2023-08-07T04:27:20 Rev1 None None
TrinitySRITrojAI-BostonU 0.58048 0.50344 0.02101 0.97899 522.94 2023-07-26T23:00:34 2023-07-26T22:54:28 Rev1 None None
UMBCb 0.49969 0.0681 0.16834 0.83416 622.25 2023-08-22T04:30:44 2023-08-22T04:23:04 Rev1 None None

All Results

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.93502 0.09464 0.3445 0.53538 634.25 2023-07-17T21:30:06 2023-07-17T21:25:10 Rev1 None None
Perspecta 0.05592 0.00541 0.00434 1.0 641.4 2023-07-20T05:20:06 2023-07-20T05:14:53 Rev1 None None
Perspecta 0.00624 0.0007 7e-05 1.0 616.65 2023-07-24T14:00:06 2023-07-24T13:59:51 Rev1 None None
Perspecta 0.02996 0.00796 0.00324 1.0 529.83 2023-07-25T14:20:07 2023-07-25T14:17:47 Rev1 None None
Perspecta 0.01362 0.00218 0.00044 1.0 530.65 2023-07-28T22:40:06 2023-07-28T22:38:31 Rev1 None None
Perspecta 0.01827 0.00234 0.00064 1.0 534.21 2023-07-29T05:40:06 2023-07-29T05:36:45 Rev1 None None
Perspecta 0.03715 0.00753 0.00362 1.0 532.08 2023-08-02T02:50:07 2023-08-02T02:43:19 Rev1 None None
Perspecta 0.01005 0.0 0.0001 1.0 534.95 2023-08-02T04:10:06 2023-08-02T04:05:58 Rev1 None None
Perspecta 0.00487 0.00301 0.00041 1.0 534.26 2023-08-02T15:00:06 2023-08-02T14:59:01 Rev1 None None
Perspecta 0.00404 0.00604 0.00128 1.0 532.91 2023-08-08T20:50:06 2023-08-08T20:48:13 Rev1 None None
Perspecta 0.00828 0.00719 0.0021 1.0 524.81 2023-08-15T15:50:07 2023-08-15T15:41:48 Rev1 None None
Perspecta 0.00824 0.00708 0.00208 1.0 524.62 2023-08-22T18:50:06 2023-08-22T18:44:19 Rev1 None None
TrinitySRITrojAI 0.0003 0.00014 0.0 1.0 561.27 2023-07-15T18:30:06 2023-07-15T18:22:43 Rev1 None None
TrinitySRITrojAI 0.07444 0.01412 0.01023 1.0 795.22 2023-09-05T17:20:07 2023-09-05T17:10:39 Rev1 None None
TrinitySRITrojAI 0.4756 0.07798 0.1536 0.86488 2300.79 2023-09-06T21:00:07 2023-09-06T20:58:23 Rev1 None None
TrinitySRITrojAI 0.49366 0.14497 0.13946 0.91275 695.67 2023-09-18T20:30:08 2023-09-18T20:23:42 Rev1 None None
TrinitySRITrojAI 0.18538 0.05206 0.05671 0.99407 686.48 2023-09-27T17:10:09 2023-09-27T17:08:17 Rev1 None None
PL-GIFT 0.01237 0.0009 0.0002 1.0 686.39 2023-07-14T22:20:08 2023-07-14T22:14:26 Rev1 None None
PL-GIFT 0.0503 0.02061 0.01071 0.99936 671.82 2023-07-28T14:50:09 2023-07-28T14:48:07 Rev1 None None
PL-GIFT 0.04339 0.02333 0.00986 0.99933 677.99 2023-07-28T18:20:10 2023-07-28T18:14:37 Rev1 None None
PL-GIFT 0.01034 0.0003 0.00011 1.0 677.57 2023-07-31T15:01:13 2023-07-31T14:54:48 Rev1 None None
Perspecta-PurdueRutgers 0.0491 0.00529 0.00362 1.0 712.09 2023-07-21T14:50:16 2023-07-20T20:50:25 Rev1 None None
Perspecta-IUB 0.01005 0.0 0.0001 1.0 711.1 2023-07-25T03:50:15 2023-07-25T03:45:04 Rev1 None None
Perspecta-IUB 0.01005 0.0 0.0001 1.0 703.42 2023-07-25T15:00:15 2023-07-25T14:53:05 Rev1 None None
Perspecta-IUB 0.0 0.0 0.0 1.0 1112.58 2023-07-25T18:30:14 2023-07-25T18:24:48 Rev1 None None
Perspecta-IUB 0.0 0.0 0.0 1.0 1307.74 2023-08-08T05:00:13 2023-08-08T04:58:40 Rev1 None None
ARM-UCSD 0.30076 0.01965 0.07571 1.0 1169.46 2023-08-23T04:30:21 2023-08-23T04:22:10 Rev1 None None
ARM 0.0839 0.02757 0.01819 0.99788 545.2 2023-07-18T04:30:27 2023-07-18T04:25:24 Rev1 None None
ARM 0.00354 0.00302 0.00047 1.0 526.61 2023-08-21T21:20:28 2023-08-21T21:15:14 Rev1 None None
ARM 0.00354 0.00302 0.00047 1.0 527.58 2023-08-21T23:20:27 2023-08-21T23:15:34 Rev1 None None
ARM 0.07047 0.02091 0.01409 0.99993 524.29 2023-08-22T01:50:27 2023-08-22T01:43:38 Rev1 None None
TrinitySRITrojAI-SBU 0.16352 0.03169 0.03508 0.99442 1441.02 2023-07-25T17:20:30 2023-07-25T17:14:49 Rev1 None None
TrinitySRITrojAI-SBU 0.14916 0.03632 0.03383 0.99432 1441.03 2023-07-28T23:40:30 2023-07-28T23:38:47 Rev1 None None
TrinitySRITrojAI-SBU 0.15749 0.03819 0.03591 0.99322 1437.51 2023-08-23T19:20:32 2023-08-23T19:11:58 Rev1 None None
TrinitySRITrojAI-SBU 0.14916 0.03632 0.03383 0.99432 1440.56 2023-08-23T21:10:32 2023-08-23T21:06:11 Rev1 None None
TrinitySRITrojAI-SBU 0.14869 0.03583 0.03358 0.99439 1439.0 2023-08-23T21:50:32 2023-08-23T21:48:17 Rev1 None None
TrinitySRITrojAI-SBU 0.14858 0.03579 0.03352 0.99435 1440.78 2023-08-23T22:30:32 2023-08-23T22:27:47 Rev1 None None
TrinitySRITrojAI-SBU 0.14817 0.03573 0.03333 0.99435 1437.19 2023-08-23T23:10:32 2023-08-23T23:08:09 Rev1 None None
TrinitySRITrojAI-SBU 0.14959 0.03588 0.03374 0.99435 1440.86 2023-08-24T00:12:26 2023-08-24T00:03:59 Rev1 None None
TrinitySRITrojAI-SBU 0.14959 0.03588 0.03374 0.99435 1438.02 2023-08-24T00:50:32 2023-08-24T00:45:52 Rev1 None None
ICSI-2 0.05867 0.00372 0.00385 1.0 615.31 2023-07-19T21:20:31 2023-07-19T21:17:34 Rev1 None None
ICSI-2 0.69315 0.0 0.25 0.5 605.99 2023-08-05T00:50:33 2023-08-05T00:48:01 Rev1 None None
ICSI-2 0.05779 0.00386 0.00379 1.0 608.88 2023-08-06T23:50:33 2023-08-06T23:41:13 Rev1 None None
ICSI-2 0.05605 0.00409 0.00367 1.0 606.35 2023-08-07T04:30:32 2023-08-07T04:27:20 Rev1 None None
ICSI-2 0.05059 0.00186 0.00261 1.0 599.53 2023-08-22T05:30:32 2023-08-22T05:30:00 Rev1 None None
TrinitySRITrojAI-BostonU 0.70969 0.02317 0.25814 0.5 1217.77 2023-07-19T23:40:32 2023-07-19T23:36:56 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 523.75 2023-07-26T00:00:33 2023-07-25T23:52:18 Rev1 :Result Parse::No Results::Missing Results: None
TrinitySRITrojAI-BostonU 0.58048 0.50344 0.02101 0.97899 522.94 2023-07-26T23:00:34 2023-07-26T22:54:28 Rev1 None None
TrinitySRITrojAI-BostonU 0.69658 0.55031 0.02521 0.97479 521.45 2023-07-26T23:40:33 2023-07-26T23:39:16 Rev1 None None
TrinitySRITrojAI-BostonU 0.49223 0.04088 0.15982 0.90128 1235.84 2023-09-04T18:50:33 2023-09-04T18:47:32 Rev1 None None
TrinitySRITrojAI-BostonU 0.49214 0.04089 0.15978 0.90145 1233.85 2023-09-04T20:10:33 2023-09-04T20:00:32 Rev1 None None
TrinitySRITrojAI-BostonU 0.59869 0.13635 0.16912 0.8051 1267.72 2023-09-04T22:30:32 2023-09-04T22:28:56 Rev1 None None
TrinitySRITrojAI-BostonU 0.41145 0.10456 0.1175 0.89235 1226.88 2023-09-05T20:30:33 2023-09-05T20:26:42 Rev1 None None
UMBCb 0.49969 0.0681 0.16834 0.83416 622.25 2023-08-22T04:30:44 2023-08-22T04:23:04 Rev1 None None

Required filename format: "rl-lavaworld-jul2023_test_<Submission Name>.simg"
Accepting submissions: True
Number of models in rl-lavaworld-jul2023, test: 238
Execution timeout (hh:mm:ss): 1 day, 15:40:00

Teams/Jobs

Team Submission Timestamp Type Job Status File Status General Status File Timestamp Time until next execution
Perspecta 2023-08-22T18:50:06 performer None Ok Ok 2023-08-22T18:44:19 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI 2023-09-27T17:10:09 performer None Ok Ok 2023-09-27T17:08:17 0 d, 0 h, 0 m, 0 s
DRAFFT performer None None Ok None 0 d, 0 h, 0 m, 0 s
PL-GIFT 2023-07-31T15:01:13 performer None None Ok 2023-07-31T14:54:48 0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers 2023-07-21T14:50:16 performer None None Ok 2023-07-20T20:50:25 0 d, 0 h, 0 m, 0 s
Perspecta-IUB 2023-08-08T05:00:13 performer None None Ok 2023-08-08T04:58:40 0 d, 0 h, 0 m, 0 s
ARM-UCSD 2023-08-23T04:30:21 performer None None Ok 2023-08-23T04:22:10 0 d, 0 h, 0 m, 0 s
ARM 2023-08-22T01:50:27 performer None Ok Ok 2023-08-22T01:43:38 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU 2023-08-24T00:50:32 performer None None Ok 2023-08-24T00:45:52 0 d, 0 h, 0 m, 0 s
ARM-UMBC performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-1 performer None None Ok None 0 d, 0 h, 0 m, 0 s
ICSI-2 2023-08-22T05:30:32 performer None None Ok 2023-08-22T05:30:00 0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU 2023-09-05T20:30:33 performer None None Ok 2023-09-05T20:26:42 0 d, 0 h, 0 m, 0 s
trojai-example 2023-07-14T20:40:30 public None None Ok 2023-07-14T20:36:56 0 d, 0 h, 0 m, 0 s
IceTorch public None None Ok None 0 d, 0 h, 0 m, 0 s
trojaicy public None None Ok None 0 d, 0 h, 0 m, 0 s
Hector public None None Ok None 0 d, 0 h, 0 m, 0 s
Cassandra-XF public None None Ok None 0 d, 0 h, 0 m, 0 s
gooddefense public None None Ok None 0 d, 0 h, 0 m, 0 s
cyberinfrastructure public None None Ok None 0 d, 0 h, 0 m, 0 s
glaros public None None Ok None 0 d, 0 h, 0 m, 0 s
Ultraman public None None Ok None 0 d, 0 h, 0 m, 0 s
BackSec public None None Ok None 0 d, 0 h, 0 m, 0 s
Palladium public None None Ok None 0 d, 0 h, 0 m, 0 s
IIECAS public None None Ok None 0 d, 0 h, 0 m, 0 s
NSEC public None None Ok None 0 d, 0 h, 0 m, 0 s
UMBCb 2023-08-22T04:30:44 performer None Ok Ok 2023-08-22T04:23:04 0 d, 0 h, 0 m, 0 s
PASS public None None Ok None 0 d, 0 h, 0 m, 0 s
DS3TwoSixZero public None None Ok None 0 d, 0 h, 0 m, 0 s
dongdong4fei public None None Ok None 0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.07411 0.02277 0.01496 1.0 528.54 2023-07-25T14:20:07 2023-07-25T14:17:47 Rev1 None None
TrinitySRITrojAI 0.10995 0.02557 0.02009 0.99799 801.87 2023-09-05T17:20:07 2023-09-05T17:10:39 Rev1 None None
PL-GIFT 0.04652 0.01966 0.01047 0.99929 673.05 2023-07-28T18:20:10 2023-07-28T18:14:37 Rev1 None None
Perspecta-PurdueRutgers 0.14656 0.03241 0.03224 0.99372 704.59 2023-07-21T14:50:16 2023-07-20T20:50:25 Rev1 None None
Perspecta-IUB 0.4155 0.16559 0.08657 0.91176 702.16 2023-07-25T03:50:15 2023-07-25T03:45:04 Rev1 None None
ARM-UCSD 0.40792 0.02417 0.11942 0.99979 1168.12 2023-08-23T04:30:21 2023-08-23T04:22:10 Rev1 None None
ARM 0.0885 0.03594 0.02108 0.99435 523.66 2023-08-22T01:50:27 2023-08-22T01:43:38 Rev1 None None
TrinitySRITrojAI-SBU 0.14587 0.03701 0.03133 0.99492 1431.41 2023-08-23T22:30:32 2023-08-23T22:27:47 Rev1 None None
ICSI-2 0.09922 0.03167 0.01853 0.99862 598.53 2023-08-22T05:30:32 2023-08-22T05:30:00 Rev1 None None
TrinitySRITrojAI-BostonU 1.16097 0.7043 0.04202 0.95798 526.06 2023-07-26T23:00:34 2023-07-26T22:54:28 Rev1 None None
trojai-example 1.12405 0.12657 0.3944 0.5 1229.64 2023-07-14T20:40:30 2023-07-14T20:36:56 Rev1 None :Schema Header:
UMBCb 0.61735 0.10882 0.19542 0.78275 621.85 2023-08-22T04:30:44 2023-08-22T04:23:04 Rev1 None None

All Results

Team Cross Entropy CE 95% CI Brier Score ROC-AUC Runtime (s) Submission Timestamp File Timestamp Leaderboard Revision Parsing Errors Launch Errors
Perspecta 0.6807 0.01059 0.24382 0.61037 635.88 2023-07-17T21:30:06 2023-07-17T21:25:10 Rev1 None None
Perspecta 0.17899 0.02048 0.03507 0.99972 627.1 2023-07-20T05:20:06 2023-07-20T05:14:53 Rev1 None None
Perspecta 0.04515 0.01888 0.00928 0.99986 616.92 2023-07-24T14:00:06 2023-07-24T13:59:51 Rev1 None None
Perspecta 0.07411 0.02277 0.01496 1.0 528.54 2023-07-25T14:20:07 2023-07-25T14:17:47 Rev1 None None
Perspecta 0.05474 0.01915 0.01078 0.99993 530.43 2023-07-28T22:40:06 2023-07-28T22:38:31 Rev1 None None
Perspecta 0.06985 0.02575 0.01472 0.99915 536.19 2023-07-29T05:40:06 2023-07-29T05:36:45 Rev1 None None
Perspecta 0.08671 0.02549 0.01885 0.99901 532.43 2023-08-02T02:50:07 2023-08-02T02:43:19 Rev1 None None
Perspecta 0.12589 0.09152 0.02481 0.97479 533.06 2023-08-02T04:10:06 2023-08-02T04:05:58 Rev1 None None
Perspecta 0.05564 0.04897 0.01469 0.99947 533.44 2023-08-02T15:00:06 2023-08-02T14:59:01 Rev1 None None
Perspecta 0.15981 0.22791 0.01875 0.99449 532.53 2023-08-08T20:50:06 2023-08-08T20:48:13 Rev1 None None
Perspecta 0.07952 0.08142 0.0158 0.9916 524.64 2023-08-15T15:50:07 2023-08-15T15:41:48 Rev1 None None
Perspecta 0.10586 0.09874 0.01906 0.98739 525.45 2023-08-22T18:50:06 2023-08-22T18:44:19 Rev1 None None
TrinitySRITrojAI 0.19989 0.16104 0.0259 0.97857 555.4 2023-07-15T18:30:06 2023-07-15T18:22:43 Rev1 None None
TrinitySRITrojAI 0.10995 0.02557 0.02009 0.99799 801.87 2023-09-05T17:20:07 2023-09-05T17:10:39 Rev1 None None
TrinitySRITrojAI 0.40352 0.05664 0.12976 0.89344 2228.82 2023-09-06T21:00:07 2023-09-06T20:58:23 Rev1 None None
TrinitySRITrojAI 0.39964 0.05429 0.12917 0.89951 2150.93 2023-09-06T22:00:08 2023-09-06T21:57:26 Rev1 None None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 527.14 2023-09-13T00:10:07 2023-09-13T00:09:36 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 2023-09-15T18:10:26 2023-09-15T17:57:39 Rev1 None None:Slurm Script Error:
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 522.63 2023-09-15T19:10:08 2023-09-15T19:00:27 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 511.36 2023-09-15T23:00:08 2023-09-15T22:54:24 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.69315 0.0 0.25 0.5 511.12 2023-09-18T18:40:09 2023-09-18T18:33:32 Rev1 :No Results::Missing Results: None
TrinitySRITrojAI 0.58067 0.1734 0.15113 0.87141 695.82 2023-09-18T20:30:08 2023-09-18T20:23:42 Rev1 None None
TrinitySRITrojAI 0.20851 0.05541 0.06748 0.98803 694.33 2023-09-27T17:10:09 2023-09-27T17:08:17 Rev1 None None
PL-GIFT 0.07345 0.03052 0.01757 0.99788 687.08 2023-07-14T22:20:08 2023-07-14T22:14:26 Rev1 None None
PL-GIFT 0.05584 0.01858 0.01181 0.99929 672.84 2023-07-28T14:50:09 2023-07-28T14:48:07 Rev1 None None
PL-GIFT 0.04652 0.01966 0.01047 0.99929 673.05 2023-07-28T18:20:10 2023-07-28T18:14:37 Rev1 None None
PL-GIFT 0.12378 0.08502 0.02636 0.97758 678.99 2023-07-31T15:01:13 2023-07-31T14:54:48 Rev1 None None
Perspecta-PurdueRutgers 0.14656 0.03241 0.03224 0.99372 704.59 2023-07-21T14:50:16 2023-07-20T20:50:25 Rev1 None None
Perspecta-IUB 0.4155 0.16559 0.08657 0.91176 702.16 2023-07-25T03:50:15 2023-07-25T03:45:04 Rev1 None None
Perspecta-IUB 0.4155 0.16559 0.08657 0.91176 710.52 2023-07-25T04:11:45 2023-07-25T03:51:24 Rev1 None None
Perspecta-IUB 0.4155 0.16559 0.08657 0.91176 701.63 2023-07-25T15:00:15 2023-07-25T14:53:05 Rev1 None None
Perspecta-IUB 3.13461 1.1133 0.11345 0.85831 1111.62 2023-07-25T18:30:14 2023-07-25T18:24:48 Rev1 None None
Perspecta-IUB 2.43803 0.9957 0.08824 0.88973 1303.73 2023-08-08T05:00:13 2023-08-08T04:58:40 Rev1 None None
ARM-UCSD 0.40792 0.02417 0.11942 0.99979 1168.12 2023-08-23T04:30:21 2023-08-23T04:22:10 Rev1 None None
ARM 0.69315 0.0 0.25 0.5 2023-07-17T21:00:27 2023-07-17T20:55:46 Rev1 :No Results::Missing Results::Info File Missing: None
ARM 0.08622 0.03776 0.01855 0.99297 548.6 2023-07-18T04:30:27 2023-07-18T04:25:24 Rev1 None None
ARM 0.69315 0.0 0.25 0.5 511.05 2023-08-21T20:20:27 2023-08-21T20:16:02 Rev1 :No Results::Missing Results: None
ARM 0.25299 0.32115 0.01459 0.99096 524.56 2023-08-21T21:20:28 2023-08-21T21:15:14 Rev1 None None
ARM 0.25299 0.32115 0.01459 0.99096 527.29 2023-08-21T23:20:27 2023-08-21T23:15:34 Rev1 None None
ARM 0.0885 0.03594 0.02108 0.99435 523.66 2023-08-22T01:50:27 2023-08-22T01:43:38 Rev1 None None
TrinitySRITrojAI-SBU 0.16705 0.03671 0.03519 0.98997 1436.22 2023-07-25T17:20:30 2023-07-25T17:14:49 Rev1 None None
TrinitySRITrojAI-SBU 0.15193 0.04164 0.03364 0.98874 1437.04 2023-07-28T23:40:30 2023-07-28T23:38:47 Rev1 None None
TrinitySRITrojAI-SBU 0.40943 0.03882 0.13495 0.86841 1385.66 2023-08-22T21:40:31 2023-08-22T21:33:51 Rev1 :Missing Results: None
TrinitySRITrojAI-SBU 0.40943 0.03882 0.13495 0.86841 1383.45 2023-08-22T23:40:31 2023-08-22T23:33:40 Rev1 :Missing Results: None
TrinitySRITrojAI-SBU 0.69315 0.0 0.25 0.5 2023-08-23T00:20:31 2023-08-23T00:19:25 Rev1 :No Results::Missing Results::Info File Missing: None
TrinitySRITrojAI-SBU 0.14763 0.03751 0.0313 0.99421 1434.31 2023-08-23T19:20:32 2023-08-23T19:11:58 Rev1 None None
TrinitySRITrojAI-SBU 0.15193 0.04164 0.03364 0.98874 1438.79 2023-08-23T21:10:32 2023-08-23T21:06:11 Rev1 None None
TrinitySRITrojAI-SBU 0.14558 0.03678 0.03122 0.99484 1433.25 2023-08-23T21:50:32 2023-08-23T21:48:17 Rev1 None None
TrinitySRITrojAI-SBU 0.14587 0.03701 0.03133 0.99492 1431.41 2023-08-23T22:30:32 2023-08-23T22:27:47 Rev1 None None
TrinitySRITrojAI-SBU 0.14617 0.03702 0.03146 0.99488 1439.55 2023-08-23T23:10:32 2023-08-23T23:08:09 Rev1 None None
TrinitySRITrojAI-SBU 0.14814 0.03764 0.03199 0.99474 1439.37 2023-08-24T00:12:26 2023-08-24T00:03:59 Rev1 None None
TrinitySRITrojAI-SBU 0.14814 0.03764 0.03199 0.99474 1440.49 2023-08-24T00:50:32 2023-08-24T00:45:52 Rev1 None None
ICSI-2 0.69315 0.0 0.25 0.5 2023-07-19T20:00:30 2023-07-19T19:51:45 Rev1 :No Results::Missing Results: :Schema Header:
ICSI-2 0.10257 0.02943 0.01897 0.99859 616.28 2023-07-19T21:20:31 2023-07-19T21:17:34 Rev1 None None
ICSI-2 0.69315 0.0 0.25 0.5 607.73 2023-08-05T00:50:33 2023-08-05T00:48:01 Rev1 None None
ICSI-2 0.10029 0.0293 0.01853 0.99855 608.43 2023-08-06T23:50:33 2023-08-06T23:41:13 Rev1 None None
ICSI-2 0.09312 0.02716 0.01656 0.99859 607.84 2023-08-07T04:30:32 2023-08-07T04:27:20 Rev1 None None
ICSI-2 0.09922 0.03167 0.01853 0.99862 598.53 2023-08-22T05:30:32 2023-08-22T05:30:00 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 2023-07-19T14:40:32 2023-07-19T14:31:42 Rev1 :No Results::Missing Results: :Schema Header:
TrinitySRITrojAI-BostonU 0.70969 0.02317 0.25814 0.5 1222.36 2023-07-19T23:40:32 2023-07-19T23:36:56 Rev1 None None
TrinitySRITrojAI-BostonU 0.69315 0.0 0.25 0.5 523.19 2023-07-25T23:40:33 2023-07-25T23:35:57 Rev1 :Result Parse::No Results::Missing Results: None
TrinitySRITrojAI-BostonU 1.16097 0.7043 0.04202 0.95798 526.06 2023-07-26T23:00:34 2023-07-26T22:54:28 Rev1 None