TrojAI Leaderboard

TrojAI Leaderboards

Click Here to Join the Competition!

Using machine learning, an artificial intelligence (AI) is trained on data, learns relationships in that data, and then is deployed to the world to operate on new data. The problem is that an adversary that can disrupt the training pipeline can insert Trojan behaviors into the AI. TrojAI’s goal is to detect Trojans hidden in trained AI models. This page is a leaderboard of how well different Trojan detectors work against a population of AIs with and without Trojans. Read more about the problem, see the full submission documentation, or get started with a free minimal example.

Submission container names must use the following format: "<Leaderboard Name>_<Data Split>_<Container Name>.simg"

Reload page to update tables. Content is pushed every 10 minutes. Timestamps are presented in UTC.

Last modified:

Evaluation Server Status

Nodes: idle; running; down.
Accepting Submissions:

Smoke Test Server Status

Nodes: idle; running; down.
Accepting Submissions:

object-detection-aug2022 image-classification-sep2022 cyber-pdf-dec2022 object-detection-feb2023 rl-lavaworld-jul2023 nlp-question-answering-aug2023 rl-randomized-lavaworld-aug2023 cyber-apk-nov2023
Archive
image-classification-jun2020 image-classification-aug2020 image-classification-dec2020 image-classification-feb2021 nlp-sentiment-classification-mar2021 nlp-sentiment-classification-apr2021 nlp-named-entity-recognition-may2021 nlp-question-answering-sep2021 nlp-summary-jan2022

Round 10 leaderboard for object detection August 2022.

Each AI is trained to perform Object Detection either using a single stage (SSD), or a two stage detector (Faster-RCNN). For those AIs that have been attacked, the presence of the pattern will cause the AI to reliably produce the wrong extractive answer. The Round 10 Training Data Download consists of 144 reference AIs (exactly 50% are poisoned) with example input data. More info here.

Example poisoned image, where the green evasion trigger on the zebra causes the box to dissapear. This image is drawn from COCO (image 117897.jpg).

train: The train dataset that is distributed with each round.
test: The test dataset that is sequestered/hidden, used for evaluation. Submissions here should be fully realized with complete schema and parameters.
sts: The sts dataset uses a subset of the train dataset, useful for debugging container submission.
holdout: The holdout dataset that is sequestered/hidden, used for holdout evaluation.
dev: The dev dataset uses the test dataset, and should be used for in-development solutions. Schemas must be valid, but do not need to be complete. Results do not count towards the program.

train test sts holdout dev

Required filename format: "object-detection-aug2022_train_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-aug2022, train: 144
Execution timeout (hh:mm:ss): 1 day, 12:00:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2022-09-21T13:10:04	performer	None	None	Ok	2022-09-21T13:01:18	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2022-09-23T05:40:05	performer	None	None	Ok	2022-09-23T05:32:01	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-10T18:22:41	performer	None	None	Ok	2023-10-10T18:21:49	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-07-23T03:30:11	performer	None	None	Ok	2023-07-23T03:23:45	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2022-09-20T19:20:07	performer	None	None	Ok	2022-09-20T19:16:36	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2022-10-06T22:50:10	performer	None	None	Ok	2022-10-06T22:41:58	0 d, 0 h, 0 m, 0 s
ARM	2022-10-03T07:30:13	performer	None	None	Ok	2022-10-03T07:25:28	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojai-example	2022-09-16T20:09:40	public	None	None	Ok	2022-09-16T20:05:28	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2022-10-17T18:40:21	performer	None	None	Ok	2022-10-17T18:34:26	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on Cross Entropy

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
trojai-example	0.96655	0.15787	0.32514	0.52537	2592.99	2022-09-16T20:09:40	2022-09-16T20:05:28	Rev1	None	None
TrinitySRITrojAI	0.1878	0.04885	0.04729	0.9864	16587.61	2022-09-23T05:40:05	2022-09-23T05:32:01	Rev1	None	None
Perspecta-PurdueRutgers	0.11633	0.07236	0.02431	0.98495	35208.11	2023-07-11T14:10:09	2023-07-11T14:08:09	Rev1	None	None
PL-GIFT	0.07819	0.03131	0.01695	0.99981	667.41	2023-10-10T04:40:11	2023-10-10T04:34:20	Rev1	None	None
Perspecta	0.30791	0.06677	0.09363	0.93962	55923.26	2022-09-21T13:10:04	2022-09-21T13:01:18	Rev1	None	None
Perspecta-IUB	0.28794	0.06866	0.09122	0.94956	4631.59	2022-09-20T19:20:07	2022-09-20T19:16:36	Rev1	None	None
ARM	0.44716	0.0774	0.151	0.8751	2595.77	2022-10-03T05:20:13	2022-10-03T05:16:26	Rev1	None	None
ARM-UCSD	0.41538	0.0547	0.13453	0.89612	19482.57	2022-10-06T22:50:10	2022-10-06T22:41:58	Rev1	None	None
UMBCb	0.31604	0.04107	0.08516	0.97357	1956.02	2022-10-17T18:40:21	2022-10-17T18:34:26	Rev1	:Container File Missing:	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
trojai-example	0.96655	0.15787	0.32514	0.52537	2592.99	2022-09-16T20:09:40	2022-09-16T20:05:28	Rev1	None	None
TrinitySRITrojAI	0.1878	0.04885	0.04729	0.9864	16587.61	2022-09-23T05:40:05	2022-09-23T05:32:01	Rev1	None	None
Perspecta-PurdueRutgers	0.11633	0.07236	0.02431	0.98495	35208.11	2023-07-11T14:10:09	2023-07-11T14:08:09	Rev1	None	None
Perspecta-PurdueRutgers	0.16639	0.05898	0.03222	0.97222	33575.19	2023-07-12T17:50:10	2023-07-12T17:44:13	Rev1	None	None
Perspecta-PurdueRutgers	0.29205	0.05908	0.07222	0.95833	31588.69	2023-07-23T03:30:11	2023-07-23T03:23:45	Rev1	None	None
PL-GIFT	0.11853	0.03474	0.0244	0.99605	1949.06	2023-02-14T16:50:07	2023-02-14T16:49:12	Rev1	None	None
PL-GIFT	0.10907	0.04427	0.02989	0.99508	701.95	2023-10-09T22:53:38	2023-10-09T22:44:59	Rev1	None	None
PL-GIFT	0.16498	0.04908	0.04589	0.99016	704.35	2023-10-10T00:50:11	2023-10-10T00:41:18	Rev1	None	None
PL-GIFT	0.13709	0.04442	0.03594	0.99334	699.12	2023-10-10T02:10:11	2023-10-10T02:07:13	Rev1	None	None
PL-GIFT	0.11084	0.04698	0.03097	0.99421	683.13	2023-10-10T03:50:12	2023-10-10T03:49:19	Rev1	None	None
PL-GIFT	0.07819	0.03131	0.01695	0.99981	667.41	2023-10-10T04:40:11	2023-10-10T04:34:20	Rev1	None	None
PL-GIFT	0.20466	0.0527	0.05458	0.98139	716.99	2023-10-10T05:22:40	2023-10-10T05:11:34	Rev1	None	None
PL-GIFT	0.13498	0.04525	0.03321	0.99277	714.66	2023-10-10T18:22:41	2023-10-10T18:21:49	Rev1	None	None
Perspecta	0.69068	0.00482	0.24883	0.50694	5997.8	2022-09-19T21:40:04	2022-09-19T21:31:36	Rev1	:Result Parse:	None
Perspecta	0.69315	0.0	0.25	0.5	875.54	2022-09-20T16:00:04	2022-09-20T15:52:03	Rev1	None	None
Perspecta	0.30791	0.06677	0.09363	0.93962	55923.26	2022-09-21T13:10:04	2022-09-21T13:01:18	Rev1	None	None
Perspecta-IUB	0.28794	0.06866	0.09122	0.94956	4631.59	2022-09-20T19:20:07	2022-09-20T19:16:36	Rev1	None	None
ARM	0.44716	0.0774	0.151	0.8751	2595.77	2022-10-03T05:20:13	2022-10-03T05:16:26	Rev1	None	None
ARM	0.51654	0.0708	0.17471	0.89082	2593.42	2022-10-03T07:30:13	2022-10-03T07:25:28	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	382.63	2022-09-19T19:10:07	2022-09-19T17:19:37	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	557.98	2022-09-19T23:30:07	2022-09-19T23:25:37	Rev1	None	None
ARM-UCSD	0.68683	0.00891	0.24721	0.51379	400.63	2022-09-19T23:50:34	2022-09-19T23:45:52	Rev1	None	None
ARM-UCSD	0.69889	0.02001	0.25175	0.50675	395.63	2022-09-20T03:50:07	2022-09-20T03:48:06	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	818.28	2022-09-20T16:10:04	2022-09-20T16:03:08	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	288.51	2022-09-20T16:30:28	2022-09-20T16:22:56	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T23:40:07	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T23:50:07	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:00:07	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:10:07	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:20:07	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:30:08	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:40:07	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:50:07	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:00:07	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:10:06	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:20:07	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:30:07	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:40:06	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:50:06	2022-09-20T23:32:15	Rev1	:Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T02:00:06	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.56854	0.08995	0.19865	0.78173	9436.56	2022-09-21T02:10:07	2022-09-20T23:32:15	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	1153.95	2022-10-04T04:20:09	2022-10-04T04:13:30	Rev1	None	None
ARM-UCSD	0.41538	0.0547	0.13453	0.89612	19482.57	2022-10-06T22:50:10	2022-10-06T22:41:58	Rev1	None	None
UMBCb	0.31604	0.04107	0.08516	0.97357	1956.02	2022-10-17T18:40:21	2022-10-17T18:34:26	Rev1	:Container File Missing:	None

Required filename format: "object-detection-aug2022_test_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-aug2022, test: 144
Execution timeout (hh:mm:ss): 1 day, 12:00:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2022-09-20T20:00:03	performer	None	None	Ok	2022-09-20T19:53:19	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2022-09-23T05:40:05	performer	None	None	Ok	2022-09-23T05:32:01	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-10T18:22:41	performer	None	None	Ok	2023-10-10T18:21:49	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-07-23T03:30:11	performer	None	Ok	Ok	2023-07-23T03:23:45	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2022-09-20T19:20:07	performer	None	None	Ok	2022-09-20T19:16:36	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2022-11-08T00:40:10	performer	None	None	Ok	2022-11-08T00:37:39	0 d, 0 h, 0 m, 0 s
ARM	2022-10-03T07:30:13	performer	None	Ok	Ok	2022-10-03T07:25:28	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojai-example	2022-09-20T18:30:09	public	None	Ok	Ok	2022-09-20T18:27:57	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2022-10-17T18:40:21	performer	None	None	Ok	2022-10-17T18:34:26	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on Cross Entropy

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
trojai-example	0.69315	0.0	0.25	0.5		2022-09-20T18:30:09	2022-09-20T18:27:57	Rev1	:Info File Missing:	None
TrinitySRITrojAI	0.39378	0.08799	0.12842	0.89902	6019.45	2022-09-09T20:00:01	2022-09-09T19:54:15	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.33308	0.08907	0.104	0.93808	662.89	2022-09-02T10:10:01	2022-09-02T10:03:39	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-PurdueRutgers	0.16787	0.09226	0.04146	0.96335	20369.45	2022-08-21T20:10:01	2022-08-21T20:01:40	Rev1	:Executed File Update::Log File Missing:	None
PL-GIFT	0.26366	0.09153	0.08257	0.96354	693.53	2023-10-09T22:53:38	2023-10-09T22:44:59	Rev1	None	None
Perspecta	0.38825	0.08085	0.12527	0.8914	55313.35	2022-09-20T20:00:03	2022-09-20T19:53:19	Rev1	None	None
TrinitySRITrojAI-SBU	0.44974	0.06643	0.14299	0.87953	1181.78	2022-09-04T19:40:01	2022-09-04T15:36:46	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.34531	0.0922	0.10788	0.92708	983.53	2022-09-02T05:00:01	2022-09-02T04:52:07	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-BostonU	0.44557	0.07967	0.14031	0.88349	11213.55	2022-08-23T14:30:01	2022-08-23T14:21:31	Rev1	:Executed File Update::Log File Missing:	None
ARM	0.62867	0.37593	0.15467	0.85957	2596.3	2022-10-03T06:20:13	2022-10-03T06:18:21	Rev1	None	None
ARM-UCSD	0.46467	0.05577	0.15539	0.85552	19518.63	2022-10-06T22:50:10	2022-10-06T22:41:58	Rev1	None	None
UMBCb	0.46014	0.06258	0.14668	0.87973	1947.54	2022-10-17T18:40:21	2022-10-17T18:34:26	Rev1	None	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
trojai-example	1.14219	0.20328	0.35385	0.47666	909.16	2022-07-28T01:30:07	2022-07-28T01:30:03	Rev1	:Executed File Update::Log File Missing:	None
trojai-example	0.95963	0.14719	0.32745	0.48563	2591.05	2022-09-16T20:09:40	2022-09-16T20:05:28	Rev1	None	None
trojai-example	0.69315	0.0	0.25	0.5		2022-09-20T18:30:09	2022-09-20T18:27:57	Rev1	:Info File Missing:	None
TrinitySRITrojAI	0.44557	0.07967	0.14031	0.88349	11072.36	2022-07-28T03:50:01	2022-07-28T03:46:36	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI	0.45826	0.14674	0.13468	0.88754	11567.63	2022-08-01T20:00:01	2022-08-01T19:51:21	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI	0.49569	0.0984	0.16507	0.83362	1261.47	2022-08-08T23:10:01	2022-08-08T23:08:01	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI	0.43343	0.06755	0.14125	0.86921	3937.95	2022-08-11T06:50:02	2022-08-11T06:41:58	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI	0.40207	0.10005	0.13224	0.90075	3942.27	2022-08-27T06:00:01	2022-08-27T05:58:46	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5		2022-09-06T22:50:01	2022-09-06T22:45:07	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
TrinitySRITrojAI	0.40557	0.10773	0.13063	0.89911	3927.8	2022-09-07T04:50:02	2022-09-07T04:34:50	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI	0.39378	0.08799	0.12842	0.89902	6019.45	2022-09-09T20:00:01	2022-09-09T19:54:15	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5		2022-09-20T18:20:04	2022-09-20T18:15:08	Rev1	:Info File Missing:	None
TrinitySRITrojAI	0.40958	0.0964	0.13166	0.89361	16610.22	2022-09-23T05:40:05	2022-09-23T05:32:01	Rev1	None	None
ICSI-2	0.48919	0.06161	0.16241	0.85031	535.05	2022-07-28T21:00:02	2022-07-28T20:56:51	Rev1	:Executed File Update::Log File Missing:	:Container Parameters (jsonschema checker):
ICSI-2	0.45518	0.0958	0.14463	0.86381	532.58	2022-07-29T23:20:01	2022-07-29T23:12:21	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.4023	0.0761	0.12481	0.90451	569.74	2022-08-03T03:20:01	2022-08-03T03:17:09	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.38275	0.07356	0.11598	0.91532	569.39	2022-08-05T00:40:01	2022-08-05T00:39:34	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.36983	0.07443	0.11192	0.92882	590.89	2022-08-09T01:00:01	2022-08-09T00:52:50	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.34072	0.08762	0.10681	0.93779	573.48	2022-08-09T07:00:02	2022-08-09T05:59:27	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.49614	0.20392	0.12848	0.92631	586.74	2022-08-09T23:50:01	2022-08-09T23:47:56	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.34129	0.09577	0.10844	0.9376	603.02	2022-08-10T22:50:02	2022-08-10T22:12:01	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.34132	0.08756	0.10686	0.93779	588.8	2022-08-11T05:30:02	2022-08-11T05:29:28	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.34523	0.09544	0.10873	0.9376	594.7	2022-08-11T21:30:01	2022-08-11T21:22:33	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.35496	0.08273	0.11088	0.92429	1185.1	2022-08-16T14:50:01	2022-08-16T14:49:40	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.33536	0.089	0.105	0.93808	593.21	2022-08-22T23:50:01	2022-08-22T23:41:20	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.33536	0.089	0.105	0.93808	594.83	2022-08-23T05:50:01	2022-08-23T00:03:15	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.3406	0.08354	0.10502	0.93412	591.03	2022-08-23T11:50:01	2022-08-23T07:14:37	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.33308	0.08907	0.104	0.93808	662.89	2022-09-02T10:10:01	2022-09-02T10:03:39	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-PurdueRutgers	0.24686	0.08555	0.05968	0.94049	20556.45	2022-07-29T01:00:02	2022-07-29T00:52:14	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-PurdueRutgers	0.23909	0.08514	0.05642	0.94126	20181.37	2022-08-19T23:20:01	2022-08-19T23:13:07	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-PurdueRutgers	0.24568	0.09897	0.05347	0.92612	20670.17	2022-08-20T21:40:02	2022-08-20T21:32:11	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-PurdueRutgers	0.16787	0.09226	0.04146	0.96335	20369.45	2022-08-21T20:10:01	2022-08-21T20:01:40	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-PurdueRutgers	0.16787	0.09226	0.04146	0.96335	33883.17	2023-07-11T14:10:09	2023-07-11T14:08:09	Rev1	None	None
Perspecta-PurdueRutgers	0.21217	0.07718	0.04889	0.95139	32870.19	2023-07-12T17:50:10	2023-07-12T17:44:13	Rev1	None	None
Perspecta-PurdueRutgers	0.32845	0.07137	0.08611	0.93403	31618.44	2023-07-23T03:30:11	2023-07-23T03:23:45	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5	242.71	2022-07-29T20:00:02	2022-07-29T19:44:36	Rev1	:Executed File Update::Log File Missing:	None
PL-GIFT	3.21884	1.36132	0.23092	0.74894	2887.89	2022-07-30T02:00:02	2022-07-29T22:41:27	Rev1	:Executed File Update::Log File Missing:	None
PL-GIFT	0.38316	0.08957	0.12258	0.90992	2654.61	2022-08-09T03:50:01	2022-08-09T03:42:13	Rev1	:Executed File Update::Log File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.42492	0.11866	0.13435	0.88657	2498.94	2022-08-20T16:30:02	2022-08-20T16:24:23	Rev1	:Executed File Update::Log File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.57207	0.16016	0.17005	0.82147	974.33	2022-08-25T23:20:01	2022-08-25T23:12:14	Rev1	:Executed File Update::Log File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.4778	0.12937	0.15503	0.8968	1925.54	2022-09-03T16:20:02	2022-09-03T16:16:06	Rev1	:Executed File Update::Log File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.4987	0.07674	0.17538	0.88262	1914.04	2022-09-03T22:20:02	2022-09-03T18:33:34	Rev1	:Executed File Update::Log File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.38923	0.07448	0.12435	0.91223	517.53	2022-09-07T20:40:02	2022-09-07T20:32:17	Rev1	:Executed File Update::Log File Missing:	None
PL-GIFT	0.37038	0.0686	0.11748	0.92033	541.24	2022-09-08T18:20:02	2022-09-08T18:17:57	Rev1	:Executed File Update::Log File Missing:	None
PL-GIFT	0.38372	0.06729	0.12096	0.91995	544.48	2022-09-09T00:20:02	2022-09-08T23:46:27	Rev1	:Executed File Update::Log File Missing:	None
PL-GIFT	0.45717	0.13378	0.13766	0.87375	1948.1	2023-02-14T16:50:07	2023-02-14T16:49:12	Rev1	None	None
PL-GIFT	0.26366	0.09153	0.08257	0.96354	693.53	2023-10-09T22:53:38	2023-10-09T22:44:59	Rev1	None	None
PL-GIFT	0.37865	0.10638	0.12004	0.90123	705.26	2023-10-10T00:50:11	2023-10-10T00:41:18	Rev1	None	None
PL-GIFT	0.30068	0.08934	0.09606	0.94772	701.37	2023-10-10T02:10:11	2023-10-10T02:07:13	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2023-10-10T03:20:11	2023-10-10T03:18:54	Rev1	:No Results::Missing Results:	:Container Parameters (jsonschema checker):
PL-GIFT	0.27922	0.10709	0.0855	0.95824	700.81	2023-10-10T03:50:12	2023-10-10T03:49:19	Rev1	None	None
PL-GIFT	0.38691	0.11987	0.12512	0.91609	669.57	2023-10-10T04:40:11	2023-10-10T04:34:20	Rev1	None	None
PL-GIFT	0.34414	0.07978	0.11045	0.92892	653.49	2023-10-10T05:22:40	2023-10-10T05:11:34	Rev1	None	None
PL-GIFT	0.30771	0.08723	0.09932	0.94416	722.18	2023-10-10T18:22:41	2023-10-10T18:21:49	Rev1	None	None
Perspecta	0.66321	0.02806	0.23535	0.61333	17442.4	2022-08-09T13:10:01	2022-08-09T13:04:43	Rev1	:Executed File Update::Log File Missing:	:Container Parameters (jsonschema checker):
Perspecta	0.6087	0.06574	0.20903	0.70737	24040.01	2022-08-30T00:40:02	2022-08-30T00:36:36	Rev1	:Executed File Update::Log File Missing:	:Container Parameters (jsonschema checker):
Perspecta	0.57544	0.06812	0.19543	0.7689	24217.35	2022-08-31T03:00:02	2022-08-31T02:55:12	Rev1	:Executed File Update::Log File Missing:	None
Perspecta	0.51267	0.08891	0.16341	0.79784	18676.66	2022-09-02T17:00:02	2022-09-02T16:59:06	Rev1	:Executed File Update::Log File Missing:	None
Perspecta	0.48061	0.07919	0.15509	0.83671	20922.93	2022-09-05T06:40:01	2022-09-05T06:32:24	Rev1	:Executed File Update::Log File Missing:	None
Perspecta	0.46803	0.07267	0.15087	0.84674	21076.29	2022-09-07T23:40:01	2022-09-07T23:39:31	Rev1	:Executed File Update::Log File Missing:	None
Perspecta	0.42916	0.08665	0.14171	0.84076	21315.05	2022-09-08T13:00:01	2022-09-08T12:57:41	Rev1	:Executed File Update::Log File Missing:	None
Perspecta	0.40836	0.07876	0.13245	0.87867	21297.73	2022-09-08T23:40:02	2022-09-08T23:32:13	Rev1	:Executed File Update::Log File Missing:	None
Perspecta	1.71484	0.38792	0.34274	0.72203	21329.54	2022-09-09T19:00:01	2022-09-09T18:53:06	Rev1	:Executed File Update::Log File Missing:	None
Perspecta	0.69315	0.0	0.25	0.5	569.95	2022-09-19T21:40:04	2022-09-19T21:31:36	Rev1	None	None
Perspecta	0.68092	0.0138	0.24509	0.52064	1137.85	2022-09-20T16:00:04	2022-09-20T15:52:03	Rev1	None	None
Perspecta	0.69315	0.0	0.25	0.5		2022-09-20T17:40:03	2022-09-20T17:31:14	Rev1	:Info File Missing:	None
Perspecta	0.38825	0.08085	0.12527	0.8914	55313.35	2022-09-20T20:00:03	2022-09-20T19:53:19	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	242.85	2022-08-11T00:50:02	2022-08-11T00:42:03	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-SBU	0.69018	0.02699	0.24895	0.55449	968.17	2022-08-11T16:30:01	2022-08-11T16:24:12	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-SBU	0.6859	0.05438	0.2487	0.84742	984.51	2022-08-19T01:40:02	2022-08-19T01:31:42	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	146.31	2022-09-02T02:30:01	2022-09-02T02:20:55	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	146.3	2022-09-02T16:00:01	2022-09-02T15:58:50	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-SBU	0.49163	0.05391	0.1645	0.8559	999.98	2022-09-02T23:50:02	2022-09-02T23:49:32	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-SBU	0.48748	0.06064	0.16207	0.85774	542.07	2022-09-03T16:40:02	2022-09-03T16:32:39	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	1000.01	2022-09-03T22:50:01	2022-09-03T17:58:57	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	997.4	2022-09-04T13:40:01	2022-09-04T13:32:50	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-SBU	0.44974	0.06643	0.14299	0.87953	1181.78	2022-09-04T19:40:01	2022-09-04T15:36:46	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-SBU	0.46014	0.06258	0.14668	0.87973	696.25	2022-09-05T04:20:01	2022-09-05T04:10:52	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2022-08-20T12:50:01	2022-08-20T05:20:27	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	242.65	2022-08-20T18:50:01	2022-08-20T14:09:27	Rev1	:Executed File Update::Log File Missing:	:Container Parameters (jsonschema checker):
Perspecta-IUB	0.38398	0.07422	0.12311	0.91291	943.14	2022-08-21T01:10:01	2022-08-21T01:09:36	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.38489	0.07559	0.12368	0.9076	1155.3	2022-08-21T07:10:02	2022-08-21T04:43:25	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.38368	0.08351	0.12466	0.90538	1157.16	2022-08-21T13:20:01	2022-08-21T10:35:53	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.38151	0.09405	0.12178	0.91358	1107.12	2022-08-21T19:20:02	2022-08-21T16:09:32	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	1.70346	0.88386	0.16209	0.8749	1110.03	2022-08-22T01:30:01	2022-08-21T21:31:52	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	1.2325	0.81994	0.1274	0.89352	1108.13	2022-08-22T07:30:02	2022-08-22T03:47:24	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.38299	0.07476	0.12332	0.91387	1104.07	2022-08-22T15:50:01	2022-08-22T15:44:02	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.38345	0.09579	0.12526	0.90847	915.39	2022-08-22T21:50:01	2022-08-22T17:33:07	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.7091	0.52659	0.12237	0.90693	1106.19	2022-08-23T03:50:02	2022-08-23T03:43:11	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.5462	0.37943	0.12211	0.90789	1103.9	2022-08-23T15:40:01	2022-08-23T15:36:57	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.46154	0.14162	0.14309	0.89265	982.75	2022-09-01T21:00:02	2022-09-01T20:53:07	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.34531	0.0922	0.10788	0.92708	983.53	2022-09-02T05:00:01	2022-09-02T04:52:07	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.3471	0.08301	0.10943	0.92593	980.65	2022-09-02T11:00:02	2022-09-02T05:24:14	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.37432	0.11724	0.11518	0.91358	956.17	2022-09-02T17:00:02	2022-09-02T14:32:45	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.37834	0.12218	0.11548	0.91657	1021.11	2022-09-03T00:30:02	2022-09-03T00:23:40	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.35561	0.09127	0.11384	0.92216	1633.86	2022-09-03T06:30:02	2022-09-03T04:12:11	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.35561	0.09127	0.11384	0.92216	4625.08	2022-09-20T19:20:07	2022-09-20T19:16:36	Rev1	None	None
TrinitySRITrojAI-BostonU	0.84611	0.09268	0.31589	0.5	11503.52	2022-08-22T16:30:01	2022-08-22T15:15:13	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-BostonU	0.84545	0.09245	0.31564	0.5	12486.37	2022-08-23T00:10:02	2022-08-22T23:53:29	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-BostonU	1.51843	0.27506	0.42086	0.6034	11137.86	2022-08-23T06:20:02	2022-08-23T04:01:32	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-BostonU	0.44557	0.07967	0.14031	0.88349	11213.55	2022-08-23T14:30:01	2022-08-23T14:21:31	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-BostonU	0.49831	0.10303	0.15791	0.84414	11119.38	2022-08-23T20:30:01	2022-08-23T17:55:58	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-BostonU	0.49946	0.04878	0.16172	0.86535	11116.17	2022-08-24T02:30:01	2022-08-24T00:09:32	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-BostonU	0.44557	0.07967	0.14031	0.88349	11469.17	2022-08-24T15:50:02	2022-08-24T15:42:02	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-BostonU	0.44557	0.07967	0.14031	0.88349	11790.8	2022-08-25T14:00:01	2022-08-25T13:50:19	Rev1	:Executed File Update::Log File Missing:	None
ARM	0.69315	0.0	0.25	0.5	868.0	2022-08-23T07:50:01	2022-08-23T09:18:28	Rev1	:Executed File Update::Log File Missing:	None
ARM	0.81852	0.08419	0.30396	0.46672	868.19	2022-08-23T19:20:01	2022-08-23T19:19:22	Rev1	:Executed File Update::Log File Missing:	None
ARM	0.87806	0.37656	0.26375	0.8342	870.05	2022-08-24T01:20:02	2022-08-23T20:13:57	Rev1	:Executed File Update::Log File Missing:	None
ARM	0.69315	0.0	0.25	0.5	868.06	2022-09-06T03:10:02	2022-09-06T03:02:06	Rev1	:Executed File Update::Log File Missing:	None
ARM	0.90598	0.37697	0.27668	0.83227	867.9	2022-09-06T09:20:01	2022-09-06T06:40:56	Rev1	:Executed File Update::Log File Missing:	None
ARM	0.67795	0.37716	0.17678	0.81395	868.02	2022-09-06T16:10:01	2022-09-06T16:04:10	Rev1	:Executed File Update::Log File Missing:	None
ARM	0.62867	0.37593	0.15467	0.85957	2596.3	2022-10-03T06:20:13	2022-10-03T06:18:21	Rev1	None	None
ARM	0.71323	0.37262	0.18769	0.87249	2597.16	2022-10-03T07:30:13	2022-10-03T07:25:28	Rev1	None	None
ARM-UCSD	0.52751	0.09885	0.18077	0.81375	3439.11	2022-09-02T06:10:01	2022-09-02T06:02:30	Rev1	:Executed File Update::Log File Missing:	None
ARM-UCSD	0.56404	0.10495	0.19593	0.77951	3452.26	2022-09-02T21:10:02	2022-09-02T21:35:08	Rev1	:Executed File Update::Log File Missing:	None
ARM-UCSD	0.55948	0.09147	0.19342	0.76399	3440.33	2022-09-03T06:00:01	2022-09-03T05:55:52	Rev1	:Executed File Update::Log File Missing:	None
ARM-UCSD	0.69054	0.00509	0.24878	0.50694	8959.98	2022-09-19T19:10:07	2022-09-19T17:19:37	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	708.34	2022-09-19T23:30:08	2022-09-19T23:25:22	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	712.03	2022-09-19T23:50:35	2022-09-19T23:45:47	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	650.04	2022-09-20T03:50:08	2022-09-20T03:48:13	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	615.03	2022-09-20T16:30:29	2022-09-20T16:23:30	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T22:20:07	2022-09-20T22:14:55	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T22:30:07	2022-09-20T22:14:55	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T22:40:07	2022-09-20T22:14:55	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T22:50:07	2022-09-20T22:14:55	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T23:00:07	2022-09-20T22:14:55	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T23:10:07	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T23:20:07	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T23:30:06	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T23:40:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T23:50:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:00:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:10:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:20:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:30:09	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:40:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:50:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:00:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:10:07	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:20:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:30:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:40:07	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:50:07	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T02:00:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.62893	0.09361	0.22448	0.70804	9334.92	2022-09-21T02:10:08	2022-09-20T23:08:46	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	1155.89	2022-10-04T04:20:10	2022-10-04T04:13:40	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	1154.27	2022-10-04T23:10:10	2022-10-04T23:07:45	Rev1	None	None
ARM-UCSD	0.46467	0.05577	0.15539	0.85552	19518.63	2022-10-06T22:50:10	2022-10-06T22:41:58	Rev1	None	None
ARM-UCSD	0.66841	0.0274	0.23736	0.63677	34424.14	2022-11-02T05:40:11	2022-11-02T05:35:09	Rev1	None	:Container Parameters (jsonschema checker):
ARM-UCSD	0.48031	0.0513	0.16388	0.82128	34260.63	2022-11-08T00:40:10	2022-11-08T00:37:39	Rev1	None	:Container Parameters (jsonschema checker):
UMBCb	0.69315	0.0	0.25	0.5	865.64	2022-10-16T21:00:23	2022-10-16T20:57:55	Rev1	None	None
UMBCb	0.46014	0.06258	0.14668	0.87973	1947.54	2022-10-17T18:40:21	2022-10-17T18:34:26	Rev1	None	None

Required filename format: "object-detection-aug2022_sts_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-aug2022, sts: 10
Execution timeout (hh:mm:ss): 2:30:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2022-09-20T16:20:03	performer	None	None	Ok	2022-09-20T16:15:49	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2022-09-22T23:30:05	performer	None	None	Ok	2022-09-22T23:24:44	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-10T17:00:11	performer	None	None	Ok	2023-10-10T16:59:04	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-07-11T03:10:11	performer	None	None	Ok	2023-07-11T03:00:58	0 d, 0 h, 0 m, 0 s
Perspecta-IUB		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2022-11-08T00:40:11	performer	None	None	Ok	2022-11-08T00:37:31	0 d, 0 h, 0 m, 0 s
ARM		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojai-example	2022-10-05T15:10:17	public	None	Ok	Ok	2022-10-05T14:59:32	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2022-10-17T18:20:22	performer	None	None	Ok	2022-10-17T18:16:50	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on Cross Entropy

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
trojai-example	0.51567	0.25566	0.17866	0.83333	180.51	2022-10-05T15:10:17	2022-10-05T14:59:32	Rev1	None	None
TrinitySRITrojAI	0.29559	0.27212	0.0956	0.95833	1180.67	2022-09-22T23:30:05	2022-09-22T23:24:44	Rev1	None	None
Perspecta-PurdueRutgers	0.40105	0.67933	0.09634	0.875	2887.14	2023-07-11T03:10:11	2023-07-11T03:00:58	Rev1	None	None
PL-GIFT	0.07871	0.06551	0.01247	1.0	55.36	2023-10-09T22:20:11	2023-10-09T22:15:40	Rev1	None	None
Perspecta	0.59455	0.133	0.21041	0.6875	1144.68	2022-09-20T16:20:03	2022-09-20T16:15:49	Rev1	None	None
ARM-UCSD	0.42054	0.15442	0.1275	1.0	1502.36	2022-10-06T22:50:11	2022-10-06T22:41:50	Rev1	None	None
UMBCb	0.43737	0.21442	0.14229	0.83333	135.39	2022-10-17T18:20:22	2022-10-17T18:16:50	Rev1	None	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
trojai-example	0.69315	0.0	0.25	0.5	0.55	2022-09-16T16:49:12	2022-09-16T16:28:58	Rev1	:Container File Missing:	:Copy Out:
trojai-example	0.69315	0.0	0.25	0.5	50.15	2022-09-16T18:15:25	2022-09-16T16:28:58	Rev1	None	None
trojai-example	0.69315	0.0	0.25	0.5	50.16	2022-09-16T18:41:59	2022-09-16T16:28:58	Rev1	None	None
trojai-example	0.69315	0.0	0.25	0.5	50.15	2022-09-16T18:55:49	2022-09-16T16:28:58	Rev1	None	None
trojai-example	0.69315	0.0	0.25	0.5		2022-09-16T19:31:19	2022-09-16T16:28:58	Rev1	:Executed File Update::Info File Missing::Container File Missing:	None
trojai-example	0.69315	0.0	0.25	0.5	131.51	2022-09-16T19:33:25	2022-09-16T16:28:58	Rev1	None	None
trojai-example	1.24928	0.79595	0.38884	0.52083	179.93	2022-09-16T19:39:51	2022-09-16T16:28:58	Rev1	None	None
trojai-example	0.85088	0.56821	0.27957	0.625	180.06	2022-09-16T19:53:23	2022-09-16T16:28:58	Rev1	None	None
trojai-example	0.9125	0.55567	0.30594	0.58333	179.98	2022-09-16T20:13:46	2022-09-16T16:28:58	Rev1	None	None
trojai-example	0.87033	0.39561	0.32378	0.5	179.9	2022-09-20T18:30:10	2022-09-20T18:27:48	Rev1	None	None
trojai-example	0.63804	0.42147	0.21279	0.70833	181.61	2022-10-05T14:20:19	2022-10-05T14:14:26	Rev1	:Container File Missing:	None
trojai-example	1.59808	0.6812	0.52814	0.08333	180.31	2022-10-05T14:50:16	2022-10-05T14:41:53	Rev1	:Container File Missing:	None
trojai-example	0.51567	0.25566	0.17866	0.83333	180.51	2022-10-05T15:10:17	2022-10-05T14:59:32	Rev1	None	None
TrinitySRITrojAI	0.29559	0.27212	0.0956	0.95833	1180.67	2022-09-22T23:30:05	2022-09-22T23:24:44	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2023-07-11T01:30:11	2023-07-11T01:29:30	Rev1	:No Results::Missing Results::Container File Missing:	:Container Parameters (jsonschema checker):
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2023-07-11T02:10:11	2023-07-11T02:08:26	Rev1	:No Results::Missing Results::Container File Missing:	:Container Parameters (jsonschema checker):
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2023-07-11T02:40:10	2023-07-11T02:34:26	Rev1	:No Results::Missing Results::Container File Missing:	:Schema Header:
Perspecta-PurdueRutgers	0.40105	0.67933	0.09634	0.875	2887.14	2023-07-11T03:10:11	2023-07-11T03:00:58	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2023-01-25T14:40:10	2023-01-25T14:32:44	Rev1	:No Results::Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.69315	0.0	0.25	0.5		2023-02-02T23:50:08	2023-02-02T23:49:18	Rev1	:No Results::Container File Missing:	:Container Parameters (learned parameters)::Container Parameters (jsonschema checker):
PL-GIFT	0.69315	0.0	0.25	0.5		2023-02-10T15:50:07	2023-02-10T15:45:32	Rev1	:No Results::Container File Missing:	:Container Parameters (learned parameters):
PL-GIFT	0.69315	0.0	0.25	0.5	71.66	2023-02-10T16:50:08	2023-02-10T16:48:51	Rev1	:No Results:	None
PL-GIFT	0.69315	0.0	0.25	0.5	100.31	2023-02-10T18:20:07	2023-02-10T18:17:02	Rev1	:No Results:	None
PL-GIFT	0.69315	0.0	0.25	0.5	144.0	2023-02-10T19:40:06	2023-02-10T19:35:33	Rev1	:No Results:	None
PL-GIFT	0.14231	0.05954	0.02343	1.0	134.51	2023-02-14T16:20:07	2023-02-14T16:17:22	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5	29.06	2023-10-06T20:50:11	2023-10-06T20:42:12	Rev1	:No Results::Missing Results:	None
PL-GIFT	0.69315	0.0	0.25	0.5	29.22	2023-10-06T21:42:38	2023-10-06T21:41:57	Rev1	:No Results::Missing Results:	None
PL-GIFT	0.69315	0.0	0.25	0.5	37.07	2023-10-09T21:00:11	2023-10-09T20:56:15	Rev1	:No Results::Missing Results:	None
PL-GIFT	0.07871	0.06551	0.01247	1.0	55.36	2023-10-09T22:20:11	2023-10-09T22:15:40	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2023-10-10T03:50:13	2023-10-10T03:49:02	Rev1	:No Results::Missing Results::Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.21279	0.1519	0.06207	1.0	56.62	2023-10-10T17:00:11	2023-10-10T16:59:04	Rev1	None	None
Perspecta	0.86773	0.77126	0.24779	0.625	1800.55	2022-09-19T19:10:03	2022-09-19T13:43:43	Rev1	None	:Timeout:
Perspecta	0.59455	0.133	0.21041	0.6875	1144.68	2022-09-20T16:20:03	2022-09-20T16:15:49	Rev1	None	None
ARM-UCSD	0.51516	0.28617	0.16466	0.79167	650.68	2022-09-19T23:40:06	2022-09-19T23:30:09	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T00:00:53	2022-09-19T23:45:42	Rev1	:Info File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	392.48	2022-09-20T16:30:30	2022-09-20T16:27:42	Rev1	None	None
ARM-UCSD	0.46552	0.16004	0.14563	0.97917	649.66	2022-09-20T17:50:06	2022-09-20T17:43:39	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	79.93	2022-10-05T20:20:10	2022-10-05T20:16:53	Rev1	None	None
ARM-UCSD	0.42054	0.15442	0.1275	1.0	1502.36	2022-10-06T22:50:11	2022-10-06T22:41:50	Rev1	None	None
ARM-UCSD	0.6713	0.09389	0.23895	0.45833	2690.42	2022-11-02T05:40:12	2022-11-02T05:35:19	Rev1	None	:Container Parameters (jsonschema checker):
ARM-UCSD	0.46868	0.15856	0.14981	0.9375	2724.25	2022-11-08T00:40:11	2022-11-08T00:37:31	Rev1	None	:Container Parameters (jsonschema checker):
UMBCb	0.69315	0.0	0.25	0.5	60.27	2022-10-17T14:50:22	2022-10-17T14:46:23	Rev1	None	None
UMBCb	0.69315	0.0	0.25	0.5	60.01	2022-10-17T16:20:21	2022-10-17T16:16:54	Rev1	None	None
UMBCb	0.69315	0.0	0.25	0.5	60.11	2022-10-17T17:10:22	2022-10-17T17:02:12	Rev1	None	None
UMBCb	0.43737	0.21442	0.14229	0.83333	135.39	2022-10-17T18:20:22	2022-10-17T18:16:50	Rev1	None	None

Required filename format: "object-detection-aug2022_holdout_<Submission Name>.simg"
Accepting submissions: False
Number of models in object-detection-aug2022, holdout: 144
Execution timeout (hh:mm:ss): 1 day, 12:00:00

Teams/Jobs

Team	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	performer	None	None	Ok	2022-09-20T19:53:19	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	performer	None	None	Ok	2022-09-23T05:32:01	0 d, 0 h, 0 m, 0 s
DRAFFT	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	performer	None	None	Ok	2022-09-20T19:16:36	0 d, 0 h, 0 m, 0 s
ARM-UCSD	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UMBC	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojai-example	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IceTorch	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PASS	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on Cross Entropy

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
TrinitySRITrojAI	0.34193	0.09211	0.11231	0.92785	9247.52	2022-08-27T06:00:01	2022-08-27T05:58:46	Rev1	:Executed File Update:	:Cleanup:
ICSI-2	0.33164	0.09464	0.10578	0.9457	1665.71	2022-08-23T05:50:01	2022-08-23T00:03:15	Rev1	:Executed File Update:	None
Perspecta-PurdueRutgers	0.29129	0.13131	0.07822	0.92033	51374.46	2022-08-21T20:10:01	2022-08-21T20:01:40	Rev1	:Executed File Update:	None
PL-GIFT	0.35137	0.06594	0.11234	0.92921	1521.68	2022-09-09T00:20:02	2022-09-08T23:46:27	Rev1	:Executed File Update:	None
Perspecta	0.3146	0.07024	0.09687	0.93403	53539.44	2022-09-20T20:00:03	2022-09-20T19:53:19	Rev1	None	:Cleanup:
TrinitySRITrojAI-SBU	0.38251	0.05547	0.11542	0.93287	3312.27	2022-09-04T19:40:01	2022-09-04T15:36:46	Rev1	:Executed File Update:	None
Perspecta-IUB	0.33807	0.07182	0.11561	0.92024	2800.66	2022-09-02T11:00:02	2022-09-02T05:24:14	Rev1	:Executed File Update:	None
TrinitySRITrojAI-BostonU	0.46373	0.07871	0.15107	0.86121	4846.82	2022-08-25T14:00:01	2022-08-25T13:50:19	Rev1	:Executed File Update:	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
TrinitySRITrojAI	0.46254	0.07874	0.15057	0.86265	5302.79	2022-07-28T03:50:01	2022-07-28T03:46:36	Rev1	:Executed File Update:	:Cleanup:
TrinitySRITrojAI	0.55614	0.16702	0.16426	0.84606	4994.49	2022-08-01T20:00:01	2022-08-01T19:51:21	Rev1	:Executed File Update:	:Cleanup:
TrinitySRITrojAI	0.39268	0.08522	0.12732	0.90181	3501.73	2022-08-08T23:10:01	2022-08-08T23:08:01	Rev1	:Executed File Update:	:Cleanup:
TrinitySRITrojAI	0.38327	0.06971	0.11866	0.9158	9072.04	2022-08-11T06:50:02	2022-08-11T06:41:58	Rev1	:Executed File Update:	:Cleanup:
TrinitySRITrojAI	0.34193	0.09211	0.11231	0.92785	9247.52	2022-08-27T06:00:01	2022-08-27T05:58:46	Rev1	:Executed File Update:	:Cleanup:
TrinitySRITrojAI	0.37083	0.10742	0.11905	0.9239	9210.02	2022-09-07T04:50:02	2022-09-07T04:34:50	Rev1	:Executed File Update:	:Cleanup:
TrinitySRITrojAI	0.38787	0.10167	0.12221	0.89988	15769.88	2022-09-09T20:00:01	2022-09-09T19:54:15	Rev1	:Executed File Update:	:Cleanup:
TrinitySRITrojAI	0.38999	0.10317	0.12272	0.90866	15906.08	2022-09-23T05:40:05	2022-09-23T05:32:01	Rev1	None	:Cleanup:
ICSI-2	0.48649	0.06557	0.1607	0.894	1524.68	2022-07-28T21:00:02	2022-07-28T20:56:51	Rev1	:Executed File Update:	:Container Parameters (jsonschema checker):
ICSI-2	0.40334	0.08355	0.12805	0.9076	1624.97	2022-07-29T23:20:01	2022-07-29T23:12:21	Rev1	:Executed File Update:	None
ICSI-2	0.38377	0.07245	0.1197	0.92747	1590.65	2022-08-03T03:20:01	2022-08-03T03:17:09	Rev1	:Executed File Update:	None
ICSI-2	0.37457	0.07378	0.11572	0.92853	1637.77	2022-08-05T00:40:01	2022-08-05T00:39:34	Rev1	:Executed File Update:	None
ICSI-2	0.35959	0.07624	0.11021	0.93895	1733.94	2022-08-09T01:00:01	2022-08-09T00:52:50	Rev1	:Executed File Update:	None
ICSI-2	0.34165	0.09282	0.10993	0.94358	1646.77	2022-08-09T07:00:02	2022-08-09T05:59:27	Rev1	:Executed File Update:	None
ICSI-2	0.52083	0.21233	0.13648	0.92978	1772.23	2022-08-09T23:50:01	2022-08-09T23:47:56	Rev1	:Executed File Update:	None
ICSI-2	0.34975	0.10279	0.11354	0.93981	1681.95	2022-08-10T22:50:02	2022-08-10T22:12:01	Rev1	:Executed File Update:	None
ICSI-2	0.34379	0.09267	0.11025	0.9428	1637.77	2022-08-11T05:30:02	2022-08-11T05:29:28	Rev1	:Executed File Update:	None
ICSI-2	0.35473	0.10238	0.11388	0.93818	1765.15	2022-08-11T21:30:01	2022-08-11T21:22:33	Rev1	:Executed File Update:	None
ICSI-2	0.34055	0.08735	0.1068	0.93972	2086.22	2022-08-16T14:50:01	2022-08-16T14:49:40	Rev1	:Executed File Update:	None
ICSI-2	0.34224	0.09618	0.11019	0.94252	1689.84	2022-08-22T23:50:01	2022-08-22T23:41:20	Rev1	:Executed File Update:	None
ICSI-2	0.33164	0.09464	0.10578	0.9457	1665.71	2022-08-23T05:50:01	2022-08-23T00:03:15	Rev1	:Executed File Update:	None
ICSI-2	0.34175	0.08927	0.10837	0.94232	1775.17	2022-08-23T11:50:01	2022-08-23T07:14:37	Rev1	:Executed File Update:	None
ICSI-2	0.33198	0.09391	0.10664	0.94599	1934.52	2022-09-02T10:10:01	2022-09-02T10:03:39	Rev1	:Executed File Update:	None
Perspecta-PurdueRutgers	0.35093	0.11059	0.09703	0.87789	52594.69	2022-07-29T01:00:02	2022-07-29T00:52:14	Rev1	:Executed File Update:	None
Perspecta-PurdueRutgers	0.34166	0.11264	0.09257	0.87539	52752.66	2022-08-19T23:20:01	2022-08-19T23:13:07	Rev1	:Executed File Update:	None
Perspecta-PurdueRutgers	0.32377	0.11454	0.08314	0.87558	52821.91	2022-08-20T21:40:02	2022-08-20T21:32:11	Rev1	:Executed File Update:	None
Perspecta-PurdueRutgers	0.29129	0.13131	0.07822	0.92033	51374.46	2022-08-21T20:10:01	2022-08-21T20:01:40	Rev1	:Executed File Update:	None
PL-GIFT	0.37879	0.10794	0.1179	0.91204	2495.98	2022-08-09T03:50:01	2022-08-09T03:42:13	Rev1	:Executed File Update:	:Container Parameters (jsonschema checker)::Cleanup:
PL-GIFT	0.44755	0.13221	0.13604	0.89159	2489.37	2022-08-20T16:30:02	2022-08-20T16:24:23	Rev1	:Executed File Update:	:Container Parameters (jsonschema checker)::Cleanup:
PL-GIFT	0.46114	0.13969	0.14312	0.90191	2440.2	2022-09-03T16:20:02	2022-09-03T16:16:06	Rev1	:Executed File Update:	:Container Parameters (jsonschema checker)::Cleanup:
PL-GIFT	0.49975	0.12266	0.16015	0.88185	2352.8	2022-09-03T22:20:02	2022-09-03T18:33:34	Rev1	:Executed File Update:	:Container Parameters (jsonschema checker):
PL-GIFT	0.38056	0.07568	0.12486	0.91435	1423.4	2022-09-07T20:40:02	2022-09-07T20:32:17	Rev1	:Executed File Update:	None
PL-GIFT	0.35618	0.06955	0.11671	0.91744	1506.59	2022-09-08T18:20:02	2022-09-08T18:17:57	Rev1	:Executed File Update:	None
PL-GIFT	0.35137	0.06594	0.11234	0.92921	1521.68	2022-09-09T00:20:02	2022-09-08T23:46:27	Rev1	:Executed File Update:	None
Perspecta	0.41019	0.07279	0.1261	0.87307	51947.72	2022-09-05T06:40:01	2022-09-05T06:32:24	Rev1	:Executed File Update:	:Cleanup:
Perspecta	0.39859	0.06019	0.12254	0.91001	53091.01	2022-09-07T23:40:01	2022-09-07T23:39:31	Rev1	:Executed File Update:	:Cleanup:
Perspecta	0.37932	0.07821	0.12492	0.88069	53263.27	2022-09-08T13:00:01	2022-09-08T12:57:41	Rev1	:Executed File Update:	:Cleanup:
Perspecta	0.31846	0.0604	0.0964	0.93682	54015.82	2022-09-08T23:40:02	2022-09-08T23:32:13	Rev1	:Executed File Update:	:Cleanup:
Perspecta	0.3146	0.07024	0.09687	0.93403	53539.44	2022-09-20T20:00:03	2022-09-20T19:53:19	Rev1	None	:Cleanup:
TrinitySRITrojAI-SBU	0.47247	0.05356	0.15479	0.9103	2877.61	2022-09-02T23:50:02	2022-09-02T23:49:32	Rev1	:Executed File Update:	None
TrinitySRITrojAI-SBU	0.48047	0.06418	0.15882	0.89323	1566.92	2022-09-03T16:40:02	2022-09-03T16:32:39	Rev1	:Executed File Update:	None
TrinitySRITrojAI-SBU	0.38251	0.05547	0.11542	0.93287	3312.27	2022-09-04T19:40:01	2022-09-04T15:36:46	Rev1	:Executed File Update:	None
TrinitySRITrojAI-SBU	0.41837	0.06148	0.12781	0.90856	1913.21	2022-09-05T04:20:01	2022-09-05T04:10:52	Rev1	:Executed File Update:	None
Perspecta-IUB	0.39707	0.07793	0.13217	0.89728	2724.53	2022-08-21T01:10:01	2022-08-21T01:09:36	Rev1	:Executed File Update:	None
Perspecta-IUB	0.39766	0.07717	0.13371	0.89448	3329.47	2022-08-21T07:10:02	2022-08-21T04:43:25	Rev1	:Executed File Update:	None
Perspecta-IUB	0.39908	0.0848	0.1358	0.89448	3300.45	2022-08-21T13:20:01	2022-08-21T10:35:53	Rev1	:Executed File Update:	None
Perspecta-IUB	0.39354	0.0924	0.13299	0.90008	3196.38	2022-08-21T19:20:02	2022-08-21T16:09:32	Rev1	:Executed File Update:	None
Perspecta-IUB	0.39662	0.07565	0.13317	0.89497	3135.08	2022-08-22T15:50:01	2022-08-22T15:44:02	Rev1	:Executed File Update:	None
Perspecta-IUB	0.40333	0.10126	0.13752	0.89757	2585.21	2022-08-22T21:50:01	2022-08-22T17:33:07	Rev1	:Executed File Update:	None
Perspecta-IUB	0.47426	0.14006	0.15223	0.89159	2808.51	2022-09-01T21:00:02	2022-09-01T20:53:07	Rev1	:Executed File Update:	None
Perspecta-IUB	0.34869	0.07776	0.12052	0.9159	2847.77	2022-09-02T05:00:01	2022-09-02T04:52:07	Rev1	:Executed File Update:	None
Perspecta-IUB	0.33807	0.07182	0.11561	0.92024	2800.66	2022-09-02T11:00:02	2022-09-02T05:24:14	Rev1	:Executed File Update:	None
Perspecta-IUB	0.38533	0.10376	0.13302	0.90992	2797.7	2022-09-02T17:00:02	2022-09-02T14:32:45	Rev1	:Executed File Update:	None
Perspecta-IUB	0.38954	0.10647	0.13406	0.90924	2883.67	2022-09-03T00:30:02	2022-09-03T00:23:40	Rev1	:Executed File Update:	None
Perspecta-IUB	0.3635	0.0833	0.12673	0.9102	4471.47	2022-09-03T06:30:02	2022-09-03T04:12:11	Rev1	:Executed File Update:	None
Perspecta-IUB	0.36022	0.08343	0.12573	0.91252	4553.35	2022-09-20T19:20:07	2022-09-20T19:16:36	Rev1	None	None
TrinitySRITrojAI-BostonU	0.46472	0.07862	0.15138	0.86034	4904.72	2022-08-23T14:30:01	2022-08-23T14:21:31	Rev1	:Executed File Update:	None
TrinitySRITrojAI-BostonU	0.49977	0.09807	0.16339	0.83922	4879.33	2022-08-23T20:30:01	2022-08-23T17:55:58	Rev1	:Executed File Update:	None
TrinitySRITrojAI-BostonU	0.50821	0.05585	0.16422	0.85774	4924.92	2022-08-24T02:30:01	2022-08-24T00:09:32	Rev1	:Executed File Update:	None
TrinitySRITrojAI-BostonU	0.46531	0.07855	0.15148	0.86053	4919.53	2022-08-24T15:50:02	2022-08-24T15:42:02	Rev1	:Executed File Update:	None
TrinitySRITrojAI-BostonU	0.46373	0.07871	0.15107	0.86121	4846.82	2022-08-25T14:00:01	2022-08-25T13:50:19	Rev1	:Executed File Update:	None

Required filename format: "object-detection-aug2022_dev_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-aug2022, dev: 144
Execution timeout (hh:mm:ss): 1 day, 0:00:00

Teams/Jobs

Team	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DRAFFT	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UCSD	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UMBC	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojai-example	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IceTorch	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PASS	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on Cross Entropy

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors

Round 11 leaderboard for image classification September 2022.

Each AI is trained to perform image classification. For those AIs that have been attacked, the presence of the trigger pattern will cause the AI to reliably produce the wrong prediction. The Round 11 Training Data Download consists of 288 reference AIs (exactly 50% are poisoned) with example input data. More info here.

Example poisoned image, where the purple polygon trigger on the street sign causes misclassification.

train: The train dataset that is distributed with each round.
test: The test dataset that is sequestered/hidden, used for evaluation. Submissions here should be fully realized with complete schema and parameters.
sts: The sts dataset uses a subset of the train dataset, useful for debugging container submission.
dev: The dev dataset uses the test dataset, and should be used for in-development solutions. Schemas must be valid, but do not need to be complete. Results do not count towards the program.

train test sts dev

Required filename format: "image-classification-sep2022_train_<Submission Name>.simg"
Accepting submissions: True
Number of models in image-classification-sep2022, train: 288
Execution timeout (hh:mm:ss): 2 days, 0:00:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2022-12-16T20:20:05	performer	None	None	Ok	2022-12-16T20:11:50	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-02-11T00:50:06	performer	None	None	Ok	2023-02-11T00:41:33	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-10T17:00:12	performer	None	None	Ok	2023-10-10T16:58:42	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-02-14T15:40:09	performer	None	None	Ok	2023-02-14T15:35:48	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2022-10-15T04:00:30	performer	None	None	Ok	2022-10-14T21:09:47	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2022-12-13T20:02:37	performer	None	None	Ok	2022-12-13T18:42:57	0 d, 0 h, 0 m, 0 s
ARM	2023-04-04T18:00:16	performer	None	None	Ok	2023-04-04T18:00:08	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	2022-12-14T22:01:34	performer	None	None	Ok	2022-12-14T21:06:01	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2022-12-15T07:10:21	performer	None	None	Ok	2022-12-15T07:07:27	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-01-20T21:40:24	performer	None	None	Ok	2023-01-20T21:31:11	0 d, 0 h, 0 m, 0 s
trojai-example	2022-09-21T17:30:13	public	None	None	Ok	2022-09-21T17:28:50	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS	2022-12-01T15:01:55	public	None	None	Ok	2022-12-01T13:44:48	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2022-11-04T14:43:29	performer	None	None	Ok	2022-11-03T20:20:40	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on Cross Entropy

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.00676	0.00086	0.0001	1.0	2981.53	2022-12-15T22:10:05	2022-12-15T21:55:42	Rev1	None	None
TrinitySRITrojAI	0.26087	0.03077	0.0695	0.98257	19119.35	2023-02-11T00:50:06	2023-02-11T00:41:33	Rev1	None	None
PL-GIFT	0.01005	0.0	0.0001	1.0	1530.02	2023-10-09T23:15:49	2023-10-09T23:01:38	Rev1	None	None
Perspecta-PurdueRutgers	0.0059	0.00281	0.00056	1.0	4245.64	2023-02-12T22:30:08	2023-02-12T22:25:15	Rev1	None	None
Perspecta-IUB	0.01537	0.0062	0.00234	1.0	42205.08	2022-10-08T02:30:09	2022-10-08T02:23:53	Rev1	None	None
ARM-UCSD	0.45631	0.09297	0.13778	0.84028	5883.57	2022-10-07T18:20:09	2022-10-07T18:15:51	Rev1	None	None
ARM	0.36728	0.059	0.11325	0.92089	2487.37	2023-04-04T18:00:16	2023-04-04T18:00:08	Rev1	None	None
TrinitySRITrojAI-SBU	0.12277	0.00989	0.01743	1.0	3874.3	2022-12-14T22:01:34	2022-12-14T21:06:01	Rev1	None	None
ICSI-2	0.01882	0.00204	0.00064	1.0	3748.12	2022-11-14T23:30:19	2022-11-14T23:23:54	Rev1	None	None
TrinitySRITrojAI-BostonU	0.27732	0.09457	0.07082	0.94637	5473.0	2022-12-06T22:10:22	2022-12-06T22:08:09	Rev1	None	None
trojai-example	0.95798	0.09962	0.32408	0.47912	3412.55	2022-09-21T17:30:13	2022-09-21T17:28:50	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5	14666.41	2022-11-29T02:30:30	2022-11-29T02:30:04	Rev1	:No Results:	None
UMBCb	0.49955	0.02726	0.16128	0.89157	3656.39	2022-10-31T19:10:23	2022-10-31T19:00:37	Rev1	None	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.6652	0.04391	0.23816	0.64374	2984.18	2022-10-13T03:30:03	2022-10-13T03:20:12	Rev1	None	None
Perspecta	0.80193	0.1474	0.237	0.70083	2855.94	2022-10-18T05:20:03	2022-10-18T05:11:57	Rev1	:Container File Missing:	None
Perspecta	1.33425	0.17995	0.38552	0.50388	2720.75	2022-10-18T17:30:03	2022-10-18T17:23:07	Rev1	:Container File Missing:	None
Perspecta	0.65184	0.04655	0.23064	0.65635	2715.51	2022-10-19T00:00:04	2022-10-18T23:56:57	Rev1	:Container File Missing:	None
Perspecta	0.62086	0.04185	0.21855	0.69739	2720.72	2022-10-19T18:10:04	2022-10-19T18:02:05	Rev1	:Container File Missing:	None
Perspecta	0.62212	0.04065	0.21871	0.69307	2697.39	2022-10-19T21:00:04	2022-10-19T20:53:59	Rev1	:Container File Missing:	None
Perspecta	0.59835	0.04744	0.20777	0.74074	2698.45	2022-10-19T23:40:03	2022-10-19T23:33:06	Rev1	:Container File Missing:	None
Perspecta	0.21427	0.05219	0.06112	0.97234	2831.66	2022-10-26T14:40:04	2022-10-26T14:32:03	Rev1	:Container File Missing:	None
Perspecta	0.12382	0.03737	0.02857	0.9919	2773.57	2022-10-27T00:50:03	2022-10-27T00:44:13	Rev1	:Container File Missing:	None
Perspecta	0.26149	0.12254	0.04851	0.96945	2764.53	2022-10-27T04:20:03	2022-10-27T04:15:11	Rev1	:Container File Missing:	None
Perspecta	0.18326	0.04828	0.05197	0.9816	2785.87	2022-10-27T15:40:04	2022-10-27T15:38:34	Rev1	:Container File Missing:	None
Perspecta	0.09854	0.03075	0.02451	0.99785	2762.58	2022-10-28T23:30:03	2022-10-28T23:22:21	Rev1	:Container File Missing:	None
Perspecta	0.11793	0.03488	0.03162	0.99696	2807.55	2022-11-02T18:04:43	2022-11-02T17:56:09	Rev1	None	None
Perspecta	0.11007	0.03466	0.02755	0.99614	2864.94	2022-11-07T21:10:05	2022-11-07T21:04:58	Rev1	None	None
Perspecta	0.09311	0.03294	0.02288	0.99725	2842.02	2022-11-15T04:00:04	2022-11-15T03:50:54	Rev1	None	None
Perspecta	0.07973	0.0299	0.02103	0.99916	2874.05	2022-11-16T01:20:04	2022-11-16T01:16:33	Rev1	None	None
Perspecta	0.05764	0.01556	0.01155	1.0	2874.81	2022-11-16T19:00:04	2022-11-16T18:58:52	Rev1	None	None
Perspecta	0.09848	0.03445	0.02498	0.99749	2866.06	2022-11-16T21:10:04	2022-11-16T21:09:20	Rev1	None	None
Perspecta	0.10029	0.01762	0.0194	1.0	2884.42	2022-11-17T22:30:04	2022-11-17T22:23:07	Rev1	None	None
Perspecta	0.09066	0.03062	0.02072	0.99904	2881.75	2022-11-22T05:20:04	2022-11-22T05:17:14	Rev1	None	None
Perspecta	0.10967	0.03244	0.02618	0.99508	2700.33	2022-11-22T07:30:04	2022-11-22T07:22:56	Rev1	None	None
Perspecta	0.06669	0.01045	0.00978	1.0	14760.75	2022-11-29T07:40:04	2022-11-29T07:38:19	Rev1	None	None
Perspecta	0.08064	0.02369	0.01815	0.99959	14762.07	2022-11-29T15:50:05	2022-11-29T15:43:06	Rev1	None	None
Perspecta	0.06829	0.02055	0.01398	1.0	14762.68	2022-11-30T20:00:04	2022-11-30T19:50:09	Rev1	None	None
Perspecta	0.08309	0.00683	0.00886	1.0	14907.68	2022-12-01T05:20:04	2022-12-01T05:16:29	Rev1	None	None
Perspecta	0.08545	0.00708	0.00926	1.0	15082.17	2022-12-01T16:50:09	2022-12-01T16:48:02	Rev1	None	None
Perspecta	0.08545	0.00708	0.00926	1.0	3681.39	2022-12-04T00:00:05	2022-12-02T03:25:52	Rev1	None	None
Perspecta	0.08577	0.00682	0.00912	1.0	4218.69	2022-12-05T20:20:04	2022-12-05T20:15:11	Rev1	None	None
Perspecta	0.07317	0.00588	0.00686	1.0	3549.95	2022-12-06T22:20:04	2022-12-06T22:10:11	Rev1	None	None
Perspecta	0.06083	0.00526	0.00506	1.0	3550.17	2022-12-07T17:00:04	2022-12-07T16:55:59	Rev1	None	None
Perspecta	0.06199	0.0053	0.00519	1.0	3540.36	2022-12-08T16:00:05	2022-12-08T15:58:05	Rev1	None	None
Perspecta	0.07189	0.00577	0.00661	1.0	3559.78	2022-12-13T04:50:05	2022-12-13T04:43:43	Rev1	None	None
Perspecta	0.07189	0.00577	0.00661	1.0	3790.52	2022-12-13T06:40:04	2022-12-13T06:33:35	Rev1	None	None
Perspecta	0.05412	0.00591	0.00463	1.0	3838.64	2022-12-13T16:00:04	2022-12-13T15:56:25	Rev1	None	None
Perspecta	0.69315	0.0	0.25	0.5		2022-12-13T21:50:05	2022-12-13T20:15:00	Rev1	:No Results::Info File Missing::Container File Missing:	None
Perspecta	0.69315	0.0	0.25	0.5		2022-12-14T00:40:04	2022-12-14T00:39:29	Rev1	:No Results::Info File Missing::Container File Missing:	None
Perspecta	0.15641	0.0192	0.03243	0.99932	3869.33	2022-12-14T17:30:05	2022-12-14T17:24:00	Rev1	None	None
Perspecta	0.07129	0.00614	0.00674	1.0	3795.97	2022-12-14T19:00:05	2022-12-14T18:55:54	Rev1	None	None
Perspecta	0.06694	0.00561	0.00592	1.0	3547.04	2022-12-15T01:20:05	2022-12-15T01:18:57	Rev1	None	None
Perspecta	0.00711	0.00099	0.00012	1.0	2981.85	2022-12-15T06:20:04	2022-12-15T06:11:21	Rev1	None	None
Perspecta	0.00676	0.00086	0.0001	1.0	2981.53	2022-12-15T22:10:05	2022-12-15T21:55:42	Rev1	None	None
Perspecta	0.00827	0.00154	0.00023	1.0	2981.53	2022-12-16T15:10:05	2022-12-16T15:00:48	Rev1	None	None
Perspecta	0.00683	0.00104	0.00012	1.0	2983.06	2022-12-16T20:20:05	2022-12-16T20:11:50	Rev1	None	None
TrinitySRITrojAI	0.32043	0.02606	0.08708	0.9809	9235.16	2022-09-30T20:50:05	2022-09-30T20:43:42	Rev1	None	None
TrinitySRITrojAI	0.54917	0.02553	0.18469	0.85156	9342.89	2022-10-07T08:40:06	2022-10-07T08:37:36	Rev1	None	None
TrinitySRITrojAI	0.49442	0.05732	0.16598	0.81554	25912.92	2022-10-08T05:20:06	2022-10-08T05:19:38	Rev1	None	None
TrinitySRITrojAI	0.47598	0.05011	0.16215	0.81542	58631.5	2022-10-17T08:50:06	2022-10-17T08:43:17	Rev1	:Container File Missing:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	2511.06	2022-11-17T18:50:05	2022-11-17T18:40:23	Rev1	:No Results:	None
TrinitySRITrojAI	0.58453	0.05725	0.19929	0.76078	64127.18	2022-11-18T00:00:55	2022-11-17T23:59:38	Rev1	None	None
TrinitySRITrojAI	0.50605	0.07226	0.16571	0.83341	115875.25	2022-12-13T01:10:06	2022-12-13T01:04:46	Rev1	None	None
TrinitySRITrojAI	0.33744	0.05843	0.10514	0.92361	170469.96	2023-01-18T17:20:06	2023-01-18T17:13:22	Rev1	None	None
TrinitySRITrojAI	0.26087	0.03077	0.0695	0.98257	19119.35	2023-02-11T00:50:06	2023-02-11T00:41:33	Rev1	None	None
PL-GIFT	0.05384	0.00709	0.00561	1.0	1936.0	2022-09-23T22:10:06	2022-09-23T22:01:36	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2022-10-12T15:10:08	2022-10-12T15:01:57	Rev1	:Info File Missing::Container File Missing:	None
PL-GIFT	0.06802	0.00735	0.00743	1.0	15352.97	2022-10-13T12:00:07	2022-10-13T11:55:39	Rev1	None	None
PL-GIFT	0.05165	0.01306	0.00939	1.0	1922.36	2022-10-14T18:20:08	2022-10-14T18:18:21	Rev1	None	None
PL-GIFT	0.05165	0.01306	0.00939	1.0	1914.95	2022-10-15T05:10:18	2022-10-15T01:10:08	Rev1	None	None
PL-GIFT	0.04584	0.01273	0.00858	1.0	2499.8	2022-10-25T23:40:07	2022-10-25T23:31:47	Rev1	:Container File Missing:	None
PL-GIFT	0.10749	0.02444	0.02664	0.99993	2016.56	2022-11-04T23:30:07	2022-11-04T23:20:37	Rev1	None	None
PL-GIFT	0.03642	0.01337	0.00779	0.99983	2499.44	2022-11-07T17:10:08	2022-11-07T17:10:02	Rev1	None	None
PL-GIFT	0.1386	0.0348	0.03823	0.9891	2483.46	2022-11-09T23:10:08	2022-11-09T23:03:07	Rev1	None	None
PL-GIFT	0.02219	0.00408	0.00143	1.0	2494.6	2022-11-11T19:20:07	2022-11-11T19:19:08	Rev1	None	None
PL-GIFT	0.02552	0.0107	0.00512	1.0	2494.44	2022-11-11T23:10:07	2022-11-11T23:09:05	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2022-11-15T17:40:09	2022-11-15T17:33:52	Rev1	:No Results::Info File Missing::Container File Missing:	None
PL-GIFT	0.69315	0.0	0.25	0.5		2022-11-15T20:20:45	2022-11-15T20:17:08	Rev1	:No Results::Info File Missing::Container File Missing:	None
PL-GIFT	0.06478	0.02366	0.01772	0.99995	2465.8	2022-11-15T23:50:08	2022-11-15T23:45:59	Rev1	None	None
PL-GIFT	0.0119	0.001	0.00021	1.0	2596.85	2022-12-15T15:50:08	2022-12-15T15:46:42	Rev1	None	None
PL-GIFT	0.0119	0.001	0.00021	1.0	2682.49	2022-12-20T19:08:06	2022-12-20T18:19:32	Rev1	None	None
PL-GIFT	0.01005	0.0	0.0001	1.0	1530.02	2023-10-09T23:15:49	2023-10-09T23:01:38	Rev1	None	None
PL-GIFT	0.02806	0.00781	0.00379	1.0	1544.88	2023-10-10T03:50:14	2023-10-10T03:46:34	Rev1	None	None
PL-GIFT	0.01005	0.0	0.0001	1.0	1538.39	2023-10-10T04:40:13	2023-10-10T04:36:35	Rev1	None	None
PL-GIFT	0.016	0.00232	0.0006	1.0	1551.86	2023-10-10T05:54:05	2023-10-10T05:49:55	Rev1	None	None
PL-GIFT	0.03438	0.01015	0.00581	1.0	1556.47	2023-10-10T14:30:13	2023-10-10T14:25:23	Rev1	None	None
PL-GIFT	0.11644	0.02551	0.02917	0.99735	1421.75	2023-10-10T15:22:02	2023-10-10T15:15:59	Rev1	None	None
PL-GIFT	0.01231	0.00125	0.00026	1.0	1433.13	2023-10-10T17:00:12	2023-10-10T16:58:42	Rev1	None	None
Perspecta-PurdueRutgers	0.3668	0.08189	0.10528	0.88129	100934.45	2022-10-03T08:20:08	2022-10-03T08:18:13	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.39643	0.08497	0.11582	0.871	101643.48	2022-10-04T22:40:07	2022-10-04T22:39:49	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.39643	0.08497	0.11582	0.871	101635.92	2022-10-06T23:30:22	2022-10-05T19:54:06	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.43815	0.08725	0.13387	0.87461	66302.31	2022-10-14T10:00:08	2022-10-14T09:52:56	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.46545	0.09003	0.14429	0.86574	126878.95	2022-10-15T15:20:09	2022-10-15T15:12:56	Rev1	:Container File Missing:	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.25688	0.07209	0.06897	0.9396	76308.23	2022-10-18T06:50:22	2022-10-18T06:41:35	Rev1	:Container File Missing:	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.29374	0.06724	0.07936	0.92559	78379.77	2022-10-24T01:40:09	2022-10-24T01:34:56	Rev1	:Container File Missing:	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.43148	0.02807	0.13377	0.92836	2981.71	2022-11-04T15:20:09	2022-11-04T15:17:23	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.91194		2022-11-04T20:40:10	2022-11-04T20:30:10	Rev1	:No Results::Info File Missing::Container File Missing:	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.9362		2022-11-06T21:00:08	2022-11-06T20:52:56	Rev1	:No Results::Info File Missing::Container File Missing:	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2022-11-08T19:40:09	2022-11-08T19:33:41	Rev1	:No Results::Info File Missing::Container File Missing:	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2022-11-11T17:20:08	2022-11-11T17:17:24	Rev1	:No Results::Info File Missing::Container File Missing:	None
Perspecta-PurdueRutgers	0.43884	0.06778	0.14517	0.87389	2567.7	2022-11-15T23:30:10	2022-11-15T23:21:05	Rev1	None	None
Perspecta-PurdueRutgers	0.93707	0.45288	0.14834	0.85335	2553.35	2022-11-16T05:00:08	2022-11-16T04:53:47	Rev1	None	None
Perspecta-PurdueRutgers	0.45463	0.06882	0.14889	0.86601	2549.1	2022-11-16T16:40:09	2022-11-16T16:36:52	Rev1	None	None
Perspecta-PurdueRutgers	0.43417	0.07036	0.14703	0.86601	2561.35	2022-11-17T02:00:07	2022-11-17T01:55:49	Rev1	None	None
Perspecta-PurdueRutgers	0.43178	0.07048	0.14644	0.86601	2502.94	2022-11-17T03:10:07	2022-11-17T03:09:26	Rev1	None	None
Perspecta-PurdueRutgers	0.41234	0.06165	0.14182	0.86789	2556.15	2022-11-17T04:41:19	2022-11-17T04:34:55	Rev1	None	None
Perspecta-PurdueRutgers	0.43116	0.04782	0.14813	0.85214	2508.91	2022-11-19T00:30:08	2022-11-18T21:26:33	Rev1	None	None
Perspecta-PurdueRutgers	0.42961	0.04791	0.14768	0.85214	2506.02	2022-11-19T02:01:15	2022-11-19T01:55:52	Rev1	None	None
Perspecta-PurdueRutgers	0.43561	0.04748	0.14917	0.85214	2519.24	2022-11-19T04:20:08	2022-11-19T04:10:44	Rev1	None	None
Perspecta-PurdueRutgers	2.2046	0.73973	0.19988	0.79514	2655.9	2022-12-10T03:50:08	2022-12-10T03:46:14	Rev1	None	None
Perspecta-PurdueRutgers	0.42526	0.04278	0.14598	0.85581	2648.54	2022-12-10T15:24:54	2022-12-10T14:40:50	Rev1	None	None
Perspecta-PurdueRutgers	0.32271	0.04188	0.11464	0.90806	2492.82	2022-12-11T16:40:09	2022-12-11T16:38:53	Rev1	None	None
Perspecta-PurdueRutgers	0.34056	0.0408	0.1184	0.90803	2491.88	2022-12-11T18:00:08	2022-12-11T18:00:18	Rev1	None	None
Perspecta-PurdueRutgers	0.30558	0.0381	0.10536	0.92704	2981.12	2022-12-11T21:50:09	2022-12-11T21:45:59	Rev1	None	None
Perspecta-PurdueRutgers	0.27909	0.03636	0.09492	0.94444	2496.9	2022-12-12T04:00:08	2022-12-12T03:53:37	Rev1	None	None
Perspecta-PurdueRutgers	0.34297	0.03023	0.10271	0.94444	2495.89	2022-12-12T06:20:08	2022-12-12T06:15:01	Rev1	None	None
Perspecta-PurdueRutgers	0.49666	0.03487	0.17468	0.76365	2497.62	2022-12-12T21:50:09	2022-12-12T21:09:20	Rev1	None	None
Perspecta-PurdueRutgers	0.18362	0.1916	0.02894	0.98905	4302.94	2023-02-06T02:00:08	2023-02-06T01:57:01	Rev1	None	None
Perspecta-PurdueRutgers	0.48216	0.03681	0.17301	0.76157	3335.57	2023-02-09T21:20:10	2023-02-09T21:15:24	Rev1	None	None
Perspecta-PurdueRutgers	0.48547	0.03766	0.17372	0.76374	3390.32	2023-02-09T22:30:10	2023-02-09T22:27:54	Rev1	None	None
Perspecta-PurdueRutgers	0.46307	0.0376	0.16676	0.77778	3176.61	2023-02-12T02:30:09	2023-02-12T02:29:10	Rev1	None	None
Perspecta-PurdueRutgers	0.46556	0.03723	0.167	0.77778	3641.39	2023-02-12T04:10:09	2023-02-12T04:02:07	Rev1	None	None
Perspecta-PurdueRutgers	0.0059	0.00281	0.00056	1.0	4245.64	2023-02-12T22:30:08	2023-02-12T22:25:15	Rev1	None	None
Perspecta-PurdueRutgers	0.02781	0.01691	0.00747	0.99986	4209.3	2023-02-13T00:40:09	2023-02-13T00:38:47	Rev1	None	None
Perspecta-PurdueRutgers	0.02801	0.01691	0.00749	0.99986	4242.56	2023-02-14T15:40:09	2023-02-14T15:35:48	Rev1	None	None
Perspecta-IUB	0.24616	0.0205	0.06302	1.0	49831.94	2022-10-06T23:40:09	2022-10-06T23:35:08	Rev1	None	None
Perspecta-IUB	0.23145	0.01981	0.0576	0.99995	41884.97	2022-10-07T14:00:09	2022-10-07T03:35:32	Rev1	None	None
Perspecta-IUB	0.01537	0.0062	0.00234	1.0	42205.08	2022-10-08T02:30:09	2022-10-08T02:23:53	Rev1	None	None
Perspecta-IUB	0.02305	0.01443	0.00543	0.99981	41364.65	2022-10-08T12:40:31	2022-10-08T04:37:48	Rev1	None	None
Perspecta-IUB	0.33401	0.00656	0.08135	0.99995	41703.38	2022-10-08T21:40:30	2022-10-08T18:08:16	Rev1	None	None
Perspecta-IUB	0.3314	0.00559	0.08016	1.0	41492.89	2022-10-09T06:30:35	2022-10-08T23:24:10	Rev1	None	None
Perspecta-IUB	0.22543	0.01824	0.05413	1.0	42087.76	2022-10-09T17:40:08	2022-10-09T17:30:28	Rev1	None	None
Perspecta-IUB	0.16931	0.0255	0.04101	0.99443	44000.76	2022-10-10T02:30:33	2022-10-09T22:35:57	Rev1	None	None
Perspecta-IUB	0.10872	0.02994	0.03099	0.9947	42151.94	2022-10-10T15:20:09	2022-10-10T15:11:15	Rev1	None	None
Perspecta-IUB	0.12328	0.02697	0.03342	0.9953	5536.52	2022-10-11T00:10:31	2022-10-10T18:15:05	Rev1	None	None
Perspecta-IUB	0.18142	0.02512	0.04338	0.99429	5557.0	2022-10-11T02:20:08	2022-10-11T02:13:19	Rev1	None	None
Perspecta-IUB	0.16654	0.0229	0.0383	0.9972	6644.42	2022-10-11T03:40:31	2022-10-11T03:02:15	Rev1	None	None
Perspecta-IUB	0.17701	0.02285	0.04105	0.99713	6695.53	2022-10-11T17:40:09	2022-10-11T17:23:06	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2022-10-11T19:20:09	2022-10-11T19:13:18	Rev1	:Info File Missing::Container File Missing:	None
Perspecta-IUB	0.20619	0.018	0.0461	0.99988	54700.54	2022-10-12T21:00:20	2022-10-12T18:57:51	Rev1	None	None
Perspecta-IUB	0.2183	0.01802	0.05042	0.99995	53655.09	2022-10-13T09:40:24	2022-10-12T23:53:26	Rev1	None	None
Perspecta-IUB	0.21104	0.01674	0.04715	1.0	54386.04	2022-10-14T01:50:10	2022-10-13T23:08:43	Rev1	None	None
Perspecta-IUB	0.2008	0.01702	0.04374	1.0	54506.62	2022-10-14T13:20:33	2022-10-14T06:51:18	Rev1	None	None
Perspecta-IUB	0.19169	0.01818	0.04159	0.9999	54738.46	2022-10-15T04:00:30	2022-10-14T21:09:47	Rev1	None	None
ARM-UCSD	0.55305	0.079	0.18167	0.79167	5683.8	2022-10-07T06:10:11	2022-10-07T06:05:34	Rev1	None	None
ARM-UCSD	0.45631	0.09297	0.13778	0.84028	5883.57	2022-10-07T18:20:09	2022-10-07T18:15:51	Rev1	None	None
ARM-UCSD	0.60889	0.10666	0.19333	0.77083	32650.77	2022-10-12T21:00:21	2022-10-11T23:57:30	Rev1	None	None
ARM-UCSD	1.20397	0.12688	0.41	0.5	3367.51	2022-11-01T16:10:12	2022-11-01T16:04:02	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-12-13T18:50:13	2022-12-13T18:42:57	Rev1	:No Results::Info File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-12-13T18:50:14	2022-12-13T18:50:47	Rev1	:No Results::Info File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-12-13T20:02:37	2022-12-13T18:42:57	Rev1	:Executed File Update::No Results::Info File Missing::Container File Missing:	None
ARM	0.69315	0.0	0.25	0.5	1829.04	2022-10-03T07:00:12	2022-10-03T06:55:39	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5	2936.19	2022-10-04T18:40:14	2022-10-04T18:31:54	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5	3178.67	2022-10-12T21:40:11	2022-10-12T21:36:43	Rev1	None	None
ARM	0.64633	0.01447	0.22789	0.66112	3180.82	2022-10-17T18:20:10	2022-10-17T18:11:32	Rev1	:Container File Missing:	None
ARM	0.69315	0.0	0.25	0.5	2695.53	2022-11-01T05:50:13	2022-11-01T06:58:02	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5	2702.23	2022-11-01T19:20:12	2022-11-01T19:16:09	Rev1	None	None
ARM	0.52828	0.04556	0.17645	0.8255	4134.8	2022-11-01T21:10:13	2022-11-01T21:08:20	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5	2700.2	2022-11-02T00:10:51	2022-11-01T19:16:09	Rev1	None	None
ARM	0.59672	0.02598	0.20403	0.78106	14892.7	2022-11-28T05:10:15	2022-11-28T05:03:33	Rev1	None	None
ARM	0.36728	0.059	0.11325	0.92089	2487.37	2023-04-04T18:00:16	2023-04-04T18:00:08	Rev1	None	None
TrinitySRITrojAI-SBU	0.2078	0.03321	0.06981	0.99841	14851.38	2022-11-29T18:50:17	2022-11-29T18:45:10	Rev1	None	None
TrinitySRITrojAI-SBU	0.14241	0.02393	0.04022	1.0	3079.61	2022-12-12T23:41:20	2022-12-12T23:38:50	Rev1	None	None
TrinitySRITrojAI-SBU	0.16352	0.01118	0.02766	1.0	3290.81	2022-12-13T02:50:17	2022-12-13T02:45:02	Rev1	None	None
TrinitySRITrojAI-SBU	0.16017	0.01098	0.02667	1.0	3582.24	2022-12-13T16:52:58	2022-12-13T16:44:35	Rev1	None	None
TrinitySRITrojAI-SBU	0.12277	0.00989	0.01743	1.0	3874.3	2022-12-14T22:01:34	2022-12-14T21:06:01	Rev1	None	None
ICSI-2	0.10749	0.00514	0.01166	1.0	6585.41	2022-09-26T03:50:13	2022-09-26T03:43:51	Rev1	None	None
ICSI-2	0.44762	0.04697	0.15718	0.84279	3512.36	2022-10-03T02:00:14	2022-10-03T01:59:58	Rev1	None	None
ICSI-2	0.05754	0.00475	0.00447	1.0	3426.85	2022-10-04T04:50:25	2022-10-04T04:43:13	Rev1	None	None
ICSI-2	0.05952	0.00476	0.00468	1.0	4259.7	2022-10-10T09:10:15	2022-10-10T09:09:08	Rev1	None	None
ICSI-2	0.05835	0.00673	0.00583	1.0	3935.69	2022-10-11T20:20:14	2022-10-11T20:11:37	Rev1	None	None
ICSI-2	0.08364	0.01985	0.01835	0.99867	4349.12	2022-10-13T01:30:13	2022-10-13T01:30:01	Rev1	None	None
ICSI-2	0.13076	0.02471	0.03505	0.99542	3984.43	2022-10-14T01:50:16	2022-10-13T20:29:39	Rev1	None	None
ICSI-2	0.16264	0.02676	0.04563	0.9947	3960.36	2022-10-14T23:20:22	2022-10-14T23:17:14	Rev1	None	None
ICSI-2	0.1081	0.02084	0.02548	0.99853	3952.7	2022-10-15T21:00:12	2022-10-15T20:53:16	Rev1	None	None
ICSI-2	0.17996	0.06299	0.05036	0.98563	3959.79	2022-10-16T05:40:13	2022-10-16T05:34:41	Rev1	None	None
ICSI-2	0.0405	0.00575	0.00349	1.0	4134.71	2022-10-25T21:20:13	2022-10-25T21:15:59	Rev1	:Container File Missing:	None
ICSI-2	0.04095	0.00654	0.00403	1.0	4612.87	2022-10-26T06:40:13	2022-10-26T06:40:02	Rev1	:Container File Missing:	None
ICSI-2	0.03098	0.00397	0.00195	1.0	3758.06	2022-11-09T18:50:18	2022-11-09T18:48:31	Rev1	None	None
ICSI-2	0.01882	0.00204	0.00064	1.0	3748.12	2022-11-14T23:30:19	2022-11-14T23:23:54	Rev1	None	None
ICSI-2	0.01882	0.00204	0.00064	1.0	3749.14	2022-11-15T03:20:58	2022-11-15T03:15:09	Rev1	None	None
ICSI-2	0.69315	0.0	0.25	0.5		2022-11-22T11:00:19	2022-11-22T10:58:01	Rev1	:No Results::Info File Missing::Container File Missing:	None
ICSI-2	0.69315	0.0	0.25	0.5		2022-11-23T00:30:20	2022-11-23T00:27:50	Rev1	:No Results::Info File Missing::Container File Missing:	None
ICSI-2	0.0626	0.01323	0.01152	1.0	84630.15	2022-11-23T23:10:19	2022-11-23T23:07:52	Rev1	None	None
ICSI-2	0.69315	0.0	0.25	0.5		2022-12-13T06:22:17	2022-12-13T06:17:44	Rev1	:No Results::Info File Missing::Container File Missing:	None
ICSI-2	0.69315	0.0	0.25	0.5		2022-12-14T05:20:20	2022-12-14T05:19:51	Rev1	:No Results::Info File Missing::Container File Missing:	None
ICSI-2	0.04395	0.01095	0.00711	0.99995	7244.01	2022-12-15T07:10:21	2022-12-15T07:07:27	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	1539.44	2022-10-18T15:20:15	2022-10-18T15:11:05	Rev1	:Container File Missing:	None
TrinitySRITrojAI-BostonU	0.60027	0.02818	0.20945	0.68981	4557.63	2022-10-29T07:10:14	2022-10-29T07:05:21	Rev1	:Container File Missing:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2022-10-31T20:10:16	2022-10-31T20:01:29	Rev1	:Executed File Update::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.56018	0.05892	0.18865	0.81862	9466.89	2022-10-31T22:10:15	2022-10-31T22:07:23	Rev1	:Log File Missing:	None
TrinitySRITrojAI-BostonU	0.56018	0.05892	0.18865	0.81862	9545.42	2022-11-01T08:30:53	2022-11-01T08:15:11	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69325	0.00164	0.25005	0.5	9534.94	2022-11-01T21:20:48	2022-11-01T21:13:17	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	8e-05	0.25	0.5	9745.25	2022-11-02T02:00:18	2022-11-02T01:53:52	Rev1	None	None
TrinitySRITrojAI-BostonU	0.79041	0.06774	0.28707	0.56855	9477.14	2022-11-02T07:10:20	2022-11-02T07:04:36	Rev1	None	None
TrinitySRITrojAI-BostonU	0.80599	0.06542	0.29317	0.5244	9565.26	2022-11-02T18:30:21	2022-11-02T18:13:50	Rev1	None	None
TrinitySRITrojAI-BostonU	0.56018	0.05892	0.18865	0.81862	9509.69	2022-11-03T03:40:21	2022-11-03T03:36:00	Rev1	None	None
TrinitySRITrojAI-BostonU	0.56018	0.05892	0.18865	0.81862	9603.86	2022-11-06T20:04:14	2022-11-06T16:40:19	Rev1	None	None
TrinitySRITrojAI-BostonU	0.56018	0.05892	0.18865	0.81862	9661.45	2022-11-07T23:21:17	2022-11-07T22:00:00	Rev1	None	None
TrinitySRITrojAI-BostonU	0.56018	0.05892	0.18865	0.81862	9682.3	2022-11-15T17:00:27	2022-11-15T16:57:31	Rev1	None	None
TrinitySRITrojAI-BostonU	0.60361	0.02366	0.20746	0.77361	9525.36	2022-11-15T19:51:44	2022-11-15T17:57:00	Rev1	None	None
TrinitySRITrojAI-BostonU	2.3362	0.27657	0.48692	0.49653	5481.1	2022-12-05T20:01:37	2022-12-05T19:44:51	Rev1	None	None
TrinitySRITrojAI-BostonU	0.27732	0.09457	0.07082	0.94637	5473.0	2022-12-06T22:10:22	2022-12-06T22:08:09	Rev1	None	None
TrinitySRITrojAI-BostonU	0.76753	0.52443	0.02778	0.94809	3033.72	2022-12-10T01:10:22	2022-12-10T01:04:54	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	1806.56	2022-12-13T18:10:18	2022-12-13T18:03:31	Rev1	:No Results:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	2020.68	2023-01-20T21:40:24	2023-01-20T21:31:11	Rev1	:No Results:	None
trojai-example	0.95798	0.09962	0.32408	0.47912	3412.55	2022-09-21T17:30:13	2022-09-21T17:28:50	Rev1	None	None
IIECAS	12.3764	1.58693	0.44792	0.11073	7560.93	2022-11-17T12:30:29	2022-11-17T12:21:16	Rev1	None	None
IIECAS	1.09716	0.12628	0.37111	0.54861	116013.04	2022-11-18T12:20:26	2022-11-18T12:12:28	Rev1	None	None
IIECAS	1.00561	0.1248	0.33778	0.59028	64116.48	2022-11-27T14:00:30	2022-11-27T13:58:29	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5	14666.41	2022-11-29T02:30:30	2022-11-29T02:30:04	Rev1	:No Results:	None
IIECAS	1.02087	0.12511	0.34333	0.58333	66585.78	2022-11-30T04:11:19	2022-11-30T02:21:07	Rev1	None	None
IIECAS	0.88354	0.12137	0.29333	0.64583	75608.21	2022-12-01T15:01:55	2022-12-01T13:44:48	Rev1	None	None
UMBCb	0.49955	0.02726	0.16128	0.89157	3656.39	2022-10-31T19:10:23	2022-10-31T19:00:37	Rev1	None	None
UMBCb	7.91988	1.34209	0.40696	0.53742	5067.91	2022-11-04T14:43:29	2022-11-03T20:20:40	Rev1	None	None

Required filename format: "image-classification-sep2022_test_<Submission Name>.simg"
Accepting submissions: True
Number of models in image-classification-sep2022, test: 216
Execution timeout (hh:mm:ss): 1 day, 12:00:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2022-12-16T20:20:05	performer	None	None	Ok	2022-12-16T20:11:50	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-02-11T00:50:06	performer	None	None	Ok	2023-02-11T00:41:33	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-10T17:00:12	performer	None	None	Ok	2023-10-10T16:58:42	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-02-14T15:40:09	performer	None	None	Ok	2023-02-14T15:35:48	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2022-12-13T20:00:08	performer	None	None	Ok	2022-12-13T19:50:40	0 d, 0 h, 0 m, 0 s
ARM-UCSD		performer	None	None	Ok	2023-03-27T02:09:28	0 d, 0 h, 0 m, 0 s
ARM	2023-04-04T18:00:16	performer	None	Ok	Ok	2023-04-04T18:00:08	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU		performer	None	None	Ok	2023-01-07T21:22:48	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2022-12-15T07:10:21	performer	None	None	Ok	2022-12-15T07:07:27	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-01-20T21:40:25	performer	None	None	Ok	2023-01-20T21:34:01	0 d, 0 h, 0 m, 0 s
trojai-example	2022-09-21T17:30:13	public	None	Ok	Ok	2022-09-21T17:28:50	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS	2022-12-04T00:00:31	public	None	None	Ok	2022-12-02T08:08:27	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2022-11-04T14:43:29	performer	None	None	Ok	2022-11-03T20:20:40	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on Cross Entropy

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.26094	0.06715	0.07978	0.96871	2235.86	2022-12-16T15:10:05	2022-12-16T15:00:48	Rev1	None	None
TrinitySRITrojAI	0.41344	0.06866	0.13081	0.90141	14132.81	2023-02-11T00:50:06	2023-02-11T00:41:33	Rev1	None	None
PL-GIFT	0.10145	0.04843	0.0279	0.99203	1149.71	2023-10-09T23:15:49	2023-10-09T23:01:38	Rev1	None	None
Perspecta-PurdueRutgers	0.29024	0.06101	0.09191	0.9567	3163.07	2023-02-13T00:40:09	2023-02-13T00:38:47	Rev1	None	None
Perspecta-IUB	0.37543	0.09072	0.11553	0.92678	3170.51	2022-11-18T18:45:04	2022-11-18T17:16:35	Rev1	None	:Container Parameters (jsonschema checker):
ARM-UCSD	0.54277	0.11701	0.16926	0.80093	4421.76	2022-10-07T18:20:09	2022-10-07T18:15:51	Rev1	None	None
ARM	0.63044	0.05541	0.2192	0.71348	3099.07	2022-11-01T21:10:13	2022-11-01T21:08:20	Rev1	None	None
TrinitySRITrojAI-SBU	0.65073	0.0963	0.22046	0.74198	2946.61	2022-12-14T22:01:34	2022-12-14T21:06:01	Rev1	None	None
ICSI-2	0.30211	0.07784	0.08909	0.94487	64458.08	2022-12-13T06:22:17	2022-12-13T06:17:44	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69214	0.04466	0.24685	0.58312	3412.87	2022-10-29T07:10:15	2022-10-29T07:06:28	Rev1	None	None
trojai-example	0.84173	0.10527	0.28669	0.53477	2543.89	2022-09-21T17:30:13	2022-09-21T17:28:50	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5		2022-11-27T12:10:30	2022-11-27T12:07:55	Rev1	:No Results::Info File Missing:	None
UMBCb	0.69034	0.0512	0.245	0.6178	2662.31	2022-10-31T19:10:23	2022-10-31T19:00:37	Rev1	None	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.69585	0.00687	0.2513	0.49537	129603.31	2022-10-03T20:40:03	2022-10-03T20:31:27	Rev1	None	:Timeout:
Perspecta	0.71976	0.08286	0.24824	0.62731	2181.47	2022-10-13T03:30:03	2022-10-13T03:20:12	Rev1	None	None
Perspecta	0.91329	0.24076	0.23932	0.69217	2143.86	2022-10-18T05:20:03	2022-10-18T05:11:57	Rev1	None	None
Perspecta	1.76118	0.32537	0.41468	0.42074	2071.51	2022-10-18T17:30:03	2022-10-18T17:23:07	Rev1	None	None
Perspecta	0.73769	0.10956	0.24833	0.63953	2035.15	2022-10-19T00:00:04	2022-10-18T23:56:57	Rev1	None	None
Perspecta	0.68774	0.09754	0.22978	0.6788	2036.43	2022-10-19T18:10:04	2022-10-19T18:02:05	Rev1	None	None
Perspecta	0.6845	0.08769	0.23123	0.67357	2034.36	2022-10-19T21:00:04	2022-10-19T20:53:59	Rev1	None	None
Perspecta	0.64453	0.07715	0.21921	0.72308	2026.29	2022-10-19T23:40:03	2022-10-19T23:33:06	Rev1	None	None
Perspecta	0.75607	0.16437	0.21981	0.76097	2114.58	2022-10-26T14:40:04	2022-10-26T14:32:03	Rev1	None	None
Perspecta	0.8982	0.23516	0.21884	0.77761	2085.55	2022-10-27T00:50:03	2022-10-27T00:44:13	Rev1	None	None
Perspecta	1.02657	0.33428	0.2214	0.77516	2079.53	2022-10-27T04:20:03	2022-10-27T04:15:11	Rev1	None	None
Perspecta	0.59227	0.09079	0.2	0.77756	2091.55	2022-10-27T15:40:04	2022-10-27T15:38:34	Rev1	None	None
Perspecta	0.4583	0.0657	0.15224	0.86081	2074.57	2022-10-28T23:30:03	2022-10-28T23:22:21	Rev1	None	None
Perspecta	0.47358	0.06943	0.15484	0.85678	2156.95	2022-11-02T18:04:43	2022-11-02T17:56:09	Rev1	None	None
Perspecta	0.38893	0.06678	0.12453	0.90415	2150.32	2022-11-07T21:10:05	2022-11-07T21:04:58	Rev1	None	None
Perspecta	0.38314	0.07537	0.1232	0.90222	2121.85	2022-11-15T04:00:04	2022-11-15T03:50:54	Rev1	None	None
Perspecta	0.41223	0.07331	0.13351	0.89069	2152.8	2022-11-16T01:20:04	2022-11-16T01:16:33	Rev1	None	None
Perspecta	0.37649	0.14735	0.09713	0.9459	2156.74	2022-11-16T19:00:04	2022-11-16T18:58:52	Rev1	None	None
Perspecta	0.37985	0.07276	0.12031	0.90578	2150.64	2022-11-16T21:10:04	2022-11-16T21:09:20	Rev1	None	None
Perspecta	0.46206	0.15627	0.11401	0.90758	2062.49	2022-11-17T22:30:04	2022-11-17T22:23:07	Rev1	None	None
Perspecta	0.36412	0.06779	0.11863	0.91615	2159.55	2022-11-22T05:20:04	2022-11-22T05:17:14	Rev1	None	None
Perspecta	0.38556	0.06515	0.12332	0.90505	2025.27	2022-11-22T07:30:04	2022-11-22T07:22:56	Rev1	None	None
Perspecta	0.39845	0.08336	0.12282	0.90959	11071.45	2022-11-29T07:40:04	2022-11-29T07:38:19	Rev1	None	None
Perspecta	0.3428	0.09285	0.09818	0.93514	11069.68	2022-11-29T15:50:05	2022-11-29T15:43:06	Rev1	None	None
Perspecta	0.34504	0.07069	0.10928	0.92953	11066.84	2022-11-30T20:00:04	2022-11-30T19:50:09	Rev1	None	None
Perspecta	0.40367	0.03316	0.12032	0.95786	11174.79	2022-12-01T05:20:04	2022-12-01T05:16:29	Rev1	None	None
Perspecta	0.35539	0.04517	0.10568	0.94796	11316.39	2022-12-01T16:50:09	2022-12-01T16:48:02	Rev1	None	None
Perspecta	0.35539	0.04517	0.10568	0.94796	2852.21	2022-12-04T00:00:05	2022-12-02T03:25:52	Rev1	None	None
Perspecta	0.35996	0.04682	0.10803	0.94629	3102.78	2022-12-05T20:20:04	2022-12-05T20:15:11	Rev1	None	None
Perspecta	0.34827	0.0418	0.1006	0.95812	2660.45	2022-12-06T22:20:04	2022-12-06T22:10:11	Rev1	None	None
Perspecta	0.35484	0.04106	0.10395	0.95735	2660.4	2022-12-07T17:00:04	2022-12-07T16:55:59	Rev1	None	None
Perspecta	0.33966	0.03792	0.09768	0.96498	2657.4	2022-12-08T16:00:05	2022-12-08T15:58:05	Rev1	None	None
Perspecta	0.33086	0.03901	0.09407	0.96708	2664.42	2022-12-13T04:50:05	2022-12-13T04:43:43	Rev1	None	None
Perspecta	0.33086	0.03901	0.09407	0.96708	2762.67	2022-12-13T06:40:04	2022-12-13T06:33:35	Rev1	None	None
Perspecta	0.3631	0.05388	0.11265	0.93077	2874.84	2022-12-13T16:00:04	2022-12-13T15:56:25	Rev1	None	None
Perspecta	0.3631	0.05388	0.11265	0.93077	2851.43	2022-12-13T21:50:05	2022-12-13T20:15:00	Rev1	None	None
Perspecta	0.48632	0.19063	0.1108	0.92751	2231.26	2022-12-14T00:40:04	2022-12-14T00:39:29	Rev1	None	None
Perspecta	0.35368	0.03905	0.10232	0.96755	2748.27	2022-12-14T17:30:05	2022-12-14T17:24:00	Rev1	None	None
Perspecta	0.32702	0.04166	0.09419	0.97171	2853.9	2022-12-14T19:00:05	2022-12-14T18:55:54	Rev1	None	None
Perspecta	0.32516	0.04197	0.09337	0.96584	2664.63	2022-12-15T01:20:05	2022-12-15T01:18:57	Rev1	None	None
Perspecta	0.27356	0.06142	0.08648	0.96588	2236.15	2022-12-15T06:20:04	2022-12-15T06:11:21	Rev1	None	None
Perspecta	0.29586	0.07533	0.09327	0.95898	2234.05	2022-12-15T22:10:05	2022-12-15T21:55:42	Rev1	None	None
Perspecta	0.26094	0.06715	0.07978	0.96871	2235.86	2022-12-16T15:10:05	2022-12-16T15:00:48	Rev1	None	None
Perspecta	0.26191	0.06434	0.08036	0.96614	2238.65	2022-12-16T20:20:05	2022-12-16T20:11:50	Rev1	None	None
TrinitySRITrojAI	0.707	0.0916	0.23573	0.68639	6866.14	2022-09-30T06:30:06	2022-09-30T06:24:28	Rev1	None	:Cleanup::Cleanup:
TrinitySRITrojAI	0.75205	0.11422	0.24401	0.68266	6865.44	2022-09-30T20:50:05	2022-09-30T20:43:42	Rev1	None	None
TrinitySRITrojAI	0.73967	0.06156	0.26013	0.59821	7017.93	2022-10-07T08:40:06	2022-10-07T08:37:36	Rev1	None	None
TrinitySRITrojAI	0.59141	0.08373	0.19756	0.76595	19243.69	2022-10-08T05:20:06	2022-10-08T05:19:38	Rev1	None	None
TrinitySRITrojAI	0.4992	0.0595	0.16927	0.81297	43071.42	2022-10-17T08:50:06	2022-10-17T08:43:17	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1813.63	2022-11-16T01:40:06	2022-11-16T01:35:44	Rev1	:No Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1887.99	2022-11-16T07:00:06	2022-11-16T06:59:01	Rev1	:No Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1816.96	2022-11-17T05:40:05	2022-11-17T05:33:04	Rev1	:No Results:	None
TrinitySRITrojAI	0.6194	0.06721	0.2151	0.72741	48083.46	2022-11-18T00:00:55	2022-11-17T23:59:38	Rev1	None	None
TrinitySRITrojAI	0.59988	0.09643	0.19629	0.78202	85772.44	2022-12-13T01:10:06	2022-12-13T01:04:46	Rev1	None	None
TrinitySRITrojAI	0.48639	0.10252	0.14782	0.85794	127683.11	2023-01-18T17:20:06	2023-01-18T17:13:22	Rev1	None	None
TrinitySRITrojAI	0.41344	0.06866	0.13081	0.90141	14132.81	2023-02-11T00:50:06	2023-02-11T00:41:33	Rev1	None	None
PL-GIFT	0.57702	0.07557	0.19379	0.78074	1429.5	2022-09-23T22:10:06	2022-09-23T22:01:36	Rev1	None	None
PL-GIFT	0.46674	0.05664	0.16051	0.84709	2038.31	2022-09-30T01:00:06	2022-09-30T00:56:52	Rev1	None	:Cleanup::Cleanup:
PL-GIFT	0.50873	0.10565	0.15658	0.85142	11566.66	2022-10-12T15:10:08	2022-10-12T15:01:57	Rev1	None	None
PL-GIFT	0.34255	0.07196	0.109	0.93236	1419.24	2022-10-14T18:20:08	2022-10-14T18:18:21	Rev1	None	None
PL-GIFT	0.7001	0.04798	0.24546	0.64489	4271.0	2022-10-20T22:00:07	2022-10-20T21:55:07	Rev1	None	:Container Parameters (jsonschema checker):
PL-GIFT	0.32598	0.07557	0.10175	0.9411	1863.26	2022-10-25T23:40:07	2022-10-25T23:31:47	Rev1	None	None
PL-GIFT	0.33886	0.09336	0.09653	0.94959	1516.36	2022-11-04T23:30:07	2022-11-04T23:20:37	Rev1	None	None
PL-GIFT	0.3101	0.09115	0.09195	0.94029	1875.68	2022-11-07T17:10:08	2022-11-07T17:10:02	Rev1	None	None
PL-GIFT	0.36153	0.08622	0.1082	0.91487	1871.2	2022-11-09T23:10:08	2022-11-09T23:03:07	Rev1	None	None
PL-GIFT	0.36958	0.09961	0.11224	0.92571	1874.25	2022-11-11T19:20:07	2022-11-11T19:19:08	Rev1	None	None
PL-GIFT	0.22401	0.07489	0.07151	0.97467	1870.67	2022-11-11T23:10:07	2022-11-11T23:09:05	Rev1	None	None
PL-GIFT	0.21259	0.06967	0.06595	0.97878	1883.08	2022-11-15T17:40:09	2022-11-15T17:33:52	Rev1	None	None
PL-GIFT	0.37087	0.11213	0.10117	0.91397	1872.44	2022-11-15T20:20:45	2022-11-15T20:17:08	Rev1	None	None
PL-GIFT	0.26396	0.07679	0.08149	0.96579	1866.32	2022-11-15T23:50:08	2022-11-15T23:45:59	Rev1	None	None
PL-GIFT	0.23528	0.10282	0.06366	0.96965	1949.04	2022-12-15T15:50:08	2022-12-15T15:46:42	Rev1	None	None
PL-GIFT	0.23425	0.10239	0.06347	0.96961	2010.96	2022-12-20T19:08:06	2022-12-20T18:19:32	Rev1	None	None
PL-GIFT	0.10145	0.04843	0.0279	0.99203	1149.71	2023-10-09T23:15:49	2023-10-09T23:01:38	Rev1	None	None
PL-GIFT	0.2305	0.07569	0.07175	0.96974	1161.14	2023-10-10T03:50:14	2023-10-10T03:46:34	Rev1	None	None
PL-GIFT	0.15154	0.05931	0.0442	0.98573	1103.41	2023-10-10T04:40:13	2023-10-10T04:36:35	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2023-10-10T05:22:41	2023-10-10T05:10:21	Rev1	:No Results::Missing Results:	:Container Parameters (jsonschema checker):
PL-GIFT	0.13755	0.05509	0.03969	0.9892	1171.78	2023-10-10T05:54:05	2023-10-10T05:49:55	Rev1	None	None
PL-GIFT	0.19401	0.06434	0.06187	0.98002	1121.07	2023-10-10T14:30:13	2023-10-10T14:25:23	Rev1	None	None
PL-GIFT	0.35994	0.09841	0.10148	0.9336	1140.28	2023-10-10T15:22:02	2023-10-10T15:15:59	Rev1	None	None
PL-GIFT	0.18219	0.07787	0.05122	0.98118	1087.82	2023-10-10T17:00:12	2023-10-10T16:58:42	Rev1	None	None
Perspecta-PurdueRutgers	0.44105	0.10542	0.13222	0.84722	72513.96	2022-10-03T08:20:08	2022-10-03T08:18:13	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.42974	0.10225	0.12829	0.85742	73585.52	2022-10-04T22:40:07	2022-10-04T22:39:49	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.49211	0.10619	0.15434	0.85322	47542.29	2022-10-14T10:00:08	2022-10-14T09:52:56	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.51457	0.11011	0.16168	0.83479	98129.1	2022-10-15T15:20:09	2022-10-15T15:12:56	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.36284	0.10839	0.10061	0.89489	61710.03	2022-10-18T06:50:22	2022-10-18T06:41:35	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.33742	0.08619	0.09471	0.90008	61248.41	2022-10-24T01:40:09	2022-10-24T01:34:56	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.35812	0.07447	0.10628	0.90771	129603.41	2022-11-01T17:50:09	2022-11-01T17:42:36	Rev1	None	:Container Parameters (learned parameters)::Timeout:
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2022-11-03T13:10:09	2022-11-03T13:07:21	Rev1	:Info File Missing:	None
Perspecta-PurdueRutgers	0.65449	0.02534	0.23147	0.63773	2236.2	2022-11-04T15:20:09	2022-11-04T15:17:23	Rev1	None	None
Perspecta-PurdueRutgers	0.31039	0.07938	0.0853	0.91615	121209.15	2022-11-04T20:40:10	2022-11-04T20:30:10	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.58752	0.03242	0.20052	0.76432	1778.7	2022-11-06T21:00:08	2022-11-06T20:52:56	Rev1	None	None
Perspecta-PurdueRutgers	0.30179	0.08706	0.08387	0.91615	118130.14	2022-11-08T19:40:09	2022-11-08T19:33:41	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.67805	0.01868	0.24277	0.5796	1782.61	2022-11-11T17:20:08	2022-11-11T17:17:24	Rev1	None	None
Perspecta-PurdueRutgers	0.56947	0.07318	0.19096	0.78562	1920.95	2022-11-15T23:30:10	2022-11-15T23:21:05	Rev1	None	None
Perspecta-PurdueRutgers	0.76088	0.35207	0.185	0.80153	1914.11	2022-11-16T05:00:08	2022-11-16T04:53:47	Rev1	None	None
Perspecta-PurdueRutgers	0.57369	0.07366	0.19305	0.78888	1924.87	2022-11-16T16:40:09	2022-11-16T16:36:52	Rev1	None	None
Perspecta-PurdueRutgers	0.56123	0.07512	0.19141	0.78888	1914.21	2022-11-17T02:00:07	2022-11-17T01:55:49	Rev1	None	None
Perspecta-PurdueRutgers	0.5424	0.07689	0.18724	0.78888	1877.95	2022-11-17T03:10:07	2022-11-17T03:09:26	Rev1	None	None
Perspecta-PurdueRutgers	0.89219	0.42945	0.18875	0.76415	1889.69	2022-11-17T04:41:19	2022-11-17T04:34:55	Rev1	None	None
Perspecta-PurdueRutgers	0.50568	0.04985	0.17495	0.81083	1879.76	2022-11-19T00:30:08	2022-11-18T21:26:33	Rev1	None	None
Perspecta-PurdueRutgers	0.623	0.25074	0.17604	0.8074	1883.73	2022-11-19T02:01:15	2022-11-19T01:55:52	Rev1	None	None
Perspecta-PurdueRutgers	0.52693	0.04722	0.18031	0.81083	1885.74	2022-11-19T04:20:08	2022-11-19T04:10:44	Rev1	None	None
Perspecta-PurdueRutgers	2.56759	0.93838	0.24419	0.69543	1993.41	2022-12-10T03:50:08	2022-12-10T03:46:14	Rev1	None	None
Perspecta-PurdueRutgers	0.5276	0.04848	0.18499	0.77962	2001.14	2022-12-10T15:24:54	2022-12-10T14:40:50	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5	505.41	2022-12-11T05:00:08	2022-12-11T04:58:39	Rev1	:No Results:	None
Perspecta-PurdueRutgers	0.73057	0.34979	0.17542	0.80624	1864.96	2022-12-11T16:40:09	2022-12-11T16:38:53	Rev1	None	None
Perspecta-PurdueRutgers	0.52362	0.04142	0.17835	0.81799	1871.02	2022-12-11T18:00:08	2022-12-11T18:00:18	Rev1	None	None
Perspecta-PurdueRutgers	0.77337	0.34835	0.1873	0.79012	2235.95	2022-12-11T21:50:09	2022-12-11T21:45:59	Rev1	None	None
Perspecta-PurdueRutgers	0.62858	0.24905	0.17664	0.81602	1872.44	2022-12-12T04:00:08	2022-12-12T03:53:37	Rev1	None	None
Perspecta-PurdueRutgers	0.53599	0.03722	0.17948	0.8176	1871.43	2022-12-12T06:20:08	2022-12-12T06:15:01	Rev1	None	None
Perspecta-PurdueRutgers	0.83918	0.34713	0.21355	0.68424	1986.49	2022-12-12T21:50:09	2022-12-12T21:09:20	Rev1	None	None
Perspecta-PurdueRutgers	0.75168	0.42941	0.13487	0.90312	3218.84	2023-02-06T02:00:08	2023-02-06T01:57:01	Rev1	None	None
Perspecta-PurdueRutgers	0.56717	0.04059	0.20211	0.68724	2499.87	2023-02-09T21:20:10	2023-02-09T21:15:24	Rev1	None	None
Perspecta-PurdueRutgers	0.56355	0.03529	0.1968	0.7368	2618.25	2023-02-09T22:30:10	2023-02-09T22:27:54	Rev1	None	None
Perspecta-PurdueRutgers	0.54627	0.04517	0.1937	0.71815	2382.63	2023-02-12T02:30:09	2023-02-12T02:29:10	Rev1	None	None
Perspecta-PurdueRutgers	0.56671	0.04855	0.20142	0.70478	2795.0	2023-02-12T04:10:09	2023-02-12T04:02:07	Rev1	None	None
Perspecta-PurdueRutgers	0.81423	0.49722	0.11825	0.91774	3221.81	2023-02-12T22:30:08	2023-02-12T22:25:15	Rev1	None	None
Perspecta-PurdueRutgers	0.29024	0.06101	0.09191	0.9567	3163.07	2023-02-13T00:40:09	2023-02-13T00:38:47	Rev1	None	None
Perspecta-PurdueRutgers	0.45266	0.26014	0.10473	0.94132	3183.51	2023-02-14T15:40:09	2023-02-14T15:35:48	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	1450.22	2022-10-05T22:40:09	2022-10-05T22:38:17	Rev1	None	None
Perspecta-IUB	0.45452	0.05118	0.15329	0.887	37485.16	2022-10-06T23:40:09	2022-10-06T23:35:08	Rev1	None	None
Perspecta-IUB	0.48582	0.05713	0.1648	0.84701	31197.94	2022-10-07T14:00:09	2022-10-07T03:35:32	Rev1	None	None
Perspecta-IUB	0.48491	0.10831	0.15727	0.87757	31816.89	2022-10-08T02:30:09	2022-10-08T02:23:53	Rev1	None	None
Perspecta-IUB	0.5696	0.1248	0.17848	0.84546	31353.94	2022-10-08T12:40:31	2022-10-08T04:37:48	Rev1	None	None
Perspecta-IUB	0.56846	0.0265	0.1904	0.84512	31110.88	2022-10-08T21:40:30	2022-10-08T18:08:16	Rev1	None	None
Perspecta-IUB	0.5535	0.02455	0.183	0.87646	31280.68	2022-10-09T06:30:35	2022-10-08T23:24:10	Rev1	None	None
Perspecta-IUB	0.46086	0.05045	0.15486	0.87903	31302.38	2022-10-09T17:40:08	2022-10-09T17:30:28	Rev1	None	None
Perspecta-IUB	0.4776	0.09831	0.14941	0.8657	33452.88	2022-10-10T02:30:33	2022-10-09T22:35:57	Rev1	None	None
Perspecta-IUB	0.77317	0.28022	0.16866	0.85434	31590.83	2022-10-10T15:20:09	2022-10-10T15:11:15	Rev1	None	None
Perspecta-IUB	0.60741	0.18245	0.16066	0.85721	4179.16	2022-10-11T00:10:31	2022-10-10T18:15:05	Rev1	None	None
Perspecta-IUB	0.46348	0.08648	0.14714	0.86737	4180.82	2022-10-11T02:20:08	2022-10-11T02:13:19	Rev1	None	None
Perspecta-IUB	0.44146	0.07907	0.14309	0.87534	4997.51	2022-10-11T03:40:31	2022-10-11T03:02:15	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2022-10-11T05:10:33	2022-10-11T04:00:25	Rev1	:Info File Missing:	None
Perspecta-IUB	0.4397	0.07606	0.14243	0.87603	4984.81	2022-10-11T17:40:09	2022-10-11T17:23:06	Rev1	None	None
Perspecta-IUB	0.46103	0.04889	0.15507	0.88387	44245.22	2022-10-11T19:20:09	2022-10-11T19:13:18	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2022-10-12T15:20:09	2022-10-12T15:10:37	Rev1	:Executed File Update::Info File Missing:	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2022-10-12T19:00:09	2022-10-12T18:57:51	Rev1	:Executed File Update::Info File Missing:	None
Perspecta-IUB	0.42076	0.04954	0.1379	0.89206	45067.73	2022-10-12T21:00:20	2022-10-12T18:57:51	Rev1	None	None
Perspecta-IUB	0.42745	0.04739	0.14082	0.89716	41399.1	2022-10-13T09:40:24	2022-10-12T23:53:26	Rev1	None	None
Perspecta-IUB	0.42878	0.04669	0.141	0.89819	40730.59	2022-10-14T01:50:10	2022-10-13T23:08:43	Rev1	None	None
Perspecta-IUB	0.42214	0.04923	0.13825	0.8936	40755.44	2022-10-14T13:20:33	2022-10-14T06:51:18	Rev1	None	None
Perspecta-IUB	0.42	0.05403	0.13757	0.88833	40810.27	2022-10-15T04:00:30	2022-10-14T21:09:47	Rev1	None	None
Perspecta-IUB	0.42	0.05403	0.13757	0.88833	41123.91	2022-11-15T17:10:08	2022-11-15T17:08:10	Rev1	None	None
Perspecta-IUB	0.65895	0.23166	0.13675	0.8879	4441.04	2022-11-17T03:50:45	2022-11-17T03:48:28	Rev1	None	:Container Parameters (jsonschema checker):
Perspecta-IUB	0.66235	0.10598	0.21817	0.74271	2593.28	2022-11-17T22:10:09	2022-11-17T22:03:12	Rev1	None	:Container Parameters (jsonschema checker):
Perspecta-IUB	0.50003	0.07657	0.16996	0.82472	2955.83	2022-11-18T04:20:09	2022-11-18T04:17:39	Rev1	None	:Container Parameters (jsonschema checker):
Perspecta-IUB	0.50283	0.13492	0.14662	0.90548	2954.72	2022-11-18T05:30:08	2022-11-18T05:26:14	Rev1	None	:Container Parameters (jsonschema checker):
Perspecta-IUB	0.37543	0.09072	0.11553	0.92678	3170.51	2022-11-18T18:45:04	2022-11-18T17:16:35	Rev1	None	:Container Parameters (jsonschema checker):
Perspecta-IUB	0.37543	0.09072	0.11553	0.92678	3377.86	2022-12-13T20:00:08	2022-12-13T19:50:40	Rev1	None	:Container Parameters (jsonschema checker):
ARM-UCSD	0.69315	0.0	0.25	0.5	1804.24	2022-10-06T22:20:09	2022-10-06T22:16:03	Rev1	None	None
ARM-UCSD	0.5556	0.09155	0.18259	0.79012	4257.3	2022-10-07T06:10:11	2022-10-07T06:05:34	Rev1	None	None
ARM-UCSD	0.54277	0.11701	0.16926	0.80093	4421.76	2022-10-07T18:20:09	2022-10-07T18:15:51	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-10-12T13:32:35	2022-10-11T23:57:30	Rev1	:Info File Missing:	None
ARM-UCSD	0.7157	0.13125	0.23222	0.72222	24636.71	2022-10-12T21:00:21	2022-10-11T23:57:30	Rev1	None	None
ARM-UCSD	0.7157	0.13125	0.23222	0.72222	8961.43	2022-10-13T04:00:20	2022-10-12T21:28:41	Rev1	None	None
ARM-UCSD	1.20397	0.14651	0.41	0.5	2546.13	2022-11-01T15:40:11	2022-11-01T15:33:06	Rev1	None	None
ARM-UCSD	1.20397	0.14651	0.41	0.5	2514.79	2022-11-01T20:30:11	2022-11-01T20:20:14	Rev1	None	None
ARM-UCSD	1.03396	0.11645	0.37355	0.5	2500.81	2022-12-13T18:50:14	2022-12-13T18:50:47	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-03-27T02:10:14	2023-03-27T02:09:28	Rev1	:No Results::Missing Results:	:Container Parameters (jsonschema checker):
ARM	0.69315	0.0	0.25	0.5	1375.72	2022-10-03T07:30:14	2022-10-03T07:26:20	Rev1	None	None
ARM	0.66913	0.0129	0.23838	0.60237	2388.62	2022-10-17T18:20:10	2022-10-17T18:11:32	Rev1	None	None
ARM	0.63044	0.05541	0.2192	0.71348	3099.07	2022-11-01T21:10:13	2022-11-01T21:08:20	Rev1	None	None
ARM	0.65914	0.03107	0.23323	0.65835	11174.49	2022-11-28T05:10:15	2022-11-28T05:03:33	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5		2023-03-28T04:40:17	2023-03-28T04:36:44	Rev1	:No Results::Missing Results::Info File Missing:	None
ARM	0.64336	0.14314	0.18768	0.80783	1840.77	2023-04-04T18:00:16	2023-04-04T18:00:08	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	938.16	2022-11-29T05:21:12	2022-11-29T05:13:35	Rev1	:No Results:	None
TrinitySRITrojAI-SBU	1.22432	0.23004	0.33275	0.5691	11107.06	2022-11-29T18:50:17	2022-11-29T18:45:10	Rev1	None	None
TrinitySRITrojAI-SBU	1.3413	0.2806	0.31737	0.59967	2309.73	2022-12-12T23:41:20	2022-12-12T23:38:50	Rev1	None	None
TrinitySRITrojAI-SBU	0.75486	0.08725	0.26725	0.62453	2380.48	2022-12-13T02:50:17	2022-12-13T02:45:02	Rev1	None	None
TrinitySRITrojAI-SBU	0.76206	0.08831	0.26994	0.62269	2608.54	2022-12-13T16:52:58	2022-12-13T16:44:35	Rev1	None	None
TrinitySRITrojAI-SBU	0.65073	0.0963	0.22046	0.74198	2946.61	2022-12-14T22:01:34	2022-12-14T21:06:01	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-01-07T21:30:19	2023-01-07T21:22:48	Rev1	:No Results:	:Schema Header:
ICSI-2	0.49894	0.07109	0.16271	0.83989	4954.9	2022-09-26T03:50:14	2022-09-26T03:42:55	Rev1	None	None
ICSI-2	0.64325	0.08268	0.22344	0.72441	2686.94	2022-10-03T02:00:15	2022-10-03T01:59:22	Rev1	None	None
ICSI-2	0.4133	0.06463	0.13373	0.89725	2529.52	2022-10-04T04:50:26	2022-10-04T04:43:23	Rev1	None	None
ICSI-2	0.69315	0.0	0.25	0.5		2022-10-10T08:40:16	2022-10-10T08:34:46	Rev1	:Info File Missing:	None
ICSI-2	0.40322	0.06265	0.12774	0.90261	3186.55	2022-10-10T09:10:15	2022-10-10T09:09:08	Rev1	None	None
ICSI-2	0.39858	0.06644	0.12588	0.90689	2980.6	2022-10-11T20:20:14	2022-10-11T20:11:37	Rev1	None	None
ICSI-2	0.43494	0.09453	0.13357	0.89965	3297.06	2022-10-13T01:30:13	2022-10-13T01:30:01	Rev1	None	None
ICSI-2	0.46428	0.07177	0.15497	0.85978	2988.68	2022-10-14T01:50:16	2022-10-13T20:29:39	Rev1	None	None
ICSI-2	0.45526	0.06498	0.1525	0.86368	2967.65	2022-10-14T23:20:22	2022-10-14T23:17:14	Rev1	None	None
ICSI-2	0.48321	0.08619	0.15631	0.86441	2977.13	2022-10-15T21:00:12	2022-10-15T20:53:16	Rev1	None	None
ICSI-2	0.63939	0.1329	0.19874	0.83025	2980.11	2022-10-16T05:40:13	2022-10-16T05:34:41	Rev1	None	None
ICSI-2	0.39105	0.07074	0.12407	0.90822	3098.31	2022-10-25T21:20:13	2022-10-25T21:15:59	Rev1	None	None
ICSI-2	0.41841	0.0842	0.13041	0.89973	3468.91	2022-10-26T06:40:13	2022-10-26T06:40:02	Rev1	None	None
ICSI-2	0.3635	0.07566	0.11306	0.92138	2818.3	2022-11-09T18:50:18	2022-11-09T18:48:31	Rev1	None	None
ICSI-2	0.36325	0.08031	0.11263	0.92245	2808.91	2022-11-14T23:30:19	2022-11-14T23:23:54	Rev1	None	None
ICSI-2	0.36325	0.08031	0.11263	0.92245	2807.1	2022-11-15T03:20:58	2022-11-15T03:15:09	Rev1	None	None
ICSI-2	0.34572	0.07765	0.10591	0.93128	35217.68	2022-11-22T11:00:19	2022-11-22T10:58:01	Rev1	None	None
ICSI-2	0.36183	0.08154	0.11309	0.9198	11242.62	2022-11-23T00:30:20	2022-11-23T00:27:50	Rev1	None	None
ICSI-2	0.31188	0.07664	0.09225	0.94072	63796.16	2022-11-23T23:10:19	2022-11-23T23:07:52	Rev1	None	None
ICSI-2	0.69315	0.0	0.25	0.5		2022-12-04T23:50:19	2022-12-04T23:44:26	Rev1	:No Results::Info File Missing:	None
ICSI-2	0.30211	0.07784	0.08909	0.94487	64458.08	2022-12-13T06:22:17	2022-12-13T06:17:44	Rev1	None	None
ICSI-2	0.30877	0.07495	0.09598	0.94414	12486.03	2022-12-14T05:20:20	2022-12-14T05:19:51	Rev1	None	None
ICSI-2	0.30926	0.08427	0.09255	0.94402	5444.1	2022-12-15T07:10:21	2022-12-15T07:07:27	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	1158.38	2022-10-18T00:00:15	2022-10-17T23:55:05	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	1154.16	2022-10-18T00:30:24	2022-10-18T00:05:51	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69214	0.04466	0.24685	0.58312	3412.87	2022-10-29T07:10:15	2022-10-29T07:06:28	Rev1	None	None
TrinitySRITrojAI-BostonU	0.82041	0.0869	0.29204	0.5643	7086.8	2022-10-31T20:10:17	2022-10-31T20:01:29	Rev1	None	None
TrinitySRITrojAI-BostonU	0.82041	0.0869	0.29204	0.5643	7123.09	2022-11-01T08:30:54	2022-11-01T08:15:26	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0001	0.25	0.5	7314.69	2022-11-02T02:00:19	2022-11-02T01:50:55	Rev1	None	None
TrinitySRITrojAI-BostonU	0.89365	0.0825	0.32826	0.46039	7091.41	2022-11-02T06:20:20	2022-11-02T06:13:15	Rev1	None	None
TrinitySRITrojAI-BostonU	0.98433	0.10842	0.34387	0.42627	7154.62	2022-11-02T18:30:22	2022-11-02T18:13:38	Rev1	None	None
TrinitySRITrojAI-BostonU	0.82041	0.0869	0.29204	0.5643	7104.33	2022-11-03T05:50:21	2022-11-03T05:47:16	Rev1	None	None
TrinitySRITrojAI-BostonU	0.82041	0.0869	0.29204	0.5643	7228.94	2022-11-06T20:04:15	2022-11-06T16:40:24	Rev1	None	None
TrinitySRITrojAI-BostonU	0.82041	0.0869	0.29204	0.5643	7160.91	2022-11-07T23:21:18	2022-11-07T22:00:09	Rev1	None	None
TrinitySRITrojAI-BostonU	0.82041	0.0869	0.29204	0.5643	7218.55	2022-11-15T17:30:58	2022-11-15T17:25:55	Rev1	None	None
TrinitySRITrojAI-BostonU	0.72758	0.04424	0.26281	0.53935	7197.8	2022-11-15T19:40:51	2022-11-15T17:50:14	Rev1	None	None
TrinitySRITrojAI-BostonU	1.32033	0.21143	0.36734	0.52002	4105.88	2022-12-07T02:10:22	2022-12-07T02:06:33	Rev1	None	None
TrinitySRITrojAI-BostonU	5.3727	1.45838	0.19444	0.69792	2280.68	2022-12-10T05:10:21	2022-12-10T05:05:16	Rev1	None	None
TrinitySRITrojAI-BostonU	5.3727	1.45838	0.19444	0.69792	2281.83	2022-12-10T08:00:22	2022-12-10T07:39:41	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	1274.19	2022-12-13T17:20:18	2022-12-13T17:15:18	Rev1	:No Results:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	1262.56	2022-12-14T03:33:15	2022-12-14T03:24:35	Rev1	:No Results:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	1523.75	2023-01-20T21:40:25	2023-01-20T21:34:01	Rev1	:No Results:	None
trojai-example	0.84173	0.10527	0.28669	0.53477	2543.89	2022-09-21T17:30:13	2022-09-21T17:28:50	Rev1	None	None
IIECAS	12.28046	1.83104	0.44444	0.11111	5691.78	2022-11-17T12:30:29	2022-11-17T12:21:16	Rev1	None	None
IIECAS	1.04122	0.1449	0.35074	0.57407	72411.13	2022-11-18T12:20:26	2022-11-18T12:12:28	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5		2022-11-27T12:10:30	2022-11-27T12:07:55	Rev1	:No Results::Info File Missing:	None
IIECAS	0.99035	0.14372	0.33222	0.59722	45830.48	2022-11-27T14:00:30	2022-11-27T13:58:29	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5	11044.76	2022-11-28T05:21:14	2022-11-28T05:18:08	Rev1	:No Results:	None
IIECAS	0.69315	0.0	0.25	0.5	11001.31	2022-11-28T09:30:30	2022-11-28T09:28:15	Rev1	:No Results:	None
IIECAS	0.69315	0.0	0.25	0.5	10999.59	2022-11-28T14:20:30	2022-11-28T14:16:37	Rev1	:No Results:	None
IIECAS	0.90898	0.14113	0.30259	0.63426	45553.76	2022-11-29T02:30:30	2022-11-29T02:30:04	Rev1	None	None
IIECAS	0.90898	0.14113	0.30259	0.63426	45545.31	2022-11-29T15:21:30	2022-11-29T02:59:18	Rev1	None	None
IIECAS	0.98018	0.14344	0.32852	0.60185	47294.07	2022-11-30T04:11:19	2022-11-30T02:21:07	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5	10998.42	2022-12-01T06:20:28	2022-12-01T06:14:21	Rev1	:No Results:	None
IIECAS	0.69315	0.0	0.25	0.5	11001.18	2022-12-01T11:50:30	2022-12-01T11:44:58	Rev1	:No Results:	None
IIECAS	0.77673	0.13498	0.25444	0.69444	54445.88	2022-12-01T15:01:55	2022-12-01T13:44:48	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5	1424.47	2022-12-04T00:00:31	2022-12-02T08:08:27	Rev1	:No Results:	:Container Parameters (jsonschema checker):
UMBCb	0.69034	0.0512	0.245	0.6178	2662.31	2022-10-31T19:10:23	2022-10-31T19:00:37	Rev1	None	None
UMBCb	7.60792	1.52536	0.39033	0.55856	3799.12	2022-11-04T14:43:29	2022-11-03T20:20:40	Rev1	None	None

Required filename format: "image-classification-sep2022_sts_<Submission Name>.simg"
Accepting submissions: True
Number of models in image-classification-sep2022, sts: 10
Execution timeout (hh:mm:ss): 1:40:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2022-12-29T21:00:04	performer	None	None	Ok	2022-12-29T20:51:10	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-02-10T23:50:06	performer	None	None	Ok	2023-02-10T23:47:23	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-09T22:35:12	performer	None	None	Ok	2023-10-09T22:25:15	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2022-12-11T16:20:08	performer	None	None	Ok	2022-12-11T16:12:25	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2022-10-12T13:32:33	performer	None	None	Ok	2022-10-12T00:48:36	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2023-03-27T20:10:14	performer	None	None	Ok	2023-03-27T20:06:37	0 d, 0 h, 0 m, 0 s
ARM	2023-04-04T18:00:17	performer	None	Ok	Ok	2023-04-04T17:59:46	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU		performer	None	None	Ok	2023-01-10T02:25:33	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2022-12-15T06:50:20	performer	None	None	Ok	2022-12-15T06:48:01	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2022-11-03T05:50:22	performer	None	None	Ok	2022-11-03T05:47:16	0 d, 0 h, 0 m, 0 s
trojai-example	2022-12-08T16:40:24	public	None	None	Ok	2022-12-08T16:39:11	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS	2022-11-28T14:20:31	public	None	None	Ok	2022-11-28T14:16:24	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2022-11-02T20:10:30	performer	None	None	Ok	2022-11-02T17:11:22	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on Cross Entropy

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.06565	0.037	0.00662	1.0	122.01	2022-12-08T15:20:06	2022-12-08T15:12:57	Rev1	None	None
TrinitySRITrojAI	0.11639	0.07195	0.01964	1.0	555.68	2023-02-10T23:50:06	2023-02-10T23:47:23	Rev1	None	None
PL-GIFT	0.01005	0.0	0.0001	1.0	59.8	2023-10-09T22:35:12	2023-10-09T22:25:15	Rev1	None	None
Perspecta-PurdueRutgers	0.08373	0.01642	0.007	1.0	1659.9	2022-10-18T05:40:08	2022-10-18T05:33:54	Rev1	:Container File Missing:	:Container Parameters (learned parameters):
Perspecta-IUB	0.00234	0.00083	1e-05	1.0	1435.5	2022-10-08T01:50:08	2022-10-08T01:41:26	Rev1	None	None
ARM-UCSD	0.22292	0.14573	0.058	1.0	198.3	2022-10-07T06:10:12	2022-10-07T06:05:52	Rev1	None	None
ARM	0.17945	0.03395	0.02873	1.0	142.38	2022-11-28T05:10:16	2022-11-28T05:03:08	Rev1	None	None
TrinitySRITrojAI-SBU	0.26883	0.15055	0.07945	1.0	104.31	2022-12-12T22:00:17	2022-12-12T21:56:41	Rev1	None	None
ICSI-2	0.01681	0.01354	0.00072	1.0	126.82	2022-11-14T23:30:20	2022-11-14T23:24:02	Rev1	None	None
TrinitySRITrojAI-BostonU	0.26979	0.10317	0.06495	1.0	319.35	2022-10-31T20:10:18	2022-10-31T20:01:29	Rev1	None	None
trojai-example	0.55684	0.24684	0.19247	0.79167	152.1	2022-09-30T17:00:19	2022-09-30T16:59:47	Rev1	None	None
IIECAS	0.51681	0.16695	0.178	0.79167	462.64	2022-11-26T14:20:30	2022-11-26T14:18:48	Rev1	None	None
UMBCb	0.588	0.1539	0.20394	0.70833	133.11	2022-10-31T18:40:25	2022-10-31T18:31:33	Rev1	:Container File Missing:	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.66583	0.05079	0.23676	0.58333	6000.62	2022-10-03T18:30:04	2022-10-03T18:28:21	Rev1	None	:Timeout:
Perspecta	0.47751	0.17169	0.15468	0.91667	519.7	2022-10-13T02:50:04	2022-10-13T02:49:18	Rev1	None	None
Perspecta	0.39355	0.18202	0.12011	0.91667	92.7	2022-10-18T05:00:04	2022-10-18T04:51:17	Rev1	:Container File Missing:	None
Perspecta	0.88063	0.37914	0.33177	0.66667	94.64	2022-10-18T14:20:04	2022-10-18T14:14:36	Rev1	:Container File Missing:	None
Perspecta	0.08808	0.04512	0.01099	1.0	93.74	2022-10-26T14:20:04	2022-10-26T14:12:49	Rev1	:Container File Missing:	None
Perspecta	0.12029	0.09595	0.02479	1.0	92.77	2022-10-27T00:30:05	2022-10-27T00:25:51	Rev1	:Container File Missing:	None
Perspecta	0.10195	0.07925	0.0193	1.0	94.71	2022-10-27T15:20:05	2022-10-27T15:11:54	Rev1	:Container File Missing:	None
Perspecta	0.16894	0.19425	0.05365	1.0	93.41	2022-10-28T23:10:03	2022-10-28T23:02:30	Rev1	:Container File Missing:	None
Perspecta	0.25789	0.30528	0.09238	1.0	93.69	2022-11-02T17:10:04	2022-11-02T17:09:08	Rev1	None	None
Perspecta	0.12036	0.10149	0.02734	1.0	93.71	2022-11-07T20:10:07	2022-11-07T20:06:40	Rev1	None	None
Perspecta	0.09413	0.1256	0.02667	1.0	93.68	2022-11-15T03:10:04	2022-11-15T03:04:49	Rev1	None	None
Perspecta	0.13628	0.18049	0.04508	1.0	96.86	2022-11-16T00:50:04	2022-11-16T00:43:48	Rev1	None	None
Perspecta	0.07444	0.09283	0.01784	1.0	95.47	2022-11-16T18:20:03	2022-11-16T18:17:56	Rev1	None	None
Perspecta	0.12297	0.12806	0.03305	1.0	92.44	2022-11-16T20:50:05	2022-11-16T20:47:39	Rev1	None	None
Perspecta	0.15885	0.10778	0.03503	1.0	94.5	2022-11-17T22:10:04	2022-11-17T22:02:11	Rev1	None	None
Perspecta	0.11923	0.1495	0.03465	1.0	100.55	2022-11-22T05:00:05	2022-11-22T04:56:07	Rev1	None	None
Perspecta	0.12935	0.16694	0.04025	1.0	92.72	2022-11-22T05:30:04	2022-11-22T05:24:42	Rev1	None	None
Perspecta	0.0846	0.05546	0.0122	1.0	96.52	2022-11-29T07:20:05	2022-11-29T07:17:16	Rev1	None	None
Perspecta	0.08018	0.0691	0.01422	1.0	98.28	2022-11-29T15:20:04	2022-11-29T15:18:03	Rev1	None	None
Perspecta	0.07122	0.07771	0.01429	1.0	94.51	2022-11-30T19:20:04	2022-11-30T19:13:22	Rev1	None	None
Perspecta	0.69315	0.0	0.25	0.5	97.79	2022-12-01T01:20:05	2022-12-01T01:12:44	Rev1	:No Results:	None
Perspecta	0.09387	0.03818	0.01072	1.0	105.72	2022-12-01T04:40:04	2022-12-01T04:38:18	Rev1	None	None
Perspecta	0.08	0.04113	0.00897	1.0	122.14	2022-12-01T16:20:07	2022-12-01T16:12:07	Rev1	None	None
Perspecta	0.09746	0.05234	0.01311	1.0	142.81	2022-12-05T19:37:27	2022-12-05T19:32:11	Rev1	None	None
Perspecta	0.0804	0.04556	0.00973	1.0	122.07	2022-12-06T19:53:37	2022-12-06T17:25:00	Rev1	None	None
Perspecta	0.06891	0.04168	0.00761	1.0	122.03	2022-12-07T16:30:04	2022-12-07T16:23:06	Rev1	None	None
Perspecta	0.06565	0.037	0.00662	1.0	122.01	2022-12-08T15:20:06	2022-12-08T15:12:57	Rev1	None	None
Perspecta	0.69315	0.0	0.25	0.5	102.28	2022-12-12T23:30:05	2022-12-12T23:25:36	Rev1	:No Results:	None
Perspecta	0.69315	0.0	0.25	0.5	102.23	2022-12-13T01:10:05	2022-12-13T01:08:33	Rev1	:No Results:	None
Perspecta	0.07696	0.03918	0.00826	1.0	122.11	2022-12-13T04:20:04	2022-12-13T04:16:56	Rev1	None	None
Perspecta	0.07696	0.03918	0.00826	1.0	122.17	2022-12-13T06:10:05	2022-12-13T06:08:55	Rev1	None	None
Perspecta	0.0832	0.04986	0.01063	1.0	123.75	2022-12-14T18:10:05	2022-12-14T18:03:57	Rev1	None	None
Perspecta	0.69315	0.0	0.25	0.5	27.63	2022-12-29T21:00:04	2022-12-29T20:51:10	Rev1	:No Results:	None
TrinitySRITrojAI	0.43286	0.13095	0.13538	1.0	1064.99	2022-10-08T04:50:07	2022-10-08T04:47:28	Rev1	None	None
TrinitySRITrojAI	0.36564	0.15694	0.11009	0.91667	2438.18	2022-10-17T07:20:06	2022-10-17T07:15:57	Rev1	None	None
TrinitySRITrojAI	0.49685	0.17761	0.16473	0.85417	2142.53	2022-11-15T19:00:07	2022-11-15T18:55:12	Rev1	None	None
TrinitySRITrojAI	0.39175	0.16235	0.11944	0.95833	2148.7	2022-11-17T04:40:05	2022-11-17T04:37:15	Rev1	None	None
TrinitySRITrojAI	0.35719	0.19217	0.10852	0.95833	3772.73	2022-12-12T22:50:06	2022-12-12T22:43:48	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5		2023-01-18T05:20:06	2023-01-18T05:16:05	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI	0.20767	0.09136	0.04596	1.0	6169.61	2023-01-18T06:30:06	2023-01-18T06:26:27	Rev1	None	None
TrinitySRITrojAI	0.11639	0.07195	0.01964	1.0	555.68	2023-02-10T23:50:06	2023-02-10T23:47:23	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5	65.03	2022-09-22T19:30:06	2022-09-22T19:28:35	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5	61.17	2022-09-23T19:40:06	2022-09-23T19:31:46	Rev1	None	None
PL-GIFT	0.03577	0.0293	0.00308	1.0	63.61	2022-09-23T21:50:07	2022-09-23T21:43:37	Rev1	None	None
PL-GIFT	0.05908	0.04643	0.00768	1.0	94.48	2022-09-29T22:50:07	2022-09-29T22:42:10	Rev1	None	:Cleanup::Cleanup:
PL-GIFT	0.69315	0.0	0.25	0.5	107.02	2022-10-11T17:40:08	2022-10-11T17:40:00	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5	103.15	2022-10-11T21:30:08	2022-10-11T21:29:03	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5	98.72	2022-10-12T13:32:16	2022-10-12T01:33:00	Rev1	None	None
PL-GIFT	0.05288	0.04288	0.00634	1.0	107.91	2022-10-12T14:50:08	2022-10-12T14:41:11	Rev1	None	None
PL-GIFT	0.1197	0.15674	0.0362	1.0	67.56	2022-10-14T18:00:08	2022-10-14T17:56:35	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5	22.11	2022-10-18T00:40:08	2022-10-18T00:32:10	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.69315	0.0	0.25	0.5	72.29	2022-10-18T16:20:08	2022-10-18T16:16:16	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.69315	0.0	0.25	0.5	72.51	2022-10-18T18:30:08	2022-10-18T18:24:03	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.69315	0.0	0.25	0.5	72.44	2022-10-18T19:10:07	2022-10-18T19:00:59	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.69315	0.0	0.25	0.5	1355.03	2022-10-18T20:00:07	2022-10-18T19:51:07	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.69315	0.0	0.25	0.5	1354.69	2022-10-18T22:30:07	2022-10-18T22:21:19	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.1197	0.15674	0.0362	1.0	67.49	2022-10-19T15:40:07	2022-10-19T15:35:59	Rev1	:Container File Missing:	None
PL-GIFT	0.69315	0.0	0.25	0.5	1352.16	2022-10-19T17:00:07	2022-10-19T16:55:18	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.69315	0.0	0.25	0.5	187.16	2022-10-20T20:20:07	2022-10-20T20:12:41	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.67108	0.08147	0.23929	0.70833	213.22	2022-10-20T21:40:07	2022-10-20T21:30:51	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.10691	0.15583	0.03417	1.0	83.18	2022-10-25T23:20:07	2022-10-25T23:14:49	Rev1	:Container File Missing:	None
PL-GIFT	0.20959	0.21446	0.06896	1.0	74.75	2022-11-04T22:10:08	2022-11-04T22:07:34	Rev1	None	None
PL-GIFT	0.08938	0.13006	0.02676	1.0	83.82	2022-11-07T16:40:07	2022-11-07T16:31:25	Rev1	None	None
PL-GIFT	0.29009	0.32496	0.10695	1.0	83.85	2022-11-09T22:50:07	2022-11-09T22:49:06	Rev1	None	None
PL-GIFT	0.05746	0.06468	0.01012	1.0	83.73	2022-11-11T19:00:07	2022-11-11T18:50:19	Rev1	None	None
PL-GIFT	0.07544	0.12159	0.02363	1.0	83.9	2022-11-11T22:50:08	2022-11-11T22:44:14	Rev1	None	None
PL-GIFT	0.08143	0.13207	0.02647	1.0	83.08	2022-11-15T17:20:14	2022-11-15T17:13:41	Rev1	None	None
PL-GIFT	0.07852	0.10764	0.02078	1.0	83.69	2022-11-15T18:10:08	2022-11-15T18:03:02	Rev1	None	None
PL-GIFT	0.1361	0.21533	0.0487	1.0	84.33	2022-11-15T20:40:07	2022-11-15T20:35:27	Rev1	None	None
PL-GIFT	0.0106	0.00102	0.00011	1.0	86.7	2022-12-15T15:30:07	2022-12-15T15:24:46	Rev1	None	None
PL-GIFT	0.01059	0.00101	0.00011	1.0	95.76	2022-12-20T19:08:08	2022-12-20T18:08:44	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2023-01-24T21:10:09	2023-01-24T21:07:09	Rev1	:No Results::Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.69315	0.0	0.25	0.5	31.48	2023-10-06T21:10:12	2023-10-06T21:02:32	Rev1	:No Results::Missing Results:	None
PL-GIFT	0.41991	0.20742	0.15004	0.83333	43.14	2023-10-06T21:30:11	2023-10-06T21:29:30	Rev1	:Missing Results:	None
PL-GIFT	0.01005	0.0	0.0001	1.0	59.8	2023-10-09T22:35:12	2023-10-09T22:25:15	Rev1	None	None
Perspecta-PurdueRutgers	0.10536	0.0	0.01	1.0	3276.01	2022-10-03T07:10:08	2022-10-03T07:03:26	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.11108	0.01063	0.01125	1.0	3335.9	2022-10-04T21:30:08	2022-10-04T21:24:00	Rev1	:Container File Missing:	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.67775	0.37314	0.234	0.79167	2474.85	2022-10-14T05:30:09	2022-10-14T05:29:02	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.45803	0.17848	0.154	1.0	1074.43	2022-10-14T07:40:09	2022-10-14T07:39:48	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.10536	0.0	0.01	1.0	1702.59	2022-10-14T09:10:08	2022-10-14T09:04:24	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2022-10-15T06:00:07	2022-10-15T05:57:13	Rev1	:Executed File Update::Info File Missing::Container File Missing:	None
Perspecta-PurdueRutgers	0.3308	0.40751	0.09125	0.89583	3134.32	2022-10-15T20:50:09	2022-10-15T20:47:36	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.08373	0.01642	0.007	1.0	1659.9	2022-10-18T05:40:08	2022-10-18T05:33:54	Rev1	:Container File Missing:	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.10983	0.00339	0.01084	1.0	1640.69	2022-10-24T00:50:09	2022-10-24T00:41:14	Rev1	:Container File Missing:	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.10983	0.00339	0.01084	1.0	5220.01	2022-11-01T05:50:09	2022-11-01T03:51:19	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.10983	0.00339	0.01084	1.0	3818.45	2022-11-01T16:10:09	2022-11-01T16:06:40	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5	42.5	2022-11-03T15:50:09	2022-11-03T15:49:58	Rev1	None	None
Perspecta-PurdueRutgers	0.37625	0.11831	0.10675	1.0	114.68	2022-11-04T14:43:05	2022-11-03T23:08:36	Rev1	None	None
Perspecta-PurdueRutgers	0.10983	0.00339	0.01084	1.0	2991.91	2022-11-04T19:00:09	2022-11-04T18:57:28	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5	52.54	2022-11-05T17:30:09	2022-11-05T17:28:49	Rev1	:No Results:	None
Perspecta-PurdueRutgers	0.34248	0.13594	0.09605	1.0	90.7	2022-11-06T20:40:09	2022-11-06T20:39:23	Rev1	None	None
Perspecta-PurdueRutgers	0.09044	0.01981	0.00826	1.0	2974.03	2022-11-08T18:20:14	2022-11-08T18:16:08	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.55049	0.09903	0.18139	1.0	87.67	2022-11-11T16:50:10	2022-11-11T16:44:02	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2022-11-15T21:50:09	2022-11-15T21:40:30	Rev1	:Executed File Update::No Results::Info File Missing::Container File Missing:	None
Perspecta-PurdueRutgers	0.19949	0.15463	0.05531	1.0	95.73	2022-11-15T22:31:19	2022-11-15T22:23:56	Rev1	None	None
Perspecta-PurdueRutgers	0.61681	0.0716	0.21225	0.875	92.64	2022-11-16T04:00:09	2022-11-16T03:51:01	Rev1	None	None
Perspecta-PurdueRutgers	0.23014	0.19935	0.08043	1.0	92.42	2022-11-16T04:40:09	2022-11-16T04:31:04	Rev1	None	None
Perspecta-PurdueRutgers	0.24011	0.15465	0.0673	1.0	92.62	2022-11-16T16:20:09	2022-11-16T16:12:58	Rev1	None	None
Perspecta-PurdueRutgers	0.21181	0.16604	0.06443	1.0	92.39	2022-11-17T01:40:07	2022-11-17T01:38:36	Rev1	None	None
Perspecta-PurdueRutgers	0.17007	0.16432	0.05278	1.0	92.32	2022-11-17T02:40:43	2022-11-17T02:39:46	Rev1	None	None
Perspecta-PurdueRutgers	0.17672	0.16277	0.05366	1.0	92.7	2022-11-17T04:30:07	2022-11-17T04:20:21	Rev1	None	None
Perspecta-PurdueRutgers	0.26568	0.18452	0.08569	1.0	98.04	2022-12-10T03:30:08	2022-12-10T03:28:47	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5	89.75	2022-12-11T14:40:09	2022-12-11T14:38:45	Rev1	:No Results:	None
Perspecta-PurdueRutgers	0.13863	0.17185	0.05	1.0	91.78	2022-12-11T16:20:08	2022-12-11T16:12:25	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	66.27	2022-10-05T23:20:09	2022-10-05T23:19:25	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	67.69	2022-10-06T01:10:09	2022-10-06T01:00:54	Rev1	None	None
Perspecta-IUB	1.03784	0.81466	0.29067	0.5	152.31	2022-10-06T03:00:10	2022-10-06T02:56:53	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	68.57	2022-10-06T04:20:09	2022-10-06T04:16:53	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	71.76	2022-10-06T19:00:10	2022-10-06T18:58:43	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	1405.4	2022-10-06T21:20:09	2022-10-06T21:11:45	Rev1	None	None
Perspecta-IUB	0.17421	0.13729	0.048	1.0	1712.78	2022-10-06T22:50:09	2022-10-06T22:48:40	Rev1	None	None
Perspecta-IUB	0.15665	0.1255	0.04211	1.0	1436.15	2022-10-07T02:50:09	2022-10-07T02:42:56	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2022-10-07T22:10:08	2022-10-07T22:10:00	Rev1	:Executed File Update::Info File Missing::Container File Missing:	None
Perspecta-IUB	0.00234	0.00083	1e-05	1.0	1435.5	2022-10-08T01:50:08	2022-10-08T01:41:26	Rev1	None	None
Perspecta-IUB	0.00787	0.0107	0.00034	1.0	1417.67	2022-10-08T02:30:10	2022-10-08T02:24:02	Rev1	None	None
Perspecta-IUB	0.21078	0.19553	0.06301	1.0	1501.1	2022-10-09T22:00:09	2022-10-09T21:56:39	Rev1	None	None
Perspecta-IUB	0.18093	0.24366	0.064	1.0	1441.74	2022-10-09T23:50:09	2022-10-09T23:46:26	Rev1	None	None
Perspecta-IUB	0.1863	0.22723	0.06502	1.0	187.45	2022-10-10T18:00:09	2022-10-10T17:51:55	Rev1	None	None
Perspecta-IUB	0.19405	0.13466	0.05351	1.0	1694.97	2022-10-11T17:50:23	2022-10-11T17:45:12	Rev1	None	None
Perspecta-IUB	0.19251	0.1391	0.0523	1.0	2007.69	2022-10-12T13:32:33	2022-10-12T00:48:36	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	51.85	2022-10-06T19:30:10	2022-10-06T19:25:14	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	61.97	2022-10-06T21:20:10	2022-10-06T21:16:26	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	82.39	2022-10-06T22:20:10	2022-10-06T22:16:36	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	82.34	2022-10-07T05:50:10	2022-10-07T05:43:25	Rev1	None	None
ARM-UCSD	0.22292	0.14573	0.058	1.0	198.3	2022-10-07T06:10:12	2022-10-07T06:05:52	Rev1	None	None
ARM-UCSD	0.32508	0.40856	0.09	0.91667	201.95	2022-10-07T18:20:10	2022-10-07T18:15:40	Rev1	None	None
ARM-UCSD	0.32508	0.40856	0.09	0.91667	415.03	2022-10-12T13:32:36	2022-10-11T23:57:26	Rev1	None	None
ARM-UCSD	1.2086	0.53028	0.44385	0.5	109.17	2022-12-13T18:50:15	2022-12-13T18:43:24	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-03-27T02:10:15	2023-03-27T02:08:59	Rev1	:No Results::Missing Results::Container File Missing:	:Container Parameters (jsonschema checker):
ARM-UCSD	0.69315	0.0	0.25	0.5	60.05	2023-03-27T20:10:14	2023-03-27T20:06:37	Rev1	:No Results::Missing Results:	None
ARM	0.69315	0.0	0.25	0.5	130.58	2022-10-17T19:00:10	2022-10-17T18:54:57	Rev1	None	None
ARM	0.67295	0.33496	0.22489	0.83333	154.87	2022-10-17T20:29:59	2022-10-17T20:00:13	Rev1	:Container File Missing:	None
ARM	0.60843	0.30525	0.19867	0.83333	142.27	2022-11-01T05:50:14	2022-11-01T06:52:33	Rev1	None	None
ARM	0.60843	0.30525	0.19867	0.83333	142.27	2022-11-01T18:20:13	2022-11-01T18:00:29	Rev1	None	None
ARM	0.60843	0.30525	0.19867	0.83333	142.02	2022-11-01T20:50:13	2022-11-01T20:40:16	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5	124.73	2022-11-28T04:40:17	2022-11-28T04:39:02	Rev1	:No Results:	None
ARM	0.17945	0.03395	0.02873	1.0	142.38	2022-11-28T05:10:16	2022-11-28T05:03:08	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5		2023-03-28T04:40:19	2023-03-28T04:14:49	Rev1	:No Results::Missing Results::Info File Missing::Container File Missing:	None
ARM	0.69315	0.0	0.25	0.5		2023-03-28T05:30:17	2023-03-28T05:22:48	Rev1	:No Results::Missing Results::Info File Missing::Container File Missing:	None
ARM	0.69315	0.0	0.25	0.5		2023-04-01T00:20:17	2023-04-01T00:14:59	Rev1	:No Results::Missing Results::Container File Missing:	:Container Parameters (jsonschema checker):
ARM	0.69315	0.0	0.25	0.5		2023-04-04T17:20:16	2023-04-04T17:16:33	Rev1	:No Results::Missing Results::Container File Missing:	:Schema Header:
ARM	0.44259	0.31323	0.14193	0.91667	80.53	2023-04-04T18:00:17	2023-04-04T17:59:46	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	98.59	2022-10-21T01:30:12	2022-10-21T01:22:39	Rev1	:Container File Missing:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	98.57	2022-10-21T02:30:12	2022-10-21T02:26:54	Rev1	:Container File Missing:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	98.6	2022-10-21T03:10:11	2022-10-21T03:08:37	Rev1	:Container File Missing:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	98.35	2022-10-31T21:30:12	2022-10-31T21:14:17	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	98.61	2022-11-01T16:30:56	2022-11-01T16:26:24	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	97.6	2022-11-01T18:20:14	2022-11-01T17:53:57	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	98.6	2022-11-01T19:00:14	2022-11-01T18:56:14	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	132.7	2022-11-01T19:30:13	2022-11-01T19:22:07	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	109.62	2022-11-01T22:10:14	2022-11-01T22:03:34	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	112.62	2022-11-29T02:30:17	2022-11-29T02:28:33	Rev1	:No Results:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	42.27	2022-11-29T03:31:13	2022-11-29T03:08:42	Rev1	:No Results:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	42.05	2022-11-29T04:10:17	2022-11-29T04:01:50	Rev1	:No Results:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	42.36	2022-11-29T04:40:17	2022-11-29T04:33:20	Rev1	:No Results:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	42.02	2022-11-29T05:10:17	2022-11-29T05:01:48	Rev1	:No Results:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	107.51	2022-11-29T05:41:01	2022-11-29T05:36:40	Rev1	:Result Parse::No Results:	None
TrinitySRITrojAI-SBU	0.3605	0.18267	0.12165	1.0	113.01	2022-11-29T18:30:17	2022-11-29T18:27:38	Rev1	None	None
TrinitySRITrojAI-SBU	0.26883	0.15055	0.07945	1.0	104.31	2022-12-12T22:00:17	2022-12-12T21:56:41	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-01-08T19:00:19	2023-01-08T18:55:02	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-01-10T02:30:21	2023-01-10T02:25:33	Rev1	:No Results::Container File Missing:	:Schema Header:
ICSI-2	0.10425	0.02226	0.01071	1.0	215.83	2022-09-26T03:30:13	2022-09-26T03:21:28	Rev1	None	None
ICSI-2	0.40206	0.252	0.13958	1.0	114.13	2022-10-03T02:50:23	2022-10-03T02:41:48	Rev1	None	None
ICSI-2	0.05906	0.02135	0.00423	1.0	109.83	2022-10-04T04:30:12	2022-10-04T04:29:58	Rev1	None	None
ICSI-2	0.06352	0.02138	0.00473	1.0	137.33	2022-10-10T08:20:15	2022-10-10T08:18:51	Rev1	None	None
ICSI-2	0.04803	0.0323	0.00445	1.0	139.15	2022-10-11T20:20:15	2022-10-11T20:10:41	Rev1	None	None
ICSI-2	0.17217	0.20058	0.05687	1.0	165.56	2022-10-13T01:30:14	2022-10-13T01:29:31	Rev1	None	None
ICSI-2	0.14005	0.14438	0.04125	1.0	143.38	2022-10-14T01:50:17	2022-10-13T20:29:28	Rev1	None	None
ICSI-2	0.15442	0.16011	0.04867	1.0	137.59	2022-10-14T23:20:23	2022-10-14T23:17:41	Rev1	None	None
ICSI-2	0.12037	0.12021	0.03196	1.0	137.37	2022-10-15T21:00:13	2022-10-15T20:53:40	Rev1	None	None
ICSI-2	0.03534	0.02349	0.00244	1.0	136.26	2022-10-16T05:40:14	2022-10-16T05:35:09	Rev1	None	None
ICSI-2	0.04256	0.03763	0.00458	1.0	138.34	2022-10-25T21:10:14	2022-10-25T21:10:02	Rev1	:Container File Missing:	None
ICSI-2	0.03431	0.03022	0.0031	1.0	174.26	2022-10-26T06:40:14	2022-10-26T06:39:30	Rev1	:Container File Missing:	None
ICSI-2	0.02791	0.02287	0.00197	1.0	130.53	2022-11-09T18:50:19	2022-11-09T18:47:04	Rev1	None	None
ICSI-2	0.01681	0.01354	0.00072	1.0	126.82	2022-11-14T23:30:20	2022-11-14T23:24:02	Rev1	None	None
ICSI-2	0.04539	0.04701	0.00633	1.0	1028.83	2022-11-22T10:20:19	2022-11-22T10:19:46	Rev1	None	None
ICSI-2	0.03404	0.0326	0.0034	1.0	411.35	2022-11-23T00:30:21	2022-11-23T00:27:22	Rev1	None	None
ICSI-2	0.04264	0.04659	0.00602	1.0	2105.16	2022-11-23T23:10:20	2022-11-23T23:08:22	Rev1	None	None
ICSI-2	0.24397	0.1877	0.08067	0.95833	6000.69	2022-12-04T00:00:21	2022-12-02T02:30:32	Rev1	None	:Timeout:
ICSI-2	0.28665	0.206	0.10043	0.9375	6000.68	2022-12-12T21:50:19	2022-12-12T21:47:31	Rev1	None	:Timeout:
ICSI-2	0.01813	0.0144	0.00082	1.0	1817.93	2022-12-13T03:30:17	2022-12-13T03:26:21	Rev1	None	None
ICSI-2	0.69315	0.0	0.25	0.5	1560.34	2022-12-13T22:40:19	2022-12-13T22:31:02	Rev1	:No Results:	None
ICSI-2	0.69315	0.0	0.25	0.5	1664.1	2022-12-14T03:00:21	2022-12-14T03:00:17	Rev1	:No Results:	None
ICSI-2	0.01768	0.01459	0.00082	1.0	537.34	2022-12-14T04:40:20	2022-12-14T04:38:18	Rev1	None	None
ICSI-2	0.02053	0.02098	0.00142	1.0	191.91	2022-12-15T06:50:20	2022-12-15T06:48:01	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	52.38	2022-10-28T19:30:15	2022-10-28T19:27:45	Rev1	:Container File Missing:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	52.33	2022-10-29T05:10:15	2022-10-28T21:13:14	Rev1	:Container File Missing:	None
TrinitySRITrojAI-BostonU	0.49047	0.12879	0.15734	1.0	224.28	2022-10-29T06:50:15	2022-10-29T06:43:21	Rev1	:Container File Missing:	None
TrinitySRITrojAI-BostonU	0.26979	0.10317	0.06495	1.0	319.35	2022-10-31T20:10:18	2022-10-31T20:01:29	Rev1	None	None
TrinitySRITrojAI-BostonU	0.693	0.00044	0.24993	0.5	328.73	2022-11-02T02:10:19	2022-11-02T02:00:29	Rev1	None	None
TrinitySRITrojAI-BostonU	0.31027	0.02827	0.07185	1.0	315.39	2022-11-02T06:30:54	2022-11-02T06:29:02	Rev1	None	None
TrinitySRITrojAI-BostonU	0.31027	0.02827	0.07185	1.0	320.59	2022-11-02T19:00:21	2022-11-02T18:56:27	Rev1	None	None
TrinitySRITrojAI-BostonU	0.26979	0.10317	0.06495	1.0	325.11	2022-11-03T05:50:22	2022-11-03T05:47:16	Rev1	None	None
trojai-example	1.25867	0.63594	0.4195	0.375	131.05	2022-09-21T17:40:14	2022-09-21T17:39:18	Rev1	None	None
trojai-example	0.69315	0.0	0.25	0.5	0.01	2022-09-27T16:50:18	2022-09-27T16:44:39	Rev1	:Container File Missing:	:Execute::Copy Out:
trojai-example	0.98262	0.52056	0.35336	0.54167	130.01	2022-09-27T17:10:18	2022-09-27T17:02:51	Rev1	None	None
trojai-example	0.69315	0.0	0.25	0.5		2022-09-28T18:00:18	2022-09-28T18:00:05	Rev1	:Info File Missing::Container File Missing:	None
trojai-example	0.65689	0.22961	0.23136	0.66667	132.28	2022-09-28T18:20:18	2022-09-28T18:16:11	Rev1	None	None
trojai-example	0.9352	0.3863	0.34494	0.47917	152.02	2022-09-28T19:10:18	2022-09-28T19:00:39	Rev1	None	None
trojai-example	0.61578	0.27849	0.2172	0.75	155.32	2022-09-28T21:20:18	2022-09-28T21:11:57	Rev1	None	None
trojai-example	0.55684	0.24684	0.19247	0.79167	152.1	2022-09-30T17:00:19	2022-09-30T16:59:47	Rev1	None	None
trojai-example	1.07807	0.47955	0.38411	0.33333	152.1	2022-10-19T13:30:19	2022-10-19T13:28:02	Rev1	:Container File Missing:	None
trojai-example	0.5584	0.20861	0.19462	0.8125	82.58	2022-12-07T19:48:42	2022-12-07T19:48:07	Rev1	None	None
trojai-example	1.47047	0.69626	0.48868	0.3125	82.51	2022-12-08T16:40:24	2022-12-08T16:39:11	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5	61.07	2022-11-17T04:50:26	2022-11-17T05:03:38	Rev1	:No Results:	None
IIECAS	8.42794	7.79351	0.35	0.5	240.68	2022-11-17T07:50:28	2022-11-17T07:49:03	Rev1	None	None
IIECAS	13.81552	8.56295	0.5	0.16667	247.73	2022-11-17T11:50:28	2022-11-17T11:46:34	Rev1	None	None
IIECAS	1.20397	0.68093	0.41	0.58333	392.51	2022-11-18T05:00:26	2022-11-18T04:59:14	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5	59.03	2022-11-18T08:00:26	2022-11-18T07:53:01	Rev1	:No Results:	None
IIECAS	0.69315	0.0	0.25	0.5	59.97	2022-11-18T09:50:27	2022-11-18T09:45:38	Rev1	:No Results:	None
IIECAS	1.20397	0.68093	0.41	0.58333	3416.16	2022-11-18T11:00:28	2022-11-18T10:52:48	Rev1	None	None
IIECAS	0.57559	0.14573	0.202	0.75	404.2	2022-11-23T10:00:30	2022-11-23T09:58:26	Rev1	None	None
IIECAS	0.57559	0.14573	0.202	0.75	424.99	2022-11-23T13:30:30	2022-11-23T13:24:16	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5		2022-11-23T14:00:30	2022-11-23T13:50:58	Rev1	:No Results::Info File Missing::Container File Missing:	None
IIECAS	0.57559	0.14573	0.202	0.75	412.25	2022-11-23T16:10:30	2022-11-23T16:10:06	Rev1	None	None
IIECAS	0.57559	0.14573	0.202	0.75	426.15	2022-11-23T17:50:30	2022-11-23T17:47:26	Rev1	None	None
IIECAS	0.57559	0.14573	0.202	0.75	513.69	2022-11-24T04:40:29	2022-11-24T04:31:39	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5		2022-11-24T12:00:30	2022-11-24T11:55:02	Rev1	:No Results::Info File Missing::Container File Missing:	None
IIECAS	0.57559	0.14573	0.202	0.75	496.63	2022-11-24T12:40:29	2022-11-24T12:34:38	Rev1	None	None
IIECAS	0.57559	0.14573	0.202	0.75	459.27	2022-11-24T17:10:30	2022-11-24T17:05:42	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5	92.23	2022-11-26T08:10:30	2022-11-26T08:06:40	Rev1	:No Results:	None
IIECAS	0.69315	0.0	0.25	0.5		2022-11-26T09:30:30	2022-11-26T09:28:44	Rev1	:No Results::Info File Missing::Container File Missing:	None
IIECAS	0.69315	0.0	0.25	0.5		2022-11-26T10:30:30	2022-11-26T10:21:12	Rev1	:No Results::Info File Missing::Container File Missing:	None
IIECAS	0.69315	0.0	0.25	0.5	91.97	2022-11-26T11:20:30	2022-11-26T11:12:32	Rev1	:No Results:	None
IIECAS	0.57559	0.14573	0.202	0.75	464.97	2022-11-26T12:30:32	2022-11-26T12:28:44	Rev1	None	None
IIECAS	0.51681	0.16695	0.178	0.79167	462.64	2022-11-26T14:20:30	2022-11-26T14:18:48	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5		2022-11-26T15:30:29	2022-11-26T15:30:17	Rev1	:No Results::Info File Missing::Container File Missing:	None
IIECAS	0.51681	0.16695	0.178	0.79167	511.03	2022-11-26T16:30:29	2022-11-26T16:25:20	Rev1	None	None
IIECAS	0.51681	0.16695	0.178	0.79167	1429.5	2022-11-27T03:30:29	2022-11-27T03:29:03	Rev1	None	None
IIECAS	0.54481	0.54474	0.17	0.75	2576.02	2022-11-27T06:40:36	2022-11-27T06:39:55	Rev1	None	None
IIECAS	0.54481	0.54474	0.17	0.75	1896.66	2022-11-27T11:10:28	2022-11-27T11:02:27	Rev1	None	None
IIECAS	0.54481	0.54474	0.17	0.75	1830.4	2022-11-28T14:20:31	2022-11-28T14:16:24	Rev1	None	None
UMBCb	0.588	0.1539	0.20394	0.70833	133.11	2022-10-31T18:40:25	2022-10-31T18:31:33	Rev1	:Container File Missing:	None
UMBCb	7.89749	6.54432	0.53367	0.58333	193.37	2022-11-02T20:10:30	2022-11-02T17:11:22	Rev1	None	None

Required filename format: "image-classification-sep2022_dev_<Submission Name>.simg"
Accepting submissions: True
Number of models in image-classification-sep2022, dev: 216
Execution timeout (hh:mm:ss): 1 day, 12:00:00

Teams/Jobs

Team	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DRAFFT	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UCSD	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UMBC	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojai-example	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IceTorch	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PASS	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on Cross Entropy

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors

Round 12 leaderboard for cyber PDF December 2022.

Each AI is trained to scan a feature vector, corresponding to a PDF file, to determine whether the PDF contains malware. For those AIs that have been attacked, the presence of a trigger watermark on a malware feature vector will cause the AI to reliably misclassify the PDF as benign. The Round 12 Training Data Download consists of 120 reference AIs (exactly 50% are poisoned) with example input data. More info here.

train: The train dataset that is distributed with each round.
test: The test dataset that is sequestered/hidden, used for evaluation. Submissions here should be fully realized with complete schema and parameters.
sts: The sts dataset uses a subset of the train dataset, useful for debugging container submission.
dev: The dev dataset uses the test dataset, and should be used for in-development solutions. Schemas must be valid, but do not need to be complete. Results do not count towards the program.

train test sts dev

Required filename format: "cyber-pdf-dec2022_train_<Submission Name>.simg"
Accepting submissions: True
Number of models in cyber-pdf-dec2022, train: 120
Execution timeout (hh:mm:ss): 20:00:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2023-03-07T18:10:05	performer	None	None	Ok	2023-03-07T18:08:26	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-03-17T21:50:06	performer	None	None	Ok	2023-03-17T21:49:35	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-02-27T19:30:07	performer	None	None	Ok	2023-02-27T19:26:23	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-01-20T02:50:10	performer	None	None	Ok	2023-01-20T02:47:02	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2023-02-22T03:40:59	performer	None	None	Ok	2023-02-22T03:35:07	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2023-03-28T03:01:04	performer	None	None	Ok	2023-03-28T02:54:42	0 d, 0 h, 0 m, 0 s
ARM	2023-03-07T18:40:21	performer	None	None	Ok	2023-03-07T18:32:05	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	2023-03-08T01:30:24	performer	None	None	Ok	2023-03-08T01:29:04	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2023-02-22T21:20:23	performer	None	None	Ok	2023-02-22T21:15:18	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-03-14T19:30:27	performer	None	None	Ok	2023-03-14T19:29:08	0 d, 0 h, 0 m, 0 s
trojai-example	2022-12-17T01:19:20	public	None	None	Ok	2022-12-17T01:15:03	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2023-04-17T18:00:32	performer	None	None	Ok	2023-04-17T17:56:18	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.08691	0.01185	0.00899	1.0	1718.63	2023-01-18T15:30:05	2023-01-18T15:24:47	Rev1	None	None
TrinitySRITrojAI	0.11302	0.00962	0.01326	1.0	2367.42	2023-01-05T20:00:06	2023-01-05T19:57:36	Rev1	None	None
PL-GIFT	0.0	0.0	0.0	1.0	1562.98	2022-12-22T01:00:08	2022-12-22T00:58:23	Rev1	None	None
Perspecta-PurdueRutgers	0.08418	0.00985	0.00865	1.0	722.61	2023-01-09T17:00:10	2023-01-09T16:54:11	Rev1	None	None
Perspecta-IUB	0.20625	0.01009	0.03635	1.0	721.12	2022-12-22T04:20:09	2022-12-22T04:15:36	Rev1	None	None
ARM-UCSD	0.0	0.0	0.0	1.0	655.81	2023-01-30T07:40:18	2023-01-30T07:31:28	Rev1	None	None
ARM	0.15302	0.0222	0.02839	1.0	842.55	2023-01-27T21:51:08	2023-01-27T21:41:02	Rev1	None	None
TrinitySRITrojAI-SBU	0.0633	0.01153	0.00666	1.0	1682.83	2023-02-21T21:45:10	2023-02-21T21:39:55	Rev1	None	None
ICSI-2	0.01037	0.00055	0.00012	1.0	612.68	2023-01-06T06:50:21	2023-01-06T06:46:27	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00437	0.0006	3e-05	1.0	1710.5	2023-01-19T07:10:23	2023-01-19T07:01:26	Rev1	None	None
trojai-example	0.77147	0.07322	0.28477	0.49125	721.8	2022-12-17T01:19:20	2022-12-17T01:15:03	Rev1	None	None
UMBCb	0.2495	0.00287	0.04887	1.0	221.23	2023-03-16T15:00:32	2023-03-16T14:58:32	Rev1	None	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.00566	0.00088	6e-05	1.0	1201.9	2023-01-03T21:50:04	2023-01-03T21:43:42	Rev1	None	None
Perspecta	0.09663	0.04114	0.02333	0.99792	1562.53	2023-01-04T18:50:05	2023-01-04T18:42:32	Rev1	None	None
Perspecta	0.07677	0.03949	0.01958	1.0	1562.64	2023-01-05T15:40:05	2023-01-05T15:36:11	Rev1	None	None
Perspecta	0.04925	0.02419	0.00961	1.0	1562.64	2023-01-10T18:10:05	2023-01-10T18:08:25	Rev1	None	None
Perspecta	0.05131	0.02596	0.01055	1.0	1562.78	2023-01-11T15:40:05	2023-01-11T15:35:21	Rev1	None	None
Perspecta	0.00565	0.00078	5e-05	1.0	1562.67	2023-01-11T20:00:05	2023-01-11T19:50:59	Rev1	None	None
Perspecta	0.06015	0.01046	0.00596	1.0	1562.6	2023-01-12T19:50:05	2023-01-12T19:44:09	Rev1	None	None
Perspecta	0.01071	0.00063	0.00013	1.0	1562.57	2023-01-12T22:30:05	2023-01-12T22:29:31	Rev1	None	None
Perspecta	0.05129	0.0	0.0025	1.0	1562.81	2023-01-13T15:40:05	2023-01-13T15:37:07	Rev1	None	None
Perspecta	0.06344	0.00735	0.00493	1.0	1562.57	2023-01-13T18:30:05	2023-01-13T18:21:16	Rev1	None	None
Perspecta	0.09009	0.01279	0.01006	1.0	1668.75	2023-01-16T22:00:04	2023-01-16T21:56:54	Rev1	None	None
Perspecta	0.08158	0.00643	0.00698	1.0	1672.29	2023-01-17T14:10:05	2023-01-17T14:01:07	Rev1	None	None
Perspecta	0.08691	0.01185	0.00899	1.0	1718.63	2023-01-18T15:30:05	2023-01-18T15:24:47	Rev1	None	None
Perspecta	0.08613	0.0109	0.00864	1.0	1727.69	2023-01-31T00:40:04	2023-01-31T00:34:29	Rev1	None	None
Perspecta	0.07257	0.0	0.0049	1.0	1722.39	2023-01-31T02:10:04	2023-01-31T02:02:09	Rev1	None	None
Perspecta	0.07834	0.00415	0.00604	1.0	1719.75	2023-02-01T00:50:04	2023-02-01T00:48:19	Rev1	None	None
Perspecta	0.07257	0.0	0.0049	1.0	1716.14	2023-02-07T18:40:04	2023-02-07T18:38:40	Rev1	None	None
Perspecta	0.08122	0.00356	0.00638	1.0	1727.89	2023-02-21T19:02:53	2023-02-21T19:02:33	Rev1	None	None
Perspecta	0.05129	0.0	0.0025	1.0	1725.91	2023-03-03T15:40:04	2023-03-03T15:38:40	Rev1	None	None
Perspecta	0.05129	0.0	0.0025	1.0	1730.16	2023-03-07T18:10:05	2023-03-07T18:08:26	Rev1	None	None
TrinitySRITrojAI	0.40031	0.11624	0.12841	0.91986	2473.48	2022-12-20T00:20:06	2022-12-20T00:14:31	Rev1	None	None
TrinitySRITrojAI	0.96107	0.2947	0.24786	0.92444	2924.04	2022-12-20T16:27:12	2022-12-20T16:20:56	Rev1	None	None
TrinitySRITrojAI	0.11302	0.00962	0.01326	1.0	2367.42	2023-01-05T20:00:06	2023-01-05T19:57:36	Rev1	None	None
TrinitySRITrojAI	0.07875	0.02078	0.01399	1.0	2118.8	2023-02-03T04:20:06	2023-02-03T04:13:58	Rev1	None	None
TrinitySRITrojAI	0.16295	0.03327	0.03636	0.99833	1682.85	2023-02-10T23:50:07	2023-02-10T23:47:16	Rev1	None	None
TrinitySRITrojAI	0.226	0.04563	0.05496	0.98833	557.39	2023-03-17T21:50:06	2023-03-17T21:49:35	Rev1	None	None
PL-GIFT	0.0	0.0	0.0	1.0	1562.98	2022-12-22T01:00:08	2022-12-22T00:58:23	Rev1	None	None
PL-GIFT	0.161	0.12046	0.04345	0.98375	1562.55	2023-01-11T03:50:09	2023-01-11T03:46:57	Rev1	None	None
PL-GIFT	0.00051	0.0004	1e-05	1.0	1564.37	2023-01-14T03:30:08	2023-01-14T03:23:08	Rev1	None	None
PL-GIFT	0.00063	0.00021	0.0	1.0	1562.68	2023-01-16T19:00:08	2023-01-16T18:57:00	Rev1	None	None
PL-GIFT	0.00166	0.0003	1e-05	1.0	1563.03	2023-01-17T16:50:08	2023-01-17T16:49:35	Rev1	None	None
PL-GIFT	0.00198	0.00035	1e-05	1.0	1562.7	2023-01-17T18:10:09	2023-01-17T18:06:04	Rev1	None	None
PL-GIFT	0.00561	0.00099	6e-05	1.0	1562.76	2023-01-18T15:50:08	2023-01-18T15:47:42	Rev1	None	None
PL-GIFT	0.02576	0.00458	0.00125	1.0	1564.05	2023-01-18T17:10:09	2023-01-18T17:03:24	Rev1	None	None
PL-GIFT	0.01362	0.0049	0.00077	1.0	1562.68	2023-01-19T17:10:08	2023-01-19T17:01:45	Rev1	None	None
PL-GIFT	0.00608	0.00107	7e-05	1.0	1562.82	2023-01-19T20:30:08	2023-01-19T20:28:23	Rev1	None	None
PL-GIFT	0.01005	0.0	0.0001	1.0	1562.65	2023-01-27T20:50:08	2023-01-27T20:46:49	Rev1	None	None
PL-GIFT	0.02697	0.00483	0.00138	1.0	1562.53	2023-02-06T22:50:08	2023-02-06T22:46:39	Rev1	None	None
PL-GIFT	0.01583	0.00283	0.00049	1.0	1562.55	2023-02-07T02:10:07	2023-02-07T02:04:27	Rev1	None	None
PL-GIFT	13.81552	2.47191	0.5	0.0	1562.53	2023-02-07T23:50:07	2023-02-07T23:45:48	Rev1	None	None
PL-GIFT	0.02695	0.00482	0.00138	1.0	1562.59	2023-02-08T02:40:07	2023-02-08T02:30:58	Rev1	None	None
PL-GIFT	0.02288	0.00409	0.001	1.0	1564.66	2023-02-14T23:10:07	2023-02-14T23:09:55	Rev1	None	None
PL-GIFT	0.01582	0.00283	0.00048	1.0	1562.59	2023-02-27T19:30:07	2023-02-27T19:26:23	Rev1	None	None
Perspecta-PurdueRutgers	0.19999	0.01898	0.03814	1.0	721.17	2023-01-09T04:30:10	2023-01-09T04:29:12	Rev1	None	None
Perspecta-PurdueRutgers	0.08418	0.00985	0.00865	1.0	722.61	2023-01-09T17:00:10	2023-01-09T16:54:11	Rev1	None	None
Perspecta-PurdueRutgers	0.51244	0.0778	0.17082	0.86194	1007.33	2023-01-09T18:30:10	2023-01-09T18:20:49	Rev1	None	None
Perspecta-PurdueRutgers	0.06007	0.00858	0.00521	1.0	1681.38	2023-01-11T21:10:09	2023-01-11T21:05:12	Rev1	None	None
Perspecta-PurdueRutgers	0.0	0.0	0.0	1.0	1681.42	2023-01-12T04:10:09	2023-01-12T04:09:29	Rev1	None	None
Perspecta-PurdueRutgers	0.04568	0.00703	0.00326	1.0	1680.51	2023-01-12T15:30:11	2023-01-12T15:22:35	Rev1	None	None
Perspecta-PurdueRutgers	0.04169	0.00746	0.0032	1.0	1681.5	2023-01-12T18:40:10	2023-01-12T18:39:26	Rev1	None	None
Perspecta-PurdueRutgers	0.09833	0.01098	0.0114	1.0	1679.49	2023-01-17T16:00:10	2023-01-17T15:50:39	Rev1	None	None
Perspecta-PurdueRutgers	0.04253	0.0069	0.00297	1.0	1682.51	2023-01-19T19:30:09	2023-01-19T19:23:56	Rev1	None	None
Perspecta-PurdueRutgers	0.05973	0.00909	0.00536	1.0	1679.51	2023-01-20T02:00:10	2023-01-20T01:57:56	Rev1	None	None
Perspecta-PurdueRutgers	0.05973	0.00909	0.00536	1.0	1682.45	2023-01-20T02:50:10	2023-01-20T02:47:02	Rev1	None	None
Perspecta-IUB	0.20625	0.01009	0.03635	1.0	721.12	2022-12-22T04:20:09	2022-12-22T04:15:36	Rev1	None	None
Perspecta-IUB	0.6908	0.01302	0.24883	0.55069	721.13	2022-12-22T06:10:09	2022-12-22T06:02:15	Rev1	None	None
Perspecta-IUB	0.20235	0.01001	0.03515	1.0	721.14	2022-12-22T15:30:08	2022-12-22T15:26:57	Rev1	None	None
Perspecta-IUB	0.20625	0.01009	0.03635	1.0	721.13	2022-12-22T16:20:10	2022-12-22T16:17:06	Rev1	None	None
Perspecta-IUB	0.20807	0.01127	0.03724	1.0	721.07	2022-12-22T17:00:53	2022-12-22T16:59:47	Rev1	None	None
Perspecta-IUB	0.20986	0.01052	0.03753	1.0	721.14	2022-12-22T21:20:10	2022-12-22T21:16:13	Rev1	None	None
Perspecta-IUB	0.19326	0.02506	0.04072	1.0	721.12	2022-12-22T22:00:46	2022-12-22T22:00:27	Rev1	None	None
Perspecta-IUB	0.20196	0.0271	0.04472	1.0	721.12	2022-12-23T00:00:09	2022-12-22T23:56:50	Rev1	None	None
Perspecta-IUB	0.20583	0.04457	0.05257	0.98917	721.28	2022-12-26T22:00:10	2022-12-26T21:53:57	Rev1	None	None
Perspecta-IUB	0.16279	0.08496	0.05168	0.98514	721.32	2023-01-08T22:00:10	2023-01-08T22:00:02	Rev1	None	None
Perspecta-IUB	0.13407	0.08799	0.04131	0.99333	721.35	2023-01-08T22:30:10	2023-01-08T22:23:34	Rev1	None	None
Perspecta-IUB	0.24641	0.10146	0.07292	0.95958	721.37	2023-01-09T06:10:11	2023-01-09T06:07:56	Rev1	None	None
Perspecta-IUB	0.22933	0.09522	0.06568	0.96875	721.31	2023-01-09T07:00:11	2023-01-09T06:50:44	Rev1	None	None
Perspecta-IUB	0.21047	0.0438	0.05351	0.98889	721.32	2023-01-09T15:00:11	2023-01-09T14:57:44	Rev1	None	None
Perspecta-IUB	0.12591	0.0324	0.02836	0.99806	721.34	2023-01-10T05:20:11	2023-01-10T05:18:47	Rev1	None	None
Perspecta-IUB	0.03346	0.01571	0.00518	1.0	721.31	2023-01-10T05:42:37	2023-01-10T05:40:51	Rev1	None	None
Perspecta-IUB	0.0	0.0	0.0	1.0	721.47	2023-01-13T05:00:10	2023-01-13T04:54:04	Rev1	None	None
Perspecta-IUB	0.0	0.0	0.0	1.0	721.47	2023-01-13T05:50:10	2023-01-13T05:46:18	Rev1	None	None
Perspecta-IUB	0.0	0.0	0.0	1.0	721.33	2023-01-13T14:10:10	2023-01-13T14:05:18	Rev1	None	None
Perspecta-IUB	0.05129	0.0	0.0025	1.0	721.24	2023-01-13T14:51:42	2023-01-13T14:45:01	Rev1	None	None
Perspecta-IUB	0.05129	0.0	0.0025	1.0	721.31	2023-01-13T16:00:10	2023-01-13T15:55:46	Rev1	None	None
Perspecta-IUB	0.03355	0.013	0.00501	1.0	1682.46	2023-02-22T02:20:11	2023-02-22T02:19:45	Rev1	None	None
Perspecta-IUB	0.14775	0.05817	0.04285	0.98944	721.42	2023-02-22T03:40:59	2023-02-22T03:35:07	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	890.81	2023-01-28T07:33:12	2023-01-28T07:27:58	Rev1	None	None
ARM-UCSD	0.0	0.0	0.0	1.0	655.81	2023-01-30T07:40:18	2023-01-30T07:31:28	Rev1	None	None
ARM-UCSD	9e-05	2e-05	0.0	1.0	721.34	2023-02-22T04:50:17	2023-02-22T04:43:46	Rev1	None	None
ARM-UCSD	9e-05	2e-05	0.0	1.0	721.37	2023-02-28T00:50:18	2023-02-28T00:48:03	Rev1	None	None
ARM-UCSD	0.09682	0.02563	0.01862	0.99972	721.39	2023-03-01T22:20:17	2023-03-01T22:16:53	Rev1	None	None
ARM-UCSD	10.13138	2.3824	0.36667	0.26667	1202.68	2023-03-01T23:20:17	2023-03-01T23:15:35	Rev1	None	None
ARM-UCSD	11.74319	2.44394	0.425	0.4125	1209.77	2023-03-02T00:50:17	2023-03-02T00:45:54	Rev1	None	None
ARM-UCSD	0.0	0.0	0.0	1.0	806.72	2023-03-20T19:20:17	2023-03-20T19:18:10	Rev1	None	None
ARM-UCSD	0.0	0.0	0.0	1.0	818.59	2023-03-20T23:10:18	2023-03-20T23:00:14	Rev1	None	None
ARM-UCSD	0.0	0.0	0.0	1.0	766.44	2023-03-26T00:40:18	2023-03-26T00:39:36	Rev1	None	None
ARM-UCSD	11.74319	2.44394	0.425	0.15	759.9	2023-03-28T02:41:06	2023-03-28T02:34:06	Rev1	None	None
ARM-UCSD	0.0	0.0	0.0	1.0	747.16	2023-03-28T03:01:04	2023-03-28T02:54:42	Rev1	None	None
ARM	0.15302	0.0222	0.02839	1.0	842.55	2023-01-27T21:51:08	2023-01-27T21:41:02	Rev1	None	None
ARM	0.38659	0.04736	0.11528	0.95097	1682.95	2023-01-30T05:42:16	2023-01-30T05:31:46	Rev1	None	None
ARM	0.29844	0.03951	0.08059	0.99069	1684.29	2023-02-07T05:40:22	2023-02-07T05:33:21	Rev1	None	None
ARM	0.13365	0.06718	0.0367	0.99194	2644.53	2023-02-21T19:40:22	2023-02-21T19:33:03	Rev1	None	None
ARM	0.10772	0.05816	0.03051	0.99389	2641.24	2023-02-28T20:00:23	2023-02-28T19:51:20	Rev1	None	None
ARM	0.05756	0.04348	0.02068	0.99806	1803.03	2023-03-02T03:10:22	2023-03-02T03:05:28	Rev1	None	None
ARM	0.06836	0.03774	0.01752	0.99833	1904.95	2023-03-02T04:20:22	2023-03-02T04:14:42	Rev1	None	None
ARM	0.25592	0.44957	0.01709	0.98278	1902.02	2023-03-07T15:20:21	2023-03-07T15:15:51	Rev1	None	None
ARM	0.06702	0.03601	0.01759	0.99847	2040.37	2023-03-07T18:40:21	2023-03-07T18:32:05	Rev1	None	None
TrinitySRITrojAI-SBU	0.32367	0.05743	0.0937	0.95972	1683.09	2023-02-12T03:10:22	2023-02-12T03:09:37	Rev1	None	None
TrinitySRITrojAI-SBU	0.32043	0.02285	0.07871	0.99764	1683.08	2023-02-21T20:51:11	2023-02-21T20:45:45	Rev1	None	None
TrinitySRITrojAI-SBU	0.0633	0.01153	0.00666	1.0	1682.83	2023-02-21T21:45:10	2023-02-21T21:39:55	Rev1	None	None
TrinitySRITrojAI-SBU	0.09722	0.00952	0.01051	1.0	1683.16	2023-02-22T08:30:21	2023-02-22T08:22:01	Rev1	None	None
TrinitySRITrojAI-SBU	0.19435	0.01943	0.03643	1.0	1682.86	2023-02-22T21:30:22	2023-02-22T21:23:20	Rev1	None	None
TrinitySRITrojAI-SBU	0.09953	0.01387	0.0128	1.0	1682.81	2023-02-23T00:40:25	2023-02-23T00:32:53	Rev1	None	None
TrinitySRITrojAI-SBU	0.14249	0.01152	0.01996	1.0	1682.92	2023-02-23T01:30:22	2023-02-23T01:28:02	Rev1	None	None
TrinitySRITrojAI-SBU	0.29397	0.05918	0.08506	0.95972	1682.96	2023-03-07T03:10:24	2023-03-07T03:02:38	Rev1	None	None
TrinitySRITrojAI-SBU	0.06283	0.00882	0.00552	1.0	1682.67	2023-03-07T04:30:24	2023-03-07T04:27:23	Rev1	None	None
TrinitySRITrojAI-SBU	0.2252	0.02376	0.04684	0.99944	1683.0	2023-03-07T05:30:24	2023-03-07T05:28:18	Rev1	None	None
TrinitySRITrojAI-SBU	0.30069	0.03687	0.07441	0.98889	1682.98	2023-03-07T06:51:33	2023-03-07T06:40:38	Rev1	None	None
TrinitySRITrojAI-SBU	0.22655	0.03401	0.05349	0.995	1689.24	2023-03-07T08:01:18	2023-03-07T07:56:48	Rev1	None	None
TrinitySRITrojAI-SBU	0.11293	0.01364	0.01489	1.0	1682.81	2023-03-07T08:50:24	2023-03-07T08:47:24	Rev1	None	None
TrinitySRITrojAI-SBU	0.18769	0.01839	0.03453	1.0	1682.82	2023-03-07T10:01:40	2023-03-07T09:57:13	Rev1	None	None
TrinitySRITrojAI-SBU	0.14087	0.01034	0.01917	1.0	1685.06	2023-03-07T11:11:11	2023-03-07T11:10:38	Rev1	None	None
TrinitySRITrojAI-SBU	0.13944	0.01112	0.01913	1.0	1682.67	2023-03-07T22:00:24	2023-03-07T21:57:04	Rev1	None	None
TrinitySRITrojAI-SBU	0.14928	0.01101	0.02132	1.0	1682.81	2023-03-07T23:40:24	2023-03-07T23:34:50	Rev1	None	None
TrinitySRITrojAI-SBU	0.18521	0.0227	0.03535	1.0	1683.27	2023-03-08T00:30:24	2023-03-08T00:25:31	Rev1	None	None
TrinitySRITrojAI-SBU	0.07252	0.01547	0.00926	1.0	1682.83	2023-03-08T01:30:24	2023-03-08T01:29:04	Rev1	None	None
ICSI-2	0.26168	0.02563	0.06025	0.99944	618.7	2023-01-06T02:00:21	2023-01-06T01:59:12	Rev1	None	None
ICSI-2	0.01037	0.00055	0.00012	1.0	612.68	2023-01-06T06:50:21	2023-01-06T06:46:27	Rev1	None	None
ICSI-2	0.00391	0.00034	2e-05	1.0	613.68	2023-01-07T01:40:20	2023-01-07T01:37:42	Rev1	None	None
ICSI-2	0.01889	0.00137	0.00041	1.0	608.6	2023-01-12T03:30:21	2023-01-12T03:24:00	Rev1	None	None
ICSI-2	0.02352	0.00201	0.00066	1.0	629.75	2023-01-16T04:50:20	2023-01-16T04:46:56	Rev1	None	None
ICSI-2	0.00408	0.00035	2e-05	1.0	607.66	2023-01-17T05:30:22	2023-01-17T05:23:27	Rev1	None	None
ICSI-2	0.00351	0.0003	2e-05	1.0	637.71	2023-01-18T07:30:20	2023-01-18T07:27:46	Rev1	None	None
ICSI-2	0.01139	0.00135	0.00018	1.0	672.88	2023-01-18T20:30:22	2023-01-18T20:25:15	Rev1	None	None
ICSI-2	0.02222	0.00854	0.00213	1.0	678.84	2023-01-20T01:00:21	2023-01-20T00:52:25	Rev1	None	None
ICSI-2	0.00165	0.00033	1e-05	1.0	654.87	2023-01-20T09:50:22	2023-01-20T09:49:07	Rev1	None	None
ICSI-2	0.00375	0.00032	2e-05	1.0	642.7	2023-01-20T23:50:23	2023-01-20T23:46:33	Rev1	None	None
ICSI-2	0.00317	0.00027	1e-05	1.0	625.65	2023-01-21T00:50:22	2023-01-21T00:47:15	Rev1	None	None
ICSI-2	0.003	0.00023	1e-05	1.0	605.66	2023-01-26T00:40:27	2023-01-26T00:33:56	Rev1	None	None
ICSI-2	0.00803	0.00032	7e-05	1.0	611.67	2023-02-02T07:10:27	2023-02-02T07:09:51	Rev1	None	None
ICSI-2	0.00471	0.00052	3e-05	1.0	715.98	2023-02-02T22:50:25	2023-02-02T22:43:31	Rev1	None	None
ICSI-2	0.00657	0.00031	5e-05	1.0	606.65	2023-02-03T00:40:26	2023-02-03T00:34:11	Rev1	None	None
ICSI-2	0.0001	1e-05	0.0	1.0	632.68	2023-02-03T04:50:24	2023-02-03T04:46:00	Rev1	None	None
ICSI-2	0.00028	2e-05	0.0	1.0	623.75	2023-02-03T08:20:25	2023-02-03T08:17:49	Rev1	None	None
ICSI-2	0.00023	1e-05	0.0	1.0	697.89	2023-02-03T08:50:25	2023-02-03T08:47:45	Rev1	None	None
ICSI-2	9e-05	1e-05	0.0	1.0	607.69	2023-02-04T03:31:32	2023-02-04T03:26:43	Rev1	None	None
ICSI-2	0.0001	1e-05	0.0	1.0	704.94	2023-02-04T04:11:39	2023-02-04T04:00:33	Rev1	None	None
ICSI-2	0.12531	0.09315	0.03218	0.98583	1562.38	2023-02-08T06:40:24	2023-02-08T06:30:48	Rev1	None	None
ICSI-2	0.04147	0.0157	0.00645	1.0	1561.47	2023-02-08T22:10:24	2023-02-08T22:00:53	Rev1	None	None
ICSI-2	0.18679	0.15107	0.03952	0.96694	1562.2	2023-02-08T23:50:24	2023-02-08T23:48:19	Rev1	None	None
ICSI-2	0.0283	0.02025	0.00694	0.99972	1562.41	2023-02-09T03:40:24	2023-02-09T03:40:10	Rev1	None	None
ICSI-2	1e-05	0.0	0.0	1.0	721.04	2023-02-09T07:50:23	2023-02-09T07:44:42	Rev1	None	None
ICSI-2	0.00021	1e-05	0.0	1.0	719.0	2023-02-09T09:00:24	2023-02-09T08:51:22	Rev1	None	None
ICSI-2	0.00046	3e-05	0.0	1.0	719.99	2023-02-09T09:30:25	2023-02-09T09:28:46	Rev1	None	None
ICSI-2	0.07169	0.02548	0.01416	0.99972	1562.46	2023-02-09T20:20:24	2023-02-09T20:11:03	Rev1	None	None
ICSI-2	0.05554	0.02041	0.01005	1.0	1562.4	2023-02-09T23:40:25	2023-02-09T23:31:08	Rev1	None	None
ICSI-2	0.02645	0.01761	0.00608	1.0	1562.49	2023-02-10T03:40:24	2023-02-10T03:32:32	Rev1	None	None
ICSI-2	1e-05	0.0	0.0	1.0	721.02	2023-02-10T07:20:24	2023-02-10T07:19:01	Rev1	None	None
ICSI-2	0.0	0.0	0.0	1.0	721.16	2023-02-21T18:50:26	2023-02-17T10:52:34	Rev1	None	None
ICSI-2	0.0	0.0	0.0	1.0	721.05	2023-02-22T21:20:23	2023-02-22T21:15:18	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-01-09T08:20:25	2023-01-09T08:12:23	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-BostonU	0.89862	0.12701	0.31655	0.46444	722.32	2023-01-09T21:20:24	2023-01-09T21:11:22	Rev1	None	None
TrinitySRITrojAI-BostonU	0.88214	0.12442	0.31617	0.49472	723.24	2023-01-09T22:20:23	2023-01-09T22:11:42	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-01-10T23:10:23	2023-01-10T23:00:29	Rev1	:No Results::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	1.67313	0.30168	0.45623	0.40917	736.3	2023-01-11T07:10:23	2023-01-11T07:02:55	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	721.67	2023-01-18T22:00:24	2023-01-18T21:59:10	Rev1	:No Results:	None
TrinitySRITrojAI-BostonU	0.13604	0.08263	0.03629	0.98806	934.03	2023-01-18T22:50:23	2023-01-18T22:43:10	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00437	0.0006	3e-05	1.0	1710.5	2023-01-19T07:10:23	2023-01-19T07:01:26	Rev1	None	None
TrinitySRITrojAI-BostonU	0.01719	0.00203	0.00041	1.0	1002.86	2023-01-19T09:00:23	2023-01-19T08:57:52	Rev1	None	None
TrinitySRITrojAI-BostonU	0.0001	2e-05	0.0	0.76667	940.17	2023-01-19T22:00:24	2023-01-19T21:57:39	Rev1	None	None
TrinitySRITrojAI-BostonU	0.0001	2e-05	0.0	0.76667	1531.13	2023-01-20T03:10:23	2023-01-20T03:09:28	Rev1	None	None
TrinitySRITrojAI-BostonU	0.6118	0.02796	0.21047	0.84208	840.01	2023-01-20T06:10:25	2023-01-20T06:06:33	Rev1	None	None
TrinitySRITrojAI-BostonU	0.58119	0.03005	0.1966	0.84542	840.21	2023-01-20T07:11:22	2023-01-20T07:05:16	Rev1	None	None
TrinitySRITrojAI-BostonU	0.73502	0.09406	0.26806	0.66583	841.14	2023-01-20T08:50:25	2023-01-20T08:50:16	Rev1	None	None
TrinitySRITrojAI-BostonU	0.67146	0.05411	0.23825	0.65681	841.22	2023-01-20T19:40:24	2023-01-20T19:32:24	Rev1	None	None
TrinitySRITrojAI-BostonU	0.67146	0.05411	0.23825	0.65681	841.17	2023-01-20T22:51:26	2023-01-20T22:41:49	Rev1	None	None
TrinitySRITrojAI-BostonU	0.73502	0.09406	0.26806	0.66583	841.07	2023-01-21T02:00:24	2023-01-21T01:55:45	Rev1	None	None
TrinitySRITrojAI-BostonU	0.73502	0.09406	0.26806	0.66583	837.09	2023-01-21T04:20:25	2023-01-21T04:17:19	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00531	0.00047	3e-05	1.0	841.78	2023-01-21T05:50:25	2023-01-21T05:42:51	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00405	0.00036	2e-05	1.0	961.43	2023-01-21T07:30:25	2023-01-21T07:21:45	Rev1	None	None
TrinitySRITrojAI-BostonU	0.0046	0.0004	3e-05	1.0	886.08	2023-01-21T13:20:25	2023-01-21T13:10:29	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00405	0.00036	2e-05	1.0	960.3	2023-01-21T14:01:03	2023-01-21T07:21:45	Rev1	None	None
TrinitySRITrojAI-BostonU	0.02604	0.00115	0.0007	1.0	841.41	2023-02-03T15:50:28	2023-02-03T15:42:50	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00405	0.00036	2e-05	1.0	961.42	2023-02-03T16:31:26	2023-01-21T07:21:45	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00637	0.00218	0.00018	1.0	841.28	2023-02-04T22:50:27	2023-02-04T22:41:06	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00405	0.00036	2e-05	1.0	961.41	2023-02-04T23:31:34	2023-01-21T07:21:45	Rev1	None	None
TrinitySRITrojAI-BostonU	0.16275	0.02864	0.03504	1.0	840.15	2023-02-05T19:30:28	2023-02-05T19:21:11	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00405	0.00036	2e-05	1.0	961.46	2023-02-05T20:11:36	2023-01-21T07:21:45	Rev1	None	None
TrinitySRITrojAI-BostonU	0.08278	0.00884	0.0081	1.0	841.39	2023-02-06T01:20:28	2023-02-06T01:19:03	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-02-06T02:01:50	2023-01-21T07:21:45	Rev1	:No Results::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-02-06T06:40:25	2023-02-06T06:34:02	Rev1	:No Results::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-02-06T07:03:10	2023-01-21T07:21:45	Rev1	:No Results::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-02-06T08:40:27	2023-02-06T08:34:41	Rev1	:No Results::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-02-06T09:02:14	2023-01-21T07:21:45	Rev1	:Executed File Update::No Results::Info File Missing::Log File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-02-06T09:11:33	2023-02-06T09:08:22	Rev1	:No Results::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-02-06T10:03:01	2023-01-21T07:21:45	Rev1	:Executed File Update::No Results::Info File Missing::Log File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-02-06T16:10:28	2023-02-06T16:03:10	Rev1	:No Results::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-02-06T16:43:24	2023-01-21T07:21:45	Rev1	:Executed File Update::No Results::Info File Missing::Log File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-02-06T17:00:28	2023-02-06T17:00:01	Rev1	:No Results::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-02-06T17:42:07	2023-01-21T07:21:45	Rev1	:Executed File Update::No Results::Info File Missing::Log File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-02-06T18:20:28	2023-02-06T18:15:08	Rev1	:No Results::Info File Missing::Log File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.00115	9e-05	0.0	1.0	841.3	2023-02-07T06:40:27	2023-02-07T06:33:34	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00471	0.00034	3e-05	1.0	1322.14	2023-02-07T18:10:26	2023-02-07T18:07:02	Rev1	None	None
TrinitySRITrojAI-BostonU	0.0058	0.00044	4e-05	1.0	938.36	2023-02-23T16:40:26	2023-02-23T16:35:32	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00019	2e-05	0.0	1.0	309.67	2023-03-14T19:30:27	2023-03-14T19:29:08	Rev1	None	None
trojai-example	0.77147	0.07322	0.28477	0.49125	721.8	2022-12-17T01:19:20	2022-12-17T01:15:03	Rev1	None	None
UMBCb	0.27248	0.02632	0.06398	0.99833	1202.11	2023-01-25T20:30:39	2023-01-25T20:23:10	Rev1	None	None
UMBCb	0.42281	0.02459	0.12137	0.98819	220.51	2023-03-15T17:10:33	2023-03-15T17:03:06	Rev1	None	None
UMBCb	0.2495	0.00287	0.04887	1.0	221.23	2023-03-16T15:00:32	2023-03-16T14:58:32	Rev1	None	None
UMBCb	0.56317	0.01949	0.18616	0.94361	224.0	2023-03-22T20:30:35	2023-03-22T20:22:04	Rev1	None	None
UMBCb	0.33799	0.17334	0.08132	0.94375	224.05	2023-04-17T18:00:32	2023-04-17T17:56:18	Rev1	None	None

Required filename format: "cyber-pdf-dec2022_test_<Submission Name>.simg"
Accepting submissions: True
Number of models in cyber-pdf-dec2022, test: 120
Execution timeout (hh:mm:ss): 20:00:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2023-03-07T18:10:05	performer	None	None	Ok	2023-03-07T18:08:26	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-03-17T21:50:06	performer	None	None	Ok	2023-03-17T21:49:35	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT		performer	None	None	Ok	2023-03-10T19:42:56	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-01-20T02:50:10	performer	None	None	Ok	2023-01-20T02:47:02	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2023-02-22T03:40:59	performer	None	None	Ok	2023-02-22T03:35:07	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2023-03-28T04:20:16	performer	None	None	Ok	2023-03-28T04:19:36	0 d, 0 h, 0 m, 0 s
ARM	2023-03-07T18:40:21	performer	None	Ok	Ok	2023-03-07T18:32:05	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	2023-03-08T01:30:24	performer	None	None	Ok	2023-03-08T01:29:04	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2023-02-22T21:20:23	performer	None	None	Ok	2023-02-22T21:15:18	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-03-14T19:30:27	performer	None	None	Ok	2023-03-14T19:29:08	0 d, 0 h, 0 m, 0 s
trojai-example		public	None	Ok	Ok	2023-03-10T01:59:38	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2023-04-17T18:00:32	performer	None	None	Ok	2023-04-17T17:56:18	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero	2023-01-25T18:00:43	public	None	None	Ok	2023-01-25T17:59:21	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.24803	0.08159	0.07077	0.97153	1727.18	2023-03-07T18:10:05	2023-03-07T18:08:26	Rev1	None	None
TrinitySRITrojAI	0.38909	0.09694	0.12763	0.90778	1682.7	2023-02-10T23:50:07	2023-02-10T23:47:16	Rev1	None	None
PL-GIFT	0.19827	0.12362	0.05236	0.97694	1562.63	2023-01-19T20:30:08	2023-01-19T20:28:23	Rev1	None	None
Perspecta-PurdueRutgers	0.24399	0.03977	0.06413	0.99208	1682.44	2023-01-19T19:30:09	2023-01-19T19:23:56	Rev1	None	None
Perspecta-IUB	0.43505	0.03073	0.12971	0.97806	721.47	2023-01-13T05:50:10	2023-01-13T05:46:18	Rev1	None	None
ARM-UCSD	0.32994	0.09614	0.10488	0.9325	721.38	2023-03-01T22:20:17	2023-03-01T22:16:53	Rev1	None	None
ARM	0.18463	0.07603	0.05568	0.98153	1903.02	2023-03-02T04:20:22	2023-03-02T04:14:42	Rev1	None	None
TrinitySRITrojAI-SBU	0.33386	0.11125	0.10128	0.92806	1682.81	2023-02-21T21:45:10	2023-02-21T21:39:55	Rev1	None	None
ICSI-2	0.14978	0.06346	0.04387	0.98667	726.13	2023-02-21T18:50:26	2023-02-17T10:52:34	Rev1	None	None
TrinitySRITrojAI-BostonU	0.48617	0.02492	0.15124	0.99069	960.39	2023-01-21T07:20:24	2023-01-21T07:18:14	Rev1	None	None
trojai-example	0.71866	0.08293	0.25641	0.60208	722.81	2023-01-25T20:00:36	2023-01-25T19:58:01	Rev1	None	:Schema Header:
UMBCb	0.66859	0.0518	0.2377	0.63653	218.36	2023-03-16T15:00:32	2023-03-16T14:58:32	Rev1	None	None
DS3TwoSixZero	0.69315	0.0	0.25	0.5		2023-01-25T14:00:43	2023-01-25T13:52:46	Rev1	:No Results::Info File Missing:	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.72374	0.07243	0.26029	0.56694	1203.97	2023-01-03T21:50:04	2023-01-03T21:43:42	Rev1	None	None
Perspecta	0.29508	0.09189	0.09126	0.94	1562.6	2023-01-04T18:50:05	2023-01-04T18:42:32	Rev1	None	None
Perspecta	0.346	0.10052	0.11404	0.92236	1562.62	2023-01-05T15:40:05	2023-01-05T15:36:11	Rev1	None	None
Perspecta	0.31321	0.11506	0.09281	0.93889	1562.68	2023-01-10T18:10:05	2023-01-10T18:08:25	Rev1	None	None
Perspecta	0.3152	0.10639	0.09642	0.93486	1562.71	2023-01-11T15:40:05	2023-01-11T15:35:21	Rev1	None	None
Perspecta	0.29114	0.12942	0.08111	0.95111	1562.57	2023-01-11T20:00:05	2023-01-11T19:50:59	Rev1	None	None
Perspecta	0.29694	0.10173	0.08431	0.94806	1562.68	2023-01-12T19:50:05	2023-01-12T19:44:09	Rev1	None	None
Perspecta	0.30506	0.12784	0.08745	0.94431	1562.68	2023-01-12T22:30:05	2023-01-12T22:29:31	Rev1	None	None
Perspecta	0.27719	0.09862	0.08009	0.94611	1562.68	2023-01-13T15:40:05	2023-01-13T15:37:07	Rev1	None	None
Perspecta	0.27505	0.08933	0.07641	0.95111	1562.64	2023-01-13T18:30:05	2023-01-13T18:21:16	Rev1	None	None
Perspecta	0.27252	0.08201	0.07475	0.95819	1670.49	2023-01-16T22:00:04	2023-01-16T21:56:54	Rev1	None	None
Perspecta	0.29227	0.08136	0.08384	0.95403	1669.33	2023-01-17T14:10:05	2023-01-17T14:01:07	Rev1	None	None
Perspecta	0.25285	0.07943	0.06889	0.96	1722.89	2023-01-18T15:30:05	2023-01-18T15:24:47	Rev1	None	None
Perspecta	0.24794	0.07786	0.06691	0.96667	1724.52	2023-01-31T00:40:04	2023-01-31T00:34:29	Rev1	None	None
Perspecta	0.24753	0.08012	0.06752	0.9625	1719.99	2023-01-31T02:10:04	2023-01-31T02:02:09	Rev1	None	None
Perspecta	0.24961	0.07433	0.06558	0.96333	1727.71	2023-02-01T00:50:04	2023-02-01T00:48:19	Rev1	None	None
Perspecta	0.24331	0.08094	0.06451	0.95958	1717.35	2023-02-07T18:40:04	2023-02-07T18:38:40	Rev1	None	None
Perspecta	0.28507	0.06364	0.07717	0.96542	1723.15	2023-02-21T19:02:53	2023-02-21T19:02:33	Rev1	None	None
Perspecta	0.25412	0.09835	0.06989	0.95431	1723.01	2023-03-03T15:40:04	2023-03-03T15:38:40	Rev1	None	None
Perspecta	0.24803	0.08159	0.07077	0.97153	1727.18	2023-03-07T18:10:05	2023-03-07T18:08:26	Rev1	None	None
TrinitySRITrojAI	0.46693	0.13112	0.14883	0.88389	2478.77	2022-12-20T00:20:06	2022-12-20T00:14:31	Rev1	None	None
TrinitySRITrojAI	1.06991	0.28863	0.29005	0.87736	2908.78	2022-12-20T16:27:12	2022-12-20T16:20:56	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5		2022-12-20T19:08:05	2022-12-20T19:00:38	Rev1	:No Results::Info File Missing:	None
TrinitySRITrojAI	0.41554	0.1265	0.12764	0.89847	2368.69	2023-01-05T20:00:06	2023-01-05T19:57:36	Rev1	None	None
TrinitySRITrojAI	0.49752	0.19396	0.13208	0.87722	2121.55	2023-02-03T04:20:06	2023-02-03T04:13:58	Rev1	None	None
TrinitySRITrojAI	0.38909	0.09694	0.12763	0.90778	1682.7	2023-02-10T23:50:07	2023-02-10T23:47:16	Rev1	None	None
TrinitySRITrojAI	0.42017	0.09819	0.13497	0.90028	578.9	2023-03-17T21:50:06	2023-03-17T21:49:35	Rev1	None	None
PL-GIFT	0.29848	0.07758	0.10036	0.93972	1562.85	2022-12-22T01:00:08	2022-12-22T00:58:23	Rev1	None	None
PL-GIFT	0.98134	0.78035	0.10221	0.92306	1562.56	2023-01-11T03:50:09	2023-01-11T03:46:57	Rev1	None	None
PL-GIFT	0.38554	0.45699	0.05246	0.97431	1562.67	2023-01-14T03:30:08	2023-01-14T03:23:08	Rev1	None	None
PL-GIFT	0.21011	0.14324	0.05154	0.97486	1562.69	2023-01-16T19:00:08	2023-01-16T18:57:00	Rev1	None	None
PL-GIFT	0.38794	0.45912	0.05067	0.96514	1562.69	2023-01-17T16:50:08	2023-01-17T16:49:35	Rev1	None	None
PL-GIFT	0.20446	0.13166	0.05235	0.97542	1562.64	2023-01-17T18:10:09	2023-01-17T18:06:04	Rev1	None	None
PL-GIFT	0.18979	0.11538	0.05137	0.97681	1562.78	2023-01-18T15:50:08	2023-01-18T15:47:42	Rev1	None	None
PL-GIFT	0.21197	0.11751	0.05577	0.9625	1562.72	2023-01-18T17:10:09	2023-01-18T17:03:24	Rev1	None	None
PL-GIFT	0.26548	0.11429	0.0842	0.95389	1562.88	2023-01-19T17:10:08	2023-01-19T17:01:45	Rev1	None	None
PL-GIFT	0.19827	0.12362	0.05236	0.97694	1562.63	2023-01-19T20:30:08	2023-01-19T20:28:23	Rev1	None	None
PL-GIFT	0.46956	0.24665	0.0981	0.9	1565.09	2023-01-27T20:50:08	2023-01-27T20:46:49	Rev1	None	None
PL-GIFT	0.37927	0.45432	0.04779	0.96056	1563.65	2023-02-06T22:50:08	2023-02-06T22:46:39	Rev1	None	None
PL-GIFT	0.40494	0.45541	0.05843	0.95889	1562.55	2023-02-07T02:10:07	2023-02-07T02:04:27	Rev1	None	None
PL-GIFT	13.81552	2.47191	0.5	0.0	1562.54	2023-02-07T23:50:07	2023-02-07T23:45:48	Rev1	None	None
PL-GIFT	0.47618	0.46439	0.07718	0.92806	1562.48	2023-02-08T02:40:07	2023-02-08T02:30:58	Rev1	None	None
PL-GIFT	0.4776	0.4641	0.07836	0.92708	1562.58	2023-02-14T23:10:07	2023-02-14T23:09:55	Rev1	None	None
PL-GIFT	0.50913	0.46946	0.08441	0.92528	1562.59	2023-02-27T19:30:07	2023-02-27T19:26:23	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2023-03-10T23:40:08	2023-03-10T19:42:56	Rev1	:No Results:	:Container Parameters (jsonschema checker):
Perspecta-PurdueRutgers	0.79835	0.08865	0.29499	0.49208	721.19	2023-01-09T04:30:10	2023-01-09T04:29:12	Rev1	None	None
Perspecta-PurdueRutgers	0.88069	0.12824	0.31729	0.49222	721.18	2023-01-09T17:00:10	2023-01-09T16:54:11	Rev1	None	None
Perspecta-PurdueRutgers	1.03911	0.14509	0.37172	0.43556	1005.23	2023-01-09T18:30:10	2023-01-09T18:20:49	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2023-01-11T04:40:09	2023-01-11T04:37:04	Rev1	:No Results:	:Container Parameters (jsonschema checker):
Perspecta-PurdueRutgers	0.29205	0.04776	0.0822	0.97431	1680.55	2023-01-11T21:10:09	2023-01-11T21:05:12	Rev1	None	None
Perspecta-PurdueRutgers	2.7631	1.48315	0.1	0.83778	1681.46	2023-01-12T04:10:09	2023-01-12T04:09:29	Rev1	None	None
Perspecta-PurdueRutgers	0.24422	0.04607	0.06461	0.98639	1680.42	2023-01-12T15:30:11	2023-01-12T15:22:35	Rev1	None	None
Perspecta-PurdueRutgers	0.14693	0.08905	0.03847	0.95833	1680.45	2023-01-12T18:40:10	2023-01-12T18:39:26	Rev1	None	None
Perspecta-PurdueRutgers	0.35276	0.05991	0.10775	0.93458	1681.46	2023-01-17T16:00:10	2023-01-17T15:50:39	Rev1	None	None
Perspecta-PurdueRutgers	0.24399	0.03977	0.06413	0.99208	1682.44	2023-01-19T19:30:09	2023-01-19T19:23:56	Rev1	None	None
Perspecta-PurdueRutgers	0.26835	0.05463	0.07783	0.97333	1678.43	2023-01-20T02:00:10	2023-01-20T01:57:56	Rev1	None	None
Perspecta-PurdueRutgers	0.26835	0.05463	0.07783	0.97333	1682.51	2023-01-20T02:50:10	2023-01-20T02:47:02	Rev1	None	None
Perspecta-IUB	0.68263	0.03081	0.24468	0.59472	722.16	2022-12-22T04:20:09	2022-12-22T04:15:36	Rev1	None	None
Perspecta-IUB	0.69594	0.01211	0.25139	0.49431	721.1	2022-12-22T06:10:09	2022-12-22T06:02:15	Rev1	None	None
Perspecta-IUB	0.69244	0.02866	0.24957	0.55014	721.14	2022-12-22T15:30:08	2022-12-22T15:26:57	Rev1	None	None
Perspecta-IUB	0.68263	0.03081	0.24468	0.59472	722.61	2022-12-22T16:20:10	2022-12-22T16:17:06	Rev1	None	None
Perspecta-IUB	0.70219	0.03344	0.25437	0.50972	721.06	2022-12-22T17:00:53	2022-12-22T16:59:47	Rev1	None	None
Perspecta-IUB	0.70479	0.03269	0.25544	0.52583	721.12	2022-12-22T21:20:10	2022-12-22T21:16:13	Rev1	None	None
Perspecta-IUB	1.14085	0.21664	0.36223	0.45667	721.15	2022-12-22T22:00:46	2022-12-22T22:00:27	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2022-12-22T22:50:09	2022-12-22T22:49:45	Rev1	:No Results::Info File Missing:	None
Perspecta-IUB	1.21276	0.21291	0.38335	0.42736	721.17	2022-12-23T00:00:09	2022-12-22T23:56:50	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	721.1	2022-12-26T05:30:09	2022-12-26T05:22:29	Rev1	:No Results:	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	720.02	2022-12-26T15:40:10	2022-12-26T15:35:17	Rev1	:No Results:	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	720.01	2022-12-26T20:10:09	2022-12-26T20:01:18	Rev1	:No Results:	None
Perspecta-IUB	0.48499	0.08365	0.1608	0.84306	721.29	2022-12-26T22:00:10	2022-12-26T21:53:57	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-01-04T22:20:10	2023-01-04T22:15:40	Rev1	:No Results:	:Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-01-05T00:50:09	2023-01-05T00:48:17	Rev1	:No Results:	:Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-01-08T05:30:09	2023-01-08T05:26:15	Rev1	:No Results:	:Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-01-08T06:20:09	2023-01-08T06:11:09	Rev1	:No Results:	:Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-01-08T07:10:10	2023-01-08T07:02:34	Rev1	:No Results:	:Container Parameters (jsonschema checker)::Schema Header:
Perspecta-IUB	1.53245	0.32701	0.42063	0.44944	721.34	2023-01-08T22:00:10	2023-01-08T22:00:02	Rev1	None	None
Perspecta-IUB	1.3411	0.31132	0.3782	0.50486	727.36	2023-01-08T22:30:10	2023-01-08T22:23:34	Rev1	None	None
Perspecta-IUB	1.1525	0.23471	0.35092	0.51778	721.36	2023-01-09T06:10:11	2023-01-09T06:07:56	Rev1	None	None
Perspecta-IUB	1.12677	0.203	0.36252	0.4525	721.35	2023-01-09T07:00:11	2023-01-09T06:50:44	Rev1	None	None
Perspecta-IUB	0.48616	0.08171	0.1611	0.84361	721.28	2023-01-09T15:00:11	2023-01-09T14:57:44	Rev1	None	None
Perspecta-IUB	0.29245	0.06881	0.08705	0.95736	721.2	2023-01-10T05:20:11	2023-01-10T05:18:47	Rev1	None	None
Perspecta-IUB	0.22701	0.08594	0.0653	0.96847	721.17	2023-01-10T05:42:37	2023-01-10T05:40:51	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	721.33	2023-01-13T04:10:11	2023-01-13T04:01:54	Rev1	:No Results:	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	721.3	2023-01-13T04:32:06	2023-01-13T04:22:57	Rev1	:No Results:	None
Perspecta-IUB	0.40597	0.03456	0.11885	0.97625	721.5	2023-01-13T05:00:10	2023-01-13T04:54:04	Rev1	None	None
Perspecta-IUB	0.43505	0.03073	0.12971	0.97806	721.47	2023-01-13T05:50:10	2023-01-13T05:46:18	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	721.35	2023-01-13T06:11:19	2023-01-13T05:56:56	Rev1	:No Results:	None
Perspecta-IUB	0.26968	0.16843	0.07472	0.96403	721.39	2023-01-13T14:10:10	2023-01-13T14:05:18	Rev1	None	None
Perspecta-IUB	0.33854	0.13285	0.10193	0.94736	721.26	2023-01-13T14:51:42	2023-01-13T14:45:01	Rev1	None	None
Perspecta-IUB	0.26843	0.10493	0.08073	0.96194	721.39	2023-01-13T16:00:10	2023-01-13T15:55:46	Rev1	None	None
Perspecta-IUB	0.26843	0.10493	0.08073	0.96194	726.33	2023-01-13T16:30:11	2023-01-13T16:22:20	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-01-24T18:00:17	2023-01-21T21:17:43	Rev1	:No Results:	:Container Parameters (jsonschema checker)::Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-01-24T20:00:13	2023-01-24T19:53:49	Rev1	:No Results:	:Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-02-16T07:00:11	2023-02-16T06:53:43	Rev1	:No Results:	:Container Parameters (jsonschema checker)::Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-02-21T18:50:11	2023-02-16T19:06:57	Rev1	:No Results:	:Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-02-21T20:20:10	2023-02-21T20:16:25	Rev1	:No Results:	:Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-02-21T20:32:06	2023-02-21T20:24:52	Rev1	:No Results:	:Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-02-21T23:00:11	2023-02-21T22:53:10	Rev1	:No Results:	:Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5	404.44	2023-02-22T01:20:11	2023-02-22T01:14:47	Rev1	:No Results:	None
Perspecta-IUB	0.25884	0.13882	0.07039	0.97236	1682.46	2023-02-22T02:20:11	2023-02-22T02:19:45	Rev1	None	None
Perspecta-IUB	1.13477	0.26529	0.34799	0.51694	721.39	2023-02-22T03:40:59	2023-02-22T03:35:07	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-01-24T19:00:20	2023-01-24T18:58:23	Rev1	:No Results:	:Schema Header:
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-01-27T22:01:05	2023-01-27T21:51:18	Rev1	:No Results:	:Schema Header:
ARM-UCSD	0.69315	0.0	0.25	0.5	891.81	2023-01-28T07:33:12	2023-01-28T07:27:58	Rev1	None	None
ARM-UCSD	6.02738	1.47401	0.47249	0.53597	673.83	2023-01-30T07:40:18	2023-01-30T07:31:28	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	721.32	2023-02-21T18:50:18	2023-02-16T17:42:42	Rev1	:No Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	721.41	2023-02-21T20:32:13	2023-02-21T20:26:33	Rev1	:Result Parse::No Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	721.38	2023-02-21T21:10:17	2023-02-21T21:07:22	Rev1	:No Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-02-21T22:00:16	2023-02-21T21:53:29	Rev1	:No Results:	:Schema Header:
ARM-UCSD	0.69315	0.0	0.25	0.5	721.38	2023-02-22T04:10:18	2023-02-22T04:09:27	Rev1	:No Results:	None
ARM-UCSD	0.88369	0.46271	0.11091	0.89472	724.35	2023-02-22T04:50:17	2023-02-22T04:43:46	Rev1	None	None
ARM-UCSD	0.88369	0.46271	0.11091	0.89472	721.36	2023-02-28T00:50:18	2023-02-28T00:48:03	Rev1	None	None
ARM-UCSD	0.32994	0.09614	0.10488	0.9325	721.38	2023-03-01T22:20:17	2023-03-01T22:16:53	Rev1	None	None
ARM-UCSD	12.66423	2.46331	0.45833	0.15972	1204.59	2023-03-01T23:20:17	2023-03-01T23:15:35	Rev1	None	None
ARM-UCSD	9.4406	2.3447	0.34167	0.47556	1206.63	2023-03-02T00:50:17	2023-03-02T00:45:54	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-03-20T18:00:17	2023-03-20T17:54:08	Rev1	:No Results:	:Container Parameters (jsonschema checker):
ARM-UCSD	2.7631	1.48315	0.1	0.84653	818.43	2023-03-20T19:20:17	2023-03-20T19:18:10	Rev1	None	None
ARM-UCSD	2.7631	1.48315	0.1	0.84653	839.75	2023-03-20T23:10:18	2023-03-20T23:00:14	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	450.66	2023-03-24T23:10:16	2023-03-24T23:07:19	Rev1	:No Results::Missing Results:	None
ARM-UCSD	3.68414	1.68058	0.13333	0.825	767.29	2023-03-26T00:40:18	2023-03-26T00:39:36	Rev1	None	None
ARM-UCSD	13.12475	2.46882	0.475	0.06611	749.46	2023-03-28T02:41:06	2023-03-28T02:34:06	Rev1	None	None
ARM-UCSD	2.99336	1.53654	0.10833	0.85556	760.26	2023-03-28T03:01:04	2023-03-28T02:54:42	Rev1	None	None
ARM-UCSD	2.99336	1.53654	0.10833	0.85556	748.7	2023-03-28T03:50:15	2023-03-28T03:42:29	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	221.49	2023-03-28T04:20:16	2023-03-28T04:19:36	Rev1	:No Results::Missing Results:	None
ARM	0.62026	0.0759	0.2167	0.71347	1682.92	2023-01-30T05:42:16	2023-01-30T05:31:46	Rev1	None	None
ARM	0.4323	0.05613	0.13551	0.92069	1684.35	2023-02-07T05:40:22	2023-02-07T05:33:21	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5	808.0	2023-02-07T07:30:21	2023-02-07T07:21:55	Rev1	:No Results:	None
ARM	0.69315	0.0	0.25	0.5	804.07	2023-02-07T08:52:22	2023-02-07T08:43:09	Rev1	:No Results:	None
ARM	0.26805	0.09077	0.08846	0.95333	2649.37	2023-02-21T19:40:22	2023-02-21T19:33:03	Rev1	None	None
ARM	0.19922	0.07307	0.06169	0.97611	2644.32	2023-02-28T20:00:23	2023-02-28T19:51:20	Rev1	None	None
ARM	0.58205	0.63231	0.05713	0.95694	1802.97	2023-03-02T03:10:22	2023-03-02T03:05:28	Rev1	None	None
ARM	0.18463	0.07603	0.05568	0.98153	1903.02	2023-03-02T04:20:22	2023-03-02T04:14:42	Rev1	None	None
ARM	1.03475	0.88594	0.07241	0.92542	1900.12	2023-03-07T15:20:21	2023-03-07T15:15:51	Rev1	None	None
ARM	0.19389	0.08087	0.05872	0.97833	2040.26	2023-03-07T18:40:21	2023-03-07T18:32:05	Rev1	None	None
TrinitySRITrojAI-SBU	0.44231	0.08923	0.14152	0.87722	1682.79	2023-02-12T03:10:22	2023-02-12T03:09:37	Rev1	None	None
TrinitySRITrojAI-SBU	0.52048	0.06598	0.16871	0.82472	1683.11	2023-02-21T20:51:11	2023-02-21T20:45:45	Rev1	None	None
TrinitySRITrojAI-SBU	0.33386	0.11125	0.10128	0.92806	1682.81	2023-02-21T21:45:10	2023-02-21T21:39:55	Rev1	None	None
TrinitySRITrojAI-SBU	0.40936	0.1111	0.12186	0.88903	1682.81	2023-02-22T08:30:21	2023-02-22T08:22:01	Rev1	None	None
TrinitySRITrojAI-SBU	0.41487	0.09098	0.12656	0.88931	1684.06	2023-02-22T21:30:22	2023-02-22T21:23:20	Rev1	None	None
TrinitySRITrojAI-SBU	0.49748	0.15181	0.14534	0.84194	1682.82	2023-02-23T00:40:25	2023-02-23T00:32:53	Rev1	None	None
TrinitySRITrojAI-SBU	0.42233	0.10675	0.13111	0.89236	1682.8	2023-02-23T01:30:22	2023-02-23T01:28:02	Rev1	None	None
TrinitySRITrojAI-SBU	0.41052	0.07983	0.13501	0.88764	1682.98	2023-03-07T03:10:24	2023-03-07T03:02:38	Rev1	None	None
TrinitySRITrojAI-SBU	0.36867	0.12521	0.11111	0.91653	1682.95	2023-03-07T04:30:24	2023-03-07T04:27:23	Rev1	None	None
TrinitySRITrojAI-SBU	0.42617	0.08238	0.13299	0.88847	1682.94	2023-03-07T05:30:24	2023-03-07T05:28:18	Rev1	None	None
TrinitySRITrojAI-SBU	0.48938	0.07834	0.15611	0.87542	1682.76	2023-03-07T06:51:33	2023-03-07T06:40:38	Rev1	None	None
TrinitySRITrojAI-SBU	0.40384	0.08414	0.12773	0.90264	1695.05	2023-03-07T08:01:18	2023-03-07T07:56:48	Rev1	None	None
TrinitySRITrojAI-SBU	0.43446	0.11063	0.13715	0.87931	1682.63	2023-03-07T08:50:24	2023-03-07T08:47:24	Rev1	None	None
TrinitySRITrojAI-SBU	0.45159	0.10238	0.1361	0.87181	1682.63	2023-03-07T10:01:40	2023-03-07T09:57:13	Rev1	None	None
TrinitySRITrojAI-SBU	0.45183	0.11508	0.14198	0.87208	1690.0	2023-03-07T11:11:11	2023-03-07T11:10:38	Rev1	None	None
TrinitySRITrojAI-SBU	0.47719	0.11797	0.1514	0.84681	1683.13	2023-03-07T22:00:24	2023-03-07T21:57:04	Rev1	None	None
TrinitySRITrojAI-SBU	0.41051	0.10438	0.12456	0.88708	1682.99	2023-03-07T23:40:24	2023-03-07T23:34:50	Rev1	None	None
TrinitySRITrojAI-SBU	0.45128	0.11133	0.1357	0.85764	1682.81	2023-03-08T00:30:24	2023-03-08T00:25:31	Rev1	None	None
TrinitySRITrojAI-SBU	0.38533	0.11717	0.12085	0.90403	1682.72	2023-03-08T01:30:24	2023-03-08T01:29:04	Rev1	None	None
ICSI-2	0.49301	0.07532	0.16352	0.845	615.75	2023-01-06T02:00:21	2023-01-06T01:59:12	Rev1	None	None
ICSI-2	0.49665	0.10753	0.16082	0.85278	610.68	2023-01-06T06:50:21	2023-01-06T06:46:27	Rev1	None	None
ICSI-2	0.26685	0.10338	0.07591	0.95306	608.69	2023-01-07T01:40:20	2023-01-07T01:37:42	Rev1	None	None
ICSI-2	0.51188	0.13631	0.16517	0.84583	604.66	2023-01-12T03:30:21	2023-01-12T03:24:00	Rev1	None	None
ICSI-2	0.29234	0.07215	0.08944	0.95333	625.81	2023-01-16T04:50:20	2023-01-16T04:46:56	Rev1	None	None
ICSI-2	0.32812	0.1145	0.10246	0.93639	617.71	2023-01-17T05:30:22	2023-01-17T05:23:27	Rev1	None	None
ICSI-2	0.27823	0.08774	0.08222	0.95014	668.77	2023-01-18T07:30:20	2023-01-18T07:27:46	Rev1	None	None
ICSI-2	0.30344	0.10133	0.09633	0.94875	675.87	2023-01-18T20:30:22	2023-01-18T20:25:15	Rev1	None	None
ICSI-2	0.41383	0.19721	0.10364	0.91708	680.77	2023-01-20T01:00:21	2023-01-20T00:52:25	Rev1	None	None
ICSI-2	0.28219	0.12809	0.07606	0.94847	665.77	2023-01-20T09:50:22	2023-01-20T09:49:07	Rev1	None	None
ICSI-2	0.27648	0.10897	0.07877	0.95194	629.64	2023-01-20T23:50:23	2023-01-20T23:46:33	Rev1	None	None
ICSI-2	0.27064	0.10972	0.07737	0.95611	635.72	2023-01-21T00:50:22	2023-01-21T00:47:15	Rev1	None	None
ICSI-2	0.69315	0.0	0.25	0.5		2023-01-24T18:00:29	2023-01-23T23:49:23	Rev1	:No Results::Info File Missing:	None
ICSI-2	0.33948	0.12738	0.105	0.93528	605.66	2023-01-26T00:40:27	2023-01-26T00:33:56	Rev1	None	None
ICSI-2	0.27954	0.04119	0.07348	0.98639	613.74	2023-02-02T07:10:27	2023-02-02T07:09:51	Rev1	None	None
ICSI-2	0.34099	0.12236	0.10785	0.93542	719.02	2023-02-02T22:50:25	2023-02-02T22:43:31	Rev1	None	None
ICSI-2	0.27764	0.05084	0.07725	0.97125	612.67	2023-02-03T00:40:26	2023-02-03T00:34:11	Rev1	None	None
ICSI-2	0.18734	0.07189	0.05534	0.9775	634.59	2023-02-03T04:50:24	2023-02-03T04:46:00	Rev1	None	None
ICSI-2	0.19982	0.06818	0.05916	0.97597	611.66	2023-02-03T08:20:25	2023-02-03T08:17:49	Rev1	None	None
ICSI-2	0.19086	0.0641	0.05391	0.98014	699.93	2023-02-03T08:50:25	2023-02-03T08:47:45	Rev1	None	None
ICSI-2	0.69315	0.0	0.25	0.5		2023-02-04T02:30:25	2023-02-04T02:23:03	Rev1	:No Results:	:Container Parameters (learned parameters):
ICSI-2	0.69315	0.0	0.25	0.5		2023-02-04T03:10:25	2023-02-04T03:08:54	Rev1	:Executed File Update::No Results::Info File Missing:	None
ICSI-2	0.1823	0.08497	0.05335	0.98083	614.75	2023-02-04T03:31:32	2023-02-04T03:26:43	Rev1	None	None
ICSI-2	0.17857	0.08039	0.05305	0.97847	698.96	2023-02-04T04:11:39	2023-02-04T04:00:33	Rev1	None	None
ICSI-2	1.18884	0.36802	0.27589	0.73653	1562.33	2023-02-08T06:40:24	2023-02-08T06:30:48	Rev1	None	None
ICSI-2	0.72948	0.23127	0.20231	0.81611	1562.44	2023-02-08T22:10:24	2023-02-08T22:00:53	Rev1	None	None
ICSI-2	1.01936	0.31608	0.24449	0.76806	1562.3	2023-02-08T23:50:24	2023-02-08T23:48:19	Rev1	None	None
ICSI-2	0.7067	0.23835	0.19415	0.8475	1562.46	2023-02-09T03:40:24	2023-02-09T03:40:10	Rev1	None	None
ICSI-2	0.15709	0.07718	0.04453	0.98458	719.92	2023-02-09T07:50:23	2023-02-09T07:44:42	Rev1	None	None
ICSI-2	0.17708	0.05352	0.04903	0.985	721.03	2023-02-09T09:00:24	2023-02-09T08:51:22	Rev1	None	None
ICSI-2	0.1871	0.05956	0.05374	0.98028	720.97	2023-02-09T09:30:25	2023-02-09T09:28:46	Rev1	None	None
ICSI-2	0.49306	0.13794	0.15846	0.87181	1562.39	2023-02-09T20:20:24	2023-02-09T20:11:03	Rev1	None	None
ICSI-2	0.56697	0.20394	0.15742	0.85694	1562.47	2023-02-09T23:40:25	2023-02-09T23:31:08	Rev1	None	None
ICSI-2	0.53269	0.20594	0.14948	0.88208	1562.45	2023-02-10T03:40:24	2023-02-10T03:32:32	Rev1	None	None
ICSI-2	0.18185	0.09196	0.05576	0.98028	719.99	2023-02-10T07:20:24	2023-02-10T07:19:01	Rev1	None	None
ICSI-2	0.14978	0.06346	0.04387	0.98667	726.13	2023-02-21T18:50:26	2023-02-17T10:52:34	Rev1	None	None
ICSI-2	0.18629	0.09844	0.05206	0.97889	720.07	2023-02-22T21:20:23	2023-02-22T21:15:18	Rev1	None	None
TrinitySRITrojAI-BostonU	0.80762	0.11196	0.29113	0.54611	721.94	2023-01-09T21:20:24	2023-01-09T21:11:22	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	721.0	2023-01-10T23:10:24	2023-01-10T23:04:14	Rev1	:No Results:	None
TrinitySRITrojAI-BostonU	1.47387	0.27746	0.42017	0.51167	735.29	2023-01-11T07:10:24	2023-01-11T07:03:44	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-01-18T17:21:25	2023-01-18T17:14:01	Rev1	:No Results:	:Container Parameters (jsonschema checker):
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	724.74	2023-01-18T21:30:23	2023-01-18T21:25:02	Rev1	:No Results:	None
TrinitySRITrojAI-BostonU	0.74203	0.19316	0.22358	0.74181	928.05	2023-01-18T22:50:23	2023-01-18T22:43:10	Rev1	None	None
TrinitySRITrojAI-BostonU	0.61373	0.15568	0.19898	0.79569	1702.94	2023-01-19T07:10:23	2023-01-19T07:01:26	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69566	0.15989	0.22734	0.73806	992.84	2023-01-19T09:00:23	2023-01-19T08:57:52	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69566	0.15989	0.22734	0.73806	1001.6	2023-01-19T19:00:25	2023-01-19T18:59:17	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69566	0.15989	0.22734	0.73806	1005.22	2023-01-19T19:31:04	2023-01-19T19:08:22	Rev1	None	None
TrinitySRITrojAI-BostonU	0.59597	0.08809	0.20673	0.70222	942.45	2023-01-19T22:00:24	2023-01-19T21:57:39	Rev1	None	None
TrinitySRITrojAI-BostonU	0.59597	0.08809	0.20673	0.70222	1520.73	2023-01-20T03:10:23	2023-01-20T03:09:28	Rev1	None	None
TrinitySRITrojAI-BostonU	0.65272	0.02894	0.23041	0.7025	839.08	2023-01-20T06:10:25	2023-01-20T06:06:33	Rev1	None	None
TrinitySRITrojAI-BostonU	0.6693	0.05518	0.23693	0.64806	840.22	2023-01-20T19:40:25	2023-01-20T19:32:24	Rev1	None	None
TrinitySRITrojAI-BostonU	0.96865	0.44916	0.27339	0.65	846.25	2023-01-20T22:40:24	2023-01-20T22:39:06	Rev1	None	None
TrinitySRITrojAI-BostonU	0.48528	0.02668	0.15118	0.97792	841.85	2023-01-21T05:50:25	2023-01-21T05:42:51	Rev1	None	None
TrinitySRITrojAI-BostonU	0.48617	0.02492	0.15124	0.99069	960.39	2023-01-21T07:20:24	2023-01-21T07:18:14	Rev1	None	None
TrinitySRITrojAI-BostonU	0.47891	0.02672	0.14835	0.98472	878.06	2023-01-21T13:20:25	2023-01-21T13:10:29	Rev1	None	None
TrinitySRITrojAI-BostonU	0.39926	0.04078	0.11774	0.96542	841.39	2023-02-03T15:50:28	2023-02-03T15:42:50	Rev1	None	None
TrinitySRITrojAI-BostonU	0.35014	0.05037	0.10349	0.95986	841.27	2023-02-04T22:50:27	2023-02-04T22:41:06	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-02-05T07:20:27	2023-02-05T07:19:07	Rev1	:No Results:	:Container Parameters (jsonschema checker):
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-02-05T15:10:28	2023-02-05T15:00:39	Rev1	:No Results:	:Container Parameters (jsonschema checker):
TrinitySRITrojAI-BostonU	0.54182	0.06954	0.18542	0.7875	837.13	2023-02-05T19:30:28	2023-02-05T19:21:11	Rev1	None	None
TrinitySRITrojAI-BostonU	0.43849	0.04544	0.13569	0.93319	841.32	2023-02-06T01:20:28	2023-02-06T01:19:03	Rev1	None	None
TrinitySRITrojAI-BostonU	0.47364	0.02749	0.14615	0.98222	964.06	2023-02-06T06:40:25	2023-02-06T06:34:02	Rev1	None	None
TrinitySRITrojAI-BostonU	0.47746	0.02739	0.1479	0.98444	961.67	2023-02-06T07:20:26	2023-02-06T07:12:04	Rev1	None	None
TrinitySRITrojAI-BostonU	0.48149	0.02751	0.14971	0.98181	961.73	2023-02-06T07:41:14	2023-02-06T07:22:15	Rev1	None	None
TrinitySRITrojAI-BostonU	0.48431	0.02799	0.15062	0.96722	841.51	2023-02-06T08:40:27	2023-02-06T08:34:41	Rev1	None	None
TrinitySRITrojAI-BostonU	0.48617	0.02492	0.15124	0.99069	959.41	2023-02-06T09:11:33	2023-02-06T09:08:22	Rev1	None	None
TrinitySRITrojAI-BostonU	0.48792	0.02502	0.15212	0.98917	961.62	2023-02-06T16:10:28	2023-02-06T16:03:10	Rev1	None	None
TrinitySRITrojAI-BostonU	0.48617	0.02492	0.15124	0.99069	960.41	2023-02-06T17:00:28	2023-02-06T17:00:01	Rev1	None	None
TrinitySRITrojAI-BostonU	0.47815	0.02695	0.14808	0.98403	963.23	2023-02-06T18:20:28	2023-02-06T18:15:08	Rev1	None	None
TrinitySRITrojAI-BostonU	0.34548	0.05241	0.10225	0.96153	846.3	2023-02-07T06:40:27	2023-02-07T06:33:34	Rev1	None	None
TrinitySRITrojAI-BostonU	0.47983	0.02604	0.14871	0.98986	1322.31	2023-02-07T18:10:26	2023-02-07T18:07:02	Rev1	None	None
TrinitySRITrojAI-BostonU	0.5032	0.0249	0.15902	0.97875	932.3	2023-02-23T16:40:26	2023-02-23T16:35:32	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-03-14T04:30:28	2023-03-14T04:28:06	Rev1	:No Results:	:Container Parameters (jsonschema checker):
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-03-14T17:40:26	2023-03-14T17:35:30	Rev1	:No Results:	:Schema Header:
TrinitySRITrojAI-BostonU	0.4916	0.02772	0.15428	0.97028	311.6	2023-03-14T19:30:27	2023-03-14T19:29:08	Rev1	None	None
trojai-example	0.85962	0.09977	0.31471	0.45181	721.78	2022-12-17T01:19:20	2022-12-17T01:15:03	Rev1	None	None
trojai-example	0.71866	0.08293	0.25641	0.60208	722.81	2023-01-25T20:00:36	2023-01-25T19:58:01	Rev1	None	:Schema Header:
trojai-example	0.78104	0.08617	0.28725	0.53972	267.17	2023-03-09T16:57:17	2023-03-09T16:56:57	Rev1	None	:Container Parameters (jsonschema checker)::Schema Header:
trojai-example	0.69315	0.0	0.25	0.5		2023-03-09T17:42:42	2023-03-09T17:42:05	Rev1	:No Results::Info File Missing:	None
trojai-example	0.69315	0.0	0.25	0.5		2023-03-09T18:11:39	2023-03-09T18:10:09	Rev1	:No Results::Info File Missing:	None
trojai-example	0.82094	0.09288	0.30323	0.45069	265.98	2023-03-10T02:00:28	2023-03-10T01:59:38	Rev1	None	:Container Parameters (jsonschema checker)::Schema Header::Execute:
UMBCb	0.7519	0.0577	0.2766	0.48278	1202.12	2023-01-25T20:30:39	2023-01-25T20:23:10	Rev1	None	None
UMBCb	0.69315	0.0	0.25	0.5	240.8	2023-03-06T16:10:36	2023-03-06T16:08:50	Rev1	:No Results:	None
UMBCb	0.69424	0.01833	0.25054	0.52097	216.68	2023-03-15T17:10:33	2023-03-15T17:03:06	Rev1	None	None
UMBCb	0.66859	0.0518	0.2377	0.63653	218.36	2023-03-16T15:00:32	2023-03-16T14:58:32	Rev1	None	None
UMBCb	0.68037	0.02249	0.24371	0.59694	224.87	2023-03-22T20:30:35	2023-03-22T20:22:04	Rev1	None	None
UMBCb	1.28286	0.28283	0.35978	0.52639	221.53	2023-04-17T18:00:32	2023-04-17T17:56:18	Rev1	None	None
DS3TwoSixZero	0.69315	0.0	0.25	0.5		2023-01-25T14:00:43	2023-01-25T13:52:46	Rev1	:No Results::Info File Missing:	None
DS3TwoSixZero	0.69315	0.0	0.25	0.5		2023-01-25T18:00:43	2023-01-25T17:59:21	Rev1	:No Results::Info File Missing:	None

Required filename format: "cyber-pdf-dec2022_sts_<Submission Name>.simg"
Accepting submissions: True
Number of models in cyber-pdf-dec2022, sts: 14
Execution timeout (hh:mm:ss): 2:20:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2023-03-07T17:40:05	performer	None	None	Ok	2023-03-07T17:39:22	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-03-17T19:30:07	performer	None	None	Ok	2023-03-17T19:29:09	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-03-14T18:20:08	performer	None	None	Ok	2023-03-14T18:13:46	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-01-17T15:20:10	performer	None	None	Ok	2023-01-17T15:18:30	0 d, 0 h, 0 m, 0 s
Perspecta-IUB		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2023-03-25T22:40:17	performer	None	None	Ok	2023-03-25T22:38:11	0 d, 0 h, 0 m, 0 s
ARM	2023-02-28T19:30:23	performer	None	Ok	Ok	2023-02-28T19:26:27	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	2023-02-21T18:50:24	performer	None	None	Ok	2023-02-18T22:52:46	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2023-02-08T06:10:25	performer	None	None	Ok	2023-02-08T06:06:03	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-01-21T04:20:26	performer	None	None	Ok	2023-01-21T04:10:39	0 d, 0 h, 0 m, 0 s
trojai-example		public	None	Ok	Ok	2023-03-10T03:04:39	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2023-04-14T21:10:36	performer	None	None	Ok	2023-04-14T21:03:12	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.0074	0.00285	8e-05	1.0	140.12	2023-01-03T21:00:05	2023-01-03T20:57:10	Rev1	None	None
TrinitySRITrojAI	0.6507	0.6584	0.19262	1.0	294.92	2022-12-22T16:20:07	2022-12-22T16:13:47	Rev1	None	None
PL-GIFT	0.0	0.0	0.0	1.0	182.64	2022-12-22T00:40:17	2022-12-22T00:37:17	Rev1	None	None
Perspecta-PurdueRutgers	0.20394	0.05149	0.03912	1.0	83.99	2023-01-09T04:10:09	2023-01-09T04:07:25	Rev1	None	None
ARM-UCSD	0.0	0.0	0.0	1.0	77.76	2023-01-30T06:20:18	2023-01-30T06:12:44	Rev1	None	None
ARM	0.16732	0.09274	0.03691	1.0	98.63	2023-01-27T21:21:16	2023-01-27T21:14:47	Rev1	None	None
TrinitySRITrojAI-SBU	0.31599	0.12962	0.08773	1.0	196.47	2023-02-12T02:50:22	2023-02-12T02:40:25	Rev1	None	None
ICSI-2	0.01161	0.00185	0.00015	1.0	72.67	2023-01-06T06:30:22	2023-01-06T06:23:20	Rev1	None	None
TrinitySRITrojAI-BostonU	0.02344	0.00812	0.00076	1.0	107.79	2023-01-18T22:21:17	2023-01-18T22:10:35	Rev1	None	None
trojai-example	0.65417	0.13356	0.2303	0.74444	37.25	2023-03-09T16:46:08	2023-03-09T16:39:47	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker)::Schema Header:
UMBCb	0.23266	0.05237	0.04723	1.0	140.27	2023-01-25T19:10:40	2023-01-25T19:05:14	Rev1	None	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.69315	0.0	0.25	0.5	28.22	2022-12-29T21:50:05	2022-12-29T21:49:46	Rev1	:No Results:	None
Perspecta	0.69315	0.0	0.25	0.5	28.23	2023-01-03T16:10:05	2022-12-30T16:32:28	Rev1	:No Results:	None
Perspecta	0.69315	0.0	0.25	0.5	29.22	2023-01-03T16:30:04	2023-01-03T16:24:07	Rev1	:No Results:	None
Perspecta	0.69315	0.0	0.25	0.5		2023-01-03T19:50:04	2023-01-03T19:40:08	Rev1	:No Results::Container File Missing:	:Schema Header:
Perspecta	0.0074	0.00285	8e-05	1.0	140.12	2023-01-03T21:00:05	2023-01-03T20:57:10	Rev1	None	None
Perspecta	0.0651	0.05606	0.01143	1.0	182.26	2023-01-04T18:20:05	2023-01-04T18:12:53	Rev1	None	None
Perspecta	0.07542	0.06928	0.016	1.0	182.28	2023-01-05T15:10:05	2023-01-05T15:05:55	Rev1	None	None
Perspecta	0.03242	0.02374	0.00273	1.0	182.36	2023-01-10T17:50:05	2023-01-10T17:41:20	Rev1	None	None
Perspecta	0.04296	0.03272	0.00478	1.0	182.47	2023-01-11T15:10:05	2023-01-11T15:03:41	Rev1	None	None
Perspecta	0.00441	0.00179	3e-05	1.0	182.34	2023-01-11T19:30:04	2023-01-11T19:25:26	Rev1	None	None
Perspecta	0.05242	0.02764	0.00489	1.0	182.3	2023-01-12T19:20:04	2023-01-12T19:15:43	Rev1	None	None
Perspecta	0.01084	0.00104	0.00012	1.0	182.35	2023-01-12T22:10:04	2023-01-12T22:06:52	Rev1	None	None
Perspecta	0.09958	0.03642	0.0119	1.0	193.23	2023-01-16T21:30:04	2023-01-16T21:22:16	Rev1	None	None
Perspecta	0.0773	0.00743	0.00568	1.0	194.0	2023-01-16T22:40:06	2023-01-16T22:36:19	Rev1	None	None
Perspecta	0.08393	0.01547	0.0071	1.0	201.28	2023-01-31T00:10:04	2023-01-31T00:00:51	Rev1	None	None
Perspecta	0.07257	0.0	0.0049	1.0	199.33	2023-01-31T00:40:05	2023-01-31T00:34:50	Rev1	None	None
Perspecta	0.07964	0.00843	0.00606	1.0	200.83	2023-02-01T00:00:05	2023-01-31T23:50:08	Rev1	None	None
Perspecta	0.08183	0.00977	0.00643	1.0	203.95	2023-02-21T18:50:05	2023-02-20T21:59:09	Rev1	None	None
Perspecta	0.05129	0.0	0.0025	1.0	201.46	2023-03-03T15:20:04	2023-03-03T15:18:25	Rev1	None	None
Perspecta	0.05129	0.0	0.0025	1.0	200.71	2023-03-07T17:40:05	2023-03-07T17:39:22	Rev1	None	None
TrinitySRITrojAI	0.52767	0.58092	0.14346	0.85556	289.36	2022-12-19T23:50:07	2022-12-19T23:49:40	Rev1	None	None
TrinitySRITrojAI	0.55578	0.61437	0.16021	0.93333	297.05	2022-12-22T06:40:07	2022-12-22T06:32:44	Rev1	None	None
TrinitySRITrojAI	0.6507	0.6584	0.19262	1.0	294.92	2022-12-22T16:20:07	2022-12-22T16:13:47	Rev1	None	None
TrinitySRITrojAI	0.6507	0.6584	0.19262	1.0	295.35	2022-12-28T07:20:07	2022-12-28T07:12:59	Rev1	None	None
TrinitySRITrojAI	0.59494	0.65509	0.16369	0.94444	272.11	2023-01-05T04:50:07	2023-01-05T04:41:56	Rev1	None	None
TrinitySRITrojAI	0.58657	0.74341	0.13839	0.86667	267.04	2023-01-05T07:00:07	2023-01-05T06:54:44	Rev1	None	None
TrinitySRITrojAI	0.63407	0.93263	0.12648	0.94444	275.17	2023-01-05T17:50:06	2023-01-05T17:45:51	Rev1	None	None
TrinitySRITrojAI	0.08962	0.01203	0.00774	1.0	276.65	2023-01-05T19:00:07	2023-01-05T18:52:48	Rev1	None	None
TrinitySRITrojAI	0.06536	0.03302	0.00708	1.0	247.69	2023-02-03T03:40:06	2023-02-03T03:38:18	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	83.85	2023-02-10T20:50:06	2023-02-10T20:40:08	Rev1	:No Results:	None
TrinitySRITrojAI	0.15704	0.10844	0.03564	1.0	196.23	2023-02-10T23:30:06	2023-02-10T23:29:47	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5		2023-03-16T23:40:07	2023-03-16T23:34:36	Rev1	:No Results::Container File Missing:	:Container Parameters (jsonschema checker):
TrinitySRITrojAI	0.18756	0.07479	0.03716	1.0	78.33	2023-03-17T19:30:07	2023-03-17T19:29:09	Rev1	None	None
PL-GIFT	0.0	0.0	0.0	1.0	182.64	2022-12-22T00:40:17	2022-12-22T00:37:17	Rev1	None	None
PL-GIFT	0.27073	0.49594	0.06808	0.95556	182.24	2023-01-11T03:30:08	2023-01-11T03:25:27	Rev1	None	None
PL-GIFT	0.00039	0.00074	0.0	1.0	182.42	2023-01-14T03:00:08	2023-01-14T02:58:40	Rev1	None	None
PL-GIFT	0.00032	0.00023	0.0	1.0	182.42	2023-01-16T18:40:08	2023-01-16T18:32:32	Rev1	None	None
PL-GIFT	0.00118	0.00083	0.0	1.0	182.41	2023-01-17T16:30:09	2023-01-17T16:27:17	Rev1	None	None
PL-GIFT	0.00395	0.00278	4e-05	1.0	182.48	2023-01-18T15:50:09	2023-01-18T15:47:08	Rev1	None	None
PL-GIFT	0.01834	0.01289	0.00089	1.0	182.43	2023-01-18T17:10:10	2023-01-18T17:02:57	Rev1	None	None
PL-GIFT	0.00724	0.00509	0.00014	1.0	182.68	2023-01-19T17:10:09	2023-01-19T17:01:21	Rev1	None	None
PL-GIFT	0.00429	0.00302	5e-05	1.0	182.62	2023-01-19T20:30:09	2023-01-19T20:27:46	Rev1	None	None
PL-GIFT	0.01005	0.0	0.0001	1.0	182.34	2023-01-27T20:50:09	2023-01-27T20:46:19	Rev1	None	None
PL-GIFT	9.86823	6.93534	0.35714	0.0	182.27	2023-02-07T22:40:07	2023-02-07T22:36:21	Rev1	None	None
PL-GIFT	0.01925	0.01353	0.00098	1.0	182.27	2023-02-08T02:40:08	2023-02-08T02:30:17	Rev1	None	None
PL-GIFT	0.01634	0.01148	0.00071	1.0	182.22	2023-02-14T23:10:08	2023-02-14T23:09:31	Rev1	None	None
PL-GIFT	0.0113	0.00794	0.00035	1.0	182.29	2023-02-27T19:30:08	2023-02-27T19:26:01	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2023-03-10T23:40:09	2023-03-10T19:43:04	Rev1	:No Results::Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	9.86823	6.93534	0.35714	0.0	62.44	2023-03-14T18:20:08	2023-03-14T18:13:46	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2023-01-09T02:50:09	2023-01-09T02:44:38	Rev1	:No Results::Container File Missing:	:Schema Header:
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2023-01-09T03:30:09	2023-01-09T03:27:05	Rev1	:No Results::Container File Missing:	:Schema Header:
Perspecta-PurdueRutgers	0.20394	0.05149	0.03912	1.0	83.99	2023-01-09T04:10:09	2023-01-09T04:07:25	Rev1	None	None
Perspecta-PurdueRutgers	0.07864	0.01978	0.00685	1.0	83.98	2023-01-09T16:30:10	2023-01-09T16:26:31	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2023-01-11T05:20:09	2023-01-11T05:11:14	Rev1	:No Results::Container File Missing:	:Container Parameters (jsonschema checker):
Perspecta-PurdueRutgers	0.10796	0.03548	0.01358	1.0	192.93	2023-01-17T15:20:10	2023-01-17T15:18:30	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-01-24T19:00:21	2023-01-24T18:57:40	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-01-27T21:51:03	2023-01-27T21:50:37	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM-UCSD	0.69315	0.0	0.25	0.5	84.36	2023-01-27T22:30:18	2023-01-27T22:22:57	Rev1	:No Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	84.37	2023-01-28T00:10:18	2023-01-28T00:06:30	Rev1	:No Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	97.87	2023-01-28T01:00:18	2023-01-28T00:59:34	Rev1	:No Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	102.74	2023-01-28T07:20:17	2023-01-28T07:12:33	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-01-30T05:30:17	2023-01-30T05:25:17	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM-UCSD	0.0	0.0	0.0	1.0	77.76	2023-01-30T06:20:18	2023-01-30T06:12:44	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	84.06	2023-02-21T18:50:19	2023-02-16T17:42:51	Rev1	:No Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	84.14	2023-02-21T20:32:14	2023-02-21T20:26:06	Rev1	:Result Parse::No Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	84.06	2023-02-21T21:10:18	2023-02-21T21:06:56	Rev1	:No Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-02-21T21:38:14	2023-02-21T21:36:32	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM-UCSD	0.69315	0.0	0.25	0.5	84.12	2023-02-22T04:10:19	2023-02-22T04:07:51	Rev1	:No Results:	None
ARM-UCSD	7e-05	2e-05	0.0	1.0	84.24	2023-02-22T04:50:18	2023-02-22T04:43:21	Rev1	None	None
ARM-UCSD	7e-05	2e-05	0.0	1.0	84.09	2023-02-28T00:50:19	2023-02-28T00:48:27	Rev1	None	None
ARM-UCSD	0.12153	0.05434	0.01982	1.0	84.11	2023-03-01T22:20:18	2023-03-01T22:17:24	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-03-20T18:50:18	2023-03-20T18:42:43	Rev1	:No Results::Container File Missing:	:Container Parameters (jsonschema checker):
ARM-UCSD	0.69315	0.0	0.25	0.5	55.47	2023-03-25T05:30:20	2023-03-25T05:27:51	Rev1	:No Results::Missing Results:	None
ARM-UCSD	0.0	0.0	0.0	1.0	94.06	2023-03-25T22:40:17	2023-03-25T22:38:11	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5		2023-01-24T18:00:27	2023-01-23T10:46:35	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM	0.69315	0.0	0.25	0.5		2023-01-24T23:50:24	2023-01-24T23:43:55	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM	0.69315	0.0	0.25	0.5		2023-01-27T02:10:23	2023-01-27T02:05:01	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM	0.69315	0.0	0.25	0.5		2023-01-27T02:40:23	2023-01-27T02:34:35	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM	0.69315	0.0	0.25	0.5		2023-01-27T03:20:24	2023-01-27T03:14:21	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM	0.69315	0.0	0.25	0.5		2023-01-27T04:00:25	2023-01-27T03:51:27	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM	0.69315	0.0	0.25	0.5		2023-01-27T04:50:23	2023-01-27T04:42:10	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM	0.16732	0.09274	0.03691	1.0	98.63	2023-01-27T21:21:16	2023-01-27T21:14:47	Rev1	None	None
ARM	0.37493	0.12957	0.1126	1.0	196.52	2023-01-30T05:42:17	2023-01-30T05:31:36	Rev1	None	None
ARM	0.3356	0.12868	0.09741	1.0	197.72	2023-02-07T05:40:23	2023-02-07T05:32:36	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5	95.74	2023-02-07T07:30:22	2023-02-07T07:21:17	Rev1	:No Results:	None
ARM	0.69315	0.0	0.25	0.5	92.79	2023-02-07T08:40:21	2023-02-07T08:37:06	Rev1	:No Results:	None
ARM	0.69315	0.0	0.25	0.5	137.89	2023-02-07T09:11:10	2023-02-07T09:05:18	Rev1	:No Results:	None
ARM	0.1607	0.11085	0.04313	1.0	308.23	2023-02-21T18:50:23	2023-02-21T05:59:48	Rev1	None	None
ARM	0.13145	0.1155	0.03541	1.0	307.49	2023-02-28T19:30:23	2023-02-28T19:26:27	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-01-10T03:20:20	2023-01-10T03:10:53	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-01-10T03:50:20	2023-01-10T03:42:35	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-01-10T16:30:22	2023-01-10T16:22:55	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-01-10T18:20:20	2023-01-10T18:13:59	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-01-24T20:00:26	2023-01-24T20:00:05	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-01-24T21:00:24	2023-01-24T20:53:02	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	83.82	2023-02-11T18:00:23	2023-02-11T17:53:02	Rev1	:No Results:	None
TrinitySRITrojAI-SBU	0.31599	0.12962	0.08773	1.0	196.47	2023-02-12T02:50:22	2023-02-12T02:40:25	Rev1	None	None
TrinitySRITrojAI-SBU	0.3123	0.04871	0.0744	1.0	196.59	2023-02-21T18:50:24	2023-02-18T22:52:46	Rev1	None	None
ICSI-2	0.28827	0.05615	0.0666	1.0	71.68	2023-01-06T01:40:23	2023-01-06T01:36:21	Rev1	None	None
ICSI-2	0.01161	0.00185	0.00015	1.0	72.67	2023-01-06T06:30:22	2023-01-06T06:23:20	Rev1	None	None
ICSI-2	0.00335	0.00096	1e-05	1.0	70.67	2023-01-07T01:20:20	2023-01-07T01:16:24	Rev1	None	None
ICSI-2	0.0183	0.00442	0.0004	1.0	71.63	2023-01-12T03:10:21	2023-01-12T03:08:34	Rev1	None	None
ICSI-2	0.02045	0.00558	0.00051	1.0	71.64	2023-01-16T04:30:20	2023-01-16T04:26:04	Rev1	None	None
ICSI-2	0.00384	0.00098	2e-05	1.0	75.71	2023-01-17T05:30:23	2023-01-17T05:22:56	Rev1	None	None
ICSI-2	0.00323	0.00092	1e-05	1.0	73.68	2023-01-18T07:30:21	2023-01-18T07:27:07	Rev1	None	None
ICSI-2	0.00828	0.0035	0.00011	1.0	83.8	2023-01-18T20:30:23	2023-01-18T20:24:39	Rev1	None	None
ICSI-2	0.0271	0.02035	0.00204	1.0	78.8	2023-01-20T00:30:22	2023-01-20T00:26:12	Rev1	None	None
ICSI-2	0.00137	0.00077	0.0	1.0	76.67	2023-01-20T09:50:24	2023-01-20T09:48:37	Rev1	None	None
ICSI-2	0.00321	0.00087	1e-05	1.0	74.71	2023-01-20T23:50:24	2023-01-20T23:45:58	Rev1	None	None
ICSI-2	0.00264	0.00072	1e-05	1.0	82.84	2023-01-21T00:50:23	2023-01-21T00:46:45	Rev1	None	None
ICSI-2	0.00312	0.00075	1e-05	1.0	72.65	2023-01-24T18:00:30	2023-01-23T23:50:04	Rev1	None	None
ICSI-2	9e-05	2e-05	0.0	1.0	80.68	2023-02-04T03:22:36	2023-02-04T03:17:26	Rev1	None	None
ICSI-2	0.10654	0.08397	0.02516	1.0	182.1	2023-02-08T06:10:25	2023-02-08T06:06:03	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-01-08T20:30:24	2023-01-08T20:21:39	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-01-09T07:41:07	2023-01-09T07:34:31	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-01-09T16:00:26	2023-01-09T15:51:29	Rev1	:No Results::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	1.11693	0.49996	0.37776	0.55556	84.54	2023-01-09T20:30:25	2023-01-09T20:24:37	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-01-18T17:31:08	2023-01-18T17:23:01	Rev1	:No Results::Container File Missing:	:Container Parameters (jsonschema checker):
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	84.49	2023-01-18T21:30:24	2023-01-18T21:25:02	Rev1	:No Results:	None
TrinitySRITrojAI-BostonU	0.02344	0.00812	0.00076	1.0	107.79	2023-01-18T22:21:17	2023-01-18T22:10:35	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00278	0.00076	1e-05	1.0	198.3	2023-01-19T06:40:25	2023-01-19T06:30:43	Rev1	None	None
TrinitySRITrojAI-BostonU	0.66776	0.19367	0.23619	0.47778	97.81	2023-01-20T07:00:25	2023-01-20T06:55:45	Rev1	None	None
TrinitySRITrojAI-BostonU	0.90898	0.59206	0.29409	0.57778	97.91	2023-01-21T04:20:26	2023-01-21T04:10:39	Rev1	None	None
trojai-example	0.69315	0.0	0.25	0.5	83.84	2022-12-16T22:03:11	2022-12-16T21:52:31	Rev1	:No Results:	None
trojai-example	0.69315	0.0	0.25	0.5	83.84	2022-12-16T22:18:49	2022-12-16T22:13:13	Rev1	:No Results:	None
trojai-example	0.69315	0.0	0.25	0.5	84.4	2022-12-16T23:59:49	2022-12-16T23:57:10	Rev1	:No Results:	None
trojai-example	0.69315	0.0	0.25	0.5	84.44	2022-12-17T00:16:04	2022-12-17T00:15:27	Rev1	:No Results:	None
trojai-example	0.69315	0.0	0.25	0.5	84.33	2022-12-17T00:43:36	2022-12-17T00:25:02	Rev1	:No Results:	None
trojai-example	0.81007	0.21121	0.3027	0.48889	87.39	2022-12-17T01:07:36	2022-12-17T01:05:14	Rev1	None	None
trojai-example	0.89348	0.2549	0.33755	0.56667	84.47	2022-12-28T17:06:41	2022-12-28T17:05:41	Rev1	None	:Schema Header::Schema Header::Schema Header::Schema Header::Schema Header:
trojai-example	0.69315	0.0	0.25	0.5		2022-12-28T17:15:14	2022-12-28T17:12:29	Rev1	:No Results::Container File Missing:	:Schema Header::Schema Header::Schema Header::Schema Header::Schema Header:
trojai-example	0.8806	0.27187	0.32699	0.47778	84.46	2023-01-25T19:40:36	2023-01-25T19:38:14	Rev1	None	:Schema Header:
trojai-example	0.69315	0.0	0.25	0.5		2023-03-09T16:17:14	2023-03-09T16:16:50	Rev1	:No Results::Info File Missing::Container File Missing:	None
trojai-example	0.69315	0.0	0.25	0.5		2023-03-09T16:34:14	2023-03-09T16:32:46	Rev1	:No Results::Info File Missing::Container File Missing:	None
trojai-example	0.65417	0.13356	0.2303	0.74444	37.25	2023-03-09T16:46:08	2023-03-09T16:39:47	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker)::Schema Header:
trojai-example	0.69315	0.0	0.25	0.5		2023-03-10T00:17:34	2023-03-10T00:14:20	Rev1	:No Results::Info File Missing::Container File Missing:	None
trojai-example	0.69315	0.0	0.25	0.5		2023-03-10T00:35:00	2023-03-10T00:28:34	Rev1	:No Results::Info File Missing::Container File Missing:	None
trojai-example	0.69315	0.0	0.25	0.5		2023-03-10T00:52:10	2023-03-10T00:44:59	Rev1	:No Results::Info File Missing::Container File Missing:	None
trojai-example	0.74083	0.16554	0.26851	0.66667	36.81	2023-03-10T01:11:12	2023-03-10T01:09:29	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker)::Schema Header:
trojai-example	0.69315	0.0	0.25	0.5	0.61	2023-03-10T01:23:11	2023-03-10T01:22:54	Rev1	:No Results::Container File Missing:	:Container Parameters (jsonschema checker)::Schema Header::Execute:
trojai-example	0.74864	0.16179	0.27309	0.5	34.4	2023-03-10T01:30:04	2023-03-10T01:28:53	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker)::Schema Header::Execute:
trojai-example	0.65533	0.18376	0.23213	0.62222	34.36	2023-03-10T01:43:42	2023-03-10T01:42:46	Rev1	None	:Container Parameters (jsonschema checker)::Schema Header::Execute:
trojai-example	0.64748	0.14578	0.22829	0.67778	40.73	2023-03-10T03:05:08	2023-03-10T03:04:39	Rev1	None	:Container Parameters (jsonschema checker)::Schema Header::Execute:
UMBCb	0.69315	0.0	0.25	0.5		2023-01-24T18:00:44	2023-01-22T17:38:34	Rev1	:No Results::Container File Missing:	:Schema Header:
UMBCb	0.69315	0.0	0.25	0.5		2023-01-24T20:50:39	2023-01-24T20:50:29	Rev1	:No Results::Info File Missing::Container File Missing:	None
UMBCb	0.23266	0.05237	0.04723	1.0	140.27	2023-01-25T19:10:40	2023-01-25T19:05:14	Rev1	None	None
UMBCb	0.69315	0.0	0.25	0.5	28.19	2023-03-01T20:30:37	2023-03-01T20:29:28	Rev1	:No Results:	None
UMBCb	1.26502	0.00973	0.51514	-0.0	83.85	2023-03-08T19:30:35	2023-03-08T19:27:41	Rev1	None	None
UMBCb	0.69315	0.0	0.25	0.5		2023-03-10T23:40:35	2023-03-09T17:11:47	Rev1	:No Results::Container File Missing:	:Container Parameters (jsonschema checker):
UMBCb	0.46666	0.08	0.14213	0.95556	31.68	2023-03-15T16:30:33	2023-03-15T16:28:09	Rev1	None	None
UMBCb	0.24771	0.00953	0.04829	1.0	28.39	2023-03-15T22:30:31	2023-03-15T22:28:34	Rev1	None	None
UMBCb	0.57962	0.06762	0.1944	0.86667	30.46	2023-03-21T20:30:33	2023-03-21T20:23:38	Rev1	None	None
UMBCb	0.37068	0.37261	0.1215	0.95556	28.35	2023-04-14T21:10:36	2023-04-14T21:03:12	Rev1	None	None

Required filename format: "cyber-pdf-dec2022_dev_<Submission Name>.simg"
Accepting submissions: True
Number of models in cyber-pdf-dec2022, dev: 120
Execution timeout (hh:mm:ss): 20:00:00

Teams/Jobs

Team	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DRAFFT	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UCSD	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UMBC	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojai-example	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IceTorch	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PASS	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors

Round 13 leaderboard for object detection Feb 2023.

Each AI is trained to perform Object Detection using a single stage (SSD), a two stage detector (Faster-RCNN), or a transformer based detector (DETR). For those AIs that have been attacked, the presence of the pattern will cause the AI to reliably produce the wrong prediction. The Training Data Download consists of 128 reference AIs with example input data. More info here.

DOTA_v2 arial image dataset with Localization Trigger altering the traffic circle box.

train: The train dataset that is distributed with each round.
test: The test dataset that is sequestered/hidden, used for evaluation. Submissions here should be fully realized with complete schema and parameters.
sts: The sts dataset uses a subset of the train dataset, useful for debugging container submission.
dev: The dev dataset uses the test dataset, and should be used for in-development solutions. Schemas must be valid, but do not need to be complete. Results do not count towards the program.

train test sts dev

Required filename format: "object-detection-feb2023_train_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-feb2023, train: 121
Execution timeout (hh:mm:ss): 3 days, 6:00:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2023-06-24T00:30:05	performer	None	None	Ok	2023-06-24T00:26:43	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-07-11T07:00:07	performer	None	None	Ok	2023-07-11T06:54:38	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-10T20:30:11	performer	None	None	Ok	2023-10-10T20:28:02	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-07-20T05:30:11	performer	None	None	Ok	2023-07-20T05:28:43	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2023-05-02T19:00:10	performer	None	None	Ok	2023-05-02T18:57:35	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2023-06-21T01:40:17	performer	None	None	Ok	2023-06-21T01:31:31	0 d, 0 h, 0 m, 0 s
ARM	2023-06-13T04:50:26	performer	None	None	Ok	2023-06-13T04:48:44	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	2023-05-02T02:00:22	performer	None	None	Ok	2023-05-02T01:51:13	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2023-06-26T08:10:27	performer	None	None	Ok	2023-06-26T08:04:02	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-06-27T15:00:28	performer	None	None	Ok	2023-06-27T14:54:13	0 d, 0 h, 0 m, 0 s
trojai-example		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.80483	0.07536	0.30157	0.45395	33303.86	2023-06-24T00:30:05	2023-06-24T00:26:43	Rev1	None	None
TrinitySRITrojAI	0.28761	0.05663	0.0818	0.96697	92227.87	2023-07-08T23:30:06	2023-07-08T23:27:02	Rev1	None	None
PL-GIFT	0.16676	0.03033	0.03932	1.0	1057.28	2023-07-07T18:20:08	2023-07-07T18:14:04	Rev1	None	None
Perspecta-PurdueRutgers	0.14331	0.09346	0.03713	0.97711	1521.31	2023-03-13T23:20:09	2023-03-13T23:18:11	Rev1	None	None
Perspecta-IUB	0.07305	0.038	0.0197	0.99698	2215.09	2023-03-25T18:30:10	2023-03-25T18:27:11	Rev1	None	None
ARM-UCSD	0.31089	0.07493	0.09475	0.95504	1239.94	2023-06-21T01:40:17	2023-06-21T01:31:31	Rev1	None	None
ARM	0.12239	0.03039	0.02449	0.99918	1444.37	2023-06-13T04:50:26	2023-06-13T04:48:44	Rev1	None	None
TrinitySRITrojAI-SBU	0.33446	0.02658	0.08495	0.99027	1013.31	2023-05-02T02:00:22	2023-05-02T01:51:13	Rev1	None	None
ICSI-2	0.04741	0.01036	0.00455	1.0	94363.48	2023-06-12T03:00:28	2023-06-12T02:54:36	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-04-09T19:30:25	2023-04-09T19:21:50	Rev1	:Container File Missing:	:Schema Header:

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.80483	0.07536	0.30157	0.45395	33303.86	2023-06-24T00:30:05	2023-06-24T00:26:43	Rev1	None	None
TrinitySRITrojAI	0.58792	0.025	0.19946	0.88857	6042.11	2023-03-25T00:30:07	2023-03-25T00:26:35	Rev1	None	None
TrinitySRITrojAI	0.64293	0.04626	0.22676	0.75027	34800.23	2023-04-18T19:40:10	2023-04-18T19:32:02	Rev1	None	None
TrinitySRITrojAI	0.63268	0.02677	0.22133	0.7463	88552.91	2023-04-25T07:50:06	2023-04-25T07:40:28	Rev1	None	None
TrinitySRITrojAI	0.70876	0.13495	0.23539	0.71395	34243.13	2023-06-02T21:20:06	2023-06-02T21:10:40	Rev1	None	None
TrinitySRITrojAI	0.53035	0.05058	0.17758	0.86061	121525.57	2023-06-07T05:40:07	2023-06-07T05:39:47	Rev1	None	None
TrinitySRITrojAI	0.42571	0.05134	0.12837	0.9253	38987.68	2023-06-26T21:00:07	2023-06-26T20:57:43	Rev1	None	None
TrinitySRITrojAI	0.28761	0.05663	0.0818	0.96697	92227.87	2023-07-08T23:30:06	2023-07-08T23:27:02	Rev1	None	None
TrinitySRITrojAI	0.38822	0.06367	0.11591	0.92941	39812.77	2023-07-11T07:00:07	2023-07-11T06:54:38	Rev1	None	None
PL-GIFT	0.44931	0.06064	0.13678	0.88953	1049.86	2023-04-27T22:20:13	2023-04-27T22:19:31	Rev1	None	None
PL-GIFT	0.59777	0.09902	0.20478	0.69093	2409.43	2023-05-11T06:50:06	2023-05-11T06:45:25	Rev1	None	None
PL-GIFT	0.16676	0.03033	0.03932	1.0	1057.28	2023-07-07T18:20:08	2023-07-07T18:14:04	Rev1	None	None
PL-GIFT	0.06873	0.02022	0.01339	1.0	1192.92	2023-07-09T18:00:07	2023-07-09T17:56:47	Rev1	None	None
PL-GIFT	0.12238	0.0287	0.02737	1.0	1238.63	2023-07-09T20:10:07	2023-07-09T20:00:57	Rev1	None	None
PL-GIFT	0.11539	0.02478	0.02334	1.0	1186.23	2023-07-09T23:20:07	2023-07-09T23:14:58	Rev1	None	None
PL-GIFT	0.0942	0.02213	0.01806	1.0	1213.12	2023-07-10T17:30:08	2023-07-10T17:22:01	Rev1	None	None
PL-GIFT	0.01694	0.00586	0.00123	1.0	1140.14	2023-07-10T19:10:08	2023-07-10T19:02:59	Rev1	None	None
PL-GIFT	0.11566	0.02762	0.02535	1.0	1074.6	2023-07-10T22:30:08	2023-07-10T22:29:31	Rev1	None	None
PL-GIFT	0.1048	0.02667	0.02311	1.0	1168.15	2023-07-12T22:40:07	2023-07-12T22:40:04	Rev1	None	None
PL-GIFT	0.3457	0.03488	0.09878	1.0	78911.58	2023-07-14T23:20:08	2023-07-14T23:17:11	Rev1	None	None
PL-GIFT	0.2795	0.02962	0.06999	0.9989	142510.69	2023-07-18T20:20:10	2023-07-18T20:10:35	Rev1	None	None
PL-GIFT	0.47324	0.04797	0.15279	0.90447	143280.68	2023-07-25T16:00:09	2023-07-25T15:58:39	Rev1	None	None
PL-GIFT	0.39255	0.20024	0.07713	0.90022	741.95	2023-10-10T00:50:13	2023-10-10T00:42:23	Rev1	None	None
PL-GIFT	0.35017	0.039	0.09946	0.98506	749.14	2023-10-10T05:22:42	2023-10-10T05:15:15	Rev1	None	None
PL-GIFT	0.46256	0.16012	0.12251	0.93311	687.61	2023-10-10T14:30:14	2023-10-10T14:25:56	Rev1	None	None
PL-GIFT	0.32067	0.04711	0.09112	0.96382	745.69	2023-10-10T17:00:13	2023-10-10T16:58:29	Rev1	None	None
PL-GIFT	0.4318	0.04212	0.13439	0.93435	714.2	2023-10-10T18:02:39	2023-10-10T17:59:18	Rev1	None	None
PL-GIFT	0.36627	0.05837	0.12723	0.94408	683.62	2023-10-10T19:20:11	2023-10-10T19:14:03	Rev1	None	None
PL-GIFT	0.52475	0.07057	0.17425	0.88377	763.58	2023-10-10T20:30:11	2023-10-10T20:28:02	Rev1	None	None
Perspecta-PurdueRutgers	0.14331	0.09346	0.03713	0.97711	1521.31	2023-03-13T23:20:09	2023-03-13T23:18:11	Rev1	None	None
Perspecta-PurdueRutgers	0.52293	0.14911	0.15293	0.8162	54241.01	2023-05-20T06:30:10	2023-05-20T06:27:01	Rev1	None	None
Perspecta-PurdueRutgers	0.52293	0.14911	0.15293	0.8162	55374.42	2023-05-29T05:10:09	2023-05-29T05:00:42	Rev1	None	None
Perspecta-PurdueRutgers	0.46465	0.13359	0.14147	0.81195	55009.21	2023-06-11T17:50:10	2023-06-11T17:40:16	Rev1	None	None
Perspecta-PurdueRutgers	0.69549	0.46623	0.1426	0.86458	57419.61	2023-07-12T00:20:10	2023-07-12T00:19:44	Rev1	None	None
Perspecta-PurdueRutgers	0.69549	0.46623	0.1426	0.86458	57595.33	2023-07-15T06:40:10	2023-07-15T06:33:56	Rev1	None	None
Perspecta-PurdueRutgers	1.13257	0.76907	0.15249	0.84128	54787.45	2023-07-17T19:20:12	2023-07-17T19:15:00	Rev1	None	None
Perspecta-PurdueRutgers	1.55671	0.97681	0.1567	0.80441	54847.82	2023-07-20T05:30:11	2023-07-20T05:28:43	Rev1	None	None
Perspecta-IUB	0.07305	0.038	0.0197	0.99698	2215.09	2023-03-25T18:30:10	2023-03-25T18:27:11	Rev1	None	None
Perspecta-IUB	0.2197	0.08925	0.06484	0.98479	1971.36	2023-03-27T20:10:11	2023-03-27T20:09:38	Rev1	None	None
Perspecta-IUB	0.2347	0.05477	0.07012	0.98506	1655.38	2023-03-29T03:00:11	2023-03-29T02:57:04	Rev1	None	None
Perspecta-IUB	0.34856	0.05517	0.11082	0.94435	6867.78	2023-03-29T20:50:10	2023-03-29T20:50:03	Rev1	None	None
Perspecta-IUB	0.34856	0.05517	0.11082	0.94435	6725.45	2023-05-02T19:00:10	2023-05-02T18:57:35	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	485.79	2023-05-17T22:50:17	2023-05-17T22:49:27	Rev1	:Missing Results:	None
ARM-UCSD	0.5205	0.04816	0.18026	0.75822	521.93	2023-06-05T23:40:17	2023-06-05T23:33:29	Rev1	None	None
ARM-UCSD	0.31089	0.07493	0.09475	0.95504	1239.94	2023-06-21T01:40:17	2023-06-21T01:31:31	Rev1	None	None
ARM	0.15563	0.03911	0.03868	0.99548	1942.35	2023-05-16T12:10:24	2023-05-16T12:04:17	Rev1	None	None
ARM	0.12146	0.03303	0.02506	0.99904	1332.64	2023-05-16T16:50:24	2023-05-16T16:44:18	Rev1	None	None
ARM	0.12239	0.03039	0.02449	0.99918	1444.37	2023-06-13T04:50:26	2023-06-13T04:48:44	Rev1	None	None
TrinitySRITrojAI-SBU	0.56428	0.03863	0.18872	0.84581	1028.38	2023-04-04T05:30:19	2023-04-04T05:22:12	Rev1	None	None
TrinitySRITrojAI-SBU	0.55265	0.03907	0.18384	0.85485	1010.28	2023-04-18T19:42:50	2023-04-18T19:40:00	Rev1	None	None
TrinitySRITrojAI-SBU	0.3976	0.03061	0.11308	0.98177	673.55	2023-04-18T23:50:24	2023-04-18T23:45:56	Rev1	None	None
TrinitySRITrojAI-SBU	0.33446	0.02658	0.08495	0.99027	1013.31	2023-05-02T02:00:22	2023-05-02T01:51:13	Rev1	None	None
ICSI-2	0.43245	0.0486	0.13363	0.93695	742.6	2023-03-15T22:10:24	2023-03-15T22:00:30	Rev1	None	None
ICSI-2	0.26257	0.07974	0.0726	0.96203	879.15	2023-03-31T10:30:21	2023-03-31T10:21:51	Rev1	None	None
ICSI-2	0.1736	0.09726	0.04306	0.97026	887.76	2023-04-07T03:10:23	2023-04-07T03:04:19	Rev1	None	None
ICSI-2	0.294	0.07303	0.08151	0.95806	853.13	2023-04-08T02:00:23	2023-04-08T01:52:38	Rev1	None	None
ICSI-2	0.23231	0.06364	0.06151	0.97697	1007.49	2023-04-19T01:40:29	2023-04-19T01:40:12	Rev1	None	None
ICSI-2	0.22221	0.06141	0.05717	0.9804	17844.11	2023-05-06T01:10:24	2023-05-06T01:08:30	Rev1	None	None
ICSI-2	0.23087	0.05649	0.0564	0.97766	3744.01	2023-05-12T10:00:24	2023-05-12T09:57:07	Rev1	None	None
ICSI-2	0.17839	0.02967	0.03594	0.99767	56061.37	2023-05-22T19:52:00	2023-05-22T19:48:12	Rev1	None	None
ICSI-2	0.1718	0.02812	0.03372	0.99836	112057.34	2023-05-28T23:00:28	2023-05-28T22:54:01	Rev1	None	None
ICSI-2	0.16238	0.02867	0.03152	0.99849	94211.9	2023-06-05T22:50:28	2023-06-05T22:41:55	Rev1	None	None
ICSI-2	0.04741	0.01036	0.00455	1.0	94363.48	2023-06-12T03:00:28	2023-06-12T02:54:36	Rev1	None	None
ICSI-2	0.17533	0.02278	0.03103	0.99986	93584.12	2023-06-26T08:10:27	2023-06-26T08:04:02	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-04-09T19:30:25	2023-04-09T19:21:50	Rev1	:Container File Missing:	:Schema Header:
TrinitySRITrojAI-BostonU	0.70183	0.03606	0.25421	0.5	914.59	2023-04-10T22:20:24	2023-04-10T22:13:48	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-06-06T21:40:28	2023-06-06T21:34:52	Rev1	:No Results::Missing Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-BostonU	0.70398	0.01785	0.25539	0.5	644.37	2023-06-11T05:50:30	2023-06-11T05:49:46	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70183	0.03606	0.25421	0.5	1971.91	2023-06-11T21:00:30	2023-06-11T20:53:10	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70398	0.01785	0.25539	0.5	703.53	2023-06-13T09:20:30	2023-06-13T09:15:37	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70398	0.01785	0.25539	0.5	2261.79	2023-06-13T21:30:31	2023-06-13T21:24:31	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70398	0.01785	0.25539	0.5	2280.26	2023-06-14T00:20:31	2023-06-14T00:14:35	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70398	0.01785	0.25539	0.5	2280.96	2023-06-14T07:20:31	2023-06-14T07:14:39	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70398	0.01785	0.25539	0.5	2190.35	2023-06-14T14:50:32	2023-06-14T14:45:31	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70398	0.01785	0.25539	0.5	752.05	2023-06-23T00:00:30	2023-06-22T23:52:22	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69146	0.00936	0.24916	0.5	4751.11	2023-06-27T15:00:28	2023-06-27T14:54:13	Rev1	None	None

Required filename format: "object-detection-feb2023_test_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-feb2023, test: 185
Execution timeout (hh:mm:ss): 5 days, 8:00:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2023-07-11T00:00:05	performer	None	None	Ok	2023-07-10T23:56:23	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-07-11T07:00:07	performer	None	None	Ok	2023-07-11T06:54:38	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-10T20:30:11	performer	None	None	Ok	2023-10-10T20:28:02	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-07-20T05:30:11	performer	None	Ok	Ok	2023-07-20T05:28:43	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2023-06-27T19:10:10	performer	None	None	Ok	2023-06-27T19:03:38	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2023-06-21T01:40:17	performer	None	None	Ok	2023-06-21T01:31:31	0 d, 0 h, 0 m, 0 s
ARM	2023-06-13T04:50:26	performer	None	Ok	Ok	2023-06-13T04:48:44	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	2023-05-02T02:00:22	performer	None	None	Ok	2023-05-02T01:51:13	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2023-07-11T02:00:28	performer	None	None	Ok	2023-07-11T01:56:07	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-06-27T15:00:28	performer	None	None	Ok	2023-06-27T14:54:13	0 d, 0 h, 0 m, 0 s
trojai-example	2023-03-13T15:10:31	public	None	None	Ok	2023-03-13T15:03:50	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.66901	0.04582	0.23789	0.63294	3714.45	2023-06-27T17:50:05	2023-06-27T17:41:31	Rev1	:Missing Results:	None
TrinitySRITrojAI	0.58517	0.07475	0.19933	0.76324	50021.37	2023-07-11T07:00:07	2023-07-11T06:54:38	Rev1	None	None
PL-GIFT	0.6747	0.06768	0.23394	0.66588	103715.42	2023-07-14T23:20:08	2023-07-14T23:17:11	Rev1	None	None
Perspecta-PurdueRutgers	0.28314	0.08543	0.07977	0.92647	79699.53	2023-07-20T05:30:11	2023-07-20T05:28:43	Rev1	None	None
Perspecta-IUB	2.11938	0.63165	0.29264	0.63835	3088.39	2023-03-27T20:10:11	2023-03-27T20:09:38	Rev1	None	None
ARM-UCSD	0.93411	0.16792	0.2931	0.63641	1895.26	2023-06-21T01:40:17	2023-06-21T01:31:31	Rev1	None	None
ARM	1.03628	0.20235	0.29674	0.69388	2107.0	2023-06-13T04:50:26	2023-06-13T04:48:44	Rev1	None	None
TrinitySRITrojAI-SBU	0.73799	0.06395	0.26705	0.55753	1500.88	2023-05-02T02:00:22	2023-05-02T01:51:13	Rev1	None	None
ICSI-2	0.79481	0.17951	0.22635	0.74606	123545.29	2023-06-12T03:00:28	2023-06-12T02:54:36	Rev1	None	None
TrinitySRITrojAI-BostonU	0.68447	0.0128	0.24619	0.52353	2041.22	2023-04-24T14:10:28	2023-04-22T11:38:05	Rev1	None	None
trojai-example	0.96553	0.12902	0.33804	0.50588	1149.63	2023-03-10T22:41:58	2023-03-10T22:40:44	Rev1	None	:Schema Header:

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.85628	0.10729	0.29425	0.48676	3760.58	2023-04-04T06:50:05	2023-04-04T06:46:51	Rev1	None	None
Perspecta	0.69315	0.0	0.25	0.5	1458.84	2023-04-18T06:50:06	2023-04-18T06:41:56	Rev1	None	None
Perspecta	0.70322	0.03718	0.25335	0.54094	3403.78	2023-04-18T15:10:07	2023-04-18T15:08:18	Rev1	None	None
Perspecta	0.68488	0.03458	0.24553	0.57765	4379.48	2023-04-28T17:40:05	2023-04-28T17:33:27	Rev1	None	None
Perspecta	0.67461	0.04314	0.24035	0.62588	4376.16	2023-04-29T03:40:05	2023-04-29T03:39:59	Rev1	None	None
Perspecta	0.73681	0.06073	0.26946	0.52412	40057.86	2023-06-24T00:30:05	2023-06-24T00:26:43	Rev1	None	None
Perspecta	0.66901	0.04582	0.23789	0.63294	3714.45	2023-06-27T17:50:05	2023-06-27T17:41:31	Rev1	:Missing Results:	None
Perspecta	0.66443	0.04559	0.23573	0.62847	1861.58	2023-07-11T00:00:05	2023-07-10T23:56:23	Rev1	:Missing Results:	None
TrinitySRITrojAI	0.782	0.06766	0.28295	0.50535	8221.66	2023-03-25T00:30:07	2023-03-25T00:26:35	Rev1	None	None
TrinitySRITrojAI	0.73832	0.04847	0.27013	0.50959	50605.8	2023-04-18T19:40:10	2023-04-18T19:32:02	Rev1	None	None
TrinitySRITrojAI	0.74802	0.05977	0.26871	0.53871	94737.94	2023-04-25T07:50:06	2023-04-25T07:40:28	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1045.57	2023-05-16T16:10:06	2023-05-16T16:06:20	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5		2023-05-26T18:00:06	2023-05-26T17:51:22	Rev1	:No Results::Missing Results::Info File Missing:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	273.28	2023-06-01T07:20:06	2023-06-01T07:13:14	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.84728	0.10419	0.29888	0.55453	55218.93	2023-06-02T21:20:06	2023-06-02T21:10:40	Rev1	None	None
TrinitySRITrojAI	0.65772	0.04184	0.23633	0.60194	170288.26	2023-06-07T05:40:07	2023-06-07T05:39:47	Rev1	None	None
TrinitySRITrojAI	0.59497	0.05576	0.20457	0.75318	48983.67	2023-06-26T21:00:07	2023-06-26T20:57:43	Rev1	None	None
TrinitySRITrojAI	0.73985	0.13193	0.24269	0.70759	113623.26	2023-07-08T23:30:06	2023-07-08T23:27:02	Rev1	None	None
TrinitySRITrojAI	0.58517	0.07475	0.19933	0.76324	50021.37	2023-07-11T07:00:07	2023-07-11T06:54:38	Rev1	None	None
PL-GIFT	0.70689	0.06132	0.25544	0.60382	1546.41	2023-04-27T22:20:13	2023-04-27T22:19:31	Rev1	None	None
PL-GIFT	0.86455	0.11637	0.30106	0.57476	3475.73	2023-05-11T06:50:06	2023-05-11T06:45:25	Rev1	None	None
PL-GIFT	6.28303	1.59088	0.37611	0.42512	137288.38	2023-06-27T18:20:52	2023-06-27T18:17:58	Rev1	:Missing Results:	None
PL-GIFT	0.64791	0.03093	0.23011	0.63488	1608.66	2023-07-07T18:20:08	2023-07-07T18:14:04	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2023-07-08T17:00:08	2023-07-08T16:58:45	Rev1	:No Results::Missing Results:	:Container Parameters (metaparameters)::Container Parameters (metaparameters schema):
PL-GIFT	0.97445	0.40475	0.25058	0.57365	1718.47	2023-07-09T18:00:07	2023-07-09T17:56:47	Rev1	None	None
PL-GIFT	0.64914	0.03412	0.23184	0.60365	1863.48	2023-07-09T20:10:07	2023-07-09T20:00:57	Rev1	None	None
PL-GIFT	0.64536	0.0316	0.23016	0.58641	1827.77	2023-07-09T23:20:07	2023-07-09T23:14:58	Rev1	None	None
PL-GIFT	0.7319	0.07514	0.25564	0.58294	1735.73	2023-07-10T17:30:08	2023-07-10T17:22:01	Rev1	None	None
PL-GIFT	0.87341	0.29549	0.26587	0.59188	1754.85	2023-07-10T19:10:08	2023-07-10T19:02:59	Rev1	None	None
PL-GIFT	0.64213	0.0293	0.22828	0.616	1727.3	2023-07-10T22:30:08	2023-07-10T22:29:31	Rev1	None	None
PL-GIFT	0.644	0.03345	0.23086	0.61994	1759.37	2023-07-12T22:40:07	2023-07-12T22:40:04	Rev1	None	None
PL-GIFT	0.6747	0.06768	0.23394	0.66588	103715.42	2023-07-14T23:20:08	2023-07-14T23:17:11	Rev1	None	None
PL-GIFT	0.67902	0.06397	0.24158	0.64029	193584.83	2023-07-18T20:20:10	2023-07-18T20:10:35	Rev1	None	None
PL-GIFT	0.70632	0.0564	0.25471	0.57206	188393.05	2023-07-25T16:00:09	2023-07-25T15:58:39	Rev1	None	None
PL-GIFT	1.14108	0.1907	0.3326	0.52412	1124.05	2023-10-10T00:50:13	2023-10-10T00:42:23	Rev1	None	None
PL-GIFT	0.71091	0.04667	0.25514	0.54541	1128.34	2023-10-10T05:22:42	2023-10-10T05:15:15	Rev1	None	None
PL-GIFT	1.09561	0.17155	0.33651	0.54347	1116.89	2023-10-10T14:30:14	2023-10-10T14:25:56	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2023-10-10T15:22:03	2023-10-10T15:17:01	Rev1	:No Results::Missing Results:	:Container Parameters (jsonschema checker):
PL-GIFT	0.83476	0.10977	0.28439	0.53024	1071.75	2023-10-10T17:00:13	2023-10-10T16:58:29	Rev1	None	None
PL-GIFT	0.71922	0.04615	0.25776	0.53894	1116.53	2023-10-10T18:02:39	2023-10-10T17:59:18	Rev1	None	None
PL-GIFT	0.78575	0.09091	0.27795	0.56065	1134.14	2023-10-10T19:20:11	2023-10-10T19:14:03	Rev1	None	None
PL-GIFT	0.77627	0.0599	0.28128	0.51053	1140.44	2023-10-10T20:30:11	2023-10-10T20:28:02	Rev1	None	None
Perspecta-PurdueRutgers	0.49376	0.09943	0.14978	0.85147	73898.53	2023-05-20T06:30:10	2023-05-20T06:27:01	Rev1	None	None
Perspecta-PurdueRutgers	0.46868	0.09453	0.14143	0.86535	75716.78	2023-05-29T05:10:09	2023-05-29T05:00:42	Rev1	None	None
Perspecta-PurdueRutgers	0.41534	0.08223	0.12831	0.87729	78407.19	2023-06-10T08:20:10	2023-06-10T08:19:31	Rev1	:Missing Results:	None
Perspecta-PurdueRutgers	0.30574	0.08178	0.08322	0.92429	78295.74	2023-06-11T17:50:10	2023-06-11T17:40:16	Rev1	None	None
Perspecta-PurdueRutgers	0.3838	0.09183	0.11632	0.88535	82448.92	2023-07-10T14:40:11	2023-07-10T14:35:18	Rev1	:Missing Results:	None
Perspecta-PurdueRutgers	0.30891	0.0925	0.08866	0.92035	82900.95	2023-07-12T00:20:10	2023-07-12T00:19:44	Rev1	None	None
Perspecta-PurdueRutgers	0.30891	0.0925	0.08866	0.92035	81533.7	2023-07-15T06:40:10	2023-07-15T06:33:56	Rev1	None	None
Perspecta-PurdueRutgers	0.39044	0.08405	0.12161	0.88365	79262.11	2023-07-16T16:10:12	2023-07-16T16:00:48	Rev1	:Missing Results:	None
Perspecta-PurdueRutgers	0.41833	0.30072	0.08081	0.92165	78248.52	2023-07-17T19:20:12	2023-07-17T19:15:00	Rev1	None	None
Perspecta-PurdueRutgers	0.28314	0.08543	0.07977	0.92647	79699.53	2023-07-20T05:30:11	2023-07-20T05:28:43	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-03-25T15:50:11	2023-03-25T15:46:48	Rev1	None	:Schema Header:
Perspecta-IUB	1.67989	0.42697	0.31374	0.63306	3470.85	2023-03-25T18:30:10	2023-03-25T18:27:11	Rev1	None	None
Perspecta-IUB	2.11938	0.63165	0.29264	0.63835	3088.39	2023-03-27T20:10:11	2023-03-27T20:09:38	Rev1	None	None
Perspecta-IUB	1.17077	0.28654	0.29032	0.55406	2530.22	2023-03-28T01:50:11	2023-03-28T01:41:16	Rev1	None	None
Perspecta-IUB	1.46808	0.3249	0.33534	0.57447	2556.06	2023-03-29T03:00:11	2023-03-29T02:57:04	Rev1	None	None
Perspecta-IUB	1.27651	0.26722	0.31383	0.53088	10960.17	2023-03-29T20:50:10	2023-03-29T20:50:03	Rev1	None	None
Perspecta-IUB	1.27651	0.26722	0.31383	0.53088	10878.02	2023-05-02T19:00:10	2023-05-02T18:57:35	Rev1	None	None
Perspecta-IUB	1.27651	0.26722	0.31383	0.53088	10463.62	2023-06-27T19:10:10	2023-06-27T19:03:38	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-05-30T17:00:18	2023-05-30T16:56:16	Rev1	:Executed File Update::No Results::Missing Results::Info File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	769.68	2023-06-05T20:40:15	2023-06-05T20:37:29	Rev1	:Missing Results:	None
ARM-UCSD	0.93411	0.16792	0.2931	0.63641	1895.26	2023-06-21T01:40:17	2023-06-21T01:31:31	Rev1	None	None
ARM	0.96557	0.18772	0.28498	0.68	3027.23	2023-05-16T12:10:24	2023-05-16T12:04:17	Rev1	None	None
ARM	0.95802	0.18412	0.28818	0.68771	2046.45	2023-05-16T16:50:24	2023-05-16T16:44:18	Rev1	None	None
ARM	1.03628	0.20235	0.29674	0.69388	2107.0	2023-06-13T04:50:26	2023-06-13T04:48:44	Rev1	None	None
TrinitySRITrojAI-SBU	0.71798	0.0412	0.26142	0.52729	1562.78	2023-04-04T05:30:19	2023-04-04T05:22:12	Rev1	None	None
TrinitySRITrojAI-SBU	0.72078	0.0413	0.26258	0.52665	1500.18	2023-04-18T19:42:50	2023-04-18T19:40:00	Rev1	None	None
TrinitySRITrojAI-SBU	0.74799	0.05432	0.27292	0.52112	1001.52	2023-04-18T23:50:24	2023-04-18T23:45:56	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	1155.27	2023-05-01T23:30:21	2023-05-01T23:29:59	Rev1	None	None
TrinitySRITrojAI-SBU	0.73799	0.06395	0.26705	0.55753	1500.88	2023-05-02T02:00:22	2023-05-02T01:51:13	Rev1	None	None
ICSI-2	0.74203	0.0577	0.26893	0.53606	1227.35	2023-03-15T22:10:24	2023-03-15T22:00:30	Rev1	None	None
ICSI-2	1.11274	0.16968	0.35806	0.52959	1268.21	2023-04-07T03:10:23	2023-04-07T03:04:19	Rev1	None	None
ICSI-2	0.76633	0.08519	0.27614	0.59471	1242.31	2023-04-08T02:00:23	2023-04-08T01:52:38	Rev1	None	None
ICSI-2	0.81266	0.09468	0.29202	0.56506	1488.52	2023-04-19T01:40:29	2023-04-19T01:40:12	Rev1	None	None
ICSI-2	0.69315	0.0	0.25	0.5		2023-05-06T00:00:24	2023-05-05T23:54:12	Rev1	None	:Container Parameters (jsonschema checker):
ICSI-2	0.84182	0.11469	0.29269	0.59035	26957.79	2023-05-06T01:10:24	2023-05-06T01:08:30	Rev1	None	None
ICSI-2	0.84182	0.11469	0.29269	0.59035	27036.49	2023-05-06T08:51:40	2023-05-06T01:10:41	Rev1	None	None
ICSI-2	0.71755	0.11121	0.24326	0.68682	5555.79	2023-05-12T10:00:24	2023-05-12T09:57:07	Rev1	None	None
ICSI-2	0.68036	0.11046	0.2277	0.71729	71364.42	2023-05-22T19:52:00	2023-05-22T19:48:12	Rev1	None	None
ICSI-2	0.70131	0.11025	0.23821	0.69706	142969.0	2023-05-28T23:00:28	2023-05-28T22:54:01	Rev1	None	None
ICSI-2	0.67516	0.11452	0.22487	0.72271	122210.48	2023-06-05T22:50:28	2023-06-05T22:41:55	Rev1	None	None
ICSI-2	0.79481	0.17951	0.22635	0.74606	123545.29	2023-06-12T03:00:28	2023-06-12T02:54:36	Rev1	None	None
ICSI-2	0.64145	0.07582	0.22393	0.72194	122411.86	2023-06-26T08:10:27	2023-06-26T08:04:02	Rev1	None	None
ICSI-2	0.69315	0.0	0.25	0.5	84571.92	2023-07-11T02:00:28	2023-07-11T01:56:07	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI-BostonU	0.69712	0.02912	0.25189	0.5	1397.03	2023-04-17T14:40:28	2023-04-17T14:36:14	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69712	0.02912	0.25189	0.5	1417.2	2023-04-17T15:20:26	2023-04-17T15:15:17	Rev1	None	None
TrinitySRITrojAI-BostonU	0.68447	0.0128	0.24619	0.52353	2041.22	2023-04-24T14:10:28	2023-04-22T11:38:05	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-06-05T21:20:30	2023-06-05T21:11:53	Rev1	:No Results::Missing Results:	:Schema Header:
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-06-05T22:40:31	2023-06-05T22:33:00	Rev1	:No Results::Missing Results:	:Schema Header:
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-06-05T23:30:26	2023-06-05T23:23:42	Rev1	:No Results::Missing Results:	:Schema Header:
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-06-06T01:00:28	2023-06-06T00:58:33	Rev1	:No Results::Missing Results:	:Schema Header:
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-06-06T20:50:29	2023-06-06T20:47:10	Rev1	:No Results::Missing Results:	:Schema Header:
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-06-06T23:10:29	2023-06-06T23:09:30	Rev1	:No Results::Missing Results::Info File Missing:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	309.91	2023-06-07T08:50:29	2023-06-07T08:49:16	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI-BostonU	0.68955	0.00988	0.2482	0.50588	6652.32	2023-06-10T06:00:31	2023-06-10T05:58:26	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.68955	0.00988	0.2482	0.50588	6383.11	2023-06-10T22:00:31	2023-06-10T21:51:48	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	944.23	2023-06-11T05:50:30	2023-06-11T05:49:46	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69712	0.02912	0.25189	0.5	2711.25	2023-06-11T21:00:30	2023-06-11T20:53:10	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70598	0.01394	0.25639	0.49471	5005.38	2023-06-12T22:50:30	2023-06-12T22:42:52	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70598	0.01394	0.25639	0.49471	4829.4	2023-06-13T04:40:30	2023-06-13T04:34:39	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70682	0.01437	0.25681	0.49412	3149.17	2023-06-13T07:10:30	2023-06-13T07:09:11	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	1065.67	2023-06-13T09:20:30	2023-06-13T09:15:37	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70682	0.01437	0.25681	0.49412	3047.44	2023-06-13T17:50:31	2023-06-13T17:48:54	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	3052.41	2023-06-13T21:30:31	2023-06-13T21:24:31	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	3157.96	2023-06-14T00:20:31	2023-06-14T00:14:35	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	3141.87	2023-06-14T07:20:31	2023-06-14T07:14:39	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70682	0.01437	0.25681	0.49412	3112.14	2023-06-14T10:40:31	2023-06-14T10:36:11	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	3100.72	2023-06-14T14:50:32	2023-06-14T14:45:31	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	1183.47	2023-06-23T00:00:30	2023-06-22T23:52:22	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69028	0.00755	0.24857	0.5	6598.71	2023-06-27T15:00:28	2023-06-27T14:54:13	Rev1	None	None
trojai-example	0.69315	0.0	0.25	0.5		2023-03-10T22:24:54	2023-03-10T22:24:44	Rev1	:Executed File Update::Info File Missing:	None
trojai-example	0.96553	0.12902	0.33804	0.50588	1149.63	2023-03-10T22:41:58	2023-03-10T22:40:44	Rev1	None	:Schema Header:
trojai-example	0.96553	0.12902	0.33804	0.50588	1141.83	2023-03-13T15:10:31	2023-03-13T15:03:50	Rev1	None	:Schema Header:

Required filename format: "object-detection-feb2023_sts_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-feb2023, sts: 10
Execution timeout (hh:mm:ss): 6:40:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2023-07-10T23:40:05	performer	None	None	Ok	2023-07-10T23:30:44	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-07-11T05:20:07	performer	None	None	Ok	2023-07-11T05:16:06	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-09T23:44:46	performer	None	None	Ok	2023-10-09T23:34:45	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-07-11T20:30:10	performer	None	None	Ok	2023-07-11T20:27:32	0 d, 0 h, 0 m, 0 s
Perspecta-IUB		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2023-06-21T01:40:18	performer	None	None	Ok	2023-06-21T01:32:02	0 d, 0 h, 0 m, 0 s
ARM	2023-05-16T11:50:24	performer	None	None	Ok	2023-05-16T11:47:01	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	2023-04-18T20:40:22	performer	None	None	Ok	2023-04-18T20:30:49	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2023-03-15T21:40:24	performer	None	None	Ok	2023-03-15T21:33:13	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-06-11T05:50:31	performer	None	None	Ok	2023-06-11T05:40:44	0 d, 0 h, 0 m, 0 s
trojai-example	2023-03-14T17:00:30	public	None	None	Ok	2023-03-14T16:59:37	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.40128	0.11164	0.11474	0.9375	460.16	2023-04-29T02:40:05	2023-04-29T02:34:42	Rev1	None	None
TrinitySRITrojAI	0.36223	0.11185	0.10238	1.0	1166.17	2023-05-22T19:20:06	2023-05-22T19:11:07	Rev1	None	None
PL-GIFT	0.23772	0.08649	0.05348	1.0	94.83	2023-07-07T18:20:09	2023-07-07T18:13:30	Rev1	None	None
Perspecta-PurdueRutgers	0.36078	0.42647	0.10162	0.96875	5178.94	2023-03-21T20:30:10	2023-03-21T20:28:14	Rev1	None	None
ARM-UCSD	0.11142	0.05462	0.01631	1.0	101.71	2023-06-21T01:40:18	2023-06-21T01:32:02	Rev1	None	None
ARM	0.18488	0.14572	0.04748	1.0	150.92	2023-05-16T11:50:24	2023-05-16T11:47:01	Rev1	None	None
TrinitySRITrojAI-SBU	0.44791	0.07471	0.13352	1.0	53.28	2023-04-18T20:40:22	2023-04-18T20:30:49	Rev1	None	None
ICSI-2	0.22077	0.09074	0.04841	1.0	75.99	2023-03-15T21:40:24	2023-03-15T21:33:13	Rev1	None	None
TrinitySRITrojAI-BostonU	0.65531	0.04044	0.23114	0.65625	292.48	2023-06-08T10:40:30	2023-06-08T10:39:39	Rev1	:Missing Results:	None
trojai-example	0.5532	0.36346	0.18464	0.5625	62.34	2023-03-10T03:26:39	2023-03-10T03:17:14	Rev1	None	:Schema Header::Execute:

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.69315	0.0	0.25	0.5		2023-04-04T03:30:06	2023-04-04T03:28:06	Rev1	:Container File Missing:	:Schema Header:
Perspecta	0.54939	0.24798	0.19794	0.59375	269.85	2023-04-04T04:30:05	2023-04-04T04:25:39	Rev1	None	None
Perspecta	0.69315	0.0	0.25	0.5		2023-04-04T05:40:05	2023-04-04T05:30:42	Rev1	:Executed File Update::Info File Missing::Container File Missing:	None
Perspecta	0.69315	0.0	0.25	0.5	101.79	2023-04-18T07:50:06	2023-04-18T07:45:06	Rev1	None	None
Perspecta	0.55499	0.08682	0.184	0.90625	246.32	2023-04-18T14:10:09	2023-04-18T14:03:44	Rev1	None	None
Perspecta	0.69315	0.0	0.25	0.5	99.35	2023-04-28T04:20:05	2023-04-28T04:15:52	Rev1	None	None
Perspecta	0.69315	0.0	0.25	0.5	50.33	2023-04-28T15:00:05	2023-04-28T14:55:00	Rev1	None	None
Perspecta	0.53183	0.12625	0.17543	0.8125	450.72	2023-04-28T16:40:05	2023-04-28T16:32:05	Rev1	None	None
Perspecta	0.53183	0.12625	0.17543	0.8125	450.52	2023-04-28T19:20:06	2023-04-28T19:11:32	Rev1	None	None
Perspecta	0.40128	0.11164	0.11474	0.9375	460.16	2023-04-29T02:40:05	2023-04-29T02:34:42	Rev1	None	None
Perspecta	0.57599	0.16278	0.194	0.5625	2875.45	2023-06-23T17:40:06	2023-06-23T17:39:45	Rev1	:Missing Results:	None
Perspecta	0.69559	0.25728	0.25	0.5625	3490.22	2023-06-23T22:50:06	2023-06-23T22:41:56	Rev1	None	None
Perspecta	0.52613	0.21006	0.17	0.875	365.06	2023-06-27T17:20:05	2023-06-27T17:17:41	Rev1	None	None
Perspecta	0.52613	0.21006	0.17	0.5	159.36	2023-07-10T20:50:05	2023-07-10T20:40:39	Rev1	None	None
Perspecta	0.52613	0.21006	0.17	0.5	165.35	2023-07-10T23:40:05	2023-07-10T23:30:44	Rev1	None	None
TrinitySRITrojAI	0.68236	0.01416	0.24461	0.59375	6000.69	2023-03-24T00:40:07	2023-03-24T00:30:19	Rev1	None	:Timeout:
TrinitySRITrojAI	0.61687	0.04086	0.21215	0.875	597.85	2023-03-24T22:00:07	2023-03-24T21:59:32	Rev1	None	None
TrinitySRITrojAI	0.818	0.18012	0.30845	0.71875	2617.08	2023-04-18T18:20:08	2023-04-18T18:19:21	Rev1	None	None
TrinitySRITrojAI	0.7568	0.16221	0.27944	0.625	210.7	2023-04-25T01:00:06	2023-04-25T00:58:54	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	86.17	2023-05-16T02:30:13	2023-05-14T22:34:28	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.64599	0.20082	0.22597	0.34375	6662.7	2023-05-16T06:50:08	2023-05-16T06:49:06	Rev1	None	None
TrinitySRITrojAI	0.64595	0.20059	0.22596	0.34375	6797.19	2023-05-18T01:00:06	2023-05-18T00:54:34	Rev1	None	None
TrinitySRITrojAI	0.6478	0.19788	0.22673	0.375	7226.4	2023-05-20T00:10:07	2023-05-20T00:08:21	Rev1	None	None
TrinitySRITrojAI	0.36223	0.11185	0.10238	1.0	1166.17	2023-05-22T19:20:06	2023-05-22T19:11:07	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	172.89	2023-05-25T06:00:06	2023-05-25T05:53:33	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.44809	0.37335	0.14757	1.0	13841.74	2023-05-26T02:40:07	2023-05-26T02:32:36	Rev1	None	None
TrinitySRITrojAI	0.71038	0.39821	0.24705	1.0	23854.84	2023-05-31T17:40:07	2023-05-31T17:38:36	Rev1	None	None
TrinitySRITrojAI	0.44191	0.15177	0.13794	0.9375	3267.54	2023-06-01T05:40:07	2023-06-01T05:36:11	Rev1	None	None
TrinitySRITrojAI	0.53922	0.31945	0.1728	0.875	3236.07	2023-06-01T19:20:06	2023-06-01T19:14:49	Rev1	None	None
TrinitySRITrojAI	0.47139	0.0761	0.14359	1.0	11172.93	2023-06-05T05:50:06	2023-06-05T05:45:08	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5		2023-06-20T16:10:10	2023-06-17T00:51:10	Rev1	:No Results::Missing Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	61.5	2023-06-21T21:50:07	2023-06-21T21:48:43	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.29722	0.05929	0.06924	1.0	3995.86	2023-06-26T19:10:06	2023-06-26T19:08:10	Rev1	None	None
TrinitySRITrojAI	0.18046	0.08331	0.03562	1.0	9333.0	2023-07-08T19:20:06	2023-07-08T19:15:49	Rev1	None	None
TrinitySRITrojAI	0.2244	0.05577	0.04384	1.0	4760.33	2023-07-11T05:20:07	2023-07-11T05:16:06	Rev1	None	None
PL-GIFT	0.57642	0.12551	0.19973	0.8125	39.17	2023-03-20T22:10:08	2023-03-20T22:00:14	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5	10.4	2023-03-22T19:50:08	2023-03-22T19:46:00	Rev1	None	None
PL-GIFT	0.58463	0.13219	0.20354	0.8125	49.92	2023-03-22T21:10:09	2023-03-22T21:07:55	Rev1	None	None
PL-GIFT	0.48042	0.16416	0.16387	0.8125	92.42	2023-04-27T16:30:06	2023-04-27T16:24:42	Rev1	None	None
PL-GIFT	0.44995	0.20035	0.14138	0.84375	88.55	2023-04-27T21:30:07	2023-04-27T21:20:32	Rev1	None	None
PL-GIFT	0.39597	0.18974	0.11382	0.75	211.44	2023-05-11T06:50:08	2023-05-11T06:44:54	Rev1	None	None
PL-GIFT	0.54545	0.15862	0.18128	0.71875	9465.34	2023-06-27T18:20:53	2023-06-27T18:19:22	Rev1	:Missing Results:	None
PL-GIFT	0.23772	0.08649	0.05348	1.0	94.83	2023-07-07T18:20:09	2023-07-07T18:13:30	Rev1	None	None
PL-GIFT	0.17024	0.0764	0.034	1.0	101.69	2023-07-08T17:00:09	2023-07-08T16:58:14	Rev1	None	None
PL-GIFT	0.17024	0.0764	0.034	1.0	102.86	2023-07-09T18:00:08	2023-07-09T17:56:55	Rev1	None	None
PL-GIFT	0.20616	0.11653	0.05033	1.0	107.36	2023-07-09T20:10:08	2023-07-09T20:00:30	Rev1	None	None
PL-GIFT	0.14377	0.06998	0.02567	1.0	106.37	2023-07-09T23:20:08	2023-07-09T23:15:05	Rev1	None	None
PL-GIFT	0.11111	0.0514	0.01603	1.0	99.88	2023-07-10T17:30:09	2023-07-10T17:22:14	Rev1	None	None
PL-GIFT	0.02475	0.01879	0.00144	1.0	108.75	2023-07-10T19:10:09	2023-07-10T19:03:08	Rev1	None	None
PL-GIFT	0.14886	0.06029	0.02485	1.0	102.18	2023-07-10T22:30:09	2023-07-10T22:29:42	Rev1	None	None
PL-GIFT	0.14318	0.08676	0.02998	1.0	102.25	2023-07-12T22:40:08	2023-07-12T22:39:15	Rev1	None	None
PL-GIFT	0.28329	0.20742	0.10006	0.90625	62.54	2023-10-06T21:42:40	2023-10-06T21:41:48	Rev1	:Missing Results:	None
PL-GIFT	0.3681	0.16607	0.1127	0.90625	54.82	2023-10-09T21:13:55	2023-10-09T21:07:47	Rev1	:Missing Results:	None
PL-GIFT	0.1001	0.04544	0.01298	1.0	62.86	2023-10-09T23:44:46	2023-10-09T23:34:45	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5	2739.11	2023-03-21T07:40:11	2023-03-21T07:32:00	Rev1	None	None
Perspecta-PurdueRutgers	0.36078	0.42647	0.10162	0.96875	5178.94	2023-03-21T20:30:10	2023-03-21T20:28:14	Rev1	None	None
Perspecta-PurdueRutgers	0.27485	0.23811	0.08029	0.90625	6995.83	2023-03-29T21:20:09	2023-03-29T21:11:06	Rev1	None	None
Perspecta-PurdueRutgers	0.27485	0.23811	0.08029	0.90625	7934.57	2023-04-04T05:30:08	2023-04-04T05:20:39	Rev1	None	None
Perspecta-PurdueRutgers	0.38366	0.28097	0.12628	0.84375	7099.89	2023-04-13T17:50:10	2023-04-13T17:49:53	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2023-05-31T03:50:09	2023-05-31T03:42:49	Rev1	:Executed File Update::No Results::Missing Results::Info File Missing::Container File Missing:	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5	63.39	2023-07-10T06:50:09	2023-07-10T06:42:19	Rev1	:No Results::Missing Results:	None
Perspecta-PurdueRutgers	0.33432	0.28669	0.09332	0.75	7506.16	2023-07-10T09:10:10	2023-07-10T09:06:06	Rev1	None	None
Perspecta-PurdueRutgers	0.63637	0.60505	0.18224	0.6875	7500.43	2023-07-11T20:30:10	2023-07-11T20:27:32	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-05-16T02:30:24	2023-05-15T20:25:25	Rev1	:No Results::Missing Results::Info File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-05-16T20:40:59	2023-05-16T20:31:03	Rev1	:No Results::Missing Results::Container File Missing:	:Schema Header:
ARM-UCSD	0.69315	0.0	0.25	0.5	39.79	2023-05-17T22:50:18	2023-05-17T22:47:12	Rev1	:Missing Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	41.16	2023-05-30T18:40:18	2023-05-30T18:38:16	Rev1	:Missing Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	42.12	2023-06-05T19:41:28	2023-06-05T19:35:42	Rev1	:Missing Results:	None
ARM-UCSD	0.60373	0.11338	0.21017	0.625	42.2	2023-06-05T23:10:17	2023-06-05T23:04:05	Rev1	None	None
ARM-UCSD	0.60373	0.11338	0.21017	0.625	45.16	2023-06-06T20:00:16	2023-06-06T19:57:59	Rev1	None	None
ARM-UCSD	0.60373	0.11338	0.21017	0.625	49.21	2023-06-20T22:30:17	2023-06-20T22:21:16	Rev1	None	None
ARM-UCSD	0.11142	0.05462	0.01631	1.0	101.71	2023-06-21T01:40:18	2023-06-21T01:32:02	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5	22.37	2023-05-16T10:50:24	2023-05-16T10:40:59	Rev1	:No Results::Missing Results:	None
ARM	0.69315	0.0	0.25	0.5	115.82	2023-05-16T11:20:24	2023-05-16T11:17:49	Rev1	:No Results::Missing Results:	None
ARM	0.18488	0.14572	0.04748	1.0	150.92	2023-05-16T11:50:24	2023-05-16T11:47:01	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-03-28T00:40:23	2023-03-28T00:35:33	Rev1	:Info File Missing::Container File Missing:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-03-28T01:00:23	2023-03-28T00:59:09	Rev1	:Info File Missing::Container File Missing:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-03-28T01:30:24	2023-03-28T01:21:57	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker)::Schema Header:
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-03-28T02:10:21	2023-03-28T02:00:33	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-04-04T00:30:20	2023-04-04T00:28:27	Rev1	:Container File Missing:	:Schema Header:
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-04-04T01:10:21	2023-04-04T01:03:11	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-04-04T02:00:20	2023-04-04T01:55:46	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	11.61	2023-04-04T03:00:20	2023-04-04T03:00:01	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	36.38	2023-04-04T03:30:21	2023-04-04T03:23:46	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	78.28	2023-04-04T04:00:20	2023-04-04T03:59:19	Rev1	:Result Parse:	None
TrinitySRITrojAI-SBU	0.5517	0.07862	0.18149	0.90625	82.22	2023-04-04T05:00:21	2023-04-04T04:54:16	Rev1	None	None
TrinitySRITrojAI-SBU	0.54535	0.08546	0.17901	0.90625	77.32	2023-04-18T19:30:24	2023-04-18T19:22:07	Rev1	None	None
TrinitySRITrojAI-SBU	0.44791	0.07471	0.13352	1.0	53.28	2023-04-18T20:40:22	2023-04-18T20:30:49	Rev1	None	None
ICSI-2	0.69315	0.0	0.25	0.5		2023-03-15T19:10:24	2023-03-15T19:08:38	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
ICSI-2	0.22077	0.09074	0.04841	1.0	75.99	2023-03-15T21:40:24	2023-03-15T21:33:13	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	17.97	2023-06-07T10:50:31	2023-06-07T10:44:53	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	102.29	2023-06-08T00:00:30	2023-06-07T23:55:59	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	99.88	2023-06-08T02:30:31	2023-06-08T02:22:14	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	99.36	2023-06-08T08:10:30	2023-06-08T08:06:44	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI-BostonU	0.65531	0.04044	0.23114	0.65625	292.48	2023-06-08T10:40:30	2023-06-08T10:39:39	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	65.92	2023-06-08T17:00:31	2023-06-08T16:56:06	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI-BostonU	0.65531	0.04044	0.23114	0.65625	281.3	2023-06-08T19:00:32	2023-06-08T18:55:22	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.65412	0.03422	0.23051	0.5	471.36	2023-06-10T04:50:31	2023-06-10T04:44:50	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-06-11T01:40:29	2023-06-11T01:35:39	Rev1	:No Results::Missing Results::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.75837	0.04975	0.2825	0.5	54.08	2023-06-11T05:50:31	2023-06-11T05:40:44	Rev1	None	None
trojai-example	0.69315	0.0	0.25	0.5	9.78	2023-03-10T03:11:19	2023-03-10T03:09:52	Rev1	None	:Schema Header::Copy in::Execute:
trojai-example	0.5532	0.36346	0.18464	0.5625	62.34	2023-03-10T03:26:39	2023-03-10T03:17:14	Rev1	None	:Schema Header::Execute:
trojai-example	0.69315	0.0	0.25	0.5	0.57	2023-03-10T03:48:12	2023-03-10T03:46:40	Rev1	:Container File Missing:	:Schema Header::Execute::Copy Out:
trojai-example	0.5532	0.36346	0.18464	0.5625	63.42	2023-03-10T03:54:10	2023-03-10T03:53:07	Rev1	None	:Schema Header:
trojai-example	0.5532	0.36346	0.18464	0.5625	64.08	2023-03-10T04:16:17	2023-03-10T04:14:57	Rev1	None	:Schema Header:
trojai-example	0.69315	0.0	0.25	0.5		2023-03-10T16:45:35	2023-03-10T16:43:14	Rev1	:Info File Missing::Container File Missing:	None
trojai-example	0.69315	0.0	0.25	0.5	12.69	2023-03-10T17:19:19	2023-03-10T17:17:19	Rev1	None	:Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example	0.69315	0.0	0.25	0.5	9.65	2023-03-10T17:32:36	2023-03-10T17:31:29	Rev1	None	:Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example	0.69315	0.0	0.25	0.5	9.62	2023-03-10T18:03:44	2023-03-10T17:59:57	Rev1	None	:Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example	0.69315	0.0	0.25	0.5	9.66	2023-03-10T18:20:22	2023-03-10T18:17:24	Rev1	None	:Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example	0.69315	0.0	0.25	0.5	9.69	2023-03-10T18:26:52	2023-03-10T18:25:43	Rev1	None	:Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example	0.69315	0.0	0.25	0.5	9.68	2023-03-10T18:31:22	2023-03-10T18:30:24	Rev1	None	:Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example	0.69315	0.0	0.25	0.5	9.61	2023-03-10T18:48:53	2023-03-10T18:46:14	Rev1	None	:Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example	0.5532	0.36346	0.18464	0.5625	63.5	2023-03-10T19:33:16	2023-03-10T19:32:14	Rev1	None	:Schema Header:
trojai-example	0.5532	0.36346	0.18464	0.5625	63.85	2023-03-10T20:07:38	2023-03-10T20:06:09	Rev1	None	:Schema Header:
trojai-example	0.69315	0.0	0.25	0.5		2023-03-10T21:46:15	2023-03-10T21:45:24	Rev1	:Executed File Update::Info File Missing::Container File Missing:	None
trojai-example	0.5532	0.36346	0.18464	0.5625	63.86	2023-03-10T21:59:23	2023-03-10T21:53:01	Rev1	None	:Schema Header:
trojai-example	0.5532	0.36346	0.18464	0.5625	70.33	2023-03-10T22:35:04	2023-03-10T22:33:52	Rev1	None	:Schema Header:
trojai-example	0.52632	0.49397	0.1664	0.5	83.99	2023-03-14T17:00:30	2023-03-14T16:59:37	Rev1	None	:Schema Header:

Required filename format: "object-detection-feb2023_dev_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-feb2023, dev: 185
Execution timeout (hh:mm:ss): 5 days, 8:00:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-06-05T06:30:06	performer	None	None	Ok	2023-06-05T06:25:25	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-07-08T17:30:09	performer	None	None	Ok	2023-07-08T17:21:21	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-07-09T20:30:08	performer	None	None	Ok	2023-07-09T20:25:00	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2023-03-25T20:00:10	performer	None	None	Ok	2023-03-25T19:53:28	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2023-06-05T19:41:29	performer	None	None	Ok	2023-06-05T19:35:08	0 d, 0 h, 0 m, 0 s
ARM		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2023-05-28T18:20:28	performer	None	None	Ok	2023-05-28T18:11:34	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-06-27T07:20:27	performer	None	None	Ok	2023-06-27T07:17:15	0 d, 0 h, 0 m, 0 s
trojai-example	2023-06-02T13:33:39	public	None	None	Ok	2023-06-02T13:30:39	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
TrinitySRITrojAI	0.65689	0.04443	0.23594	0.60976	168541.96	2023-06-05T06:30:06	2023-06-05T06:25:25	Rev1	None	None
PL-GIFT	0.70689	0.06132	0.25544	0.60382	1464.72	2023-04-27T21:41:58	2023-04-27T21:32:48	Rev1	None	None
Perspecta-PurdueRutgers	0.36033	0.03079	0.1013	0.95718	214.45	2023-03-24T05:10:09	2023-03-24T05:00:39	Rev1	None	None
Perspecta-IUB	1.68364	0.42673	0.31509	0.63006	3437.12	2023-03-25T20:00:10	2023-03-25T19:53:28	Rev1	None	None
ARM-UCSD	0.85038	0.13357	0.27261	0.55424	677.76	2023-06-05T19:41:29	2023-06-05T19:35:08	Rev1	None	None
ICSI-2	0.72548	0.11367	0.246	0.69241	5750.91	2023-05-11T09:10:23	2023-05-11T09:08:35	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	1040.08	2023-06-22T03:40:30	2023-06-22T03:32:03	Rev1	None	None
trojai-example	0.86477	0.11619	0.29668	0.56353	57033.52	2023-06-01T20:22:06	2023-06-01T20:18:52	Rev1	None	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
TrinitySRITrojAI	0.71324	0.02902	0.25918	0.49612	2592.87	2023-04-25T01:30:06	2023-04-25T01:22:30	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1070.48	2023-05-16T19:20:06	2023-05-16T19:19:34	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1065.65	2023-05-17T22:00:06	2023-05-17T21:59:21	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1081.26	2023-05-18T00:00:06	2023-05-17T23:59:01	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69698	0.0055	0.25192	0.5	1229.49	2023-05-18T05:40:07	2023-05-18T05:30:08	Rev1	None	None
TrinitySRITrojAI	0.69698	0.0055	0.25192	0.5	1218.49	2023-05-18T15:30:06	2023-05-18T15:29:08	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1050.59	2023-05-18T19:00:06	2023-05-18T18:50:12	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69698	0.0055	0.25192	0.5	1215.51	2023-05-18T23:20:06	2023-05-18T23:19:08	Rev1	None	None
TrinitySRITrojAI	0.69698	0.0055	0.25192	0.5	1551.49	2023-05-19T05:20:06	2023-05-19T05:16:04	Rev1	None	None
TrinitySRITrojAI	0.69698	0.0055	0.25192	0.5	1527.84	2023-05-19T07:00:06	2023-05-19T06:58:57	Rev1	None	None
TrinitySRITrojAI	0.69698	0.0055	0.25192	0.5	1625.55	2023-05-19T19:40:07	2023-05-19T19:14:56	Rev1	None	None
TrinitySRITrojAI	0.69698	0.0055	0.25192	0.5	1971.26	2023-05-19T21:50:06	2023-05-19T21:43:53	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1041.03	2023-05-20T03:50:06	2023-05-20T03:42:22	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1069.73	2023-05-20T07:10:07	2023-05-20T07:02:55	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1053.52	2023-05-22T20:10:06	2023-05-22T20:06:13	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1044.75	2023-05-22T23:40:07	2023-05-22T23:33:54	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.695	0.00292	0.25092	0.5	1595.61	2023-05-23T04:30:06	2023-05-23T04:23:58	Rev1	None	None
TrinitySRITrojAI	1.05912	0.15561	0.34585	0.54582	49025.67	2023-05-23T06:40:06	2023-05-23T06:35:34	Rev1	None	None
TrinitySRITrojAI	1.04264	0.15464	0.33941	0.55429	50016.76	2023-05-23T22:20:06	2023-05-23T22:17:47	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1184.09	2023-05-24T18:20:06	2023-05-24T18:19:26	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	258.59	2023-06-01T17:30:06	2023-06-01T17:28:50	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	197.61	2023-06-01T17:50:06	2023-06-01T17:49:31	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	184.49	2023-06-01T19:00:06	2023-06-01T18:57:02	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	179.17	2023-06-01T19:40:07	2023-06-01T19:32:45	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.82297	0.09679	0.29359	0.56871	58509.37	2023-06-01T20:21:39	2023-06-01T20:18:48	Rev1	None	None
TrinitySRITrojAI	0.65689	0.04443	0.23594	0.60976	168541.96	2023-06-05T06:30:06	2023-06-05T06:25:25	Rev1	None	None
PL-GIFT	0.78213	0.08581	0.27569	0.57635	793.7	2023-03-20T22:10:09	2023-03-20T22:00:44	Rev1	None	None
PL-GIFT	0.7185	0.04267	0.26037	0.54376	869.19	2023-03-22T22:00:09	2023-03-22T21:26:43	Rev1	None	None
PL-GIFT	0.75596	0.07638	0.26741	0.55429	861.91	2023-03-23T21:30:08	2023-03-23T21:29:39	Rev1	None	None
PL-GIFT	0.6892	0.02465	0.24825	0.53494	1524.88	2023-04-27T16:30:07	2023-04-27T16:25:12	Rev1	None	None
PL-GIFT	0.70689	0.06132	0.25544	0.60382	1464.72	2023-04-27T21:41:58	2023-04-27T21:32:48	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2023-06-27T17:40:08	2023-06-27T17:35:04	Rev1	:No Results::Missing Results:	:Schema Header:
PL-GIFT	0.97445	0.40475	0.25058	0.57365	1608.18	2023-07-08T17:30:09	2023-07-08T17:21:21	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2023-03-13T21:00:09	2023-03-13T20:52:31	Rev1	None	:Container Parameters (jsonschema checker):
Perspecta-PurdueRutgers	0.76273	0.09013	0.2766	0.601	2258.87	2023-03-13T21:40:09	2023-03-13T21:31:36	Rev1	None	None
Perspecta-PurdueRutgers	0.76186	0.07406	0.27566	0.53312	2030.89	2023-03-14T00:40:09	2023-03-14T00:39:49	Rev1	None	None
Perspecta-PurdueRutgers	0.71262	0.1214	0.23405	0.70624	64653.47	2023-03-21T23:20:10	2023-03-21T23:15:40	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2023-03-24T04:00:10	2023-03-24T03:51:10	Rev1	:Info File Missing:	None
Perspecta-PurdueRutgers	0.36033	0.03079	0.1013	0.95718	214.45	2023-03-24T05:10:09	2023-03-24T05:00:39	Rev1	None	None
Perspecta-PurdueRutgers	1.07704	0.13848	0.37476	0.51647	212.4	2023-03-24T20:50:08	2023-03-24T20:42:02	Rev1	None	None
Perspecta-PurdueRutgers	1.02737	0.14175	0.35288	0.48353	212.03	2023-03-24T21:50:08	2023-03-24T21:43:49	Rev1	None	None
Perspecta-PurdueRutgers	0.62779	0.09184	0.20966	0.73647	79068.7	2023-03-30T00:10:10	2023-03-30T00:05:47	Rev1	None	None
Perspecta-PurdueRutgers	10.46103	1.90913	0.42925	0.49571	861.7	2023-03-31T02:40:09	2023-03-31T02:34:12	Rev1	None	None
Perspecta-PurdueRutgers	0.61634	0.09532	0.20267	0.74947	92425.34	2023-04-04T08:00:09	2023-04-04T07:58:33	Rev1	None	None
Perspecta-PurdueRutgers	0.71426	0.03652	0.2592	0.49176	8401.41	2023-04-05T19:50:09	2023-04-05T19:42:39	Rev1	None	None
Perspecta-PurdueRutgers	0.71426	0.03652	0.2592	0.49176	8268.32	2023-04-05T23:50:09	2023-04-05T23:43:53	Rev1	None	None
Perspecta-PurdueRutgers	0.71426	0.03652	0.2592	0.49176	8188.28	2023-04-06T02:50:10	2023-04-06T02:46:51	Rev1	None	None
Perspecta-PurdueRutgers	0.88735	0.11393	0.3032	0.49035	9296.45	2023-04-06T05:20:10	2023-04-06T05:18:58	Rev1	None	None
Perspecta-PurdueRutgers	0.70969	0.03743	0.25698	0.50565	8035.62	2023-04-06T16:20:09	2023-04-06T16:16:31	Rev1	None	None
Perspecta-PurdueRutgers	0.71426	0.03652	0.2592	0.49176	8290.77	2023-04-06T19:20:09	2023-04-06T19:16:45	Rev1	None	None
Perspecta-PurdueRutgers	0.71426	0.03652	0.2592	0.49176	9380.46	2023-04-06T22:20:09	2023-04-06T22:18:04	Rev1	None	None
Perspecta-PurdueRutgers	0.7291	0.06203	0.26179	0.55094	4191.93	2023-04-07T03:20:10	2023-04-07T03:14:11	Rev1	None	None
Perspecta-PurdueRutgers	0.71426	0.03652	0.2592	0.49176	9541.76	2023-04-07T05:20:09	2023-04-07T05:10:10	Rev1	None	None
Perspecta-PurdueRutgers	0.72141	0.03744	0.26233	0.48282	11260.97	2023-04-07T18:40:09	2023-04-07T18:37:38	Rev1	None	None
Perspecta-PurdueRutgers	0.75256	0.04229	0.2757	0.452	9971.55	2023-04-08T05:40:09	2023-04-08T05:37:46	Rev1	None	None
Perspecta-PurdueRutgers	0.73027	0.03948	0.26604	0.47718	8938.11	2023-04-08T21:20:10	2023-04-08T21:18:01	Rev1	None	None
Perspecta-PurdueRutgers	0.74284	0.03993	0.27169	0.456	8119.29	2023-04-09T00:50:10	2023-04-09T00:44:47	Rev1	None	None
Perspecta-PurdueRutgers	0.71426	0.03652	0.2592	0.49176	9189.56	2023-04-10T03:10:10	2023-04-10T03:05:27	Rev1	None	None
Perspecta-PurdueRutgers	0.71426	0.03652	0.2592	0.49176	9202.37	2023-04-10T07:20:10	2023-04-10T07:15:33	Rev1	None	None
Perspecta-PurdueRutgers	0.70319	0.05827	0.25071	0.56765	4581.52	2023-04-10T18:40:10	2023-04-10T18:35:21	Rev1	None	None
Perspecta-PurdueRutgers	0.6842	0.01551	0.24709	0.514	2812.51	2023-04-10T21:50:09	2023-04-10T21:44:52	Rev1	None	None
Perspecta-PurdueRutgers	0.69549	0.0221	0.2511	0.50988	3063.68	2023-04-11T00:30:09	2023-04-11T00:27:23	Rev1	None	None
Perspecta-PurdueRutgers	0.81702	0.09865	0.27939	0.51118	47538.9	2023-04-11T03:10:10	2023-04-11T03:05:31	Rev1	None	None
Perspecta-PurdueRutgers	0.91641	0.13687	0.30482	0.54482	7324.16	2023-04-11T17:40:09	2023-04-11T17:37:13	Rev1	None	None
Perspecta-PurdueRutgers	0.84491	0.13092	0.28158	0.58976	5975.92	2023-04-11T22:10:09	2023-04-11T22:05:41	Rev1	None	None
Perspecta-PurdueRutgers	0.78347	0.09661	0.26687	0.53765	21576.28	2023-04-12T02:40:09	2023-04-12T02:33:09	Rev1	None	None
Perspecta-PurdueRutgers	0.80704	0.11543	0.27351	0.58235	44536.74	2023-04-12T21:00:10	2023-04-12T20:52:33	Rev1	None	None
Perspecta-PurdueRutgers	10.46894	1.90839	0.43265	0.49412	213.04	2023-04-13T15:50:13	2023-04-13T15:48:03	Rev1	None	None
Perspecta-PurdueRutgers	0.56556	0.0899	0.18167	0.803	78173.69	2023-04-13T18:00:10	2023-04-13T17:52:16	Rev1	None	None
Perspecta-PurdueRutgers	0.69852	0.02939	0.25169	0.49412	1460.15	2023-04-17T20:50:09	2023-04-17T20:46:14	Rev1	None	None
Perspecta-PurdueRutgers	0.69335	0.0171	0.24977	0.49341	1405.05	2023-04-17T21:40:09	2023-04-17T21:34:54	Rev1	None	None
Perspecta-PurdueRutgers	0.65101	0.02957	0.23227	0.57588	1353.2	2023-04-17T23:30:11	2023-04-17T23:22:30	Rev1	None	None
Perspecta-PurdueRutgers	0.7099	0.03031	0.25833	0.49929	1400.3	2023-04-18T00:40:12	2023-04-18T00:34:31	Rev1	None	None
Perspecta-PurdueRutgers	0.65971	0.03433	0.2353	0.57165	1392.9	2023-04-18T02:00:10	2023-04-18T01:52:26	Rev1	None	None
Perspecta-PurdueRutgers	0.75093	0.07333	0.26338	0.52112	1813.96	2023-04-24T15:10:09	2023-04-24T15:07:14	Rev1	None	None
Perspecta-PurdueRutgers	0.74519	0.06049	0.26676	0.50588	1037.8	2023-04-24T16:20:09	2023-04-24T16:15:36	Rev1	None	None
Perspecta-PurdueRutgers	1.03925	0.14379	0.35508	0.49412	1034.73	2023-04-24T19:50:08	2023-04-24T19:40:38	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5	1099.94	2023-04-25T18:00:10	2023-04-25T17:54:51	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5	1040.48	2023-04-25T19:20:09	2023-04-25T19:11:36	Rev1	None	None
Perspecta-PurdueRutgers	0.92396	0.09213	0.34502	0.50212	1117.77	2023-04-25T21:00:09	2023-04-25T20:59:42	Rev1	None	None
Perspecta-PurdueRutgers	0.70628	0.02787	0.25508	0.50212	1113.84	2023-04-25T23:50:08	2023-04-25T23:48:13	Rev1	None	None
Perspecta-PurdueRutgers	1.17342	0.14608	0.40435	0.50276	1039.76	2023-04-26T01:00:08	2023-04-26T00:57:47	Rev1	None	None
Perspecta-PurdueRutgers	1.1764	0.14692	0.40558	0.50282	1028.49	2023-04-26T02:40:08	2023-04-26T02:34:47	Rev1	None	None
Perspecta-PurdueRutgers	1.17586	0.14676	0.40535	0.50159	1029.2	2023-04-26T03:40:08	2023-04-26T03:36:03	Rev1	None	None
Perspecta-PurdueRutgers	1.17468	0.1467	0.40484	0.50259	1030.07	2023-04-26T04:20:08	2023-04-26T04:16:19	Rev1	None	None
Perspecta-PurdueRutgers	1.27576	0.16731	0.42717	0.50876	1035.7	2023-04-26T14:30:08	2023-04-26T14:21:43	Rev1	None	None
Perspecta-PurdueRutgers	0.61757	0.04466	0.21757	0.64029	1673.54	2023-04-26T16:20:08	2023-04-26T16:11:06	Rev1	None	None
Perspecta-PurdueRutgers	0.47289	0.09267	0.1446	0.86094	79621.25	2023-04-26T19:10:09	2023-04-26T19:08:42	Rev1	None	None
Perspecta-PurdueRutgers	0.7484	0.06911	0.26311	0.49424	1333.32	2023-04-27T20:00:10	2023-04-27T19:50:42	Rev1	None	None
Perspecta-PurdueRutgers	0.59382	0.03748	0.20892	0.66	1677.07	2023-04-27T21:20:07	2023-04-27T21:10:12	Rev1	None	None
Perspecta-PurdueRutgers	0.81183	0.12596	0.27491	0.59741	13936.57	2023-04-28T00:20:10	2023-04-28T00:17:20	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5	1048.41	2023-05-24T05:20:10	2023-05-24T05:16:45	Rev1	:No Results::Missing Results:	None
Perspecta-PurdueRutgers	0.68951	0.00711	0.24865	0.50588	2141.16	2023-05-28T06:10:09	2023-05-28T06:03:50	Rev1	:Missing Results:	None
Perspecta-PurdueRutgers	0.94161	0.12105	0.31185	0.45	7783.67	2023-05-29T05:30:09	2023-05-29T05:29:32	Rev1	:Missing Results:	None
Perspecta-PurdueRutgers	0.93284	0.29369	0.28217	0.49118	9647.44	2023-05-31T04:30:09	2023-05-31T04:23:17	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5	242.2	2023-06-01T05:30:09	2023-06-01T05:23:30	Rev1	:No Results::Missing Results:	None
Perspecta-PurdueRutgers	0.76419	0.08434	0.26709	0.52847	8793.88	2023-06-01T07:20:10	2023-06-01T07:14:08	Rev1	None	None
Perspecta-PurdueRutgers	0.8622	0.1176	0.28621	0.51494	9632.11	2023-06-02T05:50:09	2023-06-02T05:48:16	Rev1	None	None
Perspecta-PurdueRutgers	0.73497	0.04102	0.26792	0.47553	5640.25	2023-06-02T19:00:10	2023-06-02T18:58:57	Rev1	None	None
Perspecta-PurdueRutgers	0.7363	0.08112	0.25501	0.54012	5892.15	2023-06-03T03:00:10	2023-06-03T02:58:40	Rev1	None	None
Perspecta-PurdueRutgers	0.7526	0.07728	0.26109	0.51447	5366.44	2023-06-03T06:10:09	2023-06-03T06:01:31	Rev1	None	None
Perspecta-PurdueRutgers	0.73086	0.03739	0.26512	0.47941	5372.56	2023-06-03T08:20:10	2023-06-03T08:11:58	Rev1	None	None
Perspecta-PurdueRutgers	0.70872	0.03249	0.25496	0.50265	4141.48	2023-06-03T22:10:10	2023-06-03T22:05:18	Rev1	None	None
Perspecta-PurdueRutgers	0.93395	0.29396	0.27999	0.49106	9355.21	2023-06-04T00:00:10	2023-06-03T23:59:13	Rev1	None	None
Perspecta-PurdueRutgers	0.7273	0.0878	0.24872	0.58118	9380.49	2023-06-04T04:20:10	2023-06-04T04:19:45	Rev1	None	None
Perspecta-PurdueRutgers	0.87529	0.28675	0.26885	0.47118	5072.88	2023-06-04T07:40:10	2023-06-04T07:38:36	Rev1	None	None
Perspecta-PurdueRutgers	1.16989	0.14566	0.40265	0.50588	699.47	2023-06-04T20:40:10	2023-06-04T20:31:25	Rev1	:Missing Results:	None
Perspecta-PurdueRutgers	0.70746	0.08656	0.24094	0.60118	9370.91	2023-06-04T23:20:10	2023-06-04T23:14:39	Rev1	None	None
Perspecta-PurdueRutgers	1.18552	0.15042	0.40804	0.51024	2227.43	2023-06-05T03:50:10	2023-06-05T03:42:35	Rev1	:Missing Results:	None
Perspecta-PurdueRutgers	1.85338	0.26478	0.47128	0.50694	778.52	2023-06-05T07:00:09	2023-06-05T06:54:38	Rev1	None	None
Perspecta-PurdueRutgers	1.83702	0.26363	0.4655	0.50465	723.19	2023-06-05T19:20:09	2023-06-05T19:19:01	Rev1	None	None
Perspecta-PurdueRutgers	1.52936	0.22958	0.45331	0.51171	2487.53	2023-06-05T20:20:12	2023-06-05T20:10:46	Rev1	None	None
Perspecta-PurdueRutgers	1.06796	0.15288	0.36276	0.49824	955.3	2023-06-05T21:30:11	2023-06-05T21:26:54	Rev1	None	None
Perspecta-PurdueRutgers	1.06603	0.15311	0.36227	0.50765	1014.6	2023-06-05T23:40:10	2023-06-05T23:34:32	Rev1	None	None
Perspecta-PurdueRutgers	1.28148	0.17142	0.42568	0.50982	2513.58	2023-06-06T00:20:09	2023-06-06T00:16:52	Rev1	None	None
Perspecta-PurdueRutgers	0.72129	0.06636	0.25519	0.54824	1184.72	2023-06-06T01:20:10	2023-06-06T01:15:54	Rev1	None	None
Perspecta-PurdueRutgers	1.37377	0.20019	0.43067	0.50694	2299.67	2023-06-06T02:20:09	2023-06-06T02:10:54	Rev1	None	None
Perspecta-PurdueRutgers	0.72129	0.06636	0.25519	0.54824	2280.35	2023-06-06T03:50:09	2023-06-06T03:40:49	Rev1	None	None
Perspecta-PurdueRutgers	0.74218	0.07953	0.25868	0.53988	9700.94	2023-06-06T05:00:10	2023-06-06T04:50:25	Rev1	None	None
Perspecta-PurdueRutgers	0.7374	0.0759	0.25838	0.53824	9670.71	2023-06-06T15:40:10	2023-06-06T15:36:43	Rev1	None	None
Perspecta-PurdueRutgers	1.88515	0.26454	0.47965	0.49741	2580.95	2023-06-06T19:50:09	2023-06-06T19:47:54	Rev1	None	None
Perspecta-PurdueRutgers	0.75025	0.04319	0.27267	0.48547	1365.68	2023-06-06T20:50:09	2023-06-06T20:46:42	Rev1	None	None
Perspecta-PurdueRutgers	0.70941	0.06452	0.25086	0.55882	2570.64	2023-06-06T21:30:09	2023-06-06T21:29:44	Rev1	None	None
Perspecta-PurdueRutgers	0.73317	0.06811	0.25951	0.53765	1352.75	2023-06-06T22:50:10	2023-06-06T22:48:00	Rev1	None	None
Perspecta-PurdueRutgers	0.73317	0.06811	0.25951	0.53918	1352.99	2023-06-07T00:10:09	2023-06-07T00:01:36	Rev1	None	None
Perspecta-PurdueRutgers	1.8773	0.26394	0.47807	0.49753	2555.31	2023-06-07T00:50:10	2023-06-07T00:45:08	Rev1	None	None
Perspecta-PurdueRutgers	0.78067	0.0743	0.27681	0.50294	2574.62	2023-06-07T02:10:09	2023-06-07T02:02:58	Rev1	None	None
Perspecta-PurdueRutgers	1.8768	0.26409	0.47767	0.49818	2558.21	2023-06-07T04:10:09	2023-06-07T04:08:17	Rev1	None	None
Perspecta-PurdueRutgers	0.79133	0.08955	0.27363	0.51294	9484.59	2023-06-07T05:31:36	2023-06-07T05:21:35	Rev1	None	None
Perspecta-PurdueRutgers	0.74181	0.07815	0.25914	0.53965	9761.62	2023-06-07T18:00:10	2023-06-07T17:05:21	Rev1	None	None
Perspecta-PurdueRutgers	1.88261	0.26641	0.47659	0.50259	2561.39	2023-06-07T21:10:10	2023-06-07T21:09:30	Rev1	None	None
Perspecta-PurdueRutgers	1.90746	0.26906	0.48181	0.50388	1371.21	2023-06-07T22:20:10	2023-06-07T22:19:23	Rev1	None	None
Perspecta-PurdueRutgers	0.60252	0.04159	0.21195	0.65565	4159.91	2023-06-08T00:00:10	2023-06-07T23:51:10	Rev1	None	None
Perspecta-PurdueRutgers	0.62671	0.03138	0.22	0.64029	1367.75	2023-06-09T18:50:11	2023-06-09T18:47:43	Rev1	None	None
Perspecta-PurdueRutgers	0.76048	0.04694	0.27568	0.43212	1424.34	2023-07-07T19:01:34	2023-07-07T18:51:18	Rev1	:Result Parse::Missing Results:	None
Perspecta-PurdueRutgers	0.69785	0.0259	0.25294	0.51582	1967.79	2023-07-07T20:00:10	2023-07-07T19:56:00	Rev1	None	None
Perspecta-PurdueRutgers	0.83706	0.29111	0.25257	0.56141	3433.84	2023-07-07T21:30:11	2023-07-07T21:22:57	Rev1	None	None
Perspecta-PurdueRutgers	0.81294	0.10418	0.27354	0.51453	3837.95	2023-07-07T23:00:11	2023-07-07T22:54:50	Rev1	None	None
Perspecta-PurdueRutgers	0.64133	0.05061	0.22622	0.62059	6325.77	2023-07-08T01:20:11	2023-07-08T01:16:22	Rev1	None	None
Perspecta-PurdueRutgers	0.77317	0.04764	0.28138	0.42659	1251.87	2023-07-08T03:30:11	2023-07-08T03:23:07	Rev1	None	None
Perspecta-PurdueRutgers	0.78167	0.05022	0.28435	0.41765	1249.76	2023-07-08T04:50:10	2023-07-08T04:42:51	Rev1	None	None
Perspecta-PurdueRutgers	0.63847	0.04705	0.22555	0.62106	6861.24	2023-07-08T14:10:10	2023-07-08T14:03:21	Rev1	None	None
Perspecta-PurdueRutgers	0.8721	0.12611	0.29055	0.52235	29452.12	2023-07-09T05:40:09	2023-07-09T05:39:32	Rev1	None	None
Perspecta-PurdueRutgers	0.72925	0.03767	0.26479	0.46947	3156.61	2023-07-09T14:50:09	2023-07-09T14:47:27	Rev1	:Result Parse::Missing Results:	None
Perspecta-PurdueRutgers	0.76797	0.07562	0.27162	0.51412	3127.18	2023-07-09T16:40:09	2023-07-09T16:38:59	Rev1	None	None
Perspecta-PurdueRutgers	0.6057	0.04126	0.21324	0.65235	4142.18	2023-07-09T18:11:18	2023-07-09T18:04:06	Rev1	None	None
Perspecta-PurdueRutgers	0.60175	0.03723	0.21211	0.65306	4078.9	2023-07-09T20:30:08	2023-07-09T20:25:00	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-03-25T17:50:11	2023-03-25T17:41:42	Rev1	None	:Schema Header:
Perspecta-IUB	1.68364	0.42673	0.31509	0.63006	3437.12	2023-03-25T20:00:10	2023-03-25T19:53:28	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-05-16T02:30:26	2023-05-15T20:25:36	Rev1	:No Results::Missing Results:	:Container Parameters (metaparameters schema)::Container Parameters (learned parameters)::Container Parameters (jsonschema checker)::Schema Header:
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-05-16T20:31:03	2023-05-16T20:30:55	Rev1	:No Results::Missing Results:	:Schema Header:
ARM-UCSD	0.69315	0.0	0.25	0.5	674.76	2023-05-17T20:10:17	2023-05-17T20:09:05	Rev1	:Missing Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	709.14	2023-05-30T18:50:18	2023-05-30T18:43:00	Rev1	:Missing Results:	None
ARM-UCSD	0.85038	0.13357	0.27261	0.55424	677.76	2023-06-05T19:41:29	2023-06-05T19:35:08	Rev1	None	None
ICSI-2	0.79614	0.09319	0.28521	0.57018	1385.2	2023-03-29T09:50:21	2023-03-29T09:44:57	Rev1	None	None
ICSI-2	0.77977	0.07985	0.28031	0.55524	1297.02	2023-03-30T00:50:21	2023-03-30T00:47:40	Rev1	None	None
ICSI-2	1.08003	0.17012	0.34107	0.53694	1238.59	2023-03-31T09:20:23	2023-03-31T09:16:52	Rev1	None	None
ICSI-2	0.84919	0.10497	0.30205	0.55553	1235.14	2023-03-31T11:40:22	2023-03-31T11:37:45	Rev1	None	None
ICSI-2	1.07166	0.16199	0.34875	0.51424	1219.04	2023-04-03T07:40:22	2023-04-03T07:36:45	Rev1	None	None
ICSI-2	1.10249	0.16228	0.36162	0.53047	1210.23	2023-04-06T03:20:22	2023-04-06T03:16:04	Rev1	None	None
ICSI-2	1.12122	0.16934	0.36192	0.51876	1166.33	2023-04-06T11:20:24	2023-04-06T11:13:31	Rev1	None	None
ICSI-2	0.82636	0.08503	0.30107	0.53653	1120.23	2023-04-08T03:40:24	2023-04-08T03:39:54	Rev1	None	None
ICSI-2	1.70792	0.41999	0.36528	0.51147	1202.51	2023-04-11T09:50:22	2023-04-11T09:41:18	Rev1	None	None
ICSI-2	0.80876	0.09847	0.28436	0.55918	1159.54	2023-04-12T02:30:22	2023-04-12T02:24:58	Rev1	None	None
ICSI-2	0.79693	0.09664	0.28477	0.58959	1513.21	2023-04-14T10:10:23	2023-04-14T10:00:26	Rev1	None	None
ICSI-2	0.7437	0.06344	0.26687	0.54912	1511.85	2023-04-17T10:40:29	2023-04-17T10:39:32	Rev1	None	None
ICSI-2	0.8882	0.13356	0.29149	0.56176	1449.16	2023-04-19T00:41:32	2023-04-19T00:36:25	Rev1	None	None
ICSI-2	0.82762	0.08392	0.30251	0.52088	935.48	2023-04-25T07:20:23	2023-04-25T07:11:41	Rev1	None	None
ICSI-2	0.79094	0.08622	0.28643	0.56571	1105.16	2023-04-27T07:10:22	2023-04-27T07:10:13	Rev1	None	None
ICSI-2	0.81796	0.0845	0.29715	0.52094	1418.67	2023-04-27T08:50:22	2023-04-27T08:43:11	Rev1	None	None
ICSI-2	0.86474	0.0922	0.31491	0.50576	973.24	2023-04-27T11:02:34	2023-04-27T11:01:24	Rev1	None	None
ICSI-2	0.80211	0.08793	0.28943	0.55306	1461.85	2023-04-28T19:30:24	2023-04-28T19:26:40	Rev1	None	None
ICSI-2	0.84584	0.0945	0.30678	0.51841	959.44	2023-04-28T20:10:24	2023-04-28T20:08:10	Rev1	None	None
ICSI-2	0.81249	0.08639	0.2949	0.53635	1226.31	2023-04-30T10:50:23	2023-04-30T10:40:47	Rev1	None	None
ICSI-2	0.82219	0.09056	0.29719	0.53747	974.4	2023-05-02T02:50:24	2023-05-02T02:47:23	Rev1	None	None
ICSI-2	0.80942	0.08628	0.29387	0.53959	1135.95	2023-05-02T04:50:24	2023-05-02T04:40:42	Rev1	None	None
ICSI-2	0.793	0.08483	0.28705	0.55153	1051.61	2023-05-02T07:00:24	2023-05-02T06:58:33	Rev1	None	None
ICSI-2	1.14392	0.22595	0.33482	0.537	1019.33	2023-05-02T09:00:24	2023-05-02T08:54:20	Rev1	None	None
ICSI-2	1.05672	0.2193	0.30698	0.55182	988.53	2023-05-02T11:50:24	2023-05-02T11:47:41	Rev1	None	None
ICSI-2	0.77563	0.05931	0.28627	0.47982	28104.16	2023-05-04T13:30:24	2023-05-04T13:27:27	Rev1	None	None
ICSI-2	0.92876	0.13012	0.32085	0.56112	26770.4	2023-05-05T03:10:24	2023-05-05T03:06:29	Rev1	None	None
ICSI-2	0.82082	0.10694	0.28741	0.57071	41654.06	2023-05-07T08:40:24	2023-05-07T08:38:10	Rev1	None	None
ICSI-2	0.92219	0.12609	0.32227	0.55753	35835.26	2023-05-09T00:50:23	2023-05-09T00:49:08	Rev1	None	None
ICSI-2	0.87267	0.12024	0.30298	0.56541	11104.45	2023-05-10T12:00:24	2023-05-10T11:57:24	Rev1	None	None
ICSI-2	0.72548	0.11367	0.246	0.69241	5750.91	2023-05-11T09:10:23	2023-05-11T09:08:35	Rev1	None	None
ICSI-2	0.71609	0.10734	0.24525	0.68735	5467.14	2023-05-12T03:50:23	2023-05-12T03:41:42	Rev1	None	None
ICSI-2	0.91402	0.13132	0.31552	0.62129	71508.08	2023-05-28T18:20:28	2023-05-28T18:11:34	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70682	0.01437	0.25681	0.49412	4747.73	2023-06-20T16:10:35	2023-06-15T05:42:36	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70682	0.01437	0.25681	0.49412	2979.85	2023-06-21T00:50:30	2023-06-21T00:46:16	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70682	0.01437	0.25681	0.49412	2976.02	2023-06-21T15:40:30	2023-06-21T15:33:06	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70682	0.01437	0.25681	0.49412	2975.8	2023-06-21T18:50:29	2023-06-21T18:47:27	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70682	0.01437	0.25681	0.49412	2975.72	2023-06-21T22:10:30	2023-06-21T22:05:00	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	1040.08	2023-06-22T03:40:30	2023-06-22T03:32:03	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	1044.86	2023-06-22T17:50:30	2023-06-22T17:46:31	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	1038.59	2023-06-22T20:40:30	2023-06-22T20:32:07	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	1038.43	2023-06-22T23:00:30	2023-06-22T22:52:12	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	1136.02	2023-06-23T01:20:30	2023-06-23T01:10:50	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70682	0.01437	0.25681	0.49412	3077.54	2023-06-23T09:20:30	2023-06-23T09:10:42	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	3136.97	2023-06-24T00:20:32	2023-06-24T00:16:53	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	3092.71	2023-06-25T09:00:30	2023-06-25T08:53:12	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	4249.8	2023-06-26T00:00:30	2023-06-25T23:55:09	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	4272.44	2023-06-26T04:00:30	2023-06-26T03:54:54	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	5900.84	2023-06-26T08:50:28	2023-06-26T08:49:53	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	5850.48	2023-06-26T14:00:28	2023-06-26T13:54:04	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	6437.51	2023-06-26T22:50:28	2023-06-26T22:47:09	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69028	0.00755	0.24857	0.5	6501.26	2023-06-27T07:20:27	2023-06-27T07:17:15	Rev1	None	None
trojai-example	0.86477	0.11619	0.29668	0.56353	57033.52	2023-06-01T20:22:06	2023-06-01T20:18:52	Rev1	None	None
trojai-example	0.85976	0.1096	0.30076	0.55629	53065.8	2023-06-02T13:33:39	2023-06-02T13:30:39	Rev1	None	None

Round 14 leaderboard for MiniGrid Reinforcement Learning Lavaworld Agents July 2023.

Each AI is trained to get to the green square. For those AIs that have been attacked, the presence of the trigger will cause the Agent to head into the lava.

Example behavior of clean and poisoned RL agents.

train: The train dataset that is distributed with each round.
test: The test dataset that is sequestered/hidden, used for evaluation. Submissions here should be fully realized with complete schema and parameters.
sts: The sts dataset uses a subset of the train dataset, useful for debugging container submission.
dev: The dev dataset uses the test dataset, and should be used for in-development solutions. Schemas must be valid, but do not need to be complete. Results do not count towards the program.

train test sts dev

Required filename format: "rl-lavaworld-jul2023_train_<Submission Name>.simg"
Accepting submissions: True
Number of models in rl-lavaworld-jul2023, train: 238
Execution timeout (hh:mm:ss): 1 day, 15:40:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2023-08-22T18:50:06	performer	None	None	Ok	2023-08-22T18:44:19	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-09-27T17:10:09	performer	None	None	Ok	2023-09-27T17:08:17	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-10T18:22:42	performer	None	None	Ok	2023-10-10T18:21:57	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-07-21T14:50:16	performer	None	None	Ok	2023-07-20T20:50:25	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2023-08-08T05:00:13	performer	None	None	Ok	2023-08-08T04:58:40	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2023-08-23T04:30:21	performer	None	None	Ok	2023-08-23T04:22:10	0 d, 0 h, 0 m, 0 s
ARM	2023-08-22T01:50:27	performer	None	None	Ok	2023-08-22T01:43:38	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	2023-10-31T18:40:29	performer	None	None	Ok	2023-10-31T18:35:10	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2023-08-22T05:30:32	performer	None	None	Ok	2023-08-22T05:30:00	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-09-05T20:30:33	performer	None	None	Ok	2023-09-05T20:26:42	0 d, 0 h, 0 m, 0 s
trojai-example		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2023-08-22T04:30:44	performer	None	None	Ok	2023-08-22T04:23:04	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.05592	0.00541	0.00434	1.0	641.4	2023-07-20T05:20:06	2023-07-20T05:14:53	Rev1	None	None
TrinitySRITrojAI	0.0003	0.00014	0.0	1.0	561.27	2023-07-15T18:30:06	2023-07-15T18:22:43	Rev1	None	None
PL-GIFT	0.01237	0.0009	0.0002	1.0	686.39	2023-07-14T22:20:08	2023-07-14T22:14:26	Rev1	None	None
Perspecta-PurdueRutgers	0.0491	0.00529	0.00362	1.0	712.09	2023-07-21T14:50:16	2023-07-20T20:50:25	Rev1	None	None
Perspecta-IUB	0.01005	0.0	0.0001	1.0	711.1	2023-07-25T03:50:15	2023-07-25T03:45:04	Rev1	None	None
ARM-UCSD	0.30076	0.01965	0.07571	1.0	1169.46	2023-08-23T04:30:21	2023-08-23T04:22:10	Rev1	None	None
ARM	0.00354	0.00302	0.00047	1.0	526.61	2023-08-21T21:20:28	2023-08-21T21:15:14	Rev1	None	None
TrinitySRITrojAI-SBU	0.0931	0.02046	0.01528	0.99929	3252.21	2023-10-31T18:40:29	2023-10-31T18:35:10	Rev1	None	None
ICSI-2	0.05605	0.00409	0.00367	1.0	606.35	2023-08-07T04:30:32	2023-08-07T04:27:20	Rev1	None	None
TrinitySRITrojAI-BostonU	0.58048	0.50344	0.02101	0.97899	522.94	2023-07-26T23:00:34	2023-07-26T22:54:28	Rev1	None	None
UMBCb	0.49969	0.0681	0.16834	0.83416	622.25	2023-08-22T04:30:44	2023-08-22T04:23:04	Rev1	None	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.93502	0.09464	0.3445	0.53538	634.25	2023-07-17T21:30:06	2023-07-17T21:25:10	Rev1	None	None
Perspecta	0.05592	0.00541	0.00434	1.0	641.4	2023-07-20T05:20:06	2023-07-20T05:14:53	Rev1	None	None
Perspecta	0.00624	0.0007	7e-05	1.0	616.65	2023-07-24T14:00:06	2023-07-24T13:59:51	Rev1	None	None
Perspecta	0.02996	0.00796	0.00324	1.0	529.83	2023-07-25T14:20:07	2023-07-25T14:17:47	Rev1	None	None
Perspecta	0.01362	0.00218	0.00044	1.0	530.65	2023-07-28T22:40:06	2023-07-28T22:38:31	Rev1	None	None
Perspecta	0.01827	0.00234	0.00064	1.0	534.21	2023-07-29T05:40:06	2023-07-29T05:36:45	Rev1	None	None
Perspecta	0.03715	0.00753	0.00362	1.0	532.08	2023-08-02T02:50:07	2023-08-02T02:43:19	Rev1	None	None
Perspecta	0.01005	0.0	0.0001	1.0	534.95	2023-08-02T04:10:06	2023-08-02T04:05:58	Rev1	None	None
Perspecta	0.00487	0.00301	0.00041	1.0	534.26	2023-08-02T15:00:06	2023-08-02T14:59:01	Rev1	None	None
Perspecta	0.00404	0.00604	0.00128	1.0	532.91	2023-08-08T20:50:06	2023-08-08T20:48:13	Rev1	None	None
Perspecta	0.00828	0.00719	0.0021	1.0	524.81	2023-08-15T15:50:07	2023-08-15T15:41:48	Rev1	None	None
Perspecta	0.00824	0.00708	0.00208	1.0	524.62	2023-08-22T18:50:06	2023-08-22T18:44:19	Rev1	None	None
TrinitySRITrojAI	0.0003	0.00014	0.0	1.0	561.27	2023-07-15T18:30:06	2023-07-15T18:22:43	Rev1	None	None
TrinitySRITrojAI	0.07444	0.01412	0.01023	1.0	795.22	2023-09-05T17:20:07	2023-09-05T17:10:39	Rev1	None	None
TrinitySRITrojAI	0.4756	0.07798	0.1536	0.86488	2300.79	2023-09-06T21:00:07	2023-09-06T20:58:23	Rev1	None	None
TrinitySRITrojAI	0.49366	0.14497	0.13946	0.91275	695.67	2023-09-18T20:30:08	2023-09-18T20:23:42	Rev1	None	None
TrinitySRITrojAI	0.18538	0.05206	0.05671	0.99407	686.48	2023-09-27T17:10:09	2023-09-27T17:08:17	Rev1	None	None
PL-GIFT	0.01237	0.0009	0.0002	1.0	686.39	2023-07-14T22:20:08	2023-07-14T22:14:26	Rev1	None	None
PL-GIFT	0.0503	0.02061	0.01071	0.99936	671.82	2023-07-28T14:50:09	2023-07-28T14:48:07	Rev1	None	None
PL-GIFT	0.04339	0.02333	0.00986	0.99933	677.99	2023-07-28T18:20:10	2023-07-28T18:14:37	Rev1	None	None
PL-GIFT	0.01034	0.0003	0.00011	1.0	677.57	2023-07-31T15:01:13	2023-07-31T14:54:48	Rev1	None	None
PL-GIFT	0.01005	0.0	0.0001	1.0	885.72	2023-10-09T23:15:50	2023-10-09T23:01:48	Rev1	None	None
PL-GIFT	0.01005	0.0	0.0001	1.0	884.94	2023-10-10T02:10:14	2023-10-10T02:02:29	Rev1	None	None
PL-GIFT	0.01024	0.00021	0.00011	1.0	906.99	2023-10-10T03:20:14	2023-10-10T03:20:04	Rev1	None	None
PL-GIFT	0.01005	0.0	0.0001	1.0	903.07	2023-10-10T05:54:07	2023-10-10T05:48:05	Rev1	None	None
PL-GIFT	0.01005	0.0	0.0001	1.0	897.41	2023-10-10T14:30:15	2023-10-10T14:26:30	Rev1	None	None
PL-GIFT	0.01131	0.00084	0.00017	1.0	894.14	2023-10-10T15:05:05	2023-10-10T15:03:17	Rev1	None	None
PL-GIFT	0.04738	0.02647	0.0111	0.99912	880.11	2023-10-10T18:22:42	2023-10-10T18:21:57	Rev1	None	None
Perspecta-PurdueRutgers	0.0491	0.00529	0.00362	1.0	712.09	2023-07-21T14:50:16	2023-07-20T20:50:25	Rev1	None	None
Perspecta-IUB	0.01005	0.0	0.0001	1.0	711.1	2023-07-25T03:50:15	2023-07-25T03:45:04	Rev1	None	None
Perspecta-IUB	0.01005	0.0	0.0001	1.0	703.42	2023-07-25T15:00:15	2023-07-25T14:53:05	Rev1	None	None
Perspecta-IUB	0.0	0.0	0.0	1.0	1112.58	2023-07-25T18:30:14	2023-07-25T18:24:48	Rev1	None	None
Perspecta-IUB	0.0	0.0	0.0	1.0	1307.74	2023-08-08T05:00:13	2023-08-08T04:58:40	Rev1	None	None
ARM-UCSD	0.30076	0.01965	0.07571	1.0	1169.46	2023-08-23T04:30:21	2023-08-23T04:22:10	Rev1	None	None
ARM	0.0839	0.02757	0.01819	0.99788	545.2	2023-07-18T04:30:27	2023-07-18T04:25:24	Rev1	None	None
ARM	0.00354	0.00302	0.00047	1.0	526.61	2023-08-21T21:20:28	2023-08-21T21:15:14	Rev1	None	None
ARM	0.00354	0.00302	0.00047	1.0	527.58	2023-08-21T23:20:27	2023-08-21T23:15:34	Rev1	None	None
ARM	0.07047	0.02091	0.01409	0.99993	524.29	2023-08-22T01:50:27	2023-08-22T01:43:38	Rev1	None	None
TrinitySRITrojAI-SBU	0.16352	0.03169	0.03508	0.99442	1441.02	2023-07-25T17:20:30	2023-07-25T17:14:49	Rev1	None	None
TrinitySRITrojAI-SBU	0.14916	0.03632	0.03383	0.99432	1441.03	2023-07-28T23:40:30	2023-07-28T23:38:47	Rev1	None	None
TrinitySRITrojAI-SBU	0.15749	0.03819	0.03591	0.99322	1437.51	2023-08-23T19:20:32	2023-08-23T19:11:58	Rev1	None	None
TrinitySRITrojAI-SBU	0.14916	0.03632	0.03383	0.99432	1440.56	2023-08-23T21:10:32	2023-08-23T21:06:11	Rev1	None	None
TrinitySRITrojAI-SBU	0.14869	0.03583	0.03358	0.99439	1439.0	2023-08-23T21:50:32	2023-08-23T21:48:17	Rev1	None	None
TrinitySRITrojAI-SBU	0.14858	0.03579	0.03352	0.99435	1440.78	2023-08-23T22:30:32	2023-08-23T22:27:47	Rev1	None	None
TrinitySRITrojAI-SBU	0.14817	0.03573	0.03333	0.99435	1437.19	2023-08-23T23:10:32	2023-08-23T23:08:09	Rev1	None	None
TrinitySRITrojAI-SBU	0.14959	0.03588	0.03374	0.99435	1440.86	2023-08-24T00:12:26	2023-08-24T00:03:59	Rev1	None	None
TrinitySRITrojAI-SBU	0.14959	0.03588	0.03374	0.99435	1438.02	2023-08-24T00:50:32	2023-08-24T00:45:52	Rev1	None	None
TrinitySRITrojAI-SBU	0.0931	0.02046	0.01528	0.99929	3252.21	2023-10-31T18:40:29	2023-10-31T18:35:10	Rev1	None	None
ICSI-2	0.05867	0.00372	0.00385	1.0	615.31	2023-07-19T21:20:31	2023-07-19T21:17:34	Rev1	None	None
ICSI-2	0.69315	0.0	0.25	0.5	605.99	2023-08-05T00:50:33	2023-08-05T00:48:01	Rev1	None	None
ICSI-2	0.05779	0.00386	0.00379	1.0	608.88	2023-08-06T23:50:33	2023-08-06T23:41:13	Rev1	None	None
ICSI-2	0.05605	0.00409	0.00367	1.0	606.35	2023-08-07T04:30:32	2023-08-07T04:27:20	Rev1	None	None
ICSI-2	0.05059	0.00186	0.00261	1.0	599.53	2023-08-22T05:30:32	2023-08-22T05:30:00	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70969	0.02317	0.25814	0.5	1217.77	2023-07-19T23:40:32	2023-07-19T23:36:56	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	523.75	2023-07-26T00:00:33	2023-07-25T23:52:18	Rev1	:Result Parse::No Results::Missing Results:	None
TrinitySRITrojAI-BostonU	0.58048	0.50344	0.02101	0.97899	522.94	2023-07-26T23:00:34	2023-07-26T22:54:28	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69658	0.55031	0.02521	0.97479	521.45	2023-07-26T23:40:33	2023-07-26T23:39:16	Rev1	None	None
TrinitySRITrojAI-BostonU	0.49223	0.04088	0.15982	0.90128	1235.84	2023-09-04T18:50:33	2023-09-04T18:47:32	Rev1	None	None
TrinitySRITrojAI-BostonU	0.49214	0.04089	0.15978	0.90145	1233.85	2023-09-04T20:10:33	2023-09-04T20:00:32	Rev1	None	None
TrinitySRITrojAI-BostonU	0.59869	0.13635	0.16912	0.8051	1267.72	2023-09-04T22:30:32	2023-09-04T22:28:56	Rev1	None	None
TrinitySRITrojAI-BostonU	0.41145	0.10456	0.1175	0.89235	1226.88	2023-09-05T20:30:33	2023-09-05T20:26:42	Rev1	None	None
UMBCb	0.49969	0.0681	0.16834	0.83416	622.25	2023-08-22T04:30:44	2023-08-22T04:23:04	Rev1	None	None

Required filename format: "rl-lavaworld-jul2023_test_<Submission Name>.simg"
Accepting submissions: True
Number of models in rl-lavaworld-jul2023, test: 238
Execution timeout (hh:mm:ss): 1 day, 15:40:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2023-08-22T18:50:06	performer	None	None	Ok	2023-08-22T18:44:19	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-09-27T17:10:09	performer	None	Ok	Ok	2023-09-27T17:08:17	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-10T18:22:42	performer	None	None	Ok	2023-10-10T18:21:57	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-07-21T14:50:16	performer	None	None	Ok	2023-07-20T20:50:25	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2023-08-08T05:00:13	performer	None	None	Ok	2023-08-08T04:58:40	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2023-08-23T04:30:21	performer	None	None	Ok	2023-08-23T04:22:10	0 d, 0 h, 0 m, 0 s
ARM	2023-08-22T01:50:27	performer	None	Ok	Ok	2023-08-22T01:43:38	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	2023-10-31T18:40:29	performer	None	Ok	Ok	2023-10-31T18:35:10	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2023-08-22T05:30:32	performer	None	None	Ok	2023-08-22T05:30:00	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-11-14T18:53:43	performer	None	Ok	Ok	2023-11-14T17:50:54	0 d, 0 h, 0 m, 0 s
trojai-example	2023-07-14T20:40:30	public	None	Ok	Ok	2023-07-14T20:36:56	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2023-08-22T04:30:44	performer	None	Ok	Ok	2023-08-22T04:23:04	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy