TrojAI Leaderboard

TrojAI Leaderboards

Click Here to Join the Competition!

Using machine learning, an artificial intelligence (AI) is trained on data, learns relationships in that data, and then is deployed to the world to operate on new data. The problem is that an adversary that can disrupt the training pipeline can insert Trojan behaviors into the AI. TrojAI’s goal is to detect Trojans hidden in trained AI models. This page is a leaderboard of how well different Trojan detectors work against a population of AIs with and without Trojans. Read more about the problem, see the full submission documentation, or get started with a free minimal example.

Submission container names must use the following format: "<Leaderboard Name>_<Data Split>_<Container Name>.simg"

Reload page to update tables. Content is pushed every 10 minutes. Timestamps are presented in UTC.

Last modified:

Evaluation Server Status

Nodes: idle; running; down.
Accepting Submissions:

Smoke Test Server Status

Nodes: idle; running; down.
Accepting Submissions:

Round 10 leaderboard for object detection August 2022.

Each AI is trained to perform Object Detection either using a single stage (SSD), or a two stage detector (Faster-RCNN). For those AIs that have been attacked, the presence of the pattern will cause the AI to reliably produce the wrong extractive answer. The Round 10 Training Data Download consists of 144 reference AIs (exactly 50% are poisoned) with example input data. More info here.

Example poisoned image, where the green evasion trigger on the zebra causes the box to dissapear. This image is drawn from COCO (image 117897.jpg).

train: The train dataset that is distributed with each round.
test: The test dataset that is sequestered/hidden, used for evaluation. Submissions here should be fully realized with complete schema and parameters.
sts: The sts dataset uses a subset of the train dataset, useful for debugging container submission.
holdout: The holdout dataset that is sequestered/hidden, used for holdout evaluation.
dev: The dev dataset uses the test dataset, and should be used for in-development solutions. Schemas must be valid, but do not need to be complete. Results do not count towards the program.

train test sts holdout dev

Required filename format: "object-detection-aug2022_train_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-aug2022, train: 144
Execution timeout (hh:mm:ss): 1 day, 12:00:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2022-09-21T13:10:04	performer	None	None	Ok	2022-09-21T13:01:18	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2022-09-23T05:40:05	performer	None	None	Ok	2022-09-23T05:32:01	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-10T18:22:41	performer	None	None	Ok	2023-10-10T18:21:49	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-07-23T03:30:11	performer	None	None	Ok	2023-07-23T03:23:45	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2022-09-20T19:20:07	performer	None	None	Ok	2022-09-20T19:16:36	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2022-10-06T22:50:10	performer	None	None	Ok	2022-10-06T22:41:58	0 d, 0 h, 0 m, 0 s
ARM	2022-10-03T07:30:13	performer	None	None	Ok	2022-10-03T07:25:28	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojai-example	2022-09-16T20:09:40	public	None	None	Ok	2022-09-16T20:05:28	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2022-10-17T18:40:21	performer	None	None	Ok	2022-10-17T18:34:26	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
trojai-example	0.96655	0.15787	0.32514	0.52585	2592.99	2022-09-16T20:09:40	2022-09-16T20:05:28	Rev1	None	None
TrinitySRITrojAI	0.1878	0.04885	0.04729	0.9865	16587.61	2022-09-23T05:40:05	2022-09-23T05:32:01	Rev1	None	None
Perspecta-PurdueRutgers	0.11633	0.07236	0.02431	0.98495	35208.11	2023-07-11T14:10:09	2023-07-11T14:08:09	Rev1	None	None
PL-GIFT	0.07819	0.03131	0.01695	0.99961	667.41	2023-10-10T04:40:11	2023-10-10T04:34:20	Rev1	None	None
Perspecta	0.30791	0.06677	0.09363	0.93962	55923.26	2022-09-21T13:10:04	2022-09-21T13:01:18	Rev1	None	None
Perspecta-IUB	0.28794	0.06866	0.09122	0.9485	4631.59	2022-09-20T19:20:07	2022-09-20T19:16:36	Rev1	None	None
ARM	0.51654	0.0708	0.17471	0.88889	2593.42	2022-10-03T07:30:13	2022-10-03T07:25:28	Rev1	None	None
ARM-UCSD	0.41538	0.0547	0.13453	0.89641	19482.57	2022-10-06T22:50:10	2022-10-06T22:41:58	Rev1	None	None
UMBCb	0.31604	0.04107	0.08516	0.97319	1956.02	2022-10-17T18:40:21	2022-10-17T18:34:26	Rev1	:Container File Missing:	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
trojai-example	0.96655	0.15787	0.32514	0.52585	2592.99	2022-09-16T20:09:40	2022-09-16T20:05:28	Rev1	None	None
TrinitySRITrojAI	0.1878	0.04885	0.04729	0.9865	16587.61	2022-09-23T05:40:05	2022-09-23T05:32:01	Rev1	None	None
Perspecta-PurdueRutgers	0.11633	0.07236	0.02431	0.98495	35208.11	2023-07-11T14:10:09	2023-07-11T14:08:09	Rev1	None	None
Perspecta-PurdueRutgers	0.16639	0.05898	0.03222	0.97222	33575.19	2023-07-12T17:50:10	2023-07-12T17:44:13	Rev1	None	None
Perspecta-PurdueRutgers	0.29205	0.05908	0.07222	0.95833	31588.69	2023-07-23T03:30:11	2023-07-23T03:23:45	Rev1	None	None
PL-GIFT	0.11853	0.03474	0.0244	0.99614	1949.06	2023-02-14T16:50:07	2023-02-14T16:49:12	Rev1	None	None
PL-GIFT	0.10907	0.04427	0.02989	0.99498	701.95	2023-10-09T22:53:38	2023-10-09T22:44:59	Rev1	None	None
PL-GIFT	0.16498	0.04908	0.04589	0.98997	704.35	2023-10-10T00:50:11	2023-10-10T00:41:18	Rev1	None	None
PL-GIFT	0.13709	0.04442	0.03594	0.99344	699.12	2023-10-10T02:10:11	2023-10-10T02:07:13	Rev1	None	None
PL-GIFT	0.11084	0.04698	0.03097	0.99402	683.13	2023-10-10T03:50:12	2023-10-10T03:49:19	Rev1	None	None
PL-GIFT	0.07819	0.03131	0.01695	0.99961	667.41	2023-10-10T04:40:11	2023-10-10T04:34:20	Rev1	None	None
PL-GIFT	0.20466	0.0527	0.05458	0.98245	716.99	2023-10-10T05:22:40	2023-10-10T05:11:34	Rev1	None	None
PL-GIFT	0.13498	0.04525	0.03321	0.99248	714.66	2023-10-10T18:22:41	2023-10-10T18:21:49	Rev1	None	None
Perspecta	0.69068	0.00482	0.24883	0.50694	5997.8	2022-09-19T21:40:04	2022-09-19T21:31:36	Rev1	:Result Parse:	None
Perspecta	0.69315	0.0	0.25	0.5	875.54	2022-09-20T16:00:04	2022-09-20T15:52:03	Rev1	None	None
Perspecta	0.30791	0.06677	0.09363	0.93962	55923.26	2022-09-21T13:10:04	2022-09-21T13:01:18	Rev1	None	None
Perspecta-IUB	0.28794	0.06866	0.09122	0.9485	4631.59	2022-09-20T19:20:07	2022-09-20T19:16:36	Rev1	None	None
ARM	0.44716	0.0774	0.151	0.8751	2595.77	2022-10-03T05:20:13	2022-10-03T05:16:26	Rev1	None	None
ARM	0.51654	0.0708	0.17471	0.88889	2593.42	2022-10-03T07:30:13	2022-10-03T07:25:28	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	382.63	2022-09-19T19:10:07	2022-09-19T17:19:37	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	557.98	2022-09-19T23:30:07	2022-09-19T23:25:37	Rev1	None	None
ARM-UCSD	0.68683	0.00891	0.24721	0.51379	400.63	2022-09-19T23:50:34	2022-09-19T23:45:52	Rev1	None	None
ARM-UCSD	0.69889	0.02001	0.25175	0.50675	395.63	2022-09-20T03:50:07	2022-09-20T03:48:06	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	818.28	2022-09-20T16:10:04	2022-09-20T16:03:08	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	288.51	2022-09-20T16:30:28	2022-09-20T16:22:56	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T23:40:07	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T23:50:07	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:00:07	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:10:07	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:20:07	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:30:08	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:40:07	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:50:07	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:00:07	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:10:06	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:20:07	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:30:07	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:40:06	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:50:06	2022-09-20T23:32:15	Rev1	:Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T02:00:06	2022-09-20T23:32:15	Rev1	:Executed File Update::Info File Missing::Log File Missing::Container File Missing:	None
ARM-UCSD	0.56854	0.08995	0.19865	0.78202	9436.56	2022-09-21T02:10:07	2022-09-20T23:32:15	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	1153.95	2022-10-04T04:20:09	2022-10-04T04:13:30	Rev1	None	None
ARM-UCSD	0.41538	0.0547	0.13453	0.89641	19482.57	2022-10-06T22:50:10	2022-10-06T22:41:58	Rev1	None	None
UMBCb	0.31604	0.04107	0.08516	0.97319	1956.02	2022-10-17T18:40:21	2022-10-17T18:34:26	Rev1	:Container File Missing:	None

Required filename format: "object-detection-aug2022_test_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-aug2022, test: 144
Execution timeout (hh:mm:ss): 1 day, 12:00:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2022-09-20T20:00:03	performer	None	None	Ok	2022-09-20T19:53:19	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2022-09-23T05:40:05	performer	None	None	Ok	2022-09-23T05:32:01	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-10T18:22:41	performer	None	None	Ok	2023-10-10T18:21:49	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-07-23T03:30:11	performer	None	Ok	Ok	2023-07-23T03:23:45	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2022-09-20T19:20:07	performer	None	None	Ok	2022-09-20T19:16:36	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2022-11-08T00:40:10	performer	None	None	Ok	2022-11-08T00:37:39	0 d, 0 h, 0 m, 0 s
ARM	2022-10-03T07:30:13	performer	None	Ok	Ok	2022-10-03T07:25:28	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojai-example	2022-09-20T18:30:09	public	None	None	Ok	2022-09-20T18:27:57	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2022-10-17T18:40:21	performer	None	None	Ok	2022-10-17T18:34:26	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
trojai-example	0.69315	0.0	0.25	0.5		2022-09-20T18:30:09	2022-09-20T18:27:57	Rev1	:Info File Missing:	None
TrinitySRITrojAI	0.40557	0.10773	0.13063	0.90085	3927.8	2022-09-07T04:50:02	2022-09-07T04:34:50	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.33308	0.08907	0.104	0.93924	662.89	2022-09-02T10:10:01	2022-09-02T10:03:39	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-PurdueRutgers	0.16787	0.09226	0.04146	0.96335	20369.45	2022-08-21T20:10:01	2022-08-21T20:01:40	Rev1	:Executed File Update::Log File Missing:	None
PL-GIFT	0.26366	0.09153	0.08257	0.96373	693.53	2023-10-09T22:53:38	2023-10-09T22:44:59	Rev1	None	None
Perspecta	0.38825	0.08085	0.12527	0.89014	55313.35	2022-09-20T20:00:03	2022-09-20T19:53:19	Rev1	None	None
TrinitySRITrojAI-SBU	0.44974	0.06643	0.14299	0.88059	1181.78	2022-09-04T19:40:01	2022-09-04T15:36:46	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.34531	0.0922	0.10788	0.92978	983.53	2022-09-02T05:00:01	2022-09-02T04:52:07	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-BostonU	0.44557	0.07967	0.14031	0.88387	11213.55	2022-08-23T14:30:01	2022-08-23T14:21:31	Rev1	:Executed File Update::Log File Missing:	None
ARM	0.71323	0.37262	0.18769	0.875	2597.16	2022-10-03T07:30:13	2022-10-03T07:25:28	Rev1	None	None
ARM-UCSD	0.46467	0.05577	0.15539	0.85532	19518.63	2022-10-06T22:50:10	2022-10-06T22:41:58	Rev1	None	None
UMBCb	0.46014	0.06258	0.14668	0.88021	1947.54	2022-10-17T18:40:21	2022-10-17T18:34:26	Rev1	None	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
trojai-example	1.14219	0.20328	0.35385	0.47627	909.16	2022-07-28T01:30:07	2022-07-28T01:30:03	Rev1	:Executed File Update::Log File Missing:	None
trojai-example	0.95963	0.14719	0.32745	0.48573	2591.05	2022-09-16T20:09:40	2022-09-16T20:05:28	Rev1	None	None
trojai-example	0.69315	0.0	0.25	0.5		2022-09-20T18:30:09	2022-09-20T18:27:57	Rev1	:Info File Missing:	None
TrinitySRITrojAI	0.44557	0.07967	0.14031	0.88387	11072.36	2022-07-28T03:50:01	2022-07-28T03:46:36	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI	0.45826	0.14674	0.13468	0.88561	11567.63	2022-08-01T20:00:01	2022-08-01T19:51:21	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI	0.49569	0.0984	0.16507	0.83372	1261.47	2022-08-08T23:10:01	2022-08-08T23:08:01	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI	0.43343	0.06755	0.14125	0.87037	3937.95	2022-08-11T06:50:02	2022-08-11T06:41:58	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI	0.40207	0.10005	0.13224	0.90046	3942.27	2022-08-27T06:00:01	2022-08-27T05:58:46	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5		2022-09-06T22:50:01	2022-09-06T22:45:07	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
TrinitySRITrojAI	0.40557	0.10773	0.13063	0.90085	3927.8	2022-09-07T04:50:02	2022-09-07T04:34:50	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI	0.39378	0.08799	0.12842	0.90008	6019.45	2022-09-09T20:00:01	2022-09-09T19:54:15	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5		2022-09-20T18:20:04	2022-09-20T18:15:08	Rev1	:Info File Missing:	None
TrinitySRITrojAI	0.40958	0.0964	0.13166	0.89217	16610.22	2022-09-23T05:40:05	2022-09-23T05:32:01	Rev1	None	None
ICSI-2	0.48919	0.06161	0.16241	0.85301	535.05	2022-07-28T21:00:02	2022-07-28T20:56:51	Rev1	:Executed File Update::Log File Missing:	:Container Parameters (jsonschema checker):
ICSI-2	0.45518	0.0958	0.14463	0.86285	532.58	2022-07-29T23:20:01	2022-07-29T23:12:21	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.4023	0.0761	0.12481	0.90586	569.74	2022-08-03T03:20:01	2022-08-03T03:17:09	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.38275	0.07356	0.11598	0.91667	569.39	2022-08-05T00:40:01	2022-08-05T00:39:34	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.36983	0.07443	0.11192	0.92824	590.89	2022-08-09T01:00:01	2022-08-09T00:52:50	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.34072	0.08762	0.10681	0.93731	573.48	2022-08-09T07:00:02	2022-08-09T05:59:27	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.49614	0.20392	0.12848	0.93731	586.74	2022-08-09T23:50:01	2022-08-09T23:47:56	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.34129	0.09577	0.10844	0.93731	603.02	2022-08-10T22:50:02	2022-08-10T22:12:01	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.34132	0.08756	0.10686	0.93731	588.8	2022-08-11T05:30:02	2022-08-11T05:29:28	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.34523	0.09544	0.10873	0.93731	594.7	2022-08-11T21:30:01	2022-08-11T21:22:33	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.35496	0.08273	0.11088	0.924	1185.1	2022-08-16T14:50:01	2022-08-16T14:49:40	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.33536	0.089	0.105	0.93827	593.21	2022-08-22T23:50:01	2022-08-22T23:41:20	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.33536	0.089	0.105	0.93827	594.83	2022-08-23T05:50:01	2022-08-23T00:03:15	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.3406	0.08354	0.10502	0.93403	591.03	2022-08-23T11:50:01	2022-08-23T07:14:37	Rev1	:Executed File Update::Log File Missing:	None
ICSI-2	0.33308	0.08907	0.104	0.93924	662.89	2022-09-02T10:10:01	2022-09-02T10:03:39	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-PurdueRutgers	0.24686	0.08555	0.05968	0.94049	20556.45	2022-07-29T01:00:02	2022-07-29T00:52:14	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-PurdueRutgers	0.23909	0.08514	0.05642	0.94126	20181.37	2022-08-19T23:20:01	2022-08-19T23:13:07	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-PurdueRutgers	0.24568	0.09897	0.05347	0.92612	20670.17	2022-08-20T21:40:02	2022-08-20T21:32:11	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-PurdueRutgers	0.16787	0.09226	0.04146	0.96335	20369.45	2022-08-21T20:10:01	2022-08-21T20:01:40	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-PurdueRutgers	0.16787	0.09226	0.04146	0.96335	33883.17	2023-07-11T14:10:09	2023-07-11T14:08:09	Rev1	None	None
Perspecta-PurdueRutgers	0.21217	0.07718	0.04889	0.95139	32870.19	2023-07-12T17:50:10	2023-07-12T17:44:13	Rev1	None	None
Perspecta-PurdueRutgers	0.32845	0.07137	0.08611	0.93403	31618.44	2023-07-23T03:30:11	2023-07-23T03:23:45	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5	242.71	2022-07-29T20:00:02	2022-07-29T19:44:36	Rev1	:Executed File Update::Log File Missing:	None
PL-GIFT	3.21884	1.36132	0.23092	0.8343	2887.89	2022-07-30T02:00:02	2022-07-29T22:41:27	Rev1	:Executed File Update::Log File Missing:	None
PL-GIFT	0.38316	0.08957	0.12258	0.90992	2654.61	2022-08-09T03:50:01	2022-08-09T03:42:13	Rev1	:Executed File Update::Log File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.42492	0.11866	0.13435	0.88648	2498.94	2022-08-20T16:30:02	2022-08-20T16:24:23	Rev1	:Executed File Update::Log File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.57207	0.16016	0.17005	0.82195	974.33	2022-08-25T23:20:01	2022-08-25T23:12:14	Rev1	:Executed File Update::Log File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.4778	0.12937	0.15503	0.89824	1925.54	2022-09-03T16:20:02	2022-09-03T16:16:06	Rev1	:Executed File Update::Log File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.4987	0.07674	0.17538	0.88551	1914.04	2022-09-03T22:20:02	2022-09-03T18:33:34	Rev1	:Executed File Update::Log File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.38923	0.07448	0.12435	0.91088	517.53	2022-09-07T20:40:02	2022-09-07T20:32:17	Rev1	:Executed File Update::Log File Missing:	None
PL-GIFT	0.37038	0.0686	0.11748	0.92072	541.24	2022-09-08T18:20:02	2022-09-08T18:17:57	Rev1	:Executed File Update::Log File Missing:	None
PL-GIFT	0.38372	0.06729	0.12096	0.91995	544.48	2022-09-09T00:20:02	2022-09-08T23:46:27	Rev1	:Executed File Update::Log File Missing:	None
PL-GIFT	0.45717	0.13378	0.13766	0.87249	1948.1	2023-02-14T16:50:07	2023-02-14T16:49:12	Rev1	None	None
PL-GIFT	0.26366	0.09153	0.08257	0.96373	693.53	2023-10-09T22:53:38	2023-10-09T22:44:59	Rev1	None	None
PL-GIFT	0.37865	0.10638	0.12004	0.90413	705.26	2023-10-10T00:50:11	2023-10-10T00:41:18	Rev1	None	None
PL-GIFT	0.30068	0.08934	0.09606	0.94734	701.37	2023-10-10T02:10:11	2023-10-10T02:07:13	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2023-10-10T03:20:11	2023-10-10T03:18:54	Rev1	:No Results::Missing Results:	:Container Parameters (jsonschema checker):
PL-GIFT	0.27922	0.10709	0.0855	0.95814	700.81	2023-10-10T03:50:12	2023-10-10T03:49:19	Rev1	None	None
PL-GIFT	0.38691	0.11987	0.12512	0.91609	669.57	2023-10-10T04:40:11	2023-10-10T04:34:20	Rev1	None	None
PL-GIFT	0.34414	0.07978	0.11045	0.9294	653.49	2023-10-10T05:22:40	2023-10-10T05:11:34	Rev1	None	None
PL-GIFT	0.30771	0.08723	0.09932	0.94387	722.18	2023-10-10T18:22:41	2023-10-10T18:21:49	Rev1	None	None
Perspecta	0.66321	0.02806	0.23535	0.61333	17442.4	2022-08-09T13:10:01	2022-08-09T13:04:43	Rev1	:Executed File Update::Log File Missing:	:Container Parameters (jsonschema checker):
Perspecta	0.6087	0.06574	0.20903	0.70785	24040.01	2022-08-30T00:40:02	2022-08-30T00:36:36	Rev1	:Executed File Update::Log File Missing:	:Container Parameters (jsonschema checker):
Perspecta	0.57544	0.06812	0.19543	0.77054	24217.35	2022-08-31T03:00:02	2022-08-31T02:55:12	Rev1	:Executed File Update::Log File Missing:	None
Perspecta	0.51267	0.08891	0.16341	0.79871	18676.66	2022-09-02T17:00:02	2022-09-02T16:59:06	Rev1	:Executed File Update::Log File Missing:	None
Perspecta	0.48061	0.07919	0.15509	0.84076	20922.93	2022-09-05T06:40:01	2022-09-05T06:32:24	Rev1	:Executed File Update::Log File Missing:	None
Perspecta	0.46803	0.07267	0.15087	0.85031	21076.29	2022-09-07T23:40:01	2022-09-07T23:39:31	Rev1	:Executed File Update::Log File Missing:	None
Perspecta	0.42916	0.08665	0.14171	0.84491	21315.05	2022-09-08T13:00:01	2022-09-08T12:57:41	Rev1	:Executed File Update::Log File Missing:	None
Perspecta	0.40836	0.07876	0.13245	0.87828	21297.73	2022-09-08T23:40:02	2022-09-08T23:32:13	Rev1	:Executed File Update::Log File Missing:	None
Perspecta	1.71484	0.38792	0.34274	0.86439	21329.54	2022-09-09T19:00:01	2022-09-09T18:53:06	Rev1	:Executed File Update::Log File Missing:	None
Perspecta	0.69315	0.0	0.25	0.5	569.95	2022-09-19T21:40:04	2022-09-19T21:31:36	Rev1	None	None
Perspecta	0.68092	0.0138	0.24509	0.52064	1137.85	2022-09-20T16:00:04	2022-09-20T15:52:03	Rev1	None	None
Perspecta	0.69315	0.0	0.25	0.5		2022-09-20T17:40:03	2022-09-20T17:31:14	Rev1	:Info File Missing:	None
Perspecta	0.38825	0.08085	0.12527	0.89014	55313.35	2022-09-20T20:00:03	2022-09-20T19:53:19	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	242.85	2022-08-11T00:50:02	2022-08-11T00:42:03	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-SBU	0.69018	0.02699	0.24895	0.58681	968.17	2022-08-11T16:30:01	2022-08-11T16:24:12	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-SBU	0.6859	0.05438	0.2487	0.84529	984.51	2022-08-19T01:40:02	2022-08-19T01:31:42	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	146.31	2022-09-02T02:30:01	2022-09-02T02:20:55	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	146.3	2022-09-02T16:00:01	2022-09-02T15:58:50	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-SBU	0.49163	0.05391	0.1645	0.85532	999.98	2022-09-02T23:50:02	2022-09-02T23:49:32	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-SBU	0.48748	0.06064	0.16207	0.8588	542.07	2022-09-03T16:40:02	2022-09-03T16:32:39	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	1000.01	2022-09-03T22:50:01	2022-09-03T17:58:57	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	997.4	2022-09-04T13:40:01	2022-09-04T13:32:50	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-SBU	0.44974	0.06643	0.14299	0.88059	1181.78	2022-09-04T19:40:01	2022-09-04T15:36:46	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-SBU	0.46014	0.06258	0.14668	0.88021	696.25	2022-09-05T04:20:01	2022-09-05T04:10:52	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2022-08-20T12:50:01	2022-08-20T05:20:27	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	242.65	2022-08-20T18:50:01	2022-08-20T14:09:27	Rev1	:Executed File Update::Log File Missing:	:Container Parameters (jsonschema checker):
Perspecta-IUB	0.38398	0.07422	0.12311	0.91358	943.14	2022-08-21T01:10:01	2022-08-21T01:09:36	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.38489	0.07559	0.12368	0.90934	1155.3	2022-08-21T07:10:02	2022-08-21T04:43:25	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.38368	0.08351	0.12466	0.90644	1157.16	2022-08-21T13:20:01	2022-08-21T10:35:53	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.38151	0.09405	0.12178	0.91416	1107.12	2022-08-21T19:20:02	2022-08-21T16:09:32	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	1.70346	0.88386	0.16209	0.90258	1110.03	2022-08-22T01:30:01	2022-08-21T21:31:52	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	1.2325	0.81994	0.1274	0.9022	1108.13	2022-08-22T07:30:02	2022-08-22T03:47:24	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.38299	0.07476	0.12332	0.91474	1104.07	2022-08-22T15:50:01	2022-08-22T15:44:02	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.38345	0.09579	0.12526	0.9103	915.39	2022-08-22T21:50:01	2022-08-22T17:33:07	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.7091	0.52659	0.12237	0.91001	1106.19	2022-08-23T03:50:02	2022-08-23T03:43:11	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.5462	0.37943	0.12211	0.91204	1103.9	2022-08-23T15:40:01	2022-08-23T15:36:57	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.46154	0.14162	0.14309	0.89525	982.75	2022-09-01T21:00:02	2022-09-01T20:53:07	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.34531	0.0922	0.10788	0.92978	983.53	2022-09-02T05:00:01	2022-09-02T04:52:07	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.3471	0.08301	0.10943	0.92708	980.65	2022-09-02T11:00:02	2022-09-02T05:24:14	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.37432	0.11724	0.11518	0.91512	956.17	2022-09-02T17:00:02	2022-09-02T14:32:45	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.37834	0.12218	0.11548	0.9184	1021.11	2022-09-03T00:30:02	2022-09-03T00:23:40	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.35561	0.09127	0.11384	0.92245	1633.86	2022-09-03T06:30:02	2022-09-03T04:12:11	Rev1	:Executed File Update::Log File Missing:	None
Perspecta-IUB	0.35561	0.09127	0.11384	0.92245	4625.08	2022-09-20T19:20:07	2022-09-20T19:16:36	Rev1	None	None
TrinitySRITrojAI-BostonU	0.84611	0.09268	0.31589	0.58738	11503.52	2022-08-22T16:30:01	2022-08-22T15:15:13	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-BostonU	0.84545	0.09245	0.31564	0.51765	12486.37	2022-08-23T00:10:02	2022-08-22T23:53:29	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-BostonU	1.51843	0.27506	0.42086	0.6061	11137.86	2022-08-23T06:20:02	2022-08-23T04:01:32	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-BostonU	0.44557	0.07967	0.14031	0.88387	11213.55	2022-08-23T14:30:01	2022-08-23T14:21:31	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-BostonU	0.49831	0.10303	0.15791	0.84394	11119.38	2022-08-23T20:30:01	2022-08-23T17:55:58	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-BostonU	0.49946	0.04878	0.16172	0.86478	11116.17	2022-08-24T02:30:01	2022-08-24T00:09:32	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-BostonU	0.44557	0.07967	0.14031	0.88387	11469.17	2022-08-24T15:50:02	2022-08-24T15:42:02	Rev1	:Executed File Update::Log File Missing:	None
TrinitySRITrojAI-BostonU	0.44557	0.07967	0.14031	0.88387	11790.8	2022-08-25T14:00:01	2022-08-25T13:50:19	Rev1	:Executed File Update::Log File Missing:	None
ARM	0.69315	0.0	0.25	0.5	868.0	2022-08-23T07:50:01	2022-08-23T09:18:28	Rev1	:Executed File Update::Log File Missing:	None
ARM	0.81852	0.08419	0.30396	0.47618	868.19	2022-08-23T19:20:01	2022-08-23T19:19:22	Rev1	:Executed File Update::Log File Missing:	None
ARM	0.87806	0.37656	0.26375	0.83748	870.05	2022-08-24T01:20:02	2022-08-23T20:13:57	Rev1	:Executed File Update::Log File Missing:	None
ARM	0.69315	0.0	0.25	0.5	868.06	2022-09-06T03:10:02	2022-09-06T03:02:06	Rev1	:Executed File Update::Log File Missing:	None
ARM	0.90598	0.37697	0.27668	0.83594	867.9	2022-09-06T09:20:01	2022-09-06T06:40:56	Rev1	:Executed File Update::Log File Missing:	None
ARM	0.67795	0.37716	0.17678	0.81395	868.02	2022-09-06T16:10:01	2022-09-06T16:04:10	Rev1	:Executed File Update::Log File Missing:	None
ARM	0.62867	0.37593	0.15467	0.85957	2596.3	2022-10-03T06:20:13	2022-10-03T06:18:21	Rev1	None	None
ARM	0.71323	0.37262	0.18769	0.875	2597.16	2022-10-03T07:30:13	2022-10-03T07:25:28	Rev1	None	None
ARM-UCSD	0.52751	0.09885	0.18077	0.81346	3439.11	2022-09-02T06:10:01	2022-09-02T06:02:30	Rev1	:Executed File Update::Log File Missing:	None
ARM-UCSD	0.56404	0.10495	0.19593	0.77836	3452.26	2022-09-02T21:10:02	2022-09-02T21:35:08	Rev1	:Executed File Update::Log File Missing:	None
ARM-UCSD	0.55948	0.09147	0.19342	0.76476	3440.33	2022-09-03T06:00:01	2022-09-03T05:55:52	Rev1	:Executed File Update::Log File Missing:	None
ARM-UCSD	0.69054	0.00509	0.24878	0.50694	8959.98	2022-09-19T19:10:07	2022-09-19T17:19:37	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	708.34	2022-09-19T23:30:08	2022-09-19T23:25:22	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	712.03	2022-09-19T23:50:35	2022-09-19T23:45:47	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	650.04	2022-09-20T03:50:08	2022-09-20T03:48:13	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	615.03	2022-09-20T16:30:29	2022-09-20T16:23:30	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T22:20:07	2022-09-20T22:14:55	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T22:30:07	2022-09-20T22:14:55	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T22:40:07	2022-09-20T22:14:55	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T22:50:07	2022-09-20T22:14:55	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T23:00:07	2022-09-20T22:14:55	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T23:10:07	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T23:20:07	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T23:30:06	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T23:40:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T23:50:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:00:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:10:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:20:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:30:09	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:40:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T00:50:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:00:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:10:07	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:20:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:30:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:40:07	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T01:50:07	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-21T02:00:08	2022-09-20T23:08:46	Rev1	:Executed File Update::Info File Missing::Log File Missing:	None
ARM-UCSD	0.62893	0.09361	0.22448	0.70853	9334.92	2022-09-21T02:10:08	2022-09-20T23:08:46	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	1155.89	2022-10-04T04:20:10	2022-10-04T04:13:40	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	1154.27	2022-10-04T23:10:10	2022-10-04T23:07:45	Rev1	None	None
ARM-UCSD	0.46467	0.05577	0.15539	0.85532	19518.63	2022-10-06T22:50:10	2022-10-06T22:41:58	Rev1	None	None
ARM-UCSD	0.66841	0.0274	0.23736	0.64024	34424.14	2022-11-02T05:40:11	2022-11-02T05:35:09	Rev1	None	:Container Parameters (jsonschema checker):
ARM-UCSD	0.48031	0.0513	0.16388	0.82369	34260.63	2022-11-08T00:40:10	2022-11-08T00:37:39	Rev1	None	:Container Parameters (jsonschema checker):
UMBCb	0.69315	0.0	0.25	0.5	865.64	2022-10-16T21:00:23	2022-10-16T20:57:55	Rev1	None	None
UMBCb	0.46014	0.06258	0.14668	0.88021	1947.54	2022-10-17T18:40:21	2022-10-17T18:34:26	Rev1	None	None

Required filename format: "object-detection-aug2022_sts_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-aug2022, sts: 10
Execution timeout (hh:mm:ss): 2:30:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2022-09-20T16:20:03	performer	None	None	Ok	2022-09-20T16:15:49	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2022-09-22T23:30:05	performer	None	None	Ok	2022-09-22T23:24:44	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-10T17:00:11	performer	None	None	Ok	2023-10-10T16:59:04	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-07-11T03:10:11	performer	None	None	Ok	2023-07-11T03:00:58	0 d, 0 h, 0 m, 0 s
Perspecta-IUB		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2022-11-08T00:40:11	performer	None	None	Ok	2022-11-08T00:37:31	0 d, 0 h, 0 m, 0 s
ARM		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojai-example	2022-10-05T15:10:17	public	None	None	Ok	2022-10-05T14:59:32	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2022-10-17T18:20:22	performer	None	None	Ok	2022-10-17T18:16:50	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
trojai-example	0.51567	0.25566	0.17866	0.83333	180.51	2022-10-05T15:10:17	2022-10-05T14:59:32	Rev1	None	None
TrinitySRITrojAI	0.29559	0.27212	0.0956	0.95833	1180.67	2022-09-22T23:30:05	2022-09-22T23:24:44	Rev1	None	None
Perspecta-PurdueRutgers	0.40105	0.67933	0.09634	0.875	2887.14	2023-07-11T03:10:11	2023-07-11T03:00:58	Rev1	None	None
PL-GIFT	0.14231	0.05954	0.02343	1.0	134.51	2023-02-14T16:20:07	2023-02-14T16:17:22	Rev1	None	None
Perspecta	0.86773	0.77126	0.24779	0.6875	1800.55	2022-09-19T19:10:03	2022-09-19T13:43:43	Rev1	None	:Timeout:
ARM-UCSD	0.46552	0.16004	0.14563	1.0	649.66	2022-09-20T17:50:06	2022-09-20T17:43:39	Rev1	None	None
UMBCb	0.43737	0.21442	0.14229	0.83333	135.39	2022-10-17T18:20:22	2022-10-17T18:16:50	Rev1	None	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
trojai-example	0.69315	0.0	0.25	0.5	0.55	2022-09-16T16:49:12	2022-09-16T16:28:58	Rev1	:Container File Missing:	:Copy Out:
trojai-example	0.69315	0.0	0.25	0.5	50.15	2022-09-16T18:15:25	2022-09-16T16:28:58	Rev1	None	None
trojai-example	0.69315	0.0	0.25	0.5	50.16	2022-09-16T18:41:59	2022-09-16T16:28:58	Rev1	None	None
trojai-example	0.69315	0.0	0.25	0.5	50.15	2022-09-16T18:55:49	2022-09-16T16:28:58	Rev1	None	None
trojai-example	0.69315	0.0	0.25	0.5		2022-09-16T19:31:19	2022-09-16T16:28:58	Rev1	:Executed File Update::Info File Missing::Container File Missing:	None
trojai-example	0.69315	0.0	0.25	0.5	131.51	2022-09-16T19:33:25	2022-09-16T16:28:58	Rev1	None	None
trojai-example	1.24928	0.79595	0.38884	0.5	179.93	2022-09-16T19:39:51	2022-09-16T16:28:58	Rev1	None	None
trojai-example	0.85088	0.56821	0.27957	0.625	180.06	2022-09-16T19:53:23	2022-09-16T16:28:58	Rev1	None	None
trojai-example	0.9125	0.55567	0.30594	0.58333	179.98	2022-09-16T20:13:46	2022-09-16T16:28:58	Rev1	None	None
trojai-example	0.87033	0.39561	0.32378	0.5	179.9	2022-09-20T18:30:10	2022-09-20T18:27:48	Rev1	None	None
trojai-example	0.63804	0.42147	0.21279	0.70833	181.61	2022-10-05T14:20:19	2022-10-05T14:14:26	Rev1	:Container File Missing:	None
trojai-example	1.59808	0.6812	0.52814	0.08333	180.31	2022-10-05T14:50:16	2022-10-05T14:41:53	Rev1	:Container File Missing:	None
trojai-example	0.51567	0.25566	0.17866	0.83333	180.51	2022-10-05T15:10:17	2022-10-05T14:59:32	Rev1	None	None
TrinitySRITrojAI	0.29559	0.27212	0.0956	0.95833	1180.67	2022-09-22T23:30:05	2022-09-22T23:24:44	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2023-07-11T01:30:11	2023-07-11T01:29:30	Rev1	:No Results::Missing Results::Container File Missing:	:Container Parameters (jsonschema checker):
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2023-07-11T02:10:11	2023-07-11T02:08:26	Rev1	:No Results::Missing Results::Container File Missing:	:Container Parameters (jsonschema checker):
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2023-07-11T02:40:10	2023-07-11T02:34:26	Rev1	:No Results::Missing Results::Container File Missing:	:Schema Header:
Perspecta-PurdueRutgers	0.40105	0.67933	0.09634	0.875	2887.14	2023-07-11T03:10:11	2023-07-11T03:00:58	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2023-01-25T14:40:10	2023-01-25T14:32:44	Rev1	:No Results::Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.69315	0.0	0.25	0.5		2023-02-02T23:50:08	2023-02-02T23:49:18	Rev1	:No Results::Container File Missing:	:Container Parameters (learned parameters)::Container Parameters (jsonschema checker):
PL-GIFT	0.69315	0.0	0.25	0.5		2023-02-10T15:50:07	2023-02-10T15:45:32	Rev1	:No Results::Container File Missing:	:Container Parameters (learned parameters):
PL-GIFT	0.69315	0.0	0.25	0.5	71.66	2023-02-10T16:50:08	2023-02-10T16:48:51	Rev1	:No Results:	None
PL-GIFT	0.69315	0.0	0.25	0.5	100.31	2023-02-10T18:20:07	2023-02-10T18:17:02	Rev1	:No Results:	None
PL-GIFT	0.69315	0.0	0.25	0.5	144.0	2023-02-10T19:40:06	2023-02-10T19:35:33	Rev1	:No Results:	None
PL-GIFT	0.14231	0.05954	0.02343	1.0	134.51	2023-02-14T16:20:07	2023-02-14T16:17:22	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5	29.06	2023-10-06T20:50:11	2023-10-06T20:42:12	Rev1	:No Results::Missing Results:	None
PL-GIFT	0.69315	0.0	0.25	0.5	29.22	2023-10-06T21:42:38	2023-10-06T21:41:57	Rev1	:No Results::Missing Results:	None
PL-GIFT	0.69315	0.0	0.25	0.5	37.07	2023-10-09T21:00:11	2023-10-09T20:56:15	Rev1	:No Results::Missing Results:	None
PL-GIFT	0.07871	0.06551	0.01247	1.0	55.36	2023-10-09T22:20:11	2023-10-09T22:15:40	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2023-10-10T03:50:13	2023-10-10T03:49:02	Rev1	:No Results::Missing Results::Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.21279	0.1519	0.06207	1.0	56.62	2023-10-10T17:00:11	2023-10-10T16:59:04	Rev1	None	None
Perspecta	0.86773	0.77126	0.24779	0.6875	1800.55	2022-09-19T19:10:03	2022-09-19T13:43:43	Rev1	None	:Timeout:
Perspecta	0.59455	0.133	0.21041	0.6875	1144.68	2022-09-20T16:20:03	2022-09-20T16:15:49	Rev1	None	None
ARM-UCSD	0.51516	0.28617	0.16466	0.79167	650.68	2022-09-19T23:40:06	2022-09-19T23:30:09	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-09-20T00:00:53	2022-09-19T23:45:42	Rev1	:Info File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	392.48	2022-09-20T16:30:30	2022-09-20T16:27:42	Rev1	None	None
ARM-UCSD	0.46552	0.16004	0.14563	1.0	649.66	2022-09-20T17:50:06	2022-09-20T17:43:39	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	79.93	2022-10-05T20:20:10	2022-10-05T20:16:53	Rev1	None	None
ARM-UCSD	0.42054	0.15442	0.1275	1.0	1502.36	2022-10-06T22:50:11	2022-10-06T22:41:50	Rev1	None	None
ARM-UCSD	0.6713	0.09389	0.23895	0.45833	2690.42	2022-11-02T05:40:12	2022-11-02T05:35:19	Rev1	None	:Container Parameters (jsonschema checker):
ARM-UCSD	0.46868	0.15856	0.14981	0.91667	2724.25	2022-11-08T00:40:11	2022-11-08T00:37:31	Rev1	None	:Container Parameters (jsonschema checker):
UMBCb	0.69315	0.0	0.25	0.5	60.27	2022-10-17T14:50:22	2022-10-17T14:46:23	Rev1	None	None
UMBCb	0.69315	0.0	0.25	0.5	60.01	2022-10-17T16:20:21	2022-10-17T16:16:54	Rev1	None	None
UMBCb	0.69315	0.0	0.25	0.5	60.11	2022-10-17T17:10:22	2022-10-17T17:02:12	Rev1	None	None
UMBCb	0.43737	0.21442	0.14229	0.83333	135.39	2022-10-17T18:20:22	2022-10-17T18:16:50	Rev1	None	None

Required filename format: "object-detection-aug2022_holdout_<Submission Name>.simg"
Accepting submissions: False
Number of models in object-detection-aug2022, holdout: 144
Execution timeout (hh:mm:ss): 1 day, 12:00:00

Teams/Jobs

Team	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	performer	None	None	Ok	2022-09-20T19:53:19	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	performer	None	None	Ok	2022-09-23T05:32:01	0 d, 0 h, 0 m, 0 s
DRAFFT	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	performer	None	None	Ok	2022-09-20T19:16:36	0 d, 0 h, 0 m, 0 s
ARM-UCSD	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UMBC	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojai-example	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IceTorch	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PASS	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
TrinitySRITrojAI	0.34193	0.09211	0.11231	0.92689	9247.52	2022-08-27T06:00:01	2022-08-27T05:58:46	Rev1	:Executed File Update:	:Cleanup:
ICSI-2	0.33198	0.09391	0.10664	0.94734	1934.52	2022-09-02T10:10:01	2022-09-02T10:03:39	Rev1	:Executed File Update:	None
Perspecta-PurdueRutgers	0.29129	0.13131	0.07822	0.92033	51374.46	2022-08-21T20:10:01	2022-08-21T20:01:40	Rev1	:Executed File Update:	None
PL-GIFT	0.35137	0.06594	0.11234	0.92882	1521.68	2022-09-09T00:20:02	2022-09-08T23:46:27	Rev1	:Executed File Update:	None
Perspecta	0.31846	0.0604	0.0964	0.93663	54015.82	2022-09-08T23:40:02	2022-09-08T23:32:13	Rev1	:Executed File Update:	:Cleanup:
TrinitySRITrojAI-SBU	0.38251	0.05547	0.11542	0.93383	3312.27	2022-09-04T19:40:01	2022-09-04T15:36:46	Rev1	:Executed File Update:	None
Perspecta-IUB	0.33807	0.07182	0.11561	0.92052	2800.66	2022-09-02T11:00:02	2022-09-02T05:24:14	Rev1	:Executed File Update:	None
TrinitySRITrojAI-BostonU	0.46373	0.07871	0.15107	0.85976	4846.82	2022-08-25T14:00:01	2022-08-25T13:50:19	Rev1	:Executed File Update:	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
TrinitySRITrojAI	0.46254	0.07874	0.15057	0.8613	5302.79	2022-07-28T03:50:01	2022-07-28T03:46:36	Rev1	:Executed File Update:	:Cleanup:
TrinitySRITrojAI	0.55614	0.16702	0.16426	0.84491	4994.49	2022-08-01T20:00:01	2022-08-01T19:51:21	Rev1	:Executed File Update:	:Cleanup:
TrinitySRITrojAI	0.39268	0.08522	0.12732	0.90181	3501.73	2022-08-08T23:10:01	2022-08-08T23:08:01	Rev1	:Executed File Update:	:Cleanup:
TrinitySRITrojAI	0.38327	0.06971	0.11866	0.9157	9072.04	2022-08-11T06:50:02	2022-08-11T06:41:58	Rev1	:Executed File Update:	:Cleanup:
TrinitySRITrojAI	0.34193	0.09211	0.11231	0.92689	9247.52	2022-08-27T06:00:01	2022-08-27T05:58:46	Rev1	:Executed File Update:	:Cleanup:
TrinitySRITrojAI	0.37083	0.10742	0.11905	0.92342	9210.02	2022-09-07T04:50:02	2022-09-07T04:34:50	Rev1	:Executed File Update:	:Cleanup:
TrinitySRITrojAI	0.38787	0.10167	0.12221	0.90201	15769.88	2022-09-09T20:00:01	2022-09-09T19:54:15	Rev1	:Executed File Update:	:Cleanup:
TrinitySRITrojAI	0.38999	0.10317	0.12272	0.91088	15906.08	2022-09-23T05:40:05	2022-09-23T05:32:01	Rev1	None	:Cleanup:
ICSI-2	0.48649	0.06557	0.1607	0.89487	1524.68	2022-07-28T21:00:02	2022-07-28T20:56:51	Rev1	:Executed File Update:	:Container Parameters (jsonschema checker):
ICSI-2	0.40334	0.08355	0.12805	0.90702	1624.97	2022-07-29T23:20:01	2022-07-29T23:12:21	Rev1	:Executed File Update:	None
ICSI-2	0.38377	0.07245	0.1197	0.92689	1590.65	2022-08-03T03:20:01	2022-08-03T03:17:09	Rev1	:Executed File Update:	None
ICSI-2	0.37457	0.07378	0.11572	0.92766	1637.77	2022-08-05T00:40:01	2022-08-05T00:39:34	Rev1	:Executed File Update:	None
ICSI-2	0.35959	0.07624	0.11021	0.9402	1733.94	2022-08-09T01:00:01	2022-08-09T00:52:50	Rev1	:Executed File Update:	None
ICSI-2	0.34165	0.09282	0.10993	0.94483	1646.77	2022-08-09T07:00:02	2022-08-09T05:59:27	Rev1	:Executed File Update:	None
ICSI-2	0.52083	0.21233	0.13648	0.94715	1772.23	2022-08-09T23:50:01	2022-08-09T23:47:56	Rev1	:Executed File Update:	None
ICSI-2	0.34975	0.10279	0.11354	0.94039	1681.95	2022-08-10T22:50:02	2022-08-10T22:12:01	Rev1	:Executed File Update:	None
ICSI-2	0.34379	0.09267	0.11025	0.94406	1637.77	2022-08-11T05:30:02	2022-08-11T05:29:28	Rev1	:Executed File Update:	None
ICSI-2	0.35473	0.10238	0.11388	0.94059	1765.15	2022-08-11T21:30:01	2022-08-11T21:22:33	Rev1	:Executed File Update:	None
ICSI-2	0.34055	0.08735	0.1068	0.94078	2086.22	2022-08-16T14:50:01	2022-08-16T14:49:40	Rev1	:Executed File Update:	None
ICSI-2	0.34224	0.09618	0.11019	0.94213	1689.84	2022-08-22T23:50:01	2022-08-22T23:41:20	Rev1	:Executed File Update:	None
ICSI-2	0.33164	0.09464	0.10578	0.94502	1665.71	2022-08-23T05:50:01	2022-08-23T00:03:15	Rev1	:Executed File Update:	None
ICSI-2	0.34175	0.08927	0.10837	0.94194	1775.17	2022-08-23T11:50:01	2022-08-23T07:14:37	Rev1	:Executed File Update:	None
ICSI-2	0.33198	0.09391	0.10664	0.94734	1934.52	2022-09-02T10:10:01	2022-09-02T10:03:39	Rev1	:Executed File Update:	None
Perspecta-PurdueRutgers	0.35093	0.11059	0.09703	0.87789	52594.69	2022-07-29T01:00:02	2022-07-29T00:52:14	Rev1	:Executed File Update:	None
Perspecta-PurdueRutgers	0.34166	0.11264	0.09257	0.87539	52752.66	2022-08-19T23:20:01	2022-08-19T23:13:07	Rev1	:Executed File Update:	None
Perspecta-PurdueRutgers	0.32377	0.11454	0.08314	0.87558	52821.91	2022-08-20T21:40:02	2022-08-20T21:32:11	Rev1	:Executed File Update:	None
Perspecta-PurdueRutgers	0.29129	0.13131	0.07822	0.92033	51374.46	2022-08-21T20:10:01	2022-08-21T20:01:40	Rev1	:Executed File Update:	None
PL-GIFT	0.37879	0.10794	0.1179	0.91011	2495.98	2022-08-09T03:50:01	2022-08-09T03:42:13	Rev1	:Executed File Update:	:Container Parameters (jsonschema checker)::Cleanup:
PL-GIFT	0.44755	0.13221	0.13604	0.89149	2489.37	2022-08-20T16:30:02	2022-08-20T16:24:23	Rev1	:Executed File Update:	:Container Parameters (jsonschema checker)::Cleanup:
PL-GIFT	0.46114	0.13969	0.14312	0.90191	2440.2	2022-09-03T16:20:02	2022-09-03T16:16:06	Rev1	:Executed File Update:	:Container Parameters (jsonschema checker)::Cleanup:
PL-GIFT	0.49975	0.12266	0.16015	0.88233	2352.8	2022-09-03T22:20:02	2022-09-03T18:33:34	Rev1	:Executed File Update:	:Container Parameters (jsonschema checker):
PL-GIFT	0.38056	0.07568	0.12486	0.91483	1423.4	2022-09-07T20:40:02	2022-09-07T20:32:17	Rev1	:Executed File Update:	None
PL-GIFT	0.35618	0.06955	0.11671	0.91715	1506.59	2022-09-08T18:20:02	2022-09-08T18:17:57	Rev1	:Executed File Update:	None
PL-GIFT	0.35137	0.06594	0.11234	0.92882	1521.68	2022-09-09T00:20:02	2022-09-08T23:46:27	Rev1	:Executed File Update:	None
Perspecta	0.41019	0.07279	0.1261	0.87587	51947.72	2022-09-05T06:40:01	2022-09-05T06:32:24	Rev1	:Executed File Update:	:Cleanup:
Perspecta	0.39859	0.06019	0.12254	0.91098	53091.01	2022-09-07T23:40:01	2022-09-07T23:39:31	Rev1	:Executed File Update:	:Cleanup:
Perspecta	0.37932	0.07821	0.12492	0.8778	53263.27	2022-09-08T13:00:01	2022-09-08T12:57:41	Rev1	:Executed File Update:	:Cleanup:
Perspecta	0.31846	0.0604	0.0964	0.93663	54015.82	2022-09-08T23:40:02	2022-09-08T23:32:13	Rev1	:Executed File Update:	:Cleanup:
Perspecta	0.3146	0.07024	0.09687	0.93403	53539.44	2022-09-20T20:00:03	2022-09-20T19:53:19	Rev1	None	:Cleanup:
TrinitySRITrojAI-SBU	0.47247	0.05356	0.15479	0.91184	2877.61	2022-09-02T23:50:02	2022-09-02T23:49:32	Rev1	:Executed File Update:	None
TrinitySRITrojAI-SBU	0.48047	0.06418	0.15882	0.89429	1566.92	2022-09-03T16:40:02	2022-09-03T16:32:39	Rev1	:Executed File Update:	None
TrinitySRITrojAI-SBU	0.38251	0.05547	0.11542	0.93383	3312.27	2022-09-04T19:40:01	2022-09-04T15:36:46	Rev1	:Executed File Update:	None
TrinitySRITrojAI-SBU	0.41837	0.06148	0.12781	0.90895	1913.21	2022-09-05T04:20:01	2022-09-05T04:10:52	Rev1	:Executed File Update:	None
Perspecta-IUB	0.39707	0.07793	0.13217	0.8968	2724.53	2022-08-21T01:10:01	2022-08-21T01:09:36	Rev1	:Executed File Update:	None
Perspecta-IUB	0.39766	0.07717	0.13371	0.89506	3329.47	2022-08-21T07:10:02	2022-08-21T04:43:25	Rev1	:Executed File Update:	None
Perspecta-IUB	0.39908	0.0848	0.1358	0.89429	3300.45	2022-08-21T13:20:01	2022-08-21T10:35:53	Rev1	:Executed File Update:	None
Perspecta-IUB	0.39354	0.0924	0.13299	0.8995	3196.38	2022-08-21T19:20:02	2022-08-21T16:09:32	Rev1	:Executed File Update:	None
Perspecta-IUB	0.39662	0.07565	0.13317	0.89545	3135.08	2022-08-22T15:50:01	2022-08-22T15:44:02	Rev1	:Executed File Update:	None
Perspecta-IUB	0.40333	0.10126	0.13752	0.89718	2585.21	2022-08-22T21:50:01	2022-08-22T17:33:07	Rev1	:Executed File Update:	None
Perspecta-IUB	0.47426	0.14006	0.15223	0.89487	2808.51	2022-09-01T21:00:02	2022-09-01T20:53:07	Rev1	:Executed File Update:	None
Perspecta-IUB	0.34869	0.07776	0.12052	0.91512	2847.77	2022-09-02T05:00:01	2022-09-02T04:52:07	Rev1	:Executed File Update:	None
Perspecta-IUB	0.33807	0.07182	0.11561	0.92052	2800.66	2022-09-02T11:00:02	2022-09-02T05:24:14	Rev1	:Executed File Update:	None
Perspecta-IUB	0.38533	0.10376	0.13302	0.90914	2797.7	2022-09-02T17:00:02	2022-09-02T14:32:45	Rev1	:Executed File Update:	None
Perspecta-IUB	0.38954	0.10647	0.13406	0.90953	2883.67	2022-09-03T00:30:02	2022-09-03T00:23:40	Rev1	:Executed File Update:	None
Perspecta-IUB	0.3635	0.0833	0.12673	0.91011	4471.47	2022-09-03T06:30:02	2022-09-03T04:12:11	Rev1	:Executed File Update:	None
Perspecta-IUB	0.36022	0.08343	0.12573	0.91223	4553.35	2022-09-20T19:20:07	2022-09-20T19:16:36	Rev1	None	None
TrinitySRITrojAI-BostonU	0.46472	0.07862	0.15138	0.85899	4904.72	2022-08-23T14:30:01	2022-08-23T14:21:31	Rev1	:Executed File Update:	None
TrinitySRITrojAI-BostonU	0.49977	0.09807	0.16339	0.83931	4879.33	2022-08-23T20:30:01	2022-08-23T17:55:58	Rev1	:Executed File Update:	None
TrinitySRITrojAI-BostonU	0.50821	0.05585	0.16422	0.8588	4924.92	2022-08-24T02:30:01	2022-08-24T00:09:32	Rev1	:Executed File Update:	None
TrinitySRITrojAI-BostonU	0.46531	0.07855	0.15148	0.85918	4919.53	2022-08-24T15:50:02	2022-08-24T15:42:02	Rev1	:Executed File Update:	None
TrinitySRITrojAI-BostonU	0.46373	0.07871	0.15107	0.85976	4846.82	2022-08-25T14:00:01	2022-08-25T13:50:19	Rev1	:Executed File Update:	None

Required filename format: "object-detection-aug2022_dev_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-aug2022, dev: 144
Execution timeout (hh:mm:ss): 1 day, 0:00:00

Teams/Jobs

Team	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DRAFFT	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UCSD	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UMBC	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojai-example	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IceTorch	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PASS	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors

Round 11 leaderboard for image classification September 2022.

Each AI is trained to perform image classification. For those AIs that have been attacked, the presence of the trigger pattern will cause the AI to reliably produce the wrong prediction. The Round 11 Training Data Download consists of 288 reference AIs (exactly 50% are poisoned) with example input data. More info here.

Example poisoned image, where the purple polygon trigger on the street sign causes misclassification.

train: The train dataset that is distributed with each round.
test: The test dataset that is sequestered/hidden, used for evaluation. Submissions here should be fully realized with complete schema and parameters.
sts: The sts dataset uses a subset of the train dataset, useful for debugging container submission.
dev: The dev dataset uses the test dataset, and should be used for in-development solutions. Schemas must be valid, but do not need to be complete. Results do not count towards the program.

train test sts dev

Required filename format: "image-classification-sep2022_train_<Submission Name>.simg"
Accepting submissions: True
Number of models in image-classification-sep2022, train: 288
Execution timeout (hh:mm:ss): 2 days, 0:00:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2022-12-16T20:20:05	performer	None	None	Ok	2022-12-16T20:11:50	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-02-11T00:50:06	performer	None	None	Ok	2023-02-11T00:41:33	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-10T17:00:12	performer	None	None	Ok	2023-10-10T16:58:42	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-02-14T15:40:09	performer	None	None	Ok	2023-02-14T15:35:48	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2022-10-15T04:00:30	performer	None	None	Ok	2022-10-14T21:09:47	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2022-12-13T20:02:37	performer	None	None	Ok	2022-12-13T18:42:57	0 d, 0 h, 0 m, 0 s
ARM	2023-04-04T18:00:16	performer	None	None	Ok	2023-04-04T18:00:08	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	2022-12-14T22:01:34	performer	None	None	Ok	2022-12-14T21:06:01	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2022-12-15T07:10:21	performer	None	None	Ok	2022-12-15T07:07:27	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-01-20T21:40:24	performer	None	None	Ok	2023-01-20T21:31:11	0 d, 0 h, 0 m, 0 s
trojai-example	2022-09-21T17:30:13	public	None	None	Ok	2022-09-21T17:28:50	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS	2022-12-01T15:01:55	public	None	None	Ok	2022-12-01T13:44:48	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2022-11-04T14:43:29	performer	None	None	Ok	2022-11-03T20:20:40	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.05764	0.01556	0.01155	1.0	2874.81	2022-11-16T19:00:04	2022-11-16T18:58:52	Rev1	None	None
TrinitySRITrojAI	0.26087	0.03077	0.0695	0.9824	19119.35	2023-02-11T00:50:06	2023-02-11T00:41:33	Rev1	None	None
PL-GIFT	0.05384	0.00709	0.00561	1.0	1936.0	2022-09-23T22:10:06	2022-09-23T22:01:36	Rev1	None	None
Perspecta-PurdueRutgers	0.0059	0.00281	0.00056	1.0	4245.64	2023-02-12T22:30:08	2023-02-12T22:25:15	Rev1	None	None
Perspecta-IUB	0.24616	0.0205	0.06302	1.0	49831.94	2022-10-06T23:40:09	2022-10-06T23:35:08	Rev1	None	None
ARM-UCSD	0.45631	0.09297	0.13778	0.84028	5883.57	2022-10-07T18:20:09	2022-10-07T18:15:51	Rev1	None	None
ARM	0.36728	0.059	0.11325	0.92173	2487.37	2023-04-04T18:00:16	2023-04-04T18:00:08	Rev1	None	None
TrinitySRITrojAI-SBU	0.14241	0.02393	0.04022	1.0	3079.61	2022-12-12T23:41:20	2022-12-12T23:38:50	Rev1	None	None
ICSI-2	0.05754	0.00475	0.00447	1.0	3426.85	2022-10-04T04:50:25	2022-10-04T04:43:13	Rev1	None	None
TrinitySRITrojAI-BostonU	0.76753	0.52443	0.02778	0.97222	3033.72	2022-12-10T01:10:22	2022-12-10T01:04:54	Rev1	None	None
trojai-example	0.95798	0.09962	0.32408	0.47921	3412.55	2022-09-21T17:30:13	2022-09-21T17:28:50	Rev1	None	None
IIECAS	0.88354	0.12137	0.29333	0.64583	75608.21	2022-12-01T15:01:55	2022-12-01T13:44:48	Rev1	None	None
UMBCb	0.49955	0.02726	0.16128	0.89328	3656.39	2022-10-31T19:10:23	2022-10-31T19:00:37	Rev1	None	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.6652	0.04391	0.23816	0.64521	2984.18	2022-10-13T03:30:03	2022-10-13T03:20:12	Rev1	None	None
Perspecta	0.80193	0.1474	0.237	0.70255	2855.94	2022-10-18T05:20:03	2022-10-18T05:11:57	Rev1	:Container File Missing:	None
Perspecta	1.33425	0.17995	0.38552	0.51374	2720.75	2022-10-18T17:30:03	2022-10-18T17:23:07	Rev1	:Container File Missing:	None
Perspecta	0.65184	0.04655	0.23064	0.65625	2715.51	2022-10-19T00:00:04	2022-10-18T23:56:57	Rev1	:Container File Missing:	None
Perspecta	0.62086	0.04185	0.21855	0.69715	2720.72	2022-10-19T18:10:04	2022-10-19T18:02:05	Rev1	:Container File Missing:	None
Perspecta	0.62212	0.04065	0.21871	0.69411	2697.39	2022-10-19T21:00:04	2022-10-19T20:53:59	Rev1	:Container File Missing:	None
Perspecta	0.59835	0.04744	0.20777	0.74093	2698.45	2022-10-19T23:40:03	2022-10-19T23:33:06	Rev1	:Container File Missing:	None
Perspecta	0.21427	0.05219	0.06112	0.97208	2831.66	2022-10-26T14:40:04	2022-10-26T14:32:03	Rev1	:Container File Missing:	None
Perspecta	0.12382	0.03737	0.02857	0.99175	2773.57	2022-10-27T00:50:03	2022-10-27T00:44:13	Rev1	:Container File Missing:	None
Perspecta	0.26149	0.12254	0.04851	0.96832	2764.53	2022-10-27T04:20:03	2022-10-27T04:15:11	Rev1	:Container File Missing:	None
Perspecta	0.18326	0.04828	0.05197	0.98172	2785.87	2022-10-27T15:40:04	2022-10-27T15:38:34	Rev1	:Container File Missing:	None
Perspecta	0.09854	0.03075	0.02451	0.99788	2762.58	2022-10-28T23:30:03	2022-10-28T23:22:21	Rev1	:Container File Missing:	None
Perspecta	0.11793	0.03488	0.03162	0.99696	2807.55	2022-11-02T18:04:43	2022-11-02T17:56:09	Rev1	None	None
Perspecta	0.11007	0.03466	0.02755	0.99614	2864.94	2022-11-07T21:10:05	2022-11-07T21:04:58	Rev1	None	None
Perspecta	0.09311	0.03294	0.02288	0.99735	2842.02	2022-11-15T04:00:04	2022-11-15T03:50:54	Rev1	None	None
Perspecta	0.07973	0.0299	0.02103	0.99918	2874.05	2022-11-16T01:20:04	2022-11-16T01:16:33	Rev1	None	None
Perspecta	0.05764	0.01556	0.01155	1.0	2874.81	2022-11-16T19:00:04	2022-11-16T18:58:52	Rev1	None	None
Perspecta	0.09848	0.03445	0.02498	0.99754	2866.06	2022-11-16T21:10:04	2022-11-16T21:09:20	Rev1	None	None
Perspecta	0.10029	0.01762	0.0194	1.0	2884.42	2022-11-17T22:30:04	2022-11-17T22:23:07	Rev1	None	None
Perspecta	0.09066	0.03062	0.02072	0.99913	2881.75	2022-11-22T05:20:04	2022-11-22T05:17:14	Rev1	None	None
Perspecta	0.10967	0.03244	0.02618	0.99532	2700.33	2022-11-22T07:30:04	2022-11-22T07:22:56	Rev1	None	None
Perspecta	0.06669	0.01045	0.00978	1.0	14760.75	2022-11-29T07:40:04	2022-11-29T07:38:19	Rev1	None	None
Perspecta	0.08064	0.02369	0.01815	0.99957	14762.07	2022-11-29T15:50:05	2022-11-29T15:43:06	Rev1	None	None
Perspecta	0.06829	0.02055	0.01398	1.0	14762.68	2022-11-30T20:00:04	2022-11-30T19:50:09	Rev1	None	None
Perspecta	0.08309	0.00683	0.00886	1.0	14907.68	2022-12-01T05:20:04	2022-12-01T05:16:29	Rev1	None	None
Perspecta	0.08545	0.00708	0.00926	1.0	15082.17	2022-12-01T16:50:09	2022-12-01T16:48:02	Rev1	None	None
Perspecta	0.08545	0.00708	0.00926	1.0	3681.39	2022-12-04T00:00:05	2022-12-02T03:25:52	Rev1	None	None
Perspecta	0.08577	0.00682	0.00912	1.0	4218.69	2022-12-05T20:20:04	2022-12-05T20:15:11	Rev1	None	None
Perspecta	0.07317	0.00588	0.00686	1.0	3549.95	2022-12-06T22:20:04	2022-12-06T22:10:11	Rev1	None	None
Perspecta	0.06083	0.00526	0.00506	1.0	3550.17	2022-12-07T17:00:04	2022-12-07T16:55:59	Rev1	None	None
Perspecta	0.06199	0.0053	0.00519	1.0	3540.36	2022-12-08T16:00:05	2022-12-08T15:58:05	Rev1	None	None
Perspecta	0.07189	0.00577	0.00661	1.0	3559.78	2022-12-13T04:50:05	2022-12-13T04:43:43	Rev1	None	None
Perspecta	0.07189	0.00577	0.00661	1.0	3790.52	2022-12-13T06:40:04	2022-12-13T06:33:35	Rev1	None	None
Perspecta	0.05412	0.00591	0.00463	1.0	3838.64	2022-12-13T16:00:04	2022-12-13T15:56:25	Rev1	None	None
Perspecta	0.05412	0.00591	0.00463	1.0		2022-12-13T21:50:05	2022-12-13T20:15:00	Rev1	:No Results::Info File Missing::Container File Missing:	None
Perspecta	0.00819	0.00206	0.00036	1.0		2022-12-14T00:40:04	2022-12-14T00:39:29	Rev1	:No Results::Info File Missing::Container File Missing:	None
Perspecta	0.15641	0.0192	0.03243	0.99923	3869.33	2022-12-14T17:30:05	2022-12-14T17:24:00	Rev1	None	None
Perspecta	0.07129	0.00614	0.00674	1.0	3795.97	2022-12-14T19:00:05	2022-12-14T18:55:54	Rev1	None	None
Perspecta	0.06694	0.00561	0.00592	1.0	3547.04	2022-12-15T01:20:05	2022-12-15T01:18:57	Rev1	None	None
Perspecta	0.00711	0.00099	0.00012	1.0	2981.85	2022-12-15T06:20:04	2022-12-15T06:11:21	Rev1	None	None
Perspecta	0.00676	0.00086	0.0001	1.0	2981.53	2022-12-15T22:10:05	2022-12-15T21:55:42	Rev1	None	None
Perspecta	0.00827	0.00154	0.00023	1.0	2981.53	2022-12-16T15:10:05	2022-12-16T15:00:48	Rev1	None	None
Perspecta	0.00683	0.00104	0.00012	1.0	2983.06	2022-12-16T20:20:05	2022-12-16T20:11:50	Rev1	None	None
TrinitySRITrojAI	0.32043	0.02606	0.08708	0.9811	9235.16	2022-09-30T20:50:05	2022-09-30T20:43:42	Rev1	None	None
TrinitySRITrojAI	0.54917	0.02553	0.18469	0.85262	9342.89	2022-10-07T08:40:06	2022-10-07T08:37:36	Rev1	None	None
TrinitySRITrojAI	0.49442	0.05732	0.16598	0.81645	25912.92	2022-10-08T05:20:06	2022-10-08T05:19:38	Rev1	None	None
TrinitySRITrojAI	0.47598	0.05011	0.16215	0.8139	58631.5	2022-10-17T08:50:06	2022-10-17T08:43:17	Rev1	:Container File Missing:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	2511.06	2022-11-17T18:50:05	2022-11-17T18:40:23	Rev1	:No Results:	None
TrinitySRITrojAI	0.58453	0.05725	0.19929	0.76167	64127.18	2022-11-18T00:00:55	2022-11-17T23:59:38	Rev1	None	None
TrinitySRITrojAI	0.50605	0.07226	0.16571	0.83357	115875.25	2022-12-13T01:10:06	2022-12-13T01:04:46	Rev1	None	None
TrinitySRITrojAI	0.33744	0.05843	0.10514	0.92385	170469.96	2023-01-18T17:20:06	2023-01-18T17:13:22	Rev1	None	None
TrinitySRITrojAI	0.26087	0.03077	0.0695	0.9824	19119.35	2023-02-11T00:50:06	2023-02-11T00:41:33	Rev1	None	None
PL-GIFT	0.05384	0.00709	0.00561	1.0	1936.0	2022-09-23T22:10:06	2022-09-23T22:01:36	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2022-10-12T15:10:08	2022-10-12T15:01:57	Rev1	:Info File Missing::Container File Missing:	None
PL-GIFT	0.06802	0.00735	0.00743	1.0	15352.97	2022-10-13T12:00:07	2022-10-13T11:55:39	Rev1	None	None
PL-GIFT	0.05165	0.01306	0.00939	1.0	1922.36	2022-10-14T18:20:08	2022-10-14T18:18:21	Rev1	None	None
PL-GIFT	0.05165	0.01306	0.00939	1.0	1914.95	2022-10-15T05:10:18	2022-10-15T01:10:08	Rev1	None	None
PL-GIFT	0.04584	0.01273	0.00858	1.0	2499.8	2022-10-25T23:40:07	2022-10-25T23:31:47	Rev1	:Container File Missing:	None
PL-GIFT	0.10749	0.02444	0.02664	0.9999	2016.56	2022-11-04T23:30:07	2022-11-04T23:20:37	Rev1	None	None
PL-GIFT	0.03642	0.01337	0.00779	0.99983	2499.44	2022-11-07T17:10:08	2022-11-07T17:10:02	Rev1	None	None
PL-GIFT	0.1386	0.0348	0.03823	0.98756	2483.46	2022-11-09T23:10:08	2022-11-09T23:03:07	Rev1	None	None
PL-GIFT	0.02219	0.00408	0.00143	1.0	2494.6	2022-11-11T19:20:07	2022-11-11T19:19:08	Rev1	None	None
PL-GIFT	0.02552	0.0107	0.00512	1.0	2494.44	2022-11-11T23:10:07	2022-11-11T23:09:05	Rev1	None	None
PL-GIFT	0.03153	0.01287	0.00704	1.0		2022-11-15T17:40:09	2022-11-15T17:33:52	Rev1	:No Results::Info File Missing::Container File Missing:	None
PL-GIFT	0.03935	0.01148	0.00692	1.0		2022-11-15T20:20:45	2022-11-15T20:17:08	Rev1	:No Results::Info File Missing::Container File Missing:	None
PL-GIFT	0.06478	0.02366	0.01772	0.99995	2465.8	2022-11-15T23:50:08	2022-11-15T23:45:59	Rev1	None	None
PL-GIFT	0.0119	0.001	0.00021	1.0	2596.85	2022-12-15T15:50:08	2022-12-15T15:46:42	Rev1	None	None
PL-GIFT	0.0119	0.001	0.00021	1.0	2682.49	2022-12-20T19:08:06	2022-12-20T18:19:32	Rev1	None	None
PL-GIFT	0.01005	0.0	0.0001	1.0	1530.02	2023-10-09T23:15:49	2023-10-09T23:01:38	Rev1	None	None
PL-GIFT	0.02806	0.00781	0.00379	1.0	1544.88	2023-10-10T03:50:14	2023-10-10T03:46:34	Rev1	None	None
PL-GIFT	0.01005	0.0	0.0001	1.0	1538.39	2023-10-10T04:40:13	2023-10-10T04:36:35	Rev1	None	None
PL-GIFT	0.016	0.00232	0.0006	1.0	1551.86	2023-10-10T05:54:05	2023-10-10T05:49:55	Rev1	None	None
PL-GIFT	0.03438	0.01015	0.00581	1.0	1556.47	2023-10-10T14:30:13	2023-10-10T14:25:23	Rev1	None	None
PL-GIFT	0.11644	0.02551	0.02917	0.99759	1421.75	2023-10-10T15:22:02	2023-10-10T15:15:59	Rev1	None	None
PL-GIFT	0.01231	0.00125	0.00026	1.0	1433.13	2023-10-10T17:00:12	2023-10-10T16:58:42	Rev1	None	None
Perspecta-PurdueRutgers	0.3668	0.08189	0.10528	0.88129	100934.45	2022-10-03T08:20:08	2022-10-03T08:18:13	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.39643	0.08497	0.11582	0.871	101643.48	2022-10-04T22:40:07	2022-10-04T22:39:49	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.39643	0.08497	0.11582	0.871	101635.92	2022-10-06T23:30:22	2022-10-05T19:54:06	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.43815	0.08725	0.13387	0.87461	66302.31	2022-10-14T10:00:08	2022-10-14T09:52:56	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.46545	0.09003	0.14429	0.86574	126878.95	2022-10-15T15:20:09	2022-10-15T15:12:56	Rev1	:Container File Missing:	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.25688	0.07209	0.06897	0.9396	76308.23	2022-10-18T06:50:22	2022-10-18T06:41:35	Rev1	:Container File Missing:	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.29374	0.06724	0.07936	0.92559	78379.77	2022-10-24T01:40:09	2022-10-24T01:34:56	Rev1	:Container File Missing:	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.43148	0.02807	0.13377	0.92848	2981.71	2022-11-04T15:20:09	2022-11-04T15:17:23	Rev1	None	None
Perspecta-PurdueRutgers	0.31626	0.0699	0.08773	0.91194		2022-11-04T20:40:10	2022-11-04T20:30:10	Rev1	:No Results::Info File Missing::Container File Missing:	None
Perspecta-PurdueRutgers	0.40957	0.02701	0.12395	0.9362		2022-11-06T21:00:08	2022-11-06T20:52:56	Rev1	:No Results::Info File Missing::Container File Missing:	None
Perspecta-PurdueRutgers	0.31922	0.08142	0.08794	0.91194		2022-11-08T19:40:09	2022-11-08T19:33:41	Rev1	:No Results::Info File Missing::Container File Missing:	None
Perspecta-PurdueRutgers	0.58514	0.01752	0.19835	0.85286		2022-11-11T17:20:08	2022-11-11T17:17:24	Rev1	:No Results::Info File Missing::Container File Missing:	None
Perspecta-PurdueRutgers	0.43884	0.06778	0.14517	0.87442	2567.7	2022-11-15T23:30:10	2022-11-15T23:21:05	Rev1	None	None
Perspecta-PurdueRutgers	0.93707	0.45288	0.14834	0.8534	2553.35	2022-11-16T05:00:08	2022-11-16T04:53:47	Rev1	None	None
Perspecta-PurdueRutgers	0.45463	0.06882	0.14889	0.86685	2549.1	2022-11-16T16:40:09	2022-11-16T16:36:52	Rev1	None	None
Perspecta-PurdueRutgers	0.43417	0.07036	0.14703	0.86685	2561.35	2022-11-17T02:00:07	2022-11-17T01:55:49	Rev1	None	None
Perspecta-PurdueRutgers	0.43178	0.07048	0.14644	0.86685	2502.94	2022-11-17T03:10:07	2022-11-17T03:09:26	Rev1	None	None
Perspecta-PurdueRutgers	0.41234	0.06165	0.14182	0.86772	2556.15	2022-11-17T04:41:19	2022-11-17T04:34:55	Rev1	None	None
Perspecta-PurdueRutgers	0.43116	0.04782	0.14813	0.85103	2508.91	2022-11-19T00:30:08	2022-11-18T21:26:33	Rev1	None	None
Perspecta-PurdueRutgers	0.42961	0.04791	0.14768	0.85103	2506.02	2022-11-19T02:01:15	2022-11-19T01:55:52	Rev1	None	None
Perspecta-PurdueRutgers	0.43561	0.04748	0.14917	0.85103	2519.24	2022-11-19T04:20:08	2022-11-19T04:10:44	Rev1	None	None
Perspecta-PurdueRutgers	2.2046	0.73973	0.19988	0.8124	2655.9	2022-12-10T03:50:08	2022-12-10T03:46:14	Rev1	None	None
Perspecta-PurdueRutgers	0.42526	0.04278	0.14598	0.84852	2648.54	2022-12-10T15:24:54	2022-12-10T14:40:50	Rev1	None	None
Perspecta-PurdueRutgers	0.32271	0.04188	0.11464	0.90799	2492.82	2022-12-11T16:40:09	2022-12-11T16:38:53	Rev1	None	None
Perspecta-PurdueRutgers	0.34056	0.0408	0.1184	0.90794	2491.88	2022-12-11T18:00:08	2022-12-11T18:00:18	Rev1	None	None
Perspecta-PurdueRutgers	0.30558	0.0381	0.10536	0.92704	2981.12	2022-12-11T21:50:09	2022-12-11T21:45:59	Rev1	None	None
Perspecta-PurdueRutgers	0.27909	0.03636	0.09492	0.94444	2496.9	2022-12-12T04:00:08	2022-12-12T03:53:37	Rev1	None	None
Perspecta-PurdueRutgers	0.34297	0.03023	0.10271	0.94444	2495.89	2022-12-12T06:20:08	2022-12-12T06:15:01	Rev1	None	None
Perspecta-PurdueRutgers	0.49666	0.03487	0.17468	0.76365	2497.62	2022-12-12T21:50:09	2022-12-12T21:09:20	Rev1	None	None
Perspecta-PurdueRutgers	0.18362	0.1916	0.02894	0.99166	4302.94	2023-02-06T02:00:08	2023-02-06T01:57:01	Rev1	None	None
Perspecta-PurdueRutgers	0.48216	0.03681	0.17301	0.76389	3335.57	2023-02-09T21:20:10	2023-02-09T21:15:24	Rev1	None	None
Perspecta-PurdueRutgers	0.48547	0.03766	0.17372	0.76374	3390.32	2023-02-09T22:30:10	2023-02-09T22:27:54	Rev1	None	None
Perspecta-PurdueRutgers	0.46307	0.0376	0.16676	0.77778	3176.61	2023-02-12T02:30:09	2023-02-12T02:29:10	Rev1	None	None
Perspecta-PurdueRutgers	0.46556	0.03723	0.167	0.77778	3641.39	2023-02-12T04:10:09	2023-02-12T04:02:07	Rev1	None	None
Perspecta-PurdueRutgers	0.0059	0.00281	0.00056	1.0	4245.64	2023-02-12T22:30:08	2023-02-12T22:25:15	Rev1	None	None
Perspecta-PurdueRutgers	0.02781	0.01691	0.00747	0.99986	4209.3	2023-02-13T00:40:09	2023-02-13T00:38:47	Rev1	None	None
Perspecta-PurdueRutgers	0.02801	0.01691	0.00749	0.99986	4242.56	2023-02-14T15:40:09	2023-02-14T15:35:48	Rev1	None	None
Perspecta-IUB	0.24616	0.0205	0.06302	1.0	49831.94	2022-10-06T23:40:09	2022-10-06T23:35:08	Rev1	None	None
Perspecta-IUB	0.23145	0.01981	0.0576	0.99995	41884.97	2022-10-07T14:00:09	2022-10-07T03:35:32	Rev1	None	None
Perspecta-IUB	0.01537	0.0062	0.00234	1.0	42205.08	2022-10-08T02:30:09	2022-10-08T02:23:53	Rev1	None	None
Perspecta-IUB	0.02305	0.01443	0.00543	0.99981	41364.65	2022-10-08T12:40:31	2022-10-08T04:37:48	Rev1	None	None
Perspecta-IUB	0.33401	0.00656	0.08135	0.99995	41703.38	2022-10-08T21:40:30	2022-10-08T18:08:16	Rev1	None	None
Perspecta-IUB	0.3314	0.00559	0.08016	1.0	41492.89	2022-10-09T06:30:35	2022-10-08T23:24:10	Rev1	None	None
Perspecta-IUB	0.22543	0.01824	0.05413	1.0	42087.76	2022-10-09T17:40:08	2022-10-09T17:30:28	Rev1	None	None
Perspecta-IUB	0.16931	0.0255	0.04101	0.99445	44000.76	2022-10-10T02:30:33	2022-10-09T22:35:57	Rev1	None	None
Perspecta-IUB	0.10872	0.02994	0.03099	0.99489	42151.94	2022-10-10T15:20:09	2022-10-10T15:11:15	Rev1	None	None
Perspecta-IUB	0.12328	0.02697	0.03342	0.99532	5536.52	2022-10-11T00:10:31	2022-10-10T18:15:05	Rev1	None	None
Perspecta-IUB	0.18142	0.02512	0.04338	0.99421	5557.0	2022-10-11T02:20:08	2022-10-11T02:13:19	Rev1	None	None
Perspecta-IUB	0.16654	0.0229	0.0383	0.9972	6644.42	2022-10-11T03:40:31	2022-10-11T03:02:15	Rev1	None	None
Perspecta-IUB	0.17701	0.02285	0.04105	0.99711	6695.53	2022-10-11T17:40:09	2022-10-11T17:23:06	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2022-10-11T19:20:09	2022-10-11T19:13:18	Rev1	:Info File Missing::Container File Missing:	None
Perspecta-IUB	0.20619	0.018	0.0461	0.9999	54700.54	2022-10-12T21:00:20	2022-10-12T18:57:51	Rev1	None	None
Perspecta-IUB	0.2183	0.01802	0.05042	0.99995	53655.09	2022-10-13T09:40:24	2022-10-12T23:53:26	Rev1	None	None
Perspecta-IUB	0.21104	0.01674	0.04715	1.0	54386.04	2022-10-14T01:50:10	2022-10-13T23:08:43	Rev1	None	None
Perspecta-IUB	0.2008	0.01702	0.04374	1.0	54506.62	2022-10-14T13:20:33	2022-10-14T06:51:18	Rev1	None	None
Perspecta-IUB	0.19169	0.01818	0.04159	0.99986	54738.46	2022-10-15T04:00:30	2022-10-14T21:09:47	Rev1	None	None
ARM-UCSD	0.55305	0.079	0.18167	0.79167	5683.8	2022-10-07T06:10:11	2022-10-07T06:05:34	Rev1	None	None
ARM-UCSD	0.45631	0.09297	0.13778	0.84028	5883.57	2022-10-07T18:20:09	2022-10-07T18:15:51	Rev1	None	None
ARM-UCSD	0.60889	0.10666	0.19333	0.77083	32650.77	2022-10-12T21:00:21	2022-10-11T23:57:30	Rev1	None	None
ARM-UCSD	1.20397	0.12688	0.41	0.5	3367.51	2022-11-01T16:10:12	2022-11-01T16:04:02	Rev1	None	None
ARM-UCSD	1.03396	0.10085	0.37355	0.5		2022-12-13T18:50:13	2022-12-13T18:42:57	Rev1	:No Results::Info File Missing::Container File Missing:	None
ARM-UCSD	1.03396	0.10085	0.37355	0.5		2022-12-13T18:50:14	2022-12-13T18:50:47	Rev1	:No Results::Info File Missing::Container File Missing:	None
ARM-UCSD	1.03396	0.10085	0.37355	0.5		2022-12-13T20:02:37	2022-12-13T18:42:57	Rev1	:Executed File Update::No Results::Info File Missing::Container File Missing:	None
ARM	0.69315	0.0	0.25	0.5	1829.04	2022-10-03T07:00:12	2022-10-03T06:55:39	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5	2936.19	2022-10-04T18:40:14	2022-10-04T18:31:54	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5	3178.67	2022-10-12T21:40:11	2022-10-12T21:36:43	Rev1	None	None
ARM	0.64633	0.01447	0.22789	0.6543	3180.82	2022-10-17T18:20:10	2022-10-17T18:11:32	Rev1	:Container File Missing:	None
ARM	0.69315	0.0	0.25	0.5	2695.53	2022-11-01T05:50:13	2022-11-01T06:58:02	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5	2702.23	2022-11-01T19:20:12	2022-11-01T19:16:09	Rev1	None	None
ARM	0.52828	0.04556	0.17645	0.8255	4134.8	2022-11-01T21:10:13	2022-11-01T21:08:20	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5	2700.2	2022-11-02T00:10:51	2022-11-01T19:16:09	Rev1	None	None
ARM	0.59672	0.02598	0.20403	0.78016	14892.7	2022-11-28T05:10:15	2022-11-28T05:03:33	Rev1	None	None
ARM	0.36728	0.059	0.11325	0.92173	2487.37	2023-04-04T18:00:16	2023-04-04T18:00:08	Rev1	None	None
TrinitySRITrojAI-SBU	0.2078	0.03321	0.06981	0.99851	14851.38	2022-11-29T18:50:17	2022-11-29T18:45:10	Rev1	None	None
TrinitySRITrojAI-SBU	0.14241	0.02393	0.04022	1.0	3079.61	2022-12-12T23:41:20	2022-12-12T23:38:50	Rev1	None	None
TrinitySRITrojAI-SBU	0.16352	0.01118	0.02766	1.0	3290.81	2022-12-13T02:50:17	2022-12-13T02:45:02	Rev1	None	None
TrinitySRITrojAI-SBU	0.16017	0.01098	0.02667	1.0	3582.24	2022-12-13T16:52:58	2022-12-13T16:44:35	Rev1	None	None
TrinitySRITrojAI-SBU	0.12277	0.00989	0.01743	1.0	3874.3	2022-12-14T22:01:34	2022-12-14T21:06:01	Rev1	None	None
ICSI-2	0.10749	0.00514	0.01166	1.0	6585.41	2022-09-26T03:50:13	2022-09-26T03:43:51	Rev1	None	None
ICSI-2	0.44762	0.04697	0.15718	0.84187	3512.36	2022-10-03T02:00:14	2022-10-03T01:59:58	Rev1	None	None
ICSI-2	0.05754	0.00475	0.00447	1.0	3426.85	2022-10-04T04:50:25	2022-10-04T04:43:13	Rev1	None	None
ICSI-2	0.05952	0.00476	0.00468	1.0	4259.7	2022-10-10T09:10:15	2022-10-10T09:09:08	Rev1	None	None
ICSI-2	0.05835	0.00673	0.00583	1.0	3935.69	2022-10-11T20:20:14	2022-10-11T20:11:37	Rev1	None	None
ICSI-2	0.08364	0.01985	0.01835	0.9987	4349.12	2022-10-13T01:30:13	2022-10-13T01:30:01	Rev1	None	None
ICSI-2	0.13076	0.02471	0.03505	0.99523	3984.43	2022-10-14T01:50:16	2022-10-13T20:29:39	Rev1	None	None
ICSI-2	0.16264	0.02676	0.04563	0.9947	3960.36	2022-10-14T23:20:22	2022-10-14T23:17:14	Rev1	None	None
ICSI-2	0.1081	0.02084	0.02548	0.99855	3952.7	2022-10-15T21:00:12	2022-10-15T20:53:16	Rev1	None	None
ICSI-2	0.17996	0.06299	0.05036	0.98452	3959.79	2022-10-16T05:40:13	2022-10-16T05:34:41	Rev1	None	None
ICSI-2	0.0405	0.00575	0.00349	1.0	4134.71	2022-10-25T21:20:13	2022-10-25T21:15:59	Rev1	:Container File Missing:	None
ICSI-2	0.04095	0.00654	0.00403	1.0	4612.87	2022-10-26T06:40:13	2022-10-26T06:40:02	Rev1	:Container File Missing:	None
ICSI-2	0.03098	0.00397	0.00195	1.0	3758.06	2022-11-09T18:50:18	2022-11-09T18:48:31	Rev1	None	None
ICSI-2	0.01882	0.00204	0.00064	1.0	3748.12	2022-11-14T23:30:19	2022-11-14T23:23:54	Rev1	None	None
ICSI-2	0.01882	0.00204	0.00064	1.0	3749.14	2022-11-15T03:20:58	2022-11-15T03:15:09	Rev1	None	None
ICSI-2	0.06396	0.01328	0.01167	1.0		2022-11-22T11:00:19	2022-11-22T10:58:01	Rev1	:No Results::Info File Missing::Container File Missing:	None
ICSI-2	0.05825	0.01284	0.01036	0.99995		2022-11-23T00:30:20	2022-11-23T00:27:50	Rev1	:No Results::Info File Missing::Container File Missing:	None
ICSI-2	0.0626	0.01323	0.01152	1.0	84630.15	2022-11-23T23:10:19	2022-11-23T23:07:52	Rev1	None	None
ICSI-2	0.02377	0.00326	0.00125	1.0		2022-12-13T06:22:17	2022-12-13T06:17:44	Rev1	:No Results::Info File Missing::Container File Missing:	None
ICSI-2	0.02339	0.00324	0.00123	1.0		2022-12-14T05:20:20	2022-12-14T05:19:51	Rev1	:No Results::Info File Missing::Container File Missing:	None
ICSI-2	0.04395	0.01095	0.00711	0.99995	7244.01	2022-12-15T07:10:21	2022-12-15T07:07:27	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	1539.44	2022-10-18T15:20:15	2022-10-18T15:11:05	Rev1	:Container File Missing:	None
TrinitySRITrojAI-BostonU	0.60027	0.02818	0.20945	0.69213	4557.63	2022-10-29T07:10:14	2022-10-29T07:05:21	Rev1	:Container File Missing:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2022-10-31T20:10:16	2022-10-31T20:01:29	Rev1	:Executed File Update::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.56018	0.05892	0.18865	0.818	9466.89	2022-10-31T22:10:15	2022-10-31T22:07:23	Rev1	:Log File Missing:	None
TrinitySRITrojAI-BostonU	0.56018	0.05892	0.18865	0.818	9545.42	2022-11-01T08:30:53	2022-11-01T08:15:11	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69325	0.00164	0.25005	0.5	9534.94	2022-11-01T21:20:48	2022-11-01T21:13:17	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	8e-05	0.25	0.5	9745.25	2022-11-02T02:00:18	2022-11-02T01:53:52	Rev1	None	None
TrinitySRITrojAI-BostonU	0.79041	0.06774	0.28707	0.56689	9477.14	2022-11-02T07:10:20	2022-11-02T07:04:36	Rev1	None	None
TrinitySRITrojAI-BostonU	0.80599	0.06542	0.29317	0.52353	9565.26	2022-11-02T18:30:21	2022-11-02T18:13:50	Rev1	None	None
TrinitySRITrojAI-BostonU	0.56018	0.05892	0.18865	0.818	9509.69	2022-11-03T03:40:21	2022-11-03T03:36:00	Rev1	None	None
TrinitySRITrojAI-BostonU	0.56018	0.05892	0.18865	0.818	9603.86	2022-11-06T20:04:14	2022-11-06T16:40:19	Rev1	None	None
TrinitySRITrojAI-BostonU	0.56018	0.05892	0.18865	0.818	9661.45	2022-11-07T23:21:17	2022-11-07T22:00:00	Rev1	None	None
TrinitySRITrojAI-BostonU	0.56018	0.05892	0.18865	0.818	9682.3	2022-11-15T17:00:27	2022-11-15T16:57:31	Rev1	None	None
TrinitySRITrojAI-BostonU	0.60361	0.02366	0.20746	0.77358	9525.36	2022-11-15T19:51:44	2022-11-15T17:57:00	Rev1	None	None
TrinitySRITrojAI-BostonU	2.3362	0.27657	0.48692	0.49653	5481.1	2022-12-05T20:01:37	2022-12-05T19:44:51	Rev1	None	None
TrinitySRITrojAI-BostonU	0.27732	0.09457	0.07082	0.94748	5473.0	2022-12-06T22:10:22	2022-12-06T22:08:09	Rev1	None	None
TrinitySRITrojAI-BostonU	0.76753	0.52443	0.02778	0.97222	3033.72	2022-12-10T01:10:22	2022-12-10T01:04:54	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	1806.56	2022-12-13T18:10:18	2022-12-13T18:03:31	Rev1	:No Results:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	2020.68	2023-01-20T21:40:24	2023-01-20T21:31:11	Rev1	:No Results:	None
trojai-example	0.95798	0.09962	0.32408	0.47921	3412.55	2022-09-21T17:30:13	2022-09-21T17:28:50	Rev1	None	None
IIECAS	12.3764	1.58693	0.44792	0.55208	7560.93	2022-11-17T12:30:29	2022-11-17T12:21:16	Rev1	None	None
IIECAS	1.09716	0.12628	0.37111	0.54861	116013.04	2022-11-18T12:20:26	2022-11-18T12:12:28	Rev1	None	None
IIECAS	1.00561	0.1248	0.33778	0.59028	64116.48	2022-11-27T14:00:30	2022-11-27T13:58:29	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5	14666.41	2022-11-29T02:30:30	2022-11-29T02:30:04	Rev1	:No Results:	None
IIECAS	1.02087	0.12511	0.34333	0.58333	66585.78	2022-11-30T04:11:19	2022-11-30T02:21:07	Rev1	None	None
IIECAS	0.88354	0.12137	0.29333	0.64583	75608.21	2022-12-01T15:01:55	2022-12-01T13:44:48	Rev1	None	None
UMBCb	0.49955	0.02726	0.16128	0.89328	3656.39	2022-10-31T19:10:23	2022-10-31T19:00:37	Rev1	None	None
UMBCb	7.91988	1.34209	0.40696	0.54917	5067.91	2022-11-04T14:43:29	2022-11-03T20:20:40	Rev1	None	None

Required filename format: "image-classification-sep2022_test_<Submission Name>.simg"
Accepting submissions: True
Number of models in image-classification-sep2022, test: 216
Execution timeout (hh:mm:ss): 1 day, 12:00:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2022-12-16T20:20:05	performer	None	None	Ok	2022-12-16T20:11:50	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-02-11T00:50:06	performer	None	None	Ok	2023-02-11T00:41:33	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-10T17:00:12	performer	None	None	Ok	2023-10-10T16:58:42	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-02-14T15:40:09	performer	None	None	Ok	2023-02-14T15:35:48	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2022-12-13T20:00:08	performer	None	None	Ok	2022-12-13T19:50:40	0 d, 0 h, 0 m, 0 s
ARM-UCSD		performer	None	None	Ok	2023-03-27T02:09:28	0 d, 0 h, 0 m, 0 s
ARM	2023-04-04T18:00:16	performer	None	Ok	Ok	2023-04-04T18:00:08	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU		performer	None	None	Ok	2023-01-07T21:22:48	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2022-12-15T07:10:21	performer	None	None	Ok	2022-12-15T07:07:27	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-01-20T21:40:25	performer	None	None	Ok	2023-01-20T21:34:01	0 d, 0 h, 0 m, 0 s
trojai-example	2022-09-21T17:30:13	public	None	None	Ok	2022-09-21T17:28:50	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS	2022-12-04T00:00:31	public	None	None	Ok	2022-12-02T08:08:27	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2022-11-04T14:43:29	performer	None	None	Ok	2022-11-03T20:20:40	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.32702	0.04166	0.09419	0.97145	2853.9	2022-12-14T19:00:05	2022-12-14T18:55:54	Rev1	None	None
TrinitySRITrojAI	0.41344	0.06866	0.13081	0.90106	14132.81	2023-02-11T00:50:06	2023-02-11T00:41:33	Rev1	None	None
PL-GIFT	0.10145	0.04843	0.0279	0.99588	1149.71	2023-10-09T23:15:49	2023-10-09T23:01:38	Rev1	None	None
Perspecta-PurdueRutgers	0.29024	0.06101	0.09191	0.95722	3163.07	2023-02-13T00:40:09	2023-02-13T00:38:47	Rev1	None	None
Perspecta-IUB	0.37543	0.09072	0.11553	0.92683	3170.51	2022-11-18T18:45:04	2022-11-18T17:16:35	Rev1	None	:Container Parameters (jsonschema checker):
ARM-UCSD	0.54277	0.11701	0.16926	0.80093	4421.76	2022-10-07T18:20:09	2022-10-07T18:15:51	Rev1	None	None
ARM	0.64336	0.14314	0.18768	0.80778	1840.77	2023-04-04T18:00:16	2023-04-04T18:00:08	Rev1	None	None
TrinitySRITrojAI-SBU	0.65073	0.0963	0.22046	0.74254	2946.61	2022-12-14T22:01:34	2022-12-14T21:06:01	Rev1	None	None
ICSI-2	0.30211	0.07784	0.08909	0.94496	64458.08	2022-12-13T06:22:17	2022-12-13T06:17:44	Rev1	None	None
TrinitySRITrojAI-BostonU	5.3727	1.45838	0.19444	0.80556	2280.68	2022-12-10T05:10:21	2022-12-10T05:05:16	Rev1	None	None
trojai-example	0.84173	0.10527	0.28669	0.53635	2543.89	2022-09-21T17:30:13	2022-09-21T17:28:50	Rev1	None	None
IIECAS	0.77673	0.13498	0.25444	0.69444	54445.88	2022-12-01T15:01:55	2022-12-01T13:44:48	Rev1	None	None
UMBCb	0.69034	0.0512	0.245	0.6172	2662.31	2022-10-31T19:10:23	2022-10-31T19:00:37	Rev1	None	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.69585	0.00687	0.2513	0.49537	129603.31	2022-10-03T20:40:03	2022-10-03T20:31:27	Rev1	None	:Timeout:
Perspecta	0.71976	0.08286	0.24824	0.62663	2181.47	2022-10-13T03:30:03	2022-10-13T03:20:12	Rev1	None	None
Perspecta	0.91329	0.24076	0.23932	0.69239	2143.86	2022-10-18T05:20:03	2022-10-18T05:11:57	Rev1	None	None
Perspecta	1.76118	0.32537	0.41468	0.42473	2071.51	2022-10-18T17:30:03	2022-10-18T17:23:07	Rev1	None	None
Perspecta	0.73769	0.10956	0.24833	0.63932	2035.15	2022-10-19T00:00:04	2022-10-18T23:56:57	Rev1	None	None
Perspecta	0.68774	0.09754	0.22978	0.67867	2036.43	2022-10-19T18:10:04	2022-10-19T18:02:05	Rev1	None	None
Perspecta	0.6845	0.08769	0.23123	0.67335	2034.36	2022-10-19T21:00:04	2022-10-19T20:53:59	Rev1	None	None
Perspecta	0.64453	0.07715	0.21921	0.72274	2026.29	2022-10-19T23:40:03	2022-10-19T23:33:06	Rev1	None	None
Perspecta	0.75607	0.16437	0.21981	0.76243	2114.58	2022-10-26T14:40:04	2022-10-26T14:32:03	Rev1	None	None
Perspecta	0.8982	0.23516	0.21884	0.78121	2085.55	2022-10-27T00:50:03	2022-10-27T00:44:13	Rev1	None	None
Perspecta	1.02657	0.33428	0.2214	0.77306	2079.53	2022-10-27T04:20:03	2022-10-27T04:15:11	Rev1	None	None
Perspecta	0.59227	0.09079	0.2	0.77658	2091.55	2022-10-27T15:40:04	2022-10-27T15:38:34	Rev1	None	None
Perspecta	0.4583	0.0657	0.15224	0.86111	2074.57	2022-10-28T23:30:03	2022-10-28T23:22:21	Rev1	None	None
Perspecta	0.47358	0.06943	0.15484	0.85717	2156.95	2022-11-02T18:04:43	2022-11-02T17:56:09	Rev1	None	None
Perspecta	0.38893	0.06678	0.12453	0.90475	2150.32	2022-11-07T21:10:05	2022-11-07T21:04:58	Rev1	None	None
Perspecta	0.38314	0.07537	0.1232	0.90261	2121.85	2022-11-15T04:00:04	2022-11-15T03:50:54	Rev1	None	None
Perspecta	0.41223	0.07331	0.13351	0.89112	2152.8	2022-11-16T01:20:04	2022-11-16T01:16:33	Rev1	None	None
Perspecta	0.37649	0.14735	0.09713	0.94419	2156.74	2022-11-16T19:00:04	2022-11-16T18:58:52	Rev1	None	None
Perspecta	0.37985	0.07276	0.12031	0.90574	2150.64	2022-11-16T21:10:04	2022-11-16T21:09:20	Rev1	None	None
Perspecta	0.46206	0.15627	0.11401	0.90994	2062.49	2022-11-17T22:30:04	2022-11-17T22:23:07	Rev1	None	None
Perspecta	0.36412	0.06779	0.11863	0.91572	2159.55	2022-11-22T05:20:04	2022-11-22T05:17:14	Rev1	None	None
Perspecta	0.38556	0.06515	0.12332	0.90449	2025.27	2022-11-22T07:30:04	2022-11-22T07:22:56	Rev1	None	None
Perspecta	0.39845	0.08336	0.12282	0.91084	11071.45	2022-11-29T07:40:04	2022-11-29T07:38:19	Rev1	None	None
Perspecta	0.3428	0.09285	0.09818	0.93604	11069.68	2022-11-29T15:50:05	2022-11-29T15:43:06	Rev1	None	None
Perspecta	0.34504	0.07069	0.10928	0.92961	11066.84	2022-11-30T20:00:04	2022-11-30T19:50:09	Rev1	None	None
Perspecta	0.40367	0.03316	0.12032	0.95829	11174.79	2022-12-01T05:20:04	2022-12-01T05:16:29	Rev1	None	None
Perspecta	0.35539	0.04517	0.10568	0.94822	11316.39	2022-12-01T16:50:09	2022-12-01T16:48:02	Rev1	None	None
Perspecta	0.35539	0.04517	0.10568	0.94822	2852.21	2022-12-04T00:00:05	2022-12-02T03:25:52	Rev1	None	None
Perspecta	0.35996	0.04682	0.10803	0.94624	3102.78	2022-12-05T20:20:04	2022-12-05T20:15:11	Rev1	None	None
Perspecta	0.34827	0.0418	0.1006	0.95885	2660.45	2022-12-06T22:20:04	2022-12-06T22:10:11	Rev1	None	None
Perspecta	0.35484	0.04106	0.10395	0.95705	2660.4	2022-12-07T17:00:04	2022-12-07T16:55:59	Rev1	None	None
Perspecta	0.33966	0.03792	0.09768	0.96528	2657.4	2022-12-08T16:00:05	2022-12-08T15:58:05	Rev1	None	None
Perspecta	0.33086	0.03901	0.09407	0.96734	2664.42	2022-12-13T04:50:05	2022-12-13T04:43:43	Rev1	None	None
Perspecta	0.33086	0.03901	0.09407	0.96734	2762.67	2022-12-13T06:40:04	2022-12-13T06:33:35	Rev1	None	None
Perspecta	0.3631	0.05388	0.11265	0.93047	2874.84	2022-12-13T16:00:04	2022-12-13T15:56:25	Rev1	None	None
Perspecta	0.3631	0.05388	0.11265	0.93047	2851.43	2022-12-13T21:50:05	2022-12-13T20:15:00	Rev1	None	None
Perspecta	0.48632	0.19063	0.1108	0.94367	2231.26	2022-12-14T00:40:04	2022-12-14T00:39:29	Rev1	None	None
Perspecta	0.35368	0.03905	0.10232	0.96776	2748.27	2022-12-14T17:30:05	2022-12-14T17:24:00	Rev1	None	None
Perspecta	0.32702	0.04166	0.09419	0.97145	2853.9	2022-12-14T19:00:05	2022-12-14T18:55:54	Rev1	None	None
Perspecta	0.32516	0.04197	0.09337	0.96571	2664.63	2022-12-15T01:20:05	2022-12-15T01:18:57	Rev1	None	None
Perspecta	0.27356	0.06142	0.08648	0.96609	2236.15	2022-12-15T06:20:04	2022-12-15T06:11:21	Rev1	None	None
Perspecta	0.29586	0.07533	0.09327	0.95872	2234.05	2022-12-15T22:10:05	2022-12-15T21:55:42	Rev1	None	None
Perspecta	0.26094	0.06715	0.07978	0.96811	2235.86	2022-12-16T15:10:05	2022-12-16T15:00:48	Rev1	None	None
Perspecta	0.26191	0.06434	0.08036	0.96635	2238.65	2022-12-16T20:20:05	2022-12-16T20:11:50	Rev1	None	None
TrinitySRITrojAI	0.707	0.0916	0.23573	0.68716	6866.14	2022-09-30T06:30:06	2022-09-30T06:24:28	Rev1	None	:Cleanup::Cleanup:
TrinitySRITrojAI	0.75205	0.11422	0.24401	0.68296	6865.44	2022-09-30T20:50:05	2022-09-30T20:43:42	Rev1	None	None
TrinitySRITrojAI	0.73967	0.06156	0.26013	0.60048	7017.93	2022-10-07T08:40:06	2022-10-07T08:37:36	Rev1	None	None
TrinitySRITrojAI	0.59141	0.08373	0.19756	0.76423	19243.69	2022-10-08T05:20:06	2022-10-08T05:19:38	Rev1	None	None
TrinitySRITrojAI	0.4992	0.0595	0.16927	0.81473	43071.42	2022-10-17T08:50:06	2022-10-17T08:43:17	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1813.63	2022-11-16T01:40:06	2022-11-16T01:35:44	Rev1	:No Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1887.99	2022-11-16T07:00:06	2022-11-16T06:59:01	Rev1	:No Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1816.96	2022-11-17T05:40:05	2022-11-17T05:33:04	Rev1	:No Results:	None
TrinitySRITrojAI	0.6194	0.06721	0.2151	0.72891	48083.46	2022-11-18T00:00:55	2022-11-17T23:59:38	Rev1	None	None
TrinitySRITrojAI	0.59988	0.09643	0.19629	0.78198	85772.44	2022-12-13T01:10:06	2022-12-13T01:04:46	Rev1	None	None
TrinitySRITrojAI	0.48639	0.10252	0.14782	0.85828	127683.11	2023-01-18T17:20:06	2023-01-18T17:13:22	Rev1	None	None
TrinitySRITrojAI	0.41344	0.06866	0.13081	0.90106	14132.81	2023-02-11T00:50:06	2023-02-11T00:41:33	Rev1	None	None
PL-GIFT	0.57702	0.07557	0.19379	0.78078	1429.5	2022-09-23T22:10:06	2022-09-23T22:01:36	Rev1	None	None
PL-GIFT	0.46674	0.05664	0.16051	0.84752	2038.31	2022-09-30T01:00:06	2022-09-30T00:56:52	Rev1	None	:Cleanup::Cleanup:
PL-GIFT	0.50873	0.10565	0.15658	0.85228	11566.66	2022-10-12T15:10:08	2022-10-12T15:01:57	Rev1	None	None
PL-GIFT	0.34255	0.07196	0.109	0.93261	1419.24	2022-10-14T18:20:08	2022-10-14T18:18:21	Rev1	None	None
PL-GIFT	0.7001	0.04798	0.24546	0.63906	4271.0	2022-10-20T22:00:07	2022-10-20T21:55:07	Rev1	None	:Container Parameters (jsonschema checker):
PL-GIFT	0.32598	0.07557	0.10175	0.94119	1863.26	2022-10-25T23:40:07	2022-10-25T23:31:47	Rev1	None	None
PL-GIFT	0.33886	0.09336	0.09653	0.94839	1516.36	2022-11-04T23:30:07	2022-11-04T23:20:37	Rev1	None	None
PL-GIFT	0.3101	0.09115	0.09195	0.94076	1875.68	2022-11-07T17:10:08	2022-11-07T17:10:02	Rev1	None	None
PL-GIFT	0.36153	0.08622	0.1082	0.91427	1871.2	2022-11-09T23:10:08	2022-11-09T23:03:07	Rev1	None	None
PL-GIFT	0.36958	0.09961	0.11224	0.92644	1874.25	2022-11-11T19:20:07	2022-11-11T19:19:08	Rev1	None	None
PL-GIFT	0.22401	0.07489	0.07151	0.97471	1870.67	2022-11-11T23:10:07	2022-11-11T23:09:05	Rev1	None	None
PL-GIFT	0.21259	0.06967	0.06595	0.97861	1883.08	2022-11-15T17:40:09	2022-11-15T17:33:52	Rev1	None	None
PL-GIFT	0.37087	0.11213	0.10117	0.91427	1872.44	2022-11-15T20:20:45	2022-11-15T20:17:08	Rev1	None	None
PL-GIFT	0.26396	0.07679	0.08149	0.96755	1866.32	2022-11-15T23:50:08	2022-11-15T23:45:59	Rev1	None	None
PL-GIFT	0.23528	0.10282	0.06366	0.97214	1949.04	2022-12-15T15:50:08	2022-12-15T15:46:42	Rev1	None	None
PL-GIFT	0.23425	0.10239	0.06347	0.97222	2010.96	2022-12-20T19:08:06	2022-12-20T18:19:32	Rev1	None	None
PL-GIFT	0.10145	0.04843	0.0279	0.99588	1149.71	2023-10-09T23:15:49	2023-10-09T23:01:38	Rev1	None	None
PL-GIFT	0.2305	0.07569	0.07175	0.96995	1161.14	2023-10-10T03:50:14	2023-10-10T03:46:34	Rev1	None	None
PL-GIFT	0.15154	0.05931	0.0442	0.98894	1103.41	2023-10-10T04:40:13	2023-10-10T04:36:35	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2023-10-10T05:22:41	2023-10-10T05:10:21	Rev1	:No Results::Missing Results:	:Container Parameters (jsonschema checker):
PL-GIFT	0.13755	0.05509	0.03969	0.98928	1171.78	2023-10-10T05:54:05	2023-10-10T05:49:55	Rev1	None	None
PL-GIFT	0.19401	0.06434	0.06187	0.98037	1121.07	2023-10-10T14:30:13	2023-10-10T14:25:23	Rev1	None	None
PL-GIFT	0.35994	0.09841	0.10148	0.93338	1140.28	2023-10-10T15:22:02	2023-10-10T15:15:59	Rev1	None	None
PL-GIFT	0.18219	0.07787	0.05122	0.985	1087.82	2023-10-10T17:00:12	2023-10-10T16:58:42	Rev1	None	None
Perspecta-PurdueRutgers	0.44105	0.10542	0.13222	0.84722	72513.96	2022-10-03T08:20:08	2022-10-03T08:18:13	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.42974	0.10225	0.12829	0.85742	73585.52	2022-10-04T22:40:07	2022-10-04T22:39:49	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.49211	0.10619	0.15434	0.85322	47542.29	2022-10-14T10:00:08	2022-10-14T09:52:56	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.51457	0.11011	0.16168	0.83479	98129.1	2022-10-15T15:20:09	2022-10-15T15:12:56	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.36284	0.10839	0.10061	0.89489	61710.03	2022-10-18T06:50:22	2022-10-18T06:41:35	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.33742	0.08619	0.09471	0.90008	61248.41	2022-10-24T01:40:09	2022-10-24T01:34:56	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.35812	0.07447	0.10628	0.90771	129603.41	2022-11-01T17:50:09	2022-11-01T17:42:36	Rev1	None	:Container Parameters (learned parameters)::Timeout:
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2022-11-03T13:10:09	2022-11-03T13:07:21	Rev1	:Info File Missing:	None
Perspecta-PurdueRutgers	0.65449	0.02534	0.23147	0.63597	2236.2	2022-11-04T15:20:09	2022-11-04T15:17:23	Rev1	None	None
Perspecta-PurdueRutgers	0.31039	0.07938	0.0853	0.91615	121209.15	2022-11-04T20:40:10	2022-11-04T20:30:10	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.58752	0.03242	0.20052	0.7656	1778.7	2022-11-06T21:00:08	2022-11-06T20:52:56	Rev1	None	None
Perspecta-PurdueRutgers	0.30179	0.08706	0.08387	0.91615	118130.14	2022-11-08T19:40:09	2022-11-08T19:33:41	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.67805	0.01868	0.24277	0.5769	1782.61	2022-11-11T17:20:08	2022-11-11T17:17:24	Rev1	None	None
Perspecta-PurdueRutgers	0.56947	0.07318	0.19096	0.78618	1920.95	2022-11-15T23:30:10	2022-11-15T23:21:05	Rev1	None	None
Perspecta-PurdueRutgers	0.76088	0.35207	0.185	0.8017	1914.11	2022-11-16T05:00:08	2022-11-16T04:53:47	Rev1	None	None
Perspecta-PurdueRutgers	0.57369	0.07366	0.19305	0.78892	1924.87	2022-11-16T16:40:09	2022-11-16T16:36:52	Rev1	None	None
Perspecta-PurdueRutgers	0.56123	0.07512	0.19141	0.78892	1914.21	2022-11-17T02:00:07	2022-11-17T01:55:49	Rev1	None	None
Perspecta-PurdueRutgers	0.5424	0.07689	0.18724	0.78892	1877.95	2022-11-17T03:10:07	2022-11-17T03:09:26	Rev1	None	None
Perspecta-PurdueRutgers	0.89219	0.42945	0.18875	0.76993	1889.69	2022-11-17T04:41:19	2022-11-17T04:34:55	Rev1	None	None
Perspecta-PurdueRutgers	0.50568	0.04985	0.17495	0.8101	1879.76	2022-11-19T00:30:08	2022-11-18T21:26:33	Rev1	None	None
Perspecta-PurdueRutgers	0.623	0.25074	0.17604	0.80838	1883.73	2022-11-19T02:01:15	2022-11-19T01:55:52	Rev1	None	None
Perspecta-PurdueRutgers	0.52693	0.04722	0.18031	0.8101	1885.74	2022-11-19T04:20:08	2022-11-19T04:10:44	Rev1	None	None
Perspecta-PurdueRutgers	2.56759	0.93838	0.24419	0.71438	1993.41	2022-12-10T03:50:08	2022-12-10T03:46:14	Rev1	None	None
Perspecta-PurdueRutgers	0.5276	0.04848	0.18499	0.75952	2001.14	2022-12-10T15:24:54	2022-12-10T14:40:50	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5	505.41	2022-12-11T05:00:08	2022-12-11T04:58:39	Rev1	:No Results:	None
Perspecta-PurdueRutgers	0.73057	0.34979	0.17542	0.80693	1864.96	2022-12-11T16:40:09	2022-12-11T16:38:53	Rev1	None	None
Perspecta-PurdueRutgers	0.52362	0.04142	0.17835	0.81636	1871.02	2022-12-11T18:00:08	2022-12-11T18:00:18	Rev1	None	None
Perspecta-PurdueRutgers	0.77337	0.34835	0.1873	0.79175	2235.95	2022-12-11T21:50:09	2022-12-11T21:45:59	Rev1	None	None
Perspecta-PurdueRutgers	0.62858	0.24905	0.17664	0.81653	1872.44	2022-12-12T04:00:08	2022-12-12T03:53:37	Rev1	None	None
Perspecta-PurdueRutgers	0.53599	0.03722	0.17948	0.81696	1871.43	2022-12-12T06:20:08	2022-12-12T06:15:01	Rev1	None	None
Perspecta-PurdueRutgers	0.83918	0.34713	0.21355	0.6851	1986.49	2022-12-12T21:50:09	2022-12-12T21:09:20	Rev1	None	None
Perspecta-PurdueRutgers	0.75168	0.42941	0.13487	0.90252	3218.84	2023-02-06T02:00:08	2023-02-06T01:57:01	Rev1	None	None
Perspecta-PurdueRutgers	0.56717	0.04059	0.20211	0.69342	2499.87	2023-02-09T21:20:10	2023-02-09T21:15:24	Rev1	None	None
Perspecta-PurdueRutgers	0.56355	0.03529	0.1968	0.7368	2618.25	2023-02-09T22:30:10	2023-02-09T22:27:54	Rev1	None	None
Perspecta-PurdueRutgers	0.54627	0.04517	0.1937	0.71819	2382.63	2023-02-12T02:30:09	2023-02-12T02:29:10	Rev1	None	None
Perspecta-PurdueRutgers	0.56671	0.04855	0.20142	0.70482	2795.0	2023-02-12T04:10:09	2023-02-12T04:02:07	Rev1	None	None
Perspecta-PurdueRutgers	0.81423	0.49722	0.11825	0.91701	3221.81	2023-02-12T22:30:08	2023-02-12T22:25:15	Rev1	None	None
Perspecta-PurdueRutgers	0.29024	0.06101	0.09191	0.95722	3163.07	2023-02-13T00:40:09	2023-02-13T00:38:47	Rev1	None	None
Perspecta-PurdueRutgers	0.45266	0.26014	0.10473	0.94247	3183.51	2023-02-14T15:40:09	2023-02-14T15:35:48	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	1450.22	2022-10-05T22:40:09	2022-10-05T22:38:17	Rev1	None	None
Perspecta-IUB	0.45452	0.05118	0.15329	0.88692	37485.16	2022-10-06T23:40:09	2022-10-06T23:35:08	Rev1	None	None
Perspecta-IUB	0.48582	0.05713	0.1648	0.84654	31197.94	2022-10-07T14:00:09	2022-10-07T03:35:32	Rev1	None	None
Perspecta-IUB	0.48491	0.10831	0.15727	0.87774	31816.89	2022-10-08T02:30:09	2022-10-08T02:23:53	Rev1	None	None
Perspecta-IUB	0.5696	0.1248	0.17848	0.84688	31353.94	2022-10-08T12:40:31	2022-10-08T04:37:48	Rev1	None	None
Perspecta-IUB	0.56846	0.0265	0.1904	0.84551	31110.88	2022-10-08T21:40:30	2022-10-08T18:08:16	Rev1	None	None
Perspecta-IUB	0.5535	0.02455	0.183	0.87517	31280.68	2022-10-09T06:30:35	2022-10-08T23:24:10	Rev1	None	None
Perspecta-IUB	0.46086	0.05045	0.15486	0.87852	31302.38	2022-10-09T17:40:08	2022-10-09T17:30:28	Rev1	None	None
Perspecta-IUB	0.4776	0.09831	0.14941	0.86583	33452.88	2022-10-10T02:30:33	2022-10-09T22:35:57	Rev1	None	None
Perspecta-IUB	0.77317	0.28022	0.16866	0.84971	31590.83	2022-10-10T15:20:09	2022-10-10T15:11:15	Rev1	None	None
Perspecta-IUB	0.60741	0.18245	0.16066	0.85691	4179.16	2022-10-11T00:10:31	2022-10-10T18:15:05	Rev1	None	None
Perspecta-IUB	0.46348	0.08648	0.14714	0.86763	4180.82	2022-10-11T02:20:08	2022-10-11T02:13:19	Rev1	None	None
Perspecta-IUB	0.44146	0.07907	0.14309	0.87534	4997.51	2022-10-11T03:40:31	2022-10-11T03:02:15	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2022-10-11T05:10:33	2022-10-11T04:00:25	Rev1	:Info File Missing:	None
Perspecta-IUB	0.4397	0.07606	0.14243	0.87586	4984.81	2022-10-11T17:40:09	2022-10-11T17:23:06	Rev1	None	None
Perspecta-IUB	0.46103	0.04889	0.15507	0.88392	44245.22	2022-10-11T19:20:09	2022-10-11T19:13:18	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2022-10-12T15:20:09	2022-10-12T15:10:37	Rev1	:Executed File Update::Info File Missing:	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2022-10-12T19:00:09	2022-10-12T18:57:51	Rev1	:Executed File Update::Info File Missing:	None
Perspecta-IUB	0.42076	0.04954	0.1379	0.89258	45067.73	2022-10-12T21:00:20	2022-10-12T18:57:51	Rev1	None	None
Perspecta-IUB	0.42745	0.04739	0.14082	0.8966	41399.1	2022-10-13T09:40:24	2022-10-12T23:53:26	Rev1	None	None
Perspecta-IUB	0.42878	0.04669	0.141	0.89841	40730.59	2022-10-14T01:50:10	2022-10-13T23:08:43	Rev1	None	None
Perspecta-IUB	0.42214	0.04923	0.13825	0.89352	40755.44	2022-10-14T13:20:33	2022-10-14T06:51:18	Rev1	None	None
Perspecta-IUB	0.42	0.05403	0.13757	0.88812	40810.27	2022-10-15T04:00:30	2022-10-14T21:09:47	Rev1	None	None
Perspecta-IUB	0.42	0.05403	0.13757	0.88812	41123.91	2022-11-15T17:10:08	2022-11-15T17:08:10	Rev1	None	None
Perspecta-IUB	0.65895	0.23166	0.13675	0.90218	4441.04	2022-11-17T03:50:45	2022-11-17T03:48:28	Rev1	None	:Container Parameters (jsonschema checker):
Perspecta-IUB	0.66235	0.10598	0.21817	0.74186	2593.28	2022-11-17T22:10:09	2022-11-17T22:03:12	Rev1	None	:Container Parameters (jsonschema checker):
Perspecta-IUB	0.50003	0.07657	0.16996	0.82527	2955.83	2022-11-18T04:20:09	2022-11-18T04:17:39	Rev1	None	:Container Parameters (jsonschema checker):
Perspecta-IUB	0.50283	0.13492	0.14662	0.90852	2954.72	2022-11-18T05:30:08	2022-11-18T05:26:14	Rev1	None	:Container Parameters (jsonschema checker):
Perspecta-IUB	0.37543	0.09072	0.11553	0.92683	3170.51	2022-11-18T18:45:04	2022-11-18T17:16:35	Rev1	None	:Container Parameters (jsonschema checker):
Perspecta-IUB	0.37543	0.09072	0.11553	0.92683	3377.86	2022-12-13T20:00:08	2022-12-13T19:50:40	Rev1	None	:Container Parameters (jsonschema checker):
ARM-UCSD	0.69315	0.0	0.25	0.5	1804.24	2022-10-06T22:20:09	2022-10-06T22:16:03	Rev1	None	None
ARM-UCSD	0.5556	0.09155	0.18259	0.79012	4257.3	2022-10-07T06:10:11	2022-10-07T06:05:34	Rev1	None	None
ARM-UCSD	0.54277	0.11701	0.16926	0.80093	4421.76	2022-10-07T18:20:09	2022-10-07T18:15:51	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2022-10-12T13:32:35	2022-10-11T23:57:30	Rev1	:Info File Missing:	None
ARM-UCSD	0.7157	0.13125	0.23222	0.72222	24636.71	2022-10-12T21:00:21	2022-10-11T23:57:30	Rev1	None	None
ARM-UCSD	0.7157	0.13125	0.23222	0.72222	8961.43	2022-10-13T04:00:20	2022-10-12T21:28:41	Rev1	None	None
ARM-UCSD	1.20397	0.14651	0.41	0.5	2546.13	2022-11-01T15:40:11	2022-11-01T15:33:06	Rev1	None	None
ARM-UCSD	1.20397	0.14651	0.41	0.5	2514.79	2022-11-01T20:30:11	2022-11-01T20:20:14	Rev1	None	None
ARM-UCSD	1.03396	0.11645	0.37355	0.5	2500.81	2022-12-13T18:50:14	2022-12-13T18:50:47	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-03-27T02:10:14	2023-03-27T02:09:28	Rev1	:No Results::Missing Results:	:Container Parameters (jsonschema checker):
ARM	0.69315	0.0	0.25	0.5	1375.72	2022-10-03T07:30:14	2022-10-03T07:26:20	Rev1	None	None
ARM	0.66913	0.0129	0.23838	0.59984	2388.62	2022-10-17T18:20:10	2022-10-17T18:11:32	Rev1	None	None
ARM	0.63044	0.05541	0.2192	0.71348	3099.07	2022-11-01T21:10:13	2022-11-01T21:08:20	Rev1	None	None
ARM	0.65914	0.03107	0.23323	0.65826	11174.49	2022-11-28T05:10:15	2022-11-28T05:03:33	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5		2023-03-28T04:40:17	2023-03-28T04:36:44	Rev1	:No Results::Missing Results::Info File Missing:	None
ARM	0.64336	0.14314	0.18768	0.80778	1840.77	2023-04-04T18:00:16	2023-04-04T18:00:08	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	938.16	2022-11-29T05:21:12	2022-11-29T05:13:35	Rev1	:No Results:	None
TrinitySRITrojAI-SBU	1.22432	0.23004	0.33275	0.56919	11107.06	2022-11-29T18:50:17	2022-11-29T18:45:10	Rev1	None	None
TrinitySRITrojAI-SBU	1.3413	0.2806	0.31737	0.6046	2309.73	2022-12-12T23:41:20	2022-12-12T23:38:50	Rev1	None	None
TrinitySRITrojAI-SBU	0.75486	0.08725	0.26725	0.625	2380.48	2022-12-13T02:50:17	2022-12-13T02:45:02	Rev1	None	None
TrinitySRITrojAI-SBU	0.76206	0.08831	0.26994	0.6232	2608.54	2022-12-13T16:52:58	2022-12-13T16:44:35	Rev1	None	None
TrinitySRITrojAI-SBU	0.65073	0.0963	0.22046	0.74254	2946.61	2022-12-14T22:01:34	2022-12-14T21:06:01	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-01-07T21:30:19	2023-01-07T21:22:48	Rev1	:No Results:	:Schema Header:
ICSI-2	0.49894	0.07109	0.16271	0.84135	4954.9	2022-09-26T03:50:14	2022-09-26T03:42:55	Rev1	None	None
ICSI-2	0.64325	0.08268	0.22344	0.72488	2686.94	2022-10-03T02:00:15	2022-10-03T01:59:22	Rev1	None	None
ICSI-2	0.4133	0.06463	0.13373	0.89763	2529.52	2022-10-04T04:50:26	2022-10-04T04:43:23	Rev1	None	None
ICSI-2	0.69315	0.0	0.25	0.5		2022-10-10T08:40:16	2022-10-10T08:34:46	Rev1	:Info File Missing:	None
ICSI-2	0.40322	0.06265	0.12774	0.90243	3186.55	2022-10-10T09:10:15	2022-10-10T09:09:08	Rev1	None	None
ICSI-2	0.39858	0.06644	0.12588	0.90749	2980.6	2022-10-11T20:20:14	2022-10-11T20:11:37	Rev1	None	None
ICSI-2	0.43494	0.09453	0.13357	0.89986	3297.06	2022-10-13T01:30:13	2022-10-13T01:30:01	Rev1	None	None
ICSI-2	0.46428	0.07177	0.15497	0.85957	2988.68	2022-10-14T01:50:16	2022-10-13T20:29:39	Rev1	None	None
ICSI-2	0.45526	0.06498	0.1525	0.86248	2967.65	2022-10-14T23:20:22	2022-10-14T23:17:14	Rev1	None	None
ICSI-2	0.48321	0.08619	0.15631	0.86381	2977.13	2022-10-15T21:00:12	2022-10-15T20:53:16	Rev1	None	None
ICSI-2	0.63939	0.1329	0.19874	0.82819	2980.11	2022-10-16T05:40:13	2022-10-16T05:34:41	Rev1	None	None
ICSI-2	0.39105	0.07074	0.12407	0.90826	3098.31	2022-10-25T21:20:13	2022-10-25T21:15:59	Rev1	None	None
ICSI-2	0.41841	0.0842	0.13041	0.90012	3468.91	2022-10-26T06:40:13	2022-10-26T06:40:02	Rev1	None	None
ICSI-2	0.3635	0.07566	0.11306	0.92155	2818.3	2022-11-09T18:50:18	2022-11-09T18:48:31	Rev1	None	None
ICSI-2	0.36325	0.08031	0.11263	0.92258	2808.91	2022-11-14T23:30:19	2022-11-14T23:23:54	Rev1	None	None
ICSI-2	0.36325	0.08031	0.11263	0.92258	2807.1	2022-11-15T03:20:58	2022-11-15T03:15:09	Rev1	None	None
ICSI-2	0.34572	0.07765	0.10591	0.9315	35217.68	2022-11-22T11:00:19	2022-11-22T10:58:01	Rev1	None	None
ICSI-2	0.36183	0.08154	0.11309	0.92027	11242.62	2022-11-23T00:30:20	2022-11-23T00:27:50	Rev1	None	None
ICSI-2	0.31188	0.07664	0.09225	0.9405	63796.16	2022-11-23T23:10:19	2022-11-23T23:07:52	Rev1	None	None
ICSI-2	0.69315	0.0	0.25	0.5		2022-12-04T23:50:19	2022-12-04T23:44:26	Rev1	:No Results::Info File Missing:	None
ICSI-2	0.30211	0.07784	0.08909	0.94496	64458.08	2022-12-13T06:22:17	2022-12-13T06:17:44	Rev1	None	None
ICSI-2	0.30877	0.07495	0.09598	0.94419	12486.03	2022-12-14T05:20:20	2022-12-14T05:19:51	Rev1	None	None
ICSI-2	0.30926	0.08427	0.09255	0.94333	5444.1	2022-12-15T07:10:21	2022-12-15T07:07:27	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	1158.38	2022-10-18T00:00:15	2022-10-17T23:55:05	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	1154.16	2022-10-18T00:30:24	2022-10-18T00:05:51	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69214	0.04466	0.24685	0.58616	3412.87	2022-10-29T07:10:15	2022-10-29T07:06:28	Rev1	None	None
TrinitySRITrojAI-BostonU	0.82041	0.0869	0.29204	0.56421	7086.8	2022-10-31T20:10:17	2022-10-31T20:01:29	Rev1	None	None
TrinitySRITrojAI-BostonU	0.82041	0.0869	0.29204	0.56421	7123.09	2022-11-01T08:30:54	2022-11-01T08:15:26	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0001	0.25	0.49074	7314.69	2022-11-02T02:00:19	2022-11-02T01:50:55	Rev1	None	None
TrinitySRITrojAI-BostonU	0.89365	0.0825	0.32826	0.46073	7091.41	2022-11-02T06:20:20	2022-11-02T06:13:15	Rev1	None	None
TrinitySRITrojAI-BostonU	0.98433	0.10842	0.34387	0.42601	7154.62	2022-11-02T18:30:22	2022-11-02T18:13:38	Rev1	None	None
TrinitySRITrojAI-BostonU	0.82041	0.0869	0.29204	0.56421	7104.33	2022-11-03T05:50:21	2022-11-03T05:47:16	Rev1	None	None
TrinitySRITrojAI-BostonU	0.82041	0.0869	0.29204	0.56421	7228.94	2022-11-06T20:04:15	2022-11-06T16:40:24	Rev1	None	None
TrinitySRITrojAI-BostonU	0.82041	0.0869	0.29204	0.56421	7160.91	2022-11-07T23:21:18	2022-11-07T22:00:09	Rev1	None	None
TrinitySRITrojAI-BostonU	0.82041	0.0869	0.29204	0.56421	7218.55	2022-11-15T17:30:58	2022-11-15T17:25:55	Rev1	None	None
TrinitySRITrojAI-BostonU	0.72758	0.04424	0.26281	0.53764	7197.8	2022-11-15T19:40:51	2022-11-15T17:50:14	Rev1	None	None
TrinitySRITrojAI-BostonU	1.32033	0.21143	0.36734	0.52058	4105.88	2022-12-07T02:10:22	2022-12-07T02:06:33	Rev1	None	None
TrinitySRITrojAI-BostonU	5.3727	1.45838	0.19444	0.80556	2280.68	2022-12-10T05:10:21	2022-12-10T05:05:16	Rev1	None	None
TrinitySRITrojAI-BostonU	5.3727	1.45838	0.19444	0.80556	2281.83	2022-12-10T08:00:22	2022-12-10T07:39:41	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	1274.19	2022-12-13T17:20:18	2022-12-13T17:15:18	Rev1	:No Results:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	1262.56	2022-12-14T03:33:15	2022-12-14T03:24:35	Rev1	:No Results:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	1523.75	2023-01-20T21:40:25	2023-01-20T21:34:01	Rev1	:No Results:	None
trojai-example	0.84173	0.10527	0.28669	0.53635	2543.89	2022-09-21T17:30:13	2022-09-21T17:28:50	Rev1	None	None
IIECAS	12.28046	1.83104	0.44444	0.55556	5691.78	2022-11-17T12:30:29	2022-11-17T12:21:16	Rev1	None	None
IIECAS	1.04122	0.1449	0.35074	0.57407	72411.13	2022-11-18T12:20:26	2022-11-18T12:12:28	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5		2022-11-27T12:10:30	2022-11-27T12:07:55	Rev1	:No Results::Info File Missing:	None
IIECAS	0.99035	0.14372	0.33222	0.59722	45830.48	2022-11-27T14:00:30	2022-11-27T13:58:29	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5	11044.76	2022-11-28T05:21:14	2022-11-28T05:18:08	Rev1	:No Results:	None
IIECAS	0.69315	0.0	0.25	0.5	11001.31	2022-11-28T09:30:30	2022-11-28T09:28:15	Rev1	:No Results:	None
IIECAS	0.69315	0.0	0.25	0.5	10999.59	2022-11-28T14:20:30	2022-11-28T14:16:37	Rev1	:No Results:	None
IIECAS	0.90898	0.14113	0.30259	0.63426	45553.76	2022-11-29T02:30:30	2022-11-29T02:30:04	Rev1	None	None
IIECAS	0.90898	0.14113	0.30259	0.63426	45545.31	2022-11-29T15:21:30	2022-11-29T02:59:18	Rev1	None	None
IIECAS	0.98018	0.14344	0.32852	0.60185	47294.07	2022-11-30T04:11:19	2022-11-30T02:21:07	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5	10998.42	2022-12-01T06:20:28	2022-12-01T06:14:21	Rev1	:No Results:	None
IIECAS	0.69315	0.0	0.25	0.5	11001.18	2022-12-01T11:50:30	2022-12-01T11:44:58	Rev1	:No Results:	None
IIECAS	0.77673	0.13498	0.25444	0.69444	54445.88	2022-12-01T15:01:55	2022-12-01T13:44:48	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5	1424.47	2022-12-04T00:00:31	2022-12-02T08:08:27	Rev1	:No Results:	:Container Parameters (jsonschema checker):
UMBCb	0.69034	0.0512	0.245	0.6172	2662.31	2022-10-31T19:10:23	2022-10-31T19:00:37	Rev1	None	None
UMBCb	7.60792	1.52536	0.39033	0.5799	3799.12	2022-11-04T14:43:29	2022-11-03T20:20:40	Rev1	None	None

Required filename format: "image-classification-sep2022_sts_<Submission Name>.simg"
Accepting submissions: True
Number of models in image-classification-sep2022, sts: 10
Execution timeout (hh:mm:ss): 1:40:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2022-12-29T21:00:04	performer	None	None	Ok	2022-12-29T20:51:10	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-02-10T23:50:06	performer	None	None	Ok	2023-02-10T23:47:23	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-09T22:35:12	performer	None	None	Ok	2023-10-09T22:25:15	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2022-12-11T16:20:08	performer	None	None	Ok	2022-12-11T16:12:25	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2022-10-12T13:32:33	performer	None	None	Ok	2022-10-12T00:48:36	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2023-03-27T20:10:14	performer	None	None	Ok	2023-03-27T20:06:37	0 d, 0 h, 0 m, 0 s
ARM	2023-04-04T18:00:17	performer	None	Ok	Ok	2023-04-04T17:59:46	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU		performer	None	None	Ok	2023-01-10T02:25:33	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2022-12-15T06:50:20	performer	None	None	Ok	2022-12-15T06:48:01	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2022-11-03T05:50:22	performer	None	None	Ok	2022-11-03T05:47:16	0 d, 0 h, 0 m, 0 s
trojai-example	2024-06-11T21:03:18	public	None	None	Ok	2024-06-11T21:02:09	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS	2022-11-28T14:20:31	public	None	None	Ok	2022-11-28T14:16:24	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2022-11-02T20:10:30	performer	None	None	Ok	2022-11-02T17:11:22	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.08808	0.04512	0.01099	1.0	93.74	2022-10-26T14:20:04	2022-10-26T14:12:49	Rev1	:Container File Missing:	None
TrinitySRITrojAI	0.43286	0.13095	0.13538	1.0	1064.99	2022-10-08T04:50:07	2022-10-08T04:47:28	Rev1	None	None
PL-GIFT	0.03577	0.0293	0.00308	1.0	63.61	2022-09-23T21:50:07	2022-09-23T21:43:37	Rev1	None	None
Perspecta-PurdueRutgers	0.10536	0.0	0.01	1.0	3276.01	2022-10-03T07:10:08	2022-10-03T07:03:26	Rev1	None	:Container Parameters (learned parameters):
Perspecta-IUB	0.17421	0.13729	0.048	1.0	1712.78	2022-10-06T22:50:09	2022-10-06T22:48:40	Rev1	None	None
ARM-UCSD	0.22292	0.14573	0.058	1.0	198.3	2022-10-07T06:10:12	2022-10-07T06:05:52	Rev1	None	None
ARM	0.17945	0.03395	0.02873	1.0	142.38	2022-11-28T05:10:16	2022-11-28T05:03:08	Rev1	None	None
TrinitySRITrojAI-SBU	0.3605	0.18267	0.12165	1.0	113.01	2022-11-29T18:30:17	2022-11-29T18:27:38	Rev1	None	None
ICSI-2	0.10425	0.02226	0.01071	1.0	215.83	2022-09-26T03:30:13	2022-09-26T03:21:28	Rev1	None	None
TrinitySRITrojAI-BostonU	0.49047	0.12879	0.15734	1.0	224.28	2022-10-29T06:50:15	2022-10-29T06:43:21	Rev1	:Container File Missing:	None
trojai-example	0.5584	0.20861	0.19462	0.83333	82.58	2022-12-07T19:48:42	2022-12-07T19:48:07	Rev1	None	None
IIECAS	0.51681	0.16695	0.178	0.79167	462.64	2022-11-26T14:20:30	2022-11-26T14:18:48	Rev1	None	None
UMBCb	0.588	0.1539	0.20394	0.75	133.11	2022-10-31T18:40:25	2022-10-31T18:31:33	Rev1	:Container File Missing:	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.66583	0.05079	0.23676	0.58333	6000.62	2022-10-03T18:30:04	2022-10-03T18:28:21	Rev1	None	:Timeout:
Perspecta	0.47751	0.17169	0.15468	0.91667	519.7	2022-10-13T02:50:04	2022-10-13T02:49:18	Rev1	None	None
Perspecta	0.39355	0.18202	0.12011	0.91667	92.7	2022-10-18T05:00:04	2022-10-18T04:51:17	Rev1	:Container File Missing:	None
Perspecta	0.88063	0.37914	0.33177	0.66667	94.64	2022-10-18T14:20:04	2022-10-18T14:14:36	Rev1	:Container File Missing:	None
Perspecta	0.08808	0.04512	0.01099	1.0	93.74	2022-10-26T14:20:04	2022-10-26T14:12:49	Rev1	:Container File Missing:	None
Perspecta	0.12029	0.09595	0.02479	1.0	92.77	2022-10-27T00:30:05	2022-10-27T00:25:51	Rev1	:Container File Missing:	None
Perspecta	0.10195	0.07925	0.0193	1.0	94.71	2022-10-27T15:20:05	2022-10-27T15:11:54	Rev1	:Container File Missing:	None
Perspecta	0.16894	0.19425	0.05365	1.0	93.41	2022-10-28T23:10:03	2022-10-28T23:02:30	Rev1	:Container File Missing:	None
Perspecta	0.25789	0.30528	0.09238	1.0	93.69	2022-11-02T17:10:04	2022-11-02T17:09:08	Rev1	None	None
Perspecta	0.12036	0.10149	0.02734	1.0	93.71	2022-11-07T20:10:07	2022-11-07T20:06:40	Rev1	None	None
Perspecta	0.09413	0.1256	0.02667	1.0	93.68	2022-11-15T03:10:04	2022-11-15T03:04:49	Rev1	None	None
Perspecta	0.13628	0.18049	0.04508	1.0	96.86	2022-11-16T00:50:04	2022-11-16T00:43:48	Rev1	None	None
Perspecta	0.07444	0.09283	0.01784	1.0	95.47	2022-11-16T18:20:03	2022-11-16T18:17:56	Rev1	None	None
Perspecta	0.12297	0.12806	0.03305	1.0	92.44	2022-11-16T20:50:05	2022-11-16T20:47:39	Rev1	None	None
Perspecta	0.15885	0.10778	0.03503	1.0	94.5	2022-11-17T22:10:04	2022-11-17T22:02:11	Rev1	None	None
Perspecta	0.11923	0.1495	0.03465	1.0	100.55	2022-11-22T05:00:05	2022-11-22T04:56:07	Rev1	None	None
Perspecta	0.12935	0.16694	0.04025	1.0	92.72	2022-11-22T05:30:04	2022-11-22T05:24:42	Rev1	None	None
Perspecta	0.0846	0.05546	0.0122	1.0	96.52	2022-11-29T07:20:05	2022-11-29T07:17:16	Rev1	None	None
Perspecta	0.08018	0.0691	0.01422	1.0	98.28	2022-11-29T15:20:04	2022-11-29T15:18:03	Rev1	None	None
Perspecta	0.07122	0.07771	0.01429	1.0	94.51	2022-11-30T19:20:04	2022-11-30T19:13:22	Rev1	None	None
Perspecta	0.69315	0.0	0.25	0.5	97.79	2022-12-01T01:20:05	2022-12-01T01:12:44	Rev1	:No Results:	None
Perspecta	0.09387	0.03818	0.01072	1.0	105.72	2022-12-01T04:40:04	2022-12-01T04:38:18	Rev1	None	None
Perspecta	0.08	0.04113	0.00897	1.0	122.14	2022-12-01T16:20:07	2022-12-01T16:12:07	Rev1	None	None
Perspecta	0.09746	0.05234	0.01311	1.0	142.81	2022-12-05T19:37:27	2022-12-05T19:32:11	Rev1	None	None
Perspecta	0.0804	0.04556	0.00973	1.0	122.07	2022-12-06T19:53:37	2022-12-06T17:25:00	Rev1	None	None
Perspecta	0.06891	0.04168	0.00761	1.0	122.03	2022-12-07T16:30:04	2022-12-07T16:23:06	Rev1	None	None
Perspecta	0.06565	0.037	0.00662	1.0	122.01	2022-12-08T15:20:06	2022-12-08T15:12:57	Rev1	None	None
Perspecta	0.69315	0.0	0.25	0.5	102.28	2022-12-12T23:30:05	2022-12-12T23:25:36	Rev1	:No Results:	None
Perspecta	0.69315	0.0	0.25	0.5	102.23	2022-12-13T01:10:05	2022-12-13T01:08:33	Rev1	:No Results:	None
Perspecta	0.07696	0.03918	0.00826	1.0	122.11	2022-12-13T04:20:04	2022-12-13T04:16:56	Rev1	None	None
Perspecta	0.07696	0.03918	0.00826	1.0	122.17	2022-12-13T06:10:05	2022-12-13T06:08:55	Rev1	None	None
Perspecta	0.0832	0.04986	0.01063	1.0	123.75	2022-12-14T18:10:05	2022-12-14T18:03:57	Rev1	None	None
Perspecta	0.69315	0.0	0.25	0.5	27.63	2022-12-29T21:00:04	2022-12-29T20:51:10	Rev1	:No Results:	None
TrinitySRITrojAI	0.43286	0.13095	0.13538	1.0	1064.99	2022-10-08T04:50:07	2022-10-08T04:47:28	Rev1	None	None
TrinitySRITrojAI	0.36564	0.15694	0.11009	0.91667	2438.18	2022-10-17T07:20:06	2022-10-17T07:15:57	Rev1	None	None
TrinitySRITrojAI	0.49685	0.17761	0.16473	0.875	2142.53	2022-11-15T19:00:07	2022-11-15T18:55:12	Rev1	None	None
TrinitySRITrojAI	0.39175	0.16235	0.11944	0.95833	2148.7	2022-11-17T04:40:05	2022-11-17T04:37:15	Rev1	None	None
TrinitySRITrojAI	0.35719	0.19217	0.10852	0.95833	3772.73	2022-12-12T22:50:06	2022-12-12T22:43:48	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5		2023-01-18T05:20:06	2023-01-18T05:16:05	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI	0.20767	0.09136	0.04596	1.0	6169.61	2023-01-18T06:30:06	2023-01-18T06:26:27	Rev1	None	None
TrinitySRITrojAI	0.11639	0.07195	0.01964	1.0	555.68	2023-02-10T23:50:06	2023-02-10T23:47:23	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5	65.03	2022-09-22T19:30:06	2022-09-22T19:28:35	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5	61.17	2022-09-23T19:40:06	2022-09-23T19:31:46	Rev1	None	None
PL-GIFT	0.03577	0.0293	0.00308	1.0	63.61	2022-09-23T21:50:07	2022-09-23T21:43:37	Rev1	None	None
PL-GIFT	0.05908	0.04643	0.00768	1.0	94.48	2022-09-29T22:50:07	2022-09-29T22:42:10	Rev1	None	:Cleanup::Cleanup:
PL-GIFT	0.69315	0.0	0.25	0.5	107.02	2022-10-11T17:40:08	2022-10-11T17:40:00	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5	103.15	2022-10-11T21:30:08	2022-10-11T21:29:03	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5	98.72	2022-10-12T13:32:16	2022-10-12T01:33:00	Rev1	None	None
PL-GIFT	0.05288	0.04288	0.00634	1.0	107.91	2022-10-12T14:50:08	2022-10-12T14:41:11	Rev1	None	None
PL-GIFT	0.1197	0.15674	0.0362	1.0	67.56	2022-10-14T18:00:08	2022-10-14T17:56:35	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5	22.11	2022-10-18T00:40:08	2022-10-18T00:32:10	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.69315	0.0	0.25	0.5	72.29	2022-10-18T16:20:08	2022-10-18T16:16:16	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.69315	0.0	0.25	0.5	72.51	2022-10-18T18:30:08	2022-10-18T18:24:03	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.69315	0.0	0.25	0.5	72.44	2022-10-18T19:10:07	2022-10-18T19:00:59	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.69315	0.0	0.25	0.5	1355.03	2022-10-18T20:00:07	2022-10-18T19:51:07	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.69315	0.0	0.25	0.5	1354.69	2022-10-18T22:30:07	2022-10-18T22:21:19	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.1197	0.15674	0.0362	1.0	67.49	2022-10-19T15:40:07	2022-10-19T15:35:59	Rev1	:Container File Missing:	None
PL-GIFT	0.69315	0.0	0.25	0.5	1352.16	2022-10-19T17:00:07	2022-10-19T16:55:18	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.69315	0.0	0.25	0.5	187.16	2022-10-20T20:20:07	2022-10-20T20:12:41	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.67108	0.08147	0.23929	0.75	213.22	2022-10-20T21:40:07	2022-10-20T21:30:51	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.10691	0.15583	0.03417	1.0	83.18	2022-10-25T23:20:07	2022-10-25T23:14:49	Rev1	:Container File Missing:	None
PL-GIFT	0.20959	0.21446	0.06896	1.0	74.75	2022-11-04T22:10:08	2022-11-04T22:07:34	Rev1	None	None
PL-GIFT	0.08938	0.13006	0.02676	1.0	83.82	2022-11-07T16:40:07	2022-11-07T16:31:25	Rev1	None	None
PL-GIFT	0.29009	0.32496	0.10695	1.0	83.85	2022-11-09T22:50:07	2022-11-09T22:49:06	Rev1	None	None
PL-GIFT	0.05746	0.06468	0.01012	1.0	83.73	2022-11-11T19:00:07	2022-11-11T18:50:19	Rev1	None	None
PL-GIFT	0.07544	0.12159	0.02363	1.0	83.9	2022-11-11T22:50:08	2022-11-11T22:44:14	Rev1	None	None
PL-GIFT	0.08143	0.13207	0.02647	1.0	83.08	2022-11-15T17:20:14	2022-11-15T17:13:41	Rev1	None	None
PL-GIFT	0.07852	0.10764	0.02078	1.0	83.69	2022-11-15T18:10:08	2022-11-15T18:03:02	Rev1	None	None
PL-GIFT	0.1361	0.21533	0.0487	1.0	84.33	2022-11-15T20:40:07	2022-11-15T20:35:27	Rev1	None	None
PL-GIFT	0.0106	0.00102	0.00011	1.0	86.7	2022-12-15T15:30:07	2022-12-15T15:24:46	Rev1	None	None
PL-GIFT	0.01059	0.00101	0.00011	1.0	95.76	2022-12-20T19:08:08	2022-12-20T18:08:44	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2023-01-24T21:10:09	2023-01-24T21:07:09	Rev1	:No Results::Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	0.69315	0.0	0.25	0.5	31.48	2023-10-06T21:10:12	2023-10-06T21:02:32	Rev1	:No Results::Missing Results:	None
PL-GIFT	0.41991	0.20742	0.15004	0.83333	43.14	2023-10-06T21:30:11	2023-10-06T21:29:30	Rev1	:Missing Results:	None
PL-GIFT	0.01005	0.0	0.0001	1.0	59.8	2023-10-09T22:35:12	2023-10-09T22:25:15	Rev1	None	None
Perspecta-PurdueRutgers	0.10536	0.0	0.01	1.0	3276.01	2022-10-03T07:10:08	2022-10-03T07:03:26	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.11108	0.01063	0.01125	1.0	3335.9	2022-10-04T21:30:08	2022-10-04T21:24:00	Rev1	:Container File Missing:	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.67775	0.37314	0.234	0.79167	2474.85	2022-10-14T05:30:09	2022-10-14T05:29:02	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.45803	0.17848	0.154	1.0	1074.43	2022-10-14T07:40:09	2022-10-14T07:39:48	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.10536	0.0	0.01	1.0	1702.59	2022-10-14T09:10:08	2022-10-14T09:04:24	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2022-10-15T06:00:07	2022-10-15T05:57:13	Rev1	:Executed File Update::Info File Missing::Container File Missing:	None
Perspecta-PurdueRutgers	0.3308	0.40751	0.09125	0.89583	3134.32	2022-10-15T20:50:09	2022-10-15T20:47:36	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.08373	0.01642	0.007	1.0	1659.9	2022-10-18T05:40:08	2022-10-18T05:33:54	Rev1	:Container File Missing:	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.10983	0.00339	0.01084	1.0	1640.69	2022-10-24T00:50:09	2022-10-24T00:41:14	Rev1	:Container File Missing:	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.10983	0.00339	0.01084	1.0	5220.01	2022-11-01T05:50:09	2022-11-01T03:51:19	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.10983	0.00339	0.01084	1.0	3818.45	2022-11-01T16:10:09	2022-11-01T16:06:40	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5	42.5	2022-11-03T15:50:09	2022-11-03T15:49:58	Rev1	None	None
Perspecta-PurdueRutgers	0.37625	0.11831	0.10675	1.0	114.68	2022-11-04T14:43:05	2022-11-03T23:08:36	Rev1	None	None
Perspecta-PurdueRutgers	0.10983	0.00339	0.01084	1.0	2991.91	2022-11-04T19:00:09	2022-11-04T18:57:28	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5	52.54	2022-11-05T17:30:09	2022-11-05T17:28:49	Rev1	:No Results:	None
Perspecta-PurdueRutgers	0.34248	0.13594	0.09605	1.0	90.7	2022-11-06T20:40:09	2022-11-06T20:39:23	Rev1	None	None
Perspecta-PurdueRutgers	0.09044	0.01981	0.00826	1.0	2974.03	2022-11-08T18:20:14	2022-11-08T18:16:08	Rev1	None	:Container Parameters (learned parameters):
Perspecta-PurdueRutgers	0.55049	0.09903	0.18139	1.0	87.67	2022-11-11T16:50:10	2022-11-11T16:44:02	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2022-11-15T21:50:09	2022-11-15T21:40:30	Rev1	:Executed File Update::No Results::Info File Missing::Container File Missing:	None
Perspecta-PurdueRutgers	0.19949	0.15463	0.05531	1.0	95.73	2022-11-15T22:31:19	2022-11-15T22:23:56	Rev1	None	None
Perspecta-PurdueRutgers	0.61681	0.0716	0.21225	0.91667	92.64	2022-11-16T04:00:09	2022-11-16T03:51:01	Rev1	None	None
Perspecta-PurdueRutgers	0.23014	0.19935	0.08043	1.0	92.42	2022-11-16T04:40:09	2022-11-16T04:31:04	Rev1	None	None
Perspecta-PurdueRutgers	0.24011	0.15465	0.0673	1.0	92.62	2022-11-16T16:20:09	2022-11-16T16:12:58	Rev1	None	None
Perspecta-PurdueRutgers	0.21181	0.16604	0.06443	1.0	92.39	2022-11-17T01:40:07	2022-11-17T01:38:36	Rev1	None	None
Perspecta-PurdueRutgers	0.17007	0.16432	0.05278	1.0	92.32	2022-11-17T02:40:43	2022-11-17T02:39:46	Rev1	None	None
Perspecta-PurdueRutgers	0.17672	0.16277	0.05366	1.0	92.7	2022-11-17T04:30:07	2022-11-17T04:20:21	Rev1	None	None
Perspecta-PurdueRutgers	0.26568	0.18452	0.08569	1.0	98.04	2022-12-10T03:30:08	2022-12-10T03:28:47	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5	89.75	2022-12-11T14:40:09	2022-12-11T14:38:45	Rev1	:No Results:	None
Perspecta-PurdueRutgers	0.13863	0.17185	0.05	1.0	91.78	2022-12-11T16:20:08	2022-12-11T16:12:25	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	66.27	2022-10-05T23:20:09	2022-10-05T23:19:25	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	67.69	2022-10-06T01:10:09	2022-10-06T01:00:54	Rev1	None	None
Perspecta-IUB	1.03784	0.81466	0.29067	0.5	152.31	2022-10-06T03:00:10	2022-10-06T02:56:53	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	68.57	2022-10-06T04:20:09	2022-10-06T04:16:53	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	71.76	2022-10-06T19:00:10	2022-10-06T18:58:43	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	1405.4	2022-10-06T21:20:09	2022-10-06T21:11:45	Rev1	None	None
Perspecta-IUB	0.17421	0.13729	0.048	1.0	1712.78	2022-10-06T22:50:09	2022-10-06T22:48:40	Rev1	None	None
Perspecta-IUB	0.15665	0.1255	0.04211	1.0	1436.15	2022-10-07T02:50:09	2022-10-07T02:42:56	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2022-10-07T22:10:08	2022-10-07T22:10:00	Rev1	:Executed File Update::Info File Missing::Container File Missing:	None
Perspecta-IUB	0.00234	0.00083	1e-05	1.0	1435.5	2022-10-08T01:50:08	2022-10-08T01:41:26	Rev1	None	None
Perspecta-IUB	0.00787	0.0107	0.00034	1.0	1417.67	2022-10-08T02:30:10	2022-10-08T02:24:02	Rev1	None	None
Perspecta-IUB	0.21078	0.19553	0.06301	1.0	1501.1	2022-10-09T22:00:09	2022-10-09T21:56:39	Rev1	None	None
Perspecta-IUB	0.18093	0.24366	0.064	1.0	1441.74	2022-10-09T23:50:09	2022-10-09T23:46:26	Rev1	None	None
Perspecta-IUB	0.1863	0.22723	0.06502	1.0	187.45	2022-10-10T18:00:09	2022-10-10T17:51:55	Rev1	None	None
Perspecta-IUB	0.19405	0.13466	0.05351	1.0	1694.97	2022-10-11T17:50:23	2022-10-11T17:45:12	Rev1	None	None
Perspecta-IUB	0.19251	0.1391	0.0523	1.0	2007.69	2022-10-12T13:32:33	2022-10-12T00:48:36	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	51.85	2022-10-06T19:30:10	2022-10-06T19:25:14	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	61.97	2022-10-06T21:20:10	2022-10-06T21:16:26	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	82.39	2022-10-06T22:20:10	2022-10-06T22:16:36	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	82.34	2022-10-07T05:50:10	2022-10-07T05:43:25	Rev1	None	None
ARM-UCSD	0.22292	0.14573	0.058	1.0	198.3	2022-10-07T06:10:12	2022-10-07T06:05:52	Rev1	None	None
ARM-UCSD	0.32508	0.40856	0.09	0.91667	201.95	2022-10-07T18:20:10	2022-10-07T18:15:40	Rev1	None	None
ARM-UCSD	0.32508	0.40856	0.09	0.91667	415.03	2022-10-12T13:32:36	2022-10-11T23:57:26	Rev1	None	None
ARM-UCSD	1.2086	0.53028	0.44385	0.5	109.17	2022-12-13T18:50:15	2022-12-13T18:43:24	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-03-27T02:10:15	2023-03-27T02:08:59	Rev1	:No Results::Missing Results::Container File Missing:	:Container Parameters (jsonschema checker):
ARM-UCSD	0.69315	0.0	0.25	0.5	60.05	2023-03-27T20:10:14	2023-03-27T20:06:37	Rev1	:No Results::Missing Results:	None
ARM	0.69315	0.0	0.25	0.5	130.58	2022-10-17T19:00:10	2022-10-17T18:54:57	Rev1	None	None
ARM	0.67295	0.33496	0.22489	0.83333	154.87	2022-10-17T20:29:59	2022-10-17T20:00:13	Rev1	:Container File Missing:	None
ARM	0.60843	0.30525	0.19867	0.83333	142.27	2022-11-01T05:50:14	2022-11-01T06:52:33	Rev1	None	None
ARM	0.60843	0.30525	0.19867	0.83333	142.27	2022-11-01T18:20:13	2022-11-01T18:00:29	Rev1	None	None
ARM	0.60843	0.30525	0.19867	0.83333	142.02	2022-11-01T20:50:13	2022-11-01T20:40:16	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5	124.73	2022-11-28T04:40:17	2022-11-28T04:39:02	Rev1	:No Results:	None
ARM	0.17945	0.03395	0.02873	1.0	142.38	2022-11-28T05:10:16	2022-11-28T05:03:08	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5		2023-03-28T04:40:19	2023-03-28T04:14:49	Rev1	:No Results::Missing Results::Info File Missing::Container File Missing:	None
ARM	0.69315	0.0	0.25	0.5		2023-03-28T05:30:17	2023-03-28T05:22:48	Rev1	:No Results::Missing Results::Info File Missing::Container File Missing:	None
ARM	0.69315	0.0	0.25	0.5		2023-04-01T00:20:17	2023-04-01T00:14:59	Rev1	:No Results::Missing Results::Container File Missing:	:Container Parameters (jsonschema checker):
ARM	0.69315	0.0	0.25	0.5		2023-04-04T17:20:16	2023-04-04T17:16:33	Rev1	:No Results::Missing Results::Container File Missing:	:Schema Header:
ARM	0.44259	0.31323	0.14193	0.91667	80.53	2023-04-04T18:00:17	2023-04-04T17:59:46	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	98.59	2022-10-21T01:30:12	2022-10-21T01:22:39	Rev1	:Container File Missing:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	98.57	2022-10-21T02:30:12	2022-10-21T02:26:54	Rev1	:Container File Missing:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	98.6	2022-10-21T03:10:11	2022-10-21T03:08:37	Rev1	:Container File Missing:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	98.35	2022-10-31T21:30:12	2022-10-31T21:14:17	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	98.61	2022-11-01T16:30:56	2022-11-01T16:26:24	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	97.6	2022-11-01T18:20:14	2022-11-01T17:53:57	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	98.6	2022-11-01T19:00:14	2022-11-01T18:56:14	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	132.7	2022-11-01T19:30:13	2022-11-01T19:22:07	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	109.62	2022-11-01T22:10:14	2022-11-01T22:03:34	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	112.62	2022-11-29T02:30:17	2022-11-29T02:28:33	Rev1	:No Results:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	42.27	2022-11-29T03:31:13	2022-11-29T03:08:42	Rev1	:No Results:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	42.05	2022-11-29T04:10:17	2022-11-29T04:01:50	Rev1	:No Results:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	42.36	2022-11-29T04:40:17	2022-11-29T04:33:20	Rev1	:No Results:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	42.02	2022-11-29T05:10:17	2022-11-29T05:01:48	Rev1	:No Results:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	107.51	2022-11-29T05:41:01	2022-11-29T05:36:40	Rev1	:Result Parse::No Results:	None
TrinitySRITrojAI-SBU	0.3605	0.18267	0.12165	1.0	113.01	2022-11-29T18:30:17	2022-11-29T18:27:38	Rev1	None	None
TrinitySRITrojAI-SBU	0.26883	0.15055	0.07945	1.0	104.31	2022-12-12T22:00:17	2022-12-12T21:56:41	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-01-08T19:00:19	2023-01-08T18:55:02	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-01-10T02:30:21	2023-01-10T02:25:33	Rev1	:No Results::Container File Missing:	:Schema Header:
ICSI-2	0.10425	0.02226	0.01071	1.0	215.83	2022-09-26T03:30:13	2022-09-26T03:21:28	Rev1	None	None
ICSI-2	0.40206	0.252	0.13958	1.0	114.13	2022-10-03T02:50:23	2022-10-03T02:41:48	Rev1	None	None
ICSI-2	0.05906	0.02135	0.00423	1.0	109.83	2022-10-04T04:30:12	2022-10-04T04:29:58	Rev1	None	None
ICSI-2	0.06352	0.02138	0.00473	1.0	137.33	2022-10-10T08:20:15	2022-10-10T08:18:51	Rev1	None	None
ICSI-2	0.04803	0.0323	0.00445	1.0	139.15	2022-10-11T20:20:15	2022-10-11T20:10:41	Rev1	None	None
ICSI-2	0.17217	0.20058	0.05687	1.0	165.56	2022-10-13T01:30:14	2022-10-13T01:29:31	Rev1	None	None
ICSI-2	0.14005	0.14438	0.04125	1.0	143.38	2022-10-14T01:50:17	2022-10-13T20:29:28	Rev1	None	None
ICSI-2	0.15442	0.16011	0.04867	1.0	137.59	2022-10-14T23:20:23	2022-10-14T23:17:41	Rev1	None	None
ICSI-2	0.12037	0.12021	0.03196	1.0	137.37	2022-10-15T21:00:13	2022-10-15T20:53:40	Rev1	None	None
ICSI-2	0.03534	0.02349	0.00244	1.0	136.26	2022-10-16T05:40:14	2022-10-16T05:35:09	Rev1	None	None
ICSI-2	0.04256	0.03763	0.00458	1.0	138.34	2022-10-25T21:10:14	2022-10-25T21:10:02	Rev1	:Container File Missing:	None
ICSI-2	0.03431	0.03022	0.0031	1.0	174.26	2022-10-26T06:40:14	2022-10-26T06:39:30	Rev1	:Container File Missing:	None
ICSI-2	0.02791	0.02287	0.00197	1.0	130.53	2022-11-09T18:50:19	2022-11-09T18:47:04	Rev1	None	None
ICSI-2	0.01681	0.01354	0.00072	1.0	126.82	2022-11-14T23:30:20	2022-11-14T23:24:02	Rev1	None	None
ICSI-2	0.04539	0.04701	0.00633	1.0	1028.83	2022-11-22T10:20:19	2022-11-22T10:19:46	Rev1	None	None
ICSI-2	0.03404	0.0326	0.0034	1.0	411.35	2022-11-23T00:30:21	2022-11-23T00:27:22	Rev1	None	None
ICSI-2	0.04264	0.04659	0.00602	1.0	2105.16	2022-11-23T23:10:20	2022-11-23T23:08:22	Rev1	None	None
ICSI-2	0.24397	0.1877	0.08067	0.95833	6000.69	2022-12-04T00:00:21	2022-12-02T02:30:32	Rev1	None	:Timeout:
ICSI-2	0.28665	0.206	0.10043	0.9375	6000.68	2022-12-12T21:50:19	2022-12-12T21:47:31	Rev1	None	:Timeout:
ICSI-2	0.01813	0.0144	0.00082	1.0	1817.93	2022-12-13T03:30:17	2022-12-13T03:26:21	Rev1	None	None
ICSI-2	0.69315	0.0	0.25	0.5	1560.34	2022-12-13T22:40:19	2022-12-13T22:31:02	Rev1	:No Results:	None
ICSI-2	0.69315	0.0	0.25	0.5	1664.1	2022-12-14T03:00:21	2022-12-14T03:00:17	Rev1	:No Results:	None
ICSI-2	0.01768	0.01459	0.00082	1.0	537.34	2022-12-14T04:40:20	2022-12-14T04:38:18	Rev1	None	None
ICSI-2	0.02053	0.02098	0.00142	1.0	191.91	2022-12-15T06:50:20	2022-12-15T06:48:01	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	52.38	2022-10-28T19:30:15	2022-10-28T19:27:45	Rev1	:Container File Missing:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	52.33	2022-10-29T05:10:15	2022-10-28T21:13:14	Rev1	:Container File Missing:	None
TrinitySRITrojAI-BostonU	0.49047	0.12879	0.15734	1.0	224.28	2022-10-29T06:50:15	2022-10-29T06:43:21	Rev1	:Container File Missing:	None
TrinitySRITrojAI-BostonU	0.26979	0.10317	0.06495	1.0	319.35	2022-10-31T20:10:18	2022-10-31T20:01:29	Rev1	None	None
TrinitySRITrojAI-BostonU	0.693	0.00044	0.24993	0.5	328.73	2022-11-02T02:10:19	2022-11-02T02:00:29	Rev1	None	None
TrinitySRITrojAI-BostonU	0.31027	0.02827	0.07185	1.0	315.39	2022-11-02T06:30:54	2022-11-02T06:29:02	Rev1	None	None
TrinitySRITrojAI-BostonU	0.31027	0.02827	0.07185	1.0	320.59	2022-11-02T19:00:21	2022-11-02T18:56:27	Rev1	None	None
TrinitySRITrojAI-BostonU	0.26979	0.10317	0.06495	1.0	325.11	2022-11-03T05:50:22	2022-11-03T05:47:16	Rev1	None	None
trojai-example	1.25867	0.63594	0.4195	0.375	131.05	2022-09-21T17:40:14	2022-09-21T17:39:18	Rev1	None	None
trojai-example	0.69315	0.0	0.25	0.5	0.01	2022-09-27T16:50:18	2022-09-27T16:44:39	Rev1	:Container File Missing:	:Execute::Copy Out:
trojai-example	0.98262	0.52056	0.35336	0.54167	130.01	2022-09-27T17:10:18	2022-09-27T17:02:51	Rev1	None	None
trojai-example	0.69315	0.0	0.25	0.5		2022-09-28T18:00:18	2022-09-28T18:00:05	Rev1	:Info File Missing::Container File Missing:	None
trojai-example	0.65689	0.22961	0.23136	0.66667	132.28	2022-09-28T18:20:18	2022-09-28T18:16:11	Rev1	None	None
trojai-example	0.9352	0.3863	0.34494	0.45833	152.02	2022-09-28T19:10:18	2022-09-28T19:00:39	Rev1	None	None
trojai-example	0.61578	0.27849	0.2172	0.75	155.32	2022-09-28T21:20:18	2022-09-28T21:11:57	Rev1	None	None
trojai-example	0.55684	0.24684	0.19247	0.79167	152.1	2022-09-30T17:00:19	2022-09-30T16:59:47	Rev1	None	None
trojai-example	1.07807	0.47955	0.38411	0.33333	152.1	2022-10-19T13:30:19	2022-10-19T13:28:02	Rev1	:Container File Missing:	None
trojai-example	0.5584	0.20861	0.19462	0.83333	82.58	2022-12-07T19:48:42	2022-12-07T19:48:07	Rev1	None	None
trojai-example	1.47047	0.69626	0.48868	0.29167	82.51	2022-12-08T16:40:24	2022-12-08T16:39:11	Rev1	None	None
trojai-example	0.90144	0.4668	0.33743	0.625	14.45	2024-06-11T20:58:32	2024-06-11T20:54:24	Rev1	None	:Container Parameters (jsonschema checker)::Schema Header:
trojai-example	0.91065	0.37276	0.34653	0.5	11.19	2024-06-11T21:03:18	2024-06-11T21:02:09	Rev1	None	:Container Parameters (jsonschema checker)::Schema Header:
IIECAS	0.69315	0.0	0.25	0.5	61.07	2022-11-17T04:50:26	2022-11-17T05:03:38	Rev1	:No Results:	None
IIECAS	8.42794	7.79351	0.35	0.75	240.68	2022-11-17T07:50:28	2022-11-17T07:49:03	Rev1	None	None
IIECAS	13.81552	8.56295	0.5	0.58333	247.73	2022-11-17T11:50:28	2022-11-17T11:46:34	Rev1	None	None
IIECAS	1.20397	0.68093	0.41	0.58333	392.51	2022-11-18T05:00:26	2022-11-18T04:59:14	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5	59.03	2022-11-18T08:00:26	2022-11-18T07:53:01	Rev1	:No Results:	None
IIECAS	0.69315	0.0	0.25	0.5	59.97	2022-11-18T09:50:27	2022-11-18T09:45:38	Rev1	:No Results:	None
IIECAS	1.20397	0.68093	0.41	0.58333	3416.16	2022-11-18T11:00:28	2022-11-18T10:52:48	Rev1	None	None
IIECAS	0.57559	0.14573	0.202	0.75	404.2	2022-11-23T10:00:30	2022-11-23T09:58:26	Rev1	None	None
IIECAS	0.57559	0.14573	0.202	0.75	424.99	2022-11-23T13:30:30	2022-11-23T13:24:16	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5		2022-11-23T14:00:30	2022-11-23T13:50:58	Rev1	:No Results::Info File Missing::Container File Missing:	None
IIECAS	0.57559	0.14573	0.202	0.75	412.25	2022-11-23T16:10:30	2022-11-23T16:10:06	Rev1	None	None
IIECAS	0.57559	0.14573	0.202	0.75	426.15	2022-11-23T17:50:30	2022-11-23T17:47:26	Rev1	None	None
IIECAS	0.57559	0.14573	0.202	0.75	513.69	2022-11-24T04:40:29	2022-11-24T04:31:39	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5		2022-11-24T12:00:30	2022-11-24T11:55:02	Rev1	:No Results::Info File Missing::Container File Missing:	None
IIECAS	0.57559	0.14573	0.202	0.75	496.63	2022-11-24T12:40:29	2022-11-24T12:34:38	Rev1	None	None
IIECAS	0.57559	0.14573	0.202	0.75	459.27	2022-11-24T17:10:30	2022-11-24T17:05:42	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5	92.23	2022-11-26T08:10:30	2022-11-26T08:06:40	Rev1	:No Results:	None
IIECAS	0.69315	0.0	0.25	0.5		2022-11-26T09:30:30	2022-11-26T09:28:44	Rev1	:No Results::Info File Missing::Container File Missing:	None
IIECAS	0.69315	0.0	0.25	0.5		2022-11-26T10:30:30	2022-11-26T10:21:12	Rev1	:No Results::Info File Missing::Container File Missing:	None
IIECAS	0.69315	0.0	0.25	0.5	91.97	2022-11-26T11:20:30	2022-11-26T11:12:32	Rev1	:No Results:	None
IIECAS	0.57559	0.14573	0.202	0.75	464.97	2022-11-26T12:30:32	2022-11-26T12:28:44	Rev1	None	None
IIECAS	0.51681	0.16695	0.178	0.79167	462.64	2022-11-26T14:20:30	2022-11-26T14:18:48	Rev1	None	None
IIECAS	0.69315	0.0	0.25	0.5		2022-11-26T15:30:29	2022-11-26T15:30:17	Rev1	:No Results::Info File Missing::Container File Missing:	None
IIECAS	0.51681	0.16695	0.178	0.79167	511.03	2022-11-26T16:30:29	2022-11-26T16:25:20	Rev1	None	None
IIECAS	0.51681	0.16695	0.178	0.79167	1429.5	2022-11-27T03:30:29	2022-11-27T03:29:03	Rev1	None	None
IIECAS	0.54481	0.54474	0.17	0.75	2576.02	2022-11-27T06:40:36	2022-11-27T06:39:55	Rev1	None	None
IIECAS	0.54481	0.54474	0.17	0.75	1896.66	2022-11-27T11:10:28	2022-11-27T11:02:27	Rev1	None	None
IIECAS	0.54481	0.54474	0.17	0.75	1830.4	2022-11-28T14:20:31	2022-11-28T14:16:24	Rev1	None	None
UMBCb	0.588	0.1539	0.20394	0.75	133.11	2022-10-31T18:40:25	2022-10-31T18:31:33	Rev1	:Container File Missing:	None
UMBCb	7.89749	6.54432	0.53367	0.58333	193.37	2022-11-02T20:10:30	2022-11-02T17:11:22	Rev1	None	None

Required filename format: "image-classification-sep2022_dev_<Submission Name>.simg"
Accepting submissions: True
Number of models in image-classification-sep2022, dev: 216
Execution timeout (hh:mm:ss): 1 day, 12:00:00

Teams/Jobs

Team	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DRAFFT	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UCSD	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UMBC	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojai-example	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IceTorch	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PASS	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors

Round 12 leaderboard for cyber PDF December 2022.

Each AI is trained to scan a feature vector, corresponding to a PDF file, to determine whether the PDF contains malware. For those AIs that have been attacked, the presence of a trigger watermark on a malware feature vector will cause the AI to reliably misclassify the PDF as benign. The Round 12 Training Data Download consists of 120 reference AIs (exactly 50% are poisoned) with example input data. More info here.

train: The train dataset that is distributed with each round.
test: The test dataset that is sequestered/hidden, used for evaluation. Submissions here should be fully realized with complete schema and parameters.
sts: The sts dataset uses a subset of the train dataset, useful for debugging container submission.
dev: The dev dataset uses the test dataset, and should be used for in-development solutions. Schemas must be valid, but do not need to be complete. Results do not count towards the program.

train test sts dev

Required filename format: "cyber-pdf-dec2022_train_<Submission Name>.simg"
Accepting submissions: True
Number of models in cyber-pdf-dec2022, train: 120
Execution timeout (hh:mm:ss): 20:00:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2023-03-07T18:10:05	performer	None	None	Ok	2023-03-07T18:08:26	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-12-23T22:10:06	performer	None	None	Ok	2023-12-23T22:07:17	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-02-27T19:30:07	performer	None	None	Ok	2023-02-27T19:26:23	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-01-20T02:50:10	performer	None	None	Ok	2023-01-20T02:47:02	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2023-02-22T03:40:59	performer	None	None	Ok	2023-02-22T03:35:07	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2023-03-28T03:01:04	performer	None	None	Ok	2023-03-28T02:54:42	0 d, 0 h, 0 m, 0 s
ARM	2023-03-07T18:40:21	performer	None	None	Ok	2023-03-07T18:32:05	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	2023-03-08T01:30:24	performer	None	None	Ok	2023-03-08T01:29:04	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2023-02-22T21:20:23	performer	None	None	Ok	2023-02-22T21:15:18	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-03-14T19:30:27	performer	None	None	Ok	2023-03-14T19:29:08	0 d, 0 h, 0 m, 0 s
trojai-example	2022-12-17T01:19:20	public	None	None	Ok	2022-12-17T01:15:03	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2023-04-17T18:00:32	performer	None	None	Ok	2023-04-17T17:56:18	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.00566	0.00088	6e-05	1.0	1201.9	2023-01-03T21:50:04	2023-01-03T21:43:42	Rev1	None	None
TrinitySRITrojAI	0.11302	0.00962	0.01326	1.0	2367.42	2023-01-05T20:00:06	2023-01-05T19:57:36	Rev1	None	None
PL-GIFT	0.0	0.0	0.0	1.0	1562.98	2022-12-22T01:00:08	2022-12-22T00:58:23	Rev1	None	None
Perspecta-PurdueRutgers	0.19999	0.01898	0.03814	1.0	721.17	2023-01-09T04:30:10	2023-01-09T04:29:12	Rev1	None	None
Perspecta-IUB	0.20625	0.01009	0.03635	1.0	721.12	2022-12-22T04:20:09	2022-12-22T04:15:36	Rev1	None	None
ARM-UCSD	0.0	0.0	0.0	1.0	655.81	2023-01-30T07:40:18	2023-01-30T07:31:28	Rev1	None	None
ARM	0.15302	0.0222	0.02839	1.0	842.55	2023-01-27T21:51:08	2023-01-27T21:41:02	Rev1	None	None
TrinitySRITrojAI-SBU	0.0633	0.01153	0.00666	1.0	1682.83	2023-02-21T21:45:10	2023-02-21T21:39:55	Rev1	None	None
ICSI-2	0.01037	0.00055	0.00012	1.0	612.68	2023-01-06T06:50:21	2023-01-06T06:46:27	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00437	0.0006	3e-05	1.0	1710.5	2023-01-19T07:10:23	2023-01-19T07:01:26	Rev1	None	None
trojai-example	0.77147	0.07322	0.28477	0.49111	721.8	2022-12-17T01:19:20	2022-12-17T01:15:03	Rev1	None	None
UMBCb	0.2495	0.00287	0.04887	1.0	221.23	2023-03-16T15:00:32	2023-03-16T14:58:32	Rev1	None	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.00566	0.00088	6e-05	1.0	1201.9	2023-01-03T21:50:04	2023-01-03T21:43:42	Rev1	None	None
Perspecta	0.09663	0.04114	0.02333	0.99778	1562.53	2023-01-04T18:50:05	2023-01-04T18:42:32	Rev1	None	None
Perspecta	0.07677	0.03949	0.01958	1.0	1562.64	2023-01-05T15:40:05	2023-01-05T15:36:11	Rev1	None	None
Perspecta	0.04925	0.02419	0.00961	1.0	1562.64	2023-01-10T18:10:05	2023-01-10T18:08:25	Rev1	None	None
Perspecta	0.05131	0.02596	0.01055	1.0	1562.78	2023-01-11T15:40:05	2023-01-11T15:35:21	Rev1	None	None
Perspecta	0.00565	0.00078	5e-05	1.0	1562.67	2023-01-11T20:00:05	2023-01-11T19:50:59	Rev1	None	None
Perspecta	0.06015	0.01046	0.00596	1.0	1562.6	2023-01-12T19:50:05	2023-01-12T19:44:09	Rev1	None	None
Perspecta	0.01071	0.00063	0.00013	1.0	1562.57	2023-01-12T22:30:05	2023-01-12T22:29:31	Rev1	None	None
Perspecta	0.05129	0.0	0.0025	1.0	1562.81	2023-01-13T15:40:05	2023-01-13T15:37:07	Rev1	None	None
Perspecta	0.06344	0.00735	0.00493	1.0	1562.57	2023-01-13T18:30:05	2023-01-13T18:21:16	Rev1	None	None
Perspecta	0.09009	0.01279	0.01006	1.0	1668.75	2023-01-16T22:00:04	2023-01-16T21:56:54	Rev1	None	None
Perspecta	0.08158	0.00643	0.00698	1.0	1672.29	2023-01-17T14:10:05	2023-01-17T14:01:07	Rev1	None	None
Perspecta	0.08691	0.01185	0.00899	1.0	1718.63	2023-01-18T15:30:05	2023-01-18T15:24:47	Rev1	None	None
Perspecta	0.08613	0.0109	0.00864	1.0	1727.69	2023-01-31T00:40:04	2023-01-31T00:34:29	Rev1	None	None
Perspecta	0.07257	0.0	0.0049	1.0	1722.39	2023-01-31T02:10:04	2023-01-31T02:02:09	Rev1	None	None
Perspecta	0.07834	0.00415	0.00604	1.0	1719.75	2023-02-01T00:50:04	2023-02-01T00:48:19	Rev1	None	None
Perspecta	0.07257	0.0	0.0049	1.0	1716.14	2023-02-07T18:40:04	2023-02-07T18:38:40	Rev1	None	None
Perspecta	0.08122	0.00356	0.00638	1.0	1727.89	2023-02-21T19:02:53	2023-02-21T19:02:33	Rev1	None	None
Perspecta	0.05129	0.0	0.0025	1.0	1725.91	2023-03-03T15:40:04	2023-03-03T15:38:40	Rev1	None	None
Perspecta	0.05129	0.0	0.0025	1.0	1730.16	2023-03-07T18:10:05	2023-03-07T18:08:26	Rev1	None	None
TrinitySRITrojAI	0.40031	0.11624	0.12841	0.92111	2473.48	2022-12-20T00:20:06	2022-12-20T00:14:31	Rev1	None	None
TrinitySRITrojAI	0.96107	0.2947	0.24786	0.93611	2924.04	2022-12-20T16:27:12	2022-12-20T16:20:56	Rev1	None	None
TrinitySRITrojAI	0.11302	0.00962	0.01326	1.0	2367.42	2023-01-05T20:00:06	2023-01-05T19:57:36	Rev1	None	None
TrinitySRITrojAI	0.07875	0.02078	0.01399	1.0	2118.8	2023-02-03T04:20:06	2023-02-03T04:13:58	Rev1	None	None
TrinitySRITrojAI	0.16295	0.03327	0.03636	0.99833	1682.85	2023-02-10T23:50:07	2023-02-10T23:47:16	Rev1	None	None
TrinitySRITrojAI	0.226	0.04563	0.05496	0.98833	557.39	2023-03-17T21:50:06	2023-03-17T21:49:35	Rev1	None	None
TrinitySRITrojAI	0.50741	0.07137	0.16937	0.83694	1309.42	2023-12-23T22:10:06	2023-12-23T22:07:17	Rev1	None	None
PL-GIFT	0.0	0.0	0.0	1.0	1562.98	2022-12-22T01:00:08	2022-12-22T00:58:23	Rev1	None	None
PL-GIFT	0.161	0.12046	0.04345	0.98208	1562.55	2023-01-11T03:50:09	2023-01-11T03:46:57	Rev1	None	None
PL-GIFT	0.00051	0.0004	1e-05	1.0	1564.37	2023-01-14T03:30:08	2023-01-14T03:23:08	Rev1	None	None
PL-GIFT	0.00063	0.00021	0.0	1.0	1562.68	2023-01-16T19:00:08	2023-01-16T18:57:00	Rev1	None	None
PL-GIFT	0.00166	0.0003	1e-05	1.0	1563.03	2023-01-17T16:50:08	2023-01-17T16:49:35	Rev1	None	None
PL-GIFT	0.00198	0.00035	1e-05	1.0	1562.7	2023-01-17T18:10:09	2023-01-17T18:06:04	Rev1	None	None
PL-GIFT	0.00561	0.00099	6e-05	1.0	1562.76	2023-01-18T15:50:08	2023-01-18T15:47:42	Rev1	None	None
PL-GIFT	0.02576	0.00458	0.00125	1.0	1564.05	2023-01-18T17:10:09	2023-01-18T17:03:24	Rev1	None	None
PL-GIFT	0.01362	0.0049	0.00077	1.0	1562.68	2023-01-19T17:10:08	2023-01-19T17:01:45	Rev1	None	None
PL-GIFT	0.00608	0.00107	7e-05	1.0	1562.82	2023-01-19T20:30:08	2023-01-19T20:28:23	Rev1	None	None
PL-GIFT	0.01005	0.0	0.0001	1.0	1562.65	2023-01-27T20:50:08	2023-01-27T20:46:49	Rev1	None	None
PL-GIFT	0.02697	0.00483	0.00138	1.0	1562.53	2023-02-06T22:50:08	2023-02-06T22:46:39	Rev1	None	None
PL-GIFT	0.01583	0.00283	0.00049	1.0	1562.55	2023-02-07T02:10:07	2023-02-07T02:04:27	Rev1	None	None
PL-GIFT	13.81552	2.47191	0.5	0.5	1562.53	2023-02-07T23:50:07	2023-02-07T23:45:48	Rev1	None	None
PL-GIFT	0.02695	0.00482	0.00138	1.0	1562.59	2023-02-08T02:40:07	2023-02-08T02:30:58	Rev1	None	None
PL-GIFT	0.02288	0.00409	0.001	1.0	1564.66	2023-02-14T23:10:07	2023-02-14T23:09:55	Rev1	None	None
PL-GIFT	0.01582	0.00283	0.00048	1.0	1562.59	2023-02-27T19:30:07	2023-02-27T19:26:23	Rev1	None	None
Perspecta-PurdueRutgers	0.19999	0.01898	0.03814	1.0	721.17	2023-01-09T04:30:10	2023-01-09T04:29:12	Rev1	None	None
Perspecta-PurdueRutgers	0.08418	0.00985	0.00865	1.0	722.61	2023-01-09T17:00:10	2023-01-09T16:54:11	Rev1	None	None
Perspecta-PurdueRutgers	0.51244	0.0778	0.17082	0.87069	1007.33	2023-01-09T18:30:10	2023-01-09T18:20:49	Rev1	None	None
Perspecta-PurdueRutgers	0.06007	0.00858	0.00521	1.0	1681.38	2023-01-11T21:10:09	2023-01-11T21:05:12	Rev1	None	None
Perspecta-PurdueRutgers	0.0	0.0	0.0	1.0	1681.42	2023-01-12T04:10:09	2023-01-12T04:09:29	Rev1	None	None
Perspecta-PurdueRutgers	0.04568	0.00703	0.00326	1.0	1680.51	2023-01-12T15:30:11	2023-01-12T15:22:35	Rev1	None	None
Perspecta-PurdueRutgers	0.04169	0.00746	0.0032	1.0	1681.5	2023-01-12T18:40:10	2023-01-12T18:39:26	Rev1	None	None
Perspecta-PurdueRutgers	0.09833	0.01098	0.0114	1.0	1679.49	2023-01-17T16:00:10	2023-01-17T15:50:39	Rev1	None	None
Perspecta-PurdueRutgers	0.04253	0.0069	0.00297	1.0	1682.51	2023-01-19T19:30:09	2023-01-19T19:23:56	Rev1	None	None
Perspecta-PurdueRutgers	0.05973	0.00909	0.00536	1.0	1679.51	2023-01-20T02:00:10	2023-01-20T01:57:56	Rev1	None	None
Perspecta-PurdueRutgers	0.05973	0.00909	0.00536	1.0	1682.45	2023-01-20T02:50:10	2023-01-20T02:47:02	Rev1	None	None
Perspecta-IUB	0.20625	0.01009	0.03635	1.0	721.12	2022-12-22T04:20:09	2022-12-22T04:15:36	Rev1	None	None
Perspecta-IUB	0.6908	0.01302	0.24883	0.55153	721.13	2022-12-22T06:10:09	2022-12-22T06:02:15	Rev1	None	None
Perspecta-IUB	0.20235	0.01001	0.03515	1.0	721.14	2022-12-22T15:30:08	2022-12-22T15:26:57	Rev1	None	None
Perspecta-IUB	0.20625	0.01009	0.03635	1.0	721.13	2022-12-22T16:20:10	2022-12-22T16:17:06	Rev1	None	None
Perspecta-IUB	0.20807	0.01127	0.03724	1.0	721.07	2022-12-22T17:00:53	2022-12-22T16:59:47	Rev1	None	None
Perspecta-IUB	0.20986	0.01052	0.03753	1.0	721.14	2022-12-22T21:20:10	2022-12-22T21:16:13	Rev1	None	None
Perspecta-IUB	0.19326	0.02506	0.04072	1.0	721.12	2022-12-22T22:00:46	2022-12-22T22:00:27	Rev1	None	None
Perspecta-IUB	0.20196	0.0271	0.04472	1.0	721.12	2022-12-23T00:00:09	2022-12-22T23:56:50	Rev1	None	None
Perspecta-IUB	0.20583	0.04457	0.05257	0.98917	721.28	2022-12-26T22:00:10	2022-12-26T21:53:57	Rev1	None	None
Perspecta-IUB	0.16279	0.08496	0.05168	0.98528	721.32	2023-01-08T22:00:10	2023-01-08T22:00:02	Rev1	None	None
Perspecta-IUB	0.13407	0.08799	0.04131	0.99333	721.35	2023-01-08T22:30:10	2023-01-08T22:23:34	Rev1	None	None
Perspecta-IUB	0.24641	0.10146	0.07292	0.96083	721.37	2023-01-09T06:10:11	2023-01-09T06:07:56	Rev1	None	None
Perspecta-IUB	0.22933	0.09522	0.06568	0.96889	721.31	2023-01-09T07:00:11	2023-01-09T06:50:44	Rev1	None	None
Perspecta-IUB	0.21047	0.0438	0.05351	0.98917	721.32	2023-01-09T15:00:11	2023-01-09T14:57:44	Rev1	None	None
Perspecta-IUB	0.12591	0.0324	0.02836	0.99806	721.34	2023-01-10T05:20:11	2023-01-10T05:18:47	Rev1	None	None
Perspecta-IUB	0.03346	0.01571	0.00518	1.0	721.31	2023-01-10T05:42:37	2023-01-10T05:40:51	Rev1	None	None
Perspecta-IUB	0.0	0.0	0.0	1.0	721.47	2023-01-13T05:00:10	2023-01-13T04:54:04	Rev1	None	None
Perspecta-IUB	0.0	0.0	0.0	1.0	721.47	2023-01-13T05:50:10	2023-01-13T05:46:18	Rev1	None	None
Perspecta-IUB	0.0	0.0	0.0	1.0	721.33	2023-01-13T14:10:10	2023-01-13T14:05:18	Rev1	None	None
Perspecta-IUB	0.05129	0.0	0.0025	1.0	721.24	2023-01-13T14:51:42	2023-01-13T14:45:01	Rev1	None	None
Perspecta-IUB	0.05129	0.0	0.0025	1.0	721.31	2023-01-13T16:00:10	2023-01-13T15:55:46	Rev1	None	None
Perspecta-IUB	0.03355	0.013	0.00501	1.0	1682.46	2023-02-22T02:20:11	2023-02-22T02:19:45	Rev1	None	None
Perspecta-IUB	0.14775	0.05817	0.04285	0.98944	721.42	2023-02-22T03:40:59	2023-02-22T03:35:07	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	890.81	2023-01-28T07:33:12	2023-01-28T07:27:58	Rev1	None	None
ARM-UCSD	0.0	0.0	0.0	1.0	655.81	2023-01-30T07:40:18	2023-01-30T07:31:28	Rev1	None	None
ARM-UCSD	9e-05	2e-05	0.0	1.0	721.34	2023-02-22T04:50:17	2023-02-22T04:43:46	Rev1	None	None
ARM-UCSD	9e-05	2e-05	0.0	1.0	721.37	2023-02-28T00:50:18	2023-02-28T00:48:03	Rev1	None	None
ARM-UCSD	0.09682	0.02563	0.01862	0.99972	721.39	2023-03-01T22:20:17	2023-03-01T22:16:53	Rev1	None	None
ARM-UCSD	10.13138	2.3824	0.36667	0.63333	1202.68	2023-03-01T23:20:17	2023-03-01T23:15:35	Rev1	None	None
ARM-UCSD	11.74319	2.44394	0.425	0.575	1209.77	2023-03-02T00:50:17	2023-03-02T00:45:54	Rev1	None	None
ARM-UCSD	0.0	0.0	0.0	1.0	806.72	2023-03-20T19:20:17	2023-03-20T19:18:10	Rev1	None	None
ARM-UCSD	0.0	0.0	0.0	1.0	818.59	2023-03-20T23:10:18	2023-03-20T23:00:14	Rev1	None	None
ARM-UCSD	0.0	0.0	0.0	1.0	766.44	2023-03-26T00:40:18	2023-03-26T00:39:36	Rev1	None	None
ARM-UCSD	11.74319	2.44394	0.425	0.575	759.9	2023-03-28T02:41:06	2023-03-28T02:34:06	Rev1	None	None
ARM-UCSD	0.0	0.0	0.0	1.0	747.16	2023-03-28T03:01:04	2023-03-28T02:54:42	Rev1	None	None
ARM	0.15302	0.0222	0.02839	1.0	842.55	2023-01-27T21:51:08	2023-01-27T21:41:02	Rev1	None	None
ARM	0.38659	0.04736	0.11528	0.95167	1682.95	2023-01-30T05:42:16	2023-01-30T05:31:46	Rev1	None	None
ARM	0.29844	0.03951	0.08059	0.99028	1684.29	2023-02-07T05:40:22	2023-02-07T05:33:21	Rev1	None	None
ARM	0.13365	0.06718	0.0367	0.99222	2644.53	2023-02-21T19:40:22	2023-02-21T19:33:03	Rev1	None	None
ARM	0.10772	0.05816	0.03051	0.99389	2641.24	2023-02-28T20:00:23	2023-02-28T19:51:20	Rev1	None	None
ARM	0.05756	0.04348	0.02068	0.99806	1803.03	2023-03-02T03:10:22	2023-03-02T03:05:28	Rev1	None	None
ARM	0.06836	0.03774	0.01752	0.99833	1904.95	2023-03-02T04:20:22	2023-03-02T04:14:42	Rev1	None	None
ARM	0.25592	0.44957	0.01709	0.99056	1902.02	2023-03-07T15:20:21	2023-03-07T15:15:51	Rev1	None	None
ARM	0.06702	0.03601	0.01759	0.99833	2040.37	2023-03-07T18:40:21	2023-03-07T18:32:05	Rev1	None	None
TrinitySRITrojAI-SBU	0.32367	0.05743	0.0937	0.95917	1683.09	2023-02-12T03:10:22	2023-02-12T03:09:37	Rev1	None	None
TrinitySRITrojAI-SBU	0.32043	0.02285	0.07871	0.99778	1683.08	2023-02-21T20:51:11	2023-02-21T20:45:45	Rev1	None	None
TrinitySRITrojAI-SBU	0.0633	0.01153	0.00666	1.0	1682.83	2023-02-21T21:45:10	2023-02-21T21:39:55	Rev1	None	None
TrinitySRITrojAI-SBU	0.09722	0.00952	0.01051	1.0	1683.16	2023-02-22T08:30:21	2023-02-22T08:22:01	Rev1	None	None
TrinitySRITrojAI-SBU	0.19435	0.01943	0.03643	1.0	1682.86	2023-02-22T21:30:22	2023-02-22T21:23:20	Rev1	None	None
TrinitySRITrojAI-SBU	0.09953	0.01387	0.0128	1.0	1682.81	2023-02-23T00:40:25	2023-02-23T00:32:53	Rev1	None	None
TrinitySRITrojAI-SBU	0.14249	0.01152	0.01996	1.0	1682.92	2023-02-23T01:30:22	2023-02-23T01:28:02	Rev1	None	None
TrinitySRITrojAI-SBU	0.29397	0.05918	0.08506	0.95917	1682.96	2023-03-07T03:10:24	2023-03-07T03:02:38	Rev1	None	None
TrinitySRITrojAI-SBU	0.06283	0.00882	0.00552	1.0	1682.67	2023-03-07T04:30:24	2023-03-07T04:27:23	Rev1	None	None
TrinitySRITrojAI-SBU	0.2252	0.02376	0.04684	0.99944	1683.0	2023-03-07T05:30:24	2023-03-07T05:28:18	Rev1	None	None
TrinitySRITrojAI-SBU	0.30069	0.03687	0.07441	0.98889	1682.98	2023-03-07T06:51:33	2023-03-07T06:40:38	Rev1	None	None
TrinitySRITrojAI-SBU	0.22655	0.03401	0.05349	0.99472	1689.24	2023-03-07T08:01:18	2023-03-07T07:56:48	Rev1	None	None
TrinitySRITrojAI-SBU	0.11293	0.01364	0.01489	1.0	1682.81	2023-03-07T08:50:24	2023-03-07T08:47:24	Rev1	None	None
TrinitySRITrojAI-SBU	0.18769	0.01839	0.03453	1.0	1682.82	2023-03-07T10:01:40	2023-03-07T09:57:13	Rev1	None	None
TrinitySRITrojAI-SBU	0.14087	0.01034	0.01917	1.0	1685.06	2023-03-07T11:11:11	2023-03-07T11:10:38	Rev1	None	None
TrinitySRITrojAI-SBU	0.13944	0.01112	0.01913	1.0	1682.67	2023-03-07T22:00:24	2023-03-07T21:57:04	Rev1	None	None
TrinitySRITrojAI-SBU	0.14928	0.01101	0.02132	1.0	1682.81	2023-03-07T23:40:24	2023-03-07T23:34:50	Rev1	None	None
TrinitySRITrojAI-SBU	0.18521	0.0227	0.03535	1.0	1683.27	2023-03-08T00:30:24	2023-03-08T00:25:31	Rev1	None	None
TrinitySRITrojAI-SBU	0.07252	0.01547	0.00926	1.0	1682.83	2023-03-08T01:30:24	2023-03-08T01:29:04	Rev1	None	None
ICSI-2	0.26168	0.02563	0.06025	0.99944	618.7	2023-01-06T02:00:21	2023-01-06T01:59:12	Rev1	None	None
ICSI-2	0.01037	0.00055	0.00012	1.0	612.68	2023-01-06T06:50:21	2023-01-06T06:46:27	Rev1	None	None
ICSI-2	0.00391	0.00034	2e-05	1.0	613.68	2023-01-07T01:40:20	2023-01-07T01:37:42	Rev1	None	None
ICSI-2	0.01889	0.00137	0.00041	1.0	608.6	2023-01-12T03:30:21	2023-01-12T03:24:00	Rev1	None	None
ICSI-2	0.02352	0.00201	0.00066	1.0	629.75	2023-01-16T04:50:20	2023-01-16T04:46:56	Rev1	None	None
ICSI-2	0.00408	0.00035	2e-05	1.0	607.66	2023-01-17T05:30:22	2023-01-17T05:23:27	Rev1	None	None
ICSI-2	0.00351	0.0003	2e-05	1.0	637.71	2023-01-18T07:30:20	2023-01-18T07:27:46	Rev1	None	None
ICSI-2	0.01139	0.00135	0.00018	1.0	672.88	2023-01-18T20:30:22	2023-01-18T20:25:15	Rev1	None	None
ICSI-2	0.02222	0.00854	0.00213	1.0	678.84	2023-01-20T01:00:21	2023-01-20T00:52:25	Rev1	None	None
ICSI-2	0.00165	0.00033	1e-05	1.0	654.87	2023-01-20T09:50:22	2023-01-20T09:49:07	Rev1	None	None
ICSI-2	0.00375	0.00032	2e-05	1.0	642.7	2023-01-20T23:50:23	2023-01-20T23:46:33	Rev1	None	None
ICSI-2	0.00317	0.00027	1e-05	1.0	625.65	2023-01-21T00:50:22	2023-01-21T00:47:15	Rev1	None	None
ICSI-2	0.003	0.00023	1e-05	1.0	605.66	2023-01-26T00:40:27	2023-01-26T00:33:56	Rev1	None	None
ICSI-2	0.00803	0.00032	7e-05	1.0	611.67	2023-02-02T07:10:27	2023-02-02T07:09:51	Rev1	None	None
ICSI-2	0.00471	0.00052	3e-05	1.0	715.98	2023-02-02T22:50:25	2023-02-02T22:43:31	Rev1	None	None
ICSI-2	0.00657	0.00031	5e-05	1.0	606.65	2023-02-03T00:40:26	2023-02-03T00:34:11	Rev1	None	None
ICSI-2	0.0001	1e-05	0.0	1.0	632.68	2023-02-03T04:50:24	2023-02-03T04:46:00	Rev1	None	None
ICSI-2	0.00028	2e-05	0.0	1.0	623.75	2023-02-03T08:20:25	2023-02-03T08:17:49	Rev1	None	None
ICSI-2	0.00023	1e-05	0.0	1.0	697.89	2023-02-03T08:50:25	2023-02-03T08:47:45	Rev1	None	None
ICSI-2	9e-05	1e-05	0.0	1.0	607.69	2023-02-04T03:31:32	2023-02-04T03:26:43	Rev1	None	None
ICSI-2	0.0001	1e-05	0.0	1.0	704.94	2023-02-04T04:11:39	2023-02-04T04:00:33	Rev1	None	None
ICSI-2	0.12531	0.09315	0.03218	0.99139	1562.38	2023-02-08T06:40:24	2023-02-08T06:30:48	Rev1	None	None
ICSI-2	0.04147	0.0157	0.00645	1.0	1561.47	2023-02-08T22:10:24	2023-02-08T22:00:53	Rev1	None	None
ICSI-2	0.18679	0.15107	0.03952	0.97111	1562.2	2023-02-08T23:50:24	2023-02-08T23:48:19	Rev1	None	None
ICSI-2	0.0283	0.02025	0.00694	0.99972	1562.41	2023-02-09T03:40:24	2023-02-09T03:40:10	Rev1	None	None
ICSI-2	1e-05	0.0	0.0	1.0	721.04	2023-02-09T07:50:23	2023-02-09T07:44:42	Rev1	None	None
ICSI-2	0.00021	1e-05	0.0	1.0	719.0	2023-02-09T09:00:24	2023-02-09T08:51:22	Rev1	None	None
ICSI-2	0.00046	3e-05	0.0	1.0	719.99	2023-02-09T09:30:25	2023-02-09T09:28:46	Rev1	None	None
ICSI-2	0.07169	0.02548	0.01416	0.99972	1562.46	2023-02-09T20:20:24	2023-02-09T20:11:03	Rev1	None	None
ICSI-2	0.05554	0.02041	0.01005	1.0	1562.4	2023-02-09T23:40:25	2023-02-09T23:31:08	Rev1	None	None
ICSI-2	0.02645	0.01761	0.00608	1.0	1562.49	2023-02-10T03:40:24	2023-02-10T03:32:32	Rev1	None	None
ICSI-2	1e-05	0.0	0.0	1.0	721.02	2023-02-10T07:20:24	2023-02-10T07:19:01	Rev1	None	None
ICSI-2	0.0	0.0	0.0	1.0	721.16	2023-02-21T18:50:26	2023-02-17T10:52:34	Rev1	None	None
ICSI-2	0.0	0.0	0.0	1.0	721.05	2023-02-22T21:20:23	2023-02-22T21:15:18	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-01-09T08:20:25	2023-01-09T08:12:23	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-BostonU	0.89862	0.12701	0.31655	0.46486	722.32	2023-01-09T21:20:24	2023-01-09T21:11:22	Rev1	None	None
TrinitySRITrojAI-BostonU	0.88214	0.12442	0.31617	0.49486	723.24	2023-01-09T22:20:23	2023-01-09T22:11:42	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-01-10T23:10:23	2023-01-10T23:00:29	Rev1	:No Results::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	1.67313	0.30168	0.45623	0.41306	736.3	2023-01-11T07:10:23	2023-01-11T07:02:55	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	721.67	2023-01-18T22:00:24	2023-01-18T21:59:10	Rev1	:No Results:	None
TrinitySRITrojAI-BostonU	0.13604	0.08263	0.03629	0.98778	934.03	2023-01-18T22:50:23	2023-01-18T22:43:10	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00437	0.0006	3e-05	1.0	1710.5	2023-01-19T07:10:23	2023-01-19T07:01:26	Rev1	None	None
TrinitySRITrojAI-BostonU	0.01719	0.00203	0.00041	1.0	1002.86	2023-01-19T09:00:23	2023-01-19T08:57:52	Rev1	None	None
TrinitySRITrojAI-BostonU	0.0001	2e-05	0.0	1.0	940.17	2023-01-19T22:00:24	2023-01-19T21:57:39	Rev1	None	None
TrinitySRITrojAI-BostonU	0.0001	2e-05	0.0	1.0	1531.13	2023-01-20T03:10:23	2023-01-20T03:09:28	Rev1	None	None
TrinitySRITrojAI-BostonU	0.6118	0.02796	0.21047	0.84528	840.01	2023-01-20T06:10:25	2023-01-20T06:06:33	Rev1	None	None
TrinitySRITrojAI-BostonU	0.58119	0.03005	0.1966	0.84278	840.21	2023-01-20T07:11:22	2023-01-20T07:05:16	Rev1	None	None
TrinitySRITrojAI-BostonU	0.73502	0.09406	0.26806	0.66583	841.14	2023-01-20T08:50:25	2023-01-20T08:50:16	Rev1	None	None
TrinitySRITrojAI-BostonU	0.67146	0.05411	0.23825	0.6575	841.22	2023-01-20T19:40:24	2023-01-20T19:32:24	Rev1	None	None
TrinitySRITrojAI-BostonU	0.67146	0.05411	0.23825	0.6575	841.17	2023-01-20T22:51:26	2023-01-20T22:41:49	Rev1	None	None
TrinitySRITrojAI-BostonU	0.73502	0.09406	0.26806	0.66583	841.07	2023-01-21T02:00:24	2023-01-21T01:55:45	Rev1	None	None
TrinitySRITrojAI-BostonU	0.73502	0.09406	0.26806	0.66583	837.09	2023-01-21T04:20:25	2023-01-21T04:17:19	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00531	0.00047	3e-05	1.0	841.78	2023-01-21T05:50:25	2023-01-21T05:42:51	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00405	0.00036	2e-05	1.0	961.43	2023-01-21T07:30:25	2023-01-21T07:21:45	Rev1	None	None
TrinitySRITrojAI-BostonU	0.0046	0.0004	3e-05	1.0	886.08	2023-01-21T13:20:25	2023-01-21T13:10:29	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00405	0.00036	2e-05	1.0	960.3	2023-01-21T14:01:03	2023-01-21T07:21:45	Rev1	None	None
TrinitySRITrojAI-BostonU	0.02604	0.00115	0.0007	1.0	841.41	2023-02-03T15:50:28	2023-02-03T15:42:50	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00405	0.00036	2e-05	1.0	961.42	2023-02-03T16:31:26	2023-01-21T07:21:45	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00637	0.00218	0.00018	1.0	841.28	2023-02-04T22:50:27	2023-02-04T22:41:06	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00405	0.00036	2e-05	1.0	961.41	2023-02-04T23:31:34	2023-01-21T07:21:45	Rev1	None	None
TrinitySRITrojAI-BostonU	0.16275	0.02864	0.03504	1.0	840.15	2023-02-05T19:30:28	2023-02-05T19:21:11	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00405	0.00036	2e-05	1.0	961.46	2023-02-05T20:11:36	2023-01-21T07:21:45	Rev1	None	None
TrinitySRITrojAI-BostonU	0.08278	0.00884	0.0081	1.0	841.39	2023-02-06T01:20:28	2023-02-06T01:19:03	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-02-06T02:01:50	2023-01-21T07:21:45	Rev1	:No Results::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.00175	0.00018	0.0	1.0		2023-02-06T06:40:25	2023-02-06T06:34:02	Rev1	:No Results::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-02-06T07:03:10	2023-01-21T07:21:45	Rev1	:No Results::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.00013	1e-05	0.0	1.0		2023-02-06T08:40:27	2023-02-06T08:34:41	Rev1	:No Results::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.00405	0.00036	2e-05	1.0		2023-02-06T09:02:14	2023-01-21T07:21:45	Rev1	:Executed File Update::No Results::Info File Missing::Log File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.00405	0.00036	2e-05	1.0		2023-02-06T09:11:33	2023-02-06T09:08:22	Rev1	:No Results::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.00405	0.00036	2e-05	1.0		2023-02-06T10:03:01	2023-01-21T07:21:45	Rev1	:Executed File Update::No Results::Info File Missing::Log File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.00442	0.00035	2e-05	1.0		2023-02-06T16:10:28	2023-02-06T16:03:10	Rev1	:No Results::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.00405	0.00036	2e-05	1.0		2023-02-06T16:43:24	2023-01-21T07:21:45	Rev1	:Executed File Update::No Results::Info File Missing::Log File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.00443	0.00036	2e-05	1.0		2023-02-06T17:00:28	2023-02-06T17:00:01	Rev1	:No Results::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.00405	0.00036	2e-05	1.0		2023-02-06T17:42:07	2023-01-21T07:21:45	Rev1	:Executed File Update::No Results::Info File Missing::Log File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.00026	3e-05	0.0	1.0		2023-02-06T18:20:28	2023-02-06T18:15:08	Rev1	:No Results::Info File Missing::Log File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.00115	9e-05	0.0	1.0	841.3	2023-02-07T06:40:27	2023-02-07T06:33:34	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00471	0.00034	3e-05	1.0	1322.14	2023-02-07T18:10:26	2023-02-07T18:07:02	Rev1	None	None
TrinitySRITrojAI-BostonU	0.0058	0.00044	4e-05	1.0	938.36	2023-02-23T16:40:26	2023-02-23T16:35:32	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00019	2e-05	0.0	1.0	309.67	2023-03-14T19:30:27	2023-03-14T19:29:08	Rev1	None	None
trojai-example	0.77147	0.07322	0.28477	0.49111	721.8	2022-12-17T01:19:20	2022-12-17T01:15:03	Rev1	None	None
UMBCb	0.27248	0.02632	0.06398	0.99833	1202.11	2023-01-25T20:30:39	2023-01-25T20:23:10	Rev1	None	None
UMBCb	0.42281	0.02459	0.12137	0.98778	220.51	2023-03-15T17:10:33	2023-03-15T17:03:06	Rev1	None	None
UMBCb	0.2495	0.00287	0.04887	1.0	221.23	2023-03-16T15:00:32	2023-03-16T14:58:32	Rev1	None	None
UMBCb	0.56317	0.01949	0.18616	0.94611	224.0	2023-03-22T20:30:35	2023-03-22T20:22:04	Rev1	None	None
UMBCb	0.33799	0.17334	0.08132	0.94278	224.05	2023-04-17T18:00:32	2023-04-17T17:56:18	Rev1	None	None

Required filename format: "cyber-pdf-dec2022_test_<Submission Name>.simg"
Accepting submissions: True
Number of models in cyber-pdf-dec2022, test: 120
Execution timeout (hh:mm:ss): 20:00:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2023-03-07T18:10:05	performer	None	None	Ok	2023-03-07T18:08:26	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-12-23T22:10:06	performer	None	None	Ok	2023-12-23T22:07:17	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT		performer	None	None	Ok	2023-03-10T19:42:56	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-01-20T02:50:10	performer	None	None	Ok	2023-01-20T02:47:02	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2023-02-22T03:40:59	performer	None	None	Ok	2023-02-22T03:35:07	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2023-03-28T04:20:16	performer	None	None	Ok	2023-03-28T04:19:36	0 d, 0 h, 0 m, 0 s
ARM	2023-03-07T18:40:21	performer	None	Ok	Ok	2023-03-07T18:32:05	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	2023-03-08T01:30:24	performer	None	None	Ok	2023-03-08T01:29:04	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2023-02-22T21:20:23	performer	None	None	Ok	2023-02-22T21:15:18	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-03-14T19:30:27	performer	None	None	Ok	2023-03-14T19:29:08	0 d, 0 h, 0 m, 0 s
trojai-example		public	None	None	Ok	2023-03-10T01:59:38	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2023-04-17T18:00:32	performer	None	None	Ok	2023-04-17T17:56:18	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero	2023-01-25T18:00:43	public	None	None	Ok	2023-01-25T17:59:21	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.24803	0.08159	0.07077	0.97167	1727.18	2023-03-07T18:10:05	2023-03-07T18:08:26	Rev1	None	None
TrinitySRITrojAI	0.38909	0.09694	0.12763	0.90889	1682.7	2023-02-10T23:50:07	2023-02-10T23:47:16	Rev1	None	None
PL-GIFT	0.18979	0.11538	0.05137	0.97694	1562.78	2023-01-18T15:50:08	2023-01-18T15:47:42	Rev1	None	None
Perspecta-PurdueRutgers	0.24399	0.03977	0.06413	0.99222	1682.44	2023-01-19T19:30:09	2023-01-19T19:23:56	Rev1	None	None
Perspecta-IUB	0.43505	0.03073	0.12971	0.97806	721.47	2023-01-13T05:50:10	2023-01-13T05:46:18	Rev1	None	None
ARM-UCSD	0.32994	0.09614	0.10488	0.9325	721.38	2023-03-01T22:20:17	2023-03-01T22:16:53	Rev1	None	None
ARM	0.18463	0.07603	0.05568	0.98167	1903.02	2023-03-02T04:20:22	2023-03-02T04:14:42	Rev1	None	None
TrinitySRITrojAI-SBU	0.33386	0.11125	0.10128	0.92694	1682.81	2023-02-21T21:45:10	2023-02-21T21:39:55	Rev1	None	None
ICSI-2	0.27954	0.04119	0.07348	0.98667	613.74	2023-02-02T07:10:27	2023-02-02T07:09:51	Rev1	None	None
TrinitySRITrojAI-BostonU	0.47983	0.02604	0.14871	0.99056	1322.31	2023-02-07T18:10:26	2023-02-07T18:07:02	Rev1	None	None
trojai-example	0.71866	0.08293	0.25641	0.60194	722.81	2023-01-25T20:00:36	2023-01-25T19:58:01	Rev1	None	:Schema Header:
UMBCb	0.66859	0.0518	0.2377	0.63681	218.36	2023-03-16T15:00:32	2023-03-16T14:58:32	Rev1	None	None
DS3TwoSixZero	0.69315	0.0	0.25	0.5		2023-01-25T14:00:43	2023-01-25T13:52:46	Rev1	:No Results::Info File Missing:	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.72374	0.07243	0.26029	0.56514	1203.97	2023-01-03T21:50:04	2023-01-03T21:43:42	Rev1	None	None
Perspecta	0.29508	0.09189	0.09126	0.94056	1562.6	2023-01-04T18:50:05	2023-01-04T18:42:32	Rev1	None	None
Perspecta	0.346	0.10052	0.11404	0.92028	1562.62	2023-01-05T15:40:05	2023-01-05T15:36:11	Rev1	None	None
Perspecta	0.31321	0.11506	0.09281	0.93778	1562.68	2023-01-10T18:10:05	2023-01-10T18:08:25	Rev1	None	None
Perspecta	0.3152	0.10639	0.09642	0.93431	1562.71	2023-01-11T15:40:05	2023-01-11T15:35:21	Rev1	None	None
Perspecta	0.29114	0.12942	0.08111	0.95056	1562.57	2023-01-11T20:00:05	2023-01-11T19:50:59	Rev1	None	None
Perspecta	0.29694	0.10173	0.08431	0.94806	1562.68	2023-01-12T19:50:05	2023-01-12T19:44:09	Rev1	None	None
Perspecta	0.30506	0.12784	0.08745	0.94333	1562.68	2023-01-12T22:30:05	2023-01-12T22:29:31	Rev1	None	None
Perspecta	0.27719	0.09862	0.08009	0.94597	1562.68	2023-01-13T15:40:05	2023-01-13T15:37:07	Rev1	None	None
Perspecta	0.27505	0.08933	0.07641	0.95042	1562.64	2023-01-13T18:30:05	2023-01-13T18:21:16	Rev1	None	None
Perspecta	0.27252	0.08201	0.07475	0.95611	1670.49	2023-01-16T22:00:04	2023-01-16T21:56:54	Rev1	None	None
Perspecta	0.29227	0.08136	0.08384	0.95417	1669.33	2023-01-17T14:10:05	2023-01-17T14:01:07	Rev1	None	None
Perspecta	0.25285	0.07943	0.06889	0.95986	1722.89	2023-01-18T15:30:05	2023-01-18T15:24:47	Rev1	None	None
Perspecta	0.24794	0.07786	0.06691	0.96625	1724.52	2023-01-31T00:40:04	2023-01-31T00:34:29	Rev1	None	None
Perspecta	0.24753	0.08012	0.06752	0.96208	1719.99	2023-01-31T02:10:04	2023-01-31T02:02:09	Rev1	None	None
Perspecta	0.24961	0.07433	0.06558	0.96333	1727.71	2023-02-01T00:50:04	2023-02-01T00:48:19	Rev1	None	None
Perspecta	0.24331	0.08094	0.06451	0.95944	1717.35	2023-02-07T18:40:04	2023-02-07T18:38:40	Rev1	None	None
Perspecta	0.28507	0.06364	0.07717	0.965	1723.15	2023-02-21T19:02:53	2023-02-21T19:02:33	Rev1	None	None
Perspecta	0.25412	0.09835	0.06989	0.95431	1723.01	2023-03-03T15:40:04	2023-03-03T15:38:40	Rev1	None	None
Perspecta	0.24803	0.08159	0.07077	0.97167	1727.18	2023-03-07T18:10:05	2023-03-07T18:08:26	Rev1	None	None
TrinitySRITrojAI	0.46693	0.13112	0.14883	0.88389	2478.77	2022-12-20T00:20:06	2022-12-20T00:14:31	Rev1	None	None
TrinitySRITrojAI	1.06991	0.28863	0.29005	0.89778	2908.78	2022-12-20T16:27:12	2022-12-20T16:20:56	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5		2022-12-20T19:08:05	2022-12-20T19:00:38	Rev1	:No Results::Info File Missing:	None
TrinitySRITrojAI	0.41554	0.1265	0.12764	0.89972	2368.69	2023-01-05T20:00:06	2023-01-05T19:57:36	Rev1	None	None
TrinitySRITrojAI	0.49752	0.19396	0.13208	0.87667	2121.55	2023-02-03T04:20:06	2023-02-03T04:13:58	Rev1	None	None
TrinitySRITrojAI	0.38909	0.09694	0.12763	0.90889	1682.7	2023-02-10T23:50:07	2023-02-10T23:47:16	Rev1	None	None
TrinitySRITrojAI	0.42017	0.09819	0.13497	0.89889	578.9	2023-03-17T21:50:06	2023-03-17T21:49:35	Rev1	None	None
TrinitySRITrojAI	0.58172	0.07755	0.202	0.75417	1307.46	2023-12-23T22:10:06	2023-12-23T22:07:17	Rev1	None	None
PL-GIFT	0.29848	0.07758	0.10036	0.93972	1562.85	2022-12-22T01:00:08	2022-12-22T00:58:23	Rev1	None	None
PL-GIFT	0.98134	0.78035	0.10221	0.92819	1562.56	2023-01-11T03:50:09	2023-01-11T03:46:57	Rev1	None	None
PL-GIFT	0.38554	0.45699	0.05246	0.97333	1562.67	2023-01-14T03:30:08	2023-01-14T03:23:08	Rev1	None	None
PL-GIFT	0.21011	0.14324	0.05154	0.97389	1562.69	2023-01-16T19:00:08	2023-01-16T18:57:00	Rev1	None	None
PL-GIFT	0.38794	0.45912	0.05067	0.97	1562.69	2023-01-17T16:50:08	2023-01-17T16:49:35	Rev1	None	None
PL-GIFT	0.20446	0.13166	0.05235	0.97528	1562.64	2023-01-17T18:10:09	2023-01-17T18:06:04	Rev1	None	None
PL-GIFT	0.18979	0.11538	0.05137	0.97694	1562.78	2023-01-18T15:50:08	2023-01-18T15:47:42	Rev1	None	None
PL-GIFT	0.21197	0.11751	0.05577	0.9625	1562.72	2023-01-18T17:10:09	2023-01-18T17:03:24	Rev1	None	None
PL-GIFT	0.26548	0.11429	0.0842	0.95472	1562.88	2023-01-19T17:10:08	2023-01-19T17:01:45	Rev1	None	None
PL-GIFT	0.19827	0.12362	0.05236	0.97694	1562.63	2023-01-19T20:30:08	2023-01-19T20:28:23	Rev1	None	None
PL-GIFT	0.46956	0.24665	0.0981	0.9	1565.09	2023-01-27T20:50:08	2023-01-27T20:46:49	Rev1	None	None
PL-GIFT	0.37927	0.45432	0.04779	0.96583	1563.65	2023-02-06T22:50:08	2023-02-06T22:46:39	Rev1	None	None
PL-GIFT	0.40494	0.45541	0.05843	0.96444	1562.55	2023-02-07T02:10:07	2023-02-07T02:04:27	Rev1	None	None
PL-GIFT	13.81552	2.47191	0.5	0.5	1562.54	2023-02-07T23:50:07	2023-02-07T23:45:48	Rev1	None	None
PL-GIFT	0.47618	0.46439	0.07718	0.93431	1562.48	2023-02-08T02:40:07	2023-02-08T02:30:58	Rev1	None	None
PL-GIFT	0.4776	0.4641	0.07836	0.93347	1562.58	2023-02-14T23:10:07	2023-02-14T23:09:55	Rev1	None	None
PL-GIFT	0.50913	0.46946	0.08441	0.93153	1562.59	2023-02-27T19:30:07	2023-02-27T19:26:23	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2023-03-10T23:40:08	2023-03-10T19:42:56	Rev1	:No Results:	:Container Parameters (jsonschema checker):
Perspecta-PurdueRutgers	0.79835	0.08865	0.29499	0.49	721.19	2023-01-09T04:30:10	2023-01-09T04:29:12	Rev1	None	None
Perspecta-PurdueRutgers	0.88069	0.12824	0.31729	0.49472	721.18	2023-01-09T17:00:10	2023-01-09T16:54:11	Rev1	None	None
Perspecta-PurdueRutgers	1.03911	0.14509	0.37172	0.43236	1005.23	2023-01-09T18:30:10	2023-01-09T18:20:49	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2023-01-11T04:40:09	2023-01-11T04:37:04	Rev1	:No Results:	:Container Parameters (jsonschema checker):
Perspecta-PurdueRutgers	0.29205	0.04776	0.0822	0.97472	1680.55	2023-01-11T21:10:09	2023-01-11T21:05:12	Rev1	None	None
Perspecta-PurdueRutgers	2.7631	1.48315	0.1	0.9	1681.46	2023-01-12T04:10:09	2023-01-12T04:09:29	Rev1	None	None
Perspecta-PurdueRutgers	0.24422	0.04607	0.06461	0.98611	1680.42	2023-01-12T15:30:11	2023-01-12T15:22:35	Rev1	None	None
Perspecta-PurdueRutgers	0.14693	0.08905	0.03847	0.95833	1680.45	2023-01-12T18:40:10	2023-01-12T18:39:26	Rev1	None	None
Perspecta-PurdueRutgers	0.35276	0.05991	0.10775	0.93444	1681.46	2023-01-17T16:00:10	2023-01-17T15:50:39	Rev1	None	None
Perspecta-PurdueRutgers	0.24399	0.03977	0.06413	0.99222	1682.44	2023-01-19T19:30:09	2023-01-19T19:23:56	Rev1	None	None
Perspecta-PurdueRutgers	0.26835	0.05463	0.07783	0.97361	1678.43	2023-01-20T02:00:10	2023-01-20T01:57:56	Rev1	None	None
Perspecta-PurdueRutgers	0.26835	0.05463	0.07783	0.97361	1682.51	2023-01-20T02:50:10	2023-01-20T02:47:02	Rev1	None	None
Perspecta-IUB	0.68263	0.03081	0.24468	0.59556	722.16	2022-12-22T04:20:09	2022-12-22T04:15:36	Rev1	None	None
Perspecta-IUB	0.69594	0.01211	0.25139	0.495	721.1	2022-12-22T06:10:09	2022-12-22T06:02:15	Rev1	None	None
Perspecta-IUB	0.69244	0.02866	0.24958	0.55111	721.14	2022-12-22T15:30:08	2022-12-22T15:26:57	Rev1	None	None
Perspecta-IUB	0.68263	0.03081	0.24468	0.59556	722.61	2022-12-22T16:20:10	2022-12-22T16:17:06	Rev1	None	None
Perspecta-IUB	0.70219	0.03344	0.25436	0.50958	721.06	2022-12-22T17:00:53	2022-12-22T16:59:47	Rev1	None	None
Perspecta-IUB	0.70479	0.03269	0.25544	0.52708	721.12	2022-12-22T21:20:10	2022-12-22T21:16:13	Rev1	None	None
Perspecta-IUB	1.14085	0.21664	0.36223	0.45403	721.15	2022-12-22T22:00:46	2022-12-22T22:00:27	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2022-12-22T22:50:09	2022-12-22T22:49:45	Rev1	:No Results::Info File Missing:	None
Perspecta-IUB	1.21276	0.21291	0.38335	0.4275	721.17	2022-12-23T00:00:09	2022-12-22T23:56:50	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	721.1	2022-12-26T05:30:09	2022-12-26T05:22:29	Rev1	:No Results:	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	720.02	2022-12-26T15:40:10	2022-12-26T15:35:17	Rev1	:No Results:	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	720.01	2022-12-26T20:10:09	2022-12-26T20:01:18	Rev1	:No Results:	None
Perspecta-IUB	0.48499	0.08365	0.1608	0.84361	721.29	2022-12-26T22:00:10	2022-12-26T21:53:57	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-01-04T22:20:10	2023-01-04T22:15:40	Rev1	:No Results:	:Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-01-05T00:50:09	2023-01-05T00:48:17	Rev1	:No Results:	:Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-01-08T05:30:09	2023-01-08T05:26:15	Rev1	:No Results:	:Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-01-08T06:20:09	2023-01-08T06:11:09	Rev1	:No Results:	:Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-01-08T07:10:10	2023-01-08T07:02:34	Rev1	:No Results:	:Container Parameters (jsonschema checker)::Schema Header:
Perspecta-IUB	1.53245	0.32701	0.42063	0.45167	721.34	2023-01-08T22:00:10	2023-01-08T22:00:02	Rev1	None	None
Perspecta-IUB	1.3411	0.31132	0.3782	0.50667	727.36	2023-01-08T22:30:10	2023-01-08T22:23:34	Rev1	None	None
Perspecta-IUB	1.1525	0.23471	0.35092	0.51667	721.36	2023-01-09T06:10:11	2023-01-09T06:07:56	Rev1	None	None
Perspecta-IUB	1.12677	0.203	0.36252	0.45278	721.35	2023-01-09T07:00:11	2023-01-09T06:50:44	Rev1	None	None
Perspecta-IUB	0.48616	0.08171	0.1611	0.84361	721.28	2023-01-09T15:00:11	2023-01-09T14:57:44	Rev1	None	None
Perspecta-IUB	0.29245	0.06881	0.08705	0.95778	721.2	2023-01-10T05:20:11	2023-01-10T05:18:47	Rev1	None	None
Perspecta-IUB	0.22701	0.08594	0.0653	0.9675	721.17	2023-01-10T05:42:37	2023-01-10T05:40:51	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	721.33	2023-01-13T04:10:11	2023-01-13T04:01:54	Rev1	:No Results:	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	721.3	2023-01-13T04:32:06	2023-01-13T04:22:57	Rev1	:No Results:	None
Perspecta-IUB	0.40597	0.03456	0.11885	0.97625	721.5	2023-01-13T05:00:10	2023-01-13T04:54:04	Rev1	None	None
Perspecta-IUB	0.43505	0.03073	0.12971	0.97806	721.47	2023-01-13T05:50:10	2023-01-13T05:46:18	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5	721.35	2023-01-13T06:11:19	2023-01-13T05:56:56	Rev1	:No Results:	None
Perspecta-IUB	0.26968	0.16843	0.07472	0.97278	721.39	2023-01-13T14:10:10	2023-01-13T14:05:18	Rev1	None	None
Perspecta-IUB	0.33854	0.13285	0.10193	0.9625	721.26	2023-01-13T14:51:42	2023-01-13T14:45:01	Rev1	None	None
Perspecta-IUB	0.26843	0.10493	0.08073	0.97056	721.39	2023-01-13T16:00:10	2023-01-13T15:55:46	Rev1	None	None
Perspecta-IUB	0.26843	0.10493	0.08073	0.97056	726.33	2023-01-13T16:30:11	2023-01-13T16:22:20	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-01-24T18:00:17	2023-01-21T21:17:43	Rev1	:No Results:	:Container Parameters (jsonschema checker)::Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-01-24T20:00:13	2023-01-24T19:53:49	Rev1	:No Results:	:Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-02-16T07:00:11	2023-02-16T06:53:43	Rev1	:No Results:	:Container Parameters (jsonschema checker)::Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-02-21T18:50:11	2023-02-16T19:06:57	Rev1	:No Results:	:Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-02-21T20:20:10	2023-02-21T20:16:25	Rev1	:No Results:	:Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-02-21T20:32:06	2023-02-21T20:24:52	Rev1	:No Results:	:Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-02-21T23:00:11	2023-02-21T22:53:10	Rev1	:No Results:	:Schema Header:
Perspecta-IUB	0.69315	0.0	0.25	0.5	404.44	2023-02-22T01:20:11	2023-02-22T01:14:47	Rev1	:No Results:	None
Perspecta-IUB	0.25884	0.13882	0.07039	0.97389	1682.46	2023-02-22T02:20:11	2023-02-22T02:19:45	Rev1	None	None
Perspecta-IUB	1.13477	0.26529	0.34799	0.51833	721.39	2023-02-22T03:40:59	2023-02-22T03:35:07	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-01-24T19:00:20	2023-01-24T18:58:23	Rev1	:No Results:	:Schema Header:
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-01-27T22:01:05	2023-01-27T21:51:18	Rev1	:No Results:	:Schema Header:
ARM-UCSD	0.69315	0.0	0.25	0.5	891.81	2023-01-28T07:33:12	2023-01-28T07:27:58	Rev1	None	None
ARM-UCSD	6.02738	1.47401	0.47249	0.52028	673.83	2023-01-30T07:40:18	2023-01-30T07:31:28	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	721.32	2023-02-21T18:50:18	2023-02-16T17:42:42	Rev1	:No Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	721.41	2023-02-21T20:32:13	2023-02-21T20:26:33	Rev1	:Result Parse::No Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	721.38	2023-02-21T21:10:17	2023-02-21T21:07:22	Rev1	:No Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-02-21T22:00:16	2023-02-21T21:53:29	Rev1	:No Results:	:Schema Header:
ARM-UCSD	0.69315	0.0	0.25	0.5	721.38	2023-02-22T04:10:18	2023-02-22T04:09:27	Rev1	:No Results:	None
ARM-UCSD	0.88369	0.46271	0.11091	0.93083	724.35	2023-02-22T04:50:17	2023-02-22T04:43:46	Rev1	None	None
ARM-UCSD	0.88369	0.46271	0.11091	0.93083	721.36	2023-02-28T00:50:18	2023-02-28T00:48:03	Rev1	None	None
ARM-UCSD	0.32994	0.09614	0.10488	0.9325	721.38	2023-03-01T22:20:17	2023-03-01T22:16:53	Rev1	None	None
ARM-UCSD	12.66423	2.46331	0.45833	0.54167	1204.59	2023-03-01T23:20:17	2023-03-01T23:15:35	Rev1	None	None
ARM-UCSD	9.4406	2.3447	0.34167	0.65833	1206.63	2023-03-02T00:50:17	2023-03-02T00:45:54	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-03-20T18:00:17	2023-03-20T17:54:08	Rev1	:No Results:	:Container Parameters (jsonschema checker):
ARM-UCSD	2.7631	1.48315	0.1	0.9	818.43	2023-03-20T19:20:17	2023-03-20T19:18:10	Rev1	None	None
ARM-UCSD	2.7631	1.48315	0.1	0.9	839.75	2023-03-20T23:10:18	2023-03-20T23:00:14	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	450.66	2023-03-24T23:10:16	2023-03-24T23:07:19	Rev1	:No Results::Missing Results:	None
ARM-UCSD	3.68414	1.68058	0.13333	0.86667	767.29	2023-03-26T00:40:18	2023-03-26T00:39:36	Rev1	None	None
ARM-UCSD	13.12475	2.46882	0.475	0.525	749.46	2023-03-28T02:41:06	2023-03-28T02:34:06	Rev1	None	None
ARM-UCSD	2.99336	1.53654	0.10833	0.89167	760.26	2023-03-28T03:01:04	2023-03-28T02:54:42	Rev1	None	None
ARM-UCSD	2.99336	1.53654	0.10833	0.89167	748.7	2023-03-28T03:50:15	2023-03-28T03:42:29	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	221.49	2023-03-28T04:20:16	2023-03-28T04:19:36	Rev1	:No Results::Missing Results:	None
ARM	0.62026	0.0759	0.2167	0.71361	1682.92	2023-01-30T05:42:16	2023-01-30T05:31:46	Rev1	None	None
ARM	0.4323	0.05613	0.13551	0.92167	1684.35	2023-02-07T05:40:22	2023-02-07T05:33:21	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5	808.0	2023-02-07T07:30:21	2023-02-07T07:21:55	Rev1	:No Results:	None
ARM	0.69315	0.0	0.25	0.5	804.07	2023-02-07T08:52:22	2023-02-07T08:43:09	Rev1	:No Results:	None
ARM	0.26805	0.09077	0.08846	0.95389	2649.37	2023-02-21T19:40:22	2023-02-21T19:33:03	Rev1	None	None
ARM	0.19922	0.07307	0.06169	0.97472	2644.32	2023-02-28T20:00:23	2023-02-28T19:51:20	Rev1	None	None
ARM	0.58205	0.63231	0.05713	0.97028	1802.97	2023-03-02T03:10:22	2023-03-02T03:05:28	Rev1	None	None
ARM	0.18463	0.07603	0.05568	0.98167	1903.02	2023-03-02T04:20:22	2023-03-02T04:14:42	Rev1	None	None
ARM	1.03475	0.88594	0.07241	0.95431	1900.12	2023-03-07T15:20:21	2023-03-07T15:15:51	Rev1	None	None
ARM	0.19389	0.08087	0.05872	0.9775	2040.26	2023-03-07T18:40:21	2023-03-07T18:32:05	Rev1	None	None
TrinitySRITrojAI-SBU	0.44231	0.08923	0.14152	0.87889	1682.79	2023-02-12T03:10:22	2023-02-12T03:09:37	Rev1	None	None
TrinitySRITrojAI-SBU	0.52048	0.06598	0.16871	0.82417	1683.11	2023-02-21T20:51:11	2023-02-21T20:45:45	Rev1	None	None
TrinitySRITrojAI-SBU	0.33386	0.11125	0.10128	0.92694	1682.81	2023-02-21T21:45:10	2023-02-21T21:39:55	Rev1	None	None
TrinitySRITrojAI-SBU	0.40936	0.1111	0.12186	0.88972	1682.81	2023-02-22T08:30:21	2023-02-22T08:22:01	Rev1	None	None
TrinitySRITrojAI-SBU	0.41487	0.09098	0.12656	0.88778	1684.06	2023-02-22T21:30:22	2023-02-22T21:23:20	Rev1	None	None
TrinitySRITrojAI-SBU	0.49748	0.15181	0.14534	0.84111	1682.82	2023-02-23T00:40:25	2023-02-23T00:32:53	Rev1	None	None
TrinitySRITrojAI-SBU	0.42233	0.10675	0.13111	0.89417	1682.8	2023-02-23T01:30:22	2023-02-23T01:28:02	Rev1	None	None
TrinitySRITrojAI-SBU	0.41052	0.07983	0.13501	0.8875	1682.98	2023-03-07T03:10:24	2023-03-07T03:02:38	Rev1	None	None
TrinitySRITrojAI-SBU	0.36867	0.12521	0.11111	0.91778	1682.95	2023-03-07T04:30:24	2023-03-07T04:27:23	Rev1	None	None
TrinitySRITrojAI-SBU	0.42617	0.08238	0.13299	0.88833	1682.94	2023-03-07T05:30:24	2023-03-07T05:28:18	Rev1	None	None
TrinitySRITrojAI-SBU	0.48938	0.07834	0.15611	0.87333	1682.76	2023-03-07T06:51:33	2023-03-07T06:40:38	Rev1	None	None
TrinitySRITrojAI-SBU	0.40384	0.08414	0.12773	0.90361	1695.05	2023-03-07T08:01:18	2023-03-07T07:56:48	Rev1	None	None
TrinitySRITrojAI-SBU	0.43446	0.11063	0.13715	0.87972	1682.63	2023-03-07T08:50:24	2023-03-07T08:47:24	Rev1	None	None
TrinitySRITrojAI-SBU	0.45159	0.10238	0.1361	0.87111	1682.63	2023-03-07T10:01:40	2023-03-07T09:57:13	Rev1	None	None
TrinitySRITrojAI-SBU	0.45183	0.11508	0.14198	0.87833	1690.0	2023-03-07T11:11:11	2023-03-07T11:10:38	Rev1	None	None
TrinitySRITrojAI-SBU	0.47719	0.11797	0.1514	0.85056	1683.13	2023-03-07T22:00:24	2023-03-07T21:57:04	Rev1	None	None
TrinitySRITrojAI-SBU	0.41051	0.10438	0.12456	0.89139	1682.99	2023-03-07T23:40:24	2023-03-07T23:34:50	Rev1	None	None
TrinitySRITrojAI-SBU	0.45128	0.11133	0.1357	0.85556	1682.81	2023-03-08T00:30:24	2023-03-08T00:25:31	Rev1	None	None
TrinitySRITrojAI-SBU	0.38533	0.11717	0.12085	0.90444	1682.72	2023-03-08T01:30:24	2023-03-08T01:29:04	Rev1	None	None
ICSI-2	0.49301	0.07532	0.16352	0.84556	615.75	2023-01-06T02:00:21	2023-01-06T01:59:12	Rev1	None	None
ICSI-2	0.49665	0.10753	0.16082	0.85222	610.68	2023-01-06T06:50:21	2023-01-06T06:46:27	Rev1	None	None
ICSI-2	0.26685	0.10338	0.07591	0.95417	608.69	2023-01-07T01:40:20	2023-01-07T01:37:42	Rev1	None	None
ICSI-2	0.51188	0.13631	0.16517	0.84611	604.66	2023-01-12T03:30:21	2023-01-12T03:24:00	Rev1	None	None
ICSI-2	0.29234	0.07215	0.08944	0.95278	625.81	2023-01-16T04:50:20	2023-01-16T04:46:56	Rev1	None	None
ICSI-2	0.32812	0.1145	0.10246	0.93472	617.71	2023-01-17T05:30:22	2023-01-17T05:23:27	Rev1	None	None
ICSI-2	0.27823	0.08774	0.08222	0.94972	668.77	2023-01-18T07:30:20	2023-01-18T07:27:46	Rev1	None	None
ICSI-2	0.30344	0.10133	0.09633	0.94944	675.87	2023-01-18T20:30:22	2023-01-18T20:25:15	Rev1	None	None
ICSI-2	0.41383	0.19721	0.10364	0.92111	680.77	2023-01-20T01:00:21	2023-01-20T00:52:25	Rev1	None	None
ICSI-2	0.28219	0.12809	0.07606	0.95222	665.77	2023-01-20T09:50:22	2023-01-20T09:49:07	Rev1	None	None
ICSI-2	0.27648	0.10897	0.07877	0.95278	629.64	2023-01-20T23:50:23	2023-01-20T23:46:33	Rev1	None	None
ICSI-2	0.27064	0.10972	0.07737	0.95417	635.72	2023-01-21T00:50:22	2023-01-21T00:47:15	Rev1	None	None
ICSI-2	0.69315	0.0	0.25	0.5		2023-01-24T18:00:29	2023-01-23T23:49:23	Rev1	:No Results::Info File Missing:	None
ICSI-2	0.33948	0.12738	0.105	0.93444	605.66	2023-01-26T00:40:27	2023-01-26T00:33:56	Rev1	None	None
ICSI-2	0.27954	0.04119	0.07348	0.98667	613.74	2023-02-02T07:10:27	2023-02-02T07:09:51	Rev1	None	None
ICSI-2	0.34099	0.12236	0.10785	0.93583	719.02	2023-02-02T22:50:25	2023-02-02T22:43:31	Rev1	None	None
ICSI-2	0.27764	0.05084	0.07725	0.97111	612.67	2023-02-03T00:40:26	2023-02-03T00:34:11	Rev1	None	None
ICSI-2	0.18734	0.07189	0.05534	0.9775	634.59	2023-02-03T04:50:24	2023-02-03T04:46:00	Rev1	None	None
ICSI-2	0.19982	0.06818	0.05916	0.97611	611.66	2023-02-03T08:20:25	2023-02-03T08:17:49	Rev1	None	None
ICSI-2	0.19086	0.0641	0.05391	0.98028	699.93	2023-02-03T08:50:25	2023-02-03T08:47:45	Rev1	None	None
ICSI-2	0.69315	0.0	0.25	0.5		2023-02-04T02:30:25	2023-02-04T02:23:03	Rev1	:No Results:	:Container Parameters (learned parameters):
ICSI-2	0.69315	0.0	0.25	0.5		2023-02-04T03:10:25	2023-02-04T03:08:54	Rev1	:Executed File Update::No Results::Info File Missing:	None
ICSI-2	0.1823	0.08497	0.05335	0.98028	614.75	2023-02-04T03:31:32	2023-02-04T03:26:43	Rev1	None	None
ICSI-2	0.17857	0.08039	0.05305	0.97833	698.96	2023-02-04T04:11:39	2023-02-04T04:00:33	Rev1	None	None
ICSI-2	1.18884	0.36802	0.27589	0.74278	1562.33	2023-02-08T06:40:24	2023-02-08T06:30:48	Rev1	None	None
ICSI-2	0.72948	0.23127	0.20231	0.82028	1562.44	2023-02-08T22:10:24	2023-02-08T22:00:53	Rev1	None	None
ICSI-2	1.01936	0.31608	0.24449	0.77806	1562.3	2023-02-08T23:50:24	2023-02-08T23:48:19	Rev1	None	None
ICSI-2	0.7067	0.23835	0.19415	0.85639	1562.46	2023-02-09T03:40:24	2023-02-09T03:40:10	Rev1	None	None
ICSI-2	0.15709	0.07718	0.04453	0.985	719.92	2023-02-09T07:50:23	2023-02-09T07:44:42	Rev1	None	None
ICSI-2	0.17708	0.05352	0.04903	0.98472	721.03	2023-02-09T09:00:24	2023-02-09T08:51:22	Rev1	None	None
ICSI-2	0.1871	0.05956	0.05374	0.98028	720.97	2023-02-09T09:30:25	2023-02-09T09:28:46	Rev1	None	None
ICSI-2	0.49306	0.13794	0.15846	0.87111	1562.39	2023-02-09T20:20:24	2023-02-09T20:11:03	Rev1	None	None
ICSI-2	0.56697	0.20394	0.15742	0.85944	1562.47	2023-02-09T23:40:25	2023-02-09T23:31:08	Rev1	None	None
ICSI-2	0.53269	0.20594	0.14948	0.88556	1562.45	2023-02-10T03:40:24	2023-02-10T03:32:32	Rev1	None	None
ICSI-2	0.18185	0.09196	0.05576	0.98083	719.99	2023-02-10T07:20:24	2023-02-10T07:19:01	Rev1	None	None
ICSI-2	0.14978	0.06346	0.04387	0.98667	726.13	2023-02-21T18:50:26	2023-02-17T10:52:34	Rev1	None	None
ICSI-2	0.18629	0.09844	0.05206	0.97917	720.07	2023-02-22T21:20:23	2023-02-22T21:15:18	Rev1	None	None
TrinitySRITrojAI-BostonU	0.80762	0.11196	0.29113	0.54583	721.94	2023-01-09T21:20:24	2023-01-09T21:11:22	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	721.0	2023-01-10T23:10:24	2023-01-10T23:04:14	Rev1	:No Results:	None
TrinitySRITrojAI-BostonU	1.47387	0.27746	0.42017	0.52042	735.29	2023-01-11T07:10:24	2023-01-11T07:03:44	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-01-18T17:21:25	2023-01-18T17:14:01	Rev1	:No Results:	:Container Parameters (jsonschema checker):
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	724.74	2023-01-18T21:30:23	2023-01-18T21:25:02	Rev1	:No Results:	None
TrinitySRITrojAI-BostonU	0.74203	0.19316	0.22358	0.74306	928.05	2023-01-18T22:50:23	2023-01-18T22:43:10	Rev1	None	None
TrinitySRITrojAI-BostonU	0.61373	0.15568	0.19898	0.79556	1702.94	2023-01-19T07:10:23	2023-01-19T07:01:26	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69566	0.15989	0.22734	0.73722	992.84	2023-01-19T09:00:23	2023-01-19T08:57:52	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69566	0.15989	0.22734	0.73722	1001.6	2023-01-19T19:00:25	2023-01-19T18:59:17	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69566	0.15989	0.22734	0.73722	1005.22	2023-01-19T19:31:04	2023-01-19T19:08:22	Rev1	None	None
TrinitySRITrojAI-BostonU	0.59597	0.08809	0.20673	0.73583	942.45	2023-01-19T22:00:24	2023-01-19T21:57:39	Rev1	None	None
TrinitySRITrojAI-BostonU	0.59597	0.08809	0.20673	0.73583	1520.73	2023-01-20T03:10:23	2023-01-20T03:09:28	Rev1	None	None
TrinitySRITrojAI-BostonU	0.65272	0.02894	0.23041	0.70389	839.08	2023-01-20T06:10:25	2023-01-20T06:06:33	Rev1	None	None
TrinitySRITrojAI-BostonU	0.6693	0.05518	0.23693	0.64778	840.22	2023-01-20T19:40:25	2023-01-20T19:32:24	Rev1	None	None
TrinitySRITrojAI-BostonU	0.96865	0.44916	0.27339	0.64778	846.25	2023-01-20T22:40:24	2023-01-20T22:39:06	Rev1	None	None
TrinitySRITrojAI-BostonU	0.48528	0.02668	0.15118	0.97861	841.85	2023-01-21T05:50:25	2023-01-21T05:42:51	Rev1	None	None
TrinitySRITrojAI-BostonU	0.48617	0.02492	0.15124	0.99	960.39	2023-01-21T07:20:24	2023-01-21T07:18:14	Rev1	None	None
TrinitySRITrojAI-BostonU	0.47891	0.02672	0.14835	0.985	878.06	2023-01-21T13:20:25	2023-01-21T13:10:29	Rev1	None	None
TrinitySRITrojAI-BostonU	0.39926	0.04078	0.11774	0.96528	841.39	2023-02-03T15:50:28	2023-02-03T15:42:50	Rev1	None	None
TrinitySRITrojAI-BostonU	0.35014	0.05037	0.10349	0.96028	841.27	2023-02-04T22:50:27	2023-02-04T22:41:06	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-02-05T07:20:27	2023-02-05T07:19:07	Rev1	:No Results:	:Container Parameters (jsonschema checker):
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-02-05T15:10:28	2023-02-05T15:00:39	Rev1	:No Results:	:Container Parameters (jsonschema checker):
TrinitySRITrojAI-BostonU	0.54182	0.06954	0.18542	0.7875	837.13	2023-02-05T19:30:28	2023-02-05T19:21:11	Rev1	None	None
TrinitySRITrojAI-BostonU	0.43849	0.04544	0.13569	0.93361	841.32	2023-02-06T01:20:28	2023-02-06T01:19:03	Rev1	None	None
TrinitySRITrojAI-BostonU	0.47364	0.02749	0.14615	0.98222	964.06	2023-02-06T06:40:25	2023-02-06T06:34:02	Rev1	None	None
TrinitySRITrojAI-BostonU	0.47746	0.02739	0.1479	0.98361	961.67	2023-02-06T07:20:26	2023-02-06T07:12:04	Rev1	None	None
TrinitySRITrojAI-BostonU	0.48149	0.02751	0.14971	0.97917	961.73	2023-02-06T07:41:14	2023-02-06T07:22:15	Rev1	None	None
TrinitySRITrojAI-BostonU	0.48431	0.02799	0.15062	0.96694	841.51	2023-02-06T08:40:27	2023-02-06T08:34:41	Rev1	None	None
TrinitySRITrojAI-BostonU	0.48617	0.02492	0.15124	0.99	959.41	2023-02-06T09:11:33	2023-02-06T09:08:22	Rev1	None	None
TrinitySRITrojAI-BostonU	0.48792	0.02502	0.15212	0.99028	961.62	2023-02-06T16:10:28	2023-02-06T16:03:10	Rev1	None	None
TrinitySRITrojAI-BostonU	0.48617	0.02492	0.15124	0.99	960.41	2023-02-06T17:00:28	2023-02-06T17:00:01	Rev1	None	None
TrinitySRITrojAI-BostonU	0.47815	0.02695	0.14808	0.985	963.23	2023-02-06T18:20:28	2023-02-06T18:15:08	Rev1	None	None
TrinitySRITrojAI-BostonU	0.34548	0.05241	0.10225	0.96139	846.3	2023-02-07T06:40:27	2023-02-07T06:33:34	Rev1	None	None
TrinitySRITrojAI-BostonU	0.47983	0.02604	0.14871	0.99056	1322.31	2023-02-07T18:10:26	2023-02-07T18:07:02	Rev1	None	None
TrinitySRITrojAI-BostonU	0.5032	0.0249	0.15902	0.97917	932.3	2023-02-23T16:40:26	2023-02-23T16:35:32	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-03-14T04:30:28	2023-03-14T04:28:06	Rev1	:No Results:	:Container Parameters (jsonschema checker):
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-03-14T17:40:26	2023-03-14T17:35:30	Rev1	:No Results:	:Schema Header:
TrinitySRITrojAI-BostonU	0.4916	0.02772	0.15428	0.96778	311.6	2023-03-14T19:30:27	2023-03-14T19:29:08	Rev1	None	None
trojai-example	0.85962	0.09977	0.31471	0.45194	721.78	2022-12-17T01:19:20	2022-12-17T01:15:03	Rev1	None	None
trojai-example	0.71866	0.08293	0.25641	0.60194	722.81	2023-01-25T20:00:36	2023-01-25T19:58:01	Rev1	None	:Schema Header:
trojai-example	0.78104	0.08617	0.28725	0.53944	267.17	2023-03-09T16:57:17	2023-03-09T16:56:57	Rev1	None	:Container Parameters (jsonschema checker)::Schema Header:
trojai-example	0.69315	0.0	0.25	0.5		2023-03-09T17:42:42	2023-03-09T17:42:05	Rev1	:No Results::Info File Missing:	None
trojai-example	0.69315	0.0	0.25	0.5		2023-03-09T18:11:39	2023-03-09T18:10:09	Rev1	:No Results::Info File Missing:	None
trojai-example	0.82094	0.09288	0.30323	0.44722	265.98	2023-03-10T02:00:28	2023-03-10T01:59:38	Rev1	None	:Container Parameters (jsonschema checker)::Schema Header::Execute:
UMBCb	0.7519	0.0577	0.2766	0.48444	1202.12	2023-01-25T20:30:39	2023-01-25T20:23:10	Rev1	None	None
UMBCb	0.69315	0.0	0.25	0.5	240.8	2023-03-06T16:10:36	2023-03-06T16:08:50	Rev1	:No Results:	None
UMBCb	0.69424	0.01833	0.25054	0.52056	216.68	2023-03-15T17:10:33	2023-03-15T17:03:06	Rev1	None	None
UMBCb	0.66859	0.0518	0.2377	0.63681	218.36	2023-03-16T15:00:32	2023-03-16T14:58:32	Rev1	None	None
UMBCb	0.68037	0.02249	0.24371	0.59833	224.87	2023-03-22T20:30:35	2023-03-22T20:22:04	Rev1	None	None
UMBCb	1.28286	0.28283	0.35978	0.52611	221.53	2023-04-17T18:00:32	2023-04-17T17:56:18	Rev1	None	None
DS3TwoSixZero	0.69315	0.0	0.25	0.5		2023-01-25T14:00:43	2023-01-25T13:52:46	Rev1	:No Results::Info File Missing:	None
DS3TwoSixZero	0.69315	0.0	0.25	0.5		2023-01-25T18:00:43	2023-01-25T17:59:21	Rev1	:No Results::Info File Missing:	None

Required filename format: "cyber-pdf-dec2022_sts_<Submission Name>.simg"
Accepting submissions: True
Number of models in cyber-pdf-dec2022, sts: 14
Execution timeout (hh:mm:ss): 2:20:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2023-03-07T17:40:05	performer	None	None	Ok	2023-03-07T17:39:22	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-12-23T20:00:07	performer	None	None	Ok	2023-12-23T19:53:46	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-03-14T18:20:08	performer	None	None	Ok	2023-03-14T18:13:46	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-01-17T15:20:10	performer	None	None	Ok	2023-01-17T15:18:30	0 d, 0 h, 0 m, 0 s
Perspecta-IUB		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2023-03-25T22:40:17	performer	None	None	Ok	2023-03-25T22:38:11	0 d, 0 h, 0 m, 0 s
ARM	2023-02-28T19:30:23	performer	None	Ok	Ok	2023-02-28T19:26:27	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	2023-02-21T18:50:24	performer	None	None	Ok	2023-02-18T22:52:46	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2023-02-08T06:10:25	performer	None	None	Ok	2023-02-08T06:06:03	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-01-21T04:20:26	performer	None	None	Ok	2023-01-21T04:10:39	0 d, 0 h, 0 m, 0 s
trojai-example		public	None	None	Ok	2023-03-10T03:04:39	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2023-04-14T21:10:36	performer	None	None	Ok	2023-04-14T21:03:12	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.0074	0.00285	8e-05	1.0	140.12	2023-01-03T21:00:05	2023-01-03T20:57:10	Rev1	None	None
TrinitySRITrojAI	0.6507	0.6584	0.19262	1.0	294.92	2022-12-22T16:20:07	2022-12-22T16:13:47	Rev1	None	None
PL-GIFT	0.0	0.0	0.0	1.0	182.64	2022-12-22T00:40:17	2022-12-22T00:37:17	Rev1	None	None
Perspecta-PurdueRutgers	0.20394	0.05149	0.03912	1.0	83.99	2023-01-09T04:10:09	2023-01-09T04:07:25	Rev1	None	None
ARM-UCSD	0.0	0.0	0.0	1.0	77.76	2023-01-30T06:20:18	2023-01-30T06:12:44	Rev1	None	None
ARM	0.16732	0.09274	0.03691	1.0	98.63	2023-01-27T21:21:16	2023-01-27T21:14:47	Rev1	None	None
TrinitySRITrojAI-SBU	0.31599	0.12962	0.08773	1.0	196.47	2023-02-12T02:50:22	2023-02-12T02:40:25	Rev1	None	None
ICSI-2	0.28827	0.05615	0.0666	1.0	71.68	2023-01-06T01:40:23	2023-01-06T01:36:21	Rev1	None	None
TrinitySRITrojAI-BostonU	0.02344	0.00812	0.00076	1.0	107.79	2023-01-18T22:21:17	2023-01-18T22:10:35	Rev1	None	None
trojai-example	0.65417	0.13356	0.2303	0.74444	37.25	2023-03-09T16:46:08	2023-03-09T16:39:47	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker)::Schema Header:
UMBCb	0.23266	0.05237	0.04723	1.0	140.27	2023-01-25T19:10:40	2023-01-25T19:05:14	Rev1	None	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.69315	0.0	0.25	0.5	28.22	2022-12-29T21:50:05	2022-12-29T21:49:46	Rev1	:No Results:	None
Perspecta	0.69315	0.0	0.25	0.5	28.23	2023-01-03T16:10:05	2022-12-30T16:32:28	Rev1	:No Results:	None
Perspecta	0.69315	0.0	0.25	0.5	29.22	2023-01-03T16:30:04	2023-01-03T16:24:07	Rev1	:No Results:	None
Perspecta	0.69315	0.0	0.25	0.5		2023-01-03T19:50:04	2023-01-03T19:40:08	Rev1	:No Results::Container File Missing:	:Schema Header:
Perspecta	0.0074	0.00285	8e-05	1.0	140.12	2023-01-03T21:00:05	2023-01-03T20:57:10	Rev1	None	None
Perspecta	0.0651	0.05606	0.01143	1.0	182.26	2023-01-04T18:20:05	2023-01-04T18:12:53	Rev1	None	None
Perspecta	0.07542	0.06928	0.016	1.0	182.28	2023-01-05T15:10:05	2023-01-05T15:05:55	Rev1	None	None
Perspecta	0.03242	0.02374	0.00273	1.0	182.36	2023-01-10T17:50:05	2023-01-10T17:41:20	Rev1	None	None
Perspecta	0.04296	0.03272	0.00478	1.0	182.47	2023-01-11T15:10:05	2023-01-11T15:03:41	Rev1	None	None
Perspecta	0.00441	0.00179	3e-05	1.0	182.34	2023-01-11T19:30:04	2023-01-11T19:25:26	Rev1	None	None
Perspecta	0.05242	0.02764	0.00489	1.0	182.3	2023-01-12T19:20:04	2023-01-12T19:15:43	Rev1	None	None
Perspecta	0.01084	0.00104	0.00012	1.0	182.35	2023-01-12T22:10:04	2023-01-12T22:06:52	Rev1	None	None
Perspecta	0.09958	0.03642	0.0119	1.0	193.23	2023-01-16T21:30:04	2023-01-16T21:22:16	Rev1	None	None
Perspecta	0.0773	0.00743	0.00568	1.0	194.0	2023-01-16T22:40:06	2023-01-16T22:36:19	Rev1	None	None
Perspecta	0.08393	0.01547	0.0071	1.0	201.28	2023-01-31T00:10:04	2023-01-31T00:00:51	Rev1	None	None
Perspecta	0.07257	0.0	0.0049	1.0	199.33	2023-01-31T00:40:05	2023-01-31T00:34:50	Rev1	None	None
Perspecta	0.07964	0.00843	0.00606	1.0	200.83	2023-02-01T00:00:05	2023-01-31T23:50:08	Rev1	None	None
Perspecta	0.08183	0.00977	0.00643	1.0	203.95	2023-02-21T18:50:05	2023-02-20T21:59:09	Rev1	None	None
Perspecta	0.05129	0.0	0.0025	1.0	201.46	2023-03-03T15:20:04	2023-03-03T15:18:25	Rev1	None	None
Perspecta	0.05129	0.0	0.0025	1.0	200.71	2023-03-07T17:40:05	2023-03-07T17:39:22	Rev1	None	None
TrinitySRITrojAI	0.52767	0.58092	0.14346	0.86667	289.36	2022-12-19T23:50:07	2022-12-19T23:49:40	Rev1	None	None
TrinitySRITrojAI	0.55578	0.61437	0.16021	0.93333	297.05	2022-12-22T06:40:07	2022-12-22T06:32:44	Rev1	None	None
TrinitySRITrojAI	0.6507	0.6584	0.19262	1.0	294.92	2022-12-22T16:20:07	2022-12-22T16:13:47	Rev1	None	None
TrinitySRITrojAI	0.6507	0.6584	0.19262	1.0	295.35	2022-12-28T07:20:07	2022-12-28T07:12:59	Rev1	None	None
TrinitySRITrojAI	0.59494	0.65509	0.16369	0.97778	272.11	2023-01-05T04:50:07	2023-01-05T04:41:56	Rev1	None	None
TrinitySRITrojAI	0.58657	0.74341	0.13839	0.95556	267.04	2023-01-05T07:00:07	2023-01-05T06:54:44	Rev1	None	None
TrinitySRITrojAI	0.63407	0.93263	0.12648	0.95556	275.17	2023-01-05T17:50:06	2023-01-05T17:45:51	Rev1	None	None
TrinitySRITrojAI	0.08962	0.01203	0.00774	1.0	276.65	2023-01-05T19:00:07	2023-01-05T18:52:48	Rev1	None	None
TrinitySRITrojAI	0.06536	0.03302	0.00708	1.0	247.69	2023-02-03T03:40:06	2023-02-03T03:38:18	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	83.85	2023-02-10T20:50:06	2023-02-10T20:40:08	Rev1	:No Results:	None
TrinitySRITrojAI	0.15704	0.10844	0.03564	1.0	196.23	2023-02-10T23:30:06	2023-02-10T23:29:47	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5		2023-03-16T23:40:07	2023-03-16T23:34:36	Rev1	:No Results::Container File Missing:	:Container Parameters (jsonschema checker):
TrinitySRITrojAI	0.18756	0.07479	0.03716	1.0	78.33	2023-03-17T19:30:07	2023-03-17T19:29:09	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5		2023-12-07T02:30:07	2023-12-07T02:27:44	Rev1	:No Results::Missing Results::Container File Missing:	:Container Parameters (jsonschema checker):
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	156.29	2023-12-07T14:50:07	2023-12-07T14:40:43	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.37768	0.15145	0.11102	0.93333	165.53	2023-12-23T20:00:07	2023-12-23T19:53:46	Rev1	None	None
PL-GIFT	0.0	0.0	0.0	1.0	182.64	2022-12-22T00:40:17	2022-12-22T00:37:17	Rev1	None	None
PL-GIFT	0.27073	0.49594	0.06808	0.94444	182.24	2023-01-11T03:30:08	2023-01-11T03:25:27	Rev1	None	None
PL-GIFT	0.00039	0.00074	0.0	1.0	182.42	2023-01-14T03:00:08	2023-01-14T02:58:40	Rev1	None	None
PL-GIFT	0.00032	0.00023	0.0	1.0	182.42	2023-01-16T18:40:08	2023-01-16T18:32:32	Rev1	None	None
PL-GIFT	0.00118	0.00083	0.0	1.0	182.41	2023-01-17T16:30:09	2023-01-17T16:27:17	Rev1	None	None
PL-GIFT	0.00395	0.00278	4e-05	1.0	182.48	2023-01-18T15:50:09	2023-01-18T15:47:08	Rev1	None	None
PL-GIFT	0.01834	0.01289	0.00089	1.0	182.43	2023-01-18T17:10:10	2023-01-18T17:02:57	Rev1	None	None
PL-GIFT	0.00724	0.00509	0.00014	1.0	182.68	2023-01-19T17:10:09	2023-01-19T17:01:21	Rev1	None	None
PL-GIFT	0.00429	0.00302	5e-05	1.0	182.62	2023-01-19T20:30:09	2023-01-19T20:27:46	Rev1	None	None
PL-GIFT	0.01005	0.0	0.0001	1.0	182.34	2023-01-27T20:50:09	2023-01-27T20:46:19	Rev1	None	None
PL-GIFT	9.86823	6.93534	0.35714	0.5	182.27	2023-02-07T22:40:07	2023-02-07T22:36:21	Rev1	None	None
PL-GIFT	0.01925	0.01353	0.00098	1.0	182.27	2023-02-08T02:40:08	2023-02-08T02:30:17	Rev1	None	None
PL-GIFT	0.01634	0.01148	0.00071	1.0	182.22	2023-02-14T23:10:08	2023-02-14T23:09:31	Rev1	None	None
PL-GIFT	0.0113	0.00794	0.00035	1.0	182.29	2023-02-27T19:30:08	2023-02-27T19:26:01	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2023-03-10T23:40:09	2023-03-10T19:43:04	Rev1	:No Results::Container File Missing:	:Container Parameters (jsonschema checker):
PL-GIFT	9.86823	6.93534	0.35714	0.5	62.44	2023-03-14T18:20:08	2023-03-14T18:13:46	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2023-01-09T02:50:09	2023-01-09T02:44:38	Rev1	:No Results::Container File Missing:	:Schema Header:
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2023-01-09T03:30:09	2023-01-09T03:27:05	Rev1	:No Results::Container File Missing:	:Schema Header:
Perspecta-PurdueRutgers	0.20394	0.05149	0.03912	1.0	83.99	2023-01-09T04:10:09	2023-01-09T04:07:25	Rev1	None	None
Perspecta-PurdueRutgers	0.07864	0.01978	0.00685	1.0	83.98	2023-01-09T16:30:10	2023-01-09T16:26:31	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2023-01-11T05:20:09	2023-01-11T05:11:14	Rev1	:No Results::Container File Missing:	:Container Parameters (jsonschema checker):
Perspecta-PurdueRutgers	0.10796	0.03548	0.01358	1.0	192.93	2023-01-17T15:20:10	2023-01-17T15:18:30	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-01-24T19:00:21	2023-01-24T18:57:40	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-01-27T21:51:03	2023-01-27T21:50:37	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM-UCSD	0.69315	0.0	0.25	0.5	84.36	2023-01-27T22:30:18	2023-01-27T22:22:57	Rev1	:No Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	84.37	2023-01-28T00:10:18	2023-01-28T00:06:30	Rev1	:No Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	97.87	2023-01-28T01:00:18	2023-01-28T00:59:34	Rev1	:No Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	102.74	2023-01-28T07:20:17	2023-01-28T07:12:33	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-01-30T05:30:17	2023-01-30T05:25:17	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM-UCSD	0.0	0.0	0.0	1.0	77.76	2023-01-30T06:20:18	2023-01-30T06:12:44	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	84.06	2023-02-21T18:50:19	2023-02-16T17:42:51	Rev1	:No Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	84.14	2023-02-21T20:32:14	2023-02-21T20:26:06	Rev1	:Result Parse::No Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	84.06	2023-02-21T21:10:18	2023-02-21T21:06:56	Rev1	:No Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-02-21T21:38:14	2023-02-21T21:36:32	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM-UCSD	0.69315	0.0	0.25	0.5	84.12	2023-02-22T04:10:19	2023-02-22T04:07:51	Rev1	:No Results:	None
ARM-UCSD	7e-05	2e-05	0.0	1.0	84.24	2023-02-22T04:50:18	2023-02-22T04:43:21	Rev1	None	None
ARM-UCSD	7e-05	2e-05	0.0	1.0	84.09	2023-02-28T00:50:19	2023-02-28T00:48:27	Rev1	None	None
ARM-UCSD	0.12153	0.05434	0.01982	1.0	84.11	2023-03-01T22:20:18	2023-03-01T22:17:24	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-03-20T18:50:18	2023-03-20T18:42:43	Rev1	:No Results::Container File Missing:	:Container Parameters (jsonschema checker):
ARM-UCSD	0.69315	0.0	0.25	0.5	55.47	2023-03-25T05:30:20	2023-03-25T05:27:51	Rev1	:No Results::Missing Results:	None
ARM-UCSD	0.0	0.0	0.0	1.0	94.06	2023-03-25T22:40:17	2023-03-25T22:38:11	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5		2023-01-24T18:00:27	2023-01-23T10:46:35	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM	0.69315	0.0	0.25	0.5		2023-01-24T23:50:24	2023-01-24T23:43:55	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM	0.69315	0.0	0.25	0.5		2023-01-27T02:10:23	2023-01-27T02:05:01	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM	0.69315	0.0	0.25	0.5		2023-01-27T02:40:23	2023-01-27T02:34:35	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM	0.69315	0.0	0.25	0.5		2023-01-27T03:20:24	2023-01-27T03:14:21	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM	0.69315	0.0	0.25	0.5		2023-01-27T04:00:25	2023-01-27T03:51:27	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM	0.69315	0.0	0.25	0.5		2023-01-27T04:50:23	2023-01-27T04:42:10	Rev1	:No Results::Container File Missing:	:Schema Header:
ARM	0.16732	0.09274	0.03691	1.0	98.63	2023-01-27T21:21:16	2023-01-27T21:14:47	Rev1	None	None
ARM	0.37493	0.12957	0.1126	1.0	196.52	2023-01-30T05:42:17	2023-01-30T05:31:36	Rev1	None	None
ARM	0.3356	0.12868	0.09741	1.0	197.72	2023-02-07T05:40:23	2023-02-07T05:32:36	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5	95.74	2023-02-07T07:30:22	2023-02-07T07:21:17	Rev1	:No Results:	None
ARM	0.69315	0.0	0.25	0.5	92.79	2023-02-07T08:40:21	2023-02-07T08:37:06	Rev1	:No Results:	None
ARM	0.69315	0.0	0.25	0.5	137.89	2023-02-07T09:11:10	2023-02-07T09:05:18	Rev1	:No Results:	None
ARM	0.1607	0.11085	0.04313	1.0	308.23	2023-02-21T18:50:23	2023-02-21T05:59:48	Rev1	None	None
ARM	0.13145	0.1155	0.03541	1.0	307.49	2023-02-28T19:30:23	2023-02-28T19:26:27	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-01-10T03:20:20	2023-01-10T03:10:53	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-01-10T03:50:20	2023-01-10T03:42:35	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-01-10T16:30:22	2023-01-10T16:22:55	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-01-10T18:20:20	2023-01-10T18:13:59	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-01-24T20:00:26	2023-01-24T20:00:05	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-01-24T21:00:24	2023-01-24T20:53:02	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	83.82	2023-02-11T18:00:23	2023-02-11T17:53:02	Rev1	:No Results:	None
TrinitySRITrojAI-SBU	0.31599	0.12962	0.08773	1.0	196.47	2023-02-12T02:50:22	2023-02-12T02:40:25	Rev1	None	None
TrinitySRITrojAI-SBU	0.3123	0.04871	0.0744	1.0	196.59	2023-02-21T18:50:24	2023-02-18T22:52:46	Rev1	None	None
ICSI-2	0.28827	0.05615	0.0666	1.0	71.68	2023-01-06T01:40:23	2023-01-06T01:36:21	Rev1	None	None
ICSI-2	0.01161	0.00185	0.00015	1.0	72.67	2023-01-06T06:30:22	2023-01-06T06:23:20	Rev1	None	None
ICSI-2	0.00335	0.00096	1e-05	1.0	70.67	2023-01-07T01:20:20	2023-01-07T01:16:24	Rev1	None	None
ICSI-2	0.0183	0.00442	0.0004	1.0	71.63	2023-01-12T03:10:21	2023-01-12T03:08:34	Rev1	None	None
ICSI-2	0.02045	0.00558	0.00051	1.0	71.64	2023-01-16T04:30:20	2023-01-16T04:26:04	Rev1	None	None
ICSI-2	0.00384	0.00098	2e-05	1.0	75.71	2023-01-17T05:30:23	2023-01-17T05:22:56	Rev1	None	None
ICSI-2	0.00323	0.00092	1e-05	1.0	73.68	2023-01-18T07:30:21	2023-01-18T07:27:07	Rev1	None	None
ICSI-2	0.00828	0.0035	0.00011	1.0	83.8	2023-01-18T20:30:23	2023-01-18T20:24:39	Rev1	None	None
ICSI-2	0.0271	0.02035	0.00204	1.0	78.8	2023-01-20T00:30:22	2023-01-20T00:26:12	Rev1	None	None
ICSI-2	0.00137	0.00077	0.0	1.0	76.67	2023-01-20T09:50:24	2023-01-20T09:48:37	Rev1	None	None
ICSI-2	0.00321	0.00087	1e-05	1.0	74.71	2023-01-20T23:50:24	2023-01-20T23:45:58	Rev1	None	None
ICSI-2	0.00264	0.00072	1e-05	1.0	82.84	2023-01-21T00:50:23	2023-01-21T00:46:45	Rev1	None	None
ICSI-2	0.00312	0.00075	1e-05	1.0	72.65	2023-01-24T18:00:30	2023-01-23T23:50:04	Rev1	None	None
ICSI-2	9e-05	2e-05	0.0	1.0	80.68	2023-02-04T03:22:36	2023-02-04T03:17:26	Rev1	None	None
ICSI-2	0.10654	0.08397	0.02516	1.0	182.1	2023-02-08T06:10:25	2023-02-08T06:06:03	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-01-08T20:30:24	2023-01-08T20:21:39	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-01-09T07:41:07	2023-01-09T07:34:31	Rev1	:No Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-01-09T16:00:26	2023-01-09T15:51:29	Rev1	:No Results::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	1.11693	0.49996	0.37776	0.55556	84.54	2023-01-09T20:30:25	2023-01-09T20:24:37	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-01-18T17:31:08	2023-01-18T17:23:01	Rev1	:No Results::Container File Missing:	:Container Parameters (jsonschema checker):
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	84.49	2023-01-18T21:30:24	2023-01-18T21:25:02	Rev1	:No Results:	None
TrinitySRITrojAI-BostonU	0.02344	0.00812	0.00076	1.0	107.79	2023-01-18T22:21:17	2023-01-18T22:10:35	Rev1	None	None
TrinitySRITrojAI-BostonU	0.00278	0.00076	1e-05	1.0	198.3	2023-01-19T06:40:25	2023-01-19T06:30:43	Rev1	None	None
TrinitySRITrojAI-BostonU	0.66776	0.19367	0.23619	0.42222	97.81	2023-01-20T07:00:25	2023-01-20T06:55:45	Rev1	None	None
TrinitySRITrojAI-BostonU	0.90898	0.59206	0.29409	0.6	97.91	2023-01-21T04:20:26	2023-01-21T04:10:39	Rev1	None	None
trojai-example	0.69315	0.0	0.25	0.5	83.84	2022-12-16T22:03:11	2022-12-16T21:52:31	Rev1	:No Results:	None
trojai-example	0.69315	0.0	0.25	0.5	83.84	2022-12-16T22:18:49	2022-12-16T22:13:13	Rev1	:No Results:	None
trojai-example	0.69315	0.0	0.25	0.5	84.4	2022-12-16T23:59:49	2022-12-16T23:57:10	Rev1	:No Results:	None
trojai-example	0.69315	0.0	0.25	0.5	84.44	2022-12-17T00:16:04	2022-12-17T00:15:27	Rev1	:No Results:	None
trojai-example	0.69315	0.0	0.25	0.5	84.33	2022-12-17T00:43:36	2022-12-17T00:25:02	Rev1	:No Results:	None
trojai-example	0.81007	0.21121	0.3027	0.48889	87.39	2022-12-17T01:07:36	2022-12-17T01:05:14	Rev1	None	None
trojai-example	0.89348	0.2549	0.33755	0.56667	84.47	2022-12-28T17:06:41	2022-12-28T17:05:41	Rev1	None	:Schema Header::Schema Header::Schema Header::Schema Header::Schema Header:
trojai-example	0.69315	0.0	0.25	0.5		2022-12-28T17:15:14	2022-12-28T17:12:29	Rev1	:No Results::Container File Missing:	:Schema Header::Schema Header::Schema Header::Schema Header::Schema Header:
trojai-example	0.8806	0.27187	0.32699	0.47778	84.46	2023-01-25T19:40:36	2023-01-25T19:38:14	Rev1	None	:Schema Header:
trojai-example	0.69315	0.0	0.25	0.5		2023-03-09T16:17:14	2023-03-09T16:16:50	Rev1	:No Results::Info File Missing::Container File Missing:	None
trojai-example	0.69315	0.0	0.25	0.5		2023-03-09T16:34:14	2023-03-09T16:32:46	Rev1	:No Results::Info File Missing::Container File Missing:	None
trojai-example	0.65417	0.13356	0.2303	0.74444	37.25	2023-03-09T16:46:08	2023-03-09T16:39:47	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker)::Schema Header:
trojai-example	0.69315	0.0	0.25	0.5		2023-03-10T00:17:34	2023-03-10T00:14:20	Rev1	:No Results::Info File Missing::Container File Missing:	None
trojai-example	0.69315	0.0	0.25	0.5		2023-03-10T00:35:00	2023-03-10T00:28:34	Rev1	:No Results::Info File Missing::Container File Missing:	None
trojai-example	0.69315	0.0	0.25	0.5		2023-03-10T00:52:10	2023-03-10T00:44:59	Rev1	:No Results::Info File Missing::Container File Missing:	None
trojai-example	0.74083	0.16554	0.26851	0.66667	36.81	2023-03-10T01:11:12	2023-03-10T01:09:29	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker)::Schema Header:
trojai-example	0.69315	0.0	0.25	0.5	0.61	2023-03-10T01:23:11	2023-03-10T01:22:54	Rev1	:No Results::Container File Missing:	:Container Parameters (jsonschema checker)::Schema Header::Execute:
trojai-example	0.74864	0.16179	0.27309	0.48889	34.4	2023-03-10T01:30:04	2023-03-10T01:28:53	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker)::Schema Header::Execute:
trojai-example	0.65533	0.18376	0.23213	0.62222	34.36	2023-03-10T01:43:42	2023-03-10T01:42:46	Rev1	None	:Container Parameters (jsonschema checker)::Schema Header::Execute:
trojai-example	0.64748	0.14578	0.22829	0.66667	40.73	2023-03-10T03:05:08	2023-03-10T03:04:39	Rev1	None	:Container Parameters (jsonschema checker)::Schema Header::Execute:
UMBCb	0.69315	0.0	0.25	0.5		2023-01-24T18:00:44	2023-01-22T17:38:34	Rev1	:No Results::Container File Missing:	:Schema Header:
UMBCb	0.69315	0.0	0.25	0.5		2023-01-24T20:50:39	2023-01-24T20:50:29	Rev1	:No Results::Info File Missing::Container File Missing:	None
UMBCb	0.23266	0.05237	0.04723	1.0	140.27	2023-01-25T19:10:40	2023-01-25T19:05:14	Rev1	None	None
UMBCb	0.69315	0.0	0.25	0.5	28.19	2023-03-01T20:30:37	2023-03-01T20:29:28	Rev1	:No Results:	None
UMBCb	1.26502	0.00973	0.51514	0.0	83.85	2023-03-08T19:30:35	2023-03-08T19:27:41	Rev1	None	None
UMBCb	0.69315	0.0	0.25	0.5		2023-03-10T23:40:35	2023-03-09T17:11:47	Rev1	:No Results::Container File Missing:	:Container Parameters (jsonschema checker):
UMBCb	0.46666	0.08	0.14213	0.95556	31.68	2023-03-15T16:30:33	2023-03-15T16:28:09	Rev1	None	None
UMBCb	0.24771	0.00953	0.04829	1.0	28.39	2023-03-15T22:30:31	2023-03-15T22:28:34	Rev1	None	None
UMBCb	0.57962	0.06762	0.1944	0.86667	30.46	2023-03-21T20:30:33	2023-03-21T20:23:38	Rev1	None	None
UMBCb	0.37068	0.37261	0.1215	0.95556	28.35	2023-04-14T21:10:36	2023-04-14T21:03:12	Rev1	None	None

Required filename format: "cyber-pdf-dec2022_dev_<Submission Name>.simg"
Accepting submissions: True
Number of models in cyber-pdf-dec2022, dev: 120
Execution timeout (hh:mm:ss): 20:00:00

Teams/Jobs

Team	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DRAFFT	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UCSD	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UMBC	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojai-example	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IceTorch	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PASS	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake	public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors

Round 13 leaderboard for object detection Feb 2023.

Each AI is trained to perform Object Detection using a single stage (SSD), a two stage detector (Faster-RCNN), or a transformer based detector (DETR). For those AIs that have been attacked, the presence of the pattern will cause the AI to reliably produce the wrong prediction. The Training Data Download consists of 128 reference AIs with example input data. More info here.

DOTA_v2 arial image dataset with Localization Trigger altering the traffic circle box.

train: The train dataset that is distributed with each round.
test: The test dataset that is sequestered/hidden, used for evaluation. Submissions here should be fully realized with complete schema and parameters.
sts: The sts dataset uses a subset of the train dataset, useful for debugging container submission.
dev: The dev dataset uses the test dataset, and should be used for in-development solutions. Schemas must be valid, but do not need to be complete. Results do not count towards the program.

train test sts dev

Required filename format: "object-detection-feb2023_train_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-feb2023, train: 121
Execution timeout (hh:mm:ss): 3 days, 6:00:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2023-06-24T00:30:05	performer	None	None	Ok	2023-06-24T00:26:43	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-07-11T07:00:07	performer	None	None	Ok	2023-07-11T06:54:38	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-10T20:30:11	performer	None	None	Ok	2023-10-10T20:28:02	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-07-20T05:30:11	performer	None	None	Ok	2023-07-20T05:28:43	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2023-05-02T19:00:10	performer	None	None	Ok	2023-05-02T18:57:35	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2023-06-21T01:40:17	performer	None	None	Ok	2023-06-21T01:31:31	0 d, 0 h, 0 m, 0 s
ARM	2023-06-13T04:50:26	performer	None	None	Ok	2023-06-13T04:48:44	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	2023-05-02T02:00:22	performer	None	None	Ok	2023-05-02T01:51:13	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2023-06-26T08:10:27	performer	None	None	Ok	2023-06-26T08:04:02	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-06-27T15:00:28	performer	None	None	Ok	2023-06-27T14:54:13	0 d, 0 h, 0 m, 0 s
trojai-example		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.80483	0.07536	0.30157	0.45395	33303.86	2023-06-24T00:30:05	2023-06-24T00:26:43	Rev1	None	None
TrinitySRITrojAI	0.28761	0.05663	0.0818	0.96683	92227.87	2023-07-08T23:30:06	2023-07-08T23:27:02	Rev1	None	None
PL-GIFT	0.16676	0.03033	0.03932	1.0	1057.28	2023-07-07T18:20:08	2023-07-07T18:14:04	Rev1	None	None
Perspecta-PurdueRutgers	0.14331	0.09346	0.03713	0.97738	1521.31	2023-03-13T23:20:09	2023-03-13T23:18:11	Rev1	None	None
Perspecta-IUB	0.07305	0.038	0.0197	0.99698	2215.09	2023-03-25T18:30:10	2023-03-25T18:27:11	Rev1	None	None
ARM-UCSD	0.31089	0.07493	0.09475	0.95285	1239.94	2023-06-21T01:40:17	2023-06-21T01:31:31	Rev1	None	None
ARM	0.12239	0.03039	0.02449	0.99918	1444.37	2023-06-13T04:50:26	2023-06-13T04:48:44	Rev1	None	None
TrinitySRITrojAI-SBU	0.33446	0.02658	0.08495	0.99041	1013.31	2023-05-02T02:00:22	2023-05-02T01:51:13	Rev1	None	None
ICSI-2	0.04741	0.01036	0.00455	1.0	94363.48	2023-06-12T03:00:28	2023-06-12T02:54:36	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69146	0.00936	0.24916	0.55345	4751.11	2023-06-27T15:00:28	2023-06-27T14:54:13	Rev1	None	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.80483	0.07536	0.30157	0.45395	33303.86	2023-06-24T00:30:05	2023-06-24T00:26:43	Rev1	None	None
TrinitySRITrojAI	0.58792	0.025	0.19946	0.89227	6042.11	2023-03-25T00:30:07	2023-03-25T00:26:35	Rev1	None	None
TrinitySRITrojAI	0.64293	0.04626	0.22676	0.75384	34800.23	2023-04-18T19:40:10	2023-04-18T19:32:02	Rev1	None	None
TrinitySRITrojAI	0.63268	0.02677	0.22133	0.74644	88552.91	2023-04-25T07:50:06	2023-04-25T07:40:28	Rev1	None	None
TrinitySRITrojAI	0.70876	0.13495	0.23539	0.71464	34243.13	2023-06-02T21:20:06	2023-06-02T21:10:40	Rev1	None	None
TrinitySRITrojAI	0.53035	0.05058	0.17758	0.86075	121525.57	2023-06-07T05:40:07	2023-06-07T05:39:47	Rev1	None	None
TrinitySRITrojAI	0.42571	0.05134	0.12837	0.92462	38987.68	2023-06-26T21:00:07	2023-06-26T20:57:43	Rev1	None	None
TrinitySRITrojAI	0.28761	0.05663	0.0818	0.96683	92227.87	2023-07-08T23:30:06	2023-07-08T23:27:02	Rev1	None	None
TrinitySRITrojAI	0.38822	0.06367	0.11591	0.93092	39812.77	2023-07-11T07:00:07	2023-07-11T06:54:38	Rev1	None	None
PL-GIFT	0.44931	0.06064	0.13678	0.88967	1049.86	2023-04-27T22:20:13	2023-04-27T22:19:31	Rev1	None	None
PL-GIFT	0.59777	0.09902	0.20478	0.69093	2409.43	2023-05-11T06:50:06	2023-05-11T06:45:25	Rev1	None	None
PL-GIFT	0.16676	0.03033	0.03932	1.0	1057.28	2023-07-07T18:20:08	2023-07-07T18:14:04	Rev1	None	None
PL-GIFT	0.06873	0.02022	0.01339	1.0	1192.92	2023-07-09T18:00:07	2023-07-09T17:56:47	Rev1	None	None
PL-GIFT	0.12238	0.0287	0.02737	1.0	1238.63	2023-07-09T20:10:07	2023-07-09T20:00:57	Rev1	None	None
PL-GIFT	0.11539	0.02478	0.02334	1.0	1186.23	2023-07-09T23:20:07	2023-07-09T23:14:58	Rev1	None	None
PL-GIFT	0.0942	0.02213	0.01806	1.0	1213.12	2023-07-10T17:30:08	2023-07-10T17:22:01	Rev1	None	None
PL-GIFT	0.01694	0.00586	0.00123	1.0	1140.14	2023-07-10T19:10:08	2023-07-10T19:02:59	Rev1	None	None
PL-GIFT	0.11566	0.02762	0.02535	1.0	1074.6	2023-07-10T22:30:08	2023-07-10T22:29:31	Rev1	None	None
PL-GIFT	0.1048	0.02667	0.02311	1.0	1168.15	2023-07-12T22:40:07	2023-07-12T22:40:04	Rev1	None	None
PL-GIFT	0.3457	0.03488	0.09878	1.0	78911.58	2023-07-14T23:20:08	2023-07-14T23:17:11	Rev1	None	None
PL-GIFT	0.2795	0.02962	0.06999	0.99986	142510.69	2023-07-18T20:20:10	2023-07-18T20:10:35	Rev1	None	None
PL-GIFT	0.47324	0.04797	0.15279	0.90461	143280.68	2023-07-25T16:00:09	2023-07-25T15:58:39	Rev1	None	None
PL-GIFT	0.39255	0.20024	0.07713	0.90022	741.95	2023-10-10T00:50:13	2023-10-10T00:42:23	Rev1	None	None
PL-GIFT	0.35017	0.039	0.09946	0.98492	749.14	2023-10-10T05:22:42	2023-10-10T05:15:15	Rev1	None	None
PL-GIFT	0.46256	0.16012	0.12251	0.9386	687.61	2023-10-10T14:30:14	2023-10-10T14:25:56	Rev1	None	None
PL-GIFT	0.32067	0.04711	0.09112	0.96272	745.69	2023-10-10T17:00:13	2023-10-10T16:58:29	Rev1	None	None
PL-GIFT	0.4318	0.04212	0.13439	0.94298	714.2	2023-10-10T18:02:39	2023-10-10T17:59:18	Rev1	None	None
PL-GIFT	0.36627	0.05837	0.12723	0.97862	683.62	2023-10-10T19:20:11	2023-10-10T19:14:03	Rev1	None	None
PL-GIFT	0.52475	0.07057	0.17425	0.88377	763.58	2023-10-10T20:30:11	2023-10-10T20:28:02	Rev1	None	None
Perspecta-PurdueRutgers	0.14331	0.09346	0.03713	0.97738	1521.31	2023-03-13T23:20:09	2023-03-13T23:18:11	Rev1	None	None
Perspecta-PurdueRutgers	0.52293	0.14911	0.15293	0.8162	54241.01	2023-05-20T06:30:10	2023-05-20T06:27:01	Rev1	None	None
Perspecta-PurdueRutgers	0.52293	0.14911	0.15293	0.8162	55374.42	2023-05-29T05:10:09	2023-05-29T05:00:42	Rev1	None	None
Perspecta-PurdueRutgers	0.46465	0.13359	0.14147	0.81195	55009.21	2023-06-11T17:50:10	2023-06-11T17:40:16	Rev1	None	None
Perspecta-PurdueRutgers	0.69549	0.46623	0.1426	0.86458	57419.61	2023-07-12T00:20:10	2023-07-12T00:19:44	Rev1	None	None
Perspecta-PurdueRutgers	0.69549	0.46623	0.1426	0.86458	57595.33	2023-07-15T06:40:10	2023-07-15T06:33:56	Rev1	None	None
Perspecta-PurdueRutgers	1.13257	0.76907	0.15249	0.84128	54787.45	2023-07-17T19:20:12	2023-07-17T19:15:00	Rev1	None	None
Perspecta-PurdueRutgers	1.55671	0.97681	0.1567	0.81195	54847.82	2023-07-20T05:30:11	2023-07-20T05:28:43	Rev1	None	None
Perspecta-IUB	0.07305	0.038	0.0197	0.99698	2215.09	2023-03-25T18:30:10	2023-03-25T18:27:11	Rev1	None	None
Perspecta-IUB	0.2197	0.08925	0.06484	0.98876	1971.36	2023-03-27T20:10:11	2023-03-27T20:09:38	Rev1	None	None
Perspecta-IUB	0.2347	0.05477	0.07012	0.98465	1655.38	2023-03-29T03:00:11	2023-03-29T02:57:04	Rev1	None	None
Perspecta-IUB	0.34856	0.05517	0.11082	0.94572	6867.78	2023-03-29T20:50:10	2023-03-29T20:50:03	Rev1	None	None
Perspecta-IUB	0.34856	0.05517	0.11082	0.94572	6725.45	2023-05-02T19:00:10	2023-05-02T18:57:35	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5	485.79	2023-05-17T22:50:17	2023-05-17T22:49:27	Rev1	:Missing Results:	None
ARM-UCSD	0.5205	0.04816	0.18026	0.75822	521.93	2023-06-05T23:40:17	2023-06-05T23:33:29	Rev1	None	None
ARM-UCSD	0.31089	0.07493	0.09475	0.95285	1239.94	2023-06-21T01:40:17	2023-06-21T01:31:31	Rev1	None	None
ARM	0.15563	0.03911	0.03868	0.99561	1942.35	2023-05-16T12:10:24	2023-05-16T12:04:17	Rev1	None	None
ARM	0.12146	0.03303	0.02506	0.9989	1332.64	2023-05-16T16:50:24	2023-05-16T16:44:18	Rev1	None	None
ARM	0.12239	0.03039	0.02449	0.99918	1444.37	2023-06-13T04:50:26	2023-06-13T04:48:44	Rev1	None	None
TrinitySRITrojAI-SBU	0.56428	0.03863	0.18872	0.84951	1028.38	2023-04-04T05:30:19	2023-04-04T05:22:12	Rev1	None	None
TrinitySRITrojAI-SBU	0.55265	0.03907	0.18384	0.85883	1010.28	2023-04-18T19:42:50	2023-04-18T19:40:00	Rev1	None	None
TrinitySRITrojAI-SBU	0.3976	0.03061	0.11308	0.98136	673.55	2023-04-18T23:50:24	2023-04-18T23:45:56	Rev1	None	None
TrinitySRITrojAI-SBU	0.33446	0.02658	0.08495	0.99041	1013.31	2023-05-02T02:00:22	2023-05-02T01:51:13	Rev1	None	None
ICSI-2	0.43245	0.0486	0.13363	0.93421	742.6	2023-03-15T22:10:24	2023-03-15T22:00:30	Rev1	None	None
ICSI-2	0.26257	0.07974	0.0726	0.96066	879.15	2023-03-31T10:30:21	2023-03-31T10:21:51	Rev1	None	None
ICSI-2	0.1736	0.09726	0.04306	0.97259	887.76	2023-04-07T03:10:23	2023-04-07T03:04:19	Rev1	None	None
ICSI-2	0.294	0.07303	0.08151	0.95902	853.13	2023-04-08T02:00:23	2023-04-08T01:52:38	Rev1	None	None
ICSI-2	0.23231	0.06364	0.06151	0.97725	1007.49	2023-04-19T01:40:29	2023-04-19T01:40:12	Rev1	None	None
ICSI-2	0.22221	0.06141	0.05717	0.98026	17844.11	2023-05-06T01:10:24	2023-05-06T01:08:30	Rev1	None	None
ICSI-2	0.23087	0.05649	0.0564	0.97807	3744.01	2023-05-12T10:00:24	2023-05-12T09:57:07	Rev1	None	None
ICSI-2	0.17839	0.02967	0.03594	0.99781	56061.37	2023-05-22T19:52:00	2023-05-22T19:48:12	Rev1	None	None
ICSI-2	0.1718	0.02812	0.03372	0.99836	112057.34	2023-05-28T23:00:28	2023-05-28T22:54:01	Rev1	None	None
ICSI-2	0.16238	0.02867	0.03152	0.99836	94211.9	2023-06-05T22:50:28	2023-06-05T22:41:55	Rev1	None	None
ICSI-2	0.04741	0.01036	0.00455	1.0	94363.48	2023-06-12T03:00:28	2023-06-12T02:54:36	Rev1	None	None
ICSI-2	0.17533	0.02278	0.03103	0.99973	93584.12	2023-06-26T08:10:27	2023-06-26T08:04:02	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-04-09T19:30:25	2023-04-09T19:21:50	Rev1	:Container File Missing:	:Schema Header:
TrinitySRITrojAI-BostonU	0.70183	0.03606	0.25421	0.5	914.59	2023-04-10T22:20:24	2023-04-10T22:13:48	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-06-06T21:40:28	2023-06-06T21:34:52	Rev1	:No Results::Missing Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI-BostonU	0.70398	0.01785	0.25539	0.5	644.37	2023-06-11T05:50:30	2023-06-11T05:49:46	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70183	0.03606	0.25421	0.5	1971.91	2023-06-11T21:00:30	2023-06-11T20:53:10	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70398	0.01785	0.25539	0.5	703.53	2023-06-13T09:20:30	2023-06-13T09:15:37	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70398	0.01785	0.25539	0.5	2261.79	2023-06-13T21:30:31	2023-06-13T21:24:31	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70398	0.01785	0.25539	0.5	2280.26	2023-06-14T00:20:31	2023-06-14T00:14:35	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70398	0.01785	0.25539	0.5	2280.96	2023-06-14T07:20:31	2023-06-14T07:14:39	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70398	0.01785	0.25539	0.5	2190.35	2023-06-14T14:50:32	2023-06-14T14:45:31	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70398	0.01785	0.25539	0.5	752.05	2023-06-23T00:00:30	2023-06-22T23:52:22	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69146	0.00936	0.24916	0.55345	4751.11	2023-06-27T15:00:28	2023-06-27T14:54:13	Rev1	None	None

Required filename format: "object-detection-feb2023_test_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-feb2023, test: 185
Execution timeout (hh:mm:ss): 5 days, 8:00:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2023-07-11T00:00:05	performer	None	None	Ok	2023-07-10T23:56:23	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-07-11T07:00:07	performer	None	None	Ok	2023-07-11T06:54:38	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-10T20:30:11	performer	None	None	Ok	2023-10-10T20:28:02	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-07-20T05:30:11	performer	None	None	Ok	2023-07-20T05:28:43	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2023-06-27T19:10:10	performer	None	None	Ok	2023-06-27T19:03:38	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2023-06-21T01:40:17	performer	None	None	Ok	2023-06-21T01:31:31	0 d, 0 h, 0 m, 0 s
ARM	2023-06-13T04:50:26	performer	None	Ok	Ok	2023-06-13T04:48:44	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	2023-05-02T02:00:22	performer	None	None	Ok	2023-05-02T01:51:13	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2023-07-11T02:00:28	performer	None	None	Ok	2023-07-11T01:56:07	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-06-27T15:00:28	performer	None	None	Ok	2023-06-27T14:54:13	0 d, 0 h, 0 m, 0 s
trojai-example	2023-03-13T15:10:31	public	None	None	Ok	2023-03-13T15:03:50	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.66901	0.04582	0.23789	0.63294	3714.45	2023-06-27T17:50:05	2023-06-27T17:41:31	Rev1	:Missing Results:	None
TrinitySRITrojAI	0.58517	0.07475	0.19933	0.76306	50021.37	2023-07-11T07:00:07	2023-07-11T06:54:38	Rev1	None	None
PL-GIFT	0.6747	0.06768	0.23394	0.66488	103715.42	2023-07-14T23:20:08	2023-07-14T23:17:11	Rev1	None	None
Perspecta-PurdueRutgers	0.28314	0.08543	0.07977	0.92647	79699.53	2023-07-20T05:30:11	2023-07-20T05:28:43	Rev1	None	None
Perspecta-IUB	2.11938	0.63165	0.29264	0.64718	3088.39	2023-03-27T20:10:11	2023-03-27T20:09:38	Rev1	None	None
ARM-UCSD	0.93411	0.16792	0.2931	0.63571	1895.26	2023-06-21T01:40:17	2023-06-21T01:31:31	Rev1	None	None
ARM	1.03628	0.20235	0.29674	0.69194	2107.0	2023-06-13T04:50:26	2023-06-13T04:48:44	Rev1	None	None
TrinitySRITrojAI-SBU	0.73799	0.06395	0.26705	0.55741	1500.88	2023-05-02T02:00:22	2023-05-02T01:51:13	Rev1	None	None
ICSI-2	0.79481	0.17951	0.22635	0.74388	123545.29	2023-06-12T03:00:28	2023-06-12T02:54:36	Rev1	None	None
TrinitySRITrojAI-BostonU	0.68955	0.00988	0.2482	0.54006	6383.11	2023-06-10T22:00:31	2023-06-10T21:51:48	Rev1	:Missing Results:	None
trojai-example	0.96553	0.12902	0.33804	0.50588	1149.63	2023-03-10T22:41:58	2023-03-10T22:40:44	Rev1	None	:Schema Header:

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.85628	0.10729	0.29425	0.48924	3760.58	2023-04-04T06:50:05	2023-04-04T06:46:51	Rev1	None	None
Perspecta	0.69315	0.0	0.25	0.5	1458.84	2023-04-18T06:50:06	2023-04-18T06:41:56	Rev1	None	None
Perspecta	0.70322	0.03718	0.25335	0.54094	3403.78	2023-04-18T15:10:07	2023-04-18T15:08:18	Rev1	None	None
Perspecta	0.68488	0.03458	0.24553	0.57765	4379.48	2023-04-28T17:40:05	2023-04-28T17:33:27	Rev1	None	None
Perspecta	0.67461	0.04314	0.24035	0.62588	4376.16	2023-04-29T03:40:05	2023-04-29T03:39:59	Rev1	None	None
Perspecta	0.73681	0.06073	0.26946	0.52412	40057.86	2023-06-24T00:30:05	2023-06-24T00:26:43	Rev1	None	None
Perspecta	0.66901	0.04582	0.23789	0.63294	3714.45	2023-06-27T17:50:05	2023-06-27T17:41:31	Rev1	:Missing Results:	None
Perspecta	0.66443	0.04559	0.23573	0.62847	1861.58	2023-07-11T00:00:05	2023-07-10T23:56:23	Rev1	:Missing Results:	None
TrinitySRITrojAI	0.782	0.06766	0.28295	0.50388	8221.66	2023-03-25T00:30:07	2023-03-25T00:26:35	Rev1	None	None
TrinitySRITrojAI	0.73832	0.04847	0.27013	0.51388	50605.8	2023-04-18T19:40:10	2023-04-18T19:32:02	Rev1	None	None
TrinitySRITrojAI	0.74802	0.05977	0.26871	0.54141	94737.94	2023-04-25T07:50:06	2023-04-25T07:40:28	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1045.57	2023-05-16T16:10:06	2023-05-16T16:06:20	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5		2023-05-26T18:00:06	2023-05-26T17:51:22	Rev1	:No Results::Missing Results::Info File Missing:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	273.28	2023-06-01T07:20:06	2023-06-01T07:13:14	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.84728	0.10419	0.29888	0.55612	55218.93	2023-06-02T21:20:06	2023-06-02T21:10:40	Rev1	None	None
TrinitySRITrojAI	0.65772	0.04184	0.23633	0.60224	170288.26	2023-06-07T05:40:07	2023-06-07T05:39:47	Rev1	None	None
TrinitySRITrojAI	0.59497	0.05576	0.20457	0.75318	48983.67	2023-06-26T21:00:07	2023-06-26T20:57:43	Rev1	None	None
TrinitySRITrojAI	0.73985	0.13193	0.24269	0.70788	113623.26	2023-07-08T23:30:06	2023-07-08T23:27:02	Rev1	None	None
TrinitySRITrojAI	0.58517	0.07475	0.19933	0.76306	50021.37	2023-07-11T07:00:07	2023-07-11T06:54:38	Rev1	None	None
PL-GIFT	0.70689	0.06132	0.25544	0.60276	1546.41	2023-04-27T22:20:13	2023-04-27T22:19:31	Rev1	None	None
PL-GIFT	0.86455	0.11637	0.30106	0.57476	3475.73	2023-05-11T06:50:06	2023-05-11T06:45:25	Rev1	None	None
PL-GIFT	6.28303	1.59088	0.37611	0.48018	137288.38	2023-06-27T18:20:52	2023-06-27T18:17:58	Rev1	:Missing Results:	None
PL-GIFT	0.64791	0.03093	0.23011	0.63488	1608.66	2023-07-07T18:20:08	2023-07-07T18:14:04	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2023-07-08T17:00:08	2023-07-08T16:58:45	Rev1	:No Results::Missing Results:	:Container Parameters (metaparameters)::Container Parameters (metaparameters schema):
PL-GIFT	0.97445	0.40475	0.25058	0.57412	1718.47	2023-07-09T18:00:07	2023-07-09T17:56:47	Rev1	None	None
PL-GIFT	0.64914	0.03412	0.23184	0.61206	1863.48	2023-07-09T20:10:07	2023-07-09T20:00:57	Rev1	None	None
PL-GIFT	0.64536	0.0316	0.23016	0.58529	1827.77	2023-07-09T23:20:07	2023-07-09T23:14:58	Rev1	None	None
PL-GIFT	0.7319	0.07514	0.25564	0.58218	1735.73	2023-07-10T17:30:08	2023-07-10T17:22:01	Rev1	None	None
PL-GIFT	0.87341	0.29549	0.26587	0.59206	1754.85	2023-07-10T19:10:08	2023-07-10T19:02:59	Rev1	None	None
PL-GIFT	0.64213	0.0293	0.22828	0.616	1727.3	2023-07-10T22:30:08	2023-07-10T22:29:31	Rev1	None	None
PL-GIFT	0.644	0.03345	0.23086	0.61929	1759.37	2023-07-12T22:40:07	2023-07-12T22:40:04	Rev1	None	None
PL-GIFT	0.6747	0.06768	0.23394	0.66488	103715.42	2023-07-14T23:20:08	2023-07-14T23:17:11	Rev1	None	None
PL-GIFT	0.67902	0.06397	0.24158	0.64147	193584.83	2023-07-18T20:20:10	2023-07-18T20:10:35	Rev1	None	None
PL-GIFT	0.70632	0.0564	0.25471	0.57282	188393.05	2023-07-25T16:00:09	2023-07-25T15:58:39	Rev1	None	None
PL-GIFT	1.14108	0.1907	0.3326	0.52424	1124.05	2023-10-10T00:50:13	2023-10-10T00:42:23	Rev1	None	None
PL-GIFT	0.71091	0.04667	0.25514	0.54518	1128.34	2023-10-10T05:22:42	2023-10-10T05:15:15	Rev1	None	None
PL-GIFT	1.09561	0.17155	0.33651	0.54353	1116.89	2023-10-10T14:30:14	2023-10-10T14:25:56	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2023-10-10T15:22:03	2023-10-10T15:17:01	Rev1	:No Results::Missing Results:	:Container Parameters (jsonschema checker):
PL-GIFT	0.83476	0.10977	0.28439	0.53188	1071.75	2023-10-10T17:00:13	2023-10-10T16:58:29	Rev1	None	None
PL-GIFT	0.71922	0.04615	0.25776	0.53812	1116.53	2023-10-10T18:02:39	2023-10-10T17:59:18	Rev1	None	None
PL-GIFT	0.78575	0.09091	0.27795	0.56647	1134.14	2023-10-10T19:20:11	2023-10-10T19:14:03	Rev1	None	None
PL-GIFT	0.77627	0.0599	0.28128	0.508	1140.44	2023-10-10T20:30:11	2023-10-10T20:28:02	Rev1	None	None
Perspecta-PurdueRutgers	0.49376	0.09943	0.14978	0.85147	73898.53	2023-05-20T06:30:10	2023-05-20T06:27:01	Rev1	None	None
Perspecta-PurdueRutgers	0.46868	0.09453	0.14143	0.86535	75716.78	2023-05-29T05:10:09	2023-05-29T05:00:42	Rev1	None	None
Perspecta-PurdueRutgers	0.41534	0.08223	0.12831	0.87729	78407.19	2023-06-10T08:20:10	2023-06-10T08:19:31	Rev1	:Missing Results:	None
Perspecta-PurdueRutgers	0.30574	0.08178	0.08322	0.92429	78295.74	2023-06-11T17:50:10	2023-06-11T17:40:16	Rev1	None	None
Perspecta-PurdueRutgers	0.3838	0.09183	0.11632	0.88535	82448.92	2023-07-10T14:40:11	2023-07-10T14:35:18	Rev1	:Missing Results:	None
Perspecta-PurdueRutgers	0.30891	0.0925	0.08866	0.92035	82900.95	2023-07-12T00:20:10	2023-07-12T00:19:44	Rev1	None	None
Perspecta-PurdueRutgers	0.30891	0.0925	0.08866	0.92035	81533.7	2023-07-15T06:40:10	2023-07-15T06:33:56	Rev1	None	None
Perspecta-PurdueRutgers	0.39044	0.08405	0.12161	0.88365	79262.11	2023-07-16T16:10:12	2023-07-16T16:00:48	Rev1	:Missing Results:	None
Perspecta-PurdueRutgers	0.41833	0.30072	0.08081	0.92165	78248.52	2023-07-17T19:20:12	2023-07-17T19:15:00	Rev1	None	None
Perspecta-PurdueRutgers	0.28314	0.08543	0.07977	0.92647	79699.53	2023-07-20T05:30:11	2023-07-20T05:28:43	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-03-25T15:50:11	2023-03-25T15:46:48	Rev1	None	:Schema Header:
Perspecta-IUB	1.67989	0.42697	0.31374	0.64388	3470.85	2023-03-25T18:30:10	2023-03-25T18:27:11	Rev1	None	None
Perspecta-IUB	2.11938	0.63165	0.29264	0.64718	3088.39	2023-03-27T20:10:11	2023-03-27T20:09:38	Rev1	None	None
Perspecta-IUB	1.17077	0.28654	0.29032	0.55435	2530.22	2023-03-28T01:50:11	2023-03-28T01:41:16	Rev1	None	None
Perspecta-IUB	1.46808	0.3249	0.33534	0.578	2556.06	2023-03-29T03:00:11	2023-03-29T02:57:04	Rev1	None	None
Perspecta-IUB	1.27651	0.26722	0.31383	0.53918	10960.17	2023-03-29T20:50:10	2023-03-29T20:50:03	Rev1	None	None
Perspecta-IUB	1.27651	0.26722	0.31383	0.53918	10878.02	2023-05-02T19:00:10	2023-05-02T18:57:35	Rev1	None	None
Perspecta-IUB	1.27651	0.26722	0.31383	0.53918	10463.62	2023-06-27T19:10:10	2023-06-27T19:03:38	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-05-30T17:00:18	2023-05-30T16:56:16	Rev1	:Executed File Update::No Results::Missing Results::Info File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	769.68	2023-06-05T20:40:15	2023-06-05T20:37:29	Rev1	:Missing Results:	None
ARM-UCSD	0.93411	0.16792	0.2931	0.63571	1895.26	2023-06-21T01:40:17	2023-06-21T01:31:31	Rev1	None	None
ARM	0.96557	0.18772	0.28498	0.68047	3027.23	2023-05-16T12:10:24	2023-05-16T12:04:17	Rev1	None	None
ARM	0.95802	0.18412	0.28818	0.68947	2046.45	2023-05-16T16:50:24	2023-05-16T16:44:18	Rev1	None	None
ARM	1.03628	0.20235	0.29674	0.69194	2107.0	2023-06-13T04:50:26	2023-06-13T04:48:44	Rev1	None	None
TrinitySRITrojAI-SBU	0.71798	0.0412	0.26142	0.528	1562.78	2023-04-04T05:30:19	2023-04-04T05:22:12	Rev1	None	None
TrinitySRITrojAI-SBU	0.72078	0.0413	0.26258	0.52812	1500.18	2023-04-18T19:42:50	2023-04-18T19:40:00	Rev1	None	None
TrinitySRITrojAI-SBU	0.74799	0.05432	0.27292	0.52153	1001.52	2023-04-18T23:50:24	2023-04-18T23:45:56	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	1155.27	2023-05-01T23:30:21	2023-05-01T23:29:59	Rev1	None	None
TrinitySRITrojAI-SBU	0.73799	0.06395	0.26705	0.55741	1500.88	2023-05-02T02:00:22	2023-05-02T01:51:13	Rev1	None	None
ICSI-2	0.74203	0.0577	0.26893	0.53653	1227.35	2023-03-15T22:10:24	2023-03-15T22:00:30	Rev1	None	None
ICSI-2	1.11274	0.16968	0.35806	0.52965	1268.21	2023-04-07T03:10:23	2023-04-07T03:04:19	Rev1	None	None
ICSI-2	0.76633	0.08519	0.27614	0.59412	1242.31	2023-04-08T02:00:23	2023-04-08T01:52:38	Rev1	None	None
ICSI-2	0.81266	0.09468	0.29202	0.56518	1488.52	2023-04-19T01:40:29	2023-04-19T01:40:12	Rev1	None	None
ICSI-2	0.69315	0.0	0.25	0.5		2023-05-06T00:00:24	2023-05-05T23:54:12	Rev1	None	:Container Parameters (jsonschema checker):
ICSI-2	0.84182	0.11469	0.29269	0.59059	26957.79	2023-05-06T01:10:24	2023-05-06T01:08:30	Rev1	None	None
ICSI-2	0.84182	0.11469	0.29269	0.59059	27036.49	2023-05-06T08:51:40	2023-05-06T01:10:41	Rev1	None	None
ICSI-2	0.71755	0.11121	0.24326	0.68653	5555.79	2023-05-12T10:00:24	2023-05-12T09:57:07	Rev1	None	None
ICSI-2	0.68036	0.11046	0.2277	0.71688	71364.42	2023-05-22T19:52:00	2023-05-22T19:48:12	Rev1	None	None
ICSI-2	0.70131	0.11025	0.23821	0.69788	142969.0	2023-05-28T23:00:28	2023-05-28T22:54:01	Rev1	None	None
ICSI-2	0.67516	0.11452	0.22487	0.72482	122210.48	2023-06-05T22:50:28	2023-06-05T22:41:55	Rev1	None	None
ICSI-2	0.79481	0.17951	0.22635	0.74388	123545.29	2023-06-12T03:00:28	2023-06-12T02:54:36	Rev1	None	None
ICSI-2	0.64145	0.07582	0.22393	0.72329	122411.86	2023-06-26T08:10:27	2023-06-26T08:04:02	Rev1	None	None
ICSI-2	0.69315	0.0	0.25	0.5	84571.92	2023-07-11T02:00:28	2023-07-11T01:56:07	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI-BostonU	0.69712	0.02912	0.25189	0.5	1397.03	2023-04-17T14:40:28	2023-04-17T14:36:14	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69712	0.02912	0.25189	0.5	1417.2	2023-04-17T15:20:26	2023-04-17T15:15:17	Rev1	None	None
TrinitySRITrojAI-BostonU	0.68447	0.0128	0.24619	0.51453	2041.22	2023-04-24T14:10:28	2023-04-22T11:38:05	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-06-05T21:20:30	2023-06-05T21:11:53	Rev1	:No Results::Missing Results:	:Schema Header:
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-06-05T22:40:31	2023-06-05T22:33:00	Rev1	:No Results::Missing Results:	:Schema Header:
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-06-05T23:30:26	2023-06-05T23:23:42	Rev1	:No Results::Missing Results:	:Schema Header:
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-06-06T01:00:28	2023-06-06T00:58:33	Rev1	:No Results::Missing Results:	:Schema Header:
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-06-06T20:50:29	2023-06-06T20:47:10	Rev1	:No Results::Missing Results:	:Schema Header:
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-06-06T23:10:29	2023-06-06T23:09:30	Rev1	:No Results::Missing Results::Info File Missing:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	309.91	2023-06-07T08:50:29	2023-06-07T08:49:16	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI-BostonU	0.68955	0.00988	0.2482	0.50976	6652.32	2023-06-10T06:00:31	2023-06-10T05:58:26	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.68955	0.00988	0.2482	0.54006	6383.11	2023-06-10T22:00:31	2023-06-10T21:51:48	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	944.23	2023-06-11T05:50:30	2023-06-11T05:49:46	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69712	0.02912	0.25189	0.5	2711.25	2023-06-11T21:00:30	2023-06-11T20:53:10	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70598	0.01394	0.25639	0.49471	5005.38	2023-06-12T22:50:30	2023-06-12T22:42:52	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70598	0.01394	0.25639	0.49471	4829.4	2023-06-13T04:40:30	2023-06-13T04:34:39	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70682	0.01437	0.25681	0.49412	3149.17	2023-06-13T07:10:30	2023-06-13T07:09:11	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	1065.67	2023-06-13T09:20:30	2023-06-13T09:15:37	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70682	0.01437	0.25681	0.49412	3047.44	2023-06-13T17:50:31	2023-06-13T17:48:54	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	3052.41	2023-06-13T21:30:31	2023-06-13T21:24:31	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	3157.96	2023-06-14T00:20:31	2023-06-14T00:14:35	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	3141.87	2023-06-14T07:20:31	2023-06-14T07:14:39	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70682	0.01437	0.25681	0.49412	3112.14	2023-06-14T10:40:31	2023-06-14T10:36:11	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	3100.72	2023-06-14T14:50:32	2023-06-14T14:45:31	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	1183.47	2023-06-23T00:00:30	2023-06-22T23:52:22	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69028	0.00755	0.24857	0.48506	6598.71	2023-06-27T15:00:28	2023-06-27T14:54:13	Rev1	None	None
trojai-example	0.69315	0.0	0.25	0.5		2023-03-10T22:24:54	2023-03-10T22:24:44	Rev1	:Executed File Update::Info File Missing:	None
trojai-example	0.96553	0.12902	0.33804	0.50588	1149.63	2023-03-10T22:41:58	2023-03-10T22:40:44	Rev1	None	:Schema Header:
trojai-example	0.96553	0.12902	0.33804	0.50588	1141.83	2023-03-13T15:10:31	2023-03-13T15:03:50	Rev1	None	:Schema Header:

Required filename format: "object-detection-feb2023_sts_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-feb2023, sts: 10
Execution timeout (hh:mm:ss): 6:40:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2023-07-10T23:40:05	performer	None	None	Ok	2023-07-10T23:30:44	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-07-11T05:20:07	performer	None	None	Ok	2023-07-11T05:16:06	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2024-03-19T16:00:08	performer	None	None	Ok	2024-03-19T15:59:59	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-07-11T20:30:10	performer	None	None	Ok	2023-07-11T20:27:32	0 d, 0 h, 0 m, 0 s
Perspecta-IUB		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2023-06-21T01:40:18	performer	None	None	Ok	2023-06-21T01:32:02	0 d, 0 h, 0 m, 0 s
ARM	2023-05-16T11:50:24	performer	None	None	Ok	2023-05-16T11:47:01	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	2023-04-18T20:40:22	performer	None	None	Ok	2023-04-18T20:30:49	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2023-03-15T21:40:24	performer	None	None	Ok	2023-03-15T21:33:13	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-06-11T05:50:31	performer	None	None	Ok	2023-06-11T05:40:44	0 d, 0 h, 0 m, 0 s
trojai-example	2023-03-14T17:00:30	public	None	None	Ok	2023-03-14T16:59:37	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.40128	0.11164	0.11474	0.9375	460.16	2023-04-29T02:40:05	2023-04-29T02:34:42	Rev1	None	None
TrinitySRITrojAI	0.36223	0.11185	0.10238	1.0	1166.17	2023-05-22T19:20:06	2023-05-22T19:11:07	Rev1	None	None
PL-GIFT	0.23772	0.08649	0.05348	1.0	94.83	2023-07-07T18:20:09	2023-07-07T18:13:30	Rev1	None	None
Perspecta-PurdueRutgers	0.36078	0.42647	0.10162	0.96875	5178.94	2023-03-21T20:30:10	2023-03-21T20:28:14	Rev1	None	None
ARM-UCSD	0.11142	0.05462	0.01631	1.0	101.71	2023-06-21T01:40:18	2023-06-21T01:32:02	Rev1	None	None
ARM	0.18488	0.14572	0.04748	1.0	150.92	2023-05-16T11:50:24	2023-05-16T11:47:01	Rev1	None	None
TrinitySRITrojAI-SBU	0.44791	0.07471	0.13352	1.0	53.28	2023-04-18T20:40:22	2023-04-18T20:30:49	Rev1	None	None
ICSI-2	0.22077	0.09074	0.04841	1.0	75.99	2023-03-15T21:40:24	2023-03-15T21:33:13	Rev1	None	None
TrinitySRITrojAI-BostonU	0.65531	0.04044	0.23114	0.65625	292.48	2023-06-08T10:40:30	2023-06-08T10:39:39	Rev1	:Missing Results:	None
trojai-example	0.5532	0.36346	0.18464	0.5625	62.34	2023-03-10T03:26:39	2023-03-10T03:17:14	Rev1	None	:Schema Header::Execute:

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.69315	0.0	0.25	0.5		2023-04-04T03:30:06	2023-04-04T03:28:06	Rev1	:Container File Missing:	:Schema Header:
Perspecta	0.54939	0.24798	0.19794	0.59375	269.85	2023-04-04T04:30:05	2023-04-04T04:25:39	Rev1	None	None
Perspecta	0.69315	0.0	0.25	0.5		2023-04-04T05:40:05	2023-04-04T05:30:42	Rev1	:Executed File Update::Info File Missing::Container File Missing:	None
Perspecta	0.69315	0.0	0.25	0.5	101.79	2023-04-18T07:50:06	2023-04-18T07:45:06	Rev1	None	None
Perspecta	0.55499	0.08682	0.184	0.90625	246.32	2023-04-18T14:10:09	2023-04-18T14:03:44	Rev1	None	None
Perspecta	0.69315	0.0	0.25	0.5	99.35	2023-04-28T04:20:05	2023-04-28T04:15:52	Rev1	None	None
Perspecta	0.69315	0.0	0.25	0.5	50.33	2023-04-28T15:00:05	2023-04-28T14:55:00	Rev1	None	None
Perspecta	0.53183	0.12625	0.17543	0.8125	450.72	2023-04-28T16:40:05	2023-04-28T16:32:05	Rev1	None	None
Perspecta	0.53183	0.12625	0.17543	0.8125	450.52	2023-04-28T19:20:06	2023-04-28T19:11:32	Rev1	None	None
Perspecta	0.40128	0.11164	0.11474	0.9375	460.16	2023-04-29T02:40:05	2023-04-29T02:34:42	Rev1	None	None
Perspecta	0.57599	0.16278	0.194	0.5625	2875.45	2023-06-23T17:40:06	2023-06-23T17:39:45	Rev1	:Missing Results:	None
Perspecta	0.69559	0.25728	0.25	0.5625	3490.22	2023-06-23T22:50:06	2023-06-23T22:41:56	Rev1	None	None
Perspecta	0.52613	0.21006	0.17	0.875	365.06	2023-06-27T17:20:05	2023-06-27T17:17:41	Rev1	None	None
Perspecta	0.52613	0.21006	0.17	0.5	159.36	2023-07-10T20:50:05	2023-07-10T20:40:39	Rev1	None	None
Perspecta	0.52613	0.21006	0.17	0.5	165.35	2023-07-10T23:40:05	2023-07-10T23:30:44	Rev1	None	None
TrinitySRITrojAI	0.68236	0.01416	0.24461	0.59375	6000.69	2023-03-24T00:40:07	2023-03-24T00:30:19	Rev1	None	:Timeout:
TrinitySRITrojAI	0.61687	0.04086	0.21215	0.875	597.85	2023-03-24T22:00:07	2023-03-24T21:59:32	Rev1	None	None
TrinitySRITrojAI	0.818	0.18012	0.30845	0.6875	2617.08	2023-04-18T18:20:08	2023-04-18T18:19:21	Rev1	None	None
TrinitySRITrojAI	0.7568	0.16221	0.27944	0.625	210.7	2023-04-25T01:00:06	2023-04-25T00:58:54	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	86.17	2023-05-16T02:30:13	2023-05-14T22:34:28	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.64599	0.20082	0.22597	0.375	6662.7	2023-05-16T06:50:08	2023-05-16T06:49:06	Rev1	None	None
TrinitySRITrojAI	0.64595	0.20059	0.22596	0.375	6797.19	2023-05-18T01:00:06	2023-05-18T00:54:34	Rev1	None	None
TrinitySRITrojAI	0.6478	0.19788	0.22673	0.375	7226.4	2023-05-20T00:10:07	2023-05-20T00:08:21	Rev1	None	None
TrinitySRITrojAI	0.36223	0.11185	0.10238	1.0	1166.17	2023-05-22T19:20:06	2023-05-22T19:11:07	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	172.89	2023-05-25T06:00:06	2023-05-25T05:53:33	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.44809	0.37335	0.14757	1.0	13841.74	2023-05-26T02:40:07	2023-05-26T02:32:36	Rev1	None	None
TrinitySRITrojAI	0.71038	0.39821	0.24705	1.0	23854.84	2023-05-31T17:40:07	2023-05-31T17:38:36	Rev1	None	None
TrinitySRITrojAI	0.44191	0.15177	0.13794	0.9375	3267.54	2023-06-01T05:40:07	2023-06-01T05:36:11	Rev1	None	None
TrinitySRITrojAI	0.53922	0.31945	0.1728	0.875	3236.07	2023-06-01T19:20:06	2023-06-01T19:14:49	Rev1	None	None
TrinitySRITrojAI	0.47139	0.0761	0.14359	1.0	11172.93	2023-06-05T05:50:06	2023-06-05T05:45:08	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5		2023-06-20T16:10:10	2023-06-17T00:51:10	Rev1	:No Results::Missing Results::Container File Missing:	:Schema Header:
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	61.5	2023-06-21T21:50:07	2023-06-21T21:48:43	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.29722	0.05929	0.06924	1.0	3995.86	2023-06-26T19:10:06	2023-06-26T19:08:10	Rev1	None	None
TrinitySRITrojAI	0.18046	0.08331	0.03562	1.0	9333.0	2023-07-08T19:20:06	2023-07-08T19:15:49	Rev1	None	None
TrinitySRITrojAI	0.2244	0.05577	0.04384	1.0	4760.33	2023-07-11T05:20:07	2023-07-11T05:16:06	Rev1	None	None
PL-GIFT	0.57642	0.12551	0.19973	0.8125	39.17	2023-03-20T22:10:08	2023-03-20T22:00:14	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5	10.4	2023-03-22T19:50:08	2023-03-22T19:46:00	Rev1	None	None
PL-GIFT	0.58463	0.13219	0.20354	0.90625	49.92	2023-03-22T21:10:09	2023-03-22T21:07:55	Rev1	None	None
PL-GIFT	0.48042	0.16416	0.16387	0.8125	92.42	2023-04-27T16:30:06	2023-04-27T16:24:42	Rev1	None	None
PL-GIFT	0.44995	0.20035	0.14138	0.84375	88.55	2023-04-27T21:30:07	2023-04-27T21:20:32	Rev1	None	None
PL-GIFT	0.39597	0.18974	0.11382	0.75	211.44	2023-05-11T06:50:08	2023-05-11T06:44:54	Rev1	None	None
PL-GIFT	0.54545	0.15862	0.18128	0.71875	9465.34	2023-06-27T18:20:53	2023-06-27T18:19:22	Rev1	:Missing Results:	None
PL-GIFT	0.23772	0.08649	0.05348	1.0	94.83	2023-07-07T18:20:09	2023-07-07T18:13:30	Rev1	None	None
PL-GIFT	0.17024	0.0764	0.034	1.0	101.69	2023-07-08T17:00:09	2023-07-08T16:58:14	Rev1	None	None
PL-GIFT	0.17024	0.0764	0.034	1.0	102.86	2023-07-09T18:00:08	2023-07-09T17:56:55	Rev1	None	None
PL-GIFT	0.20616	0.11653	0.05033	1.0	107.36	2023-07-09T20:10:08	2023-07-09T20:00:30	Rev1	None	None
PL-GIFT	0.14377	0.06998	0.02567	1.0	106.37	2023-07-09T23:20:08	2023-07-09T23:15:05	Rev1	None	None
PL-GIFT	0.11111	0.0514	0.01603	1.0	99.88	2023-07-10T17:30:09	2023-07-10T17:22:14	Rev1	None	None
PL-GIFT	0.02475	0.01879	0.00144	1.0	108.75	2023-07-10T19:10:09	2023-07-10T19:03:08	Rev1	None	None
PL-GIFT	0.14886	0.06029	0.02485	1.0	102.18	2023-07-10T22:30:09	2023-07-10T22:29:42	Rev1	None	None
PL-GIFT	0.14318	0.08676	0.02998	1.0	102.25	2023-07-12T22:40:08	2023-07-12T22:39:15	Rev1	None	None
PL-GIFT	0.28329	0.20742	0.10006	0.90625	62.54	2023-10-06T21:42:40	2023-10-06T21:41:48	Rev1	:Missing Results:	None
PL-GIFT	0.3681	0.16607	0.1127	0.90625	54.82	2023-10-09T21:13:55	2023-10-09T21:07:47	Rev1	:Missing Results:	None
PL-GIFT	0.1001	0.04544	0.01298	1.0	62.86	2023-10-09T23:44:46	2023-10-09T23:34:45	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5	108.99	2024-03-19T01:40:09	2024-03-19T01:33:56	Rev1	:No Results::Missing Results:	None
PL-GIFT	0.69315	0.0	0.25	0.5	168.02	2024-03-19T02:30:08	2024-03-19T02:23:57	Rev1	:No Results::Missing Results:	None
PL-GIFT	0.69315	0.0	0.25	0.5	170.87	2024-03-19T16:00:08	2024-03-19T15:59:59	Rev1	:No Results::Missing Results:	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5	2739.11	2023-03-21T07:40:11	2023-03-21T07:32:00	Rev1	None	None
Perspecta-PurdueRutgers	0.36078	0.42647	0.10162	0.96875	5178.94	2023-03-21T20:30:10	2023-03-21T20:28:14	Rev1	None	None
Perspecta-PurdueRutgers	0.27485	0.23811	0.08029	0.90625	6995.83	2023-03-29T21:20:09	2023-03-29T21:11:06	Rev1	None	None
Perspecta-PurdueRutgers	0.27485	0.23811	0.08029	0.90625	7934.57	2023-04-04T05:30:08	2023-04-04T05:20:39	Rev1	None	None
Perspecta-PurdueRutgers	0.38366	0.28097	0.12628	0.84375	7099.89	2023-04-13T17:50:10	2023-04-13T17:49:53	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2023-05-31T03:50:09	2023-05-31T03:42:49	Rev1	:Executed File Update::No Results::Missing Results::Info File Missing::Container File Missing:	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5	63.39	2023-07-10T06:50:09	2023-07-10T06:42:19	Rev1	:No Results::Missing Results:	None
Perspecta-PurdueRutgers	0.33432	0.28669	0.09332	0.75	7506.16	2023-07-10T09:10:10	2023-07-10T09:06:06	Rev1	None	None
Perspecta-PurdueRutgers	0.63637	0.60505	0.18224	0.6875	7500.43	2023-07-11T20:30:10	2023-07-11T20:27:32	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-05-16T02:30:24	2023-05-15T20:25:25	Rev1	:No Results::Missing Results::Info File Missing::Container File Missing:	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-05-16T20:40:59	2023-05-16T20:31:03	Rev1	:No Results::Missing Results::Container File Missing:	:Schema Header:
ARM-UCSD	0.69315	0.0	0.25	0.5	39.79	2023-05-17T22:50:18	2023-05-17T22:47:12	Rev1	:Missing Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	41.16	2023-05-30T18:40:18	2023-05-30T18:38:16	Rev1	:Missing Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	42.12	2023-06-05T19:41:28	2023-06-05T19:35:42	Rev1	:Missing Results:	None
ARM-UCSD	0.60373	0.11338	0.21017	0.625	42.2	2023-06-05T23:10:17	2023-06-05T23:04:05	Rev1	None	None
ARM-UCSD	0.60373	0.11338	0.21017	0.625	45.16	2023-06-06T20:00:16	2023-06-06T19:57:59	Rev1	None	None
ARM-UCSD	0.60373	0.11338	0.21017	0.625	49.21	2023-06-20T22:30:17	2023-06-20T22:21:16	Rev1	None	None
ARM-UCSD	0.11142	0.05462	0.01631	1.0	101.71	2023-06-21T01:40:18	2023-06-21T01:32:02	Rev1	None	None
ARM	0.69315	0.0	0.25	0.5	22.37	2023-05-16T10:50:24	2023-05-16T10:40:59	Rev1	:No Results::Missing Results:	None
ARM	0.69315	0.0	0.25	0.5	115.82	2023-05-16T11:20:24	2023-05-16T11:17:49	Rev1	:No Results::Missing Results:	None
ARM	0.18488	0.14572	0.04748	1.0	150.92	2023-05-16T11:50:24	2023-05-16T11:47:01	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-03-28T00:40:23	2023-03-28T00:35:33	Rev1	:Info File Missing::Container File Missing:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-03-28T01:00:23	2023-03-28T00:59:09	Rev1	:Info File Missing::Container File Missing:	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-03-28T01:30:24	2023-03-28T01:21:57	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker)::Schema Header:
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-03-28T02:10:21	2023-03-28T02:00:33	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-04-04T00:30:20	2023-04-04T00:28:27	Rev1	:Container File Missing:	:Schema Header:
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-04-04T01:10:21	2023-04-04T01:03:11	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5		2023-04-04T02:00:20	2023-04-04T01:55:46	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	11.61	2023-04-04T03:00:20	2023-04-04T03:00:01	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	36.38	2023-04-04T03:30:21	2023-04-04T03:23:46	Rev1	None	None
TrinitySRITrojAI-SBU	0.69315	0.0	0.25	0.5	78.28	2023-04-04T04:00:20	2023-04-04T03:59:19	Rev1	:Result Parse:	None
TrinitySRITrojAI-SBU	0.5517	0.07862	0.18149	0.90625	82.22	2023-04-04T05:00:21	2023-04-04T04:54:16	Rev1	None	None
TrinitySRITrojAI-SBU	0.54535	0.08546	0.17901	0.90625	77.32	2023-04-18T19:30:24	2023-04-18T19:22:07	Rev1	None	None
TrinitySRITrojAI-SBU	0.44791	0.07471	0.13352	1.0	53.28	2023-04-18T20:40:22	2023-04-18T20:30:49	Rev1	None	None
ICSI-2	0.69315	0.0	0.25	0.5		2023-03-15T19:10:24	2023-03-15T19:08:38	Rev1	:Container File Missing:	:Container Parameters (jsonschema checker):
ICSI-2	0.22077	0.09074	0.04841	1.0	75.99	2023-03-15T21:40:24	2023-03-15T21:33:13	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	17.97	2023-06-07T10:50:31	2023-06-07T10:44:53	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	102.29	2023-06-08T00:00:30	2023-06-07T23:55:59	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	99.88	2023-06-08T02:30:31	2023-06-08T02:22:14	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	99.36	2023-06-08T08:10:30	2023-06-08T08:06:44	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI-BostonU	0.65531	0.04044	0.23114	0.65625	292.48	2023-06-08T10:40:30	2023-06-08T10:39:39	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	65.92	2023-06-08T17:00:31	2023-06-08T16:56:06	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI-BostonU	0.65531	0.04044	0.23114	0.65625	281.3	2023-06-08T19:00:32	2023-06-08T18:55:22	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.65412	0.03422	0.23051	0.5625	471.36	2023-06-10T04:50:31	2023-06-10T04:44:50	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5		2023-06-11T01:40:29	2023-06-11T01:35:39	Rev1	:No Results::Missing Results::Info File Missing::Container File Missing:	None
TrinitySRITrojAI-BostonU	0.75837	0.04975	0.2825	0.5	54.08	2023-06-11T05:50:31	2023-06-11T05:40:44	Rev1	None	None
trojai-example	0.69315	0.0	0.25	0.5	9.78	2023-03-10T03:11:19	2023-03-10T03:09:52	Rev1	None	:Schema Header::Copy in::Execute:
trojai-example	0.5532	0.36346	0.18464	0.5625	62.34	2023-03-10T03:26:39	2023-03-10T03:17:14	Rev1	None	:Schema Header::Execute:
trojai-example	0.69315	0.0	0.25	0.5	0.57	2023-03-10T03:48:12	2023-03-10T03:46:40	Rev1	:Container File Missing:	:Schema Header::Execute::Copy Out:
trojai-example	0.5532	0.36346	0.18464	0.5625	63.42	2023-03-10T03:54:10	2023-03-10T03:53:07	Rev1	None	:Schema Header:
trojai-example	0.5532	0.36346	0.18464	0.5625	64.08	2023-03-10T04:16:17	2023-03-10T04:14:57	Rev1	None	:Schema Header:
trojai-example	0.69315	0.0	0.25	0.5		2023-03-10T16:45:35	2023-03-10T16:43:14	Rev1	:Info File Missing::Container File Missing:	None
trojai-example	0.69315	0.0	0.25	0.5	12.69	2023-03-10T17:19:19	2023-03-10T17:17:19	Rev1	None	:Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example	0.69315	0.0	0.25	0.5	9.65	2023-03-10T17:32:36	2023-03-10T17:31:29	Rev1	None	:Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example	0.69315	0.0	0.25	0.5	9.62	2023-03-10T18:03:44	2023-03-10T17:59:57	Rev1	None	:Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example	0.69315	0.0	0.25	0.5	9.66	2023-03-10T18:20:22	2023-03-10T18:17:24	Rev1	None	:Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example	0.69315	0.0	0.25	0.5	9.69	2023-03-10T18:26:52	2023-03-10T18:25:43	Rev1	None	:Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example	0.69315	0.0	0.25	0.5	9.68	2023-03-10T18:31:22	2023-03-10T18:30:24	Rev1	None	:Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example	0.69315	0.0	0.25	0.5	9.61	2023-03-10T18:48:53	2023-03-10T18:46:14	Rev1	None	:Schema Header::Copy in::Copy in::Copy in::Copy in::Copy in:
trojai-example	0.5532	0.36346	0.18464	0.5625	63.5	2023-03-10T19:33:16	2023-03-10T19:32:14	Rev1	None	:Schema Header:
trojai-example	0.5532	0.36346	0.18464	0.5625	63.85	2023-03-10T20:07:38	2023-03-10T20:06:09	Rev1	None	:Schema Header:
trojai-example	0.69315	0.0	0.25	0.5		2023-03-10T21:46:15	2023-03-10T21:45:24	Rev1	:Executed File Update::Info File Missing::Container File Missing:	None
trojai-example	0.5532	0.36346	0.18464	0.5625	63.86	2023-03-10T21:59:23	2023-03-10T21:53:01	Rev1	None	:Schema Header:
trojai-example	0.5532	0.36346	0.18464	0.5625	70.33	2023-03-10T22:35:04	2023-03-10T22:33:52	Rev1	None	:Schema Header:
trojai-example	0.52632	0.49397	0.1664	0.5	83.99	2023-03-14T17:00:30	2023-03-14T16:59:37	Rev1	None	:Schema Header:

Required filename format: "object-detection-feb2023_dev_<Submission Name>.simg"
Accepting submissions: True
Number of models in object-detection-feb2023, dev: 185
Execution timeout (hh:mm:ss): 5 days, 8:00:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-06-05T06:30:06	performer	None	None	Ok	2023-06-05T06:25:25	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-07-08T17:30:09	performer	None	None	Ok	2023-07-08T17:21:21	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-07-09T20:30:08	performer	None	None	Ok	2023-07-09T20:25:00	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2023-03-25T20:00:10	performer	None	None	Ok	2023-03-25T19:53:28	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2023-06-05T19:41:29	performer	None	None	Ok	2023-06-05T19:35:08	0 d, 0 h, 0 m, 0 s
ARM		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2023-05-28T18:20:28	performer	None	None	Ok	2023-05-28T18:11:34	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-06-27T07:20:27	performer	None	None	Ok	2023-06-27T07:17:15	0 d, 0 h, 0 m, 0 s
trojai-example	2023-06-02T13:33:39	public	None	None	Ok	2023-06-02T13:30:39	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
TrinitySRITrojAI	0.65689	0.04443	0.23594	0.60976	168541.96	2023-06-05T06:30:06	2023-06-05T06:25:25	Rev1	None	None
PL-GIFT	0.70689	0.06132	0.25544	0.60276	1464.72	2023-04-27T21:41:58	2023-04-27T21:32:48	Rev1	None	None
Perspecta-PurdueRutgers	0.36033	0.03079	0.1013	0.95718	214.45	2023-03-24T05:10:09	2023-03-24T05:00:39	Rev1	None	None
Perspecta-IUB	1.68364	0.42673	0.31509	0.64059	3437.12	2023-03-25T20:00:10	2023-03-25T19:53:28	Rev1	None	None
ARM-UCSD	0.85038	0.13357	0.27261	0.55418	677.76	2023-06-05T19:41:29	2023-06-05T19:35:08	Rev1	None	None
ICSI-2	0.72548	0.11367	0.246	0.69071	5750.91	2023-05-11T09:10:23	2023-05-11T09:08:35	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	1040.08	2023-06-22T03:40:30	2023-06-22T03:32:03	Rev1	None	None
trojai-example	0.86477	0.11619	0.29668	0.56224	57033.52	2023-06-01T20:22:06	2023-06-01T20:18:52	Rev1	None	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
TrinitySRITrojAI	0.71324	0.02902	0.25918	0.50141	2592.87	2023-04-25T01:30:06	2023-04-25T01:22:30	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1070.48	2023-05-16T19:20:06	2023-05-16T19:19:34	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1065.65	2023-05-17T22:00:06	2023-05-17T21:59:21	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1081.26	2023-05-18T00:00:06	2023-05-17T23:59:01	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69698	0.0055	0.25192	0.5	1229.49	2023-05-18T05:40:07	2023-05-18T05:30:08	Rev1	None	None
TrinitySRITrojAI	0.69698	0.0055	0.25192	0.5	1218.49	2023-05-18T15:30:06	2023-05-18T15:29:08	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1050.59	2023-05-18T19:00:06	2023-05-18T18:50:12	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69698	0.0055	0.25192	0.5	1215.51	2023-05-18T23:20:06	2023-05-18T23:19:08	Rev1	None	None
TrinitySRITrojAI	0.69698	0.0055	0.25192	0.5	1551.49	2023-05-19T05:20:06	2023-05-19T05:16:04	Rev1	None	None
TrinitySRITrojAI	0.69698	0.0055	0.25192	0.5	1527.84	2023-05-19T07:00:06	2023-05-19T06:58:57	Rev1	None	None
TrinitySRITrojAI	0.69698	0.0055	0.25192	0.5	1625.55	2023-05-19T19:40:07	2023-05-19T19:14:56	Rev1	None	None
TrinitySRITrojAI	0.69698	0.0055	0.25192	0.5	1971.26	2023-05-19T21:50:06	2023-05-19T21:43:53	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1041.03	2023-05-20T03:50:06	2023-05-20T03:42:22	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1069.73	2023-05-20T07:10:07	2023-05-20T07:02:55	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1053.52	2023-05-22T20:10:06	2023-05-22T20:06:13	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1044.75	2023-05-22T23:40:07	2023-05-22T23:33:54	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.695	0.00292	0.25092	0.57094	1595.61	2023-05-23T04:30:06	2023-05-23T04:23:58	Rev1	None	None
TrinitySRITrojAI	1.05912	0.15561	0.34585	0.54741	49025.67	2023-05-23T06:40:06	2023-05-23T06:35:34	Rev1	None	None
TrinitySRITrojAI	1.04264	0.15464	0.33941	0.55582	50016.76	2023-05-23T22:20:06	2023-05-23T22:17:47	Rev1	None	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	1184.09	2023-05-24T18:20:06	2023-05-24T18:19:26	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	258.59	2023-06-01T17:30:06	2023-06-01T17:28:50	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	197.61	2023-06-01T17:50:06	2023-06-01T17:49:31	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	184.49	2023-06-01T19:00:06	2023-06-01T18:57:02	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.69315	0.0	0.25	0.5	179.17	2023-06-01T19:40:07	2023-06-01T19:32:45	Rev1	:No Results::Missing Results:	None
TrinitySRITrojAI	0.82297	0.09679	0.29359	0.56835	58509.37	2023-06-01T20:21:39	2023-06-01T20:18:48	Rev1	None	None
TrinitySRITrojAI	0.65689	0.04443	0.23594	0.60976	168541.96	2023-06-05T06:30:06	2023-06-05T06:25:25	Rev1	None	None
PL-GIFT	0.78213	0.08581	0.27569	0.57635	793.7	2023-03-20T22:10:09	2023-03-20T22:00:44	Rev1	None	None
PL-GIFT	0.7185	0.04267	0.26037	0.54929	869.19	2023-03-22T22:00:09	2023-03-22T21:26:43	Rev1	None	None
PL-GIFT	0.75596	0.07638	0.26741	0.54953	861.91	2023-03-23T21:30:08	2023-03-23T21:29:39	Rev1	None	None
PL-GIFT	0.6892	0.02465	0.24825	0.53494	1524.88	2023-04-27T16:30:07	2023-04-27T16:25:12	Rev1	None	None
PL-GIFT	0.70689	0.06132	0.25544	0.60276	1464.72	2023-04-27T21:41:58	2023-04-27T21:32:48	Rev1	None	None
PL-GIFT	0.69315	0.0	0.25	0.5		2023-06-27T17:40:08	2023-06-27T17:35:04	Rev1	:No Results::Missing Results:	:Schema Header:
PL-GIFT	0.97445	0.40475	0.25058	0.57412	1608.18	2023-07-08T17:30:09	2023-07-08T17:21:21	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2023-03-13T21:00:09	2023-03-13T20:52:31	Rev1	None	:Container Parameters (jsonschema checker):
Perspecta-PurdueRutgers	0.76273	0.09013	0.2766	0.60071	2258.87	2023-03-13T21:40:09	2023-03-13T21:31:36	Rev1	None	None
Perspecta-PurdueRutgers	0.76186	0.07406	0.27566	0.53271	2030.89	2023-03-14T00:40:09	2023-03-14T00:39:49	Rev1	None	None
Perspecta-PurdueRutgers	0.71262	0.1214	0.23405	0.70424	64653.47	2023-03-21T23:20:10	2023-03-21T23:15:40	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5		2023-03-24T04:00:10	2023-03-24T03:51:10	Rev1	:Info File Missing:	None
Perspecta-PurdueRutgers	0.36033	0.03079	0.1013	0.95718	214.45	2023-03-24T05:10:09	2023-03-24T05:00:39	Rev1	None	None
Perspecta-PurdueRutgers	1.07704	0.13848	0.37476	0.51647	212.4	2023-03-24T20:50:08	2023-03-24T20:42:02	Rev1	None	None
Perspecta-PurdueRutgers	1.02737	0.14175	0.35288	0.48353	212.03	2023-03-24T21:50:08	2023-03-24T21:43:49	Rev1	None	None
Perspecta-PurdueRutgers	0.62779	0.09184	0.20966	0.73647	79068.7	2023-03-30T00:10:10	2023-03-30T00:05:47	Rev1	None	None
Perspecta-PurdueRutgers	10.46103	1.90913	0.42925	0.49571	861.7	2023-03-31T02:40:09	2023-03-31T02:34:12	Rev1	None	None
Perspecta-PurdueRutgers	0.61634	0.09532	0.20267	0.74947	92425.34	2023-04-04T08:00:09	2023-04-04T07:58:33	Rev1	None	None
Perspecta-PurdueRutgers	0.71426	0.03652	0.2592	0.49176	8401.41	2023-04-05T19:50:09	2023-04-05T19:42:39	Rev1	None	None
Perspecta-PurdueRutgers	0.71426	0.03652	0.2592	0.49176	8268.32	2023-04-05T23:50:09	2023-04-05T23:43:53	Rev1	None	None
Perspecta-PurdueRutgers	0.71426	0.03652	0.2592	0.49176	8188.28	2023-04-06T02:50:10	2023-04-06T02:46:51	Rev1	None	None
Perspecta-PurdueRutgers	0.88735	0.11393	0.3032	0.49035	9296.45	2023-04-06T05:20:10	2023-04-06T05:18:58	Rev1	None	None
Perspecta-PurdueRutgers	0.70969	0.03743	0.25698	0.50565	8035.62	2023-04-06T16:20:09	2023-04-06T16:16:31	Rev1	None	None
Perspecta-PurdueRutgers	0.71426	0.03652	0.2592	0.49176	8290.77	2023-04-06T19:20:09	2023-04-06T19:16:45	Rev1	None	None
Perspecta-PurdueRutgers	0.71426	0.03652	0.2592	0.49176	9380.46	2023-04-06T22:20:09	2023-04-06T22:18:04	Rev1	None	None
Perspecta-PurdueRutgers	0.7291	0.06203	0.26179	0.55094	4191.93	2023-04-07T03:20:10	2023-04-07T03:14:11	Rev1	None	None
Perspecta-PurdueRutgers	0.71426	0.03652	0.2592	0.49176	9541.76	2023-04-07T05:20:09	2023-04-07T05:10:10	Rev1	None	None
Perspecta-PurdueRutgers	0.72141	0.03744	0.26233	0.48282	11260.97	2023-04-07T18:40:09	2023-04-07T18:37:38	Rev1	None	None
Perspecta-PurdueRutgers	0.75256	0.04229	0.2757	0.452	9971.55	2023-04-08T05:40:09	2023-04-08T05:37:46	Rev1	None	None
Perspecta-PurdueRutgers	0.73027	0.03948	0.26604	0.47718	8938.11	2023-04-08T21:20:10	2023-04-08T21:18:01	Rev1	None	None
Perspecta-PurdueRutgers	0.74284	0.03993	0.27169	0.456	8119.29	2023-04-09T00:50:10	2023-04-09T00:44:47	Rev1	None	None
Perspecta-PurdueRutgers	0.71426	0.03652	0.2592	0.49176	9189.56	2023-04-10T03:10:10	2023-04-10T03:05:27	Rev1	None	None
Perspecta-PurdueRutgers	0.71426	0.03652	0.2592	0.49176	9202.37	2023-04-10T07:20:10	2023-04-10T07:15:33	Rev1	None	None
Perspecta-PurdueRutgers	0.70319	0.05827	0.25071	0.56765	4581.52	2023-04-10T18:40:10	2023-04-10T18:35:21	Rev1	None	None
Perspecta-PurdueRutgers	0.6842	0.01551	0.24709	0.514	2812.51	2023-04-10T21:50:09	2023-04-10T21:44:52	Rev1	None	None
Perspecta-PurdueRutgers	0.69549	0.0221	0.2511	0.50988	3063.68	2023-04-11T00:30:09	2023-04-11T00:27:23	Rev1	None	None
Perspecta-PurdueRutgers	0.81702	0.09865	0.27939	0.51118	47538.9	2023-04-11T03:10:10	2023-04-11T03:05:31	Rev1	None	None
Perspecta-PurdueRutgers	0.91641	0.13687	0.30482	0.54482	7324.16	2023-04-11T17:40:09	2023-04-11T17:37:13	Rev1	None	None
Perspecta-PurdueRutgers	0.84491	0.13092	0.28158	0.58976	5975.92	2023-04-11T22:10:09	2023-04-11T22:05:41	Rev1	None	None
Perspecta-PurdueRutgers	0.78347	0.09661	0.26687	0.53765	21576.28	2023-04-12T02:40:09	2023-04-12T02:33:09	Rev1	None	None
Perspecta-PurdueRutgers	0.80704	0.11543	0.27351	0.58235	44536.74	2023-04-12T21:00:10	2023-04-12T20:52:33	Rev1	None	None
Perspecta-PurdueRutgers	10.46894	1.90839	0.43265	0.49412	213.04	2023-04-13T15:50:13	2023-04-13T15:48:03	Rev1	None	None
Perspecta-PurdueRutgers	0.56556	0.0899	0.18167	0.803	78173.69	2023-04-13T18:00:10	2023-04-13T17:52:16	Rev1	None	None
Perspecta-PurdueRutgers	0.69852	0.02939	0.25169	0.49412	1460.15	2023-04-17T20:50:09	2023-04-17T20:46:14	Rev1	None	None
Perspecta-PurdueRutgers	0.69335	0.0171	0.24977	0.49341	1405.05	2023-04-17T21:40:09	2023-04-17T21:34:54	Rev1	None	None
Perspecta-PurdueRutgers	0.65101	0.02957	0.23227	0.57588	1353.2	2023-04-17T23:30:11	2023-04-17T23:22:30	Rev1	None	None
Perspecta-PurdueRutgers	0.7099	0.03031	0.25833	0.49929	1400.3	2023-04-18T00:40:12	2023-04-18T00:34:31	Rev1	None	None
Perspecta-PurdueRutgers	0.65971	0.03433	0.2353	0.57165	1392.9	2023-04-18T02:00:10	2023-04-18T01:52:26	Rev1	None	None
Perspecta-PurdueRutgers	0.75093	0.07333	0.26338	0.52112	1813.96	2023-04-24T15:10:09	2023-04-24T15:07:14	Rev1	None	None
Perspecta-PurdueRutgers	0.74519	0.06049	0.26676	0.50588	1037.8	2023-04-24T16:20:09	2023-04-24T16:15:36	Rev1	None	None
Perspecta-PurdueRutgers	1.03925	0.14379	0.35508	0.49412	1034.73	2023-04-24T19:50:08	2023-04-24T19:40:38	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5	1099.94	2023-04-25T18:00:10	2023-04-25T17:54:51	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5	1040.48	2023-04-25T19:20:09	2023-04-25T19:11:36	Rev1	None	None
Perspecta-PurdueRutgers	0.92396	0.09213	0.34502	0.50212	1117.77	2023-04-25T21:00:09	2023-04-25T20:59:42	Rev1	None	None
Perspecta-PurdueRutgers	0.70628	0.02787	0.25508	0.50212	1113.84	2023-04-25T23:50:08	2023-04-25T23:48:13	Rev1	None	None
Perspecta-PurdueRutgers	1.17342	0.14608	0.40435	0.50212	1039.76	2023-04-26T01:00:08	2023-04-26T00:57:47	Rev1	None	None
Perspecta-PurdueRutgers	1.1764	0.14692	0.40558	0.50271	1028.49	2023-04-26T02:40:08	2023-04-26T02:34:47	Rev1	None	None
Perspecta-PurdueRutgers	1.17586	0.14676	0.40535	0.50165	1029.2	2023-04-26T03:40:08	2023-04-26T03:36:03	Rev1	None	None
Perspecta-PurdueRutgers	1.17468	0.1467	0.40484	0.50271	1030.07	2023-04-26T04:20:08	2023-04-26T04:16:19	Rev1	None	None
Perspecta-PurdueRutgers	1.27576	0.16731	0.42717	0.50859	1035.7	2023-04-26T14:30:08	2023-04-26T14:21:43	Rev1	None	None
Perspecta-PurdueRutgers	0.61757	0.04466	0.21757	0.64029	1673.54	2023-04-26T16:20:08	2023-04-26T16:11:06	Rev1	None	None
Perspecta-PurdueRutgers	0.47289	0.09267	0.1446	0.86094	79621.25	2023-04-26T19:10:09	2023-04-26T19:08:42	Rev1	None	None
Perspecta-PurdueRutgers	0.7484	0.06911	0.26311	0.49424	1333.32	2023-04-27T20:00:10	2023-04-27T19:50:42	Rev1	None	None
Perspecta-PurdueRutgers	0.59382	0.03748	0.20892	0.66	1677.07	2023-04-27T21:20:07	2023-04-27T21:10:12	Rev1	None	None
Perspecta-PurdueRutgers	0.81183	0.12596	0.27491	0.59741	13936.57	2023-04-28T00:20:10	2023-04-28T00:17:20	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5	1048.41	2023-05-24T05:20:10	2023-05-24T05:16:45	Rev1	:No Results::Missing Results:	None
Perspecta-PurdueRutgers	0.68951	0.00711	0.24865	0.50588	2141.16	2023-05-28T06:10:09	2023-05-28T06:03:50	Rev1	:Missing Results:	None
Perspecta-PurdueRutgers	0.94161	0.12105	0.31185	0.45	7783.67	2023-05-29T05:30:09	2023-05-29T05:29:32	Rev1	:Missing Results:	None
Perspecta-PurdueRutgers	0.93284	0.29369	0.28217	0.49129	9647.44	2023-05-31T04:30:09	2023-05-31T04:23:17	Rev1	None	None
Perspecta-PurdueRutgers	0.69315	0.0	0.25	0.5	242.2	2023-06-01T05:30:09	2023-06-01T05:23:30	Rev1	:No Results::Missing Results:	None
Perspecta-PurdueRutgers	0.76419	0.08434	0.26709	0.52847	8793.88	2023-06-01T07:20:10	2023-06-01T07:14:08	Rev1	None	None
Perspecta-PurdueRutgers	0.8622	0.1176	0.28621	0.51494	9632.11	2023-06-02T05:50:09	2023-06-02T05:48:16	Rev1	None	None
Perspecta-PurdueRutgers	0.73497	0.04102	0.26792	0.47553	5640.25	2023-06-02T19:00:10	2023-06-02T18:58:57	Rev1	None	None
Perspecta-PurdueRutgers	0.7363	0.08112	0.25501	0.54012	5892.15	2023-06-03T03:00:10	2023-06-03T02:58:40	Rev1	None	None
Perspecta-PurdueRutgers	0.7526	0.07728	0.26109	0.51447	5366.44	2023-06-03T06:10:09	2023-06-03T06:01:31	Rev1	None	None
Perspecta-PurdueRutgers	0.73086	0.03739	0.26512	0.47941	5372.56	2023-06-03T08:20:10	2023-06-03T08:11:58	Rev1	None	None
Perspecta-PurdueRutgers	0.70872	0.03249	0.25496	0.50265	4141.48	2023-06-03T22:10:10	2023-06-03T22:05:18	Rev1	None	None
Perspecta-PurdueRutgers	0.93395	0.29396	0.27999	0.49118	9355.21	2023-06-04T00:00:10	2023-06-03T23:59:13	Rev1	None	None
Perspecta-PurdueRutgers	0.7273	0.0878	0.24872	0.58118	9380.49	2023-06-04T04:20:10	2023-06-04T04:19:45	Rev1	None	None
Perspecta-PurdueRutgers	0.87529	0.28675	0.26885	0.47129	5072.88	2023-06-04T07:40:10	2023-06-04T07:38:36	Rev1	None	None
Perspecta-PurdueRutgers	1.16989	0.14566	0.40265	0.50588	699.47	2023-06-04T20:40:10	2023-06-04T20:31:25	Rev1	:Missing Results:	None
Perspecta-PurdueRutgers	0.70746	0.08656	0.24094	0.60118	9370.91	2023-06-04T23:20:10	2023-06-04T23:14:39	Rev1	None	None
Perspecta-PurdueRutgers	1.18552	0.15042	0.40804	0.51041	2227.43	2023-06-05T03:50:10	2023-06-05T03:42:35	Rev1	:Missing Results:	None
Perspecta-PurdueRutgers	1.85338	0.26478	0.47128	0.50694	778.52	2023-06-05T07:00:09	2023-06-05T06:54:38	Rev1	None	None
Perspecta-PurdueRutgers	1.83702	0.26363	0.4655	0.50465	723.19	2023-06-05T19:20:09	2023-06-05T19:19:01	Rev1	None	None
Perspecta-PurdueRutgers	1.52936	0.22958	0.45331	0.51494	2487.53	2023-06-05T20:20:12	2023-06-05T20:10:46	Rev1	None	None
Perspecta-PurdueRutgers	1.06796	0.15288	0.36276	0.49824	955.3	2023-06-05T21:30:11	2023-06-05T21:26:54	Rev1	None	None
Perspecta-PurdueRutgers	1.06603	0.15311	0.36227	0.50765	1014.6	2023-06-05T23:40:10	2023-06-05T23:34:32	Rev1	None	None
Perspecta-PurdueRutgers	1.28148	0.17142	0.42568	0.50988	2513.58	2023-06-06T00:20:09	2023-06-06T00:16:52	Rev1	None	None
Perspecta-PurdueRutgers	0.72129	0.06636	0.25519	0.54824	1184.72	2023-06-06T01:20:10	2023-06-06T01:15:54	Rev1	None	None
Perspecta-PurdueRutgers	1.37377	0.20019	0.43067	0.50753	2299.67	2023-06-06T02:20:09	2023-06-06T02:10:54	Rev1	None	None
Perspecta-PurdueRutgers	0.72129	0.06636	0.25519	0.54824	2280.35	2023-06-06T03:50:09	2023-06-06T03:40:49	Rev1	None	None
Perspecta-PurdueRutgers	0.74218	0.07953	0.25868	0.53988	9700.94	2023-06-06T05:00:10	2023-06-06T04:50:25	Rev1	None	None
Perspecta-PurdueRutgers	0.7374	0.0759	0.25838	0.53824	9670.71	2023-06-06T15:40:10	2023-06-06T15:36:43	Rev1	None	None
Perspecta-PurdueRutgers	1.88515	0.26454	0.47965	0.49765	2580.95	2023-06-06T19:50:09	2023-06-06T19:47:54	Rev1	None	None
Perspecta-PurdueRutgers	0.75025	0.04319	0.27267	0.48541	1365.68	2023-06-06T20:50:09	2023-06-06T20:46:42	Rev1	None	None
Perspecta-PurdueRutgers	0.70941	0.06452	0.25086	0.55882	2570.64	2023-06-06T21:30:09	2023-06-06T21:29:44	Rev1	None	None
Perspecta-PurdueRutgers	0.73317	0.06811	0.25951	0.53765	1352.75	2023-06-06T22:50:10	2023-06-06T22:48:00	Rev1	None	None
Perspecta-PurdueRutgers	0.73317	0.06811	0.25951	0.53918	1352.99	2023-06-07T00:10:09	2023-06-07T00:01:36	Rev1	None	None
Perspecta-PurdueRutgers	1.8773	0.26394	0.47807	0.49741	2555.31	2023-06-07T00:50:10	2023-06-07T00:45:08	Rev1	None	None
Perspecta-PurdueRutgers	0.78067	0.0743	0.27681	0.50294	2574.62	2023-06-07T02:10:09	2023-06-07T02:02:58	Rev1	None	None
Perspecta-PurdueRutgers	1.8768	0.26409	0.47767	0.49824	2558.21	2023-06-07T04:10:09	2023-06-07T04:08:17	Rev1	None	None
Perspecta-PurdueRutgers	0.79133	0.08955	0.27363	0.51294	9484.59	2023-06-07T05:31:36	2023-06-07T05:21:35	Rev1	None	None
Perspecta-PurdueRutgers	0.74181	0.07815	0.25914	0.53965	9761.62	2023-06-07T18:00:10	2023-06-07T17:05:21	Rev1	None	None
Perspecta-PurdueRutgers	1.88261	0.26641	0.47659	0.50271	2561.39	2023-06-07T21:10:10	2023-06-07T21:09:30	Rev1	None	None
Perspecta-PurdueRutgers	1.90746	0.26906	0.48181	0.50388	1371.21	2023-06-07T22:20:10	2023-06-07T22:19:23	Rev1	None	None
Perspecta-PurdueRutgers	0.60252	0.04159	0.21195	0.65565	4159.91	2023-06-08T00:00:10	2023-06-07T23:51:10	Rev1	None	None
Perspecta-PurdueRutgers	0.62671	0.03138	0.22	0.64029	1367.75	2023-06-09T18:50:11	2023-06-09T18:47:43	Rev1	None	None
Perspecta-PurdueRutgers	0.76048	0.04694	0.27568	0.43212	1424.34	2023-07-07T19:01:34	2023-07-07T18:51:18	Rev1	:Result Parse::Missing Results:	None
Perspecta-PurdueRutgers	0.69785	0.0259	0.25294	0.51594	1967.79	2023-07-07T20:00:10	2023-07-07T19:56:00	Rev1	None	None
Perspecta-PurdueRutgers	0.83706	0.29111	0.25257	0.56171	3433.84	2023-07-07T21:30:11	2023-07-07T21:22:57	Rev1	None	None
Perspecta-PurdueRutgers	0.81294	0.10418	0.27354	0.51424	3837.95	2023-07-07T23:00:11	2023-07-07T22:54:50	Rev1	None	None
Perspecta-PurdueRutgers	0.64133	0.05061	0.22622	0.62059	6325.77	2023-07-08T01:20:11	2023-07-08T01:16:22	Rev1	None	None
Perspecta-PurdueRutgers	0.77317	0.04764	0.28138	0.42659	1251.87	2023-07-08T03:30:11	2023-07-08T03:23:07	Rev1	None	None
Perspecta-PurdueRutgers	0.78167	0.05022	0.28435	0.41771	1249.76	2023-07-08T04:50:10	2023-07-08T04:42:51	Rev1	None	None
Perspecta-PurdueRutgers	0.63847	0.04705	0.22555	0.62106	6861.24	2023-07-08T14:10:10	2023-07-08T14:03:21	Rev1	None	None
Perspecta-PurdueRutgers	0.8721	0.12611	0.29055	0.52329	29452.12	2023-07-09T05:40:09	2023-07-09T05:39:32	Rev1	None	None
Perspecta-PurdueRutgers	0.72925	0.03767	0.26479	0.46953	3156.61	2023-07-09T14:50:09	2023-07-09T14:47:27	Rev1	:Result Parse::Missing Results:	None
Perspecta-PurdueRutgers	0.76797	0.07562	0.27162	0.51412	3127.18	2023-07-09T16:40:09	2023-07-09T16:38:59	Rev1	None	None
Perspecta-PurdueRutgers	0.6057	0.04126	0.21324	0.65235	4142.18	2023-07-09T18:11:18	2023-07-09T18:04:06	Rev1	None	None
Perspecta-PurdueRutgers	0.60175	0.03723	0.21211	0.65306	4078.9	2023-07-09T20:30:08	2023-07-09T20:25:00	Rev1	None	None
Perspecta-IUB	0.69315	0.0	0.25	0.5		2023-03-25T17:50:11	2023-03-25T17:41:42	Rev1	None	:Schema Header:
Perspecta-IUB	1.68364	0.42673	0.31509	0.64059	3437.12	2023-03-25T20:00:10	2023-03-25T19:53:28	Rev1	None	None
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-05-16T02:30:26	2023-05-15T20:25:36	Rev1	:No Results::Missing Results:	:Container Parameters (metaparameters schema)::Container Parameters (learned parameters)::Container Parameters (jsonschema checker)::Schema Header:
ARM-UCSD	0.69315	0.0	0.25	0.5		2023-05-16T20:31:03	2023-05-16T20:30:55	Rev1	:No Results::Missing Results:	:Schema Header:
ARM-UCSD	0.69315	0.0	0.25	0.5	674.76	2023-05-17T20:10:17	2023-05-17T20:09:05	Rev1	:Missing Results:	None
ARM-UCSD	0.69315	0.0	0.25	0.5	709.14	2023-05-30T18:50:18	2023-05-30T18:43:00	Rev1	:Missing Results:	None
ARM-UCSD	0.85038	0.13357	0.27261	0.55418	677.76	2023-06-05T19:41:29	2023-06-05T19:35:08	Rev1	None	None
ICSI-2	0.79614	0.09319	0.28521	0.57041	1385.2	2023-03-29T09:50:21	2023-03-29T09:44:57	Rev1	None	None
ICSI-2	0.77977	0.07985	0.28031	0.55576	1297.02	2023-03-30T00:50:21	2023-03-30T00:47:40	Rev1	None	None
ICSI-2	1.08003	0.17012	0.34107	0.53788	1238.59	2023-03-31T09:20:23	2023-03-31T09:16:52	Rev1	None	None
ICSI-2	0.84919	0.10497	0.30205	0.55276	1235.14	2023-03-31T11:40:22	2023-03-31T11:37:45	Rev1	None	None
ICSI-2	1.07166	0.16199	0.34875	0.51329	1219.04	2023-04-03T07:40:22	2023-04-03T07:36:45	Rev1	None	None
ICSI-2	1.10249	0.16228	0.36162	0.53112	1210.23	2023-04-06T03:20:22	2023-04-06T03:16:04	Rev1	None	None
ICSI-2	1.12122	0.16934	0.36192	0.51976	1166.33	2023-04-06T11:20:24	2023-04-06T11:13:31	Rev1	None	None
ICSI-2	0.82636	0.08503	0.30107	0.53594	1120.23	2023-04-08T03:40:24	2023-04-08T03:39:54	Rev1	None	None
ICSI-2	1.70792	0.41999	0.36528	0.51259	1202.51	2023-04-11T09:50:22	2023-04-11T09:41:18	Rev1	None	None
ICSI-2	0.80876	0.09847	0.28436	0.55788	1159.54	2023-04-12T02:30:22	2023-04-12T02:24:58	Rev1	None	None
ICSI-2	0.79693	0.09664	0.28477	0.59071	1513.21	2023-04-14T10:10:23	2023-04-14T10:00:26	Rev1	None	None
ICSI-2	0.7437	0.06344	0.26687	0.54647	1511.85	2023-04-17T10:40:29	2023-04-17T10:39:32	Rev1	None	None
ICSI-2	0.8882	0.13356	0.29149	0.56094	1449.16	2023-04-19T00:41:32	2023-04-19T00:36:25	Rev1	None	None
ICSI-2	0.82762	0.08392	0.30251	0.52047	935.48	2023-04-25T07:20:23	2023-04-25T07:11:41	Rev1	None	None
ICSI-2	0.79094	0.08622	0.28643	0.56565	1105.16	2023-04-27T07:10:22	2023-04-27T07:10:13	Rev1	None	None
ICSI-2	0.81796	0.0845	0.29715	0.52082	1418.67	2023-04-27T08:50:22	2023-04-27T08:43:11	Rev1	None	None
ICSI-2	0.86474	0.0922	0.31491	0.50647	973.24	2023-04-27T11:02:34	2023-04-27T11:01:24	Rev1	None	None
ICSI-2	0.80211	0.08793	0.28943	0.55141	1461.85	2023-04-28T19:30:24	2023-04-28T19:26:40	Rev1	None	None
ICSI-2	0.84584	0.0945	0.30678	0.51871	959.44	2023-04-28T20:10:24	2023-04-28T20:08:10	Rev1	None	None
ICSI-2	0.81249	0.08639	0.2949	0.53659	1226.31	2023-04-30T10:50:23	2023-04-30T10:40:47	Rev1	None	None
ICSI-2	0.82219	0.09056	0.29719	0.53776	974.4	2023-05-02T02:50:24	2023-05-02T02:47:23	Rev1	None	None
ICSI-2	0.80942	0.08628	0.29387	0.53976	1135.95	2023-05-02T04:50:24	2023-05-02T04:40:42	Rev1	None	None
ICSI-2	0.793	0.08483	0.28705	0.55165	1051.61	2023-05-02T07:00:24	2023-05-02T06:58:33	Rev1	None	None
ICSI-2	1.14392	0.22595	0.33482	0.53624	1019.33	2023-05-02T09:00:24	2023-05-02T08:54:20	Rev1	None	None
ICSI-2	1.05672	0.2193	0.30698	0.55176	988.53	2023-05-02T11:50:24	2023-05-02T11:47:41	Rev1	None	None
ICSI-2	0.77563	0.05931	0.28627	0.47894	28104.16	2023-05-04T13:30:24	2023-05-04T13:27:27	Rev1	None	None
ICSI-2	0.92876	0.13012	0.32085	0.55947	26770.4	2023-05-05T03:10:24	2023-05-05T03:06:29	Rev1	None	None
ICSI-2	0.82082	0.10694	0.28741	0.57059	41654.06	2023-05-07T08:40:24	2023-05-07T08:38:10	Rev1	None	None
ICSI-2	0.92219	0.12609	0.32227	0.55676	35835.26	2023-05-09T00:50:23	2023-05-09T00:49:08	Rev1	None	None
ICSI-2	0.87267	0.12024	0.30298	0.56488	11104.45	2023-05-10T12:00:24	2023-05-10T11:57:24	Rev1	None	None
ICSI-2	0.72548	0.11367	0.246	0.69071	5750.91	2023-05-11T09:10:23	2023-05-11T09:08:35	Rev1	None	None
ICSI-2	0.71609	0.10734	0.24525	0.68771	5467.14	2023-05-12T03:50:23	2023-05-12T03:41:42	Rev1	None	None
ICSI-2	0.91402	0.13132	0.31552	0.62471	71508.08	2023-05-28T18:20:28	2023-05-28T18:11:34	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70682	0.01437	0.25681	0.49412	4747.73	2023-06-20T16:10:35	2023-06-15T05:42:36	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70682	0.01437	0.25681	0.49412	2979.85	2023-06-21T00:50:30	2023-06-21T00:46:16	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70682	0.01437	0.25681	0.49412	2976.02	2023-06-21T15:40:30	2023-06-21T15:33:06	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70682	0.01437	0.25681	0.49412	2975.8	2023-06-21T18:50:29	2023-06-21T18:47:27	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70682	0.01437	0.25681	0.49412	2975.72	2023-06-21T22:10:30	2023-06-21T22:05:00	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	1040.08	2023-06-22T03:40:30	2023-06-22T03:32:03	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	1044.86	2023-06-22T17:50:30	2023-06-22T17:46:31	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	1038.59	2023-06-22T20:40:30	2023-06-22T20:32:07	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	1038.43	2023-06-22T23:00:30	2023-06-22T22:52:12	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	1136.02	2023-06-23T01:20:30	2023-06-23T01:10:50	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70682	0.01437	0.25681	0.49412	3077.54	2023-06-23T09:20:30	2023-06-23T09:10:42	Rev1	:Missing Results:	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	3136.97	2023-06-24T00:20:32	2023-06-24T00:16:53	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	3092.71	2023-06-25T09:00:30	2023-06-25T08:53:12	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	4249.8	2023-06-26T00:00:30	2023-06-25T23:55:09	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	4272.44	2023-06-26T04:00:30	2023-06-26T03:54:54	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	5900.84	2023-06-26T08:50:28	2023-06-26T08:49:53	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	5850.48	2023-06-26T14:00:28	2023-06-26T13:54:04	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70631	0.01441	0.25655	0.5	6437.51	2023-06-26T22:50:28	2023-06-26T22:47:09	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69028	0.00755	0.24857	0.48506	6501.26	2023-06-27T07:20:27	2023-06-27T07:17:15	Rev1	None	None
trojai-example	0.86477	0.11619	0.29668	0.56224	57033.52	2023-06-01T20:22:06	2023-06-01T20:18:52	Rev1	None	None
trojai-example	0.85976	0.1096	0.30076	0.55671	53065.8	2023-06-02T13:33:39	2023-06-02T13:30:39	Rev1	None	None

Round 14 leaderboard for MiniGrid Reinforcement Learning Lavaworld Agents July 2023.

Each AI is trained to get to the green square. For those AIs that have been attacked, the presence of the trigger will cause the Agent to head into the lava.

Example behavior of clean and poisoned RL agents.

train: The train dataset that is distributed with each round.
test: The test dataset that is sequestered/hidden, used for evaluation. Submissions here should be fully realized with complete schema and parameters.
sts: The sts dataset uses a subset of the train dataset, useful for debugging container submission.
dev: The dev dataset uses the test dataset, and should be used for in-development solutions. Schemas must be valid, but do not need to be complete. Results do not count towards the program.

train test sts dev

Required filename format: "rl-lavaworld-jul2023_train_<Submission Name>.simg"
Accepting submissions: True
Number of models in rl-lavaworld-jul2023, train: 238
Execution timeout (hh:mm:ss): 1 day, 15:40:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2023-08-22T18:50:06	performer	None	None	Ok	2023-08-22T18:44:19	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-09-27T17:10:09	performer	None	None	Ok	2023-09-27T17:08:17	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-10T18:22:42	performer	None	None	Ok	2023-10-10T18:21:57	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-07-21T14:50:16	performer	None	None	Ok	2023-07-20T20:50:25	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2023-08-08T05:00:13	performer	None	None	Ok	2023-08-08T04:58:40	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2023-08-23T04:30:21	performer	None	None	Ok	2023-08-23T04:22:10	0 d, 0 h, 0 m, 0 s
ARM	2023-08-22T01:50:27	performer	None	None	Ok	2023-08-22T01:43:38	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	2023-10-31T18:40:29	performer	None	None	Ok	2023-10-31T18:35:10	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2023-08-22T05:30:32	performer	None	None	Ok	2023-08-22T05:30:00	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-09-05T20:30:33	performer	None	None	Ok	2023-09-05T20:26:42	0 d, 0 h, 0 m, 0 s
trojai-example		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IceTorch		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
trojaicy		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Hector		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Cassandra-XF		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
gooddefense		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
cyberinfrastructure		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
glaros		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Ultraman		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
BackSec		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Palladium		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
IIECAS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
NSEC		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
UMBCb	2023-08-22T04:30:44	performer	None	None	Ok	2023-08-22T04:23:04	0 d, 0 h, 0 m, 0 s
PASS		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
DS3TwoSixZero		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
dongdong4fei		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
Mindrake		public	None	None	Ok	None	0 d, 0 h, 0 m, 0 s

Best Results based on ROC-AUC

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.05592	0.00541	0.00434	1.0	641.4	2023-07-20T05:20:06	2023-07-20T05:14:53	Rev1	None	None
TrinitySRITrojAI	0.0003	0.00014	0.0	1.0	561.27	2023-07-15T18:30:06	2023-07-15T18:22:43	Rev1	None	None
PL-GIFT	0.01237	0.0009	0.0002	1.0	686.39	2023-07-14T22:20:08	2023-07-14T22:14:26	Rev1	None	None
Perspecta-PurdueRutgers	0.0491	0.00529	0.00362	1.0	712.09	2023-07-21T14:50:16	2023-07-20T20:50:25	Rev1	None	None
Perspecta-IUB	0.01005	0.0	0.0001	1.0	711.1	2023-07-25T03:50:15	2023-07-25T03:45:04	Rev1	None	None
ARM-UCSD	0.30076	0.01965	0.07571	1.0	1169.46	2023-08-23T04:30:21	2023-08-23T04:22:10	Rev1	None	None
ARM	0.00354	0.00302	0.00047	1.0	526.61	2023-08-21T21:20:28	2023-08-21T21:15:14	Rev1	None	None
TrinitySRITrojAI-SBU	0.0931	0.02046	0.01528	0.99929	3252.21	2023-10-31T18:40:29	2023-10-31T18:35:10	Rev1	None	None
ICSI-2	0.05867	0.00372	0.00385	1.0	615.31	2023-07-19T21:20:31	2023-07-19T21:17:34	Rev1	None	None
TrinitySRITrojAI-BostonU	0.58048	0.50344	0.02101	0.97899	522.94	2023-07-26T23:00:34	2023-07-26T22:54:28	Rev1	None	None
UMBCb	0.49969	0.0681	0.16834	0.83391	622.25	2023-08-22T04:30:44	2023-08-22T04:23:04	Rev1	None	None

All Results

Team	Cross Entropy	CE 95% CI	Brier Score	ROC-AUC	Runtime (s)	Submission Timestamp	File Timestamp	Leaderboard Revision	Parsing Errors	Launch Errors
Perspecta	0.93502	0.09464	0.3445	0.54106	634.25	2023-07-17T21:30:06	2023-07-17T21:25:10	Rev1	None	None
Perspecta	0.05592	0.00541	0.00434	1.0	641.4	2023-07-20T05:20:06	2023-07-20T05:14:53	Rev1	None	None
Perspecta	0.00624	0.0007	7e-05	1.0	616.65	2023-07-24T14:00:06	2023-07-24T13:59:51	Rev1	None	None
Perspecta	0.02996	0.00796	0.00324	1.0	529.83	2023-07-25T14:20:07	2023-07-25T14:17:47	Rev1	None	None
Perspecta	0.01362	0.00218	0.00044	1.0	530.65	2023-07-28T22:40:06	2023-07-28T22:38:31	Rev1	None	None
Perspecta	0.01827	0.00234	0.00064	1.0	534.21	2023-07-29T05:40:06	2023-07-29T05:36:45	Rev1	None	None
Perspecta	0.03715	0.00753	0.00362	1.0	532.08	2023-08-02T02:50:07	2023-08-02T02:43:19	Rev1	None	None
Perspecta	0.01005	0.0	0.0001	1.0	534.95	2023-08-02T04:10:06	2023-08-02T04:05:58	Rev1	None	None
Perspecta	0.00487	0.00301	0.00041	1.0	534.26	2023-08-02T15:00:06	2023-08-02T14:59:01	Rev1	None	None
Perspecta	0.00404	0.00604	0.00128	1.0	532.91	2023-08-08T20:50:06	2023-08-08T20:48:13	Rev1	None	None
Perspecta	0.00828	0.00719	0.0021	1.0	524.81	2023-08-15T15:50:07	2023-08-15T15:41:48	Rev1	None	None
Perspecta	0.00824	0.00708	0.00208	1.0	524.62	2023-08-22T18:50:06	2023-08-22T18:44:19	Rev1	None	None
TrinitySRITrojAI	0.0003	0.00014	0.0	1.0	561.27	2023-07-15T18:30:06	2023-07-15T18:22:43	Rev1	None	None
TrinitySRITrojAI	0.07444	0.01412	0.01023	1.0	795.22	2023-09-05T17:20:07	2023-09-05T17:10:39	Rev1	None	None
TrinitySRITrojAI	0.4756	0.07798	0.1536	0.86389	2300.79	2023-09-06T21:00:07	2023-09-06T20:58:23	Rev1	None	None
TrinitySRITrojAI	0.49366	0.14497	0.13946	0.91215	695.67	2023-09-18T20:30:08	2023-09-18T20:23:42	Rev1	None	None
TrinitySRITrojAI	0.18538	0.05206	0.05671	0.99421	686.48	2023-09-27T17:10:09	2023-09-27T17:08:17	Rev1	None	None
PL-GIFT	0.01237	0.0009	0.0002	1.0	686.39	2023-07-14T22:20:08	2023-07-14T22:14:26	Rev1	None	None
PL-GIFT	0.0503	0.02061	0.01071	0.99936	671.82	2023-07-28T14:50:09	2023-07-28T14:48:07	Rev1	None	None
PL-GIFT	0.04339	0.02333	0.00986	0.99936	677.99	2023-07-28T18:20:10	2023-07-28T18:14:37	Rev1	None	None
PL-GIFT	0.01034	0.0003	0.00011	1.0	677.57	2023-07-31T15:01:13	2023-07-31T14:54:48	Rev1	None	None
PL-GIFT	0.01005	0.0	0.0001	1.0	885.72	2023-10-09T23:15:50	2023-10-09T23:01:48	Rev1	None	None
PL-GIFT	0.01005	0.0	0.0001	1.0	884.94	2023-10-10T02:10:14	2023-10-10T02:02:29	Rev1	None	None
PL-GIFT	0.01024	0.00021	0.00011	1.0	906.99	2023-10-10T03:20:14	2023-10-10T03:20:04	Rev1	None	None
PL-GIFT	0.01005	0.0	0.0001	1.0	903.07	2023-10-10T05:54:07	2023-10-10T05:48:05	Rev1	None	None
PL-GIFT	0.01005	0.0	0.0001	1.0	897.41	2023-10-10T14:30:15	2023-10-10T14:26:30	Rev1	None	None
PL-GIFT	0.01131	0.00084	0.00017	1.0	894.14	2023-10-10T15:05:05	2023-10-10T15:03:17	Rev1	None	None
PL-GIFT	0.04738	0.02647	0.0111	0.99915	880.11	2023-10-10T18:22:42	2023-10-10T18:21:57	Rev1	None	None
Perspecta-PurdueRutgers	0.0491	0.00529	0.00362	1.0	712.09	2023-07-21T14:50:16	2023-07-20T20:50:25	Rev1	None	None
Perspecta-IUB	0.01005	0.0	0.0001	1.0	711.1	2023-07-25T03:50:15	2023-07-25T03:45:04	Rev1	None	None
Perspecta-IUB	0.01005	0.0	0.0001	1.0	703.42	2023-07-25T15:00:15	2023-07-25T14:53:05	Rev1	None	None
Perspecta-IUB	0.0	0.0	0.0	1.0	1112.58	2023-07-25T18:30:14	2023-07-25T18:24:48	Rev1	None	None
Perspecta-IUB	0.0	0.0	0.0	1.0	1307.74	2023-08-08T05:00:13	2023-08-08T04:58:40	Rev1	None	None
ARM-UCSD	0.30076	0.01965	0.07571	1.0	1169.46	2023-08-23T04:30:21	2023-08-23T04:22:10	Rev1	None	None
ARM	0.0839	0.02757	0.01819	0.99788	545.2	2023-07-18T04:30:27	2023-07-18T04:25:24	Rev1	None	None
ARM	0.00354	0.00302	0.00047	1.0	526.61	2023-08-21T21:20:28	2023-08-21T21:15:14	Rev1	None	None
ARM	0.00354	0.00302	0.00047	1.0	527.58	2023-08-21T23:20:27	2023-08-21T23:15:34	Rev1	None	None
ARM	0.07047	0.02091	0.01409	0.99993	524.29	2023-08-22T01:50:27	2023-08-22T01:43:38	Rev1	None	None
TrinitySRITrojAI-SBU	0.16352	0.03169	0.03508	0.99463	1441.02	2023-07-25T17:20:30	2023-07-25T17:14:49	Rev1	None	None
TrinitySRITrojAI-SBU	0.14916	0.03632	0.03383	0.99449	1441.03	2023-07-28T23:40:30	2023-07-28T23:38:47	Rev1	None	None
TrinitySRITrojAI-SBU	0.15749	0.03819	0.03591	0.9935	1437.51	2023-08-23T19:20:32	2023-08-23T19:11:58	Rev1	None	None
TrinitySRITrojAI-SBU	0.14916	0.03632	0.03383	0.99449	1440.56	2023-08-23T21:10:32	2023-08-23T21:06:11	Rev1	None	None
TrinitySRITrojAI-SBU	0.14869	0.03583	0.03358	0.99463	1439.0	2023-08-23T21:50:32	2023-08-23T21:48:17	Rev1	None	None
TrinitySRITrojAI-SBU	0.14858	0.03579	0.03352	0.99463	1440.78	2023-08-23T22:30:32	2023-08-23T22:27:47	Rev1	None	None
TrinitySRITrojAI-SBU	0.14817	0.03573	0.03333	0.99463	1437.19	2023-08-23T23:10:32	2023-08-23T23:08:09	Rev1	None	None
TrinitySRITrojAI-SBU	0.14959	0.03588	0.03374	0.99463	1440.86	2023-08-24T00:12:26	2023-08-24T00:03:59	Rev1	None	None
TrinitySRITrojAI-SBU	0.14959	0.03588	0.03374	0.99463	1438.02	2023-08-24T00:50:32	2023-08-24T00:45:52	Rev1	None	None
TrinitySRITrojAI-SBU	0.0931	0.02046	0.01528	0.99929	3252.21	2023-10-31T18:40:29	2023-10-31T18:35:10	Rev1	None	None
ICSI-2	0.05867	0.00372	0.00385	1.0	615.31	2023-07-19T21:20:31	2023-07-19T21:17:34	Rev1	None	None
ICSI-2	0.69315	0.0	0.25	0.5	605.99	2023-08-05T00:50:33	2023-08-05T00:48:01	Rev1	None	None
ICSI-2	0.05779	0.00386	0.00379	1.0	608.88	2023-08-06T23:50:33	2023-08-06T23:41:13	Rev1	None	None
ICSI-2	0.05605	0.00409	0.00367	1.0	606.35	2023-08-07T04:30:32	2023-08-07T04:27:20	Rev1	None	None
ICSI-2	0.05059	0.00186	0.00261	1.0	599.53	2023-08-22T05:30:32	2023-08-22T05:30:00	Rev1	None	None
TrinitySRITrojAI-BostonU	0.70969	0.02317	0.25814	0.5	1217.77	2023-07-19T23:40:32	2023-07-19T23:36:56	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69315	0.0	0.25	0.5	523.75	2023-07-26T00:00:33	2023-07-25T23:52:18	Rev1	:Result Parse::No Results::Missing Results:	None
TrinitySRITrojAI-BostonU	0.58048	0.50344	0.02101	0.97899	522.94	2023-07-26T23:00:34	2023-07-26T22:54:28	Rev1	None	None
TrinitySRITrojAI-BostonU	0.69658	0.55031	0.02521	0.97479	521.45	2023-07-26T23:40:33	2023-07-26T23:39:16	Rev1	None	None
TrinitySRITrojAI-BostonU	0.49223	0.04088	0.15982	0.90135	1235.84	2023-09-04T18:50:33	2023-09-04T18:47:32	Rev1	None	None
TrinitySRITrojAI-BostonU	0.49214	0.04089	0.15978	0.90128	1233.85	2023-09-04T20:10:33	2023-09-04T20:00:32	Rev1	None	None
TrinitySRITrojAI-BostonU	0.59869	0.13635	0.16912	0.80506	1267.72	2023-09-04T22:30:32	2023-09-04T22:28:56	Rev1	None	None
TrinitySRITrojAI-BostonU	0.41145	0.10456	0.1175	0.89245	1226.88	2023-09-05T20:30:33	2023-09-05T20:26:42	Rev1	None	None
UMBCb	0.49969	0.0681	0.16834	0.83391	622.25	2023-08-22T04:30:44	2023-08-22T04:23:04	Rev1	None	None

Required filename format: "rl-lavaworld-jul2023_test_<Submission Name>.simg"
Accepting submissions: True
Number of models in rl-lavaworld-jul2023, test: 238
Execution timeout (hh:mm:ss): 1 day, 15:40:00

Teams/Jobs

Team	Submission Timestamp	Type	Job Status	File Status	General Status	File Timestamp	Time until next execution
Perspecta	2023-08-22T18:50:06	performer	None	None	Ok	2023-08-22T18:44:19	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI	2023-09-27T17:10:09	performer	None	None	Ok	2023-09-27T17:08:17	0 d, 0 h, 0 m, 0 s
DRAFFT		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
PL-GIFT	2023-10-10T18:22:42	performer	None	None	Ok	2023-10-10T18:21:57	0 d, 0 h, 0 m, 0 s
Perspecta-PurdueRutgers	2023-07-21T14:50:16	performer	None	None	Ok	2023-07-20T20:50:25	0 d, 0 h, 0 m, 0 s
Perspecta-IUB	2023-08-08T05:00:13	performer	None	None	Ok	2023-08-08T04:58:40	0 d, 0 h, 0 m, 0 s
ARM-UCSD	2023-08-23T04:30:21	performer	None	None	Ok	2023-08-23T04:22:10	0 d, 0 h, 0 m, 0 s
ARM	2023-08-22T01:50:27	performer	None	Ok	Ok	2023-08-22T01:43:38	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-SBU	2023-10-31T18:40:29	performer	None	None	Ok	2023-10-31T18:35:10	0 d, 0 h, 0 m, 0 s
ARM-UMBC		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-1		performer	None	None	Ok	None	0 d, 0 h, 0 m, 0 s
ICSI-2	2023-08-22T05:30:32	performer	None	None	Ok	2023-08-22T05:30:00	0 d, 0 h, 0 m, 0 s
TrinitySRITrojAI-BostonU	2023-11-14T18:53:43	performer	None	None	Ok	2023-11-14T17:50:54	0 d, 0 h, 0 m, 0 s
trojai-example