TrojAI Test and Evaluation Documentation

Contents:

• What Is TrojAI
  • Resources
  • Communication Channels
  • Examples
    • Image Classification
    • Reinforcement Learning
    • Object Detection
  • Problem Statement
  • Source Code
  • References
• Overview
  • Metrics
  • Success
  • Data Splits
  • Additional Analysis
• System Architecture
  • Test Servers
    • Evaluation Server
    • Smoke Test Server
    • Job Timeout
  • Compute Resources
• Accounts
  • Terms and Conditions
  • Request Account
  • Verify Team Creation
• Data
  • Image Based Tasks
  • Natural Language Processing Based Tasks
  • Datasets
    • round0
    • image-classification-jun2020
    • image-classification-aug2020
    • image-classification-dec2020
    • image-classification-feb2021
    • nlp-sentiment-classification-mar2021
    • nlp-sentiment-classification-apr2021
    • nlp-named-entity-recognition-may2021
    • nlp-question-answering-sep2021
    • nlp-summary-jan2022
    • object-detection-jul2022
    • image-classification-sep2022
    • cyber-pdf-dec2022
    • object-detection-feb2023
• Submission
  • Container Submission
  • Configuration
    • Parameter Loading
    • Configure Mode
  • Container API (Round 10)
  • Container API (Round 9)
  • Container API (Round 5-8)
  • Container API (Round 1-4)
  • Output Files
• Results
  • Jobs Table
  • Results Table
  • All Results Table
  • Error Codes
  • Previous Leaderboards
    • Round 0 Leaderboard
    • Round 1 Leaderboard
    • Round 2 Leaderboard
    • Round 3 Leaderboard
    • Round 4 Leaderboard
    • Round 5 Leaderboard
    • Round 6 Leaderboard
    • Round 7 Leaderboard
    • Round 8 Leaderboard
    • Round 9 Leaderboard
• Software
  • Minimal TrojAI Example
  • Trojan Embedding Tools
  • Google Drive API Tools
  • Round Generation Code
• License
  • Container Use
  • Software License
  • Data License