6 FBI-Provided Solved Dataset #1

The results of Section 6 are based on searches of the sequestered dataset FBI-Provided Solved Dataset #1. This dataset consists of 516 operational probes collected from a particular type of crime. Members of the FBI manually annotated the probe images and confirmed the ground truth mate. All probes searched were a single sample depicting a region from a distal phalanx. EFS data provided with the probe image may include:

  • Pattern classification
  • Core locations (unconfirmed source)
  • Delta locations (unconfirmed source)
  • Minutia locations (unconfirmed source)

6.1 Failures

Table 6.1 shows the number of failures to create templates. Table 6.2 shows the number of failures to produce a candidate list.

Table 6.1: Number of failures to create templates.
Image Type Content Failures Attempts
Exemplar Image 0 173
Probe Image + EFS 0 516
Probe Image 0 516
Table 6.2: Number of failures to produce a candidate list. This number includes any failures to create a probe template from Table 6.1.
Distractor Imp. Probe Content Failures Attempts
Plain Image 0 516
Roll Image 0 516
Plain Image + EFS 0 516
Roll Image + EFS 0 516

6.2 CMC Plots

The CMC plots in Figure 6.1 show the FNIR of ThalesCogent+0005 when searching FBI-Provided Solved Dataset 1 against enrollment database where a single mated identity for each search probe was present. The plots are faceted by the distractor impression type, mated impression type, and whether probe EFS data was provided. Tabular versions of FNIR at select ranks can be viewed in Table 6.3.

CMC when searching FBI-Provided Solved Dataset 1 probes, faceted by distractor impression type, mated impression type, and whether probe EFS data was provided.

Figure 6.1: CMC when searching FBI-Provided Solved Dataset 1 probes, faceted by distractor impression type, mated impression type, and whether probe EFS data was provided.

6.3 CMC Table

The values in Table 6.3 correspond to Figure 6.1.

Table 6.3: Region FNIR values from CMC plotted in Figure 6.1.
Distractor Imp. Probe Content Rank 1 Rank  ≤ 50 Rank  ≤ 100
Plain Image 0.2248 0.1589 0.1473
Roll Image 0.2306 0.1570 0.1473
Plain Image + EFS 0.1977 0.1318 0.1221
Roll Image + EFS 0.2035 0.1376 0.1240

6.4 DET Plots

The DET plots in Figure 6.2 show the false positive and false negative identification rate tradeoffs of ThalesCogent+0005 when searching FBI-Provided Solved Dataset 1 against enrollment database where a single mated identity for each search probe was present. The plots are faceted by the distractor impression type, mated impression type, and whether probe EFS data was provided. Tabular versions of FNIR at select FPIR can be viewed in Table 6.4.

DET when searching FBI-Provided Solved Dataset 1 probes, faceted by the distractor impression type, mated impression type, and whether probe EFS data was provided

Figure 6.2: DET when searching FBI-Provided Solved Dataset 1 probes, faceted by the distractor impression type, mated impression type, and whether probe EFS data was provided

6.5 DET Table

The values in Table 6.4 correspond to Figure 6.2.

Table 6.4: Region FNIR values corresponding to FPIR plotted in Figure 6.2.
Distractor Imp. Probe Content FPIR = 0.01 FPIR = 0.02 FPIR = 0.1
Plain Image 0.1545 0.1341 0.0795
Roll Image 0.1545 0.1341 0.0773
Plain Image + EFS 0.1391 0.1192 0.0596
Roll Image + EFS 0.1350 0.1150 0.0597