Surefire Report

Summary

[Summary] [Package List] [Test Cases]


Tests Errors Failures Skipped Success Rate Time
151 0 0 0 100% 3.556

Note: failures are anticipated and checked for with assertions while errors are unanticipated.


Package List

[Summary] [Package List] [Test Cases]


Package Tests Errors Failures Skipped Success Rate Time
GEN-8-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-8-1-authoritative-aggregator 1 0 0 0 100% 0.002
gov.nist.secauto.decima.xml.testing.assertion 52 0 0 0 100% 0.004
GEN-7-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-7-1-authoritative-entity-same-regid-and-role 1 0 0 0 100% 0.001
GEN-9-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-9-1-authoritative-entity-role-missing-softwareCreator 1 0 0 0 100% 0.001
GEN-5-2[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-5-2-non-authoritative-entity-blank-regid 1 0 0 0 100% 0.014
GEN-4-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-4-1-authoritative-entity-no-regid 1 0 0 0 100% 0.001
GEN-11-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-11-1-link-invalid-swid-scheme 1 0 0 0 100% 0.001
baseline-primary-auth[file:/home/circleci/project/swidval/src/test/resources/unit-tests/baseline-primary-auth 1 0 0 0 100% 0.001
GEN-8-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-8-1-authoritative-distributor 1 0 0 0 100% 0.001
gov.nist.secauto.decima.xml.assessment.schema 24 0 0 0 100% 0.121
gov.nist.secauto.decima.xml.assessment.schematron 23 0 0 0 100% 0.792
gov.nist.secauto.decima.xml.templating.document.post.template 24 0 0 0 100% 0.015
GEN-8-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-8-1-authoritative-licensor 1 0 0 0 100% 0.013
GEN-4-2[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-4-2-authoritative-entity-blank-regid 1 0 0 0 100% 0.001
GEN-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/baseline-minimal 1 0 0 0 100% 0.001
GEN-2-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-8-1-authoritative-missing 1 0 0 0 100% 0.002
GEN-4-3[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-4-3-authoritative-entity-default-regid 1 0 0 0 100% 0.002
GEN-2-2[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-2-2-authoritative-empty-xml-lang 1 0 0 0 100% 0.001
GEN-5-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-5-1-non-authoritative-entity-no-regid 1 0 0 0 100% 0.002
gov.nist.secauto.swid.swidval 4 0 0 0 100% 2.55
GEN-5-3[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-5-3-non-authoritative-entity-default-regid 1 0 0 0 100% 0.002
PRI-8-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/PRI-8-1-empty-top-level-directory 1 0 0 0 100% 0.001
GEN-10-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-10-1-non-authoritative-entity-role-missing-softwareCreator 1 0 0 0 100% 0.001
GEN-8-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-8-1-authoritative-softwareCreator 1 0 0 0 100% 0.001
GEN-6-3[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-6-3-non-authoritative-entity-default-regid 1 0 0 0 100% 0.001
GEN-6-2[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-6-2-non-authoritative-entity-blank-regid 1 0 0 0 100% 0.021
GEN-6-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-6-1-non-authoritative-entity-no-regid 1 0 0 0 100% 0.001
GEN-2-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-2-1-authoritative-no-xml-lang 1 0 0 0 100% 0.001
GEN-8-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-8-1-authoritative-multiple 1 0 0 0 100% 0.001

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

GEN-8-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-8-1-authoritative-aggregator

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.002

gov.nist.secauto.decima.xml.testing.assertion

Class Tests Errors Failures Skipped Success Rate Time
DerivedRequirementAssertion 28 0 0 0 100% 0
RemainingAssertion 16 0 0 0 100% 0.002
OverallAssertion 8 0 0 0 100% 0.002

GEN-7-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-7-1-authoritative-entity-same-regid-and-role

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.001

GEN-9-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-9-1-authoritative-entity-role-missing-softwareCreator

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.001

GEN-5-2[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-5-2-non-authoritative-entity-blank-regid

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.014

GEN-4-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-4-1-authoritative-entity-no-regid

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.001

GEN-11-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-11-1-link-invalid-swid-scheme

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.001

baseline-primary-auth[file:/home/circleci/project/swidval/src/test/resources/unit-tests/baseline-primary-auth

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.001

GEN-8-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-8-1-authoritative-distributor

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.001

gov.nist.secauto.decima.xml.assessment.schema

Class Tests Errors Failures Skipped Success Rate Time
SchemaAssessment 24 0 0 0 100% 0.121

gov.nist.secauto.decima.xml.assessment.schematron

Class Tests Errors Failures Skipped Success Rate Time
SchematronAssessment 23 0 0 0 100% 0.792

gov.nist.secauto.decima.xml.templating.document.post.template

Class Tests Errors Failures Skipped Success Rate Time
DefaultTemplateProcessor 24 0 0 0 100% 0.015

GEN-8-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-8-1-authoritative-licensor

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.013

GEN-4-2[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-4-2-authoritative-entity-blank-regid

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.001

GEN-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/baseline-minimal

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.001

GEN-2-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-8-1-authoritative-missing

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.002

GEN-4-3[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-4-3-authoritative-entity-default-regid

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.002

GEN-2-2[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-2-2-authoritative-empty-xml-lang

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.001

GEN-5-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-5-1-non-authoritative-entity-no-regid

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.002

gov.nist.secauto.swid.swidval

Class Tests Errors Failures Skipped Success Rate Time
ExampleTest 1 0 0 0 100% 2.311
SWIDTagCharacteristicsTest 2 0 0 0 100% 0.025
SchematronTest 1 0 0 0 100% 0.214

GEN-5-3[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-5-3-non-authoritative-entity-default-regid

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.002

PRI-8-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/PRI-8-1-empty-top-level-directory

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.001

GEN-10-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-10-1-non-authoritative-entity-role-missing-softwareCreator

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.001

GEN-8-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-8-1-authoritative-softwareCreator

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.001

GEN-6-3[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-6-3-non-authoritative-entity-default-regid

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.001

GEN-6-2[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-6-2-non-authoritative-entity-blank-regid

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.021

GEN-6-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-6-1-non-authoritative-entity-no-regid

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.001

GEN-2-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-2-1-authoritative-no-xml-lang

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.001

GEN-8-1[file:/home/circleci/project/swidval/src/test/resources/unit-tests/GEN-8-1-authoritative-multiple

Class Tests Errors Failures Skipped Success Rate Time
xml] 1 0 0 0 100% 0.001

Test Cases

[Summary] [Package List] [Test Cases]

ExampleTest

 exampleTest 2.261

DefaultTemplateProcessor

 Template[classpath:templates/primary-non-auth-swid.xml] 0.006
Template[classpath:templates/primary-non-auth-swid.xml] 0.001
Template[classpath:templates/primary-non-auth-swid.xml] 0.001
Template[classpath:templates/primary-non-auth-swid.xml] 0.001
Template[classpath:templates/primary-non-auth-swid.xml] 0
Template[classpath:templates/primary-non-auth-swid.xml] 0
Template[classpath:templates/primary-non-auth-swid.xml] 0
Template[classpath:templates/primary-non-auth-swid.xml] 0.001
Template[classpath:templates/primary-non-auth-swid.xml] 0
Template[classpath:templates/primary-auth-swid.xml] 0.001
Template[classpath:templates/primary-auth-swid.xml] 0
Template[classpath:templates/primary-auth-swid.xml] 0.001
Template[classpath:templates/primary-auth-swid.xml] 0
Template[classpath:templates/primary-auth-swid.xml] 0.001
Template[classpath:templates/primary-auth-swid.xml] 0.001
Template[classpath:templates/primary-auth-swid.xml] 0
Template[classpath:templates/primary-auth-swid.xml] 0.001
Template[classpath:templates/primary-auth-swid.xml] 0
Template[classpath:templates/primary-auth-swid.xml] 0
Template[classpath:templates/primary-auth-swid.xml] 0
Template[classpath:templates/primary-auth-swid.xml] 0
Template[classpath:templates/primary-auth-swid.xml] 0
Template[classpath:templates/primary-auth-swid.xml] 0
Template[classpath:templates/minimal-swid.xml] 0

SchemaAssessment

 Assessment[[4]XML Schema: ] 0.007
Assessment[[6]XML Schema: ] 0.006
Assessment[[8]XML Schema: ] 0.007
Assessment[[10]XML Schema: ] 0.005
Assessment[[12]XML Schema: ] 0.005
Assessment[[14]XML Schema: ] 0.004
Assessment[[16]XML Schema: ] 0.006
Assessment[[18]XML Schema: ] 0.005
Assessment[[20]XML Schema: ] 0.005
Assessment[[22]XML Schema: ] 0.005
Assessment[[24]XML Schema: ] 0.005
Assessment[[26]XML Schema: ] 0.005
Assessment[[28]XML Schema: ] 0.004
Assessment[[30]XML Schema: ] 0.005
Assessment[[32]XML Schema: ] 0.005
Assessment[[34]XML Schema: ] 0.005
Assessment[[36]XML Schema: ] 0.003
Assessment[[37]XML Schema: ] 0.005
Assessment[[39]XML Schema: ] 0.006
Assessment[[41]XML Schema: ] 0.005
Assessment[[43]XML Schema: ] 0.005
Assessment[[45]XML Schema: ] 0.004
Assessment[[47]XML Schema: ] 0.005
Assessment[[49]XML Schema: ] 0.004

SchematronAssessment

 Assessment[[5]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.non-auth)] 0.062
Assessment[[7]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.non-auth)] 0.043
Assessment[[9]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.auth)] 0.078
Assessment[[11]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.auth)] 0.037
Assessment[[13]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.auth)] 0.045
Assessment[[15]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.non-auth)] 0.029
Assessment[[17]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.non-auth)] 0.041
Assessment[[19]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.auth)] 0.026
Assessment[[21]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.auth)] 0.026
Assessment[[23]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.auth)] 0.026
Assessment[[25]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.auth)] 0.03
Assessment[[27]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.non-auth)] 0.039
Assessment[[29]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.auth)] 0.03
Assessment[[31]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.non-auth)] 0.031
Assessment[[33]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.auth)] 0.03
Assessment[[35]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.auth)] 0.025
Assessment[[38]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.auth)] 0.027
Assessment[[40]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.non-auth)] 0.031
Assessment[[42]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.non-auth)] 0.027
Assessment[[44]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.auth)] 0.024
Assessment[[46]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.auth)] 0.026
Assessment[[48]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.non-auth)] 0.033
Assessment[[50]Schematron: classpath:schematron/swid-nistir-8060.sch(swid.primary.auth)] 0.026

DerivedRequirementAssertion

 DerivedRequirementAssertion[derivedId=GEN-6-2,result=WARNING] 0
DerivedRequirementAssertion[derivedId=GEN-6-2,result=WARNING] 0
DerivedRequirementAssertion[derivedId=GEN-6-2,result=WARNING] 0
DerivedRequirementAssertion[derivedId=GEN-6-2,result=WARNING] 0
DerivedRequirementAssertion[derivedId=GEN-5-2,result=FAIL] 0
DerivedRequirementAssertion[derivedId=GEN-5-2,result=FAIL] 0
DerivedRequirementAssertion[derivedId=GEN-4-3,result=FAIL] 0
DerivedRequirementAssertion[derivedId=GEN-4-3,result=FAIL] 0
DerivedRequirementAssertion[derivedId=GEN-7-1,result=FAIL] 0
DerivedRequirementAssertion[derivedId=GEN-5-3,result=FAIL] 0
DerivedRequirementAssertion[derivedId=GEN-5-3,result=FAIL] 0
DerivedRequirementAssertion[derivedId=GEN-6-3,result=WARNING] 0
DerivedRequirementAssertion[derivedId=GEN-6-3,result=WARNING] 0
DerivedRequirementAssertion[derivedId=GEN-6-3,result=WARNING] 0
DerivedRequirementAssertion[derivedId=GEN-6-3,result=WARNING] 0
DerivedRequirementAssertion[derivedId=GEN-2-1,result=FAIL] 0
DerivedRequirementAssertion[derivedId=GEN-2-2,result=FAIL] 0
DerivedRequirementAssertion[derivedId=GEN-2-2,result=FAIL] 0
DerivedRequirementAssertion[derivedId=GEN-5-1,result=FAIL] 0
DerivedRequirementAssertion[derivedId=GEN-6-1,result=WARNING] 0
DerivedRequirementAssertion[derivedId=GEN-6-1,result=WARNING] 0
DerivedRequirementAssertion[derivedId=GEN-8-1,result=FAIL] 0
DerivedRequirementAssertion[derivedId=GEN-4-1,result=FAIL] 0
DerivedRequirementAssertion[derivedId=GEN-4-2,result=FAIL] 0
DerivedRequirementAssertion[derivedId=GEN-4-2,result=FAIL] 0
DerivedRequirementAssertion[derivedId=GEN-9-1,result=FAIL] 0
DerivedRequirementAssertion[derivedId=GEN-11-1,result=FAIL] 0
DerivedRequirementAssertion[derivedId=GEN-10-1,result=WARNING] 0

RemainingAssertion

 RemainingAssertion[quantifer=ALL,result=PASS] 0.001
RemainingAssertion[quantifer=ALL,result=PASS] 0.001
RemainingAssertion[quantifer=ALL,result=PASS] 0
RemainingAssertion[quantifer=ALL,result=PASS] 0
RemainingAssertion[quantifer=ALL,result=PASS] 0
RemainingAssertion[quantifer=ALL,result=PASS] 0
RemainingAssertion[quantifer=ALL,result=PASS] 0
RemainingAssertion[quantifer=ALL,result=PASS] 0
RemainingAssertion[quantifer=ALL,result=PASS] 0
RemainingAssertion[quantifer=ALL,result=PASS] 0
RemainingAssertion[quantifer=ALL,result=PASS] 0
RemainingAssertion[quantifer=ALL,result=PASS] 0
RemainingAssertion[quantifer=ALL,result=PASS] 0
RemainingAssertion[quantifer=ALL,result=PASS] 0
RemainingAssertion[quantifer=ALL,result=PASS] 0
RemainingAssertion[quantifer=ALL,result=PASS] 0

xml]

 0.021

xml]

 0.014

xml]

 0.002

xml]

 0.001

OverallAssertion

 OverallAssertion[quantifer=ALL,PASS] 0.001
OverallAssertion[quantifer=ALL,PASS] 0
OverallAssertion[quantifer=ALL,PASS] 0
OverallAssertion[quantifer=ALL,PASS] 0
OverallAssertion[quantifer=ALL,PASS] 0
OverallAssertion[quantifer=ALL,PASS] 0.001
OverallAssertion[quantifer=ALL,PASS] 0
OverallAssertion[quantifer=ALL,PASS] 0

xml]

 0.002

xml]

 0.002

xml]

 0.001

xml]

 0.001

xml]

 0.013

xml]

 0.001

xml]

 0.001

xml]

 0.002

xml]

 0.002

xml]

 0.001

xml]

 0.001

xml]

 0.001

xml]

 0.001

xml]

 0.001

xml]

 0.001

xml]

 0.001

xml]

 0.001

xml]

 0.001

xml]

 0.001

xml]

 0.001

SWIDTagCharacteristicsTest

 testNonAuthoritative 0.016
testAuthoritative 0.007

SchematronTest

 temporaryTest 0.213