Viewing Problem Report Details

The Problem Report Details screen lets you view all the information that you are authorized to view for the given report. It also lets you carry out any actions that you are authorized perform relating to the report. The following actions and information are available.


4.1 Problem Report Actions

The following list contains the possible actions for a problem report. The actual list displayed to the user is dependent on privileges:

Comment In Review

If the report is currently being reviewed, and you are a reviewer in the review group that is performing the review, you will see a link allowing you to add a comment to the record of comments associated with that review. You can also do this from the Review Details page.

Make Final Response To End Review

If the report is currently being reviewed, and you are a responder in the review group that is performing the review, you will see a link allowing you to end the review. You can also do this from the Review Details page.

View Current Review

If the report is currently being reviewed, and you are a reviewer in the review group that is performing the review, you will see a link allowing you to view the Review Details page. From this page you can read the discussion comments that have been recorded in the review so far, and add your own comments.

Notify Submitter of Report Status

If the report is currently in a state requiring the submitter to be notified, and you are a responder for the Certification Authority (CA), you will see a link allowing you to notify the submitter. This option is available after the end of the Specification Authority (SA) Review, and after an Expert Group review. It is also available during the appeals process.

Publish Report

If the report has been given a Final Resolution and the Submitter has already been notified, and you are a responder for the Certification Authority (CA), you will see a link allowing you to Publish the Report and its resolution. You should only use this option if the Submitter has responded to the notification to indicate that they agree with the resolution.

Mark Report as Appealed

If the report has been given a Final Resolution and the Submitter has already been notified, and you are a responder for the Certification Authority (CA), you will see a link allowing you to Mark the Report as Appealed. You should use this option if the Submitter has responded to the notification to indicate that they do not agree with the resolution.

Show/Hide Review Discussions

If you are a reviewer then you have the option of re-displaying the page with or without the review discussions being shown after the review summary information for each review that has been performed, or is in progress, for the report.


4.2 Public Problem Report Information

The following public information is always visible:

Problem Report Number

The unique report number of the Problem Report as assigned when the report is first submitted. If the report has been published, it will also have been assigned a Resolution Id which will be shown in brackets. This is a unique key giving the resolution type and number for each published report. For example, TSD.0123 or INT.1234. The type codes are given below.

Submitter's Classification

This is the classification of the problem as defined by the submitter. The options are explained in the table below.

Problem Classifications
ClassificationDescription
Test Suite problem The test suite is returning a FAIL verdict when it should be returning a PASS.
Certification System problem The Certification software or processes do not allow you to certify your product.
Specification problem There is ambiguous text in the specification, and the test suite or certification system have interpreted the text in a different way to the way it has been interpreted during the development of your product.

State

The state of a report indicates which stage in the report life-cycle the report has reached. The state for all published reports is Resolved. The states that a report can be in are given below:

Problem Report States
StateDescription
TSMA Review The problem was classified as a Test Suite problem, and the Test Suite Maintenance Authority is reviewing it. This review should take no more than 10 days and will be followed by the Specification Authority Review.
CA Review The problem was classified as a Certification System problem, and the Certification Authority is reviewing it. This review should take no more than 10 days and will be followed by the Specification Authority Review.
SA Review The Specification Authority is reviewing the report This review should complete no more than 14 days after the report is raised.
Preliminary Review Inconclusive The preliminary review by the Specification Authority was inconclusive, and a detailed review using an Expert Group will be begun after the submitter has been notified.
Expert Group Review An Expert Group Authority are performing a detailed review of the report since the SA review was inconclusive.
Preparing For Submitter Review The report has been given a final resolution, and the Certification Authority has not yet passed the information on for review by the report submitter.
Awaiting Submitter Acceptance The Certification Authority has passed information about the report resolution to the submitter and the submitter is reviewing it.
Appealed By Submitter The submitter has appealed against the report resolution and the appeals process is in progress.
Resolved The report has been resolved and the resolution agreed by the submitter.

Report Resolution

The report resolution is shown, if one has been assigned. If this resolution has not yet been published, this will be indicated, and the resolution should not be taken as final. The resolutions are given below.

Resolution Codes
CodeType
TSDTest Suite Deficiency
CSDCertification System Deficiency
INTInterpretation Issue with a specification
DUPDuplicate of Previous Problem Report
REJReport Rejected

Raised

This gives the date and time that the report was raised.

Published

If the report has been published, this gives the date and time that the it was published.

Last Updated

This gives the date and time that the last update was made to the report. This includes changes of state, or the addition of any discussion comments being made during a review. This way it is possible for a reviewer to see which reports have been recently updated.

Certification Program

The name of the Certification Program that includes the test suite, certification system or specification to which the problem report refers.

Test Suite

If the report relates to a test suite, the name and version of the Test Suite are shown.

Test Identification

If the report relates to a test, the name of the test case is shown. Multiple test numbers may be given, separated by commas.

Specification

If a specification has been given by the submitter, its name and version will be given. For specification problems (INTs), this is the Specification that contains the problem reported. For Test Suite problems (TSDs) a specification reference may be given to justify some product behavior that is reported by the test suite as a FAIL.

Location in Specification

If present, this gives the reference to the location in the specification to which the problem or justification refers.

Linked Problem Reports

If the submitter considered that their problem relates to other existing problem reports in the Problem Reporting system, they may have provided the relevant report number(s), which will be shown.

Problem Summary

This gives the problem summary as entered by the submitter.

Problem Text

This is the full description of the problem as entered by the submitter.

Test Output

If the problem was identified in test journal output, this will show the relevant fragment of output, as supplied by the submitter.


4.3 Confidential Problem Information

Reviewers from the Certification Authority will see extra fields in the Problem Report Details view, as described below:

Name

The name and email address of the submitter, or of the contact person if the report was submitted on behalf of a group of people.

Company Name

The name of the company or organization that submitted the report.

Telephone Number

The telephone number for the submitter.

Submitter Reference

If the submitter gave a reference number to enable them to identify the report easily in their records, this will be shown.

Product Name

If the submitter gave any information about the product which was being tested when the reported problem was identified, this will be shown.

Operating Environment

If the submitter gave any information about the operating environment in which their product was being tested when the reported problem was identified, this will be shown.


4.4 Review Information

Summary information about the Problem Report Reviews that are in progress or have been completed is presented under the Problem Report details. A summary of each review is shown in a table giving the information described below. If the viewer is a reviewer and has asked for discussions to be included in the Problem Report Details view, each comment made during the review will be presented in a table under the summary information. To view full details of a given review on a separate page, click on the Review Type value on the right of the top entry.

Review Type

The type of the review, which is one of the following:

Review Types
TypeDescription
SA Review The Specification Authority Review, which occurs for every Problem Report submitted. If this review is conclusive then the Problem Report is referred back to the submitter. If it is inconclusive then the submitter will be notified and a Expert Group Review will begin.
TSMA Review The Test Suite Maintenance Authority Review, which occurs before the SA Review for problems which are classified as Test Suite problem by the submitter. The conclusion of the TSMA Review is used as a recommendation in the following SA Review.
CA Review The Certification Authority Review, which occurs before the SA Review for problems which are classified as Certification System problem by the submitter. The conclusion of the CA Review is used as a recommendation in the following SA Review.
Expert Group Review The Expert Group Review, which may occur if the SA Review recommends it. The Expert Group Review must supply a resolution.

Start Date

The date on which the review started.

Completed

The date on which the review completed, if it is complete.

Status

The status of the review - either Active or Complete. If it is active, the due date for completion will be shown.

Name

The name and email address of the responder who closed the review.

Review Resolution

The review resolution is shown, if one has been assigned. Review resolutions for CA and TSMA Reviews are recommendations to the SA Review. Any resolution for the SA Review is Final.

Review Conclusion

The Review Conclusion is shown. This will include any special cases or exclusions that apply to the resolution, and can be used to provide a generic record of when the reported problem is permissible.


4.5 Problem Report History

If the viewer is a Certification Authority (CA) responder, and full information including review discussions has been requested, then a table of history of the Problem Report will also be shown.