The Problem Report Details screen lets you view all the information that you are authorized to view for the given report. It also lets you carry out any actions that you are authorized perform relating to the report. The following actions and information are available.
The following list contains the possible actions for a problem report. The actual list displayed to the user is dependent on privileges:
If the report is currently being reviewed, and you are a reviewer in the review group that is performing the review, you will see a link allowing you to add a comment to the record of comments associated with that review. You can also do this from the Review Details page.
If the report is currently being reviewed, and you are a responder in the review group that is performing the review, you will see a link allowing you to end the review. You can also do this from the Review Details page.
If the report is currently being reviewed, and you are a reviewer in the review group that is performing the review, you will see a link allowing you to view the Review Details page. From this page you can read the discussion comments that have been recorded in the review so far, and add your own comments.
If the report is currently in a state requiring the submitter to be notified, and you are a responder for the Certification Authority (CA), you will see a link allowing you to notify the submitter. This option is available after the end of the Specification Authority (SA) Review, and after an Expert Group review. It is also available during the appeals process.
If the report has been given a Final Resolution and the Submitter has already been notified, and you are a responder for the Certification Authority (CA), you will see a link allowing you to Publish the Report and its resolution. You should only use this option if the Submitter has responded to the notification to indicate that they agree with the resolution.
If the report has been given a Final Resolution and the Submitter has already been notified, and you are a responder for the Certification Authority (CA), you will see a link allowing you to Mark the Report as Appealed. You should use this option if the Submitter has responded to the notification to indicate that they do not agree with the resolution.
If you are a reviewer then you have the option of re-displaying the page with or without the review discussions being shown after the review summary information for each review that has been performed, or is in progress, for the report.
The following public information is always visible:
The unique report number of the Problem Report as assigned when the report is first submitted. If the report has been published, it will also have been assigned a Resolution Id which will be shown in brackets. This is a unique key giving the resolution type and number for each published report. For example, TSD.0123 or INT.1234. The type codes are given below.
This is the classification of the problem as defined by the submitter. The options are explained in the table below.
| Problem Classifications | |
|---|---|
| Classification | Description |
| Test Suite problem | The test suite is returning a FAIL verdict when it should be returning a PASS. |
| Certification System problem | The Certification software or processes do not allow you to certify your product. |
| Specification problem | There is ambiguous text in the specification, and the test suite or certification system have interpreted the text in a different way to the way it has been interpreted during the development of your product. |
The state of a report indicates which stage in the report life-cycle the report has reached. The state for all published reports is Resolved. The states that a report can be in are given below:
| Problem Report States | |
|---|---|
| State | Description |
| TSMA Review | The problem was classified as a Test Suite problem, and the Test Suite Maintenance Authority is reviewing it. This review should take no more than 10 days and will be followed by the Specification Authority Review. |
| CA Review | The problem was classified as a Certification System problem, and the Certification Authority is reviewing it. This review should take no more than 10 days and will be followed by the Specification Authority Review. |
| SA Review | The Specification Authority is reviewing the report This review should complete no more than 14 days after the report is raised. |
| Preliminary Review Inconclusive | The preliminary review by the Specification Authority was inconclusive, and a detailed review using an Expert Group will be begun after the submitter has been notified. |
| Expert Group Review | An Expert Group Authority are performing a detailed review of the report since the SA review was inconclusive. |
| Preparing For Submitter Review | The report has been given a final resolution, and the Certification Authority has not yet passed the information on for review by the report submitter. |
| Awaiting Submitter Acceptance | The Certification Authority has passed information about the report resolution to the submitter and the submitter is reviewing it. |
| Appealed By Submitter | The submitter has appealed against the report resolution and the appeals process is in progress. |
| Resolved | The report has been resolved and the resolution agreed by the submitter. |
The report resolution is shown, if one has been assigned. If this resolution has not yet been published, this will be indicated, and the resolution should not be taken as final. The resolutions are given below.
| Resolution Codes | |
|---|---|
| Code | Type |
| TSD | Test Suite Deficiency |
| CSD | Certification System Deficiency |
| INT | Interpretation Issue with a specification |
| DUP | Duplicate of Previous Problem Report |
| REJ | Report Rejected |
This gives the date and time that the report was raised.
If the report has been published, this gives the date and time that the it was published.
This gives the date and time that the last update was made to the report. This includes changes of state, or the addition of any discussion comments being made during a review. This way it is possible for a reviewer to see which reports have been recently updated.
The name of the Certification Program that includes the test suite, certification system or specification to which the problem report refers.
If the report relates to a test suite, the name and version of the Test Suite are shown.
If the report relates to a test, the name of the test case is shown. Multiple test numbers may be given, separated by commas.
If a specification has been given by the submitter, its name and version will be given. For specification problems (INTs), this is the Specification that contains the problem reported. For Test Suite problems (TSDs) a specification reference may be given to justify some product behavior that is reported by the test suite as a FAIL.
If present, this gives the reference to the location in the specification to which the problem or justification refers.
If the submitter considered that their problem relates to other existing problem reports in the Problem Reporting system, they may have provided the relevant report number(s), which will be shown.
This is the full description of the problem as entered by the submitter.
If the problem was identified in test journal output, this will show the relevant fragment of output, as supplied by the submitter.
Reviewers from the Certification Authority will see extra fields in the Problem Report Details view, as described below:
The name and email address of the submitter, or of the contact person if the report was submitted on behalf of a group of people.
The name of the company or organization that submitted the report.
The telephone number for the submitter.
If the submitter gave a reference number to enable them to identify the report easily in their records, this will be shown.
If the submitter gave any information about the product which was being tested when the reported problem was identified, this will be shown.
If the submitter gave any information about the operating environment in which their product was being tested when the reported problem was identified, this will be shown.
Summary information about the Problem Report Reviews that are in progress or have been completed is presented under the Problem Report details. A summary of each review is shown in a table giving the information described below. If the viewer is a reviewer and has asked for discussions to be included in the Problem Report Details view, each comment made during the review will be presented in a table under the summary information. To view full details of a given review on a separate page, click on the Review Type value on the right of the top entry.
The type of the review, which is one of the following:
| Review Types | |
|---|---|
| Type | Description |
| SA Review | The Specification Authority Review, which occurs for every Problem Report submitted. If this review is conclusive then the Problem Report is referred back to the submitter. If it is inconclusive then the submitter will be notified and a Expert Group Review will begin. |
| TSMA Review | The Test Suite Maintenance Authority Review, which occurs before the SA Review for problems which are classified as Test Suite problem by the submitter. The conclusion of the TSMA Review is used as a recommendation in the following SA Review. |
| CA Review | The Certification Authority Review, which occurs before the SA Review for problems which are classified as Certification System problem by the submitter. The conclusion of the CA Review is used as a recommendation in the following SA Review. |
| Expert Group Review | The Expert Group Review, which may occur if the SA Review recommends it. The Expert Group Review must supply a resolution. |
The date on which the review started.
The date on which the review completed, if it is complete.
The status of the review - either Active or Complete. If it is active, the due date for completion will be shown.
The name and email address of the responder who closed the review.
The review resolution is shown, if one has been assigned. Review resolutions for CA and TSMA Reviews are recommendations to the SA Review. Any resolution for the SA Review is Final.
The Review Conclusion is shown. This will include any special cases or exclusions that apply to the resolution, and can be used to provide a generic record of when the reported problem is permissible.
If the viewer is a Certification Authority (CA) responder, and full information including review discussions has been requested, then a table of history of the Problem Report will also be shown.