ICL Pathway
BIT Regression Test Report NR2
Ref:
Version:
Date:
FUJ00078727
FUJ00078727
VI/REP/162
1.0
06/04/99
Document Title:
Document Type:
Abstract:
Status:
Distribution:
Author:
© 1998 ICL Pathway Ltd
Business Integration Testing NR2 Regression Test Report
Final Report
This document is a summary of the BIT Regression Cycle.
Approved
ICL Pathway Horizon
Gill Jackson John Wheeler
Jan Holmes Mick Clarke
Tony Hayward
Dave Hollingsworth
Simon Palladino BA
Mark Taylor
Peter Dreweatt Geoff Robinson
Peter Lindsey
Peter Jeram
John Dicks ICL Pathway
Tan Morrison
Stephen Doyle
Graham Chatten
Chris Humphries Chris Wannell
Richard Long Martin Riddell
Pathway Library
Horizon Library
D.Colclough/K.Barrett
COMMERCIAL IN CONFIDENCE
Page I of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref. VI/REP/162
Version: 1.0
Date: __ 06/04/99
0 Document control
0.1 Document history
Version I Date Reason
Issue 0.1 I 15/03/99 I First draft of the document
Issue 0.2 I 19/03/99 I Appendix sections updated for regression run PinICLs. Acceptance
Criteria tables added based on Acceptance managers review
meetings.
Issue 0.3 I 05/04/99 I PinICL statuses updated. All Appendix sections updated.
Issue 1.0 I 06/04/99 I Review comments actioned. KPR entries added.
0.2 Approval authorities
Name Position Signature Date
Gill Jackson Pathway T&I Manager
0.3 Associated documents
Reference Vers I Date Title Source
fy] VI/STR/006 I 2.0 24/10/1997 I Rev. T&I Approach for Pathway R2 Pathway
[2] 23/02/1999 I BITO3 Low Level Test Script Pathway
[3] I VV/TSC/151__ {2.0 I 02/12/1998_I BPS Acceptance Test Script Pathway
[4] VVACS/O11 {2.1 25/02/1999 I Audit Acceptance Test Script Pathway
[5] I VVREP/028__I1.0 I 26/02/1999 _I BIT Final Pass Report Pathway
[7] CR/REP/012 I0.53. I 29/03/99 Known Problem Register at New Pathway
Release 2
© 1998 ICL Pathway Ltd
COMMERCIAL IN CONFIDENCE
Page 2 of 45
ICL Pathway
BIT Regression Test Report NR2 Ref:
Version:
Date:
FUJ00078727
FUJ00078727
VI/REP/162
1.0
06/04/99
0.4 Abbreviations
BIT Business Integration Testing
TI Technical Integration
T&I Testing & Integration
LLTS Low Level Test Script
OBCS Order Book Control System
BPS Benefit Payment System
APS Automated Payment Service
EPOSS Electronic Point of Sale Service
APR Automated Payment Reconciliation
BES Benefit Encashment Service
CMS Card Management Service
PAS Payment Authorisation Service
CCS Common Charging System
SLAM Service Level Agreement Monitoring
FRMS Fraud Risk Management System
FCMS Fraud Case Management System
CON Contract Administration
TPS Transaction Processing System
TIP Transaction Information Processing
RDMC Reference Data Management Center
RDDS Reference Data Distribution System
HAPS Host APS
KPR Known Problem Register
CAPS Customer Accounting & Payments Strategy
ESNS Electronic Stop Notice (Control) System
POCL Post Office Counters Ltd
BA Benefits Agency
NR2 New Release 2
FTMS File Transfer Management System
0.5 Changes in this version
Review comments actioned. KPR entries added.
0.6 Changes forecast
© 1998 ICL Pathway Ltd
COMMERCIAL IN CONFIDENCE
Page 3 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
0.7 Table of Contents
0 DOCUMENT CONTROL
0.1 DOCUMENT HISTOR’
0.2. APPROVAL AUTHORITE
0.3. ASSOCIATED DOCUMENTS.
0.4 ABBREVIATION:
0.5 CHANGES IN THIS VE
0.6 CHANGES FORECAS
0.7. TABLE OF CONTENT:
1, INTRODUCTION...
2. SCOPE AND OBJECTIVES...
3. MANAGEMENT SUMMARY.
4, SYSTEM UNDER TEST...
4.1 ENVIRONMENT
4.2 SOFTWARE...
5. TEST CONDUCT..
5.1 TESTS PERFORMED ........ceese00see
5.2 TEST EXECUTION...
6. TEST RESULTS...
6.1 TOTAL TEST STATISTICS.
6.2. BPS ACCEPTANCE TEST STATISTI
6.3. AUDIT ACCEPTANCE TEST STATISTI
7. PINICLS..
TA
7.2. BPS ACCEPTANCE PINICL!
7.3. AupIT ACCEPTANCE PINIC!
8. CONCLUSION...
8.1 SUMMARY
8.2 ISSUES..
8.3 TEST PROCEDURE IMPROVEMENTS FOR FUTURE REL
APPENDIX A..eseees
APPENDIX B...
APPENDIX D...
APPENDIX E...
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 4 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref. VI/REP/162
Version: 1.0
Date: 06/04/99
1. ‘Introduction
This document is produced for ICL Pathway management. It is a summary of the
Business Integration Testing Regression Pass of the New Release 2 System. It
describes the test environment, test activities performed, test results and the
conclusions drawn.
There is a previous BIT Final Pass Report, which describes the results of the
previous test cycle.
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd Page 5 of 45
age 5 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
Scope and Objectives
The principle objective of this Regression Cycle was to prove the Audit System was
acceptable, which had not been ready for the BIT Final Pass. It also provided a
vehicle to:
prove other areas that had not been proven during the Final Pass activity (such as
Invoicing)
¢ prove that many of the PinICLs raised during BIT Final Pass had been cleared
* run the BPS Acceptance scenarios again
The objectives of the BIT Test phase were:
e to prove data integrity across the various systems making up the NR2 solution
to prove that these systems integrate, and run together in a live like environment
.
© to provide an audit trail of the tests performed
© to demonstrate that the system meets the agreed User Acceptance Criteria,
particularly for BPS & Audit.
The scope of BIT is wide-ranging:
data is created at its source ...
e running the relevant desktop transactions for EPOSS, APS, CMS/PAS, OBCS
and BES
e BPS transactions via the 3 types of Helpdesk
e creating input files at the load area for CAPS & ESNS, and creating input files
on the remote FTMS Gateways for De La Rue Card Systems, De La Rue
Security Printing, Royal Mail and CFM
e loading the POCL and BA Reference Data in the same way as it will be done
live, e.g. using the RDDS & RDMC products
... and processing the data via the Maestro Batch Schedules, Harvesters, Bulk
Loaders through the TPS, CMS/PAS Extract, and Data Warehouse Systems
... and confirming the results by
e running and checking the Desktop Reports, Receipts, Cash Account,
PMSR/CBOS Reconciliation reports, the APR Reports, the CCS Invoice, the
CON system and a sample of performance measures via SLAM, FRMS reports,
BPS MIS Reports and Business Development Reports
e checking and reconciling the output files to CAPS, ESNS, TIP & HAPS
All of this is done on an Architecture that is as live like as possible, thus
testing the use of auto-config. counters, multiple Agents & Correspondence
Servers, Help Desks, Data Warehouse, MIS Clients, RDMC Workstation, etc.
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 6 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
3. Management Summary
The Audit system was much improved from the previous cycle, and the success
rates documented below should be acceptable. The A06 mapping was also aligned,
and the Invoice was successfully reconciled every day of the cycle. (These were the
two key issues from the BIT Final Pass Report).
All sessions where BES, EPOS, APS & OBCS were performed together were again
successful. (Additional scenarios had been added since the Final Pass, because
concems had been raised).
The BIT Regression Cycle Low Level Test Script comprised 8711 test steps, and a
subset of these were mapped to BPS & Audit acceptance criteria.
8168 of these test steps were successfully executed, with actual results matching
those expected. This is a success rate of 93.8%.
The 543 test steps that were unsuccessful were approximately, 40%
build/configuration issues, 50% product error, and 10% script/data or test execution
error. The product errors are all thought to be Low Business Impact.
110 PinICLs were raised as a result of this Regression Cycle.
53 of these were build/configuration issues, closed as duplicates or were no
fault in product.
57 of these were product errors of which 25 related to the audit system. Of
the remaining 32, 7 of these are on the KPR.
The BIT LLTS test steps are mapped against Acceptance Criteria for all products,
but this Regression Cycle was used as an Acceptance vehicle for BPS & Audit only.
2190 test steps were mapped against the BPS Acceptance Scenarios. 2130 of
these test steps were successfully executed, which is 97.5%.
13 new PinICLs were raised, and 42 outstanding PinICLs from previous
testing were encountered.
2524 test steps were Audit Tests, which included the script lines covering
the 34 Audit Acceptance scenarios. 2362 of these test steps were
successfully executed, which is 93.6%.
40 new PinICLs were raised, and 7 outstanding PinICLs from previous
testing were encountered. (25 of the new PinICLs and 3 of the outstanding
PinICLs came about as part of the execution of the 34 audit Acceptance
scenarios.)
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 7 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
The BPS Acceptance Managers meetings held on Friday 12/03/99, Tuesday
16/02/99 and Wednesday 17/02/99 concluded that 142 out of the 160 BPS
Acceptance Criteria were successfully proven. An additional conclusion was that
the majority of the PinICLs that had caused BPS acceptance criteria to fail had now
already had fixes made for them.
The Audit Acceptance Managers meeting held on Wednesday 17/03/99, concluded
that 11 out of 16 Audit Acceptance Criteria were successfully proven. It was also
noted that the majority of problems that had caused Audit acceptance criteria to fail
were of a low business impact.
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 8 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
4. System Under Test
4.1 Environment
The test environment is known as a ‘BIT Rig’, the major components of which are
as follows:
¢ Single Sequent Host running under the DYNIX operating system, and with Oracle
Database
e 4 Correspondence Servers running under NT 4, and supporting Riposte messaging
software
e 4 Agent Servers, running under NT 4
¢ The 3 varieties of BPS Help Desk running under NT 4, and with Oracle Forms/SQL
e I Post Office with 1 Gateway and 1 Non-Gateway counter
¢ 1 Post Office with 1 Gateway and 2 Non-Gateway counters
e 5 Post Offices with a single Gateway counter
¢ (all Post Offices running under NT4, and supporting Riposte messaging software)
e¢ 2non-automated Post Offices were included in the Correspondence Servers
¢ 6Local & Remote FTMS Gateway Servers,
e A Data Warehouse running on a Sequent Host, Dynix & Oracle
« 3MIS Clients for CCS, CON, SLAM, FRMS, Bus.Dev., BPS MIS
e ASLAM Cache Server
e ARDMC Workstation
e 4 Tivoli Servers
e An Audit/Archive Server
4.2 Software
The software release was 9F Baseline, Increment 8.1, with 105 additional fast-
tracks. These were all applied before the start of the test cycle, and are identified on
the TI Certificate of Build. One fast-track fix applied during the cycle, for an
emergency fix that was required to the Audit System.
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 9 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
Test Conduct
Tests Performed
The testing was performed over the period from the 25" February to the 14" March
inclusive.
The following test script was run:
Script Number Description
BITO3 BIT Low Level Test Script
Test Execution
The LLTS was printed off on a daily basis, and the test runners initialed each step as
it was performed. Each step was marked as tick (successful), cross (unsuccessful) or
question mark (query). All unsuccessfuls and queries were subsequently
investigated. These were classified as product error, build/configuration issue,
script/date/test execution error, or no problem (mis-understanding). PinICLs were
raised for all product errors and build/configuration issues, (where there wasn’t
already an outstanding PinICL).
A Test Diary was kept during the cycle. This can be found in datahome/business
integration testing/acceptance pass 2/acceptance pass diary.
There were regular visits by the customer’s auditors during the test cycle.
03/03/99 : Graham Patterson
04/03/99 : Graham Patterson, Damon Lawrence, Lynette Marsden
05/03/99 : Geoff Robinson, Graham Patterson, Damon Lawrence, Lynette Marsden
08/03/99 : Graham Patterson.
10/03/99 : Geoff Robinson, Les Buckett, Ruth Stinchombe
11/03/99 : Geoff Robinson, Les Buckett, Ruth Stinchombe
16/03/99 : Damon Lawerence, Chris Malone
17/03/00: Christine Lowry, Charlie McDowell
Initial feedback indicates that they were all satisfied with the way testing was
conducted.
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 10 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
6. Test Results
6.1 Total Test Statistics
Statistics Percentages
Executed I Successful I Unsuccessful I Deferred I Executed I Unsuccessful
Successful
8711 8168 543 0 93.8% 6.2%
Key:
Executed: Number of test conditions (successful and
unsuccessful)
Successful: Number of test conditions run and were Successful
Unsuccessful: Number of test conditions run and were Unsuccessful
Deferred: Number of test conditions not run and will not be run until the BIT
Regression Cycles. These are the Audit test steps.
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 11 of 45
ICL Pathway
FUJ00078727
FUJ00078727
BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
6.2 BPS Acceptance Test Statistics
Test Steps
Statistics
Percentages
Executed I Successful
Unsuccessful I Deferred I Executed I Unsuccessful
Successful
2190 2130 60 0 97.5% 2.5%
Key:
Executed: Number of test conditions run (successful and
unsuccessful)
Successful: Number of test conditions run and were Successful
Unsuccessful: Number of test conditions run and were Unsuccessful
Deferred: Number of test conditions not run and will not be run until the BIT
© 1998 ICL Pathway Ltd
Regression Cycles.
COMMERCIAL IN CONFIDENCE
Page 12 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref. VI/REP/162
Version: 1.0
Date: 06/04/99
Acceptance Criteria
Meetings were held with the BPS Acceptance Managers to consider the levels of
success for the BPS Acceptance Criteria. Their assessments are documented below.
The table below is a summary of all BPS Acceptance Criteria.
Totals Amount
Successful (No incidents recorded against the 160
criteria although observations may have been
noted)
Unproven (Due to either application problems 0
stopping a case from performing further
planned actions, script or data errors certain
areas of the script could not be executed
leading to some criteria being unproven)
Unsuccessful (One or more incidents raised 18
against the criteria)
The summary of each individual BPS Acceptance area is as follows:
PAS
Totals Amount
Successful (No incidents recorded against the 34
criteria although observations may have been
noted)
Unsuccessful (One or more incidents raised 4
against the criteria)
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 13 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref. VI/REP/162
Version: 1.0
Date: 06/04/99
CMS
Totals Amount
Successful (No incidents recorded against the 40
criteria although observations may have been
noted)
Unsuccessful (One or more incidents raised 2
against the criteria)
DSS Interface
Totals Amount
Successful (No incidents recorded against the 22
criteria although observations may have been
noted)
Unsuccessful (One or more incidents raised 2
against the criteria)
BES
Totals Amount
Successful (No incidents recorded against the 64
criteria although observations may have been
noted)
Unsuccessful (One or more incidents raised 10
against the criteria)
These are documented in Appendix A.
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 14 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
6.3 Audit Acceptance Test Statistics
Test Steps
Statistics Percentages
Executed I Successful I Unsuccessful I Deferred I Executed I Unsuccessful
Successful
2524 2362 162 0 93.6% 6.4%
Key:
Executed: Number of test conditions run (successful and
unsuccessful)
Successful: Number of test conditions run and were Successful
Unsuccessful: Number of test conditions run and were Unsuccessful
Deferred: Number of test conditions not run and will not be run until the BIT
© 1998 ICL Pathway Ltd
Regression Cycles.
COMMERCIAL IN CONFIDENCE
Page 15 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
Acceptance Criteria
A meeting needs to be held with the Audit Acceptance Manager to consider the
levels of success for the Audit Acceptance Criteria. Their assessments are
documented below. The table below is a summary of.
Of the 34 scenarios to be executed 4 (201,206,208,218) contained elements of R2+
functionality. These cases were therefore either totally excluded or partially
excluded from the testing performed.
Totals Amount
Successful (No incidents recorded against the 11
criteria although observations may have been
noted)
Unproven (Due to either application problems 0
stopping a case from performing further
planned actions, script or data errors certain
areas of the script could not be executed
leading to some criteria being unproven)
Unsuccessful (One or more incidents raised 5
against the criteria)
*Non audit-related application problems did prevent scenario 223 from being
executed fully but it was deemed that the omitted elements of the scenario did not
effect the overall proving of any of the acceptance criteria.
These are documented in Appendix B.
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 16 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref. VI/REP/162
Version: 1.0
Date: 06/04/99
7. PinICLs
71 Total PinICLs
110 PinICLs were raised as a result of this BIT Regression Cycle.
53 of these were build/configuration issues, closed as duplicates or were no fault in
product.
57 of these were product errors of which 25 related to the audit system. Of the
remaining 32, 7 of these are on the KPR.
These PinICLs are detailed in Appendix C.
These figures include the BPS & Audit Acceptance PinICLs below.
7.2 BPS Acceptance PinICLs
Based on the execution of 136 BPS Acceptance scenarios, 13 PinICLs were opened
for BPS Acceptance as part of the BIT cycle, 42 PinICLs were encountered that
were already outstanding problems.
The BPS Acceptance PinICLs are detailed in Appendix D.
7.3, Audit Acceptance PinICLs
Based on the execution of 34 Audit Acceptance scenarios, 25 PinICLs were opened
for Audit Acceptance as part of the BIT cycle, 3 PinICLs were encountered that
were already outstanding problems.
The Audit Acceptance PinICLs are detailed in Appendix E.
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 17 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref. VI/REP/162
Version: 1.0
Date: 06/04/99
8. Conclusion
8.1 Summary
The test cycle showed that the NR2 System is close to maturity.
e BPS meets the majority of agreed requirements and acceptance criteria.
e Audit meets the majority of the agreed requirements and acceptance criteria.
e The Invoicing system performed well, and was reconciled on a daily basis.
e There are still many bugs within the system, but these appear to be of low
business impact.
8.2 Issues
None
8.3. Test Procedure Improvements for future Releases
No further suggestion to those detailed in the BIT Final Pass Reports.
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd Page 18 of 45
age 18 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
Appendix A
BPS Acceptance Test Results
Section Al : PAS Acceptance Test Results
The PAS Acceptance Manager has made the following assessments.
Acceptance I Scenario(s) Result PinICL(s) / Comments
Reference Reference
71/1 71,72,75 Successful
7351/2 75 Successful
752/1 38,75 Successful
753/L 83,86 Successful
754/1 14,16 Successful
755/1 17,18 Successful
755/2 70,75 Successful
Observation PC0022647 - Payment showed as available after it was
stopped although it could not actually be encashed.
755/3 86 Successful
756/1 48,79,81,86 Successful
758/1 15,82 Successful
758/2 75 Successful
7762/1 75 Successful
769/1 45,103,104 Unsuccessful
Incident PC0022669 - Alt payee local and foreign encashments are
(Medium) being prevented in a certain combination of NPO set-up.
7710/4 24 Unsuccessful
Incident PC0023147 - A foreign encashment performed while the
(Low) customer’s NPO was emergency closed was not rectified
overnight to not be a foreign.
770/5 25 Successful
TA 79 Successful
T73/1 75 Successful
Incident PC0022399 - Due to incorrect encashment validation all
(Low) carded casual agent transactions are being reported as an
exception as opposed to the encashment details being
returned to CAPS.
78/1 81 Successful
783/1 75,86 Successful
79/1 79 Successful
T97/L 29 Successful
Observation PC0022470 - When Establishing contingency payments
the find option on the benefit type box did not perform
correctly.
Observation PC0021282 - Help Prompt for due date box on
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 19 of 45
ICL Pathway
FUJ00078727
FUJ00078727
BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
contingency screen incorrect.
797/2 29 Successful
797/3 29 Successful
7974 30 Successful
795 31,32 Successful
797/6 29,106 Successful
7977 30,33 Successful
79718 30 Successful
798/2 84 Successful
798/3 39 Successful
970/3 26 Successful
970/4 88 Successful
9TT/L 117,118 Unsuccessful
Incident PC0022416 - Payment is not available for a customer
(Medium) who is introduced as a Uncarded casual agent (Temporary
Agent).
977/2 19,20 Successful
© 1998 ICL Pathway Ltd
COMMERCIAL IN CONFIDENCE
Page 20 of 45
ICL Pathway
FUJ00078727
FUJ00078727
BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
Section A2 : CMS Acceptance Test Results
The CMS Acceptance Manager has made the following assessments.
Acceptance I Scenario(s) Result PinICL(s) / Comments
Reference Reference
700/1 86 Successful
700/2 139 Successful
700/3 5.6 Successful
700/4 133 Successful
704/1 76,86 Successful
704/2 82 Successful
07/1 82 Successful
707/2 2 4,135.1 I Successful
36
707/3 i Successful
713/1 67,68 Successful
Observation PC0018670 - Invalid mode appears when tab appears
when swiping cards on the renewal option.
74/1 67 Successful
715/2 41,142 Successful
716/1 81 Successful
TTL 60,67,137 Unsuccessful
Incident PC0022378 - An unactivated card impounded at one
(Low) counter could still be used after being activated at
another.
17/2 13 Successful
718/1 142 Successful
719/3 46 Successful
720/3 42 Successful
720/5 42 Successful
72016 44 Successful
720/7 48 Successful
720/9 37,41 Successful
720/10 55 Successful
72/1 41 Successful
721/2 143 Successful
724/1 13,82 Successful
Observation PC0019669 - The stop event for a card showed up on the
old and new cards as opposed to just showing for the old
card.
725/1 44 Successful
725/2 44.138 Successful
726/1 55,60 Successful
726/2 82 Successful
RIN 82 Successful
732/1 67 Successful
© 1998 ICL Pathway Ltd
COMMERCIAL IN CONFIDENCE
Page 21 of 45
ICL Pathway
FUJ00078727
FUJ00078727
BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
Observation PC0019942 - The incorrect event was shown at the Help
Desk after a Temporary Token was impounded.
T4V/1 75 Successful
742/1 86 Successful
745/1 55 Successful
794/1 1,2,38,67,93, I Successful
94
795/1 6,38,49,50,11 I Successful
0,119
796/1 5,45,98,106 Successful
Observation PC0019959 - Encashment that is prevented due to RPOI
restriction causes a normal nil receipt to be given to the
customer.
Observation PC0019955 - The content of the receipt given to a
customer when the system is unable to contact the
correspondence server is possibly misleading.
968/4 67 Successful
970/5 26,27 Successful
© 1998 ICL Pathway Ltd
COMMERCIAL IN CONFIDENCE
Page 22 of 45
ICL Pathway
FUJ00078727
FUJ00078727
BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
Section A3 : DSS Interface Acceptance Test Results
The DSS Acceptance Manager has made the following assessments.
Acceptance I Scenario(s) Result PinICL(s) / Comments
Reference Reference
934/1 16,86 Successful
934/2 21,81,85 Unsuccessful
Incident PC0021921 - Ina certain functional circumstance a
(Low) customer ends up not being asked EVP during card
activation.
934/3 81 Successful
934/10 88 Successful
935/1 86 Successful
935/2 86 Successful
935/3 86 Successful
935/4 79,81,86,141 I Successful
935/5 83 Successful
935/6 75 Successful
935/7. 75 Successful
935/8 87 Unsuccessful
Incident PC0023162 - Attempted RPOI infringements performed
(Low) at non-automated offices are not appearing on the FRMS
infringement report.
935/9 81,87 Successful
935/13 88 Successful
936/4 41,86 Successful
936/6 86 Successful
937/3 86 Successful
955/1 13 Successful
955/2 12,89 Successful
955/3 3 Successful
955/4 8.9 Successful
955/5 13 Successful
© 1998 ICL Pathway Ltd
COMMERCIAL IN CONFIDENCE
Page 23 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
Section A4 : BES Acceptance Test Results
The BES Acceptance Manager has made the following assessments.
Acceptance I Scenario(s) Result PinICL(s) / Comments
Reference Reference
759/1 1,2,38,67,93, I Unsuccessful
94,95,96,122
Incident PC0019439 - Unable to compare the Casual Agents
(Low) Details during Carded Casual Agent transaction.
Observation PC0018961 - When a customer presents an expired
Temporary Token the clerk is not informed that the token
has expired.
Observation PC0022633 - System incorrectly prompted for a card to
be cut in half.
Observation PC0022679 - Temporary Token was incorrectly refereed
to at the counter.
Observation PC0019044 - Token ID not rejected during carded casual
agent transaction although no payments could be
collected.
760/1 8,10,38,51,90 I Successful
91,100
61/1 8,91,92.93,94 I Successful
T63/1 51,123 Successful
764/1 6,38,49,50,51 I Unsuccessful
110,118, 119
Incident PC0017699 - Carded Casual Agent Transaction receipts
(Low) do not show details for the casual agent.
Observation PC0017672 - Inconsistency in the name format used.
between counter and HD receipts.
Observation PC0017671 - Alternative payee receipts include details of
the main beneficiary.
Observation PC0012038 - Manual Receipt shown for encashment has
minor misalignment in the details displayed.
Observation PC0014328 - Milk Token amount in the wrong place on a
receipt.
Observation PC0022026 - Manual counter receipt differs slightly to
printed receipt.
64/2 38 Successful
64/3 111,112,113 _I Successful
765/1 38 Successful
66/1 7,17,99,125,1 I Successful
26
Observation PC0019378 - Position of the word void on an encashment
receipt.
767 6,38,49,50,11_ I Unsuccessful
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 24 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
0,119
Incident (Medium) I PC0019503 - Some Appointee encashments are being
wrongly recorded as foreign encashments.
768/1 100,101,110 _I Successful
T70/1 41 Unsuccessful
Incident PC0019179 - When a customer performs a third foreign
(Low) encashment they are told of the reason why no payments
are due.
Observation PC0019930 - Message shown when a Help Desk foreign
override is performed is incorrectly positioned.
Observation PC0019735 - Declaration on Welsh Receipts is
overwritten when large amount of payments encashed.
70/2 97 Unsuccessful
Incident (Low) PC0022488 - Social fund payments are not being
correctly excluded from foreign encashment counting.
770/3 1,140 Successful
772/1 8.41 Successful
774/1 54,63 Successful
TB87/1 107,114 Successful
788/1 10,51,102 Successful
789/1 10,51,102 Successful
790/1 8,124 Successful
798/1 59,69 Successful
840/1 1,2,10,38,51, I Successful
67,90,91,93,9
4,95,96,100 Observation PC0018961 - When a customer presents an expired
Temporary Token the clerk is not informed that the token
has expired.
841/2 10,51 Successful
841/3 110 Successful
842/1 51 Successful
843/1 92,93,94 Successful
844/1 6,10,38,49,50 I Successful
100
845/1 7,99,125,126 I Successful
Observation PC0019378 - Position of the word void on an encashment
receipt.
846/1 127,133 Successful
847/1 38,49,50,110, I Successful
io
848/1 51,116 Successful
849/1 41 Successful
850/1 127,133 Successful
851/1 127,133 Successful
854/1 38,50,110 Successful
855/1 111,115 Successful
856/1 8,125 Successful
858/1 41,128 Unsuccessful
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 25 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
Incident PC0017956 - Counter does not always correctly prompt
(Low) the clerk that a foreign encashment is being performed.
859/1 127,131 Successful
861/1 53,105,107 Successful
862/1 5,45,98,106,1 I Successful
29
863/1 1,2,8,38,67.9 I Successful
3,94
865/1 6,38,49,50,11 I Successful
0,119
866/1 51 Successful
867/1 39,59 Successful
874/1 93,94 Unsuccessful
Incident PC0021908 - When a stopped TT is presented at the
(Low) counter it is not prompted to be impounded.
Incident PC0019003 - During Carded Casual Agent transaction if
(Low) one card is stopped then both cards end up being
impounded.
Observation PC0019068 - Some of the counter receipts do not have
manual view options available for when the printer fails
and a manual receipt has to be produced.
Observation PC0019012 - Card impound receipts produced by
different transaction at the counter show inconsistent
details.
Observation PC0017280 - Unactivated card presented at NPO is
impounded.
Observation PC0022113 - Mistakes on Bilingual impound receipts.
Observation PC0022126 - Bilingual impound receipts contain spelling
mistake of ‘Derbynned’.
875/1 93 Successful
87/1 38,40,67 Successful
88/1 45,98,130,13 I Successful
2
893/1 127,131 Successful
904/1 56,62,64,65,6 I Unsuccessful
6,105
Incident (Low) PC0019982 - Customer collected payments as alternative
Payee without being instructed to collect payments they
had available as main beneficiary.
904/3 10,51,102,10 I Successful
6
904/4 109,111 Successful
904/5 52,108,109 I Successful
908/1 6,38,49,50,51 I Unsuccessful
(110,118,119
Incident PC0017699 - Carded Casual Agent Transaction receipts
(Low) do not show details for the casual agent.
910/1 108,109 Successful
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 26 of 45
ICL Pathway
FUJ00078727
FUJ00078727
BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
910/2 106 Successful
924/1 36.42,43,47 I Successful
943/1 78 Successful
9044/1 100,10 Successful
1,102,119
944/2 120 Successful
963/1 34 Successful
965/1 M1 Successful
969/1 23 Unsuccessful
Incident (Low)
PC0023147 - A foreign encashment performed while the
customer’s NPO was emergency closed was not rectified
overnight to not be a foreign.
© 1998 ICL Pathway Ltd
COMMERCIAL IN CONFIDENCE
Page 27 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
Appendix B
Audit Acceptance Test Results
The Audit Acceptance Manager has made the following assessments.
Acceptance I Scenario(s) Result PinICL(s) / Comments
Reference _I Reference
699/1 1-24 Successful
699/2 1-24 Unsuccessful
Incident PC22898 - The archive file for Help Desk calls
(Low) (PASCAR) contains duplicate data
Incident PC22553 - No archive file was produced on 12/02/2000
(Low) for TMS_RX_PAYMENT_STOPS (PASTRS).
Incident PC20521 - OBCS Exception files are not being moved
(Low) from load_area to ARC_FOUT.
699/3 1-24 Successful
699/4 1-24 Successful
699/5 1-24 Successful
699/6 Successful
699/9. 25-29 Successful
816/1 1, 3-10,12- Unsuccessful
14,17-
19,21,23- Incident PC22756 - OBCS table TMS_TX_LOCAL_STOPS
(Low) archive file is not being produced.
Incident PC23029 - Access Rights to the BES reports for the
(Low) standard POCL auditor function are possible incorrect.
Incident PC23031 - Standard POCL auditor does not have access
(Low) to user roles for post office staff. Emergency auditor has
access but the method of retrieving this information is
long winded.
Observation PC22667, PC22889, PC22287, PC:
PC22374, PC23117, PC22295, PC:
PC18983.
A series of PinICLs were found as part of the scenarios
that tested this criteria that related to the naming of the
audited files.
Observation PC22543 - Files hoarded on separate days although
processed by the hoarder at the same time.
Observation PC22286 - Certain hoarded files not visible at
Workstation.
Observation PC22368 - Register entry for utility
Agent_Load_Audit_Data not set correctly.
921/5 32 Successful
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 28 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
942/3 1-9,11,13- Unsuccessful
18,20-30,34
Incident PC22370 - Archived Message store contained out of
(Low) sequence and duplicated message store entries.
Incident PC22812 - Restore_Audit_Data should process all
(Low) retrieved message store files it is only processing the first.
PC22367 - Utility to rebuild message store on the audit
Observation server did not function correctly.
PC22368 - Register entry for utility
Observation Agent_Load_Audit_Data not set correctly.
942/6 1-9,11, 13- Successful
18,20-30,34
942/7 1-9,11, 13- Unsuccessful
18,20-30,34
Tncident PC22553 - No archive file was produced on 12/02/2000
(Low) for TMS_RX_PAYMENT_STOPS (PASTRS).
Incident PC22756 - OBCS table TMS_TX_LOCAL_STOPS
(Low) archive file is not being produced.
942/8 1-9,11, 13- Successful
18,20-30,34
Observation PC22367 - Utility to rebuild message store on the audit
server did not function correctly
942/9 1-9,11, 13 Successful
18,20-30,34
942/10 Successful
Observation PC22286 - Certain hoarded files not visible at
Workstation.
942/11 1-9,11, 13- Unsuccessful
18,20-30,34
Incident 812 - Restore_Audit_Data should process all
(Low) retrieved message store files it is only processing the first
file.
Observation PC22423 — Audit Workstation couldn’t write to CD over
the network.
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 29 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
Appendix C
All PinICLs raised during Regression Pass (including BPS Acceptance & Audit
Acceptance)
PinICL statuses shown are as at 06/04/99
PinICL Description Status
PC22918 I ‘Media’ error on archive server Closed — No Fault
in Product.
PC22739 I Agent_Gei_ClusterID reported an error on the audit I Closed — No Fault
server in Product.
PC22667 I CAPS Gatherer is renaming files incorrectly. Closed — Fix Made
and Re-Tested.
PC22533_I Archive Gathering files more than once. Fix for Live Trial
PC22289 I The TMS Archive files are being renamed incorrectly I Fix for Live Trial
on the Archive Server.
PC22898 I The archive file for Help Desk calls (PASCAR) is KPR
sometimes a duplicate of the
previous days file.
PC22213 I PASRRF_AUDIT job gives error event and Closed — Fix Made
corresponding error in Maestro (Build).
journal.
PC22340 I The Audit Log Gatherer is renaming files incorrectly. Closed — Fix Made
and Re-Tested.
PC22211 I Audit jobs unable to connect to share. Closed — Fix Made
and Re-Tested.
PC22423 I Audit Workstation couldn’t write to CD. Closed — No Fault
in Product.
PC22280 I AUDIT_STRT1.MAES_ AUDIT failures. Closed.- Fix Made
(Build)
PC22734 I Entries incorrectly deleted from file register tables Closed — No Fault
in Product.
PC22543 I Files hoarded on separate days although processed by I Closed — Fix Made
the hoarder at the same time. and Re-Tested.
PC22284 I PMSR reports being gathered by PASRRF_AUDIT I Closed — Fix Made
job not APR_AUDIT job. (Build)
PC22287 I The Horizon Help Desk files are being renamed Closed — Fix Made
incorrectly by the HHD Gatherer. and Re-Tested.
PC22270 I HHD_AUDIT failed - cannot connect to share. Closed — Fix made
and re-tested.
PC22286 I Certain hoarded files not visible at Workstation Closed — Fix made
and re-tested.
PC22367 I Utility to rebuild message store on the audit server did I Closed — Fix Made
not function correctly. (Build).
PC22553 I No archive file was produced on 12/02/2000 for Closed —
TMS_RX_PAYMENT_STOPS (PASTRS). Consolidated with
PC22908.
PC22554 I No archive file was produced on 12/02/2000 for Closed —
TMS_TX_INFRINGEMENTS (PASTTI). Consolidated with
PC22908.
PC22370 I Archived Message store contained out of sequence Closed — Fix made
and duplicated message store entries. and re-tested.
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
y Page 30 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
PC22417 I PASCMS archive files - no .arc or .tmp files were Closed — Fix made
produced on the 10/02/2000 for a series of tables. and re-tested.
PC22368 I registry entry for utility Agent_Load_Audit_Data not I Closed — Fix Made
set correctly. (Build).
PC22812 I Restore_Audit_Data should process all retrieved Closed — Fix made
message store files it is only processing the first file. and re-tested.
PC22292 I TDLR Gatherer is renaming Temporary Token Fix For Live Trial
exception Archive files incorrectly,
PC22293 I The TIP Gatherer is renaming archive files Closed — Fix made
incorrectly. and re-tested.
Audit files on Tivoli are suffixed .tmp. meaning that Closed ~ No Fault
the Audit Gatherer will not collect them. in Product.
The Tivoli Gatherer is renaming files incorrectly; Fix For Live Trial
Was unable to recover files using the Legato Closed ~ Fix Made
Networker User facility on the Audit Workstation. and Re-Tested.
PC22690 I Reference Data file REFR-0101-031 in $ARC_FOUT I Closed — No Fault
had no ‘write! access. in product.
PC23029 I Access writes to the BES reports for the standard Closed — No Fault
POCL auditor function are possibly incorrect. in Product.
PC22908 I Archive file for TMS_TX_CARDS_UPDATES KPR
(PASTTN) was missing on the 19%
PC22818 I Possible that Calls_Are table is being archived Closed — No Fault
incorrectly. in Product.
PC22295_I The DLR Gatherer is renaming files incorrectly. Fix For Live Trial
PC22356 I The HAPS Gatherer is renaming files incorrectly Closed — Fix Made
& Re-tested.
PC22366 I OBCS error message was misleading. Closed — Fix Made
and Re-Tested.
PC22756 I OBCS table TMS_TX_LOCAL_STOPS archive file Closed — Fix Made
is not being produced. and Re-Tested.
PC22294 I The RAMIL Gatherer is renaming files incorrectly. Closed — Fix Made
& Re-Tested.
PC23007 I Emergency auditor has access to the training and Closed — No Fault
admin functions when first logged in. in Product.
PC23031 I Standard POCL auditor does not have access to user Closed — No Fault
roles for post office staff. Emergency auditor has in Product.
access but the method of retrieving this information is
long winded.
PC22407 I Time out message appearing occasionally at the Help I Closed — Fix Made
Desk. (Build).
PC22669 I Alt payee local and foreign encashmenis are being Closed — Fix Made
prevented in a certain combination of NPO set-up. and Re-Tested.
PC22557 I A Batch and On-Line payment were loaded the same I Closed— No Fault
day and subsequent contingency processing was based I in Product.
on the on-line payment not the batch payment.
PC22399 I Due to incorrect encashment validation all carded Closed — Fix Made
casual agent transactions are being reported as an and Re-Tested.
exception as opposed to the encashment details being
returned to CAPS.
PC22378 I An unactivated card impounded at one counter could I KPR
still be used after being activated at another.
PC22633 I System incorrectly prompted for a card to be cut in KPR
half
PC22488 I Social fund payments are not being correctly excluded _I KPR
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 31 of 45
ICL Pathway
BIT Regression Test Report NR2
FUJ00078727
FUJ00078727
Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
from foreign encashment counting.
PC22679 I Temporary Token was incorrectly refereed to atthe I KPR
counter.
PC22470 I When Establishing contingency payments the find KPR
option on the benefit type box did not perform
correctly.
PC23147 I A foreign encashment performed while the customer's I Closed — No Fault
NPO was emergency closed was not rectified in Product.
overnight to not be a foreign.
PC23162 I Attempted RPOI infringements performed at non- Fix For Live Trial
automated offices are not appearing on the FRMS
infringement report.
PC22647 I Payment showed as available after it was stopped Closed — No Fault
although it could not actually be encashed. in Product.
PC22416 I Payment is not available for a customer who is Closed — Fix Made
introduced as a Uncarded casual agent (Temporary & Re-Tested.
Agent).
PC22910 I Error events received on Agent01. Closed — Fix Made
& Re-Tested.
PC22763 I AGFTMS4 failed to link to Maestro. Closed — Fix Made
(Build).
PC22940 I The value on the APR 10 day exception report is Closed as
printing as a whole number of duplicate of
pence, not as pounds.pence. PC19394.
PC22701 I Following an APS card payment an immediate KPR
reversal for the transaction was
attempted, resulting in a Desktop message of; "This
transaction cannot be
reversed it is from a previous accounting period”.
PC22590 I APSC318 reported it had already been run today even I Closed — Fix Made
though it hadn’t. (Build).
PC22231 I Maestro Stdlist program AS_Mstdlist missing from Closed — Fix Made
HHD local gateway and Re-Tested.
PC22505 I On certain counters the Event Viewer had Errors Closed — No Fault
relating to the Asset Manager: in Product.
PC22681 I Problems Authorising some Validation Failures Closed — Fix Made
and Re-Tested.
PC22279 I B_HV_ALL security package error Closed — No Fault
in Product.
PC22654 I Some counter Event Viewers had errors Closed — Duplicate
relating to the job B_HV_POREDIR. of PC22504.
PC22504 I B_HV_POREDIR Event Viewer Error Closed — Fix Made
and Re-Tested.
PC22444 I BHBES maestro job failure. Closed — Fix made
(Build).
PC22325 I c:\tmp\snapshotNT 1.bat file missing from Closed — Fix Made
Correspondence Servers. (Build).
PC22473 I Problem with CBoS Cash Accounting Week. Closed — Fix Made
and Re-Tested.
PC22380 I CBoS pmsr105 not showing error code correctly. Closed — No Fault
in product.
PC22662 I CCS - Error received on Suppliers Remedies Report Closed — Fix Made
FRM-40735: no access to an underlying table and Re-Tested.
PC22663_I CONADICCS expiry date display possibly confusing. I Closed — No Fault
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 32 of 45
ICL Pathway
BIT Regression Test Report NR2
FUJ00078727
FUJ00078727
Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
In Product.
PC22661 I Selection of Manual performance Measure entry from I Closed — Fix Made
the Contract Administration gave an application error. I and Re-Tested.
PC22909 I Critical event was reported on Corr Server CSO2 Closed — Fix Made
and Re-Tested.
PC22830 I Duplicate data in OBCS transmission file from one Closed as
day to the next. Duplicate of
PC22623
PC22623 I Duplicate Data in OBCS files. Closed as
Duplicate of
PC22445.
PC22413 I Error appeared on Event Viewer on counter. Closed — Fix Made
(Build).
PC22386 I Error on Event Viewer on certain counters Closed — No Fault
relating to Riposte Training. in Product.
PC22384 I Error on Event Viewer on certain counters relating to I Closed — Duplicate
Serial Devices:- of PCI 7904.
PC22329 I Error message displayed when selecting refresh for Closed — Fix Made
FCMS Business Object reports - 'evq detail’ and & Re-Tested.
‘evp summary’.
PC22241 I Transfer from HAPS to APS failed on local gateway. Closed ~ Fix Made
(Build).
PC22249 I Horizon FTMS Gway fails delivery to seq18. Closed ~ Fix Made
(Build)
PC22290 I Following rebuild of Horizon local gateway for FTMS I Closed — Fix Made
problems, it appears that Maestro had not been re- Build).
installed.
PC22288 I Maestro ref-data load failing. Closed — Fix Made
and Re-Tested.
PC22984 I Job MISMONTH.MISC401 failed Closed — Fix Made
and Re-Tested.
PC22282 I No End of day marker appeared for a post office. Closed — No Fault
in Product
PC22437 I OBCSCO001 process failed attempting to transfer a file. I Closed — Fix Made
(Build).
PC22591 I OBCSC002 fails deleting from file register Closed — Duplicate
of PC22445.
PC22585 I OBCSC00S file transfer errors occurred. Closed — Duplicate
of PC22437.
PC22281 I OORACLE.OBCSC001 job failure Closed — No Fault
in Product.
PC22395 I Patrol server not present on BITO3 Closed — Fix Made
(Build).
PC22589_I PAYONIT2.SUPC301 failed recreating index Fix For Live Trial
PC22517 I Unable to produce any of the PCDF Daily & Weekly Closed — Fix Made
Token Summaries. & Re-Tested.
PC22765 I Purge process SUPC316 failed Closed ~ No Fault
in Product.
PC22296 I The job RDDATALD.RDLAOD4 ran for 13 hours. Closed — No Fault
in Product.
PC22285 I Rddsmisex submitted by rddsextract continues to Closed — Fix Made
extract ‘all’ Post Office opening hours ona daily basis. I & Re-Tested.
PC22219 I Rddstpsex - erroneous current_date held. Closed — No Fault
in Product.
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 33 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref. VI/REP/162
Version: 1.0
Date: 06/04/99
PC22699 I ICMF/OCMF files in $ARC_FOUT did not have Closed — No Fault
Read/write access, in Product.
Revaluation Processes & Procedures possibly require I Closed — No Fault
amendment. in Product.
PC22762_ I RMLTRK.CMSC504 job failed. Closed ~ No Fault
in Product.
PC22795 I Possible to stop payments reported as encashment Closed — Fix Made
validation errors. & Re-Tested.
PC22278 I TIP file transfer failure. Closed — Fix Made
(Build).
PC22379 I Tivoli failed to start TMS services Closed — No Fault
in Product.
PC22871_I TPS Bes file rec caused D/W to fail Fix For Live Trial
PC22291 I Incorrect message displayed when same use name Closed — No Fault
logged into training and actual system. in Product.
PC22671 I BPS MIS Contingency encashments report included KPR
encashment values for non-contingency payments.
PC22809 I Balancing Daily cash dec's to Cash Flow total. Closed — No Fault
in Product.
PC22300 I While using the test printer option the desktop Closed — Fix Made
crashed, (Build)
PC22664 I Item total not populated on Counters Revenue report. I Closed — Fix Made
& Re-Tested.
PC22676 I P&A group 14, £12, not reported on summary Closed ~ No Fault
in Product.
PC22675 I Txn's were not reported on counter daily report Closed — Fix Made
& Re-Tested.
PC23117 I Archived TIP files have incorrect extension on the KPR
audit server.
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 34 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
Outstanding PinICLs (raised during previous testing), that were encountered during
Regression Pass (including BPS Acceptance scenarios & Audit Acceptance Scenarios)
PinICL statuses shown are as at 06/04/99
PinICL Description Status
18983 PASCMS and OBCS Audit Files are not adhering to Closed — Fix Made
Naming Standards. & Re-Tested.
19506 Lack of operational procedures for Legato. Fix For Live Trial.
20521 OBCS Exception files are not being moved from Fix For Live Trial
load_area to ARC_FOUT.
21724 Archive Server showed 'Perflib' error Closed — Fix Made
& Re-Tested.
21813 Process SUPC311 missing from maestro schedule. Closed — No Fault
In Product.
21866 If the Audit Agent is not running for a number of days, I Fix For Live Trial.
messages with a deletion time of I day will be deleted
by Riposte archiving before a copy is made into the
Audit File.
22019 The Archive Gatherer instance for APR is abending. Closed — Fix Made
Message on event viewer is ‘Access is Denied’. & Re-Tested.
12038 Manual Receipt shown for encashment has minor KPR
misalignment in the details displayed.
16609 Impound receipt contains incorrect NINO when Closed — No Fault
system does not match the card to a currently active in Product.
customer.
17368 Prompts for a 2" Foreign Encashment are potentially _I Closed — No Fault
incorrect., in Product.
17699 Carded Casual Agent Transaction receipts do not KPR
show details for the casual agent.
17671 Alternative payee receipts include details of the main I Closed — No Fault
beneficiary. In Product.
17672 Inconsistency in the name format used between KPR
counter and HD receipts.
17956 Counter does not always correctly prompt the clerk KPR
that a foreign encashment is being performed.
18550 Missing re-order card prompt at the Help Desk after I KPR
DSS call completed.
18961 When a customer presents an expired Temporary KPR
Token the clerk is not informed that the token has
expired.
19044 Token ID not rejected during carded casual agent KPR
transaction although no payments could be collected.
22026 Manual counter receipt differs slightly to printed KPR
receipt.
19012 Card impound receipts produced by different KPR
transaction at the counter show inconsistent details.
19043 Some receipts automatically print at the counter and KPR
some receipts require the clerk to invoke the print
option.
19068 I Some of the counter receipts do not have manual view [KPR
options available for when the printer fails and a
manual receipt has to be produced.
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 35 of 45
ICL Pathway
BIT Regression Test Report NR2 Ref:
Version:
Date:
FUJ00078727
FUJ00078727
VI/REP/162
1.0
06/04/99
19179 When a customer performs a third foreign encashment I KPR
they are told of the reason why no payments are due.
19503 Some Appointee encashments are being wrongly Closed — Fixed
recorded as foreign encashments. made and re-
tested.
19378 Position of the word void on an encashment receipt. KPR
19438 Lack of issue/receipt/retain receipt prompts during Closed — No Fault
encashment process. in Product. (Issue
for acceptance
review)
19439 Unable to compare the Casual Agents Details during I KPR
Carded Casual Agent transaction.
19482 Timings shown for an encashment throughout the Closed — No Fault
system. in Product. (Issue
for acceptance
review)
19510 Incorrect Payee Role shown for carded casual Agent Closed — No Fault
Transaction. in Product. (Issue
for acceptance
review)
19511 Timing of the don’t complete encashment prompt. Closed = No Fault
in Product. (Issue
for acceptance
review)
19616 Casual Agent flag not set on encashment details for Closed — No Fault
carded casual agent encashment. in Product. (Issue
for acceptance
review)
19655 Encashment Tab 3 shown during an encashment Closed - No Fault
displays inconsistent details. in Product. (Issue
for acceptance
review)
19668 Carded Casual Agent encashment on behalf of an Closed - No Fault
appointee shows an incorrect role for the encashment. I in Product. (Issue
for acceptance
review)
19669 The stop event for a card showed up on the old and Fix For Live Trial
new cards as opposed to just showing for the old card,
19735 Declaration on Welsh Receipts is overwritten when KPR
large amount of payments encashed.
19930 Message shown when a Help Desk foreign override is_I Closed - Fix Made
performed is incorrectly positioned. and Re-tested.
19942 The incorrect event was shown at the Help Desk after I Fix For Live Trial
a Temporary Token was impounded.
19955 The content of the receipt given to a customer when Closed - Fix Made
the system is unable to contact the correspondence and Re-tested.
server is possibly misleading.
19959 The content of the receipt given to a customer in the Closed - Fix Made
RPOV/GRI situation is possibly incorrect. and Re-tested.
19982 I Customer collected payments as alternative Payee Fix For Live Trial
without being instructed to collect payments they had
available as main beneficiary.
18670 Invalid mode appears when tab appears when swiping I KPR
cards on the renewal option
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 36 of 45
ICL Pathway
BIT Regression Test Report NR2
FUJ00078727
FUJ00078727
Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
21908 When a stopped TT is presented at the counter it is not I Closed - Fix Made
prompted to be impounded. and Re-tested.
21153 Occasionally a counter error message is occurring Monitor for re-
during BES transactions that causes the desktop to occurrence in next
have to be re-started. regression cycle.
21921 Ina certain functional circumstance a customer ends Closed — Fix Made
up not being asked EVP during card activation. and Re-Tested.
19003 During Carded Casual Agent transaction if one card is_I Closed — Fix Made
stopped then both cards end up being impounded. and Re-Tested.
14328 Milk token amount in the wrong place on a receipt. Closed — No Fault
in Product.
17280 Unactivated card presented at NPO is impounded. KPR
21282 Help prompt for due date box on contingency screen Closed — Fixed
incorrect. made and re-
tested.
22113 Mistakes on Bilingual impound receipts. KPR
22126 Bilingual impound receipts contain spelling mistake of I KPR
‘Derbynneb’.
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 37 of 45
ICL Pathway
BIT Regression Test Report NR2
FUJ00078727
FUJ00078727
Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
Appendix D
PinICLs raised during Regression Pass, based on execution of BPS Acceptance
scenarios
PinICL statuses shown are as at: 06/04/99
PinICL Description Scenario(s) Incident / Accept. Ref I Status
PINCL found I Observation
against. recorded.
22669 Alt payee local and foreign 103 Incident 769/1 Closed - Fix
encashments are being prevented in (Med) Made and Re-
a certain combination of NPO set- Tested.
up.
22557 A Batch and On-Line payment were I 29 N/A N/A Closed — No
loaded the same day and subsequent Fault in
contingency processing was based Product.
on the on-line payment not the batch
payment.
22378 An unactivated card impounded at 137 Incident TTA KPR
‘one counter could still be used after (Low)
being activated at another.
22633 System incorrectly prompted fora I 122 Observation I 759/1 KPR
card to be cut in half.
22488 Social fund payments are not being, 97 Incident 770/2 KPR
correctly excluded from foreign (Low)
encashment counting.
22679 Temporary Token was incorrectly I 96 Observation I 759/1 KPR
refereed to at the counter,
22470 ‘When Establishing contingency 29 Observation I 797/1 KPR
payments the find option on the
benefit type box did not perform
correctly.
22647 Payment showed as available after it, I 70 Observation I 755/2 Closed — Noa
was stopped although it could not Problem.
actually be encashed.
22416 Payment is not available for a 6, 117 Incident 977. Closed - Fix
customer who is introduced as a (Medium) Made & Re-
Uncarded casual agent (Temporary Tested.
Agent).
22399 Due to incorrect encashment Various Incident TB Closed - Fix
validation all carded casual agent (Low) Made and Re-
transactions are being reported as an Tested.
exception as opposed to the
encashment details being returned to
CAPS.
22407 Time out message appearing Various N/A N/A Closed - Fix
occasionally at the Help Desk. Made (Build).
Outside scope
of BPS
Acceptance.
23147 A foreign encashment performed 23,24 Incident 969/1, 770/4 I Closed - No
while the customer’s NPO was (low) Fault in
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 38 of 45
FUJ00078727
FUJ00078727
Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
ICL Pathway BIT Regression Test Report NR2
emergency closed was not rectified Product.
overnight to not be a foreign,
23162 Attempted RPOT infringements 87 Incident 935/8 Fix For Live
performed at non-automated offices (Low) Trial
are not appearing on the FRMS
infringement report.
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 39 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
Outstanding PinICLs (raised during previous testing), that were encountered during
the execution of the BPS acceptance scenarios during the BIT Regression Cycle :
PinICL statuses shown are as at: 06/04/99
PinICL I Description Scenario(s) Incident / Accept. Status
PINCL found I Observation I Ref.
against. recorded.
19378 I Position of the word void on an Various Observation I 766/1 & KPR
encashment receipt. 845/1
19438 I Lack of issue/receipt/retain receipt Various No Fault in Closed — no
prompts during encashment process. Product. Fault. (Issue for
acceptance
review)
19439 I Unable to compare the Casual Agents I 119 Incident 759/1 Proposed to be
Details during Carded Casual Agent (Low) fixed at R2+.
transaction.
19482 I Timings shown for an encashment Various No Fault in Closed - no Fault.
throughout the system. Product. (Issue for
acceptance
review)
19510 I Incorrect Payee Role shown for 119 No Fault in Closed - no Fault.
carded casual Agent Transaction. Product. (Issue for
acceptance
review)
19511 I Timing of the don’t complete Various No Fault in Closed - no Fault.
encashment prompt. Product. (Issue for
acceptance
review)
19616 I Casual Agent flag not set on Various No Fault in Closed - no Fault.
encashment details for carded casual Product. (Issue for
agent encashment. acceptance
review)
19655 I Encashment Tab 3 shown during an Various No Fault in Closed - no Fault.
encashment displays inconsistent Product. (Issue for
details. acceptance
review)
19668 I Carded Casual Agent encashment on I 119 No Fault in Closed - no Fault.
behalf of an appointee shows an Product. (Issue for
incorrect role for the encashment. acceptance
review)
19669 I The stop event for a card showed up Observation I 724/1 Fix For Live Trial
on the old and new cards as opposed
to just showing for the old card.
19735 I Declaration on Welsh Receipts is 99 Observation I 770/1 KPR
overwritten when large amount of
payments encashed.
19930 I Message shown when a Help Desk 97 Observation I 770/1 Closed - Fix
foreign override is performed is Made and Re-
incorrectly positioned. Tested.
19942 _I The incorrect event was shown at the_I 76 Observation _I 732/: Fix For Live
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 40 of 45
ICL Pathway
BIT Regression Test Report NR2
FUJ00078727
FUJ00078727
Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
Help Desk after a Temporary Token Trial.
was impounded.
19955 I The content of the receipt given to a 103 Observation I 796/1 Closed - Fix
customer when the system is unable Made and Re-
to contact the correspondence server Tested.
is possibly misleading.
19959 I The content of the receipt given toa I 79 Observation I 796/1 Closed - Fix
customer in the RPOI/GRI situation Made and Re-
is possibly incorrect. tested.
19982 I Customer collected payments as 128 Incident 904/1 Fix For Live Trial
alternative Payee without being (Low)
instructed to collect payments they
had available as main beneficiary.
12038 I Manual Receipt shown for 38 Observation I 764/1 KPR
encashment has minor misalignment
in the details displayed.
16609 I Impound receipt contains incorrect 122 No Fault in Closed - No Fault
‘NINO when system does not match Product. in Product.
the card to a currently active
customer,
17368 I Prompts for a 2™ Foreign Various No Fault in Closed - No Fault
Encashment are potentially incorrect., Product. in Product.
17699 I Carded Casual Agent Transaction 100,110 Incident 7641 & KPR
receipts do not show details for the (Low) 908/1
casual agent.
17671 Alternative payee receipts include Various Observation I 764/1 Closed ~ No Fault
details of the main beneficiary. in Product.
17672 I Inconsistency in the name format Various Observation I 764/1 KPR
used between counter and HD
receipts.
17956 I Counter does not always correctly 52 Incident 858/1 KPR
prompt the clerk that a foreign (Low)
encashment is being performed.
18550 I Missing re-order card promptat the I 66 NIA NIA KPR
Help Desk after DSS call completed. Outside the scope
of BPS
acceptance
criteria.
18961 I When a customer presents an expired I 2,76,82 Observation I 759/1 & KPR
Temporary Token the clerk is not 840/1
informed that the token has expired.
19012 I Card impound receipts produced by 94/122 Observation I 874/1 KPR
different transaction at the counter
show inconsistent details
19043 I Some receipts automatically print at 92,76,13 N/A N/A KPR
the counter and some receipts require Outside scope of
the clerk to invoke the print option. BPS Acceptance.
19068 I Some of the counter receipts do not 95,122 Observation I 874/1 KPR
have manual view options available
for when the printer fails and a
manual receipt has to be produced.
19179 I When a customer performs a third 41 Incident 770/1 KPR
foreign encashment they are not told (Low)
of the reason why no payments are
due.
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 41 of 45
ICL Pathway
BIT Regression Test Report NR2
FUJ00078727
FUJ00078727
Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
19503 I Some Appointee encashments are 132 Incident 767/1 Closed - Fixed
being wrongly recorded as foreign (Medium) made and re-
encashments. tested.
18670 I Invalid mode appears when tab 143 Observation I 713/1 KPR
appears when swiping cards on the
renewal option.
21908 I When a stopped TT is presented ai__I Various Incident 87471 Closed - Fix
the counter it is not prompted to be (Low) Made and Re-
impounded. tested.
21153 I Occasionally a counter error message I Various NIA NIA Monitor for re-
is occurring during BES transactions occurrence in
that causes the desktop to have to be next regression
re-started. cycle.
21921 I Inacertain functional circumstance a I 85 Incident 934/2 Closed — Fix
customer ends up not being asked (Low) Made and Re-
EVP during card activation. Tested.
19003 I During Carded Casual Agent 10 Incident 874/1 Closed - Fix
transaction if one card is stopped (Low) Made and Re-
then both cards end up being Tested.
impounded.
19044 I Token ID not rejected during carded I 10 Observation I 759/1 KPR
casual agent transaction although no
payments could be collected.
14328 I Milk token amount in the wrong 56, 105,123 Observation I 764/1 Closed ~ No Fault
place on a receipt. in Product.
17280 I Unactivated card presented at NPO is I 137 Observation I 874/1 KPR
impounded.
22026 I Manual counter receipt differs 38 Observation I 764/1 KPR
slightly to printed receipt.
21282 I Help prompt for due date box on 30 Observation I 797/4 Closed - Fix
contingency screen incorrect. made and re-
tested.
22113 I Mistakes on Bilingual impound 76 Observation I 874/1 KPR
receipts.
22126 I Bilingual impound receipts contain 76 Observation I 874/1 KPR
spelling mistake of ‘Derbynneb’.
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 42 of 45
ICL Pathway
BIT Regression Test Report NR2
FUJ00078727
FUJ00078727
Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
Appendix E
PinICLs raised during BIT Regression Pass, whilst executing Audit scenarios
PinICL statuses shown are as at: 06/04/99
PinICL Description Scenario(s) Incident / Accept. Ref I Status
PINCL found I Observation
against. recorded.
PC22667 I CAPS Gatherer is renaming files 202,205,216, I Observation I 816/1 Closed — Fix
incorrectly. 217, 21, Made and Re-
222 Tested.
PC22889 I The TMS Acrhive files are being 210,230 Observation I 816/1 Fix For Live
renamed incorrectly on the archive Trial
server.
PC22898 I The archive file for Help Desk calls I 209 Observation I 699/2 KPR
(PASCAR) contains duplicate data.
PC22423 I Audit Workstation couldn’t write to I 210,223,230 I N/A N/A Closed —- No
CD over the network. Fault in
Product.
Outside scope
of Acceptance.
PC22543 I Files hoarded on separate days 217, 230 Observation I 816/1 Closed — Fix
although processed by the hoarder at Made and Re-
the same time. Tested.
PC22287 I The Horizon Help Desk files are 233 Observation I 816/1 Closed — Fix
being renamed incorrectly by the Made and Re-
HHD Gatherer. Tested.
PC22366 I OBCS error message was misleading I 223 NA N/A Closed - Fix
Made and Re-
Tested.
Outside scope
of Audit
Acceptance.
PC22270 I HHD_AUDIT failed - cannot 218, 233 N/A N/A Closed - Fix
connect to share. made and re-
tested.
Outside scope
of Acceptance.
PC22286 I Certain hoarded files not visible at Observation I 816/1, Closed - Fix
Workstation. 942/10 made and re-
tested,
PC22367 I Utility to rebuild message store on 210,230 Observation I 942/3,942/8 I Closed - Fix
the audit server did not function Made (Build).
correctly.
PC22553 I No archive file was produced on. 202 Incident 699/2,942/7 Closed —
12/02/2000 for (Low) Consolidated
TMS_RX_PAYMENT_STOPS with PC22908
(PASTRS).
PC22370 I Archived Message store contained 210,230 Incident 942/3 Closed - Fix
out of sequence and duplicated (Low) made and re-
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 43 of 45
ICL Pathway
BIT Regression Test Report NR2
FUJ00078727
FUJ00078727
Ref: VI/REP/162
Version: 1.0
Date: 06/04/99
message store entries. tested.
PC22368 I Register entry for utility 210,230 Observation I 816/1,942/3 I Closed - Fix
Agent_Load_Audit_Data not set Made (Build).
correctly.
PC22812 I Restore_Audit_Data should process I 210,230 Incident 942/11, Closed - Fix
all retrieved message store files it is (Low) 942/3 made and re-
only processing the first file. tested.
PC22292 I TDLR Gatherer is renaming 216,230 Observation I 816/1 Fix For Live
Temporary Token exception Trial
Archive files incorrectly.
PC22293 I The TIP Gatherer is renaming 219,230 Observation I 816/1 Closed - Fix
archive files incorrectly. made and re-
tested.
PC22374 I The Tivoli Gatherer is renaming 230 Observation I 816/1 Fix For Live
files incorrectly. Trial
PC23029 I Access rights to the BES reports for I 231 Incident 816/1 Closed — As per
the standard POCL auditor function (Low) specification.
are possibly incorrect.
PC22295 I The DLR Gatherer is renaming files I 205,216,230 I Observation I 816/1 Fix For Live
incorrectly. Trial
PC22356 I The HAPS Gatherer is renaming 230 Observation I 816/1 Closed - Fix
files incorrectly. Made & Re-
Tested.
PC22756 I OBCS table 223 Incident 942/7, 816/1 I Closed - Fix
TMS_TX_LOCAL_STOPS archive (Low) Made & Re-
file is not being produced. Tested.
PC22294 I The RAMIL Gatherer is renaming 205 Observation I 816/ Closed — Fix
files incorrectly. Made & Re-
Tested.
PC23007 I Emergency auditor has access to the I 232 N/A N/A Closed - No
training and admin functions when Fault in
first logged in, Product.
PC23031 I Standard POCL auditor does not 231 Incident 816/1 Closed — As per
have access to user roles for post (Low) specification
office staff. Emergency auditor has
access but the method of retrieving
this information is long winded.
PC23117 I Archived TIP files have incorrect 230 Incident 816/1 KPR
extension on the audit server. (Low)
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 44 of 45
FUJ00078727
FUJ00078727
ICL Pathway BIT Regression Test Report NR2 Ref. VI/REP/162
Version: 1.0
Date: 06/04/99
Outstanding PinICLs (raised during previous testing), that were encountered during
the execution of the Audit acceptance scenarios during the BIT Regression Cycle:
PinICL statuses shown are as at: 06/04/99
PinICL Description Scenario(s) Incident / Accept. Status
PINCL found Observation I Ref
against. recorded.
PC18983_ I PASCMS and OBCS Audit Files 202,203,204,205 I Observation I 816/1 Closed - Fix
are not adhering to Naming 207,215,216 Made & Re-
Standards. Tested.
PC20521 I OBCS Exception files are not being I 223 Incident 699/2 Fix For Live
moved from load_area to (Low) Trial
ARC_FOUT.
PC21813 I Process SUPC311 missing from 208 (Scenario N/A N/A Closed — No
maestro schedule. amended as Fault In
purging of Help Product.
Desk notes not
part of R2
solution)
COMMERCIAL IN CONFIDENCE
© 1998 ICL Pathway Ltd
Page 45 of 45