Model Office Testing Progress Report Final Pass
Progress Report for Model Office Testing - Day 15 & 16
Wednesday 03" and Thursday 04'* March 1999
Management Summary
¢ Test schedule has stabilised after migration activity
¢ A number of issues have been encountered surrounding BES. These are
under investigation, and most of them may be linked to a single
contributing factor
¢ Cash Accounts are still misbalancing, but the causes of each misbalance has
been previously identified, and was therefore expected, as no corrective
action has been applied to the software baseline or test plan
¢ All testing activity complete to schedule
Overall status of MOT testing: GREEN
The management summary status indicators are defined as follows;
Green — No major issues which require escalation outside of the testing arena
Amber _ Testing have serious concerns over quality
Red Major system difficulties have prevented progress
Planned ‘Key’ Counter Activity on day 15 & 16
¢ Stock Unit balancing at all outlets.
¢ Celtic reopens after Temporary closure
e Cash Account production at all outlets
e Planned reference data change - Amendment of product name
Actual ‘Key’ Counter Activity on day 15 & 16
e A number of issues were identified with BES;
¢ Several instances were 2 payments were expected, but only one
was available - initial Pathway investigation indicates a problem
with the PMS service - unconfirmed by CAPS/Horizon
¢ Foreign encashments being refused as ‘Unable to contact HQ’ -
Definitely due to PMS Failure - successfully retested
¢ GRI encashment restricted at counter but available via Helpdesk
¢ Collection of card generates ‘PUN presented at wrong PO’ -
possibly attributed to temporary office closure
¢ No EVP when attempting foreign encashment - again, may be due
to temporary closure
e All other AP, BES, EPOSS and OBCS activity completed without major
incident
c:\testing\ mot\ reports\mo990304.doc 05/03/99 Page 1 of 4
FUJ00078635
FUJ00078635
Model Office Testing Progress Report Final Pass
Overnight Processing
¢ Overnight processes ran without incident
Planned Interface Activity
e TIP - Transaction files from Pathway
e CAPS - Change of Circs., Payment, Batch Stop files and Automatic card
requests from CAPS to Pathway. Encashments and card request
confirmations from Pathway to CAPS.
¢ OBCS - transaction files delivered from Pathway for all outlets (except
Omagh)
¢ POCL RDP - None planned
e HAPS - transactions polled from existing legacy equipment and Horizon
APS
Actual Interface Activity
e TIP - All transaction files have been received at TIP, with the exception of
the following;
e TIP received day 14 files, which were renamed and processed
successfully. A duplicate set of files was resent on the overnight of day
15. These were all rejected as duplicates
¢ POCL RDP - No activity on day 15 or 16
e CAPS - All Online and Batch activity completed on schedule.
Reconciliation with PACS is ongoing.
¢ OBCS - All transactions received as expected for day 14 & 15. However
since day 13, each day’s transaction file has contained duplicated
information. An incident has been raised to track this.
e HAPS - HAPS confirmed that day 14 & 15 transaction files were
received. Transactions previously reported as omitted from day 14 were
successfully collected on day 15. Reconciliation of day 15 transactions is
underway.
Test Metrics
Test Conditions for days 15 & 16 Test Conditions for the Cycle
Conditions Passed 1417 Conditions Passed 7148
Conditions Failed 17 Conditions Failed 70
Conditions Not Run 6 Conditions Not 103
Run
Total 1440 Total 7321
Test conditions failed were due to;
¢ Various issues with BES identified on day 16
Test conditions not run were due to;
¢ the OBCS service is not available at the Northern Ireland outlet
c:\testing\ mot\ reports\mo990304.doc 05/03/99 Page 2 of 4
FUJ00078635
FUJ00078635
Model Office Testing Progress Report Final Pass
Incidents Retested
Horizon Incident re-tests are derived from those outstanding at the
conclusion of Model Office Rehearsal Cycle 3 and the two preproval test
phases. Results of the retests of Incidents raised by TIP during previous
MOR’s are also included;
TIP Incidents
High I Medium I Low I Closed I Total
¢ Re-tests planned in cycle 0 13 9 1 23
¢ Re-tests closed 2 9 1 12
e Re-tests Outstanding 0 11 0 0 11
Horizon Incidents
High I Medium Low I Total
¢ Re-tests planned in cycle 5 49 43 97
e Re-tests failed (and now raised 4 4 8
as new incidents)
e Incidents not covered in plan 1 7 2 10
e Incidents closed 4 24 33 61
¢ Incidents pending investigation 0 1 0 1
¢ Outstanding Re-tests 0 13 4 17
Total 5 49 43 97
Details of new incidents resulting from the retesting exercise;
Existing PinICL_I Description of Incident New Helpdesk Ref.
PC20537 Event shows unexpected ‘Rollover Abandoned’ event_I_E-9902250112
PC20564 Inconsistencies between transaction ID on Customer E-9903020101
Receipt and Transaction Log
PC20613 Office daily Rem Out report shows pre-migration E-9902180098
transactions in BP02
PC20280 Inconsistencies between Nil Girobank deposits and E-9902240180
withdrawal summaries
PC20188 ‘e’ displayed as ‘#’ on a number of reports E-9903020104
PC20303 Recovered BES encashment displayed on daily but E-9902180128
not weekly recovered transaction report
PC20674 ONCH report displays information for only one Stock I E-9902240152
Unit, when more than 1 SU declaration has been
made
PC20179 EPOSS - All cash account reports need to be printed E-9903040084
again if PCHL reconciliation screen is cancelled
Re-tests planned for tomorrow.
High: 0 Medium: 2 Low: 1
Incidents Raised on day 15 & 16
c:\testing\ mot\ reports\mo990304.doc 05/03/99 Page 3 of 4
FUJ00078635
FUJ00078635
FUJ00078635
FUJ00078635
Model Office Testing Progress Report Final Pass
High 1
Medium 15
Low 14
*These categories are an initial testing impact, and are subject to Product
Management confirmation
Further details are available on the Incidents Report which is sent as an
appendix under separate cover.
Summary status of new Horizon incidents
High I Medium I Low I Total
Raised during MOT 93 108 201
New Incidents Closed 27 57 84
Outstanding new incidents 0 66 51 117
Summary of the above
Closed :
¢ Operation/Set-up problem 4 3 7
e Fixed for Live Trial 9 11 20
¢ No fault 7 17 24
¢ Procedural Change 0 21 21
¢ Duplicate of existing call 5 5 10
¢ KPR Issue 2 0 2
Under Investigation with :
¢ Pathway 66 51 117
¢ Horizon
¢ Outlet Systems Group
1 93 108 201
c:\testing\ mot\ reports\mo990304.doc 05/03/99 Page 4 of 4