Model Office Testing Progress Report Final Pass
Progress Report for Model Office Testing - Day 14
Tuesday 02"¢ March 1999
Management Summary
¢ A potential workaround to a number of the BES issues raised previously
has been identified. Practicality and implementation of this solution is up
for debate
e A number of EPOSS issues have been identified, the most serious of which
allowed production of a Cash Account with revaluation errors.
e All testing activity complete to schedule
Overall status of MOT testing: I GREEN
The management summary status indicators are defined as follows;
Green No major issues which require escalation outside of the testing arena
Amber _ Testing have serious concerns over quality
Red Major system difficulties have prevented progress
Planned ‘Key’ Counter Activity
¢ Second day of contingency payments due to temporary closure of Celtic.
The count of foreign encashments is not expected to be incremented
during this period.
e Manual ‘Final’ Cash Account to be produced at Omagh to simulate an
outlet changing ownership.
Actual ‘Key’ Counter Activity
e A pattern seems to be emerging that may account for a number of the BES
issues identified during MOT. Some examples of these issues are;
e Erratic results when attempting Carded Casual Agent encashments
¢ Inability to perform foreign encashments during the hybrid period
between counter and data centre migration
¢ Inconsistent results when applying Geographical Restrictions (i.e.
encashing a GB -only payment ata Northern Ireland outlet)
e The incorrect application of a 30 minute lock-out when attempting
nominated office encashment
After preliminary investigation, all of these issues seem to be because we
are attempting to encash payments generated on a Release 1c data centre
at a Release 2 outlet. The inconsistent results can be explained by the fact
that a stop and reissue of a Rel 1c payment once the data centre has
migrated to Rel 2 effectively cures all of the above issues. A possible
solution for Live Trial may be to enforce a stop and reissue of all payments
once the data centre has migrated. Although some problems will still be
c:\testing\ mot\ reports\ mo990302.doc [ DATE ] Page 1 of 5
FUJ00078616
FUJ00078616
Model Office Testing Progress Report Final Pass
encountered during the four week hybrid period, when the counter has
migrated but the data centre is still at Rel 1c, the impact of the above issues
could be reduced significantly.
The Cash Account at Arsenal was produced successfully, however a
worrying issue has been identified. All Stock Units were balanced
successfully and rolled to the next CAP. The cash account produced
subsequently misbalanced by 4p. Investigation found this to be an error in
the postal order revaluation performed on day 13. This should not have
happened, as the system validates the postal order revaluation process
before a Stock Unit balance and rollover can occur. This is a late breaking
issue, so further investigation is underway, and the incident will be
detailed on the day 15 report.
All other AP, BES, EPOSS and OBCS activity completed without major
incident
Overnight Processing
Overnight processes ran without incident
Planned Interface Activity
TIP - Transaction files from Pathway
CAPS - Change of Circs., Payment, Batch Stop files and Automatic card
requests from CAPS to Pathway. Encashments and card request
confirmations from Pathway to CAPS.
OBCS - transaction files delivered from Pathway for all outlets (except
Omagh)
POCL RDP - None planned
HAPS - transactions polled from existing legacy equipment and Horizon
APS
Actual Interface Activity
TIP - All transaction files have been received at TIP, with the exception of
the following;
e Transactions for Wolves were expected but not received
e End of day markers for Celtic, which were expected although the
outlet was marked as temporarily closed, were not received.
¢ The outstanding BES encashments from the non-automated outlet were
received, but an issue was identified with the population of the value
field of voided encashments. Investigation is underway
e Resent transaction files of the invalid item id are still outstanding
POCL RDP - An additional change drop was sent to amend the Cash
Account status of Wolves from ‘London’ to ‘Provincial’
CAPS - All Online and Batch activity completed on schedule.
Reconciliation with PACS is ongoing.
OBCS - All transactions received as expected for day 13.
HAPS - HAPS confirmed that Day 13 transaction files were received.
Reconciliation is underway
c:\testing\ mot\ reports\ mo990302.doc [ DATE ] Page 2 of 5
FUJ00078616
FUJ00078616
FUJ00078616
FUJ00078616
Model Office Testing Progress Report Final Pass
Test Metrics
Test Conditions for day Test Conditions for the Cycle
Conditions Passed 912 Conditions Passed 5731
Conditions Failed 2 Conditions Failed 53
Conditions Not Run 3 Conditions Not Run 97
Total 917 Total 5881
Test conditions failed were due to;
¢ a known issue with the encashment count not incrementing during the
hybrid migration period
Test conditions not run were due to;
e the OBCS service is not available at the Northern Ireland outlet
Incidents Retested
Horizon Incident re-tests are derived from those outstanding at the
conclusion of Model Office Rehearsal Cycle 3 and the two preproval test
phases. Results of the retests of Incidents raised by TIP during previous
MOR’s are also included;
TIP Incidents
High I Medium I Low I Closed I Total
e Re-tests planned in cycle 0 13 9 1 23
e Re-tests closed 2 9 1 12
e Re-tests Outstanding 0 11 0 0 11
Horizon Incidents
High I Medium Low _I Total
e Re-tests planned in cycle 5 49 43 97
e Re-tests failed (and now raised 3 4 7
as new incidents)
e Incidents not covered in plan 1 7 2 10
e Incidents closed 2 19 28 49
¢ Incidents pending investigation 1 2 0 3
e Outstanding Re-tests 1 18 9 28
Total 5 49 43 97
Details of new incidents resulting from the retesting exercise;
c:\testing\ mot\ reports\ mo990302.doc [ DATE ] Page 3 of 5
Model Office Testing Progress Report Final Pass
Existing PinICL I Description of Incident New Helpdesk Ref.
PC20537 Event shows unexpected ‘Rollover Abandoned’ event _ I E-9902250112
PC20564 Inconsistencies between transaction ID on Customer I E-9903020101
Receipt and Transaction Log
PC20613 Office daily Rem Out report shows pre-migration E-9902180098
transactions in BP02
PC20280 Inconsistencies between Nil Girobank deposits and E-9902240180
withdrawal summaries
PC20188 “€ displayed as ‘# on a number of reports E-9903020104
PC20303 Recovered BES encashment displayed on daily but not I E-9902180128
weekly recovered transaction report
Tto follow...
Re-tests planned for tomorrow.
High: 0 Medium: 1 Low: 3
Incidents Raised Today
High 0
Medium 4
Low 7
*These categories are an initial testing impact, and are subject to Product
Management confirmation
Further details are available on the Incidents Report which is sent as an
appendix under separate cover.
Summary status of new Horizon incidents
High I Medium I Low I Total
Raised during MOT* 0 73 97 170
New Incidents Closed 16 49 65
Outstanding new incidents 0 57 48 105
*Nine incidents were duplicated on the incident log
e day 9, in error. They have been removed from the
Summary of the above
Closed :
¢ Operation/Set-up problem 3 2 5
e Fixed for Live Trial 4 11 15
¢ No fault 2 13 15
e Procedural Change 1 19 20
¢ Duplicate of existing call 4 4 8
e KPR Issue 2 0 2
Under Investigation with :
e Pathway 57 47 104
¢ Horizon
¢ Outlet Systems Group 1 1
0 73 97 170
c:\testing\ mot\ reports\ mo990302.doc [ DATE ]
Page 4 of 5
FUJ00078616
FUJ00078616
FUJ00078616
FUJ00078616
Model Office Testing Progress Report Final Pass
c:\testing\ mot\ reports\ mo990302.doc [ DATE ] Page 5 of 5