From:
Subject:
Date:
Inline-Images:
: Newsome Pete +_
WBONO001136
WBON0001136
"Bansal Steve (BRAOI
I "Defence Legal (Chris Jay)"
RE: PRIVATE & CONFIDENTIAL - SUBJECT TO PRIVILEGE - Quick query - Bond
Dickinson KELs Question
Thu, 29 Jun 2017 07:10:38 +0000
image001.gif; image009. gif; image011.gif; image013.gif; image015.png; image017. gif;
image019.jpg; image021.jpg; image022.jpg; image023.jpg; image024.jpg; image025 jpg;
image026.jpg; image027.jpg; image028.jpg; image029.jpg; image030.jpg; image031 jpg;
image032.jpg; image033.jpg; image034.jpg; image035.jpg; image036.png;
image037.png; image038.jpg; image039.jpg; image040.png; image041.png;
image042.jpg; image043.jpg; image044 jpg; image045.jpg; image046.jpg; image047.jpg;
image048 jpg; image049.jpg; image050.png; image051.png; image052.jpg:
image002.png; image008.png; image003.png; image004.png; image005.png;
image006.png; image007.png; image053.png; image054.png; image056.jpg
Hi
We have circa 3500 KEL’s relative to POA, the following is based on the current Master KEL workbook,
posted on POA SharePoint.
During 2017 an average of 16 KEL’s per week continue to be reviewed. Typical examples of KEL’s
reviewed, updated and approved by the forum recently are illustrated below.
In the first, although these alerts are defined as not presently being seen by SMC, appropriate action steps are
now in place so as should incidents reoccur during a Blade server reboot event.
The second example details a KEL that was incomplete due to lack of assigned priorities . The update (v.2) is
now approved and live ensuring that a P1 call with voicing is raised with Unix. Terminology within all
KEL’s is also verified as being current relative to contractual changed.
KEL Ref:
Version
Criteria for review
Comments
JonnalagaddaN3649Q
3
No Incident Priority assigned. Currently such
alerts are not occurring.
SSC : Possible rewording:
1. Ifa single occurrence of this alert,
SMC can Safely ignore this event.
2. If SMC observe >3 events with in a 10-
minute period, pass a PS call over to Unix
(no need to voice Unix).
3. If the event keeps recurring (as in this,
case, when there was a constant stream of
events generated), then raise a P! call and
pass to Unix - contact Unix ASAP (both in
& out of hours).
SMC to amend accordingly.
maxwellg3554M
Priority not assigned and need to discuss on
SMC action
SSC: This is the loading of the
replenishment files. P1 with voicing to
UNIX. They will probably know already
as there must be an underlying issue with
the BRDB database. - SMC
ISD —amend to POA
WBD_001006.000001
WBONO001136
WBON0001136
da
Blade piXXpbfXXX/cX non-sensor event
Blade pi1 9pbf007/c1 non-sensor event, eventDate = Sat Nov 06 03:11:46 GMT 2010, Hardware NonFatal, errortype=Correctable DRAM ECC
Error, errorcode=0x01, diagdata=0x8a620000e57¢1000
Symptoms
Server Name :~ LPRPPANOO7
Date Stamp :- 06/11/2010 3:10:46
Event Text :- cBlade pit9pbF007/c1 non-sensor event, eventDate = Sat Nov 06 03:11:46 GMT 2010, Hardware NonFatal, errrtype=Correctable DRAM ECC Error, errorcode=0x01,
diagdata-0x8620000657¢ 1000 Configuration Item: Unable to resolve Server LPRPPANOO7
Problem
Blade Rebooted
Solution
rea sl
oy
SSCS SOE CC
3. If the event keeps recurting (as in this case, when there was @ constant stream of events generated), then raise # PA call and pass to Unix - contact Unix ASAP (both in & out of
hours).
‘As per TFS#4913429
Please folow KEL JonnalagadidaNSO2iK for PIM ( Power In Module ) events.
WBD_001006.000002
WBONO001136
WBON0001136
LFS_RDC.BRDBCO08_CHECK_RDC_FROM_LFS1 Abend
LFS_RDC.BRDBCO08_CHECK_RDC_FROM_LFS1 Abend - error BRDBCOOS reports nnn successes from 128 Fad Hashes
Symptoms
TWS job log content:
= 308 + M_DB_SRV#LFS_RDC130150[(1301 06/27/10), (LES_RDC130150) ] .BRDBCOOB_CHECK_RDC_FROM_LFS1
= USER bEdbbivi
= SCLFILE : $BRDB_PROC/BRDBCOOS BRDB_RDC_FROM LFS 20100627
Job Number: 9026
‘Sun 27/06/10 14:34:52 BST
Sun 27-Jun-2010
sun 27-Jun-2010
Sun 27-Jun-2010
Sun 27-Jun-2010
Sun 27-Jun-2010
Sun 27-Jun-2010
Sun 27-Jun-2010
sun 27-Jun-2010
sun 27-Jun-2010
sun 27-Jun-2010
sun 27-Jun-2010
Sun 27-Jun-2010
Sun 27-Jun-2010
Sun 27-Jun-2010 14:34:
AWSBIS3081 End of job
Debug Level for module BRDBCO0S is set to <0>
Fad Hash 3 not run
Fad Hash 11 not run
Fad Hash 27 not run
Fad Hash 35 not run
Fad Hash 51 not run
Fad Hash 59 not run
Fad Hash 75 not run
Fad Hash 83 not run
Fad Hash 99 not
Fad Hash 107 not
Fad Hash 123 not run
117 successes from 128 Fad Hashes
Process Failed
FY
2
1
1
1
1
1
FY
1
FY run
1 run
Ft
1
1
Exit status
system Time (Seconds)
= User Time (Seconds)
Blapsed Time (minutes) : 0
Thursday 2:
WBD_001006.000003
WBONO001136
WBONO0001136
Problem
The Fad Hash check faire incomplete processing ofall fad hashes for the stream,
The sequence of events (TWS jobs) which led to this:
LUFS_ROC. BRDBXOO3_ROC_FROM_LFS_1 completed successful
LLFS_ROC.BRDXO03_RDC_FROM_LFS_2 abended - BRDB node not avaiable
[LFS_ROC. BRDBXOO3_RDC_FROM_LFS_3 abended - BRDB node not avaiable
[LFS_ROC. BRDXOO3_RDC_FROM_LFS_4 abended - BRDB node not avaiable
2,34 were retried with success.
[BRED node 4 failed, which prompted an auto-renun.
[UFS_RDC. BRDBKOO3_RDC_FROM_LFS_1_RERUN completed successfully
UFS_ROC. RUN abended - BROB node not available
[LFS_ROC. BRDBXO03_RDC_FROM_LFS_1_RERUN abended - BRDB node not available
[UFS_ROC. BRDBXOO3_ROC_FROM_LFS_1_RERUN abended - BRDB node not available
2,3,4 were retried with success.
In summary, al jobs were eventually retried successfuly...so the fad hash check should be successful, right ?
Regards
Steve Bansal
Senior Service Delivery Manager
Business & Application Services
Post Office Account
FUJITSU
Lovelace Road, Bracknell, Berkshire. RG12 8SN
WBD_001006.000004
WBONO001136
WBON0001136
Web: uk.fujitsu.com
eo! £I¥]inIeIc-
Fujitsu named as
Responsible Business
of the Year
Fujitsu is proud to partner with Action for Children
[CIO: Global Intelligence for the CIO. Fujitsu’s online resource for ICT leaders
= Please consider the environment - do you really need to print this email?”
From: Newsome, Pete
Sent: 26 June 2017 10:43
To: Bansal, Steve (BRAO1)
Ce: Godeseth, Torstein ; Defence Legal (Chris Jay,)
Subject: PRIVATE & CONFIDENTIAL - SUBJECT TO PRIVILEGE - Quick query - Bond Dickinson
KELs Question
Steve
At the meeting we had with Post Office and their legal representatives they asked the question again on
whether we currently (understanding this is a ‘living’ document set) have any KELs on the audit store or that
are related to errors or bugs in the system that could cause imbalance in sub postmasters accounts.
Thanks
Pete
Pete Newsome
Account Manager
Post Office Account, Fujitsu UK&I
Tel:
E-Mail:
Web: http://uk.fujtsu.com
Web: uk.fujitsu.com
* Fujitsu named as
Responsible Business
of the Year
Fujitsu is proud to partner with Action for
WBD_001006.000005
/-C1O: Global Intelligence for the CIO. Fujitsu’s online resource for ICT leaders
Sponsors of the 2015 Rugby World Cup
= Please consider the environment - do you really need to print this email?”
From: Bansal, Steve (BRAO1)
Sent: Tuesday, November 1, 2016 11:53 AM
To: Newsome, Pete <7
i GRO i
Ce: Harvey, Michael < GRO
Subject: RE: Quick query - Bond Dickinson KELs Question
} Thompson, Peter
WBONO001136
WBON0001136
I can arrange this, would this forum like to review the KEL’s or should I forward to Pete to distribute?
Regards
Steve Bansal
Senior Service Delivery Manager
Business & Application Services
Post Office Account
FUJITSU
Lovelace Road, Bracknell, Berkshire. RG12 8SN
Fujitsu named as
Responsible Business
of the Year
Fujitsu is proud to partner with Action for Children
I-CIO: Global Intelligence for the CIO. Fujitsu’s online resource for ICT leaders
= Please consider the environment - do you really need to print this email?
From: Newsome, Pete
Sent: 01 November 2016 11:08
To: Thompson, Peter} GRO
C GRO a
Gel Harvey, Micha < GRO f
Subject: FW: Quick query - Bond Dickinson KELs Gistion
Pete and Steve
’ Bansal, Steve (BRAO1)
WBD_001006.000006
WBONO001136
WBON0001136
T assume we can pull a few KELs as examples as asked for below?
Pete
Pete Newsome
Business Change Manager
Post Office Account, Fujitsu UK&I
Web: http://uk.fujitsu.com
b: uk fujitsu.com
OnOMe
Fujitsu named as
Responsible Business
of the Year
Fujitsu is proud to partner with A Children
/-C1O: Global Intelligence for the CIO. Fujitsu’s online resource for ICT leaders
Sponsors of the 2015 Rugby World Cup
= Please consider the environment - do you really need to print this email?”
From: Loraine, Paul Imnailts GRO
Sent: 31 October 20
To: Newsome, Pete:
arsons, Andre’
ic Williams
Subject: FW: Quick query
Hi Pete
By way of an introduction, I am a colleague of Andy Parsons at Bond Dickinson.
With apologies for bringing this issue up again, we need to revisit the Known Error Log point and I’m currently looking to draft a
short description of what the KEL is / its scope etc. In addition to your helpful notes below, we wondered whether you might be
able to provide us with a few example KELs (5 or so), just from the top of the pile? Is this feasible / easily done?
Thanks
Paul
From: Parsons, Andrew
Sent: 23/09/2016 10:
To: pete.newsome(”
WBD_001006.000007
WBONO001136
WBON0001136
Ce: Rodric Williams { GRO ); Prime, Amy; Michael.Harvey:
Subject: RE: Quick query
Thanks Pete ~ much appreciated,
A
Paul Loraine
Solicitor
Bond Dickinson LLP
www.bonddickinson.com
From: pete.newsome! ___ GRO -
Sent: 23 September 2016 10:26
To: Parsons, Andrew
Ce: Rodrie Williams
Subject: RE: Quick query [BD-4A.FID26896945]
; Prime, Amy; Michael. Harveys
Andrew
We have checked all the KELs (takes time as they have free text included) and have found there are no KELs
that directly affect the normal operation of the Core Audit Process.
Pete
Pete Newsome
Business Change Manager
Post Office Account, Fujitsu UK&I
E-Mail: I GRO
Web: hirp//uk.fujtsu.com
Fujitsu named as
Responsible Business
of the Year
Fujitsu is proud to partner with Action for Children
WBD_001006.000008
WBONO001136
WBONO001136
L-CIO: Global Intelligence for the CIO. Fujitsu’s online resource for ICT leaders
Sponsors of the 2015 Rugby World Cup
= Please consider the environment - do you really need to print this email?”
From: Parsons, Andrew [mailt i
Sent: 21 September 2016 13:40
To: Newsome, Pete! GRO 7
Ce: Rodric Williams I _. . GRO } Prime, Amy
i GRO 5 Harvey, Michael <__ GRO
Subject: RE: Quick query [BD-4A.FID26896945]
Pete
Thanks. Very useful.
Noted on the theme of questions ~— unfortunately these are not always under are control as these are questions being put by Freeths,
the postmasters' solicitors.
That said, are you 100% sure that there are no KELs in respect of the Core Audit Log? If so, we may say this to Freeths so to try to
avoid having to disclose the KELs.
Thanks
‘Andy
Andrew Parsons
Partner
Bond Dickinson LLP
www.bondd
From: pete.newsomet GRO
Sent: 21 September 2016 12:36
To: Parsons, Andrew
Ce: Rodrie William:
Subject: RE: Quick query [BD-4A-FID26896945]
; Prime, Amy; Michael. Harvey(
Andrew
As requested, please find below our answers to the 6 questions posed.
We would, however, like to first point out our concern regarding the underlying, erroneous, theme that these questions (and the
previous questions we've provided answers to you on) seem to be driving at. At the risk of sounding like a “broken record”, the
key premise of the HNG-X (and Horizon) system is the Core Audit Log. This comprises the only source of the “truth”. And to our
knowledge there has been no identified issues with the Core Audit Log and there are no KELs in respect of this log. To this end,
the questions regarding the existence or otherwise of issues with other elements of the system are, in our opinion, a distraction to
the key premise and could be used to create an erroneous view of HNG-X / Horizon. It is our view that a strong rebuttal is required
and a shift of focus from a view that we should somehow constantly need to “prove the negative” to a focus on the fact that the
Core Audit Log provides a true source of the data entered and transactions performed at the relevant terminals. Any subsequent
WBD_001006.000009
WBONO001136
WBON0001136
use of said data by the system does not impact on this “truth” and as such we often determine the existence or otherwise of errors
by reference to the Core Audit Log.
The answers (highlighted in yellow) to your questions are:
What format do these logs take and where are they held? The logs (referred to as the Known Error Log or “KEL”) are held on a
What level of detail is included within the logs (i.e. are they generic logs for all Horizon errors or linked to specific branches, do the
logs explain the consequences of the error and the fix which was applied, etc.)?
When did Fujitsu begin to maintain these logs and are they still maintained? ramen sae
Are the logs capable of being extracted and provided to us? Yes via excel data extract
Have Post Office previously been provided with a copy of these and, if so, to whom and when? We don’t believe Post Office has
ever asked for this before but it is available if required.
Has there been any correspondence between Post Office and Fujitsu concerning these logs? I suspect loads— but it would be good to
just understand in high level terms how they are used.
Hope this helps
Pete
Pete Newsome
Business Change Manager
Post Office Account, Fujitsu UK&I
Web: hhttp://uk.fujitsu.com
Web: uk.fujitsu.com
Fujitsu named as
Responsible Business
of the Year
Fujitsu is proud to partner with Action for Children
I-CIO: Global Intelligence for the CIO. Fujitsu’s online resource for ICT leaders
WBD_001006.000010
WBONO001136
WBON0001136
Sponsors of the 2015 Rugby World Cup
= Please consider the environment - do you really need to print this email?
From: Newsome, Pete
Sent: 19 September 2016 13:57
To: 'Parsons, Andrew! _ GRO _
Ce: Rodric Williams:
q “GRO
Subject: RE: Quick query [BD-4A.FID26896945]
Prime, Amy
Andrew
Will check with colleagues and get back with an update.
Regards
Pete
Pete Newsome
Business Change Manager
Post Office Account, Fujitsu UK&I
E-Mai
Web: hhttp://uk.fujitsu.com
‘Web: uk.fujitsucom
Fujitsu named as
Responsible Business
of the Year
Fujitsu is proud to partner with Action for Children
I-ClO: Global Intelligence for the CIO. Fujitsu's online resource for ICT leaders
Sponsors of the 2015 Rugby World Cup
= Please consider the environment - do you really need to print this email?
From: Parsons, Andrew [mailto! GRO
Sent: 19 September
“GRO “ Prime, Amy
WBD_001006.000011
WBONO001136
WBON0001136
Pete
Hope you're well. Would you mind hoping with what is hopefully a quick query?
The solicitors for the postmasters have asked us to provide them with a copy of the 'known error logs' kept by Fujitsu and all
correspondence between Fujitsu and Post Office relating to the same. So we can respond to this request it would be appreciated if
you could confirm whether a Horizon "known error log" or a similar documents exist. We've not decided yet on whether to provide
this information (and so don't need any documents from you at this stage) — we're just trying to scope out what might be covered
by the request.
We would appreciate if you could help with the following:
What format do these logs take and where are they held?
What level of detail is included within the logs (i.e. are they generic logs for all Horizon errors or linked to specific branches, do the
logs explain the consequences of the error and the fix which was applied, etc)?
When did Fujitsu begin to maintain these logs and are they still maintained?
Are the logs capable of being extracted and provided to us?
Have Post Office previously been provided with a copy of these and, if so, to whom and when?
Has there been any correspondence between Post Office and Fujitsu concerning these logs? I suspect loads — but it would be good to
just understand in high level terms how they are used.
I'm hoping that this questions are fairly easy to address but if they do need more careful thought, please let me know and we can
discuss how to tackle them.
If possible, a response by close of business on Wednesday would be useful.
Kind regards
‘Andy
Andrew Parsons
Partner
Bond Dickinson LLP
www.bonddickinson.com
Please consider the environment! Do you need to print this email?
ly privileged and protected by law. petenewsomef ly is authorised to
T please notify andrew.parsons( is Soon as possible and delete any
communication or attachments is prohibited and may be unlawful,
The information in this e-mail and any attachments is confidential and may be le
access this e-mail and any attachments. If you are not petenewsomef”
copies. Unauthorised use, dissemination, distribution, publication or 6
ached to this e-mail will have been ch
ige which may be caused by software viruses
ced by us with virus detection software before transmission, Bond Dickinson LLP accepts no liability for any loss or
id you should carry out your own virus checks before opening any attachment.
Content of this email which does not relate to the official business of Bond Dickinson LLP, is neither given nor endorsed by it.
This email is sent by Bond Dickinson LLP which is a limited liability partnership registered in E
London Riverside, London, SE1 2AU, where a list of members’ names is open to inspection. We
consultant who is of equivalent standing. Our VAT registration number is GB123393627.
nd and Wales under number 0C317661. Our registered office is 4 More
e the term partner to refer to a member of the LLP, or an employee or
WBD_001006.000012
WBONO001136
WBON0001136
Bond Dickinson LLP is authorised and regulated by the Solicitors Regulation Authority.
Unless otherwise stated, this email has been sent from Fujitsu Services Limited (registered in England No
96056); Fujitsu EMEA PLC (registered in England No 2216100) both with registered offices at: 22 Baker
Street, London W1U 3BW; PFU (EMEA) Limited, (registered in England No 1578652) and Fujitsu
Laboratories of Europe Limited (registered in England No. 4153469) both with registered offices at: Hayes
Park Central, Hayes End Road, Hayes, Middlesex, UB4 8FE.
This email is only for the use of its intended recipient. Its contents are subject to a duty of confidence and
may be privileged. Fujitsu does not guarantee that this email has not been intercepted and amended or that it
is virus-free.
Unless otherwise stated, this email has been sent from Fujitsu Services Limited (registered in England No
96056); Fujitsu EMEA PLC (registered in England No 2216100) both with registered offices at: 22 Baker
Street, London W1U 3BW; PFU (EMEA) Limited, (registered in England No 1578652) and Fujitsu
Laboratories of Europe Limited (registered in England No. 4153469) both with registered offices at: Hayes
Park Central, Hayes End Road, Hayes, Middlesex, UB4 8FE.
This email is only for the use of its intended recipient. Its contents are subject to a duty of confidence and
may be privileged. Fujitsu does not guarantee that this email has not been intercepted and amended or that it
is virus-free.
Andrew Parsons
Partner
Bond Dickinson LLP
www.bonddi
WBD_001006.000013