Deen

@Trevor Tinsley Below is the RCA for last weeks outage: "At 16:26 BST on 14th June our monitoring systems detected a loss of connectivity to one of our datacentres (MDH - Maidenhead). This was a temporary loss of communication between the firewalls brought about by a temporary loss of power to a switch during routine maintenance. The power outage should not have caused any issues, but on this occasion, all remaining firewalls incorrectly took on master status. Steps were taken to resolve the issue by demoting secondary firewalls and this was completed at 16:42. The total impacted time was 16 minutes.A planned update to the firewalls which includes changes to mitigate this situation is already in place and will be scheduled over the coming months.The chance of the error occurring again is extremely low and we apologise for the inconvenience this will have caused."

@Adrian Simpkins @Daniel Good to hear you are back up and running.

Further changes have been made to correct the problem, if anyone still affected can flush their browser cache please and let me know if the problems persist.

Unfortunately although the patch did correct one of the issues there were further issues discovered here that needed to be addressed. Therefore a fix is being rolled out now and should be deployed to all shortly.

All, the patch has now been deployed, let me know if any of the problems persist. If you do continue to see issues be sure to flush your browser cache before trying again.

A patch is now in the process of being deployed to all instances. I will post confirmation once this has been completed.

All, we are aware of the issue and are currently working on a fix. I will have a further update for you shortly.

@Trevor Tinsley I will have that for you shortly and will let you know here when it is ready.

@Adam Toms I should have an RCA early tomorrow for you.

The issue should now be corrected. Please accept our apologies and let us know if any issues persist.

@Izu Normally this utility is used for wiping a new system of demo\test data before a go live. I'm not sure there is any documented backup method as such and running the tool results in permanent data deletion. There is a dry run option you can use with the utility though if you want to test it out before committing to a live run. If you want a backup though that would likely need to go via the Cloud team.

@Adrian Simpkins Looks like a refresh issue of sorts, does hitting the refresh button clear the notification?

This issue was caused by blank email templates, deleting any blank templates from the below location in the admin view should correct the problem.

@Frank Reay, From discussing this with my colleagues and looking at your setup via the passcode provided, I believe you can only search on values in the h_cmdb_assets table, h_devicename which as the name suggests stores the Device Name is taken from the h_cmdb_assets_mobile_device table which would not be searchable. It would probably require an enhancement to enable this.

@Frank Reay, thanks for this. I'm currently taking a look and will have an update for you tomorrow.

Hi @Frank Reay, Apologies for the delay in getting back to you. I've been trying to replicate this but not having much luck, if you could PM me a support passcode I can take a closer look at your setup.

The patch has now been deployed. Please let me know if anyone sees any further issues here. If the issue persists try flushing the browser cache.

All, We now have a patch for this issue, this should be deployed to all instances shortly and I will confirm when this has been done.

You could create a report using the main requests table and also h_buz_activities I believe. There is a h_actor column in the activities table which you can use to filter by technician.

@Ann I've tagged it as an enhancement, if feasible it will be considered for future releases.

@Michael Sharp It would be interesting to determine if this affects all the commonly used browsers or is limited to just one. Is everyone using Chrome for example?

@Ann Not possibly currently from what I can see but would make for a useful enhancement.

@Alisha Don't think this would be possible with the current setup so I'll tag it as an enhancement.

@Jamie Talbot Good to hear thanks.

@Jamie Talbot Have you seen any further issues? I suspect the problem may have been specific to your ISP.