Correcting and commenting on our earlier report. This Editor had earlier published on 11 Dec, as follow up to the extensive coverage on Babylon Health’s ‘GP at hand’ pilot activity in London, summarizing a report in Digital Health stating that the North West London Collaboration of Clinical Commissioning Groups (CCG) ended plans for expanding a test of the Babylon video consult/symptom checker app for GP practices in that area and that the app could be ‘manipulated’ to secure GP appointments faster and would not reduce demands on GPs. The original article was first corrected at an NHS England‘s representative’s request to reinforce that this was a local CCG project and that NHS England was not involved. The second request we received last Friday was from Babylon Health’s PR representative, Giles Kenningham, principal at Trafalgar Strategy. It was certainly strong and quoted here, edited as indicated to remove the link to the original article and Mr. Kenningham’s signature:

Your recent article on Babylon is factually wrong and misleading (link removed):
You claim the babylon app was dropped after being manipulated by patients. The term ‘manipualtion’ has been removed from the board papers and is wrong. Similarly the planned pilot had never begun so there so nothing to roll out.
This story is based on incorrect board papers which have now been corrected.

Please find a spokesman quote below. (closing signature removed)

A spokesperson for Babylon said:

“No pilot was ever carried out, nor any agreement signed with Babylon for such a pilot.

“Discussions were held after Babylon was selected in a competitive procurement exercise as the best technology to trial in GP practices across North West London. Subsequently, a decision was taken not to fund the pilot.”

This Editor then checked on the Digital Health article and found it had been removed without any follow-up or correction. Thus on Friday 8 Dec, this Editor removed the article, thanked Mr. Kenningham for bringing it to attention, and added that our report cited Digital Health as the source. I also requested a reference or third-party confirmation of his corrections. (This last request was not received as of the time of this writing.)

Wanting to get to the bottom of this for our Readers–and as a marketer who’s corrected more than a few inaccurate reports, your Editor has located the CCG’s report which is here published 22 November. It corresponds with Mr. Kenningham’s full note. The CCG report appears to have been revised (the URL indicates a v3), there never was a Babylon pilot, this version does not use the word ‘manipulation’, and the end result was that the CCG decided not to proceed to the pilot stage. In short, it appears to this Editor that the Digital Health report was based on an earlier and incorrect version of the report (perhaps as early as 25 Oct) and we are of course happy to correct. My fault and apology to our Readers and to Babylon in that I should have located the 22 Nov revised report prior to publishing the article and essentially provided a correction to Digital Health‘s report.

However, the CCG’s report on their Babylon evaluation contains two findings that were included in Digital Health‘s now-deleted article and give some pause. The CCG used focus groups of potential users, which surfaced that, in the CCG’s words, “The focus groups had also commented that there is a risk of some people gaming the symptom checker to achieve a GP appointment. The insights gathered therefore revealed that the symptom checker in particular was unlikely to reduce demand for GP services.”

Our Editor Chrys has pointed out the Pulse article which also comments on this and was corrected for the CCG’s revised report. The comments here by practicing GPs are worth reading. Scroll down and you’ll see that  ‘gaming the system’ has happened using direct triage in practices using personal phone consults–no app required. Can this even work?

Focus groups are highly subjective, but they are great ways of surfacing the flaws that developers and companies have gone blind to.

We hope that Babylon Health does take this feedback seriously. This Editor makes no secret of her advocacy of technology that can speed the obtaining of care, but based on her experience with early-stage companies, every critique, every hole that can be kicked in a service, delivery, and logistics, exposing a weakness should be appreciated–and ruthlessly scrutinized for flaws that need solutions. This becomes harder to do when you’ve achieved Big Funding. Babylon is typically burning a hole through it (The Times, 1 Oct–hat tip to Chrys). The pressure on now to find The Road to Breakeven must be stunning.

Important updates: Speaking of finding solutions, Babylon differs strongly with the findings of the Care Quality Commission (CQC)(not to be confused with the CCG), in the CQC report on their service published on Friday 8 December. 

(more…)