A press release rehashed as a news article on the BBC website today – “Lie detector software saves ?500k” states:
Lie detector software has saved a south London council almost ?500,000 it was losing through benefit fraud.
During a phone call Voice Risk Analysis (VRA) software analyses minute changes in the voices of those claiming benefits to see if they are lying.
During the pilot, almost 1,700 people were assessed, of which 377 had their benefits stopped or decreased.
For starters, VRA isn’t a lie detector – there is no such thing. Even the polygraph isn’t really a lie detector, and in any case evidence from either machine cannot be used in court. The success rate of VRA itself is not particularly encouraging:
What we see here is that 198 true statements were coreectly determined to be true but 118 true statements were incorrectly determined to be false. We also see that 127 false statements were correctly determined to be false but 73 false statements were incorrectly determined to be true. In short, 37.3 per cent of the true statements were adjudged to be false and 36.5 per cent of the false statements were adjudged to be true.
While a strong case can be made for using them as one of many tools in an assessment process, with due care and attention taken as regards their fallibility and the risks involved, there’s nothing to suggest this is the case here, particularly given how the council is trumpeting it. Processing 1,700 cases in five months (17 or so per working day) is pretty swift work, to boot.
This is further exacerbated by the numbers – the false positive and false negative rates are similar, but assuming the vast majority of claims are genuine, then there are going to be more genuine claimants are going to be denied benefits they deserve, than bogus ones who get away scot-free.
The only remaining thing in their favour is they can be a deterrent – albeit a fairly expensive one – and that their ongoing usefulness as a deterrent depends on how they are used. Used carefully and judiciously these are a good idea; used as a quick fix to plough through thousands of claims and they quickly become ineffective and even oppressive.