Science

DDAT Trial Critique Part 2

Following up from our earlier post Critical appraisal of DDAT Controlled Trial Professor Snowling has kindly sent me the full text of their paper.

Snowling & Hulme’s paper criticizes the DDAT study [PDF] on a number of fronts. Firstly because the study did not include a ‘treated control group’ in addition to the ‘treated group’ and the ‘untreated control group’. This third group is required to demonstrate that the children did not improve simply because they were receiving more attention from their parents. Secondly, the way the participants were selected for the two groups meant that the groups were not of equal ability at the start of the study making it difficult to properly assess the relative improvements of the two groups by the end of study. Thirdly the tests used to measure the children’s abilities before and after the 6 month study period had statistical weaknesses which call into question the study’s conclusion. Finally that paper lacked details of the exercise the children did and the raw scores of each of the tests administrated. Without these details other scientists cannot repeat or reanalysis the study, a basic requirement of a scientific study.

It is worth noting that Snowling & Hulme’s paper does not prove that DDAT does not work. It only shows that DDAT haven’t proven their technique works to the rigorous standards required by the scientific community.

2 Comments

  1. FrazzleDazzle

    Chris, I did find her comment #6 to be quite interesting, at least from an ADHD (and possibly other types of LDs) standpoint, particularly the last of the 6:

    “6) It is interesting to look at the six DST measures that did improve over the two years of the study. Arguably, these were those with the least obvious connection to literacy. Gains were made on bead threading, balance, rapid naming, semantic fluency, a measure of segmentation and a measure of working memory.”

    I plan to look at these 6 DST measures and how improvements in these areas transfers to real learning. The working memory part really caught my eye, because as of the completion of the Dore program, my son has made some measurable gains in working memory, which is really great news for him.

Comments are closed.