#H809 Can Computers Overcome Tensions between Qualitative and Quantitative Research Approaches?

The second paper in H809, from Wegerif and Mercer, uses computer-based language analysis as an opportunity to discuss qualitative and quantitative approaches in educational research.  The paper dates from 1997 and, similar to the Hiltz and Meinke paper, its main objective seems to highlight the role novel computer-based technologies can play in research.

Quantitative data analysis enables testing of research hypotheses, creating evidence and making generalisations.  This helps to build a body of knowledge and making predictions for new situations.  Qualitative approaches allow much finer level of analysis and more attention to the particular context.

The time required for analysis and the space required for presentation mean that there is a de facto relationship between degree of abstraction useful in the data and the sample size of a study or the degree of generalisation. More concrete data such as video-recordings of events cannot be used to generalise across a range of events without abstracting and focusing on some key features from each event. (276)

Increasing computer power allows for analysis of much higher amounts of data in more detail and reduce the required level of abstraction in the categorisation. Large amounts of data can be analysed with more sensitivity to content and context.

We believe that the incorporation of computer-based methods into the study of talk offers a way of combining the strengths of quantitative and qualitative methods of discourse analysis while overcoming some of their main weaknesses. (271)

I agree that computer-based discourse analysis may overcome some weaknesses of both approaches, language may still be difficult to capture quantitatively because:

  • nonverbal language plays an important part in communication
  • meanings may be ambiguous
  • meanings may change over time or vary among persons and among contexts.

I’m not sure it’s helpful to analyse language with the same tools and rigour as positive sciences, as context is much more prevalent in language than in positive sciences.

More computer power doesn’t mean that the subjective role of the researcher can be completely discarded.  Researchers may have various  motives for their research.  As a researcher you always need to make interpretative decisions. Even with computer-based text analysis the researcher still decides which categories to use, which hypotheses to test and which excerpts to publish.  I believe it’s best to document these decisions as well and transparently as possible.  For example, the researchers could discuss limitations and weaknesses of their research or suggest alternative explanations (e.g. perhaps learners knew each other better the second time).  Also making data publicly available would help, so other researchers can scrutinize the results (although few may have time and incentive to do this).

Reference:

Wegerif, R. and Mercer, N.(1997) ‘Using Computer-based Text Analysis to Integrate Qualitative and Quantitative Methods in Research on Collaborative Learning’, Language and Education, 11(4), pp. 271–286.
Advertisements
This entry was posted in H809 and tagged .

One comment on “#H809 Can Computers Overcome Tensions between Qualitative and Quantitative Research Approaches?

  1. I preferred the approach of these authors – they seemed to lay it all out in front of us on the table – the strengths and weaknesses and possible pitfalls in what they were doing so we the readers were under no illusions. Both authors are now in prestigious roles and you can see how their Opus Magnus followed shortly after. With research we have to rely on the authors to offer us everything they can, not only so that we can draw our own conclusions, but surely so that we can if we wish, replicate or build on the research. I follow my wife as she does medical market research on vast texts – hour long interviews with 30+ specialists. This is still very much a manual process, though no longer delivered on audio cassettes and analysed on huge sheets of paper. Credible software must exist to support, though not replace this process. And finally, even if the software saves time, there has to be a significant amount of effort and thought coming from the authors which is ultimately what counts. How do they present and interpret their findings. Is what they produced accessible and well written so that others can get their heads around it?

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s