{"id":6572,"date":"2016-01-25T08:05:23","date_gmt":"2016-01-25T08:05:23","guid":{"rendered":"http:\/\/blogs.bath.ac.uk\/edswahs\/?p=6572"},"modified":"2016-01-25T08:05:23","modified_gmt":"2016-01-25T08:05:23","slug":"outdoor-learning-seems-just-as-incoherent-as-i-feared","status":"publish","type":"post","link":"https:\/\/blogs.bath.ac.uk\/edswahs\/2016\/01\/25\/outdoor-learning-seems-just-as-incoherent-as-i-feared\/","title":{"rendered":"Outdoor learning seems just as incoherent as I feared"},"content":{"rendered":"

I've been reading the research report<\/a> on outdoor learning recently published by the Blagrave Trust, UCL, the IoL, and Giving Evidence:\u00a0The Existing Evidence-Base about the\u00a0Effectiveness of Outdoor Learning<\/em>.<\/p>\n

It will\u00a0not make comfortable reading for anyone who has been banging on recently about how great outdoor learning [ OL ] is \u2013 that is, for most of those involved in OL who want to publicise what they do \u2013 that is, for most of them. \u00a0You don't have to read the report for long to realise how threadbare these various claims turn out to be. \u00a0It's not helped, of course, that outdoor learning is such a fuzzy 'n'\u00a0floppy\u00a0idea: outdoor learning turns out to be\u00a0any learning that accrues from an experience out of doors, as opposed, say, to indoor learning which ... \u00a0You get the picture.<\/p>\n

Thus the Ten Tors expedition, a field trip to a rocky shore, a scout camp, a nature walk, learning maths at a forest school, a visit to an outdoor theatre, painting al fresco, skinny dipping, fox hunting, detectoring, working on the allotment, a walk with the Ramblers, plane\u00a0spotting, etc, etc can\u00a0all lead to outdoor learning, and the only thing they all have in common is that they take place outdoors.<\/p>\n

What next, you have to wonder? \u00a0A claim that indoor learning<\/em> is good for you as well? \u00a0But nobody ever talks of indoor learning because it makes little sense to do so (as it is so varied in every sense). \u00a0Why, then, is it sensible to talk of outdoor learning?<\/p>\n

I have thought for a while now that outdoor learning lacked conceptual clarity, and that, because of this, some (at least) of the claims it makes for itself were perhaps open to question. \u00a0This report suggests that there is no perhaps about it.<\/p>\n

Here are a few extracts from the summary of findings<\/p>\n

1. A sense of the sector as a whole<\/strong><\/em><\/p>\n

There is no comprehensive or regular (repeated) survey of the scale of outdoor learning in the UK. There are some studies of specific outdoor learning activities (e.g., of particular types, or in particular parts of the UK). In these, some authors express concern about barriers to delivering outdoor learning and a reduction in outdoor learning.<\/em><\/p>\n

2. The current research base\u00a0<\/strong><\/em><\/p>\n

Crowdsourcing UK research revealed an enthusiasm for research and sharing of knowledge amongst people who deliver outdoor learning activities. However, some of the material submitted were data or reflections which included named individuals, rather than anonymized research reports. This raises some issues around practitioners\u2019 understanding of research ethics.<\/em><\/p>\n

There is a growing body of individual studies and systematic reviews about the development and effectiveness of outdoor learning. We found 15 systematic reviews of the effects of outdoor learning. They provide extensive evidence of the effects of outdoor learning. However, the set is somewhat confusing because many of them overlap in terms of the primary studies they include. Moreover,\u00a0some systematic reviews include other systematic reviews, or are an update of an earlier review. This overlap therefore repeatedly reports the same evidence without necessarily strengthening it.<\/em><\/p>\n

Distinctions between types of interventions and outcomes employed to categorise studies are not always clear. For instance, \u2018healthy lifestyles\u2019 and \u2018health and well-being\u2019 were part of the \u2018learning and development\u2019 domain, while \u2018health behaviour\u2019 and \u2018health, physical \/ mental\u2019 were part of the \u2018health\u2019 domain.<\/em><\/p>\n

Four features<\/strong><\/em> of the\u00a058 primary UK studies\u00a0are striking:<\/em><\/p>\n

a. They are spread thinly across many populations (types and age groups), interventions, settings and outcomes, such that few topics have been researched more than a handful of times. This leads to our suggestion that the sector collectively identify and prioritise the important unanswered questions, and then focuses its (presumably limited) research resources on those priority questions.<\/em><\/p>\n

b. The activities and participants on which studies focus may not be where the sector would choose that research should focus. For example, the most common study topics are: adventure or residential activity; 11-14 year olds; and the general population. This leaves very few studies on (and hence little insight about) other age groups, popular activity such as Scouts or Ramblers, or people who are not in employment, education or training (NEET), have disabilities or are post-trauma.<\/em><\/p>\n

c. That there seems surprisingly little linkage between the outcomes measured by the studies and the agenda of \u2018customers\u2019 and funders. The outcomes measured are mainly around \u2018character development-type\u2019 outcomes (communication skills, teamwork, self-confidence etc. Very few studies addressed interventions with strong links to core curriculum subjects. There was only one primary study of educational outcomes at Key Stage 1 (5-7 year olds), few of educational outcomes at Key Stages 2, 3 and 4, and none at or beyond Key Stage 5 (sixth form). There is also a mismatch with the interests of employers: \u2018employability\u2019 is only measured in relation to offenders but not young people generally. Looking internationally, only six of the 15 systematic reviews looked at educational attainment, and only one addressed employability.<\/em><\/p>\n

d. Safety is little covered in the systematic reviews and was not measured as an outcome in any of the primary studies. Safety is obviously a major issue in outdoor learning since it can be dangerous: few social interventions can result in broken limbs or fatalities. Even if safety isn\u2019t the primary focus of a study, data could be gathered about safety: this is often how patient safety data and insights are gathered in medical research.<\/em><\/p>\n

3. Outcomes assessed<\/strong><\/em><\/p>\n

This evidence, both in the UK and internationally, and in both primary studies and systematic reviews, is very varied in terms of the populations who are offered outdoor learning, the type of outdoor learning and the outcomes assessed. The categorisation that informed this study captured some interventions and outcomes, but others emerged from the literature. Generally, there is considerable consensus in the general aims of interventions, but little consensus on the outcomes for assessing their effects.<\/em><\/p>\n

4. The designs of individual evaluations\u00a0<\/strong><\/em><\/p>\n

We compared reports of UK studies in terms of attributes on a scale developed by Project Oracle, which looks at the extent of plans for an intervention and the evidence for it (described further in the document). Using this scale was challenging because the Project Oracle scale was designed for organisations to plan and assess their own interventions and evaluations, rather than to assess research reported elsewhere.<\/em><\/p>\n

Many UK studies did not reach Level One of the Project Oracle scale, normally because they did not cite or appear to use a Theory of Change (also known as a logic model: an articulation of the inputs, the intended outcomes, how the inputs are meant to produce those outcomes, and assumptions about context, participants or other conditions). Clear theories of change serve a couple of useful purposes: first, they demonstrate that the practitioners understand their intervention; and second, they are invaluable for other practitioners reading the research in estimating whether they will achieve the same outcomes with those interventions in their contexts. To be clear, a practitioner may have a theory of change but not cite it in their research, but (a) citing it in the research is useful and (b) experience from many other social sectors suggests that practitioners may need support to develop or articulate their theories of change. \u00a0No UK study, or set of studies, featured the more demanding attributes of Levels Four or Five, around the intervention having been replicated in several places.<\/em><\/p>\n

Implications for practice and policy<\/strong><\/em><\/p>\n

The study did not set out to look at implications of the research for practice and policy. \u00a0Nonetheless, we found:<\/em><\/p>\n

Almost all outdoor learning interventions have a positive effect. \u00a0The effect attenuates over time: the effect as measured immediately after the intervention is stronger than in follow-up measures after a few months. This is common for social interventions. However, one meta-analysis found that effects relating to self-control were high and were normally maintained over time.<\/em><\/p>\n

Evidence for the value of longer interventions. The systematic reviews found that overnight and multi-day activities had a stronger effect than shorter ones. While this is perhaps unsurprising, it does pose a challenge for funders \/ funding since it obviously forces a trade-off with the number of participants.<\/em><\/p>\n

Recommendations<\/strong><\/em><\/p>\n

For providers of outdoor learning<\/em><\/p>\n

Outdoor learning organisations can refer to systematic reviews of research about outdoor learning when planning their programmes. Careful reading is required to (a) check the rigour of each review and the studies they include (for instance, did the review include a systematic search and critical appraisal of the studies included?); and (b) check the precise types of programmes, populations and outcomes they studied.<\/em><\/p><\/blockquote>\n

Implications for the outdoor learning sector about developing its research<\/em><\/p>\n

Because the existing research is spread quite thinly, few questions about effectiveness are yet answered reliably. We therefore recommend that the outdoor learning sector collectively prioritise the various unanswered questions in order to focus its research resources on those which are most important.<\/em><\/p><\/blockquote>\n

We recommend that the outdoor learning sector:<\/em><\/p>\n

1. Types and volume of activity: Pull together the various data sources on this to give the current picture, and create a system to regularly capture data on the types and volumes of activity.<\/em><\/p>\n

2. Improve practitioners\u2019 theories of change, enabling practitioners\u2019 to both create and to use them. Theories of change are explained in Box 4: they are invaluable for understanding why an intervention works and hence whether it is likely to work in other contexts, but only few evaluations of UK outdoor learning activity cited them.<\/em><\/p>\n

3. Convene practitioners, researchers and others to prioritise research topics.<\/em><\/p>\n

4. Manage the resulting sector-wide research agenda, through relationships with funders, and possibly by creating partnerships between practitioners and researchers.<\/em><\/p>\n

5. Ensure that both interventions and research are described clearly, fully and publicly.<\/em><\/p>\n

Outdoor learning organisations need to have systems in place to support ethical practices for monitoring and research, particularly the storage and sharing of data from evaluations.<\/em><\/p>\n

Greater consensus about the important outcomes of interest would allow research findings from different studies to be pooled more easily, and thereby facilitate accumulating knowledge to inform better the whole field.<\/em><\/p>\n

.....................................<\/em><\/p>\n

Enough ...<\/p>\n","protected":false},"excerpt":{"rendered":"

I've been reading the research report on outdoor learning recently published by the Blagrave Trust, UCL, the IoL, and Giving Evidence:\u00a0The Existing Evidence-Base about the\u00a0Effectiveness of Outdoor Learning. It will\u00a0not make comfortable reading for anyone who has been banging on...<\/p>\n","protected":false},"author":237,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[2,4],"tags":[],"class_list":["post-6572","post","type-post","status-publish","format-standard","hentry","category-comment","category-news-and-updates"],"acf":[],"jetpack_featured_media_url":"","jetpack-related-posts":[],"_links":{"self":[{"href":"https:\/\/blogs.bath.ac.uk\/edswahs\/wp-json\/wp\/v2\/posts\/6572","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.bath.ac.uk\/edswahs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.bath.ac.uk\/edswahs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/edswahs\/wp-json\/wp\/v2\/users\/237"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/edswahs\/wp-json\/wp\/v2\/comments?post=6572"}],"version-history":[{"count":0,"href":"https:\/\/blogs.bath.ac.uk\/edswahs\/wp-json\/wp\/v2\/posts\/6572\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.bath.ac.uk\/edswahs\/wp-json\/wp\/v2\/media?parent=6572"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/edswahs\/wp-json\/wp\/v2\/categories?post=6572"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.bath.ac.uk\/edswahs\/wp-json\/wp\/v2\/tags?post=6572"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}