Problem Based Learning as a Dance

Having been a science and computing teacher, I commonly hear people say “but your subjects lend themselves well to PBL” and I wonder what they mean.  Of course, it’s true that there are many great opportunities for PBL in science and computing; but these also need ‘enabling knowledge’ to be in place. In some subjects including computing, there is a real dynamic tension between this enabling knowledge, and further knowledge growth. I wonder if it just looks simpler for unfamiliar subjects?

Pedagogical approaches in ICT exemplify this.  Before students can program, they need certain mental constructs. Variables, Loops, Decision Structures and their like.  However, in the application there is a dance back and forwards as mental constructs are built, enacted and extended. In the language of SOLO taxonomy, learning uni-structural concepts allows multi-structural and relational exploration. But, along the way, new facts are uncovered as uni-structural facts, needing to be integrated … it’s a dance that goes back and forwards.

Not all curriculum designers understand this dance… When I was taught computing, the approach taken in COMP 111 and COMP 112 was to cover all relevant uni-structural concepts first. Then we looked at all multi-structural extensions and at the end of the year, we wrapped up in a lightweight relational project.  It wasn’t the most interesting to say the least, and the subject  was notable for the fact that it was unpopular and 95% male.

(source: www.johnbiggs.com.au)

Contrast this approach to the approach my Math 206 paper in Mathematical Applications – something which ignited our curiosity and motivated me and my friends to spend countless hours in the computer lab. Here we were given some traditional lectures, a series of tutorials, and a list of seven problems to solve. Oh, and by the way,  to solve the problems we would need to know how to program in FORTRAN.  The poor printers were put in overdrive as we printed reams of documentation…

Now if I was going to construct this course myself, I might be tempted to offer a little bit more support in the development of FORTRAN knowledge… but the principle then was sound. The problems were interesting, challenging, real-world and very very fun. Pupil uptake was high and attainment was equally satisfying.

This all reminds me of a book, from my holiday reading list: What the BEST College Teachers Do,  by Ken Bain (2004). In this book, Bain presents his view based upon years of highly successful teaching and upon a rigorous research base:

Creating a Natural Critical Learning Environment begins with raising big questions that students will find important, intriguing, or beautiful.  … building courses around big questions, often questions that are bigger than the course or the particular discipline.  The idea is to get students engaged in a question or problem, and as they pursue that question they learn. . .history, chemistry, journalism, or whatever.  They also develop the powers of their own minds.

Of course, it is still necessary to make pupil’s thinking visible. To build, extend and challenge thinking. In SOLO language, to go to the Abstract and Extended-Abstract.  While PBL offers many opportunities here, we also need the techniques known to many good teachers, that are promoted through the likes of Harvard’s Project Zero which I highly recommend.  This combination of PBL as canvas,  and the application of diverse learning tools (the teachers’ pallet) makes for real magic in the classroom.

Coming full circle – it this easier in computing and science?  No, it requires deep thinking about the learning process in each subject and intricate planning. The one advantage computers give is the immediacy of feedback – but properly trained, peer feedback can be just as immediate and as Eric Mazur at Harvard has shown, can lead to significant learning gains. Furthermore, a key element of PBL is the engagement of ‘real world audiences’ … giving rather effective feedback!

Making up our Minds

Education research must be really frustrating for many as it appears to contradict itself over time, and differing settings. This situation reminds me of story given by Martin Seligman (2004) in his very entertaining TED lecture.

He explains:

So they came to me — CNN — and they said, “Professor Seligman, would you tell us about the state of psychology today? We’d like to interview you about that.” And I said, “Great.” And she said, “But this is CNN, so you only get a sound bite.” So I said, “Well, how many words do I get?” And she said, “Well, one.” And cameras rolled, and she said, “Professor Seligman, what is the state of psychology today?”

And I said: “Good.”

“Cut. Cut. That won’t do. We’d really better give you a longer sound bite.” “Well, how many words do I get this time?” “I think, well, you get two. Doctor Seligman, what is the state of psychology today?”

And I said: “Not good.”

“Look, Doctor Seligman, we can see you’re really not comfortable in this medium. We’d better give you a real sound bite. This time you can have three words. Professor Seligman, what is the state of psychology today?”

To which I said: “Not good enough.”

The same story, I suggest, might apply to educational effectiveness research. We have made great strides over the last fifty years highlighting many things which contribute to learners’ success. And this has been good.

However, at times research has been too dogmatic, ideological and bound by distinct paradigms. Much of the early debate around traditional vs progressive education might fall in to this camp. At its worst, this has led to the teach-by-numbers approach that has de-professionalised teachers and short changed learners. This is not good.

We have learnt that our former quantitative tools were blunt instruments that only weakly pick up on complexity, interactions, non-linear effects and the very contextual nature of learning. If at all. This is not to say that prior progress is illusory – far from it; but it is now appropriate to ask ‘what next’ as our research power improves. Now with much greater technical finesse, better data, mixed methods and a generally more pragmatic approach research may shine a light on old and new dilemmas. Former pivotal studies such as Coleman (1966) are being reanalysed and reconsidered (Borman & Dowling, 2010) and we are finding answers to previously impossible questions – e.g. such as the temporal and contextual impact of leadership (Day et al., 2009) and its impact on student attainment (Connolly, 2015).

It is easy to see how early efforts were ‘good’, some application of these became ‘not good’ but with new methods and more computational power, we can now improve on ‘not good enough’.

An example of this is the recent report of the US National Mathematics Advisory Panel (2008) which highlights early antagonism between traditional and progressive paradigms. However, advice now moves beyond this to a pragmatic mix, which recognises that a blend of approaches is required. So too, when we consider problem based learning; for which a dogmatic application of pure PBL is not good (Walker, Leary, Hmelo-Silver, & Ertmer, 2015). Also not good, is an uncritical application of Hattie’s Visible Learning (2009) which deserves close scrutiny and a revisiting of sources at times.

References

Borman, G., & Dowling, M. (2010). Schools and Inequality: A Multilevel Analysis of Coleman’s Equality of Educational Opportunity Data. Teachers College Record, 112(5), 1201–1246.

Coleman, J. S. (1966). EQUALITY OF EDUCATIONAL OPPORTUNITY. Retrieved from http://eric.ed.gov/?id=ED012275

Connolly, V. (2015). Leadership, School Culture and Attainment: a secondary data analysis of TALIS 2013 (England) (MPhil). University of Cambridge, Cambridge.

Day, C., Sammons, P., Hopkins, D., Harris, A., Leithwood, K., Gu, Q., … Kington, A. (2009). The Impact of School Leadership on Pupil Outcomes: Final report (DCSF-RR No. 108). London: Department for Children, Schools and Families. Retrieved from http://dera.ioe.ac.uk/11329/1/DCSF-RR108.pdf

Hattie, J. (2009). Visible Learning: A Synthesis of Over 800 Meta-Analyses Relating to Achievement. New York: Routledge.

NMAP. (2008). The Final Report of the National Mathematics Advisory Panel. US Department of Education. Retrieved from http://www2.ed.gov/about/bdscomm/list/mathpanel/report/final-report.pdf

Seligman, M. (2004). The new era of positive psychology. Retrieved from https://www.ted.com/talks/martin_seligman_on_the_state_of_psychology?language=en

Walker, A., Leary, H., Hmelo-Silver, C., & Ertmer, P. A. (Eds.). (2015). Essential Readings in Problem-Based Learning: Exploring and Extending the Legacy of Howard S. Barrows. West Lafayette, Indiana: Purdue University Press.

Motivation and Learning Languages

Polyglot Benny Lewis learned languages late in life. Through his experience, he challenges traditional notions of learning and believes that learning languages can be made easy if learners are passionate about literature, people and culture.

Instead of a formal method, he advocates a more PBL approach, where the problem is “how do I survive on holiday?” or “how do I communicate with people?” … but certainly the problem is not “how do I pass this exam?”.

In his recent TEDx video, he outlines some of his philosophy

His recent book Fluent in Three Months is reviewed by Alison Griswold for Business Insider and she says his main tricks are:

  • Speak the language out loud from day one. Beginners shouldn’t be afraid of mispronouncing things or sounding unpolished, Lewis says. It’s most important that they start practising — aloud — right away.
  • Learn practical phrases first. New language learners should aim for phrases like “bathroom where?” that will help them communicate about basic needs. “That’s not very eloquent, but it’s totally understandable,” Lewis notes.
  • Forget about learning strict grammar. As part of getting basic vocabulary and phrases down, Lewis says people shouldn’t worry too much initially about learning the rules of grammar. Those can be filled in later.
  • Practice by Skyping with a native speaker. One of today’s best language learning tools, Lewis says, is the Internet — specifically video chats like Skype. Using these free services, an English speaker in New York can easily get free or cheap conversational lessons from a native speaker of another language elsewhere in the world.
  • Listen to local radio stations. Another option for immersing yourself in a foreign language is to stream radio from a country that speaks it. To do this, Lewis recommends checking out TuneIn, an online repository of radio stations from around the world.
  • Practice a one-minute introduction to yourself. One of Lewis’s favorite tricks for beginners is to have them write out a short introduction to themselves, and then work on translating it with a native speaker. This relatively quick activity teaches plenty about basic vocabulary and phrases.
  • Avoid generic language courses. Lewis discourages people from signing up for classes like Rosetta Stone, which he feels are too generalized to help the average beginner. At that stage, he says personalized feedback is the most important thing to have.
  • Instead, check out free language-learning tools online. Duolingo is one of Lewis’s favorites, as well as italiki, an online site that connects you with native speakers for personal language lessons.
  • Be prepared to put in a lot of time and practice. Lewis believes that people who are willing to study a foreign language full-time could reach a B2 level in just a few months. On the other hand, he thinks the same level could be achieved in a year or two with one to two hours of practice each day.
  • Don’t aim for perfection. The problem that most beginners run into, Lewis argues, is that they become so focused on reaching a perfect end-stage that they get discouraged and never get past the early stages. The best way to deal with this? Get comfortable with mistakes, and don’t try to be perfect.

source

These look remarkably like standard based PBL where projects are real-life and authentic, varied, multidisciplinary and FUN.  And with respect to those GCSE exams, Lewis contends that after learning a language conversationally,  it is then appropriate to return to a more formal learning of grammar / exam prep… but by this point, even that would look fun.

For a similar story, Joshua Foer uses Memrise to learn African tribal languages.

It’s all about balance

Education debate is all too often polarised.

Progressives vs Traditionalists,

Competition vs Collaboration,

Testing vs Trust.

And so on. A cynic might say that this makes for good headlines as a quick look at BBC reporting of phonics will show:

“Phonics lessons are ‘almost abuse'” (BBC News, 2014a)

Or

“Phonics is the “best way” to teach reading” (BBC News, 2014b)

And so it is with Problem Based Learning (PBL) and the work of John Hattie (2009). One does not have to dig that deep to find often contradictory meaning. For example, homework is touted as a weak to moderate influence on student attainment – yet a closer look reveals that this is merely an average of two very different pictures. For primary pupils, homework is of little benefit to their academic progress. For secondary pupils, the picture is very different – as any teacher will know, homework in the right circumstances is a powerful learning support. However, we can take this even further – really effective homework targets areas of weakness needing attention, rather than mechanistic repetition (Stobart, 2014) – perhaps we could say homework is personalised? A progressive concept of which Hattie disproves. Or does he?

In Hattie’s overview of educational interventions PBL is ranked a very lowly 118th. With an effect size of 0.15, problem based learning is barely better than ‘just leaving children to get on with it’ … However, there is a wide variation in the eight meta-analyses that Hattie synthesises and it is worth exploring these meta-analyses individually.

To believe Hattie, PBL is detrimental to knowledge acquisition. He quotes Dochy et. al. (2003) showing an effect size of -0.78 on the acquisition of knowledge. This is equivalent to the loss of over one year’s teaching! If this were true, it would be enough to dent the ardour of any teacher. However, Dochy et. al. do not believe in the robustness of their own result – and state “this result is strongly influenced by two studies and the vote count does not reach a significant level. It is concluded that the combined effect size for the effect on knowledge is non-robust” (ibid: 533). What Hattie is very positive about is the impact of PBL on skills acquisition (d = 0.66) and knowledge and complex theory retention (d=0.75). It is this level which is most important at ‘A’ level’s higher grades which require synthesis and deep thinking.

Notwithstanding this raises a number of questions

  • What is PBL best at doing?
  • What should PBL be combined with to give maximal benefit?
  • How is PBL moderated by age and subject domain?
  • Does PBL equally suit all learners, irrespective of their baseline?

Early research methodologies lacked much sophistication and ‘resolving power’. The field of educational effectiveness research has only latterly been able to explore interaction effects and non-linear relationships and we should be alert to the weaknesses of past research. Day et. al.’s (2009) exploration of the developmental pathways that schools travel is a fascinating example which illustrates the weaknesses of a ‘one size fits all’ approach. It should be no surprise that PBL should be similarly blended with other techniques as befits each learners’ situation.

For one example of how PBL is combined with academic rigour, watch Marc Chun’s Keynote to PBL World 2013.

 

References

BBC News, 2014a. Phonics lessons are “almost abuse”, says academic [WWW Document]. BBC News. URL http://www.bbc.co.uk/news/education-25928432 (accessed 7.23.16).

BBC News, 2014b. Headteacher: Phonics is the “best way” to teach reading [WWW Document]. BBC News. URL http://www.bbc.co.uk/news/education-25928436 (accessed 7.23.16).

Day, C., Sammons, P., Hopkins, D., Harris, A., Leithwood, K., Gu, Q., Brown, E., Ahtaridou, E., Kington, A., 2009. The Impact of School Leadership on Pupil Outcomes: Final report (DCSF-RR No. 108). Department for Children, Schools and Families, London.

Dochy, F., Segers, M., Van den Bossche, P., Gijbels, D., 2003. Effects of problem-based learning: a meta-analysis. Learn. Instr. 13, 533–568. doi:10.1016/S0959-4752(02)00025-7

Hattie, J., 2009. Visible Learning: A Synthesis of Over 800 Meta-Analyses Relating to Achievement. Routledge, New York.

Stobart, G., 2014. The Expert Learner: Challenging the Myth of Ability. Open University Press, Maidenhead.

Stanford takes its time…

Stanford University’s ‘Year of Learning’ … In a year long, strategy encompasing all disciplines, Stanford take a fresh look at the

  • latest research on learning and teaching
  • role of technology in developing and supporting learning and teaching
  • the changing demography of education as the world goes global

I really recommend their blog 

 

All too often development planning is rushed – an example of the urgent crowding out the important. Stanford’s is a great example, from one of the world’s leading educational institutes of planning done well.  As Stoll, Fink and Earl (2003) once said:  it’s about learning and it’s about time.

 

References

Stoll, L., Fink, D., & Earl, L. M. (2003). It’s about learning (and it’s about time). London: RoutledgeFalmer.

Is this time different? Paul Mason on PostCapitalism

Paul Mason, economics editor of Channel Four, describes information technology as both product and disrupter of Capitalism.

His thesis, written in his book,  PostCapitalism: A guide to the future,  is that for a very long time Capitalism has confounded its critics by being more adaptable than could be imagined. However, Information Technology, he opines, poses a new challenge that is different to all preceding challengers.

In his talk at London Google HQ, he describes the main ways in which Information Technology does this:

  • The price mechanism is dissolving – e.g. the marginal costs of information goods are reduced to the effort of selecting ‘copy’ and ‘paste’ – this leads to an exponential price downfall. Never before have we lived in an era when prices would fall off a cliff.
  • It de-links work hours from wages. Work has become distributed, networked and target based (not time based).
  • Organisations, hierarchies and businesses are changing:  decentralised, non-managed, non-hierarchical, voluntary and diffuse.

So what comes next?

Interestingly for technologists, he points to the rise of a post-capitalist third sector driven by open source and collaborative action. He sees the rise of a quasi-sharing economy, where information is freely available leading to the optimal use of information.  The role of large information based companies will be forever undermined by the collapsing ‘price mechanism’, already under-way. The advent of AI will do the same for service sectors and automation in manufacturing.

The big question though, is just how fast will all this be, and what shape will the transition take?

The Doctor is in – your robot will see you now…

June 29, 2007…  Less than ten years ago.  This was the day the iPhone was released.  How the world has changed since then…

The pace of this change is exponential. Think explosive. Think accelerating. Think of the Gemino Curse which almost killed Harry Potter when raiding a vault in Gringott’s Bank.  A nifty dramatisation of compounding interest in which golden objects duplicated themselves recursively, in a swift attempt to drown intruders in gold.

The number of authors highlighting dangers in their sector is also growing. Sir Michael Barber et al., outline a coming avalanche in education, to name one example. Richard and Daniel Susskind go much further in their scholarly masterpiece:  The future of the professions. Looking beyond sectors, they cut to the heart of the issue and highlight how the historical d

rivers for the creation and maintenance of professions are ripe for disruption; and that this disruption is all too easily achieved.

 

Learning to Learn

Meta-cognitive interventions are one of the most cost-effective things teachers and schools can do, according to the Sutton Trust and the EEF toolkit.

But how do we help pupils become better learners?  This is the subject of a rigorous longitudinal study by James Mannion and Neil Mercer (2016), at the University of Cambridge.

They develop and test an interesting approach – and it yields results. Pupils who engage in their ‘learning to learn’ programme, do better at GCSE.  This is particularly true for pupils from disadvantaged backgrounds.

Like my own research in to the effect of leadership and culture (Connolly, 2015), they find it is a complex mixture of approaches that impact on results. In particular they focus on a curriculum to teach the following methods:

  • Self Regulation
  • Meta-Cognition
  • Oral Communication
  • A Shared Language of Learning
  • Collaboration
  • A Plan for Transfer

In his very influential synthesis, John Hattie (2003) suggests that approximately 50 percent of pupils’ attainment is due to home and pupil factors. Looking at parts of this curriculum, perhaps ‘learning to learn’ is the start of a fruitful look at how schools can engage with those factors.  Certainly, the UK is behind the curve on this – New Zealand placed ‘Learning to Learn’ on the curriculum many years ago.  Mannion and Mercer’s paper is a very welcome development in English education.

References

Connolly, V. (2015). Leadership, School Culture and Attainment: a secondary data analysis of TALIS 2013 (England) (MPhil). University of Cambridge, Cambridge.

Hattie, J. (2003). Teachers Make a Difference, What is the research evidence? Camberwell VIC: Australian Council Educational Research. Retrieved from http://www.acer.edu.au/documents/RC2003_Hattie_TeachersMakeADifference.pdf

Mannion, J., & Mercer, N. (2016). Learning to learn: improving attainment, closing the gap at Key Stage 3. The Curriculum Journal, 27(2), 246–271. http://doi.org/10.1080/09585176.2015.1137778

The Goldilocks Principle

It would seem that the brewing crisis in teacher recruitment really might be a crisis.  With the perfect storm gathering, of rising pupil numbers, failing recruitment and retention issues… how long before crisis will equal pupils being sent home for lack of a teacher? It has happened before…

This is a terribly sad state of affairs. Sad because we are discussing the wrong question:  What’s really best for students’ learning…?

As politicians blame teachers and schools, repeatedly, possibly endlessly, for failing their charges… let’s consider:

Pupils’ learning environment, is teachers’ work environment

If you can see the sense of that, then it follows that bashing teachers is the same as bashing pupils…  and it all boils down to one failed message:

more = better

For example – teachers just need to work harder. work longer hours, longer terms, with more pupils, with more marking, more differentiation, more complexity and more accountability.

But reality is different. School effectiveness research has long moved on. Now is the time to consider working smart; with a full awareness of the law of diminishing returns. Perhaps the Singaporeans were right:  Teach less,  learn more?

I call this the Goldilocks Principle.

We need to get smarter on how much effort, time and resource is just right… And the answer will be different for different schools… It’s the same reason why we have so many different pasta sauces – we are all different after all. Sometimes, one size does not fit all…

If we sort this out, perhaps the 300,000 plus teachers not teaching might actually return to the classroom and the teacher recruitment crisis will be shown for what it is… a teacher morale crisis based on a failing, simplistic and outdated model of education.

 

Race to the Finnish line

Perennial questions that keep resurfacing:

What’s the Finnish secret?  and Should UK education become more like Finland?

Perhaps though, we have more in common with Finland than we think?

The 2010 OECD report on education in Finland lists a number similarities to UK initiatives:

  • A core curriculum that has become increasingly less prescriptive
  • Choice for schools and teachers on the text books and methods they use
  • A comprehensive system, with no selection
  • High numbers of immigrants in the capital, Helsinki;
  • Early intervention for children with additional learning needs to keep all children in main stream schools if possible  (Latest election campaigning suggests this is about to get a welcome big boost in England)
  • School meals for all
  • Links with industry
  • High levels of formative assessment and measurement (sound like AfL to anyone?)

They also have some things we profess to like/ aspire to,  such as:

  • High esteem on vocational training, often integrated with academic training

Arguably we could do better on all of the above.The UK has recently stepped back from the following, although Finland holds them important:

  • Modular exams
  • Individualised learning programmes for all upper secondary school students promoting real flexibility and choice
  • Full service pastoral care in all schools  (we used to call this the Every Child Matters initiative coupled with Sure Start)
  • University based ITT underpinned by a 5 year Masters degree.

Finally, Finland seems to differ strongly with the UK on:

  • Accountability via sampling, to help schools
  • Strong home-school links
  • Abolished setting/ streaming
  • Trust in teachers

And very sadly,  both countries are bad at:

  • Continuing professional training for teachers

However there are a few things that England does which Finland does not.  Is the difference between our systems more defined by what the English do additionally?  Might a dose of ‘less be more’ for English education? Looking to the UK’s top private schools could be good instruction.  These highly performing institutions:

  • Teach fewer days per year
  • Focus more on character building, community service and meta-cognitive development
  • Trust teachers more
  • Have generally opted out of league tables
  • Offer more curriculum choice and flexibility to pupils

While these schools also benefit from high levels of funding and family advantage, this does not explain all of private schools’ success. Perhaps there’s a lesson in this.