Saturday, November 25, 2017

Reflections on Jen Porter's Presentation



On November 16, Jen Porter presented to EDDE 806 on her proposed area of research for her dissertation, “The Gamification of education: A behaviour analytic perspective.” The research problem she is hoping to address is the relative absence of empirical studies on the effectiveness of gamification in education, even though it has become something of a buzzword in higher education circles. Jen has been discussing her unique perspective on gamification in teaching and learning with her classmates both within and outside of course spaces for some time, so her choice of topic was no surprise. She approaches this work from a behaviourist perspective—considering the impact in an educational setting of positive reinforcement, effective feedback, the imposition of rules and constraints, and “flow” (via Czikszentmihalyi’s 1990 work on this concept), on students’ motivation and the transfer of knowledge. However, she has encountered some resistance from various corners because people have a strong negative reaction to the idea of behaviourism—perhaps because they associate it with earlier versions of this approach.  

The format of Jen’s presentation was thorough and methodical, yet accessible. One challenge I had was that, while I am familiar with the concept of gamification and numerous aspects of it that Jen laid out in the presentation, her methodology is very different from the work I have been reviewing in my own research. Because of this, I would probably benefit from a bit more explanation of some of the methods she plans to use in her research. For example, a more detailed explanation of hierarchical linear modeling and the use of ANCOVA and MANCOVA, and how these would be useful in a relatively small study, would help me to understand this project better. But that may be more of a commentary of my own limitations in this area. Also, I am always a fan of people utilizing the methods and school of thought that they are advocating for. In other words, would there have been a different way of presenting this project that utilized behaviourist analytic approach?

Regarding the use of graphics and other elements in the slides: I liked the variety, and the visualization of the game elements into the three categories of Dynamics, Mechanics, and Components helped me to understand the concepts. The value of using images of James Paul Gee and his publications was less clear, perhaps, but I have the most concern about the use of the graph that showed the simplified and limited concept of “the art of flow.” Visuals make a strong impression on viewers—if this was meant to be an example of what not to do in this study, it should at least be countered by a visual depiction of what one should do. Otherwise, viewers will retain this image in their memories, and perhaps recall the project in a mistaken or misleading way.

Because this project is so different from my own, it is hard to determine what I might take away from this presentation that I might use in my own research. Jen’s commitment to the work certainly shines through, though, and it has certainly led me to take a closer look at behaviour analytics and how it might apply to my work as an educator.

References:
Csikszentmihalyi, M. (1990). Flow: the psychology of optimal experience. New York: Harper & Row.

Thursday, August 24, 2017

Me at the Saylor Academy Higher Education Summit

It's a short clip from a panel that I moderated. Thanks to the wonderful people at the Saylor Academy for keeping me in the headlines.

https://twitter.com/saylordotorg/status/900735884655554560

Sunday, August 6, 2017

My contribution to August Open Perspective: What are Open Education Degrees?

I was invited to contribute to the Open Education Consortium's Year of Open (that's this year) Open Perspectives pages for the month of August. My modest contribution appears here (about halfway down the page). Special thanks to Una Daly for reaching out to me, and to Steve Phillips for reviewing my response and making several excellent suggestions.

Monday, July 31, 2017

Movies I Haven't Seen (and May Never See)

This represents a break from what I have usually blogged about to date, but it's a young blog, and anyway, I need to stop thinking about work and my research. (I'll get back to all of that soon.) Being who I am, though, I can't help throwing in the academic angle. So here is an irrelevant post.



I think the idea of cultural literacy is more or less dead, since it has typically been used as a proxy for arguing that Americans (or Western Civilization, more generally) should all embrace and adhere to a standard canon of all the great works of art. Many would include movies in discussions of the canon, and certainly my friends and colleagues often do.

I’ve often felt left out of the conversation when it comes to certain movies that of course everyone has seen (except me). I know enough about them to nod in vague agreement or to cover by saying something like, “I’ve heard that the director…” whatever seems appropriate to say at that point.

But it is time to come clean. This list could change, if someone insists I must see one of these. But that has happened before and I have resisted, mainly through lethargy or a reluctance to watch a three-hour epic. But go ahead—make a case. Or share your own list.

8-1/2
A Separation
Alien
Alien 3
Alien Resurrection
Aliens
An Officer and a Gentleman
Beauty and the Beast (any version)
Ben-Hur
Blade Runner
Dawn of the Dead
Django Unchained
Exorcist
Friday the 13th (any of them)
Frozen
Full Metal Jacket
Gandhi
Hateful Eight
Home Alone
Hurt Locker
Inglourious Basterds
Jurassic World
Kramer vs. Kramer
Lawrence of Arabia
Life of Pi
Lord of the Rings (the whole trilogy)
Malcolm X
Million Dollar Baby
No Country for Old Men (but I read the book)
Once Upon a Time in the West
One Flew Over the Cuckoo’s Nest
Paranormal Activity
Rogue One: A Star Wars Story
Scarface (I did see the 1931 version)
Seven Samurai
Shawshank Redemption
Slumdog Millionaire
The Aviator
The 400 Blows
The Help
The Lion King
The Passion of the Christ
The Pianist
The Professional
The Revenant
The Twilight Saga
There Will be Blood
Top Gun
Whiplash (even though my son is a drummer at the same high school where the director attended)
Wolf of Wall Street
Yojimbo

Monday, July 10, 2017

The Future (?) of PLA



I recently returned from the 29th National Institute on the Assessment of Adult Learning, which I also direct. (This is partly why there has been so much time between posts.) As much as I love being handed a microphone and acting as host to all of these educators and assessment professionals, I do find that the role is harder to fill every year. It’s not my energy level flagging (I think). Rather, it’s the nature of the main topic of the Institute, Prior Learning Assessment (or PLAR for you Canadians, or RPL or CPL for other people). It’s been around for 45 years, and it’s a valid method of assessing the learning that adults acquire through work, military experience, hobbies, or any external learning experience. It’s also changing and evolving, which keeps it interesting: institutions have introduced new methods and approaches for translating learning into credit that students can earn toward a degree. PLA links education and the workplace: competency-based education really does come directly out of the PLA world.

The problem, however, is that, on the one hand, PLA is being co-opted by people who don't understand it, and on the other hand, it is being shoved to the side by institutions that mistakenly see it as a time-waster and an unnecessary expense.

Both of these issues have everything to do with money. Not that this is surprising.

Prior Learning Assessment has its roots in the radical challenge to authority of the 1960s that affected all institutions. All sources of traditional authority were called into question, and higher education was no exception. Why was it that only learning that one acquired within the walls of the ivory tower had value? Why couldn’t learning that none acquired through experience or through less formal training also be valued? PLA was seen as liberating and transformational, as the everyday learning one acquired was suddenly valuable and validated. (Yes, it still had to be validated by people in the ivory tower, but it was a good step.) At first only a handful of institutions did PLA, and these tended to be ones that were exclusively adult-focused: my institution, SUNY Empire State College, Charter Oak State College, and a few University Without Walls programs that sprouted up at places like UMass-Amherst and the University of Minnesota.

These programs existed to transform the lives of adult learners, to expand access to education, and to make people feel that they were not imposters—that they belonged in the college classroom, and that their knowledge was as valid and as relevant as anything a professor might teach them. While this idea has not been accepted by everyone—many college faculty members still raise questions about the rigor of PLA, and the notion that something learned on one’s own could be as good as something a professor could have taught them—it has certainly gained a foothold in higher education.

Recently, though, the idea of leveraging learning acquired outside the classroom has been co-opted by those looking for ways to crank out more college degrees and increase the number of adults with credentials, without spending more money on higher education. Rather than add classroom space, why not just increase the number of credits students bring in from outside and get them closer to the finish line? While this isn’t a bad idea in principle, it’s being applied by a number of state systems without any sense of the empowerment and transformation that PLA should represent. Instead, it’s a cynical move on the part of politicians who are mistrustful of their public institutions, instituted as a way of suggesting that the ivory tower is indeed not as valuable as its inhabitants believe.

On the other side of the coin, PLA is seen by some as expensive and irrelevant. Studies have consistently shown that students who use PLA persist in college longer and have much higher graduation rates—in other words, students who earn credit via PLA actually take more courses with you, not fewer, because they are less likely to drop out. However, misguided faculty members and bean-counters look at the costs and revenues for the numerous methods of prior learning assessment on their own terms, and don’t relate them to the success of the overall enterprise. They see PLA as either a shortcut to college credit, akin to what a diploma mill would do, or as taking students out of their own courses in favor of the cheaper PLA methods. Cheaper must mean less profitable, right? Actually, wrong.

I think the problem here, as it is at my own institution, is that people are not sure to which category PLA methods belong. Are they an academic offering, comparable to courses? Or are they the same as transferred courses? Or are they a recruiting and enrollment management tool, to be compared to the expenses incurred by Admissions and Marketing and Advising?

I think PLA has something in common with all three, though they should be considered to be their own category. PLA is an academic offering, a method of documenting and addressing the learning outcomes of a course: courses are just one way to earn credit. As such, PLA methods utilize a rigorous approach to assessing students, in that the assessment is focused on the actual work produced and how well it demonstrates mastery of the subject—whether someone showed up to class or made smart comments in class is not part of the determination of credit.

Credit earned via PLA is also like transferred credit form another institution—it is credit earned elsewhere that your institution agrees to accept toward your own degrees. I am not aware of any institution that it trying to limit admissions to transfer students—why the double standard?

Finally, the idea that PLA competes with an institution’s own traditional offerings is flat out wrong-headed. Students do not, and should not, use PLA as a kind of independent study. (There is much to be said in favor of self-paced independent study for those students who prefer that approach, though.) On the other hand, forcing a student to enroll in your regular courses when they already know a subject is a waste of time, both the student’s and the instructor’s. Short-sighted institutions look at the cost of tuition for a course, and compare that to the cost of a portfolio assessment or a challenge exam (which is usually much lower), and they think they are actually doing math when they arrive at the conclusion that they will make more money if they get students into courses. Which, again, is not true. Students have options: they can drop out or transfer, or, if they are told this when they arrive, they can simply choose not to enroll.

All of this is to explain why I am so discouraged at the end of the National Institute. Even my own institution has fallen prey to both of these misguided tendencies, driven by the fear of the market, and not knowing how to develop a sustainable business model: the quick, cynical fix, and the pursuit of the short-term gain, at the cost of the long-term gain and the sacrifice of the mission.