This was a major topic of conversation at Educause last week, and I had the chance to chat briefly with Adrian Sannier of Pearson on the exhibit floor–and also to try it out myself.
A few quick facts/impressions. A lot of the early buzz was about “Google’s new free and open source LMS” or similar. Almost none of that is accurate. It’s not a Google product, it’s a Pearson product. It’s available (for now) through the Google Apps marketplace, and integrates (or will–this week, they’re promising) with an existing Google Apps for Education database if you have one. But everyone I talked to from Google was very quick to point out that they didn’t develop this, aren’t offering it, don’t really have much of anything to do with it. They marched me straight over to the Pearson folks if I even tried to ask a question.
It’s also not at all Open Source. Pearson uses the term “open” very very loosely–so far I haven’t seen anything at all open about it. Adrian Sannier says that that is coming–some way for teachers to identify parts of their courses that could be shared with a wider network, multiple campuses or maybe all users of the system or maybe the whole world. But that’s not available yet. And the source code is definitely not open or available. There aren’t even API’s yet (although again, Adrian promises that there will be).
What is, however, is free of charge. That’s the main “selling” point, and when asked if that’s the distinguishing feature he would most want to claim, Adrian was very clear (both to me and to my friend Michael Feldstein. Michael has a very good blog post about OpenClass here ). This is not going to cost anyone money–free as in free beer, not as in free speech–and that’s what they’re proud of and what they’re promoting.
For now (and this should change sometime early in 2012), OpenClass is only available to Google Apps for Education campuses. Since we at Macaulay do use Google Apps for education, I (like hundreds of others) went immediately after the announcement and installed OpenClass to check it out right away.
I could talk at some length about what I discovered in testing–and we’ll be doing a lot more testing and trying (maybe for some spring classes, perhaps) as time goes by. It’s still very much in beta, with some features that aren’t quite working yet–some of them essential–and some little bugs that they’re still working on. The Pearson people seem to be extremely committed to fixing those bugs–they are responsive on twitter and by email, and in fact, when I pointed out a bug to their folks at Educause at about 3 in the afternoon, they called me back with more questions within 45 minutes, and then had the problem fixed by dinnertime that same day. That’s impressive, and not something that most LMS vendors would ever dream of doing for an end-user. That kind of response is reserved for high-level “escalated” tickets. Will that last? Who knows. But it did leave a good taste in my mouth.
As for the product itself, even given that it’s in beta, I have to say and somewhat hate to say that I’m not all that impressed. It’s an LMS. A fairly ordinary LMS. It’s not got revolutionary features, and the so-called social networking integration (mostly just an activity wall pulling together everything that is happening throughout the LMS for a given user as a main front page) is pretty much a big meh. The discussion board is not particularly attractive or navigable, and the general features (gradebook, announcements, submission/dropbox, assignments, documents) are just standard. Functional, but nothing interesting. The design is fine, but not very elegant and hardly customizable at all.
This is a standard LMS for a class (not a fully online class, Pearson is trying to make that distinction very clear) where a teacher and students want to do the basic LMS stuff–post a few things, assign and submit a few things, check grades, have a little bit of discussion–mainly just for asking and answering questions, not what I call a “real” online discussion (wide-ranging, digressive, engaging, critical, multi-media). Multi-media capabilities are limited. Sharing with the world outside the classroom, or escaping the silos of course and semester that the LMS is so married to, are both just about non-existent.
But all of that could come. At least for now, the promise or potential for most of that seems pretty strong. And one thing that Adrian also pointed out–with a free LMS, upgrades and new features can come much more quickly and easily. Most of the time, they will come fairly transparently. Nothing at all like an “enterprise” LMS upgrade. So that all remains to be seen.
I’m really interested to see how this will open beyond Google Apps for Education. When (and again, it could be just a few months) this opens up more widely, will that be to all Google customers? So that if I’m not affiliated with any institution, but I want to (for free) set up a class where I could teach and/or learn about birding or reef aquaria or the history of haberdashery, can I do that? And can I do it in a way that will make sense for learners–not just for a traditional class/semester-based type of education? Open questions!
I will also say that OpenClass is still a long, long, way from being even a bit close to the kinds of features and functionality, and from the kind of “disruptive” innovation that we are already seeing and demonstrating and doing at Macaulay (and elsewhere, of course) with WordPress. It’s like some of us are already working with refining a very low-cost and efficient warp drive technology, while Pearson has just introduced a fairly nice three-speed bicycle which they will give away for free.
But…when the overwhelming majority of classes in this country are riding around right now on a ten-speed bicycle, for which they are paying $100k a year (or whatever), a nice shiny three-speed for free is going to sound like a pretty good deal. If possible, though, I’m always going to want to do the deeper exploration that a cruising speed of warp 6 or 7 can allow.
Big news today in the field of Open Educational Resources!
I’ve posted before about my admiration for smarthistory.org (and I do have a personal connection!). Today the news is out that they have joined forces with the Khan Academy. Two fantastic OERs are now working together, and the world of open learning, available to all, is wider than before. This means great things for smarthistory, great things for Khan Academy, and great things for learners everywhere.
Here’s the announcement direct from Smarthistory:
Dear Smarthistory Contributor/Supporter,
We have some terrific news! As you know, Smarthistory has been growing fast. Our content and usage numbers are way up (visits are now over 150,000 per month) and we have been working hard to make the site an indispensable resource for students and informal learners. At the same time, we have been actively looking for similar initiatives. For the past year, the one that we were most excited about was the Khan Academy (www.khanacademy.org). So you can imagine our excitement when Sal Khan contacted us. To make a long story short, we’ve joined forces.
Rest assured, Sal and the rest of his amazing team are committed to the same principles as Smarthistory. Their content is entirely free, uses the same creative commons license that we do, and they accept no advertising. Like Smarthistory, Khan Academy is fully committed to open education, and they are also a not-for-profit. And Smarthistory isn’t going away, it will retain its own identity, but within the Khan Academy umbrella. As of today, Smarthistory.org simply redirects to Smarthistory.khanacademy.org (they have MUCH better servers!) (EDIT–Not anymore!)
If you’re not familiar with the Khan Academy, here’s some info from their site:
Khan Academy is a not-for-profit with the goal of changing education for the better by providing a free world-class education to anyone anywhere.
All of the site’s resources are available to anyone. It doesn’t matter if you are a student, teacher, home-schooler, principal, adult returning to the classroom after 20 years, or a friendly alien just trying to get a leg up in earthly biology. The Khan Academy’s materials and resources are available to you completely free of charge.
And if you haven’t seen it, watch Sal’s TED Talk to get a better idea of their history and goals and how they’re using learning analytics to “flip” the classroom:
or read this recent article in the Economist: http://www.economist.com/node/21529062.
We look forward to continuing to work together to create open resources for art history education.
Beth & Steven
Khan Academy’s blog post about the news is here.
This is a little (hell, VERY) technical–but it might be useful to some, and it seems like my most technical posts get the most attention somehow! 🙂
When running a WordPress site with multiple authors (a class site is a perfect example), sometimes you want to see all the posts by one author gathered together. WordPress makes this quite easy–you can just go to www.name-of-site/author/authors-username . Or there is even a sidebar widget to automatically list all the authors names, linked to those pages with all their posts.
But we’ve found that many times, on a class site, a professor (or maybe even visitors to the site like other students) will want to easily review everything that a given student has done. In other words, they want an author archive page that includes all the posts by that author, and also all the comments that that author has left on posts written by others
This was surprisingly difficult to find a way to accomplish. There are a couple of plugins that do something like this–but not exactly–and I couldn’t even get the best candidate among them to work at all.
So I decided to get my hands dirty. When WordPress displays that author’s page, it looks (first) for a file called author.php . And you can (in a child theme or editing a theme or creating a theme) customize that file to display what you want.
I made a child theme of the Twentyeleven default theme, and put a new author.php file in that child. The code is already there in the existing author.php to queue the first post, identifying the author, and then run the loop to pull all posts by that author.
I added a small piece of code–of course this has to be enclosed in the usual <?php and ?>
$comment_author = get_the_author_id()
That just pulls the author_id that we’re going to need in the next bit of code to find all the comments by that author.
Then the next bit of code, which took me far too long to figure out how to write, grabs all the comments by that author, and displays them one by one, with each one including a line about when it is was posted, and what post (with a link) it was commenting on. This could all be customized–and yes, this also needs to be enclosed in <?php and ?>
$comments = get_comments(array(user_id=>$comment_author));
foreach($comments as $comment) :
$url = ‘<a href=”‘ . get_permalink($comment->comment_post_ID) . ‘”>’ . get_the_title($comment->comment_post_ID) . ‘</a>’;
echo (‘”‘ . $comment->comment_content . ‘” <br> –( posted on ‘ . get_comment_date(‘M j, Y’) . ‘, commenting on the post ‘ . $url . ‘ )<br /> <br>’);
If you try copying and pasting that code, do be careful about the single and double quotes. I’m not going to bother fixing them all, but they do need to be plain, not curly or “smart” single and double quotation marks. The code is fussy that way!
That’s about it. I also changed the template a bit so that the posts would not be displayed in their entirety, but just as titles linking to the full posts. And I turned off pagination for this page.
An example of it in action, which may not last, since it’s a demo site I use for lots of things, is here.
Hope this is useful for anyone who comes across it!
I’ve been getting some inquiries, and it’s been a while since I last described our eportfolio setup, so I thought I might put it all in a post instead of copying and pasting into various emails.
We host our eportfolios on an external server. It’s a dedicated server, all ours–but it’s the same server we use for many other purposes, so it would be misleading to think that it’s all for the eportfolios. But in any case, it’s got a quad-core xeon processor with 8gb of RAM. We backup nightly, and backup the databases four times a day. We currently have close to 2000 sites and a similar number of users. At this point we’re doing fine on hard drive space (we have 150GB, with two drives in a RAID), but the vault we use for backups is smaller and getting pretty full. I think we will be needing a storage space increase next year.
We’re using WordPress (with Multisite), keeping up with version upgrades fairly religiously (3.1.3 as of today). We’re running Red Hat Linux, and we have Apache 2.2.3 PHP version 5.3.6 and MySQL version 5.0.45.
The WordPress install is pretty much stock, out-of-the-box. I try not to modify the core code if I can avoid it, because it just causes hell around upgrade time. However, there are a couple of exceptions that help with security and spam prevention. One is that I’ve renamed the file wp-signup.php, and deleted the wp-signup.php file that normally exists within BuddyPress. The other is that I’ve completely deleted wp-trackback.php. That means no trackbacks, but trackback spam was just killing us otherwise, and since we don’t/can’t use Akismet (more about that below) it was the only option (the nuclear option) to get rid of the trackback spam problem. I do also use a translation file to change the word “blog” to “site” throughout the admin interface.
This is where things get a little complicated. We have about 140 plugins available (219 themes), and just about all of them have some value, at least to someone. There are a few that are orphaned, and I’m overdue for a cleanout of those, but for the most part they are there because somebody wanted them and is using them. And I don’t want to really review/explain all of them. But I will give the highlights–the ones that we use the most often and find the most valuable. (All of these, except where noted, can be found by googling–they’re mostly in the WordPress repository).
System-wide there are five plugins in our MU (must-use) folder:
- PostByMailEnabler–This one is probably not a total “must use,” but it has been useful for some students, particularly when traveling abroad. It allows the “post by email” function that is otherwise only possible in a stand-alone WordPress site.
- Signup Question–This is a critical plugin for us. Because we do not limit user registration by email domain as most campuses might, we have to have some way to control who registers–to limit it to our students and alumni. Signup Question lets me pick a codeword, and only people who have the codeword can register. It’s a simple matter to give the codeword to our students, or anyone else who we think should have an account, and when/if that codeword gets compromised, it’s a simple matter to change it.
- Userthemes Revisited Plugin–Actually, Userthemes, and even Userthemes Revisited, do not work in the current version of WordPress. But thanks to the heroic efforts this semester of a student intern, we do have a working version of this plugin, with about 99.5% of its functionality. It’s not in the WordPress repository yet, but I hope to get it there soon. In the meantime I can share it by request. This is a fantastic plugin IF you are running a multisite installation with some small group of users who are extra skilled and extra trustworthy. They can (once you allow them) edit theme files to their heart’s content, without harming or affecting the theme itself–and you don’t have to give them FTP access or do any FTPing for them. They can go beyond just editing the CSS, and edit the PHP and HTML code of the theme files. As you can guess, this can be dangerous–they can do tons of damage if they’re malicious–so you really have to only use it for trusted users. But for them, and in those cases where editing the CSS (more about that below) just won’t do what they need to do, it’s invaluable.
- WordPress MU Theme Stats–Probably not critical, but I find it useful to see what themes are being used by which sites, and it helps to know that it’s safe to eliminate some themes if they’re not being used by anyone.
- WPMU Plugin Manager–WordPress multisite with its “Network Activate” option for plugins takes away some of the usefulness of this one, but not all. I like the fact that I can have some plugins I might not be ready to give everyone access to, but still have them available for my couple of super-admins, or with discretion for a few users. Sometimes there is a plugin that is good to have, but only for some users, not all. This gives that control.
Then there are a bunch of other plugins–here are some of the most critical. Some of these are most useful for class sites (and we have a lot of those). In many ways, aside from using WordPress as a personal eportfolio platform, we also use it as a kind of an LMS–for “class eportfolios”–I’ll try to note those cases, because people looking just for individual eportfolios might not care about those:
- Add Users Sidebar Widget–This is one that is very useful for class sites. In fact it’s the main way we have students added to those sites. It takes the responsibility for populating those sites out of the faculty (or staff or admin) hands, and puts it into the students’ hands. They have to actively join the site, instead of waiting passively for “someone” to set up their accounts.
- Admin Ads–Maybe not critical, but handy for administrators to give a message to all users–like “we’re going down for maintenance tomorrow for three hours!” or “The eportfolio expo is coming up next week!” You can style the announcements and add images…but of course, like any mass announcement, you want to use it sparingly.
- Anthologize–Takes your WordPress site and turns it into an ebook–or pdf. Early stages, but awfully useful for archiving, and a kind of publishing.
- AStickyPostOrderER–an unofficial version by Max Bond to work with current WordPress version. Allows manual ordering of posts, without the kluge of altering publication dates. Really makes WordPress more of a publishing platform and less of a blog platform.
- Auto Thickbox–OK, not critical, but I like Thickbox popups for images. I really do. Students seem to, also, so this makes every image link into a pretty thickbox popup link.
- BuddyPress–Adds social networking to the eportfolio platform. Groups, friends, profiles, for all users. This is something students requested very strongly…but then never really used it too much. It’s there, and some use it, especially as they’re getting started at the college, but they seem to migrate pretty quickly to their own other platforms (facebook). A college-specific social network is something that seems nice in the abstract, but doesn’t appeal quite so much in the reality. Still, it’s there, and it does get some use, and I wouldn’t want to take it away.
- Capability Manager–Very useful on some class sites where the standard WordPress roles and capabilities aren’t fine-grained enough. Some faculty want students to be able to do some of what Editors do, but not all. Or all of what Authors do, and even a little of what Admins do. This plugin lets the admin choose exactly what each user role can do or not do.
- Category Order–Pretty much what it says. Makes it easy to put categories into different orders for arranging menus. Custom menus in newer WordPress themes makes this unnecessary, but for themes that don’t support custom menus, it helps.
- Digress.it–So powerful and useful for classes, and for individual publications, but hasn’t seen that much implementation for us yet. Waiting for the right project, I guess. Allows paragraph-by-paragraph commenting (annotation!) on a posted text.
- Easy Facebook Like Button–Students like this a lot (ha!). Their friends can easily “like” a post, and then everyone on facebook knows about it! We have some students very savvy about social networking and promotion.
- Email Users–NOTE–this can NOT be used anymore! Causes Mysql to crash in big installations! Critical for class sites. One of professors’ most-requested features. They want to blast an email to all their students, or to selected students, and this makes that relatively simple (sometimes students send the emails to their spam folders–not much to be done about that!)
- FD Footnotes–For students interested in using their eportfolios to publish research work, this makes footnotes extremely elegant and simple.
- Grader–For class sites. Enables administrators to grade posts, and for users and administrators to view their grades through a gradebook-like interface.
- Keep IFrame–stops the problem of WordPress stripping away iframe tags (for example, for google maps or dipity timelines) when they are in posts.
- More Privacy Options–Critical for us. Makes privacy options human-readable and more fine-grained. Users can choose from:
- I would like my site to be visible to everyone, including search engines (like Google, Bing, Technorati) and archivers
- I would like to block search engines, but allow normal visitors
- I would like my site to be visible only to registered users of this network
- I would like my site to be visible only to registered users of the site itself
- I would like my site to be visible only to Admins.
This plugin (along with password protecting posts and pages), is critical to our philosophy of allowing the students themselves to actively consider and determine (and change at will) what is public and what is private on their eportfolios
- NextGEN Gallery–Very heavily used (although it’s a bit of a steep learning curve) in class sites and some individual eportfolios. A great solution for displaying galleries of images (slideshows, albums, etc.)
- Page Links To–Lets you link a page to any URL–a specific post, an external site, whatever. This makes organizing menus much more effective. Along with custom menus, you can really design a site navigation with this.
- pageMash–Quickly and easily change page orders and parent/child relationships. Another good navigation organizer.
- podPress–generally we encourage the posting of video files to youtube or vimeo, to try to spare our storage space. But when that’s not possible, because of privacy concerns or other reasons, or when there’s an audio file to be posted, PodPress is an excellent solution. Upload the file to the site, enter the URL in PodPress, and there’s a nice embedded player with good options and functionality. Also can produce an iTunes-compatible feed, although that’s not something we’ve had much interest in yet.
- Private Comments–Mainly used for class sites–but could be helpful for any case when an outside evaluator is to look at a student’s eportfolio. It lets the commenter preface the comment with a (configurable) short-code, and any comment so prefaced will only be visible to the commenter and the author of the post being commented on.
- Simple:Press–I can’t say enough in praise of Simple:Press for class sites. This is a fully-featured, completely functional, discussion forum platform. It’s not just a plugin, it’s the equal (or better) of phpbb or ip.board or vbulletin. And it’s completely free. Far better than bbpress. Because it’s so feature-rich, it’s a bit complicated to setup, but so elegant and usable. There isn’t a better threaded discussion forum platform.
- Simple Import Users–for class sites–IF you don’t use Add Users Sidebar Widget (above). IF you’d rather import all the users from a list and set up their accounts for them. This plugin does it. But again, philosophically, I’m opposed to this approach for students. I think the active engagement of creating and managing their own accounts is preferable.
- Site Template–This one is CRITICAL to our model of giving students freedom to design different types of sites, but still giving them some guidance as to the fundamental outlines or beginning steps. Site Template lets a super-admin build some sites–selecting for each one a theme, a set of plugins, even default pages and text on them. Each of those sites can then (with one click) be labelled as a “template” and any new site, at the time of creation, can choose to use that template. In this way students have a starting point–any part of which can be altered as they choose. Templates can be added or subtracted at any time. We currently give students six template options:
- A Basic, Flexible, Reflective Eportfolio
- A Resume/Career Eportfolio
- A Photography/Artwork Eportfolio
- A Study Abroady/Travel Eportfolio
- A Fun, Whimsical Eportfolio
Each one has specific starting structure–but none of those structures are permanent. They’re just a kind of default scaffolding. And we might well add another template or two soon.
- Subscribe To Comments–WordPress automatically notifies an author of a comment on a post. But students who leave comments like to be notified that somebody else has commented later, and sometimes discussion gets going that way.
- TinyMCE Advanced–mainly useful for tables! Students seem to want to organize content in posts into columns and rows (for example, to have control over where pictures and text appear). They don’t have to know the code to create tables, if they just use the toolbar buttons TinyMCE Advanced can provide.
- Who We Are–For class sites, makes a nice-looking page of all the authors on the site, pulling their info and avatars from their BuddyPress Profiles
- WordPress.com Custom CSS–This plugin almost, almost, makes userthemes unnecessary. For the more advanced design-minded students, they can control almost all the styling of their site, without ever touching the original theme’s stylesheet. Safe and effective. And (especially with Firebug in Firefox, or “inspect element” in Chrome–but I prefer Firebug), it lets students begin to learn some CSS, which is sure to stand them in good stead. Even for things like removing the “posted on date” or “posted in category” lines below the titles of posts (something that many themes include, and many students don’t like), they can just learn the use of display: none; . Et voila!
- WP-reCAPTCHA–As I mentioned above, we can’t (aren’t presently willing to) use Akismet. I understand that Akismet has to pay their own bills, and I understand that they’re trying to come up with some model for educational pricing (and I hope they will soon, and I think it will be fair). But right now, for a network like ours, we would have to pay more than we can afford. And I respect what they do too much to cheat on that. So until the educational pricing model comes out in a way that will work for us, we have to have an alternative anti-spam solution. WP-reCAPTCHA stops all the spambots (except trackback spam which I kill using the nuclear option described above). It doesn’t stop human-created spam, but that’s a tiny problem. I know that CAPTCHAs are a pain. I know that they may discourage some commenters. But for now, it’s the solution we’re using. At least reCAPTCHA does some good for a larger project.
That’s about the size of it, as of the date of this writing. In the fall, with a whole new crop of freshmen, things will change again. And a new WordPress version will be along soon, too. So I probably shouldn’t wait two years again without updating this!
(And I didn’t even talk much about themes–we’ve got an awful lot of those! and with userthemes and customs css, I suppose you could say we even have infinite themes!)
Our motto for our eportfolios at Macaulay (one of our mottoes–I tend to proliferate mottoes) is “Collect, Reflect, Present.” That spells out (not necessarily in order of priority) what I thought students would be doing with eportfolios, and those goals, from the beginning, have shaped the choices in building our platform. But there is another purpose to which eportfolios are frequently put, and it’s a purpose that I want to untangle a little in this post.
We don’t say “Collect, Reflect, Present, Assess.” (Although it could be easily argued, and I’ll argue a bit below, that “Reflect” really can be a kind, an excellent kind, of assessment). We didn’t implement a system or a platform that was primarily designed to assess our students’ or our program’s fulfillment of predetermined or externally structured criteria.
As I mentioned in my previous post, we have a system that works more organically, more flexibly, allowing students to determine for themselves what (if anything) will happen with their eportfolios, what they will collect, reflect, and present, and even what they will assess. And as I described in that previous post, that choice of approach has had implications for what quality of eportfolios we get (in a very good way), and implications for what quantity of eportfolios we get (in a way we’re working on improving).
But we have also reached a point where assessment can be very productive–not the kind of assessment that checks whether standards are met or pre-designed structures filled in. I would call that kind of assessment “measuring up” (as in “does this eportfolio measure up?”). We’re at the point where we can do something more difficult, but (possibly) more substantive and more useful…”measuring” (as in “how can we describe what is happening with this eportfolio? What does it tell us about this student?”)
For a long time I had a sort of inferiority complex about the question of assessment in regard to our eportfolios, because our approach is really not well-suited to the kind of quantitative, universal, standardized approach that many people mean when they say “assessment.” Because what our students are doing with their eportfolios takes so many different forms, it’s not easily possible to say “yes, this one measures up. No, this one falls short.”
And the more I thought about this, the more I began to think back to my own history with portfolio assessment (before the “e” even existed) as a writing teacher. I thought about how and why portfolio assessment entered writing instruction and where it came from. The whole point of portfolio assessment, originally, in writing instruction, was to provide alternate assessments–richer ones. More nuanced and complicated ones. To assess the things (like writing ability) that are NOT easily or accurately assessed by a single test, or a single score.
Portfolios in writing instruction were about growth, about process, about diversity. They were implemented specifically because the picture of a student as a writer can not be reduced to just data or skills. Writing teachers sat with students’ portfolios for long periods of time. They looked at everything. They read drafts and students’ reflections of how drafts became final products. They read students’ thoughts about what each piece of writing said about the student as a writer. They thought about students’ choices, and their reasoning for their choices. They thought about what and why students were collecting. How and when they were reflecting on what they collected. Where and to whom and how they were presenting what they collected.
Portfolio assessment at its best can be qualitative assessment, formative assessment. Not just summative assessment leading to a grade or a score or a single evaluation, but deep description leading to more process and more progress, feeding back into more recommendations and more learning for the student, for the eportfolio system, and for the program.
I’m not sure why I originally fell into a prejudice that this kind of deep assessment was somehow “soft” or “just anecdotal.” Somehow not “real” or “valid” assessment. I know very well from my own research and scholarship that true observation and deep description are not less effective and less important than numbers and graphs or rubrics and scores. In fact, in many cases, in many disciplines and types of research, from participant observation fieldwork to the Scholarship of Teaching and Learning, I know very well that measuring is actually often superior–more comprehensive, more insightful, more detailed, more useful for planning and changing and learning, even more accurate and “objective” and transferable–to measuring up.
Rather than scoring on a rubric, or checking off items on a list of competencies (and I do not want to imply that “measuring up” like that is never valuable), the kinds of questions we can be asking about eportfolios (and are starting to ask)–measuring, studying, deep assessment questions–are the kinds of questions that always get asked in the Scholarship of Teaching and Learning. Pat Hutchings (in the introduction to Opening Lines: Approaches to the Scholarship of Teaching and Learning) frames them like this:
- “What works?”
- “What is?”
- “Visions of the possible”
- “Theory building” questions
These are the kinds of questions that eportfolios like ours (and many others, I don’t mean to sound exceptionalist here) can answer so well (or lead to more depth in the questions).
So the techniques we’re planning and will be implementing over the next months for assessing eportfolios will take that kind of path. We will work by selecting a representative (random or intentionally selected–there is validity in both methods) sample and doing some deep description, including content analysis, tagging, and coding for comparison. Not starting with the rubric, but starting with the eportfolios (“What is?”) and moving from them to the careful and nuanced judgments (never complete, never finished) about “what works?” and then to those “visions of the possible” and “theory building.” We can see what is happening at certain points, and then see how that changes over time, and get a very accurate and well-developed sense of what is happening system-wide, or with individual students. We can do some almost-ethnographic work with the eportfolios, and start to measure how they work, what they can do, and we can see pathways that students are taking that we might not even have imagined.
To assess eportfolios in this way will not be rapid or efficient or automatic. It will be time-consuming and push us to question what we’re looking at, what we’re looking for, what assumptions we’re bringing and what conclusions we’re reaching for. It will push us to think about teaching and learning in deeper ways than “value added” or “standards-driven” or even “general education.” And we will hew more closely to the origins of eportfolios in portfolio assessment, in authentic assessment. When you select a sample and discuss and think about how it’s being sampled, and when you ask a team of experienced thoughtful raters to look at each eportfolio in the sample, and not just “score” it, but code it with keywords, describe it and analyze it, then you’re measuring. And you’re getting a rich picture of student learning, with real results that can be applied beyond a grade or a score (for a program or a student). Some of this (once the codes are developed) can be done by content analysis software. But the bulk of it is human judgment. And that’s what’s really good about it.
Maybe there’s an important fight to be had. When administrators (and I speak as one) start to ask for assessment, maybe we shouldn’t (maybe I shouldn’t) be too quick to bend and say “yes, let’s see if they measure up.” Maybe we can find a way to use eportfolios to help with the process that portfolio assessment in writing instruction started…to promote alternate assessment where learners and learning are explored and understood, not just rated and scored.
Some early thoughts, anyway–lots more to be said on this.
(An excellent article on this subject, one that influenced me a lot, is by Minnes and Boskic at UBC from 2008 “Eportfolios: From Description to Analysis.” http://www.irrodl.org/index.php/irrodl/article/download/502/1050)
At Macaulay, for a wide range of reasons (some of which I described back when we first got started), our eportfolio system has always been what I like to think of as “organically” growing. Our students build eportfolios because they want to, and develop them when they feel the need to, and (except for the class sites, which are a different kind of animal, usually), they aren’t really required to do anything in particular with them. We try to support and encourage and recognize–maybe gently guide–with an approach of “opportunity, not obligation,” (or my own favorite metaphor of letting students make their own curving and self-directed paths across campus, rather than paving straight diagonals for them to follow).
This gives us a collection, we’ve found, that is long on quality (in many cases), but not necessarily so long on quantity across the system overall. We have some very strong individual examples, but choosing any random eportfolio, it’s never very predictable what you will get. Something just beginning? Something with a potentially great idea, not developed yet? Some great blog-like reflections, without an overall pattern or structure? A pattern or structure without much content in it? Or a fully-developed (but still quirky or individual) eportfolio? In a system that grows organically, any of these are possible, and all of them are “success,” because it’s really about process, more than product. An eportfolio that is almost empty today, with just a few default posts, is no more a “failure” than a freshly plowed field might be, before anything has been planted or sprouted.
But this year I wanted to think more about the “gently guiding” part of our obligation to support these projects. Not to force or restrict or compel, but to illustrate and exemplify and honor. I thought that by featuring, showcasing, some examples of the many approaches and processes that were happening with the eportfolios, we could achieve some goals that I felt were good for our students, for the project, and for the college (and maybe broader audiences, too).
Those goals were these:
- I wanted to recognize the diversity of eportfolio approaches
- I wanted (through peer pressure and positive reinforcement) to encourage students to spend some time and effort developing their eportfolios, no matter what the different approach they chose
- I wanted to draw some internal (among our students) attention (“buzz”) to the eportfolio system and its uses
- I wanted to do the same for external audiences
- I wanted to push students to reach out for help to push their eportfolios to do things (in terms of design, in terms of content, in terms of features) that they didn’t know how to do.
So, in other words, I thought we would have an “Eportfolio Expo.” This was not, by any means, a new idea. Just about every eportfolio program I know of does some kind of “expo,” or “showcase,” or “festival.” But my thought here, in this pilot event, was that we would solicit nominees–asking students to nominate their own or others’ as exemplary eportfolios in a wide variety of categories. And we would have some prizes, too. And I would be happy if we achieved even one or two of those goals, even partially.
So over the past weeks, we solicited nominations. And we got fifteen solid ones–and they are fifteen diverse ones, too. You can see all the nominees–with small screenshots and descriptions, and links (the title of each eportfolio is a link) to view the eportfolios themselves–on the gallery page that I set up (Next-Gen Gallery plugin FTW).
We did promise prizes (pretty nifty ones!) for the Judges’ Choice and the People’s Choice (more about that below), but one thing that really came out from the event on April 13, when the nominees presented their eportfolios, was that the evening, the nomination, the event, was about so much more than a prize. The commitment, the dedication, the genuine interest in sharing and recognizing and learning from each other, and the real joy in the diversity of approaches, was just inspiring. One of the Instructional Technology Fellows who was present even got a little teary-eyed at one point, and I have to admit to some of the same emotion myself.
It was a weeknight, a little before spring break (still during midterms for many students) but we still got about half of the nominees to attend, and several brought friends. Even students from Queens College and the College of Staten Island (our most “far-flung” campuses) were there. The students presented their work, we talked about eportfolios generally, we shared ideas about how to improve the ones we saw, we talked about plugins and class work and academic and professional work, and socializing and humor and movies and food. And we ate Magnolia cupcakes and drank coffee. Everybody got very jazzed and excited, and every one of them will be continuing to develop their eportfolios. And the friends who came (five Queens College freshmen in particular) will almost certainly be building and submitting their own for next year. The evening was promised to end by 8 PM, but we kept going until a bit past 9 PM–there was so much to show and learn.
While it was very much an informal and insiders event, I can’t say enough about how good the feeling and buzz was…even though none of the students who were there was the winner of the Judges Choice award (Maisha Lopa, the winner of the award, had to do a presentation for CUNY BA and couldn’t join us). It was real feeling of pioneering, getting started, planning and being on the ground floor–exactly what a pilot should be. Much of the talk was about how these eportfolios could and would continue to grow and change–how as nominees they were really snapshots of one single point in time of a picture that would never really be “finished” or set. Just the kind of emphasis on process that I was hoping to promote! Students even had updated their sites on that same day, in some cases making some fairly substantive changes and additions, even though the judging was over. And that same process, the same degree of ongoing change and looking back and looking ahead, has been going on even now that the event is over, too.
And now the event continues–because the voting for the “People’s Choice” award is still ongoing. This is open internet voting, and I definitely encourage anyone reading this post to visit the gallery, check out all the eportfolios, and then vote yourself! As of now, there are well over a thousand votes. And (the best part of that) the nominated students are telling me that they are getting comments and suggestions and appreciation of their work and their ideas and their efforts from people who had never seen their eportfolios before–from family members in other countries, from employers and faculty, and from fellow students–inside and outside of Macaulay and CUNY.
The judges also decided, after the event on Wednesday night, that one single Judges’ Choice was not enough. So there will be more Judges’ Awards, in more categories, after spring break when the People’s Choice voting closes. Those, of course, will also be announced on the gallery page.
This was a pilot, a first annual event. We’re getting great suggestions from students already about how to make it bigger and better next year, and I can really see this becoming a signature event–reinforcing something that is at the core of the eportfolio project–at Macaulay and everywhere. Sharing, presenting, reflecting, interacting…it’s all part of seeing the bigger picture of the “Museum of Me” that an eportfolio can be.
My own favorite Open Educational Resource is the webby- award- winning smarthistory.org (full disclosure– I do have a personal connection to the site and one of the founders!).
It’s a perfect example of what the future of the textbook can look like–embodying conversation, multiple media, a student-centered approach to learning, contextualized knowledge, active engagement, interdisciplinary learning, everything that the web can do that traditional textbooks can’t. And it’s completely free to students and faculty. And completely free in an arena (art history textbooks) where students usually have to spend large amounts of money for resources which aren’t nearly as useful for their learning.
But “free” usually means that somewhere, someone, is paying (TANSTAAFL). In this case, smarthistory has been funded by a combination of some generous grants, and a whole lot of volunteer time and attention and work from people who really care about it. That’s taken it a long way, and it’s very close to where it needs to be to become a true “textbook-killer.” After lots of research with college faculty and students, and high school teachers and students, and independent learners, all of whom are already using the site extensively, the smarthistorians have identified what it will take to make the site a comprehensive replacement for an art history survey textbook. They’re so close! To get over that final step, they’ve started a kickstarter campaign, to try to “crowd-source” the support they need. It’s an ambitious effort, and a real experiment to see if the community of users can, together, provide not just the intellectual and interactive support they’ve already been giving, but also a financial boost.
Smarthistory will always remain free and open to its users. That’s a commitment the team has made; it’s in the DNA of the project. With the help of the community, that can always be the case–for learners everywhere.
Visit the kickstarter page to watch a video intro and find out more.
Something interesting happened last week. I got a phone call from a gentleman who is involved in an organization of families and descendants of the victims of the Triangle Shirtwaist Fire. Since the 100th anniversary of the fire is coming up this year, the family members are coming together to organize memorial events and information for the public.
He told me that the family of one of the victims had asked him to contact me because they had come across a course website from one of the Macaulay seminars, where students posted their research about the Triangle Shirtwaist Fire. The site, from 2008, with the student’s research, was giving the family a good source of information about their ancestor.
One of the things the student noted in his research was that the woman he was studying had her name spelled in several different ways in some of the contemporary and historical sources he found. He speculated a bit about these misspellings, and tried to think about reasons they might have occurred. It was a good example of a student engaging with real historical research–the kind of problem that does occur when using primary texts.
The family members had decided, in recent years, that they wanted to standardize the spelling for themselves. So they contacted me to ask that on the site, we try to acknowledge their wishes. Easily and gladly done (with a simple note that the family contacted us and made the request–which added to the whole discussion of the various spellings)–and even better, I got to notify the student, now a senior, that the work he had done as a freshman was still around, still of value, and actually having an impact on the descendants of the historical figures he studied. Of course he was thrilled!
Frequently I hear an objection about having students do public-facing work: “What if they have errors? What if there are mistakes? Won’t it make us look bad?” I think this case makes a good answer. Yes. There will be mistakes (this is not the first time I’ve been contacted about a student-created website from a previous year). But no, they don’t make us look bad. They make the learning for the students (and the public) go on beyond the boundaries of the semester or the class, and they give students a commitment and an engagement to their work. And they give students real evidence that their work can really matter–that they can learn not just to think like historians (or literary critics or biologists or whatever), but to actually do what historians do. And to have their work have meaning for real people, outside the classroom and outside the college, in all the ways that historians’ work has meaning.
Some might say it’s not entirely worth it, but Alkivia Chameleon is a very nice and very popular theme, so I wanted it to work!
Unfortunately (as others have complained), since the latest update (was it the WordPress update? or the Chameleon update? I’m not sure), sites using this theme no longer have any posts appearing on the home page. Yuck. It’s like losing your whole homepage. And the workaround (using widgets) just wasn’t very useful.
So I did a little poking around, and until and unless the theme author gets things working again, I have a temporary fix that seems to work just fine. It seems that the file front-page.php was the problem. I went in via FTP, renamed that file (could have deleted it, but thought I’d better not take a risk in case I still needed it. So I just called it “nono.php.” Choose your own clever name).
So anyone else who has alkivia chameleon and WordPress 3.0, and wants to keep using both, just get rid of (or rename) front-page.php and you will once again have posts on your front page. Phew!