Click. Connect. Learn.

All posts in Portfolio + Assessment

The Web Is Your MOOC, and Portfolios To The Rescue

I'm getting ready to head in to DrupalCon, where over the next few days I'll be talking education and open learning with anyone who is interested.

And as I'm heading in, I have MOOCs on the brain - not because I'm particularly a fan of MOOCs, but because of the tendency to take a great thing (in this case, information and interpersonal exchanges distributed broadly over the web) and reduce it into something that feels more manageable, but is ultimately something lesser (in this case, MOOC platforms). More on this later.

The Web Is Your MOOC

Part of the reason that I'm thinking these thoughts prior to heading into DrupalCon is that I've long held the notion that open source communities have been engaging in effective peer-supported learning, even while many for-profit companies and academic communities have been struggling to distill the process of peer-supported learning into something resembling a replicable product. From having participated in and built many types of learning communities over the years, simpler is often better - many open source communities have done amazing work with listservs and issue queues, and many more feature-rich platforms have withered because, over time, a site owners "must-have" feature is the post launch usability nightmare. There's a moral in there about user-centered design and user testing, but that's a subject for another post.

But getting back to MOOCs, the early MOOCs - the ones run by Stephen Downes, Alec Couros, Dave Cormier, George Siemens, (and yes, I know I'm forgetting people - please fill in the gaps in the comments) etc - encouraged participation from anywhere. If you had a blog with an RSS feed, you were in. Participants remained in control of their work (depending, of course, on the publishing tool they were using. Open source platforms generally offer more options for data ownership and portability than their closed brethren). The MOOC was like a marauding mob of information, with the potential to sprout anywhere.

It's All About The Portfolio

In the post-lifestream, post-MOOC era, it's been rare to see much excitement about portfolios. This doesn't surprise me, because like all good ideas, portfolios have been around for a while, and thus lack the shiny newness that generates great marketing copy. However, the need for the concept hasn't diminished - any time you see a site that promises to collect the sources of your learning into a single location, so you can show your employers what you know! - you should think, "portfolio." All of the sites that promise to simplify collecting and curating your digital footprint? Portfolios. A lot of the conversations around documenting and receiving credit for informal learning have their roots (and possibly solutions) in portfolios.

In the conversations we have had about portfolios over the years, we have seen three main barriers, or areas of misunderstanding:

  • Distinguishing between a working and a presentation portfolio: simply put, the working portfolio is a running collection of just about everything you do. The presentation portfolio is a selection of elements from the working portfolio selected for a specific purpose. Portfolios can serve different purposes for different reasons, and the relationship between the working portfolio and the presentation portfolio is key.
  • Portfolios need care and feeding over time: as mentioned before, the working portfolio is messy. Periodically, the working portfolio needs to be pruned and cleaned up. But, messy is great, and if it's not messy, that could be a sign that things aren't working as they should.
  • Ownership and control of the portfolio: because most portfolio implementations are paid for by an organization, the organization usually controls access to the portfolio and any information in it. Organizational control is also seen as an essential element to assessment. However, this flies in the face of learner control and ownership of the means by which they learn. Ultimately, this is a data portability issue with implications for the learning experience. More on this later.

Concluding Thoughts

One of the things that has been particularly underwhelming about the corporate MOOCs that have cropped up is their uncanny resemblance to an LMS with an open enrollment policy. While there are many differences between the platform-stylehttps://chronicle.com/article/Providers-of-Free-MOOCs-Now/136117/ MOOCs and the original versions, the lack of learner control is a key element. Like Vegas, work in a MOOC stays in a MOOC (unless, of course, a company pays money to study student data).

In the platform-style MOOCs, the open web is missing. From a learner perspective, the portfolio is MIA. For a learner, throwing the evidence of your learning into a space that someone else controls isn't a viable long term strategy.

So, if you're at DrupalCon and want to talk open learning, let's make some time and sit down together. Open source, and the methodologies that support sustainable open source development, have a lot in common with open learning. I'd love to hear what other people are doing in this space.

Badges, Portfolios, and Blending Formal and Informal Learning

Over the last few weeks, as part of our work on portfolios and open content, I've been digging into Mozilla's Open Badge Infrastructure.

From the project description page:

Learning today happens everywhere, not just in the classroom. But it's often difficult to get recognition for skills and achievements that happen outside of school.

Coming up with a way that allows people to display informal learning in a way that makes sense to people not actively involved in the communities where the learning occurred is critical to ensuring that, as learning and scholarship evolve, new means of acquiring and demonstrating knowledge are recognized as valid.

The challenge here - and badges as defined by Mozilla have a role to play in overcoming this challenge - is to help create an environment where the assessment of informal learning is easier to do, is more comprehensive, and does not detract from or shape the experience of the learner. The following thoughts lay out some ideas on a system that helps address this larger issue.

Badges, Portfolios, and Blending Formal and Informal Learning

The components of the above diagram are explained in more detail below. Or, just tl;dr the pesky details, and jump straight to the end. Or, leave while you can and check out the kittens.

Learner

Things start with the learner because, like Aristotle's prime mover, we need to start somewhere.

While a complete breakdown of the various means by which learning occurs is both outside the scope of this document and firmly outside my areas of expertise, we will allow the following general definition to suffice:

Learning occurs through a series of activities and/or questions. As a result of these activities and questions, the learner gains new knowledge, and grows. This growth funnels back to the learner, allowing for additional questions and activities leading to more learning and growth.

Self Documented: Blog, Film, Publication, etc

Documenting knowledge is pretty straightforward. People can make videos, create blogs, use tools like VoiceThread or Sliderocket, and publish their work on the open web. One form of documenting learning could also be a working portfolio (a fairly comprehensive collection of the pieces that are used/created during the learning process, which starts to run into the concept of the presentation portfolio, described below. In practice, a working portfolio could be nearly identical to a blog.

More traditional ways of documenting expertise include publishing via print.

Blog, YouTube, Magazine, Resume, CV

As has been covered in countless other places, publishing to the web is easy. Any standard publishing tool (like Google Sites, Blogger, Wordpress, Drupal, YouTube, etc, etc) can be used as a platform for an individual learner to document and reflect on their learning.

More traditional documentation includes a résumé or a CV.

Regardless of the means, in any of these scenarios the learner assembles the different components that represent his or her learning, growth, and knowledge. For example, a CV includes a list of publications, but not the actual publications. In this way, self documented learning is a collection of fragmented artifacts that require additional research (usually for both the learner and for anyone evaluating the learning) to accurately assess the breadth of the work over time, and the relative value and merit of the work for a specific context.

Badge Issuer

The Badge Issuer is a central part of Mozilla's Open Badge Infrastructure; the issuer (as the name implies) is the organization that supports learners as they address challenges and earn badges. A key element of the learning ecosystem around badges is that the means to earning badges is intentionally left open:

Issuer badge systems are independent of the Infrastructure - how you assess work, decide who earns badges, issue badges within your site, display badges within your site, etc. - that's all up to each Issuer.

This means that the central part of the learning experience has the potential to be defined within the relationship between the learner and the organization that helps structure the learning. One of the things that is attractive about the badge architecture is that, within this open structure, a learner can present self documented learning to a Badge Issuer as part of their work.

Because the criteria for determining how badges are earned is left to the discretion of the badge issuer, a broad array of learning experiences have the potential to be supported by the badge issuer.

Backpack, Display Site

Backpacks and Display Sites are two components of the Open Badge Infrastructure.

Backpacks are used by individuals to store and organize their earned badges. Display Sites can run the gamut from social sites that support user profiles (where people presumably would add their badges to their profiles) to job hunting sites.

The learning that is represented in both a Backpack and a Display Site provides a clear picture of what a person has been learning, and how they have been learning it. Additionally, because each badge contains information that points back to more documentation about how the badge was earned, people interested in learning more about the skills implied by the badge will still need to do some additional legwork to learn more about the relative importance of the badges.

LMS, School, or some other Structured Setting

This is learning as currently experienced by most of us, through school, college, university, a professional training course, a LMS delivering courses within any one of these settings, or as part of ongoing training in the workplace.

For most of us, this is the piece of the system where we have the most familiarity.

Transcript, Diploma

Transcripts and Diplomas are probably some of the more familiar demonstrations of learning with which we are all familiar, but they can be remarkably imprecise. At their best, they offer evidence of effort over time: a person did this work for this amount of time and earned this degree from this organization. But, what does a MA in Philosophy really mean? What skills does someone have who has earned a B+ in Calculus, and does it matter if that B+ was earned from College A or College B? These are highly subjective evaluations, to the point where they lack any real meaning without some larger context.

Portfolio

A presentation portfolio is a collection of work created and/or referenced by the learner that helps demonstrate the what a person has learned, and how they learned it. Portfolios can serve many purposes, depending on the audience for the portfolio and the reason that the portfolio was created.

For example, one collection of artifacts within a portfolio could be used to show areas where a learner needed to improve. A second collection of artifacts could highlight work that the learner believed exemplified their intellectual growth. These two portfolios could contain some of the same artifacts.

Portfolios can be assembled to address the needs of the learner, or the needs of the organizations within which the learner works. Our preference is for portfolios that leave full control within the hands of the learner, but within a well designed portfolio system there is no compelling technical reason why the needs of the organization should disempower the needs of the learners within the organization. Too frequently, we see portfolio systems designed to meet a narrow set of requirements driven solely by the needs of assessment. This is not necessary, or helpful, in understanding what portfolios can do.

During the process of learning in other places, information should be flowing into the portfolio. As mentioned above, a working portfolio (that contains a running collection of information assembled/created as part of the learning process) could also feed into the cleaner, more polished presentation portfolio.

To emphasize: the system we are discussing requires data portability, under the control of the learner. The learner must be able to move their work where they need to, when they need to.

A full description of portfolios is beyond the scope of this document. For more information on Portfolios, their uses, and some of the things to think about when implementing portfolios, check out Dr. Helen Barret's blog. She has forgotten more about portfolios than most of us will ever know, and is an amazing resource on the subject.

Evaluation, and/or Coherent Presentation of Skills

When evaluating the relative worth of a person's experience and knowledge, we are making a judgment rooted in a context: is a person's knowledge and experience a good fit for a specific situation? This is not an absolute judgment, and once we enter the realm of assessment and evaluation, we are outside the purview of what might matter to a self-directed learner.

Badges go a long way toward solving the problem of how to recognize the value of informal learning, but badges don't solve the issue of how to contextualize that learning to provide a more comprehensive picture of the learner. And, in a fully DIY environment, providing that more comprehensive picture may never be necessary. Providing the more comprehensive picture of what a learner has accomplished only becomes relevant when we get into the realm of assessment or evaluation.

Portfolios, unlike other ways of demonstrating what we have learned, provide a more fully contextualized picture of our intellectual growth. Portfolios also have the added benefit of being both a means of recording what we have learned (in a presentation portfolio) while documenting the process of how we learned (as part of a working portfolio). Using badges as waypoints to help chart this growth seems a natural fit.

Closing Thoughts

It's worth noting that almost none of what I describe here is actually necessary for learning. For learning to happen, all that's really needed is a learner to ask questions, engage in some hands-on activities, and have a space to document and reflect on the process. Everything else isn't really a learning issue; it's an assessment issue. For too long, we have allowed assessment to drive how we define learning, instead of the other way around. The thing that gets me excited about badges is that it has actually put focus on the value of informal learning because Badges have the potential to provide a uniform way for people to understand what occurred within the informal learning process. Badges provide a greater degree of context to the informal learning process, largely by including the organizational reputation of the issuer as part of the value/credibility of the badge.

The Badge Specification is relatively lightweight, and it should remain that way. Badges alongside a portfolio system, however, provide a context that raises the credibility of both the badge and the portfolio. The work highlighted within the portfolio provides additional information about how and why the learner earned the badge. A well designed portfolio system, working alongside a well designed badge system, would collect these pieces as learning occurred, so the accumulation of artifacts for the portfolio is indivisible from the learning itself.

Cheating Is Not A Test Security Issue

The Atlanta Journal-Constitution has done a review of cheating on tests in school districts across the country. The results aren't pretty.

A tainted and largely unpoliced universe of untrustworthy test results underlies bold changes in education policy, the findings show. The tougher teacher evaluations many states are rolling out, for instance, place more weight than ever on tests.

And, cue the folks who miss the point entirely:

Daria Hall, director of k-12 policy with the nonprofit The Education Trust, said education officials should take steps to ensure the validity of test results because of the critical role they play in policy and practice.

“If we are going to make important decisions based on test results — and we ought to be doing that — we have to make important decisions about how we are going to ensure their trustworthiness,” she said. “That means districts and states taking ownership of the test security issue in a way that they haven’t to date.”

Cheater Pen

No. This is not about test security (read: another unfunded mandate for schools to enforce a system of assessment that has never worked all that well, even before it was pushed front and center into education policy. Read: another "growth opportunity" for "educational services providers" who will supply a that guarantees your tests are completely, totally secure).

This is about designing assessment that can't be cheated, and about not tying pay - for both teachers and administrators - to performance on flawed, oversimplified assessments. Portfolios come to mind as an option that would reflect the experience of learners within their class, provide a clear and accurate representation of growth and learning.

However, the argument against portfolios would have us believe that they are just too expensive and time consuming.

But what's more expensive? Running a good portfolio system that works, or paying for tests that are imprecise measures of a small subset of what people actually learn.

What's more time consuming? Running a good portfolio system that works, or dedicating class time to teaching the test, taking the test, and trying to catch the cheaters after the fact.

To all the people who get a lot of attention for saying that our educational system is broken: please stop, and consider that our assessment system is broken, and is getting in the way of student learning.

You're not saving money or time when what you buy is broken. You're not assessing more efficiently when people can sidestep your efficiency measures. You're not measuring good performance when people cheat their way to the top.

Image Credit: "What the hell is a cheater pen anyway?" taken by DigitalCellulose, published under an Attribution Non-Commercial No Derivatives license.

What Nicholas Kristof Leaves Out: Discussing the Value of Teachers

Nicholas Kristof has a piece in today's NY Times titled The Value of Teachers. In this piece he points to a recent comprehensive study that looks at the earning gains for students who have "good" teachers.

The money quote comes in the third paragraph:

That’s right: A great teacher is worth hundreds of thousands of dollars to each year’s students, just in the extra income they will earn.

Kristof buries the fact that the study is based on value-added methodology and conflates student performance on test scores with good teaching. He alludes to value-added in the 11th paragraph, but never actually addresses the fact that test scores and value added analysis aren't infallible.

Ms. Powaga - Fifth Grade, an Oasis in the Desert

The study authors (and this piece shouldn't detract from the worth and value of the study, which merits a read) are clear on this, even though Kristof is not. The executive summary (pdf download) of the study leads with a discussion of value added analysis:

Researchers have not reached a consensus about the accuracy and long-term impacts of VA because of data and methodological limitations.

The researchers conclude that, for their study, value-added analysis is a valid tool, as they look at over a million students from 4th grade to adulthood. As I said earlier, the study is a good read.

However, in his article on the study, Kristof uses false equivalencies:

Conversely, a very poor teacher has the same effect as a pupil missing 40 percent of the school year. We don’t allow that kind of truancy, so it’s not clear why we should put up with such poor teaching.

Truancy and the quality of a teacher are two very separate things. Conflating them here serves a rhetorical purpose (truancy = bad; bad teaching = truancy) but aside from being an interesting rhetorical gimmick, it just doesn't make sense.

The piece also commits one of the standard mistakes made in many pieces about teacher quality: it assumes that there is an objectively "good" teacher that will work for every kid in every class. The reality is (and people who have worked in school with kids can attest to this) different teachers connect with different kids. Sally's great teacher will be Jimmy's average teacher. We're dealing with human beings here, and human experiences differ.

However, the main (intentional?) oversight in the piece is the complete inattention to the elephant in the room in the school reform debate. If a kid comes from an upper middle class or higher in the socioeconomic ladder, they will attend one of the best schools in the world, in the United States Public School System. The "crisis" in public education is not present in high-rent zip codes. So, when we talk about the problems facing public education, let's situate them honestly. They are connected to issues of poverty, and issues of health, and in many cases, to problems surrounding food insecurity.

Kristof alludes to the importance of poverty, but then dismisses the importance of the issue as something that can be undone by good teachers:

we need an array of other antipoverty measures as well, especially early childhood programs. But the evidence is now overwhelming that even in a grim high-poverty school, some teachers have far more impact on their students than those in the classroom next door.

In the piece, Kristof declares that the problems facing education have an "obvious" solution:

The obvious policy solution is more pay for good teachers, more dismissals for weak teachers.

Wouldn't it be awesome if it was that simple? Unfortunately, the realist in me has a hard time believing that poverty and inequal access to quality education can be solved just by giving good teachers a raise. Until we start talking about education, poverty, and health together, as three related issues, the "obvious" solutions will obscure our vision of the hard challenges we need to overcome.

And part of that discussion needs to include what happens to education when good teachers are forced to work under the limits of bad policy.

Image Credit: "Ms. Powaga - Fifth Grade, an Oasis in the Desert" taken by Michael 1952, published under an Attribution license.

Open Content, Where You Want It, In A Space You Control

In the past, we have talked a fair amount about open content. Done correctly, open content has the potential to support meaningful change within education. A significant amount of open content exists on the web; much of this content, however, is not immediately reusable.

In this post and the accompanying screencast, we break down a system that can be used for authoring, redistributing, remixing, and collaborating on open content. The site is customized on top of VoiceBox, and all of the components used to build it are freely available. I'll be presenting on this topic in more detail at Educon in a couple weeks.

This system has several differences from other systems that support open content, but one major difference merits additional notice: it is designed to be porous, and it is designed to be installed and run by the people or organization creating the content. It can be as public or as private as you want it to be, but that decision is left up to individual content authors, as opposed to the people building the content silo.

Overview

Within the site, people can:

  • Create and join groups; groups are workspaces that can be fully or partially private.
  • Author notes; notes are the main form of content within the site. A person creating a lesson would build it by creating notes.
  • Start discussions; discussions occur within groups, and provide a means to discuss areas of general interest, or to discuss a specific note.
  • Offer feedback; feedback is private between the person receiving and the person offering feedback.

Notes can be created as individual pages, or organized hierarchically into multiple page books. Each book can be accessed in print-friendly format, and each book generates its own RSS feed that can be used to import the book outside the site.

In conjunction with a service like BookBrewer, this site can be used by schools or other organizations to create, distribute, and sell eBooks. Also, given that this site is built on Drupal, we just might write some code that allows Views to output content in ePub format.

Video Breakdown, Education Version

Use the minute marks to skip around the video to find the sections that interest you most.

Creating Notes | 0:15

The opening section breaks down how to create notes, and how to shift pages within a book. Notes can contain a variety of different media, and in this section we talk briefly about embedding images, audio, video, and other files within your notes.

Groups | 4:15

This section describes how to use groups to work collaboratively. It shows how to track activity that has occurred within groups, provides an overview of group home pages, and shows the different ways that users can choose to share their content.

To see an example of how to create a group, skip ahead to the 15:00 mark of the video.

Discussions | 7:10

This section shows how to use discussions to collaborate within the site. Discussions can be tied to a specific note, or more general within groups.

Feedback | 9:30

Feedback is a private communication between a reviewer and an author. For example, a teacher can provide private feedback to a student, or a department head can provide feedback and evaluation to an instructor in their department.

Moving and Copying Content | 12:30

In this section, we show how people can work with other people within the site, and how work can be distributed outside of the site. We highlight how to access the RSS feed, and print-friendly format of each book.

For people working in the site, we cover how to copy books between groups to allow people to derive copies and remix content without disturbing the work of their peers

Video Breakdown, Drupal Version

This breakdown gives a high-level overview of how the functionality was created. As mentioned earlier, the site build is based on VoiceBox. The main additions within the Open Content site include the ability to create multiple page books (leveraging core Book module and the contrib Book Manager) and the ability to form working groups (using Organic Groups).

Creating Notes | 0:15

Notes are created using CCK, and the Filefield, Imagefield, and Embedded Media Field modules. With the exception of the embedded media field, this setup is identical to what we are using on VoiceBox. Audio and video nodes are formatted using SWF Tools, and images are displayed using LightBox2. We will likely be switching to ColorBox in Drupal 7.

Groups | 4:15

The groups functionality is created using Organic Groups. The additional access control options for groups are created using the OG Access Roles module.

Discussions | 7:10

Discussions are structurally identical to Notes, with the exception of a nodereference that allows a discussion to refer back to a specific note. The nodereference field is populated using the Node Reference URL Widget module, and the link to create the actual discussion is created via Views.

Feedback | 9:30

Like discussions, feedback nodes use a nodereference to point back to a specific note. Additionally, feedback nodes make use of the Node Access User Reference module to control access to the feedback node.

Moving and Copying Content | 12:30

The ability to copy books is done via the Book Copy module.

Additionally, when books are placed into a group, the group affiliation and the level of access control is kept in synch throughout the book tree via the Book Manager module.

The RSS feeds for books are generated via the Views module, and the print-friendly format comes from the core Book module.

Conclusion

If there any follow up questions, please feel free to ask them in the comments.

Social Learning and The Freedom To Change Your Mind

Last week, Fred Bartels posted that, over the holiday break, he was going to start doing some brainstorming about an online progressive school. In response to some initial questions, Fred started to flesh out his vision.

I responded within the thread; this post is an attempt to extend and clarify some of those thoughts.

Cats in a Bowl

Part of the puzzle in defining and "building" an online school requires that we address issues related to reuse, redistribution (of both lessons and completed projects), and possibly recontextualization/remixing of lessons and materials created as part of the learning process.

Lessons, in this context, are really semi-structured exercises that can support a broad array of research-based, project-based experiences.

Assessment shifts from teachers determining what a student needs to know to a student articulating what they learned and considered valuable from the process.

The role of the teacher (and really, every other learner in the system) is to help people spot the gems that arise from their experiences.

Portfolio-based assessment is more readily suited toward documenting this type of experience than multiple choice tests, but whatever form the assessment takes, the assessment should highlight the learner's understanding of their experience as the starting point for determining what has been learned. Toward that end, assessment should include reflection back on how a learner has progressed, and part of schooling would need to include methods to support students as they identify where they have grown, and where they need work.

When it comes to developing a system/web site/web application to support this type of learning, there are many systems that already do this (and a bunch that don't - as a general rule, any system predicated on a hierarchy where the teacher controls a class-like space will be less than satisfying). Rather than getting too deep into the mechanics of designing another one, it might be more instructive to look at common elements/habits of mind that support this type of learning.

The communities, and their output, are endlessly iterative. They support a never ending stream of questions, responses, conversations, outside inputs, search, recontextualization of existing sources, original research, publishing, revision, and so on.

Learners can choose to dip into the stream and highlight what they consider important or valuable; over time these highlighted/curated/researched/freshly articulated/endlessly revised objects become what some people might call "finished." Personally, I think it is more accurate to call them snapshots, as we should all reserve the right to change our minds as we discover more.

But the key to any system like this is the underlying expectation that learning never ends, can always be revised, and should always be subject to new input from various sources. A system that supports this type of learning should simplify the discovery of these new sources of information, and the publication and revision of snapshots of learning in progress.

Image Credit: Photo "Baby Cats" taken by randomix, published under a Non-Commercial/No Derivatives/Attribution license.

Assessment

One way of changing education is to change how we assess learning.

This isn't going to be a post about standards, but we need to start with them to get into the center of the discussion (this is not to say that standards are not a subject worthy of close consideration; rather, they are just not the main focus here, today).

  • Standards define curricular goals and objectives.
  • Textbook companies prepare packaged materials that are "aligned to the standards." These textbooks, in theory, are designed to address the curricular goals and objectives as defined by the standards (and for fun, ask a textbook rep to demonstrate how their texts "align to the standards." Ask them to define the process by which the texts are "aligned to standards." Then, get out the boots, and enjoy the hijinks that will ensue).
  • Student learning is measured by a standardized test that claims to assess a student's base of knowledge as measured against the standard.
  • The "quality" of a school is determined (in part or in whole) by how students have done on the test. Test results can be a key factor in closing down schools.
  • The "quality" of a teacher is determined (and in many of the merit pay schemes, teachers are rewarded or punished) based on student scores on these tests.

So, let's take an enormous, completely unjustifiable leap of faith and assume that the standards actually define something meaningful, for one reason and one reason only: this post is not about standards, it's about assessment.

When a curriculum is defined by a pre-packaged text, teachers and students are relegated to content consumers. Teachers get the text; they deliver the text; they test on the text, and teacher effectiveness is tied to how students perform on the test that purportedly measures how well students "know" the content that has been delivered to them. Any process used to "learn" the material is overshadowed by the means of assessment that defines the experience, and defines one's success or failure within that experience.

It's also worth noting that in lower performing schools, there is more motivation to stick with the "proven" or "traditional" route of using a standards-aligned text, as this provides a level of cover and plausible deniability should a school not meet growth goals. In an environment where sanctions accompany low test scores, using alternative means of working with kids is equated with gambling with kid's futures - unless, of course it's happening under the auspices of TFA, KIPP, or a charter school. Higher performing schools - where socioeconomic level appears to play a role - tend to have more freedom to experiment, largely because the threat of sanctions for "failure" is missing.

This is why serious discussions about assessment are a necessary part of the dialogue around improving education. What would an educational environment look like where, in addition to or instead of a standardized test, students had the opportunity to show their mastery via two portfolios: one defined by the school, and the second defined by the student?

The process of building a portfolio (ie, of crafting the assessment) is also a learning process. Selecting and justifying elements in a portfolio requires a level of critical, reflective thought that is not present in either preparing for or taking current standardized tests. It's a more efficient means of mastering both material and life skills than the assessments that currently claim to measure those skills.

What would teacher professional development look like if a teacher was assessed on how they provided feedback on student work? What if teachers developed professional portfolios that included curriculum they developed, modified, collaborated on, and/or shared? Most teachers create curriculum on a regular basis as workarounds for sections of the text that are weak or not suited for their classroom; what if creating and sharing these units was made an explicit requirement for growth and development as a teacher? What if this ongoing creativity and collaboration was a factor in assessing an educator's professional growth?

These shifts are possible now; they require a change in how we look at assessment, which potentially could inform changes in what and how we teach.

Changing assessment is hard. Generally, more individualized assessment takes more time. From a business place, it's hard to plan a "disruptive" business around this because you can't really streamline the time required for good feedback. The challenge (and therefore the opportunity here) is to make tools that simplify and streamline creating portfolios of work that demonstrate learning. The benefit - especially when compared to other forms of evaluation, and certainly to standardized testing - is that the process of creating and justifying the artifacts that demonstrate learning is also a process that supports and reinforces learning.

But this is a subtle point, and one that is often buried beneath the time required to assess portfolio-based projects versus the time required to process a standardized test. Ironically, the quest for efficiency in assessment has occurred at the expense of efficiency in learning.

Syndicate content