Click. Connect. Learn.

All posts in Education Policy

Manufactured Crisis: Education Schools and the National Council on Teacher Quality

Update: Bruce Baker, over at School Finance 101, has a more detailed breakdown of the NCTQ report.
End Update

The National Council on Teacher Quality put out a report that is it describing as "an unprecedented evaluation of more than 1,100 colleges and universities that prepare elementary and secondary teachers."

Let's take a step back from the hyperbole and see what's going on.

Let's say your organization has a goal: undermine the work of trained, experienced educators in the classroom, and the programs that prepare them. This goal hits teachers unions, who have a large body of credentialed, trained, and experienced educators, and the traditional methods by which these professional enter the workplace.

More importantly, this also supports non-standard shortcuts to putting teachers in the classroom, such as the short trainings given to people who enter the classroom via Teach For America.

Create a Crisis in Teacher Preparation!

This is best done in the form of a long report. Make the actual report over 100 pages (pdf download), to ensure that most people rely on the executive summary. One of the benefits of releasing a long document is that you can bury gems like this that show your full distrust of educational schools:

Programs might provide us with “counterfeit” syllabi that they think would do better on our standards rather than the syllabi distributed to students that actually reflect the training candidates receive.

The statement above is contained at the top of page 83 of the full report. The statement contains an end note (and again, nice work not linking end notes, thus ensuring that they are read out of context). The end note (number 52, found on page 104 of the full report) reads:

In comparing copies of syllabi that we obtained via campus outreach with those we received directly from programs, we found no instances of counterfeit syllabi. We will continue our practice of auditing for future editions of the Review.

In other words, this fraud and deceit that we insinuated was happening never happened.

There are gems like this buried throughout the document. Really, pick a page and sift.

Repeat Tired Arguments To Make Them Sound True

The Executive Summary (available on its own as a pdf download, and as part of the full report) opens with this chestnut:

Once the world leader in educational attainment, the United States has slipped well into the middle of the pack. Countries that were considered little more than educational backwaters just a few years ago have leapt to the forefront of student achievement.

Interestingly, no end note is provided to support this assertion. This assertion clearly ignores the effects of poverty on test scores and, more importantly, child health and well being.

Repeating unproven assertions doesn't make them true. It does, however, bring them into the conversation.

Which Is Exactly The Point

If your goal is to gain public support for alternate methods of teacher credentialing, or for getting rid of the credentialed teachers that are supported by unions, you need to erode confidence in the system that trains these professionals.

It should matter that the authors of the report actually admit (on page 13 of the full report) that "Evidence of Effectiveness" is "essentially not ratable". If a study claims to measure the effectiveness of a program, I would hope that there would be some evidence of that effectiveness.

But the point isn't accuracy. The point is to introduce the story line of failed education schools into the narrative. Despite the inaccuracies of this study, many of which are freely noted by the study authors, the flawed infographics march forward, another example of how incomplete data is of dubious value, and can nonetheless be misused.

Bullying: One Kid Talking To Another About Not Taking A Test

While collecting up my thoughts after the Portland Public Schools Common Core event last week, I came across this set of talking points written by the district "as a support to principals and teachers to understand State of Oregon requirements and our practices around testing."

The full doc is available for download from the Portland Public Schools site; I have also stored a copy locally (pdf download). The FAQ is dated February, 2013; it's not clear whether this document is a version that has been updated over the years, or whether these talking points were created fresh in early 2013. If anyone knows the backstory on how and why this document came into existence, please let me know (either via a comment or via the contact form).

The document is written with the OAKS tests in mind. In Oregon, the OAKS tests will be used until the "next generation" assessments aligned with the Common Core are rolled out. Oregon is currently part of the Smarter Balanced consortium, and the tests that Oregon is moving to do not yet exist (although some Oregon school districts have been volunteered to field test draft versions).

The Portland Public Schools FAQ reveals the bind that teachers and principals within the district find themselves. From the FAQ:

The tests are used by the state to rate schools – both on how well students do overall and also on how many students take the tests. If a school falls below 95% participation, the school’s state rating falls. The ratings are made public in the school’s State Report Card and are often used by parents weighing school choices.

In other words, school rankings place an emphasis on test taking - potentially, a school with 100% participation but lower schools could be labelled "better" than a school with 94% participation and higher scores (and for the purposes of this post, we will not address the valid concern/question of whether the test is an accurate measure of learning - we'll leave that for another day). In any case, the way schools are rated creates a strong incentive for schools and teachers to get kids tested. While I have yet to hear of any hospitalized Oregonians being presented with tests, state and district policies that reward schools for testing kids create the pressure where that type of behavior becomes possible.

The next point in the FAQ addresses how familiarity with test taking helps kids do better on tests:

Most students use the Reading and Writing OAKS tests in 11th grade to meet their high school graduation requirement of showing mastery in these Essential Skills. The Class of 2014 and beyond must also pass Math tests. If students refuse to test prior to the 11th grade, they will have limited familiarity with the testing environment when they first have their opportunity in high school. This could negatively impact their performance and their on-time graduation (emphasis mine).

While no one can dispute that a familiarity with the structure of a test brings a benefit on the test, it begs the question of whether the test measures actual learning, or whether the test measures the ability to sit through a test. Is the point of testing to help students get better at tests? If so, then test away, but I would like to hear any credible educator try and make the case that the point of school should be to learn how to take standardized tests. The fact that this is mentioned in an FAQ on why tests are a Good Thing(tm) feels like either an oversight or really bad advice.

The next section of the FAQ outlines how to respond to a parent's request for an exemption.

For a school to excuse a student under this rule, the parent must provide a written request listing the reasons for the request and propose an alternative learning activity for the student to do during the testing that would meet the same goals as participation in the state assessment. An example of an activity might be that the student work on homework or a special assignment covering the same set of skills being tested.
The school may then consider the parent’s suggested activity but choose instead to engage the student in a different activity that the school determines. The point of having the parent suggest an alternate activity is to help emphasize the educational value and importance of the assessment.

In other words, if a parent opts their child out from testing, the parent should be given some busywork that the school can subsequently ignore; this will teach the parent the lesson that the standardized tests are very important.

If the district thinks that this approach will do anything except anger parents, the people writing these policies should get out more. Most parents of school age kids are busy; giving a busy person a busywork assignment that can be arbitrarily ignored is not a good negotiating strategy, or a good way to foster open communication.

The FAQ also describes how to react if students talk with one another about opting out.

Q: What if students are encouraging other students to boycott testing?
A: Principals, teachers and schools must clearly assert that students must not coerce or in any way intimidate other students to share their position or their actions on testing. Schools should follow their anti-bullying protocols to intervene with students who engage in such behavior.

So, if one kid talks to another kid about not taking a test, this should be addressed as a bullying issue? Seriously? This approach demeans any ongoing anti-bullying efforts underway at the school. Bullying is a real issue affecting kids. Opting out of a test, and talking about it, is not bullying. Questioning authority is also pretty natural to kids. Fortunately, I know that most teachers and principals have the sense to not go down this path, but the fact that this is the recommended approach from the district shows a misplaced emphasis on the value of what happens in schools.

The FAQ ends by circling back to the point of the whole exercise:

Q: Does a legitimate exemption or a refusal count against my school’s test participation rate?
A: Any student enrolled on the first instructional day in May and for at least one-half of the school year who does not test, regardless of the reason, counts against the school’s participation rate.

To put it another way: if you let kids not take the test, you, your school, and your teachers will look bad. That's how we crunch the numbers.

The existing policies around testing create pressure to test as many kids as possible. Allowing students not to take the test - even for valid reasons - counts against a school's publicly available rankings. It doesn't matter that these rankings aren't an accurate representation of what transpires within the school - once the ranking is published, it's everywhere, affecting everything from parental perception to property values.

With the new, as yet unseen, completely untested Common Core assessments on the way, school districts need to be more candid and more realistic about the actual value of tests. Doubling down on the "tests are valuable and you must take them" approach won't fly, especially when the assessments show some real signs of being unsound. Treating parents who don't want to see their children's time wasted on poorly crafted assessments of dubious value as troublemakers is not a viable strategy. I hope that, within both Portland Public Schools and other school districts nationwide, there is candid, open conversation on the effects of an increased reliance on testing. One of the catchphrases of the accountability-through-testing crowd is "the kids can't wait." If it's a choice between rushing into a poorly crafted assessment, or spending that time engaged in the classroom, I'll choose the second, and wait. My kid can't afford to be rushed into a poorly conceived thought experiment.

How Common Core Should Be Rolled Out

After attending the Portland Public Schools Common Core parent event, I've been thinking about the event, the people tasked to staff it, and the split between the Common Core standards, what our kids will be taught as a result of the adoption of these standards, and parent and community frustration at how these standards have been adopted.

One piece of feedback that I hope that people in Portland Public School District are hearing is that people want to talk about the process by which the standards were adopted. At the event last night, there was no outlet or opportunity to discuss concerns with the standards themselves. As a result, curriculum people were barraged with policy questions.

In rolling out Common Core, the district should have a series of events that focus on sample instruction within the classrooms. Focus on what kids will be doing. For what it's worth, this should be happening regardless of Common Core - it's good parent outreach, and it's a good way for the district to remain connected to the communities within it.

At a separate event, the district should bring in higher level admins who played more of a decision making role in the details of the Common Core implementation. While the parents who attended the event last night were a self selected group, there was a clear sense among parents that they did not have a voice or an opportunity to be heard. I suspect that a great deal of frustration could be reduced if the district made time to have an open conversation where they heard concerns. I would not anticipate that parental frustration will be reduced by ignoring it.

For parents who are frustrated, you also have options. Interestingly, one of the videos shown at the Portland Common Core event last night was produced by New York State, and featured New York State Education Commissioner John King. New York State has an active Opt Out movement, and the movement has been galvanized in part by the heavy handed, ignore/bully opposition approach of Commissioner King.

Oregon doesn't have a comparable opt out movement, but this page of talking points found on the PPS web site (pdf download), and attached to this post, seems to indicate that, at the district level, they are thinking about responses to opting out. The PPS document "is intended as a support to principals and teachers to understand State of Oregon requirements and our practices around testing." The talking points include responses to parents who exempt their students from testing. This document is geared for the OAKS tests. Interestingly, the document defines one student talking to another student about opting out as potential bullying. The document also notes that students who opt out of tests count against a school's overall test average - this seems like an arbitrary statistical decision, and a good spot for opt-out advocates to begin work.

I hope that as the Common Core rollout moves forward, there are frank, open, and candid discussions between the district, administrators, teachers, students, and parents. The Common Core rollout is stumbling forward, but the one thing that unites all stakeholders is a desire for an excellent education within a strong public school system.

Parent Information Night On The Common Core

Last night, on Tuesday, June 12th, I attended what was called a "Parent's Academy" on the in-progress Common Core rollout. The event was put on by Portland Public Schools. The goal of the event was stated clearly on one of the handouts they provided:

The purpose of our presentation tonight is to help families understand the new Common Core State Standards and how these changes will benefit your child's education. Our intent is to help you to become informed about ways you can help your child be successful.

This goal set the tone for the evening, and attempted to provide a context: the Common Core Standards are here, they will benefit your child's education, we have a plan, and you can help. The goal of the meeting was to provide a positive, forward looking message - both about the quality of Common Core, and about the ways in which the District is preparing for the rollout. As one presenter put it, "The fact is, they're here, they're adopted, and we're moving forward with them." Several times in the evening, we heard very clearly that the standards are "Focused and Coherent."

Focused and Coherent

The event had three distinct sections - from 6:30 to 6:50, the entire group was given an overview by the director of Instruction, Curriculum, and Assessment for the District. After the introductory session, there were two subject-specific breakout sessions. The first ran from 6:55 to 7:40; the second from 7:45 to 8:30.

At the outset of this post, I need to highlight that the representatives from Portland Public School District did a great job. In each session, the presenters were met with questions that ranged from curious to skeptical to downright hostile, and they answered these questions with a level of poise and professionalism that deserves notice and praise.

However, some of the questions asked were both fair and difficult. For example, the presenters were asked how they could vouch for the Smarter Balanced tests, given that the tests weren't complete. The presenter responded that the tests were under development, and that the questions were designed to assess how people could apply skills. The response the presenter gave is accurate, but, unfortunately, it's not directly related to the question. We'll get back to this disconnect later in the post, but this disconnect isn't the fault of the presenter - there isn't a good answer to the question, and the presenter had the unfortunate job of having to provide answers to things that are impossible to answer, at least while sticking to talking points.

Did You Know?

During the event, there were also some areas of unintended irony - the person providing the initial overview used several quotations from Karl Fisch's Did You Know presentation, which - having been created in 2006 - predates the Common Core. Heck, Tom Hoffman's fact check of "Did You Know" predates the Common Core. I was also struck that a presentation designed to describe the road to 21st Century Skills was contained within the 20th Century Information Zombie known as PowerPoint.

The presenters also stuck very close to the "approved" history of the Common Core - there was no mention that, of the 28 original authors, fully half worked for testing organizations; or that the Gates Foundation has issued at least $150 million in grants to help support Common Core.

In fairness, though, within this context, getting into the political backstory is counterproductive. There were some parents in the audience who really wanted to discuss the background of the Common Core to the exclusion of all else, but the goal of this meetup wasn't to discuss the validity of the Core Standards or the process by which they came into existence; rather, it's to figure out what the implementation will look like. I also suspect that a secondary (or maybe even a primary) goal of the event was to garner parental support for the rollout, but - at least based on the self-selecting group of parents who came to this event - it feels a long way off before there is anything approaching excitement about the Common Core rollout.

In this parent's information session, the focus was on what kids would be seeing in the classroom, and from what was discussed in this event, in the bulk of the day to day for the kids - especially in the elementary grades - things will look remarkably similar. It was also interesting to see how questions about curricular implementation led to issues of staffing - for example, one parent asked a question about reading strategies, and the response led directly to issues that could be addressed by lower student/teacher ratios. I didn't get the sense that this was intentional - the Common Core rollout is taking place in a time when schools are chronically understaffed, and in talking about anything related to the daily reality of schools, staffing issues are unavoidable.

In discussing the Common Core Standards, the discussion also led pretty directly to curriculum. Although standards and curriculum are two separate things, curriculum is the face by which people see the standards, and I'd be curious to know the cost of this implementation in terms of new curriculum adoption, and teacher professsional development to deliver it. There were also some questions about how students with learning differences will be supported - in both instruction and assessment - and the path for these students was not immediately clear in the discussion.

The issues around testing and assessment also drew some attention. The presenters didn't have specific information about time currently spent on testing relative to time required for testing as part of the Common Core rollout, but the general inclination was that, between both formative and summative assessments, there would be an increase in testing overall.

As we were discussing the assessment piece, I was struck by how the move to a fully computerized testing environment shifts the dynamics of test taking. There has already been a lot of discussion about how some districts lack the computing infrastructure to give the new tests, and about how schools already feel like they are overtested - and even Arne Duncan admits that the transition to Common Core will involve "a couple of choppy years." However, what struck me in talking over the details of the new test is how kids who are comfortable with a keyboard and mouse will have an advantage on these exams. The new exams are designed to be taken on a computer; every answer gets keyed in, so a kid who has practice writing at a keyboard will be more comfortable in this test taking environment. Several parents in the room noted that they don't have computers in their homes, or that they have a single computer that is shared among multiple people. From this perspective, the new tests have the potential to highlight issues related to the digital divide, instead of measure academic performance.

Denied

And, of course, this assumes that the tests actually measure anything of value. Given that the tests don't yet exist, we are taking the value of the tests on faith at this point. During one of the information sessions, I was looking at the practice test with one of the presenters. As we went to start the practice test, we were repeatedly met with an "Access Denied" error. While this is likely not any major technical issue, from a symbolic place it's pretty priceless. But, even with this technical glitch, the presenter I was talking with didn't miss a beat, and she moved on to highlight some of the questions shared on the Smarter Balanced web site.

The presenters - who were all district-level people, many of whom are working directly with teachers to help them prepare for the Common Core rollout - did a great job. They are tasked with preparing people for a program many people either actively dislike or partially misunderstand. The people presenting the Common Core didn't write the Common Core. The people presenting the Common Core didn't make the decision to adopt the Common Core. The Common Core came about as a result of political, economic, and educational decisions - and the people who made those decisions are fully isolated from the effects of those decisions on the lives of individuals within our public school system.

And this is my single biggest take away from the event: teachers are left explaining a system they didn't develop and didn't choose. Teachers become the public face of policy decisions that originate thousands of miles away. When policy makers create a mess - and I would describe a set of standards that are poorly understood, backed by curriculum that is not yet defined, assessed by testing instruments that do not yet exist, as "a mess" - teachers are the ones who attempt to explain it. Our teachers are doing a great job. I hope, at some point, our policy makers catch up.

If We Need Data, Who Collects It?

Getting data on how people learn and how they can be supported while learning is a worthwhile goal.

However, collecting data takes time, and the means by which these data points will be collected and stored have yet to be identified.

Even capturing a subset of the data specified in the CEDS standard (and this is the data standard implemented by InBloom) requires a significant investment in - at the very least - time, technology, staff training, and data analysis skills.

Kindergarten and the Common Core

I would also wager that many districts are also swamped with the rollout of the Common Core standards, to the point where their ability to articulate their guidelines about data collection is limited or incomplete.

In looking at the most obvious ways that this data will be collected, a few options come to mind:

  • Standardized tests - these are easy data points to collect, and there is an obvious push to use standardized assessments to fill in data points. However, given that standardized tests that align to the Common Core don't exist yet, and that the early versions are expensive, flawed, and controlled by vendors, the quality and value of this data is suspect.
  • Data collection via educational software - This approach simplifies the process of gathering data (as the machines track interactions) but we should not confuse quantity with quality. Additionally, if we begin to rely on apps to collect data about learning, we are getting into the process of building software to meet two distinct goals: tracking specific data points, and teaching lessons. Given that tracking data points is what pays the bills, the data collection can easily trump the learner needs. Additionally, the educational value of educational software is very much an open question.
  • Teachers collect data - With this approach, the job description of a teacher expands to include increased data collection responsibilities. Teachers already do a fair amount of this (it's called grading!), but the amount of time to implement some of the data collection schemes being floated as an option require significant time to implement (what does data collection look like for a high school teacher who sees 150 students a day?) as well as training in best practices for data collection.

Any of the approaches are going to be flawed. Technologically mediated solutions - via standardized tests or learning software - eliminates time that should be spent in more authentic learning. Pushing the burden onto teachers reduces the amount of time teachers have to work with students, and changes the nature of the job. There are a lot of initiatives calling for increased data, and increased use of data. These calls for increased use of data, however, generally ignore the time and effort required to collect useful and reliable data. In the end, if the data collected is going to be useful in supporting teachers and students, collection will likely fall on the backs of teachers and school staff - to the detriment of instructional time, at the expense of more constructive time with children.

Getting The Details With Common Core

On Wednesday, OPB ran one of the better stories I have heard within mainstream media on the Common Core standards; the piece was reported by Rob Manning. The piece focused on adoption within Oregon, and contains gems like this quotation from a district superintendent:

Lazy Cow

“In eastern Oregon, we have a saying that cattle get bigger because you feed them, not because you weigh them.”

However, the story also fails to nail down some key details.

Adopting the "Smarter Balanced" Assessment

The Manning piece describes how the Oregon Board of Education recently voted to adopt the currently incomplete Smarter Balanced assessments.

The tests are a work in progress and are still two years off. But hundreds of Oregon students and teachers have already tried the new “Smarter Balanced” assessment.

While the tests are two years off, there has been concern about whether or not the tests are on schedule to meet that timetable. Recent large scale failures of online tests (see previous link) do not allay these concerns. A lack of internet connectivity required to administer the tests is also a recognized problem.

Additionally, even Arne Duncan admits that the new tests will lead to “a couple of choppy years” for schools.

So, while the tests are technically a work in progress, not acknowledging that there is uncertainty about whether the tests will be ready when they are needed is an omission that glosses over the scope of the challenges involved in rolling out the tests accompanying the new standards.

Moreover, there are some concerns about the quality of both PARCC and Smarter Balanced questions.

A more accurate description here would read:

The full content of these tests is not yet finished, and there have been concerns that the tests won't be fully ready in time. However, hundreds of Oregon students and teachers have already field-tested a draft version of the new “Smarter Balanced” assessment.

The Origins of Common Core

The original piece at OPB contains scant and incomplete information about the origin of the Common Core standards, and the conditions that led to their widespread adoption.

Unlike "No Child Left Behind," this didn’t come through Congress. State-level officials put it together -- though the Obama Administration is on board.

State level officials did not put this together. The original group that put this together consisted of a small group of people working for testing organizations, with support from the major textbook companies and Edison Learning, a charter school operator and "school turnaround" specialist with a spotty record of success. The fact that the Common Core standards are called "state" standards is good marketing, but it ignores the reality that these standards were designed at the national level, by people and organizations doing work both nationally and internationally.

Also, saying that the Obama administration is "on board" misrepresents the level of support from the Obama administation for the Common Core standards. As noted in an earlier post, the Obama administration set the adoption of Common Core standards - and of tying teacher evaluations to standardized test results - as weighted criteria in Race to the Top, and as a requirement for NCLB waivers. When federal funding is tied to adopting both a set of standards, and assessments tied to those standards, that goes far beyond being "on board."

A more accurate description here would read:

The Common Core standards were developed by representatives from textbook companies, educational organizations, testing organizations, and other individuals, with lead authorship generally attributed to David Coleman, Sue Pimentel, Bill McCallum and Jason Zimba. While the Obama administration has been careful not to advocate for the standards by name, federal education policy has provided funding incentives for states that adopted the standards, and assessments aligned to the standards.

Field Tests

Students in Oregon were subjects in field testing, but the method of choosing schools for these field tests remains unclear.

David Beasley, superintendent of the Gaston District in western Washington County, says “Well, I’d like to say we volunteered, but we didn’t.”

Unfortunately, there is no follow up here to learn why or how this district was chosen. It's clear that students were made to take the tests, and we can only assume that this was done at the expense of instructional time. In New York, Pearson was paid millions of dollars to administer field tests, sparking parent outrage and a larger Opt Out movement.

Why was this district chosen? Did they have a choice? How much instructional time was devoted to these tests in this district? How many other schools in Oregon took these tests?

The superintendent clearly is not completely pleased here. It would have been interesting to hear more - even just one or two sentences - about the backstory.

With All That Said...

The rest of the story is pretty solid. They get student observations on the tests, which is an interesting perspective that most education writers overlook or ignore entirely. But the details matter.

The Common Core standards, much curriculum aligned to those standards, the tests measuring progress relative to the standards - these different pieces were all developed by the same people. Some companies or organizations had representation in all of these elements, and Federal education policy - and more importantly, Federal education funding - supported the adoption of the Common Core standards. Adopting the standards, of course, creates an immediate need for the new tests and the new curriculum.

With this much business at stake, it's no surprise that the people working on Common Core also spend a good chunk of money lobbying:

However, the adoption of Common Core standards, the rollout of the tests related to these standards, and the need for new curriculum that supports these standards, are often treated as separate entities. On the one hand, that's technically true - the standards are just standards. But, the federal policies, especially incentives in the various strands of Race to the Top and the NCLB Waiver process, helped ensure that Common Core standard adoption and new standardized assessments occurred together.

The origins of the standards, and the web of policies tying together the standards, the assessments, and the new curriculum, is very opaque. The complexity is made worse when one starts to look at the financial interests of the organizations that played a role in developing these new standards, as many of the companies and organizations involved in developing the standards could make enormous sums of money from services ranging from textbooks, testing, teacher training, and school turnaround support.

This complexity, however, is all the more reason why stories about the Common Core need to get the background right. If you miss the background, you miss the story, and everyone remains underinformed.

Image Credit: "Lazy Cow" taken by sarah white, published under an Attribution Share-Alike license.

Common Misconceptions Around Common Core

There's no getting around it. The Common Core standards bring out the crazy.

Benjamin Reilly does a good job of collecting the crazy in one place, but his "alert" highlights a real issue: the amount of disinformation about Common Core has the potential to derail any rational discussion about the standards.

So, for those following along at home, here is a high level breakdown of the elements of this discussion. At the outset, I want to stress that this is a summary, and that there are certainly things I am missing and/or getting wrong. Please, point out these myriad shortcomings in the comments.

The best place to start is with the Common Core standards - these are learning standards, plain and simple. There are things to like and dislike about them in their own right, but the standards are just that: standards. My preferred starting point for analysis of the standards and their implications is Tom Hoffman.

Of course, new standards require new curriculum aligned to those standards. Thank goodness, some of the people that participated in writing the standards are ready with products to sell that make sure districts meet those standards.

The Federal Race to the Top program (and it's worth noting that there are different strands of Race to the Top) emphasized adoption of Common Core standards and the implementation of student data systems. In Race to the Top, when you see language around "college and career ready standards" that is generally a stand in for Common Core. Whenever you see language around personalized learning, bringing data-driven decisions to the classroom, and/or identifying teachers with a track record of success, the means to achieve these goals are generally understood to include a comprehensive data system.

A representative sample of what this language looks like in the Race to the Top documentation is included below:

Under Proposed Priority 1, applicants must design a personalized learning environment that uses collaborative, data-based strategies and 21st century tools such as online learning platforms, computers, mobile devices, and learning algorithms, to deliver instruction and supports tailored to the needs and goals of each student

The federal data standard is at CEDS; inBloom is implementing the CEDS standard in its datastore.

When the Obama administration allowed states to get waivers for NCLB, the conditions for getting waivers reinforced some of the incentives in Race to the Top, including Common Core adoption and using student test scores as part of teacher evaluations - which, in turn, reinforced the need for a comprehensive data system.

Another facet related to - but separate from - Common Core are the new tests that accompany Common Core adoption. These tests have been referred to as the Next Generation of Assessments, and have been discussed in many places; this speech from Secretary Duncan in 2010 provides a good introduction to the concept. A recent flare-up over some of the new tests - in this case, written by Pearson - sparked an Opt-out movement in New York. Gotham Schools looks at some of the good things in the new tests.

So, a short version - we have:

  • Common Core standards;
  • New curriculum, aligned to the Common Core standards;
  • New standardized tests, aligned to the Common Core;
  • Centralized data systems to collect information on students and teachers;
  • Race to the Top, which gave money to states and districts that prioritized implementing the above components;
  • Waivers for NCLB, which reinforce some of the incentives for Race to the Top.

And, of course, this is happening against a political and social backdrop that includes heated debates about the worth of teachers unions, intense and well funded efforts to privatize public education, the agressive expansion of both for-profit and non-profit charters, cheating scandals, a narrative about how our school system is failing, and an increased reliance on standardized tests as a measure for both teacher effectiveness and school success. All of these elements are related - but ultimately distinct - strands in the conversation.

This web of related-but-separate elements makes it simultaneously honest but disingenuous when advocates for Common Core say things like, "The new standards don't mandate what teachers teach." This is honest because the standards, with some glaring exceptions, attempt to stay out of implemetation. It's a disingenuous statement, though, because the implementation of Common Core is embedded in these other elements that do place constraints on educators.

But, when you have Glenn Beck and Michelle Malkin adding their misshapen four cents to the conversation, one thing is nearly certain: the progressive left will support whatever they argue against. This is a lost opportunity, because the educational system in the entire United States would benefit from a clear discussion of Common Core. The present direction of the conversation makes that increasingly unlikely.

Barriers and Contradictions

Last weekend, we ran another open content authoring session at Lewis Elementary in Portland, OR; we'll have more details on the event in a post laster this week. During this session, we talked with several educators about ways to work around the organizational barriers they face. I'm going to list out a couple here; frequently, when we talk about the things that are absent from school learning environment, the conversation stops at blockages of YouTube and other social media sites. Really, though, there are barriers that are far more basic and pervasive than that.

Contradiction

Students Can't Save HTML Files

We spoke with an educator working within PPS who had set up a lesson where students were learning about the web, including some basic HTML and css. The lesson went fine until it came time for students to save their work; they were blocked from saving html files.

SSH is blocked

We have worked in schools, and worked with teachers in schools, where SSH is blocked. For anyone working in web development, SSH is a central tool to doing out work. Blocking SSH is akin to teaching carpentry without hammer and saws.

Districts Claim Ownership Over Teacher Intellectual Property

The way some district contracts are written, districts claim ownership over any work that is done during school hours, over a school network, or on a school-provided machine. So, if a teacher does planning during the school day, even if she is creating something entirely new that is her creation, the district position is that they - the district - own that work.

Why Should We Care?

In the current political climate of educational reform, teachers are under a tremendous amount of pressure. Teachers and schools have a lot of rhetoric directed at them about how they need to embrace "21st century learning" and teach web literacies and develop knowledge workers, all while meeting more time consuming reporting mandated by the unfunded mandates of NCLB, and having their performance measured by standardized tests that often don't examine what learning looks like.

And in the face of all this, there are district-level policies that directly interfere with a teachers ability to work. When a district claims ownership over creative work done during the work day, the district creates an enormous disincentive to work with peers during school time, as any result of the collaboration would be owned by the district and not the creators. This flies directly in the face of what networked, connected teaching should be, as it is predicated on sharing our work with others. Fortunately, as we discussed in our authoring event, incorporating openly licensed materials into our work makes district claims of ownership a moot point, as the district can still claim ownership but the license allows for free and universal reuse.

What is incredibly heartening is talking with teachers, and hearing the creativity, thought, and caring that they put into their work. There are some amazing educators working to help our kids learn, and it's great to see.

What is disheartening is to see the artificial, policy-driven barriers put in their way. Here in Oregon, we are hearing a lot of talk about improving our educational system. And some of these things actually sound okay. And please don't get me wrong: high level change is part of the solution too. But we also need to remove the unnecessary barriers to teachers doing their best work. The notion that a district owns a teacher's work needs to be addressed legislatively, and through contracts. If a district thinks that they are going to get rich from owning and selling content, they should go talk to their local newspaper - the one that went out of business three years ago.

Image Credit: "Contradiction" taken by sweetenough, published under an Attribution Share-Alike license.

Additional Questions About How inBloom, Schools, Districts, and States Store Data

Over the last few days, I spent a little time looking over the inBloom Data Store Logical Model. Based on what I have seen there, I have some additional questions and observations about the data that is stored within the system. The questions included here are not comprehensive by any means. Rather, this is a short list compiled after spending around an hour reviewing the data model.

A. inBloom Could Be Used to Screen Immigration Status

inBloom can store information about how a person verifies their identity. The values used here could be used as a screen to check immigration status. Given some of the laws passed at the state level, I would hope that schools would not be passing on this information. What educational goals are supported by collecting this data?

-------------

-------------

I also like how "Family Bible" is included as a proof of ID.

B. Getting Ready For People to Opt Out

inBloom appears be anticipating that people will opt out of tests. The Reason Not Tested list includes parental waivers, and parents opting out.

-------------

-------------

Using this data, people or organizations with access to data stored in inBloom could create a rolodex of parents - complete with addresses, emails, and contact info - who are opting out of testing.

C. Getting Ready To Restrain

inBloom has the capacity to track when students are restrained.

-------------

-------------

However, inBloom makes no similar accomodations for tracking students that are subject to corporal punishment. According to congressional testimony (quoted below), there are between 2 and 3 million occurrences of students being hit in school each year, and corporal punishment is legal in 30 states. Given how inBloom supports tracking other disciplinary actions, this seems like an odd and unnecessary omission.

The prevalence of corporal punishment of children in schools remains high in the United States. In spite of many education and other national groups calling for corporal punishment in schools to be banned, the United States remains one of the few industrialized countries allowing corporal punishment in 30 states.\2,21\ According to the Office of Civil Rights (2007), school officials, including teachers, administered corporal punishment to 223,190 school children across the nation during the 2006-2007 school year.\8,12\ Experts note that there are about 1.5 million reported cases of physical punishment in school each year, but calculate the actual number to be at least 2-3 million; as a result of such punishment, 10,000-20,000 students request subsequent medical treatment each year.\8,9,12\ During this same period, the top ten states for students being hit were, in order of highest to lowest frequency: Mississippi, Arkansas, Alabama, Oklahoma, Louisiana, Tennessee, Oklahoma, Texas, Georgia, Missouri, and Florida.

D. What Student Characteristics Really Matter?

inBloom supports the ability for schools to track Student Characteristics

-------------

-------------

Apparently, "Immigrant" and "Single mother" are "conditions" that get recorded. See point A, above, about how inBloom could be used to target families based on immigration status.

E. Collecting Social Security Numbers

According to the enumerations, Social Security Numbers are among the ID's stored by inBloom for both Staff and Students.

-------------

-------------

Additionally, inBloom's FAQ states that social security numbers will be stored if everyone agrees that they should:

inBloom discourages storing social security numbers in its data service, but legally school districts and state may record student social security numbers. inBloom prohibits storage of social security numbers in the data store unless agreed to by both inBloom and the state/district on a case-by-case basis.

However, less than a month ago, Iwan Streichenberger, the CEO of inBloom appeared to say (via Twitter) that inBloom does not store Social Security numbers. As I asked a couple days ago, however, it looks like inBloom defers to states and/or districts, and that they will store what they are provided.

Closing Thoughts

In many ways, inBloom is helping to bring visibility to the issue of data collection, data storage, and data sharing. inBloom is a data store, collecting data from many sources into one location. inBloom is different than other past efforts for its scale and partnership efforts. It would be great to see inBloom and the various agencies collecting data be more proactive about how data is collected, when the collected data can be reviewed by students, teachers, and parents, and how inaccurate date in the system can be reviewed or deleted. Right now, inBloom appears pretty silent on most of these questions, which does nothing to dispel concerns about how - and by whom - the data will be used.

When data is collected at scale, on a large number of people, over time, the role of for-profit companies in the ecosystem needs to be blatantly, obviously clear. When a data set is large enough, even a small number of data points from within that data set can be used to target and identify individuals within that data set. Given the value of student data, and the lack of transparency around how that data is used once it has been handed over, both inBloom and any schools, districts, and states collecting data need to clarify the rules, and how people can be certain these rules are being followed. In the absence of guarantees, students and parents need to be given access to their data so they can review and correct it as needed.

As we have seen, sometimes data is completely worthless. Moreover, if a student is at a school where corporal punishment is practiced, how much can we trust a discipline report from the same person who hits kids in the name of education? There are lot of open questions here, and these open questions undermine the value of any data that would be collected at scale.

Most importantly, kids aren't going to school to provide researchers with data points. The purpose of school isn't to get people comfortable with life under constant observation. The endless efforts at data collection to capture what "works" with learning have the potential to disrupt the learning they are trying to capture. Learning requires trust; treating students like subjects - rather than people - is a surefire way to erode trust before it has a chance to get started. Without clear, obvious, and fully transparent rules around data collection and how that data is managed, we run the risk of observing our public education system into irrelevance.

Beverly Hall, Cheating, and Ruling By Fear

When Beverly Hall ran the Atlanta public school system, she oversaw gains on student test scores on standardized tests throughout the city. These gains resulted in her being named the 2009 Superintendent of the Year, and collecting $580,000 in performance bonuses over 10 years.

According to an indictment handed down on Friday, Beverly Hall and 35 other people within the Atlanta school system conspired to cheat. The cheating consisted of people changing student answers on standardized tests. The gains in Atlanta - based largely in improved test scores on standardized tests - are likely not real.

Beverly Hall and Arne Duncan at the White House

While the cheating in Atlanta - and the level of cheating - is horriffic, it's not new - and there are some indicators that it could be widespread. With that in mind, it's worthwhile to look at the conditions that existed under Dr. Hall's leadership that are cited in the indictment as contributing to the scandal.

The cheating scandal also has implications for the integrity of data collected on students. Given the push to collect more data, and to use that data more widely, the actual quality and accuracy of data needs to be unquestioned. Cheating scandals like this make that seem like an unreachable goal.

The quotations in A, B, and C are from the New York Times. The quotation in section D is from the Atlanta Journal-Constitution

A. Merit Pay, and Fear of Job Security

Teachers and principals whose students had high test scores received tenure and thousands of dollars in performance bonuses. Otherwise, as one teacher explained, it was “low score out the door.”

Ms. Parks, a 17-year veteran, said a reason she had kept silent so long was that as a single mother, she could not afford to lose her job.

B. No Excuses Mentality

Her (Hall's) focus on test scores made her a favorite of the national education reform movement, nearly as prominent as the schools chancellors Joel I. Klein of New York City and Michelle Rhee of Washington. Like them, she was a fearsome presence who would accept no excuses when it came to educating poor children. She held yearly rallies at the Georgia Dome, rewarding principals and teachers from schools with high test scores by seating them up front, close to her, while low scorers were shunted aside to the bleachers.

C. Ruling By Fear, and Job Security

Dr. Hall was known to rule by fear. She gave principals three years to meet their testing goals. Few did; in her decade as superintendent, she replaced 90 percent of the principals.

Teachers and principals whose students had high test scores received tenure and thousands of dollars in performance bonuses. Otherwise, as one teacher explained, it was “low score out the door.”

D. Retribution Against People Who Spoke Out

When a teacher at C.W. Hill Elementary complained about cheating by a colleague in 2005, Hall suspended the accused educator for 20 days. As for the whistle-blower, Hall fired her.

Closing Thoughts

Richard Hyde, one of the investigators whose work led to the indictment, made the following observation after listening to secretly taped recordings of the people cheating:

As he listened to the hours of secretly recorded conversations of cheating teachers and principals, he was surprised. “I heard them in unguarded moments,” Mr. Hyde said. “You listen, they’re good people. Their tone was of men and women who cared about kids.”

When we talk about improving our educational system, how do we ensure that the structure around teachers and students support and reward our best work? How many more cheating scandals do our students need to endure before we begin to look at - and jettison - the failed experiments of merit pay, no excuses, and ruling by fear?

Image Credit: Picture of Beverly Hall and Arne Duncan at the White House found at http://www.substancenews.net/articles.php?page=1866

Syndicate content