Stop wasting your time on item-analysis of standards and skills on state ELA tests, people
Tim Shanahan has some advice and candor that many principals and district leaders sorely need to hear.
“What makes the difference in reading performance isn’t practice answering certain question types, but practice in interpreting texts that are challenging–that pose barriers to meaning.
. . . The point isn’t that the standards should be ignored, but that teachers have to understand that reading comprehension tests do not/cannot measure single, separable, independent skills. These instruments provide nothing more than an overall indicator of general reading comprehension performance.”
This is the annual rigmarole that schools waste their ELA teachers’ time with at the beginning of each school year.
Stop it, folks. Just stop it. You’re not going to glean new insight about how to effectively teach literacy to your kids by doing intensive item analysis of the standards and questions on the ELA state test.
Instead, read real literature and engage your kids in learning about their world. Then you might actually have an impact.
“At least on paper, it is difficult to tell what separates the schools at the bottom of the list from those at the top, which cuts to the core of what makes school turnaround so difficult: nobody knows precisely what works.
‘The problem is that there is no silver bullet to turnaround interventions,’ said Priscilla Wohlstetter, a distinguished research professor at Columbia University’s Teacher College. ‘It’s a really tough thing to figure out what makes the difference in schools.’”
Make sure to read behind the headlines on the new CREDO study. There’s a lot of unknowns and nuance to their findings.
Matt Barnum does a nice job of drawing those out in this Chalkbeat piece.
“…the study can’t explain why closures happen more often in certain communities. For instance, if low-achieving schools with many white students are especially likely to be located in rural areas where there are fewer alternative schools, that may help explain the results.
Another explanation could be that the expansion of charter schools in high-minority areas puts additional fiscal and enrollment pressure on districts and charters — as charters expand, other schools may close as their enrollment declines.
What is clear, though, is that black and low-income students and communities are especially likely to have a school closed.”
I’ve worked in ELA classrooms in 6th, 7th, and 8th grade using the Expeditionary Learning curriculum (freely available on EngageNY), and now I work supporting other ELA teachers in the Bronx, who often also use this curriculum.
I think the curriculum has a lot to offer*, but it’s also a heck of a lot of work to unpack. While each lesson provides a script, there’s few you could deliver as is. First of all, you’d never be able to get through many of them in a normal period. EL throws the kitchen sink into these lessons. Furthermore, you’d find yourself stranded in the middle of a lesson confused, trying to figure out where it was supposed to be going, or discovering you were supposed to have an anchor chart drawn up to refer to.
Like most curricula, Expeditionary Learning ELA curriculum requires each teacher to have first read, processed, adapted, and developed additional resources to complement each and every lesson. My co-teachers and I would develop our own “talking points” based on our interpretations of a lesson, then create an accompanying presentation, and finally, create a student guide/handout that matched our talking points and presentation. Doing this was intensive work for each individual lesson. The teachers I’ve been working with also find this incredibly daunting to do — most especially because they are also often told to implement the Teacher’s College writing curriculum alongside of it (. . . which is a whole ‘nother can of worms I’m not going to get into here). Suffice it to say, I’ve been trying to figure out how I can help other middle school teachers process and implement the EL curriculum efficiently and effectively.
So this summer I worked on a couple of tools to try to help ELA teams and teachers to be more strategic about how they are using the EL curriculum.
First on offer is a curricular overview of all the modules from 6-8, starting from a departmental-wide overview, then moving to a pacing calendar, which includes all of NYC’s official calendar dates. If you’re not in NYC, then of course modify to match your own district’s calendar.
At first glance, this may look like I’ve just copied and pasted a bunch of stuff from the original EL materials and reorganized it. And much of it is exactly that (my intent is to make it more accessible; EngageNY’s materials can be hard to manipulate and adapt). But I’ve also made a few editorial additions and decisions, which I will explain shortly.
In order to use the document, first make a copy for yourself, then you can edit it as you wish. Please share this with any teachers you think might be able to use it.
The first thing you’ll see is a departmental overview, consisting of Enduring Understandings, Essential Questions, and Focus Skills/Standards. These are not an explicit part of the EL curriculum itself, so I created the EUs and EQs based off the the module-level content. The focus skills I pulled from the EngageNY 6-8 Curriculum Map, which lists those focus skills for each Module 1-4 across the grades, so I thought those made sense as an encapsulation of the overall focus.
You’ll want to discuss these as an ELA team. Are these the Enduring Understandings you and Skills you want your students to graduate your school equipped with? Modify these first, then tailor the modules and units to match your focus.
I then included all the protocols and practices that EL provides as part of the curriculum. These are all good. But you would be wise to discuss these as a school, across all your content areas, and select a few common protocols and practices that you will use consistently across classrooms.
You’ll notice I’ve included every single module, including the alternative modules. So you will need to delete the columns and content that your team are not actually using, both in the section for Essential Questions/Assessments and in the Sequence section.
For the Focus Skills/Standards for each module, I literally went through every single lesson standard for each unit and looked at what was consistently practiced across the unit, then counted only those most practiced as the focus skills. I then pulled the “I can” statements that were developed by EL to align with those standards. But even still, you’re most likely going to want to focus and narrow these down to make them even more targeted.
I didn’t include the Focus Skills/Standards for Unit 3 of any modules because I’ve made the strategic decision to advise the schools I am working with to cut Unit 3 from each module. There’s simply not enough time, and while Unit 3s are nice, they are not essential. They are the fluffier “performance task” pieces. There’s a lot more to explain about my rationale on this, but not going to get into it now. Ask me if you want to know more. In any case, I didn’t want to waste my own time digging into something I wasn’t going to use.
Now you get to the pacing calendar. This is where the rubber meets the road. It’s nice to say you want to do all 4 modules. Go ahead, try to pace those out, while ensuring you’re including assessment days for MOSLs, baselines, iReady, test prep, or whatever the heck else your school will throw into the mix.
Or don’t. I already did it for you, leaving some extra time in there in March with the assumption you’re doing some test prep. If you wanted to do full modules, including Unit 3, you’d only be able to barely get through 3 modules.
So either you barely do three modules (probably still would need trimming). Or you cut Unit 3s and do Units 1 and 2 only for four modules.
You then need to consider your marking periods. Do you want the modules to align with those? If you’re doing four marking periods, it can be done. But it requires cutting Module 1 quite a bit. What you can do is cut Module 1 at the Unit 2 Mid-Unit assessment. This isn’t as tragic as it seems, since if you think about it, module 1 is really about getting students up to speed and engaged in reading and writing — then you can move on for deeper work in module 2.
Finally, the next thing you’re really going to need to take a look at as a team, aside from the actual lesson planning and development, are the mid and end-of-unit assessments. Do these align with the focus that your department has for your students? Do you want to modify them to include more multiple-choice, or more short-response writing? Do you want to design your own to supplant them? This is important work, because it will determine the type of data that you are looking at most closely to determine student feedback and grades.
Here’s an example of an adapted calendar in which Units have been cut and paced out in order to match a real school’s calendar. You can see that once you cut out all the school’s assessment days and “skill” days on Fridays, you’ve only got roughly 100 calendar days for the EL curriculum, and even that’s probably being optimistic.
The other resource I’d like to share is that EL has done some nice work turning the standards into student friendlier “I can” statements. But unfortunately, they embedded these wonderful statements deep within and across their many lengthy documents. So I pulled them all out and put them alongside the relevant grade-level standards so that you can access them more easily.
I am aware that the NY standards are being revised, but let’s be honest — they aren’t substantially different than the CCSS, and tests won’t align to the new ones for a few more years. I’ll update these accordingly, but it will just be a matter of some shifting around and deleting of a few of the standards.
I hope these are useful resources as you plan for your upcoming school year. Please let me know if there’s anything that I need to clarify or revise, or if you need further assistance in using these. Good luck!
* As a footnote, I want to note that Expeditionary Learning’s materials have a long way to go before they could be considered a viable curriculum in practice (in my opinion). And yet, comparative to most other ELA curricula, this is some of the better stuff out there, though I’d advise you to check out LearnZillion’s work with Louisiana’s Guidebook Units (disclosure: I’ve done a little bit of work on those and with LZ in general) or Great Mind’s Wit and Wisdom for clearer and more user friendly ELA curriculum.
What this tells us is that we’ve got alot of work to do before we have rigorous curricula in more ELA classrooms that every teacher can effectively deliver.
But I also want to point out that the fact that EngageNY has provided this curriculum under an open license and for open access is the only reason that we’re able to have this conversation and that I’m able to provide these resources. I can’t do that for Teacher’s College curriculum because it’s proprietary. So the more we can share open educational resources, the more transparently and widely we can develop better stuff.
Thanks, Expeditionary Learning, EngageNY, NYSED, and the Public Consulting Group for providing these resources to the public. Now let’s get to work making ELA curriculum better and more usable.
I’ve argued before that one of the biggest problems with what we teach students across our nation is that it’s completely incoherent, and we do little to nurture a collective sense of values, knowledge, and civic engagement.
Here’s that problem in action:
Virginia’s standards of learning for U.S. history to 1865 include “describing the cultural, economic and constitutional issues that divided the nation” and “explaining how the issues of states’ rights and slavery increased sectional tensions.” Alabama fifth-graders “identify causes of the Civil War from the Northern and Southern viewpoints.”
Contrast that with Delaware, where school districts set their own curriculum but a syllabus for the eighth grade suggesting what might be covered during instruction says that abolition meant that the American people could for the first time “seriously claim to be living up to their commitment to the principle of liberty rooted in the American state papers.”
In Michigan, curriculum also is decided locally, though the state’s social studies standards for the Civil War and Reconstruction in eighth grade include the instructions: “Explain the reasons (political, economic, and social) why Southern states seceded and explain the differences in the timing of secession in the Upper and Lower South.”
Teacher shortages in high needs areas, such as SPED and math, with no end in sight
One of the suggestions here for addressing this makes a lot of sense to me:
“Make teacher certification national instead of state by state. Prospective teachers must pass an exam specific to the state they want to work in. But if a teacher wants to move from, say, Pennsylvania to California, they can’t immediately apply for jobs there. By having a national certification exam, teachers would have more mobility to go where they’re needed.”
I have been privileged to attend a few workshops now on these writing strategies, and have begun including them in my work with teachers here in the Bronx. My blog post on the strategies is listed on TWR’s webpage. Nice to see my little logo up there alongside NY Times, Washington Post, and The Atlantic. 🙂
The book is on pre-sale here and you can find workshops on the method from TWR here and from WITsi here.
The invisible crop killer
“Research has shown dicamba vapor can travel up to three miles, and symptoms may not manifest themselves for weeks after application. Crops with herbicide injury aren’t covered by crop insurance, and proving who was responsible and recovering damages is a little like having a hit and run on your car in the parking lot at Walmart.”
Kids struggling with disrupted education need coherent systems of support
“Thoughtfully creating coherent systems of support that enable all students to graduate from high school prepared to enter college or the workforce requires a wholesale rethinking of the ways in which education and social service agencies interact with one another, with the children in their care, and with families and caregivers.”
This one critical and overlooked aspect of the incoherency that kids experience in our educational systems. I would add to this the incoherency in content, instructional practices, and expectations to that list.
This was a key argument in support of common standards and content. Students who are struggling are often the ones who change living situations most frequently, and they experience an incoherent mess of content across classrooms and schools, rather than a thoughtfully sequenced and coherent set of topics, themes, and skills.
Still wearing his headset, Greene opens up the floor for questions. One student, from Denmark, asks, “How does it feel to be teaching in the next step of education?” As Greene answers—about how it’s so wonderful that people from around the globe can gather and share complex ideas like this—a student flings a virtual tesseract at the teacher’s head. Next step, indeed.
the74 breathlessly reports on a digital early learning initiative in California wine-making country, but I’m not sure the lessons promoted therein should be taken at face value.
“The first message is, digital works,” Nemko [the Superintendent and promoter of this effort] says. “Digital is engaging, and the one thing we know is that student engagement is the biggest measure of achievement. If you are engaged more — and this has a breadth and depth because of all the additional games and letter recognition — you are going to learn more.”
But that’s not the message I receive when I read this article. What I see is what happens when a concerted effort is made to provide a systematic and structured effort to address literacy development in young learners. I’m sure all the bells and whistles of an iPad are lovely. But adding animations and interactivity to a text alone are not what promotes literacy growth. What I view as the most powerful levers here are that the initiative is getting parents involved, and they are structuring vocabulary, phonemic awareness, phonics, and comprehension activities around a core body of texts.
So kudos is certainly due to the efforts being made, in public-private partnerships, to promote the literacy development of Napa Valley children. But let’s not turn this into another mistaken boosterist heralding of iPads and personalized digital learning.
If you care about education, it’s worth paying close attention to what’s going down in Silicon Valley. The hyperdrive capitalism of venture investment, with its raw focus on the rapid scale of the highest performing and rapid failure of all the rest, parallels and in some ways informs edtech and charter models.
There’s certainly a healthy and necessary space in education for a private marketplace of rapid iteration, scale, and fail. But there’s also a necessity for the less efficient but robust, slow-growth, long-term models of public schools.
In The New Yorker there is an interesting piece on Y-Combinator’s Sam Altman relevant to this. It’s interesting purely as a biopic, but scattered throughout are insights into the driving mindsets and ethics of Silicon Valley. Let’s take a closer look at some quotes from the article with the frame of education in mind.
Altman, as he nursed a negroni after dinner, had his own warning for the timid: “Democracy only works in a growing economy. Without a return to economic growth, the democratic experiment will fail. And I have to think that YC is hugely important to that growth.”
Democracy needs a heck of a lot more than just a viable economy. It needs strong civic institutions and an active citizenry that has a shared understanding of how to engage with those institutions and of their purpose. Public education should serve the public in cultivating shared civic knowledge and values.
. . . In his book “Hackers & Painters,” Graham calculated that smart hackers at a startup could get 36x more work done than the average office drone—and that they would, therefore, eventually blow up employment as we know it. He made this sound patriotic and fun; how could an oligarchic technocracy go wrong?
Indeed? How could a focus solely on only the most productive and efficient members of society go wrong? In education, imagine if we only invested in the most gifted and talented. The rest would be herded into service professions or unskilled labor. A meritocracy! Wait. Isn’t that more or less how things used to be before the advent of a public education . . .
. . . And he told me, “It’s bad for the companies and bad for Silicon Valley if companies can stay alive just because they’re [associated with Y-Combinator]. It’s better for everyone if bad companies die quickly.”
This is a driving philosophy of venture capital and rapid scale that Silicon Valley pursues. Scale the few most successful ventures rapidly, and fail the remainder. With schools, we could only invest in and scale the ones that demonstrated strong academic performance — all the rest we would close. Sounds good, right? Kids should only be in schools that have demonstrated their worth.
But there’s a problem with rapid scale in terms of sustainability:
. . .The truth is that rapid growth over a long period is rare, that the repeated innovation required to sustain it is nearly impossible, and that certain kinds of uncontrollable growth turn out to be cancers. . . Every great startup—Facebook, Airbnb—has no idea why it’s growing at first, and has to figure that out before the growth stalls. Growth masks all problems.”
A school could be high performing, but not such a great place to be.
This isn’t to say that there isn’t a place for markets in the education system. A market doesn’t have to mean Silicon Valley style scale and fail.
…it’s possible to create a huge tech company without taking venture capital, and without spending far beyond your means. It’s possible, in other words, to start a tech company that runs more like a normal business than a debt-fueled rocket ship careening out of control. Believe it or not, start-ups don’t even have to be headquartered in San Francisco or Silicon Valley.
. . . You can simply start a business, run it to serve your customers, and forget about outside investors and growth at any cost.
Schools that do this work are the ones that get better: they put their focus on service to their students and families and adapt accordingly.
But there’s other ways that those who abide by the scale and fail model are investing in, recognizing the limitations of a brick and mortar approach. Venture capitalist Marc Andreessen (you may have heard of AltSchools?) lays out the long-game for software and tech in the education industry in this Vox interview:
Primary education in the US is a monopoly. It’s a public sector monopoly with very little competition. Even the charter schools end up under sustained attack for violating the monopoly. You see this most recently in New York with De Blasio trying to shut them down. A government-sponsored monopoly is not easy to move.
. . . New technologies tend to vaporize on impact with those institutions. The last thing a unionized public school wants to do is to fundamentally change how they operate. Of course they don’t want to adopt new technology. It’s antithetical to the philosophy.
So the solution? Software!
Look, there’s great potential for technology in the education sphere, and I think experiments like AltSchools and Udacity are well worth making. But Andreessen’s premise here is false. Having worked in NYC public schools for even the short length of time that I have, I’ve seen so many tech fads get readily embraced by educators and districts that it’s become ridiculous. Rather than “vaporizing on impact,” new tech fads rather seem to become desperately embraced and then just as hurriedly discarded. Harried educators and administrators would love it if a SMART Board or data system or robot would magically and rapidly improve the outcomes for their kids!
But I do think Andreessen makes a more balanced analysis and point here:
We can’t revamp the entire system. Nobody can. But I think more and more, there are gaps in what the current system can accommodate compared to what people actually want. There are opportunities to build on the edges, around the sides, parallel systems. And at the very least introduce choice. In the best-case scenario, it becomes a real challenger to the status quo.
I fully agree that there are massive gaps and many opportunities to better serve our nation’s students, and I for one welcome the evolution of edtech and tools and software, as well as the vibrant niches of effective charter models and networks. But we’re on a quixotic mission if we’re shooting for supplanting public education systems, rather than supplementing them.
The argument for why this is so can be viewed in statements that Barack Obama and Vox’s Ezra Klein have made about the function of public institutions vs. private ones (I’ve posted this before):
The final thing I’ll say is that government will never run the way Silicon Valley runs because, by definition, democracy is messy. This is a big, diverse country with a lot of interests and a lot of disparate points of view. And part of government’s job, by the way, is dealing with problems that nobody else wants to deal with.
. . . sometimes we get, I think, in the scientific community, the tech community, the entrepreneurial community, the sense of we just have to blow up the system, or create this parallel society and culture because government is inherently wrecked. No, it’s not inherently wrecked; it’s just government has to care for, for example, veterans who come home. That’s not on your balance sheet, that’s on our collective balance sheet, because we have a sacred duty to take care of those veterans. And that’s hard and it’s messy, and we’re building up legacy systems that we can’t just blow up.
I will say one thing about both government and private-sector production, which is something that I do think is important is there is an advantage to being willing to do kludgy, difficult, somewhat unpleasant things.
. . . As you say, there’s an attraction — recognizing the government is inefficient — to just saying, “Well, let’s just do cash transfer for everything. Let’s go UBI for everything.” But there is a lot that government does, often not that well, that somebody needs to be doing, because a lot of the people you want to help are actually really difficult to help. This is something . . . this is one of the things I believe strongly in policy that we underrate.
A lot of what we’re trying to do in government is not help people who want “free stuff,” but is help people who are actually very, very difficult to help. This is particularly true in health care.
And particularly true in education. The work of education is a slow, complicated, incremental process that will benefit from new technologies, software, and schools, but that will not rapidly scale, and provides a public service that makes rapid failure of massive amounts of schools or students a nonviable option.
“Students do the bulk of their learning independently. They make their own way through online lessons, digital texts and multimedia, and follow links to extra, explanatory resources. They upload all their work. Yet the students and parents interviewed for this story said that they have more one-on-one interactions with teachers than they did in traditional schools.”
Unsurprisingly, one of the few virtual learning schools that demonstrates success is predicated on forming relationships between teachers and families. The competency-based aspect of its curriculum is also intriguing and worth keeping an eye on.
For students with disabilities and other students for whom more traditional schools can present significant obstacles, this form of learning holds great promise.
“Lighting is really not about a fixture in the ceiling anymore,” said Mariana Figueiro, who leads light and health research at the Lighting Research Center of Rensselaer Polytechnic Institute. “It’s about delivering individualized light treatments to people.”
. . . At Brown University, researchers are looking at both spectrum and intensity to design a system to help adolescents stay alert in school.
“If we just did blue enhanced light it might be better for the circadian timing system, but it might not be as good for the alertness and the academic needs that they have,” said Mary A. Carskadon, a professor of psychiatry and human behavior who studies sleep in children, adolescents and young adults. “We want to see if we can hit on the best combination that will enhance those features.”
“On a cloudless summer day, sunlight touched nearly every corner of the building with the help of vast windows and sun tubes; experts say that students learn better when they are exposed to natural light.
The building, too, is designed to be incorporated in lessons. With a rooftop full of solar panels and a geothermal-well system to heat and cool water, it will be a “net-zero” building . . .
The school will feature a rooftop solar lab with a moveable solar array, allowing students to learn about the photovoltaic panels fueling their school. Signs will teach them about the geothermal wells.”
Even the school’s layout is intended to be built into lessons.