The Mirage of a Mirage: On the New TNTP Report on PD


IMG_20150718_135114

Today I went down to DC* for TNTP’s release of their Mirage report on the (non)impact of professional development on teacher effectiveness. TNTP presented an overview of the findings, then journalist Amanda Ripley facilitated an interesting panel with USED’s John King, teacher Jennifer Corroy Parras, DC’s Kaya Henderson, and AIR researcher Dr. Michael Garet.

The big story is that teacher PD is 1) enormously expensive, yet 2) there’s no silver bullet. In other words, teaching is complex (glad ed reform world is beginning to acknowledge this), so we still are very far from knowing what improves teacher practice at scale, yet we’re investing a lot of time, energy, and money in it willy nilly.

There are a lot of aspects to explore, and the panel touched on a number of them. Ripley provided some nice framing of the systemic issues, such as that most PD (and US system of ed at large) is disjointed and incoherent, and that there is a general lack of clarity around what effective teaching looks like, accompanied by high expectations. She noted that this lack of clarity and high expectations for teachers parallels student experiences in our educational system, with both teachers and students leveling off in performance after an initial 5 years.

Both John King and Kaya Henderson pointed out that an oft missing link in PD is a focus on curriculum, a point on which I strongly concur. Curriculum provides the frame, the backbone, the structure that daily guides student and teacher experiences in the classroom. Without that structure and purpose, we are left with the incoherent gloop that Ripley first referred to.

TNTP’s report is incredibly insightful and useful–if enervating–material. I feel like it’s also important to define the kind of PD which the report mainly seems to abide by. I’ll admit that I haven’t yet dived too deep into the report, but from an initial scan of the survey questions and findings, I obtained the distinct impression that they mostly mean “PD” as in a specific dosage or frequency of a prescribed intervention that results in a change in an individual’s teacher practice within the classroom (and which should then ideally translate into improved student outcomes).

When I think of PD, I think of teachers sitting together around a table and collaborating to design common assessments, curriculum, resources, and examining student work and data. This was a component of TNTP’s teacher survey (noted as informal & formal collaboration, and peer time), but the report notes that an equal amount of such time was dedicated to this in both “improvers” and “non-improvers.” But I think there’s one key aspect of such collaborative time that we need to delineate, and which I believe could distinguish between those two populations: how teacher collaboration and planning time connects to a school-wide system.

Let me give some specific examples of what I mean to make this tangible:

  • A bi-weekly 8th grade-level team meeting working to horizontally (within the grade) align curriculum and assessments and strategically build  and reinforce content knowledge and skills
  • A weekly ELA department team meeting working to vertically align curriculum and assessments (and strategically build  and reinforce content knowledge and skills)
  • A PBIS system of agreed upon (developed both school-wide and via grade-level teams) infractions, consequences, and rewards
  • An established vision for utilizing advisory time to provide social-psychological interventions, accompanied by planning time to design these interventions, and time to analyze and assess their impact

You could go into both an effective and ineffective school and witness such use of collaborative time–but the key is how that teacher collaboration ties into a coherent, school-wide system.**

Admittedly, though, this all goes back to the great complexity not only of teaching, but of working in a school. There are so many variables behind what goes into anything remotely approximating either “PD” or “teacher practice” that it is difficult to define what we’re looking for, and even more difficult to do well consistently and to replicate and scale across different contexts.

I came back to NYC with three takeaways that best summarize my thoughts from the TNTP report . We would do well to consider the following in education reform:

  1. Coherency (in curriculum & assessment, first and foremost)
  2. Clarity (in expectations, feedback, and roles for teachers and students)
  3. Hard work (and more hard work)

*Thanks to Educators 4 Excellence for this opportunity

**I think this is what may have contributed to the differences between the charter and district schools in this study. The charter network was more effective in supporting their teachers effectiveness and growth over time. Charter schools often have much tighter and coherent school-wide structures and systems tied to assessment, curriculum, teacher practice, and observation.

Advertisements

3 thoughts on “The Mirage of a Mirage: On the New TNTP Report on PD

  1. Hey Mark,
    Thanks for sharing what you learned from the panel discussion of the TNTP Mirage Report! I’m going to dive into the report now, but you’ve given me some thoughts on Teacher PD that I’d like to share. As someone “trained” to deliver effective professional development to educators, your thoughts regarding curriculum are on point. It does appear, however, that PD is sometimes used as a catch all for teacher collaboration, organization, and even general meetings. An effective professional development program is designed and delivered with several research based components that can help ensure its effectiveness. Disregarding the levels of change, the professional development needs of teachers (based on their input pre-delivery) and the ongoing follow-up and support yields an activity that may not actually be professional development.

    MIke

    Like

    1. Hi Mike, thanks for sharing your thinking on this. As someone who delivers PD, you may find the TNTP report a difficult read–because it suggests that there is no such thing as “effective” professional development! That’s the hard news in it. I think you’re right that PD is used as a catch-all–but in my mind, the most effective PD I’ve experienced has less to do with someone who has been trained coming in to my building, and more to do with my team getting together and collaborating (in a structured manner that aligns with school-wide systems and vision). Big takeaway from the report was essentially: we don’t know what works and why. Further research needed!

      Mark

      Like

      1. Mike

        I agree. Without collaboration, PD is toothless.
        I also think that sometimes as educators, we don’t define terms as clear as we should. There can be a benefit from outside evaluation and sometimes motivation, but that ain’t PD!

        Mike

        Like

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s