Tag Archives: ALAST

Fixing Teacher Preparation in New York State: Why Collaborative Processes Improve Outcomes.

How should we prepare prospective teachers for the classroom?

Law schools require a three-year sequence of classes and culminates in an examination – the bar exam.  The exam is not an accurate predictor of success or competence, it is the badge that the legal profession requires for entry.

The Office of the Professions within the New York State Department of Education (NYSED) licenses about fifty different professions. From medicine to veterinarian  to massage therapist to speech language pathologist, each has specific requirements and the state issues licenses/certifications that are required for practice.

The licensing process sets a minimum bar for entry into a profession.

State Ed approves colleges and university courses of study and requires terminal exams. The NYSED website lays out the step by step process and before John King required two examinations, the LAST and the ACT-W, the pass rates were in the high 90 percents.

When David Steiner, who had an excellent relationship with the education community, especially the unions, precipitously left his deputy John King became the commissioner.

The Common Core and the Common Core testing “pushed off the end of the diving board” approach has been well documented. Proficiency rates (aka pass rates) moved from 2/3 passing to 2/3 failing. Opposition grew into the Opt -Out Movement, one in five students opted out, and the opt-outs are heavily concentrated in suburban communities: the better to pressure the local electeds. The Long Island Opt-Out Facebook page has over 20,000 “friends.”

What had not received adequate coverage is the King imposed changes to teacher preparation certification requirements. King dumped the two exams and replaced them with four exams without any consultation with college instructors or deans.

The new exams are the edTPA, Educating All Students (EAS), Academic Literacy Skills Test (ALST) and the Content Specialty Test (CST) in the area of specialization.  At colleges the new requirements created chaos, suddenly colleges were turned into test prep mills, new exam passing rates fell sharply, many students were not completing the cycle of exams and the state instituted safety nets in an attempt to salvage and defend the flawed system. (See John King letter here)

If I was teaching a course for superintendents on policy creation and implementation I would use the  teacher prep policy changes as an example of how well-intended changes can crash without a carefully crafted collaborative plan; and, I would emphasize the word collaborative.

There is an immense literature on organizational change: the number one rule, “participation reduces resistance.”

A year or so ago the new chancellor and the new state commissioner began to rebuild the relationships: teachers, legislators, parents, the governor, trying to craft policies that addressed the myriad issues confronting schools.

Betty Rosa, the new chancellor is the leader of the policy board, the Board of Regents. Rosa chose Regents Cashin and Collins to co-chair the Higher Education Committee. Regent. Cashin, a career educator in New York City and Regent Collins, with a nursing,  background from Buffalo.

Over the last year the chairs of the Higher Ed Committee have held about ten forums across the state (I attended two of them). Hundreds of college teachers and students participated, wide ranging discussions, a few panels were live streamed. Deans of colleges of education met with the Higher Ed Committee, the union, the  UUP (United University Professions) played a crucial role. An edTPA Task Force was formed, co-chaired by a high level SUNY administrator and a vice president of the UUP.

At the Monday. February 13th Regents Meeting [Meeting canceled due to blizzard conditions] a proposal will be put forth.

(Click on the links for detailed explanations)

 

Proposed Amendments to Part 80 of the Commissioner’s Regulations Related to the Elimination of the Academic Literacy Skills Test (ALST) for Teacher Certification and to Remove Unnecessary References to the Liberal Arts and Sciences Test |  HE (A) 1 *
Proposed Amendment to Section 80-1.5 of the Regulations of the Commissioner of Education Relating to the Establishment of a Multiple Measures Review Process for the edTPA |  HE (D) 1 *

 

The Academic Literacy Skills Test (ALST) will no longer be required and a revised safety net will be in place for the edTPA .

This is not the end of the process, the ed TPA Task Force will continue to review the teacher preparation requirements,  especially the student teaching requirements that vary widely from college to college.

The King approach: to push changes through the Board of Regents without any consensus from the field, from the folks who are expected to carry out the edict frequently dooms the plan.

Enrollment rates in college preparation programs have plummeted from 20% to 40% across the state.  Troubling numbers of students are not completing the exams and not seeking state certification – perhaps seeking employment in other states or in charter schools.

Consensus does not mean unanimity:  at some point in a consensus-building process the leadership has to move to implementation. I fully expect the Board to approve the actions, a comment period, final action later in the Spring, and, a continuing process to explore and revise the teacher preparation pathway.

Yes, we want to assure that teachers are adequately prepared for the classroom. We don’t know whether the exams assure competence, we cannot predict classroom outcomes based on college or exam grades. Teaching is part art and part skill. The revised process appears to be a major step in the right direction, but, only a step.  Are students from some colleges more successful than students from other colleges, and, if so, why? Does teacher diversity or gender impact student learning?  How many weeks of student teaching is the “right” amount? Exploring and fine tuning the teacher prep process is ongoing. The required course of study and the exams provide minimum requirements, akin to the legal profession bar exam.

As teachers we know we will always have to strive to get better, first year or tenth year or twentieth year there are always new skills, if we stop learning we atrophy.

Back to that course for superintendents: I would ask Regents Cashin and Collins to lay out the process that they followed,  Building consensus can be slow, frustrating, at times filled with conflict, personality can get in the way of process, there will be wrong turns, and, eventually the leadership must bring the process to a conclusion. Everyone will not satisfied and some may throw stones.  Remember what Churchill said about democracy: “Democracy is the worst form of government, except for all the others.”

Regents Cashin and Collins deserve accolades for correcting a broken process by including all the folks involved in the day to day preparation of new teachers in the process and having the patience and understanding to continue to seek to improve teacher preparation as we move forward in New York State.

What is the “New Teacher” Crisis? Should We Set High Barriers to Becoming a Teacher or Figure Out How to Retain New Teachers? Exploring the Dunning -Kruger Syndrome

The Dunning-Kruger effect, named after David Dunning and Justin Kruger of Cornell University, occurs where people fail to adequately assess their level of competence — or specifically, their incompetence — at a task and thus consider themselves much more competent than everyone else. This lack of awareness is attributed to their lower level of competence robbing them of the ability to critically analyze their performance, leading to a significant overestimate of themselves.

The State Education Department, under former commissioner King and de facto commissioner Wagner have made decisions that I have to believe are due to a Dunning-Kruger effect, they make no sense otherwise.

The latest are the decisions relating to “raising the bar” for prospective teachers by creating unproven testing obstacles.

The first wave of education reform in New York City was intended to move from patronage hiring to hiring based upon qualifications. The creation of the Board of Examiners, a quasi-independent board created examinations for teachers and supervisors and promulgated rank-ordered lists. Teachers who received passing grades were appointed to positions in schools pursuant to their grade: highest grade to the lowest passing grade. For seventy years the hiring of teachers was a meritocracy; I remember sitting in the gymnasium at Brooklyn Tech High School for hours poring over questions and writing a series of essays. Months later I was grilled by a panel of examiners, it seems like it took hours, and, eventually a list was posted in the newspaper listing the candidates who passed the exam, with their grade. Yes, a form of public shaming, we survived.

In the 60’s the Board of Examiners became the subject of increasing criticism, with a rising civil rights movement racial disparities in pass/fail rates challenged the validity of the tests: were the tests actually job-related?

In the 1972 the federal courts ruled the Board of Examiners tests unconstitutional. (Read the Court of Appeal decision here ), the Chancellor at the time supported the decision of the trial court,

In a memorandum to the Board of Education, quoted by Judge Mansfield in his opinion, Chancellor Scribner stated that to defend against plaintiffs’ case,

“… would require that I both violate my own professional beliefs and defend a system of personnel selection and promotion which I no longer believe to be workable.”

From the mid-seventies into the 90’s New York City required a 20-minute interview. New York State instituted a two-exam system: the LAST and the ACT-W, passing rates continued to increase; today they are in the high 90th percentiles.

A recent study conducted by Hemp Langford of SUNY/Albany and other scholars reviewed teacher quality,

We analyze 25 years of data on the academic ability of teachers in New York State and document that since 1999 the academic ability of both individuals certified and those entering teaching has steadily increased. These gains are widespread and have resulted in a substantial narrowing of the differences in teacher academic ability between high- and low-poverty schools and between White and minority teachers. We interpret these gains as evidence that the status of teaching is improving.

Unfortunately New York State jumped on the “raise the bar” bandwagon without reviewing teacher quality within the state. At the March 17th Regents Meeting the de facto commissioner, defending the new hyper-testing requirements said,

“I think we all want … to send a very clear message that it should be difficult to enter the profession.”

No. I think the “very clear message” we want to send; New York State is preparing highly qualified students to enter the profession. “Difficult” does not assure quality.

The State Ed Department has certainly made it difficult to become a teacher, with no assurances that the hurtles will improve the quality of the workforce.

Prospective teachers in New York State are now required to pass four separate examinations: edTPA, the Academic Literacy Skills Test (ALST), the Educating All Students (EAS) test and the Content Specialty Test (CST) in order to receive their initial teaching certificate.

The edTPA, created by Stanford University and administered and scored by Pearson,

Evidence of a candidate’s ability to teach is drawn from a subject-specific learning segment of 3-5 lessons from a unit of instruction taught to one class of students. Materials assessed as part of the edTPA process include video clips of instruction, lesson plans, student work samples, analysis of student learning, and reflective commentaries. Based on the submitted evidence, which is reviewed by trained scorers, faculty and candidates can discuss the impact of candidates’ teaching performance on student learning and determine ways to improve teaching. Faculty can analyze evidence of candidate performance to guide decision-making about program revision. State education agencies may use edTPA scores for licensure and accreditation

The Academic Literacy and Skills Test (ALAST) is a 210-minute, computer-based exam.

[The teacher candidate] reads a complex informational and narrative text and demonstrates command of key ideas and details in the text … makes logical inferences based on textual evidence … delineates and evaluates the argument and specific claims in a text.

The ALST consists of a selected response section and constructed responses, two focused responses and one extended response.

The Educating All Students (EAS) test is a 135-minute, computer-based exam “consisting of selected response items based on scenario-based responses … the competencies include Diverse Student Populations, English Language Learners, Students with Disabilities, Teacher Responsibilities and School-Home Relationships.”

The Content Specialty Test (CST) is a series of tests in about fifty different areas, the Multi-Subject Grades 1-6 (Common Branches) is a computer-based test:

Part One: Literacy and English Language Arts, Part Two: 40 selected-response items and a constructed response item in Mathematics: Part Three: 40 selected-response items and one constructed response item in Arts and Sciences, tests can be taken in three separate sections or at one time: 5 hours and 15 minutes.

About ten hours of actual testing time and days and days preparing for and constructing the video segment of the edTPA.

The tests and the test preparation materials cost the student about a thousand dollars.

Is the any evidence that the battery of testing will produce more qualified teachers and better student outcomes? The answer is no.

There is general agreement that the edTPA is valuable and should be integrated into college programs; “clinically-rich” programs incorporate a great deal of actual in-class practice teaching, and, a few colleges, very few, use videos as reflective teaching-learning tools for teacher candidates.

I asked the Director of Field Services in a teacher education program if he saw any relationship between the ALAST and EAS exams and teacher quality. His answer, “I’m baffled, top students failed and marginal students passed, it makes no sense to me.”

The State Education folks clearly suffer from Dunning-Kruger Syndrome; they are ignoring mountains of evidence insisting that they are correct.

In New York City 35% of new teachers leave within five years and I’m sure the same number accrues in inner city high poverty school districts across the state; teachers leave high poverty schools at much more accelerated rates than teachers in high achieving schools.

The core of the teacher issue is teacher retention in schools with the lowest academic achievement.

Sadly the rush to “test to teacher excellence” appears to be driving away prospective teachers, enrollment in teacher preparation programs across the state is sharply down.

While the folks in charge constantly beat the diversity drums, they agree that we should attract a more diverse teaching workforce; however, the failure rates on the ALAST and the EAS are significantly higher among black and Hispanic test takers. The exam system is the subject of a lengthy litigation (Gulino v Board of Education and State Education) that is nearing a conclusion; the federal court could rule the exams are discriminatory and unconstitutional.

Yes, I understand Finland only selects teachers from the top ten percent of applicants, Finland is also a nation with almost no childhood poverty and income equality, within their workforce teachers are well-paid. If we dragged Finnish teachers across the pond and dumped them in Rochester or East New York we would not see magic.

Rather than address the problem, attracting the right candidates, providing high quality teacher preparation programs based in evidence, supporting new teachers over their first few years, we are discouraging new applicants, using “tests” that are unproven, not valid or reliable and ignoring the discouraging exit of new teachers, from both the profession and from high needs schools.

Is there a vaccine to cure Dunning-Kruger Syndrome?