kitchen table math, the sequel: stupid in Brookline

Friday, January 18, 2008

stupid in Brookline

In what may be the most innovative attempt to measure student progress in the state, Brookline officials recently unveiled a two-year effort to supplement the pencil-and-paper testing provided by the Massachusetts Comprehensive Assessment System with in-classroom activities that cover a broader range of topics and skills.
[snip]

Junior high school science teachers have developed an assessment to measure skills in inquiry and data analysis, which are not measured by MCAS. Seventh-graders are presented with an activity involving a bouncing ball, while eighth-graders use a pendulum for their assessment, and how the students collect and analyze the results is graded according to guidelines that are shared by all of their teachers.

The resulting discussion among the teachers, according to Mark Goldner, a Heath School science teacher, explored the students' poor results in making sense of their data and how the teachers could deepen understanding of these skills.

In the past, Brookline officials have taken a strong stand against what they see as the narrowing focus by schools statewide to meet MCAS-tested standards, and the high-stakes requirement that students pass the MCAS to graduate from high school.

[snip]

The new assessment system was constructed when teams of teachers, grouped by subject and grade, explored how to capture evidence of such learning.

Fischer-Mueller said Brookline officials read a lot of research on assessments and their role in closing the achievement gap, and look at what other schools are doing. "But we don't just transfer, we translate for what will work well in Brookline to get the results we want," she said.

note: They "read a lot of research."

Were any of them trained in assessment and psychometrics?

No.

Did any of them go back to college and take a course or two in assessment and psychometrics?

No.

Has the public been provided a bibliography of the "research" these educators read?

No.

They read a lot of research, then spent hours of their time cooking up whole new tests to give their students on top of the state tests the kids already have to take. If you want your child to be tested and assessed all the livelong day, move to Brookline!

Brookline's fancy new tests will enable * Brookline teachers to send home report cards assessing the whole child, not just the child's knowledge of math, science, social studies, and ELA.

Here in Irvington we're way ahead of the game. Our Comments Bank [see here for sample Comment Bank including Positive and Negative Comments!] allows teachers to punch in a code that prints out such Comment-Bank gems as "finds subject matter difficult" or "inferential thinking needs improvement" on Quarterly Report Cards and Interim Reports. Lucky us. As a teacher told us this week, "Parents want to know these things."

Yes, indeed. Prefab essentializing comments about your child's innate cognitive abilities: so much more authentic than a simple B or C.

The public got its first extended look at the system during the School Committee's Jan. 3 meeting, where members praised the assessment presentations.

The public. Just getting its first extended look.

That rings a bell.

"This is such a culture change," chairwoman Judy Meyers said. "When I came to the School Committee eight years ago, there were pockets of excellence in individual schools, but no learning together and sharing what we knew. The whole approach has changed."

[snip]

"We are mining MCAS data as well," Stone said. "But we put analysis and critical thinking in our learning expectations, and we must have a way to assess that. Paper-and-pencil tests just do not give us all we need."

More tests, please!

Because of state and national requirements, the paper-and-pencil tests aren't going away. But Brookline officials have long maintained that their existing curriculum is more than adequate, and students don't receive any special MCAS preparation. The new system won't demand significantly more time from students or teachers, officials said, but will provide a common way of measuring the performance of the district's teachers, students, and schools.


So....the new tests won't take any more time because a) we don't count the time we spent cooking up the tests, presenting the tests to the public, and flogging the tests in the education press and b) we're also going to ignore the time the kids spend taking the new tests and the teachers spend giving the new tests.

et voila

More tests in the same amount of time.

Board member and MCAS supporter Alan Morse questioned whether the science-inquiry assessment might interfere with students' ability to perform well on the MCAS science tests.

"No," said Sue Zobel, a Lincoln School science teacher. "A lot of us are coming out of mourning over MCAS and losing the inquiry strand because the test is a mile wide and an inch deep. We've been wanting to restore inquiry to science."

Superintendent Bill Lupini concurred.

"This doesn't just inform instruction, it's fun and motivational," he said of the new assessments. "In a lot of cases, it's using time a different way, rather than taking more time. These aren't assessments where you stop learning for a big test. You could argue that it is instruction: It's real-world learning."

In looking beyond MCAS, district seeks a sharper view
By Andreae Downs
Globe Correspondent / January 13, 2008

I have a suggestion.

Let's assess the fun and motivational part. Let's find out just how fun and motivational students find these fun and motivational non-tests. Then let's find out just how fun and motivational it is for parents to learn that their kids have hosed a whole new set of tests.

Suggestion number 2: I say we all send letters of support to board member Alan Morse.

Today.



* popular edu-term

7 comments:

SteveH said...

"...to supplement the pencil-and-paper testing provided by the Massachusetts Comprehensive Assessment System with in-classroom activities that cover a broader range of topics and skills."

Isn't that called tests, quizzes, and homework. Can't they figure out what a child knows based on what they write down on paper? How about a lab report? How about class participation? What do they learn in ed school?

The problem is not pencil and paper, and nothing ever stopped them from doing more than what's on MCAS. Since when are state tests the goal and not the minimum.


"For instance, in gym class a teacher may record the number of situps each child in a particular grade can perform. The number would be compared with what a fit child of that age and gender might be expected to perform."

Wow! That's innovative. How did they come up with that? Do they use paper and pencil to write down the numbers?

"...while eighth-graders use a pendulum for their assessment, and how the students collect and analyze the results is graded according to guidelines that are shared by all of their teachers."

Only one assessment, and "how" they collect and analyze the results, not the results themselves? "Your results are crap, but you sure work well in a team."

They don't like bad test scores, so rather than focus on better teaching and curricula, they figure that they just need a different way to measure results. Fuzzier.

Catherine Johnson said...

Wow! That's innovative. How did they come up with that? Do they use paper and pencil to write down the numbers?

that was my thought

Catherine Johnson said...

They don't like bad test scores, so rather than focus on better teaching and curricula, they figure that they just need a different way to measure results.

Actually it's much, much worse than that.

When schools decide to "assess" critical thinking skills, they give themselves an out when students fail to learn.

I suppose some schools will use such assessments as a means of saying "We're doing a good job in spite of the fact that our state scores are poor."

However, many schools will use this as a way of explaining low test scores, of rationing slots in Honors & AP courses, etc.

What can a student who receives a comment like, "needs improvement in inferential thinking" do about it?

What can his parents do?

Nothing.

That's the point.

Instructivist said...

[They don't like bad test scores, so rather than focus on better teaching and curricula, they figure that they just need a different way to measure results. Fuzzier.]

Not just a different way to measure results, but qualitatively entirely different results. Much more important and supposedly ignored results. These vastly superior but nebulous results are then thought to trump more recognizable results. It's a logical progression from voodoo instruction to voodoo assessment.

I also find it contradictory that on the one hand the new voodoo assessment is praised for covering "a broader range of topics and skills" and the conventional test is condemned for being a mile wide on the other hand. So it is too broad and not broad enough at the same time.

SteveH said...

"These vastly superior but nebulous results are then thought to trump more recognizable results."

This was what I was getting at.

Do they really believe this? That there is some sort of assessment that makes it OK to flunk MCAS?

This is a question from the 4th grade math MCAS 2007 practice test.

Sheila baked 2 batches of cookies. Each batch had 36 cookies. Which number sentence could be used to determine the total number of cookies Sheila baked?

A. 2 + 36 = 
B. 2 - 36 = 
C. 2 X 36 = 
D. 2 / 36 = 

What other knowledge makes it OK for a fourth grader to get this question wrong?

They want something more than MCAS, but nothing was and is stopping them. If they want to use mindreading for assessment, they can do that, but it has to stand on its own. MCAS has nothing to do with it. As for standing on its own, the article gives absolutely no information to judge the program's effectiveness. Chalk another one up to the journalists.

Instructivist said...

[What other knowledge makes it OK for a fourth grader to get this question wrong?]

Hmmm...

Let's see:

Higher-order thinking skills
Critical thinking
Creativity
Metacognitive skills
Empathy with the cookies
21th (or is it 22nd) century skills
etc. etc. blah, blah

Anonymous said...

Imagine my surprise to find this when I was searching my name.

It's always fun to bash people when you don't have the full story, isn't it? I'll bet you had a good time.

Contact me (you can find me through the Brookline, MA Public Schools website) if you'd like to know the real story. But the truth won't be as fun for you as making up all sorts of assumptions about how bad our instruction is here in Brookline.

I will add that our standardized test scores remain among the highest in our state.

- Mark Goldner