Posted tagged ‘Assessment’

AP Physics redesign: Will Honors Physics disappear from high schools?

September 6, 2010

A message from the College Board’s official listserve for Advanced Placement Physics gave a tantalizing hint of big doings in the redesign of the AP Physics program, which is being funded by the National Science Foundation as part of an all-natural sciences overhaul.  The development briefly described by the writer was that the one-year “Physics B” course, which does not use calculus, would be broken up into two courses, one on mechanics and thermodynamics and one on electricity and magnetism (in the same way that college physics courses devote one semester to each of these subjects).  High schools would have the option of teaching each of these new courses as one year courses, so that the algebra-based AP physics sequence could be a two-year sequence.  The mechanics course would be called AP Physics A, and the electricity and magnetism course would be named AP Physics B.

The College Board seems to be enforcing a hush-hush order on those who have been involved in the redesign, so it is impossible to know for sure what is going on.  Of course, the hush-hush order makes it impossible for school districts to plan for these changes.  And with the budget collapses being faced by many states in the next fiscal year, planning is more important than ever.  However, the College Board seems undisturbed by this because it is someone else’s problem.

However poorly the College Board is handling its project, the development of an autonomous one-year advanced placement course on mechanics and thermodynamics raises the possibility that the standard college-prep Honors Physics course will soon be obsolete and disappear from high schools.  The syllabus of the rumored Physics A course would be close to that of Florida’s Honors Physics 1 course.  However, it would have three major advantages over Florida’s present Honors Physics offering.  First, it would have the quality control resulting from an end-of-course exam.  A Physics 1 end-of-course exam is presently living in the purgatory of the “when budget conditions allow” section of Florida’s new high school graduation law, but the state’s educational policy leaders seem to lack the nerve to impose such a test on high schools – even if they were not staring down the barrel of the worst budget year in memory.  Second, the College Board does some monitoring of teacher quality in its AP courses.  Teacher quality is a particular issue in physics classrooms nationally:  Only one-third of those teaching high school physics have a degree in physics or physics education (many – or most – school districts believe that a bachelor’s degree in biology provides an ample background in physics).  Third, an AP Physics A course might be more attractive to students than an Honors Physics course.  Many high schools provide students taking AP courses a boost in the calculation of class rank, and strong colleges look on AP courses favorably in the admissions process.  Therefore, some students who would not take Honors Physics might take AP Physics A to boost their standing.

The trends revealed by the recent AIP high school physics survey demonstrated that the College Board had already begun its takeover of the industry of quantitative high school physics courses.  Sixty percent of students taking AP Physics B are taking it as a first high school physics course – that is, they haven’t taken a standard high school physics course prior to Physics B.  So taking AP Physics as a first course is common.  Nineteen percent of students enrolled in quantitative high school physics courses during the 2008-2009 academic year were taking an AP physics course – up from 16% in 2004-2005.

Some high schools already encourage incoming freshmen to take AP Biology instead of the standard first-year biology course, so perhaps we are not far from a time in which all college-prep science courses carry the College Board’s AP brand and standard honors science courses have disappeared from the scene.  One can only imagine that the College Board’s empire builders thought of this some time ago and are gleeful at the progress they are making toward such a world.

RTTT Assessment Program: Two “comprehensive” consortia funded, SCOBES high school EOC consortium not

September 2, 2010

The US Department of Education has funded the two large consortia that applied to the “comprehensive” component of the Race to the Top Assessment Program.  Florida is a leader in one of these consortia.

But the SCOBES proposal for high school end-of-course testing that included twelve states (not Florida) and a specific STEM track for high school students was not funded.

Coverage from School Zone, Gradebook and Curriculum Matters.

Lesson from Texas: Is an Algebra I EOC meltdown coming in Florida?

August 30, 2010

Hat tip to Jeff Solochek at Gradebook for this bit of cheer:

Texas has had a meltdown in its first crack at an Algebra I end-of-course exam.

Is Florida next?  We’ll see in the spring.

2010 ACT Science: Florida moves down one spot – to 50th

August 18, 2010

National average:  20.9

Florida:  19.1

We beat Mississippi.  That’s it.

Florida was 49th in 2009, and really that was bad enough.

The ACT comparison engine is here.

Leslie Postal’s coverage of the ACT story in the Sentinel is here.

Idaho sets course for EOC’s in high school science for class of 2017

August 16, 2010

Curriculum Matters is reporting that Idaho is scrapping plans to require a passing score on a science competency test for high school graduation and is instead planning to require passing scores on science end-of-course tests for the high school graduating class of 2017.

Ensure that Florida’s university-bound high school graduates are STEM-ready

August 11, 2010

According to the report Closing the Talent Gap released by the Florida Council of 100 and the Florida Chamber of Commerce in January, 2010, our state will need “100,000 more science and technology professionals than we are on track to produce” during the next five years.  Of the 50,000 bachelors’ degrees awarded by Florida’s public universities each year, only 8,500 students are in STEM (science, technology, engineering and mathematics) fields.  The state’s independent colleges and universities add another 1,200 bachelors’ degrees in engineering and information sciences to the total.  Because the numbers of STEM bachelors’ degrees produced each year in Florida is so small compared to the shortfall, it is clear that meeting Florida’s needs for science and technology professionals in the next decade will require a major shift in the culture and priorities of the state’s educational system.  While Florida’s colleges and universities will need to build their capacity for educating scientists and engineers, it is equally important that Florida’s public high schools dramatically increase the number of students they send to the state’s universities who are both interested in science and engineering careers and well prepared for the rigor of undergraduate programs in those fields.  Doing so will require our high schools to recast their missions.  The core science subjects of biology, chemistry and physics must become central to our high schools’ curricula, and the preparation of every university-bound graduate for rigorous undergraduate programs in science and engineering fields must become a high priority for the mission of each high school.  This imperative must be as high a priority as raising graduation rates.  While the new high school graduation requirements in math and science passed by the Florida Legislature in 2010 and signed into law by Governor Crist are an important step forward in making sure that every high school graduate is mathematically and scientifically literate, they do not accomplish the goal of making sure that every university-bound student has a comprehensive preparation in all the core science areas of biology, chemistry and physics.

To illustrate why such a fundamental shift in our high schools is necessary, let’s go back to Haley, the ninth-grader that Orlando Sentinel reporter Leslie Postal had with an Orange County ninth-grader talked with for an article published in April.  Haley expressed an interest in advanced life sciences classes like Anatomy and Physiology, marking her as a possible future health professional.  However, Haley also complained about the new chemistry-or-physics requirement for high school graduation, saying, “Other courses are just so much more interesting…Not all careers do you need to know chemistry and physics.”

But of course if Haley is heading for a career as a pharmacist, physical therapist or physician, she will have to deal with both chemistry and physics in college, in addition to a heavy load of the life science courses in which she professes an interest.  Research [Philip M. Sadler and Robert H. Tai, Science, Vol. 317, Pgs. 457-458 (2007)] says that students who have taken strong high school courses in chemistry and physics are more likely to succeed in the college-level chemistry and physics classes.  Those of us who actually teach science at the college level knew that even before Sadler and Tai published their paper.

In high demand university courses such as General Chemistry, General Physics and Organic Chemistry, the failure of a student to prepare properly often has financial consequences, both for the university (and therefore taxpayers if the university is public) and the student.  If the student earns a grade of “D” or “F”, she or he must repeat the course, extending the student’s time to graduation and keeping another student from taking the class in a timely fashion.  If the student earns enough D’s or F’s, she or he can be forced to change career plans altogether, costing the state one more STEM professional.

Our concerns about STEM-readiness should not be confined to students like Haley who set their sights on STEM careers in high school or before.  No one would argue that a student should be held to a career choice she or he made at age 15.  Yet a talented high school student who decides to forgo chemistry or physics classes and precalculus mathematics because of a conviction that she or he will be pursuing a career in the arts is cutting off an important range of career options.  In fact, it is not uncommon for upper division university students to realize that they find a STEM career attractive but that they have massive math and science deficits that stretch all the way back to their high school days.

How can we make sure that our best and brightest — our university-bound high-school graduates — are well-prepared for the rigors of undergraduate programs in science and engineering?  Unfortunately, the present system that relies on students obtaining advice from parents, teachers, guidance counselors and peers is not working.  While the new high school graduation law – that requires “chemistry or physics” – will have a dramatic effect on the chemistry course-taking rate, it is less likely to increase the physics course-taking rate since chemistry is generally listed as a prerequisite for physics in Florida’s school districts.

Instead, it appears that to achieve the goal of dramatically increasing the number of STEM-ready university-bound students a new incentive will have to be put in place.  There are three policy options for providing such an incentive:

Initiating a program of differentiated high school diplomas:  Florida can initiate a program of differentiated high-school diplomas like that recently adopted in Virginia. The highest-level diploma — which in Virginia is called an “Advanced Studies Diploma” and is intended for university-bound students — should require that each graduate take courses in biology, chemistry and physics. The same bill (SB 4) that installed Florida’s new high-school graduation requirements also called for a study of differentiated diploma options by the Florida Legislature’s research and analysis unit, the Office of Program Policy Analysis and Government Accountability. The report will be completed in time for the Legislature to consider this option during its 2011 session.

Modifying requirements for Bright Futures Scholarships:  The eligibility requirements for Bright Futures Scholarships could be modified to require biology, chemistry and physics.  Bright Futures is an immensely popular program among voters, and steps taken the last few years to arrest the rapid increase in the program’s budget have already incited considerably grumbling among university students and their parents.  It is unlikely that legislators would be willing to tighten the eligibility requirements further at this time.

Requiring high school biology, chemistry and physics for admission to the state’s public universities:  Requiring a full slate of science courses for university admission is the most direct way of ensuring that every university-bound student is STEM-ready.  However, the state’s universities have been emphasizing the issues of accessibility and graduation rate.  The Florida Board of Governors, which would have to make the change to admissions requirements, might not be willing to impose additional graduation requirements in science because of the possible perception that they would be limiting access to the universities.

All three of these options face significant political obstacles.  However, it is likely that the Bright Futures option faces the steepest obstacles of all because the scholarship program is such a hot button issue with middle class voters.

Making sure that every university-bound student is STEM-ready isn’t just about preparing the scientists, engineers and mathematicians needed to keep Florida’s high technology industries fed.  It is also about providing the greatest possible range of opportunities for Florida’s students.  In the future, the state’s highest paying and most secure jobs will be concentrated in the STEM fields.  It only makes sense to be sure our best and brightest don’t cut themselves off from these opportunities while they are still in high school.

RTTT Assessment Program: What Florida is doing; what Florida missed out on

August 9, 2010

Twelve states – including Massachusetts, New York and Mississippi, have jointly proposed a breathtaking overhaul of high school with a request to the Race to the Top Assessment Program.  The full proposal is available here, but the Center for K-12 Assessment and Performance Management prepared a nice illustration of what the “SCOBES” program would do.  In short, the program would track students by using a European-style testing program.  The program would include a specific track for students preparing for STEM majors in selective colleges and universities, as well as others for non-STEM majors in selective postsecondary institutions, and career and technical programs based both in the schools and at community colleges.

Florida chose not to join SCOBES, but is playing a leading role in PARCC, a consortium requesting $160 million to overhaul math and language arts assessment in grades 3-11.  The Center for K-12 Assessment and Performance Management also prepared an illustration of the PARCC proposal.

It is frustrating that Florida has passed on SCOBES and is therefore doing nothing about science assessment.

FCAT Controversy: HumRRO provides readable explanation of FCAT statistics

August 9, 2010

For those of us that are FCAT statistics novices, the HumRRO report solicited by the Florida Department of Education provides a helpful introduction.  The general framework of the learning gain measurement and its challenges are neatly discussed at a level that nonspecialists should be able to understand.

Learning Gains: Decline in 4th and 5th grade gains hammer elementary school grades

August 7, 2010

The percentage of Florida’s elementary schools earning A’s or B’s dropped from 90% in 2009 to 74% this year, mostly because of a decline in the learning gains recorded for 4th and 5th graders on this year’s FCAT.  School superintendents statewide are complaining about the decision of the Florida Department of Education to release elementary and middle school grades yesterday despite the superintendents’ ongoing concerns about the validity of the learning gain results.  Education Commissioner Eric Smith continues to argue that the results are valid and that the declines are a result of budget cuts and economic stress on students’ families.

Coverage from the Orlando Sentinel and St. Pete Times.

Monroe County’s Debra Walker: Learning gain statistics unreliable

August 5, 2010

From Monroe County School Board member Debra Walker, a comment posted on my summary of the FCAT situation:

I have been complaining about this for years. The FCAT developmental scaled score is the least reliable statistic in the batch. It’s several statistical transforms away from the original test data. Because the stat comes from two years of FCAT tests based on different standards, the error accumulates over the years. After three years, the error reflected in a developmental score is 15%.

Why doesn’t a statistician point this out? Basing teacher salaries and school funding on inappropriate statistics may be politic, but it’s rotten policy!

It’s stuff like this that drives me crazy. Every legislator should be required to pass a college level statistics course before he/she is allowed to vote on bills.

Update (11:00 am): On Debra’s last point:  Every college student should be required to pass a college level statistics class.  Even if they’re not going to be legislators.


Follow

Get every new post delivered to your Inbox.