A Programmer's Apology

Obama on Math and Science Education

Mon, 27 Apr 2009 18:12:35 -0800

Since we know that the progress and prosperity of future generations will depend on what we do now to educate the next generation, today I'm announcing a renewed commitment to education in mathematics and science. This is something I care deeply about....
A half century ago, this nation made a commitment to lead the world in scientific and technological innovation; to invest in education, in research, in engineering; to set a goal of reaching space and engaging every citizen in that historic mission. That was the high water mark of America's investment in research and development....
We will not just meet, but we will exceed the level achieved at the height of the space race, through policies that invest in basic and applied research, create new incentives for private innovation, promote breakthroughs in energy and medicine, and improve education in math and science.

Obama, speaking before the National Academy of Sciences today, inspires. Read or listen to the full speech here: text, audio.

Untitled

Wed, 18 Mar 2009 15:41:11 -0800

(Click the image to see the equations.)

Submitted by Anh Nguyen.

Uncertain Principles Challenge 2008

Tue, 21 Oct 2008 06:49:55 -0800

Help Chad Orzel raise money for Science teaching! Go here now.

Why, you ask? John Scalzi says it best:

Chad is, like, six feet, 28,000 inches. He’s a pretty big dude. And as everyone knows, large dudes are funny to watch dancing. But there’s more! He’s also a physicist and a fully tenured professor or such, and as well all know, the overlap between “tenured physics professors” and “adept dancers” is trivially small. Finally, Chad has a sort of gawky, innate dignity — he’s a friendly sort, but let’s just say I’ve never seen him prone to wanton acts of physical comedy. What I’m saying is, making Chad Orzel dance like a monkey would be the comedy highlight of 2008.

Art Project #11

Fri, 07 Mar 2008 13:24:33 -0800

(Click the image to see the equations.)

Virtual math spaces

Wed, 12 Sep 2007 18:51:42 -0800

CyberMath is a shared virtual environment for exploring mathematics. I've long wanted to make Graphing Calculator into an authoring tool for such an interactive immersive space. The popularity and success of World of Warcraft hints at the possibilities in coming years.

Does anyone here use Second Life or have any knowledge of Croquet? The technology for building these spaces is maturing. I'm now wondering how to make it accessible to teachers and curriculum authors so that they can focus on the mathematical content and pedagogy while constructing mathematical landscapes.

I would welcome any advice.

Lunar Eclipse

Thu, 30 Aug 2007 13:48:57 -0800

Enjoy two rather different views of Monday night's total lunar eclipse. I watched from Chabot with a huge crowd, frenetic activity, many telescopes big and small, television news crews shining floodlights periodically on people in sleeping bags and people in line for the big telescope, the Castilleja High School astronomy class - the TV crews loved interviewing them. One Chabot astronomer in a pointy hat and cape told amusing and educational stories all night long. Quite a few shooting stars. One particularly large one just at the start of totality after the diamond in the diamond ring faded away was a big crowd pleaser.

Kudos to Astropixie for pointing out the images!

Cubes

Mon, 20 Aug 2007 11:48:48 -0800

Nico Bakker sent in this document saying Here is another example of the beauty of Graphing Calculator.

Thank you, Nico!

Click the image to see the equations.

Click here for the movie.

"Math is hard"

Wed, 25 Jul 2007 11:16:20 -0800

Mattel got a lot of flack for its talking Barbie doll which said "Math is hard." I wanted to reprogram the voice chips to say "Partial differential equations with Neumann boundary conditions are hard." It's not that I completely disagreed with Mattel, I just thought Barbie should have been more specific. Imagine the conversations: "Mommy, what's a Neumann boundary condition?" "Well you see dear, that's when you fix the value of the derivative on the boundary curve." But then, I've been working on nerd propaganda for decades.

Cross-platform development

Wed, 04 Jul 2007 10:50:58 -0800

I clicked "Restart" after Apple Software Update applied what I thought were minor system patches, and my computer rebooted into Windows....

Adventures in Optimization: OpenGL

Tue, 19 Jun 2007 11:53:53 -0800

Over the past few years, the hardware-accelerated rendering pipeline has rapidly increased in complexity, bringing with it increasingly intricate and potentially confusing performance characteristics. Improving performance used to mean simply reducing the CPU cycles of the inner loops in your renderer; now it has become a cycle of determining bottlenecks and systematically attacking them. This loop of identification and optimization is fundamental to tuning a heterogeneous multiprocessor system; the driving idea is that a pipeline, by definition, is only as fast as its slowest stage. Thus, while premature and unfocused optimization in a single-processor system can lead to only minimal performance gains, in a multiprocessor system such optimization very often leads to zero gains. - Cem Cebenoyan, NVIDIA, in GPU Gems

Adventures in Optimization: Threading

Sun, 10 Jun 2007 15:11:09 -0800

After identifying the superficial bugs slowing GC4, I set out to measure the degree of parallelism I was able to achieve with the new multi-threaded calculation code. Are there any other calls like GetWRefCon unintentially introducing dependencies stalling threads? Was GC able to keep multiple CPU cores fed wih independent work? In additional to the traditional questions of Where is the software spending its time? What is it doing there? I now have to ask those question separately of multiple threads of execution on multiple CPU cores and understand the answers in context, asking When is one thread of execution stalled waiting for results from another? With the right tool, the answer can be obvious.

Adventures in Optimization: Benchmarking

Sun, 10 Jun 2007 14:16:23 -0800

My first job at Apple in 1992 was benchmarking the quality of a dozen different handwriting recognition software libraries from different companies. We like to pretend that everything from health to cars to wars can be measured by a single number but real systems are multi-dimensional. Benchmarks are like standards: everyone likes to make their own. I approach software measurements with my old Stanford Physics lab training. I treat the software as tangible physical system, experiment to determine what I can measure reproducibly, look for mathematical relationships between variables, and attempt to construct a useful basis set of axes upon which to characterize their phase space. This did not make me any friend while benchmarking for Apple. Each company or internal group with a solution to sell had strong ideas about comparing systems to put their own solution in the best light. Furthermore, handwriting recognition was and is still an unsolved research problem. Comparing different research projects is quite different from comparing products of a mature technology. Ultimately, none of the choices proved adequate.

For Graphing Calculator, I use performance measurements to make programming choices when comparing high-level algorithms, low-level implementation details, different compilers, and compilation options. Holding the Command key while pressing the slider Play button will initiate a stopwatch to time the slider. When I'm focusing on a particular routine, this is useful to compare small code changes from one build to the next. In the Graphing Calculator menu, the Graphing Calculator > Benchmark command runs through thirty-two tests timing calculation and drawing. These help me compare how GC behaves on different hardware and how its behavior changes across versions years apart. The report looks like this:

Adventures in Optimization: Prelude

Sun, 10 Jun 2007 10:55:10 -0800

Two weeks ago, I ran the Intel-native GC4 on an 8-core machine. It revved all 8 processing cores yet ran no faster than on a four-year old single-core G4 laptop at one-third the clock speed. A few minutes with Shark identified the culprit: a single innocuous call to GetWRefcon. In the single-user, single-core, single-threaded Macintosh toolbox of 1984, that call would have taken a few instructions. Mac OS X must share system resources across multiple users, processor cores, applications, and threads of execution all making demands at once. GetWRefCon is labelled Not Thread Safe: it is not guaranteed to work at all from anywhere but the main thread. Rather than crash or return a bogus result, it was causing all eight otherwise independent threads of execution to serialize on that one shared resource, passing the baton from one thread to the other, unable to execute in parallel. Fixing this was easy. Although the window structure is a shared resource protected by a lock, the RefCon itself that I actually needed contained read-only information all threads could read in parallel safely without locking. No need to go through GetWRefCon at all. The parallel threads should have been passed a pointer to the read-only document record directly.

After fixing that, some tests ran twenty times faster. Other tests however, still ran at the same speed as on the older, slower, single-core laptop. I devoted the last two weeks to figuring out why.

Spike!

Mon, 04 Jun 2007 21:54:22 -0800

Spike returns triumphant from the garden. After inhaling half an avocado, he held on greedily to the rest until he was ready for it. His wet food contains a fair bit of avocado. He seemed quite pleased with himself to discover that food really does fall from trees. I wouldn't let him back in until he finished. Close-up below the fold....

glBufferSubData

Thu, 31 May 2007 18:27:11 -0800

Yesterday was spent debugging until two in the morning trying to diagnose a drawing artifact which occured only on Intel-native builds of GC4 when animating colors on a static 3D model defined using an implicit surface equation using OpenGL vertex buffer objects. The image above started out, correctly, as a solid red sphere. When animating the colors using the GC slider, the top of the sphere did not change, remaining red. The middle of the sphere animated correctly. The bottom of the sphere animated but rgb color values (a,b,c) would display shifted as (b,c,a).