Remove (now bogus) assert.

Authored by ezyang.