I really feel that I need to hurry with implementing vertex buffers and more flexible drawing of stuff, though. Maybe create an object like XNA SpriteBatch. Right now, there is very little you can do to improve performance once you reach a certain point.
Eventually, we'll start including Lua libraries people make into LÖVE. But it's too early for that. The API is likely to change many times still. That said, the animation library in particular does not really depend on any LÖVE functions, does it?