Well, not ideal because it will be overridden during an upgrade, but, deleting the code in embed_embedly_integration.html in the templates folder disables embedly since then the JavaScript used to display it is gone.

Let me know if there is a better way.