For large documents with many embedded SVGs, the performance suffers by a lot (especially on Firefox). The easiest solution for this would be to change the rendering engine from SVG to HTML5 Canvas. However, this comes with a mayor drawback: the documents are no longer scaleable.
HTML5 canvas rendering was used for quite some time at the beginning and has been ditched in favour of SVG.
Another possibility would be to render SVGs inside the document as raster images.