there are several causes for this problem. First of all, please remember, if this splines was maybe placed on an other layer than 0. Otherwise a refresh with this button helps quite a lot, because sometimes the wireframe doesn't get deleted on the first refresh after the spline gets deleted.
If the problem persists, we need to dive deeper.
I solved now by pressing the "set all" button.