Fixed serious bug in Index.remove

I had responded to the original PR with a nice test to demo.
However its been many years I just forgot."
This was a bit of a fiddle to track down

Thank you @mthadley for the nice PR sorry for the massive delay.