It's grape hyacinth and it's VERY difficult to eradicate. I have it in my rockery. I do my best to remove it every year and it always comes up again.

Admittedly, it's harder on a rockery as you can't dig down between the stones, but it still spreads very easily.

Do NOT allow it to seed, unless you really want it everywhere.