Update: So I managed to fix it. Just a heads up for anyone who may be stuck in this sort of situation, do NOT use extractor bit sets. They work fine for applications where there is still a chance that the bolt may come lose, not here. If you do use an extractor bit and it breaks you are screwed because you need something even harder to drill through it.
What I did was, grind off the part that was sticking out of the head with the extractor stuck in it. So i pretty much by-passed it. Then I used normal bits to drill out the bolt. Took time but got it done.