Try rubbing alcohol, but it will be difficult, as granite is porous and permanent marker is, well, permanent.
Didn't find the answer you were looking for?