HELP!!

Does anyone know how to get pencil marks off aida cloth without having to take it off the scroll frame to wash it???

As I stitch, I mark off each square on my pattern with greylead pencil. The problem is that my scroll frame rested on the "coloured" in squares and I know have some of the pencil marks rubbed off onto my aida cloth.

I really don't want to take the work off the scroll frame because I would have to sew it back on, but I do have to get the stains out before I continue stitching on that part of it, because it would be visible in the finished areas.

I really hope someone reads this and has some answers for me.

In case you are wondering I have tried using an eraser designed for use on fabric, but that has left rubber residue and did not really work, in some spots it smudged it further.