I would go along with using a scraper to remove the basic adhesive, same as you might remove bathroom silicone, then some kind of cleaner to finish.
I would avoid using any silicon based cleaner as that can stop anything sticking to the cleaned surface in future.