I want to glue  non edible rhinestones on a pair of fondant baby shoes but is there a certain kind of glue to use?

Try using royal icing

Thank you.  I will give that a try.

I would use piping gel. It's clear & it won't show as much as royal icing. It doesn't dry hard so they can easily be taken off since they are non-edible.