Is there an ivory coloring or do you add a pinch of chocolate or something?

instead of using clear vanilla, I use the cheap brown vanilla. Perfect ivory color. Don't ask me how much .... first, there's no such thing as too much vanilla and second, I just add it until it looks right!

Ditto what IndyDeb said. Use brown vanilla.

Yep. Or if you want, there is Ivory color.

I use ivory coloring paste. You should be able to find it at any Michael's, Hobby Lobby or AC Moore.

I agree pure vanilla or Americolor makes a nice ivory gel paste color.