Another option is to needle felt the two together.
You’ll need loose wool fiber (cat hair and dog hair also work great) and felting needles (very sharp, use with caution!).
There’s lots of great tutorials on needle felting on the internet.
Any sort of glue you try to use will be ineffective.
Felting the two pieces together is simple and permanent, if you get ...