I second that epoxy fill the void!
Maybe epoxy and one or two screws. I wouldn’t trust superglue
Fill the pocket with epoxy, then set the pin in and let it harden, just make sure that the epoxy doesn’t get on the moving parts of the pin.
Cool project. Please show the results after gluing.
I have found that super glue works really well with raw wood.
Given how light weight the pin is I think it would hold well. Just put a drop over the holes in the pin back rivet style, so it grips the metal well.
I have been having really good luck with just tiny brass screw with these little picture hangers I have been using to make pendants and larger wall hangings.
I use a pen vice drill to make a tiny pilot hole and screw it in, no glue.
I am betting that it would work well with the pin backs as well.
Maybe a drop of super glue to seat it, then a tiny brass screw to make sure it holds? (or just the screw)
Now to see the strength test!