My approach to making sure that my xbits are always found when I need them is to use small, round rare earth magnets.
The problem with round magnets is finding a method to fasten them. Epoxy or other types of glue do not always provide permanent and clean results.
I use a home made Tool Caddy for storing my tools, so this examples applies to how I devised a method to use magnets to hold my xbits.
I wanted a half a dozen or so tool bit holders, so I drilled 6 1/4" holes right through a 3/4" board. This diameter is exactly the diameter of the tool bits.
I then measured the diameter of the magnets and, from the other side of the board, I drilled a partial hole, just deep enough to fit the magnet.
Once the magnets were set in place, I covered the magnets with a plastic strip, and fastened the strip with a couple of screws.
Now I can insert my xbits and have them pulled in and held by the magnets. They wont fall out, and the magnets are set securely. Moreover, these magnets are kept clean for future uses.
Using this concept, there are many possibilities for holding small, round bits