You can also access the inputs on the controllers. In an attempt to simplify this stuff I'm keeping it quite generic based on the controllers that are mainstream right now. By this I'm mainly meaning the Quest and Index controllers.
We might run into a situation down the line where controllers have different inputs, or they get rid of controllers all together and have just hand tracking. I'm betting against things changing significantly from an input point of view though