Explore other backend registration mechanisms

[msaroufim]

What we have for now are things like

1. Custom op registration
2. Flags_gems style monkey patching
3. PrivateUse1
4. Intra kernel dispatcher
5. Probably more
   For our first release we're focusing on flags_gems but I want to keep this issue open so we can explain the tradeoffs to people a bit better

[ParamThakkar123]

@msaroufim For number 2 Flags_gems style monkey patching, should we consider adding a helper module which implements monkey patching over already existing flags_gems implementation ?

[msaroufim]

So we actually do a good job at flags_gems style already. It's probably more helpful for us to have examples of doing privateuse1 and infra kernel dispatcher

[ParamThakkar123]

On It!