Add feature flags for each primitives

[tisonkun]

To allow users to exclude unused primitives and perhaps internal structs + deps.

But perhaps a bit overengineering and would be a breaking change. Just track as a backlog.