At the moment only Phorge administrators can invite people using this page:
These are the current policies:
Can Use Application
Can Configure Application
Can Create (non-bot) Users
Can Disable Users
Can Browse User Directory
Maybe, we can evaluate the addition of a "Can Invite User" (and See All Invitations) policy.