Concepts & Terminology

Neurox has a number of different concepts and terminology that are important to understand.

Users

• A User is associated with a unique email address

• A User can belong to one or more Groups

• Users can log in as local users or via their configured Identity Provider (IdP)

Groups

• A group associates Users with Workloads

• Groups are automatically synced from your configured Identity Provider (IdP)

• Your IdP also determines which Users are part of which Groups

• In addition to users, groups also have an associated set of Projects and Quotas

• Projects and Quotas are configured in Neurox and not in your IdP

Projects

• Projects are company initiatives

• Every Project has an associated Priority Limit and Priority Default

• Every Project has at least one allowed Node Pool

• A single Project may be associated with multiple Groups

Node Pools

• A Node Pool is a set of GPU nodes within your Workload Clusters

• Node Pools typically have similar GPU hardware across all nodes

• The total number of GPUs in a Node Pool constrains the maximum value of its summed associated Quotas

Priority Limits

• A Priority Limit is a numeric value directly associated with Projects

• Priority Limits determine the maximum Priority Level for a Workload

Priority Default

• A Priority Default is a numeric value directly associated with Projects

• Priority Defaults determine the default Priority Level that is selected for a Workload

Priority Levels

• A Priority Level is a numeric value directly associated with Workloads

• The value of a priority level can be set to a preset less than or equal to the Workload's Project's Priority Limit

• During eviction, higher Priority Levels take precedence over lower ones

Quotas

• A Quota allocates a number GPUs within a single Node Pool to a specific Group

• A Quota guarantees that number of GPU resources within a Node Pool for that Group's Workloads

• The sum of of all Quotas associated with a given Node Pool must not exceed the number of GPUs within that Node Pool

Workloads

• A Workload is an application that requests GPU

• Every Workload has an associated Group, Project, and Priority Level

• By association, every Workload also has a set of Node Pools and Quotas

• The user may select the Node Pools, and override Priority Level