Organizations
Understand how organizations work as the top-level container for all platform resources.
An organization is the top-level entity in Pipelines. Everything you work with — projects, team members, pipelines, models, tools, evaluation criteria, and prompts — belongs to an organization.
Creating an organization
Organizations are provisioned by the Pipelines team. Contact us to set up a new organization. Once created, the designated owner becomes the first Org Admin and can begin inviting team members and creating projects.
Organization settings
Org Admins can manage organization-wide resources from the admin sidebar. These resources are available across all projects in the organization:
| Sidebar item | What it manages |
|---|---|
| Models | Custom LLM models with bring-your-own-key credentials. See Model Registry. |
| MCP Servers | MCP server connections and tool endpoints. See Tools. |
| Evaluations | Organization-scoped evaluation criteria. See Evaluations. |
| Prompts | Organization-scoped prompt library entries. See Prompt Library. |
| Templates | Organization-scoped pipeline templates. See Templates. |
| API Keys | API keys for external API access. |
| People | Organization-wide team management. See Team Management. |
| Credentials | Organization-level credentials for external services. Currently supports HuggingFace API tokens, used for accessing HuggingFace datasets. Credentials are stored encrypted and displayed masked (e.g., ****abcd). Each credential type can only be set once per organization. |
Organization dashboard
When an Org Admin navigates to the Dashboard from the sidebar, they see an organization-level overview with the following widgets:
| Widget | What it shows |
|---|---|
| Projects | Count of projects in the organization, with a sparkline trend. Click to see a detailed list of all projects with their contributor counts and statuses. |
| Activity | A composite view of Submissions, Completed Tasks, and Daily Active Submitters, with trend lines and a timeseries chart. |
| Pipeline Completion | Percentage of tasks that have reached the end node, shown as a progress ring. |
| Engagement | Average submissions per active contributor and the maximum submissions by a single contributor, with trend lines and a chart. |
| First Review Pass Rate | How often submissions pass review on the first attempt. |
| Avg Reviews per Review Node | Average number of review rounds per task across all projects. |
The dashboard includes a timeframe selector to adjust the reporting period.
Project Admins see a project-level dashboard when they navigate to a specific project. The org-level dashboard is only visible to Org Admins.