Issue

Users might wonder what they can use Custom LLMs for, since Copilot for Extraction and Copilot for Development are not available to them, unlike the built-in OpenAI providers.

Solution

The Custom LLM provider in TotalAgility only allows linking to a custom process and doesn’t offer the same built-in capabilities as the OOTB providers. It provides flexibility to integrate with any LLM, but requires users to handle all request/response logic within the linked process.

By making use of a Custom LLM integration, users can connect their workflows to self-hosted, fine-tuned, or private cloud endpoints (such Anthropic Claude, Google Gemini, or local Llama deployments) alongside TotalAgility’s built-in AI capabilities.

This offer's flexibility with regard to:

• Data Sovereignty & Compliance: Fulfills strict regulatory requirements (GDPR, HIPAA, zero-retention policies) by directing sensitive data to internally hosted or region-isolated LLM instances.
• Model Flexibility: Enables organizations to utilize existing LLM enterprise subscriptions, custom-trained domain models, or open-source LLMs rather than relying solely on default provider endpoints.

They can also use your custom LLM in a GenAI activity within a process.

Applies to