Tracing for AiKA
Why Trace AiKA?
Tracing provides detailed observability into AiKA's chat processing pipeline, capturing the flow of how your chats go from initial question to knowledge retrieval, re-ranking and then to final response generation. This can be useful for debugging purposes and understanding what kind of queries and knowledge bases work best within your Portal instance as well as capture the efficacies in the model outputs.
How to Enable Tracing
To enable tracing:
- Go to Config Manager > AiKA settings
- Navigate to aika > tracing: enableTracing
- Toggle the option to enabled
- Configure your export destination (currently, Arize Phoenix is the only supported destination)
- Add required
apiKey
andurl
in the module options
When the enableTracing flag is toggled on and the module has started, traces will be captured for each conversation, providing insights into the AI's decision-making process.