Hi Team,
These are very interesting cases.
From what you described, it seems that you are uploading a document containing company data, but the issue likely occurs during the retrieval stage.
If the information works when placed in the Company Description but not when stored in the Knowledge Source, it usually means that the retrieval step is not matching the caller’s question with the stored embeddings. So testing it in the Company Description was actually a very good diagnostic step.
It also depends heavily on how the information is written in the document. Knowledge sources generally perform much better when the content is written in natural language, rather than in database-style records or short fragments.
For example, instead of writing:
try writing something like:
Customers can send service requests to
[email protected].
This provides more context and improves the chances that the retrieval system will match the caller’s question with the relevant information.
Regarding the email case
I am almost 100% sure that the prompt may be designed not to expose email addresses by default, since emails can sometimes be treated as confidential information.
A few things to check:
- Make sure the "Confidentiality Mode" option is disabled.
- Ensure that the Agent Instructions explicitly allow the agent to provide company contact information, such as email addresses or pricing details.
- If the instructions do not clearly allow this, the model may intentionally avoid sharing that information. In this case, the prompt should be adjusted to explicitly permit the agent to provide company email addresses when customers ask for them.
Regarding the labor rate example
For this type of information, I would recommend formatting the content using Markdown.
For example, create a file such as labor_rates.md and structure it clearly:
# Labor Rates
Our standard labor rate is $120 per hour.
If a customer asks about labor pricing, inform them that the current labor rate is $120 per hour.
Language models tend to work very well with plain text and Markdown formats, especially when the information is clearly structured.
Very interested to help you guys solve this. Mind you, Ive seen our knowledge base answer much more complex answers than what you are trying to do here. The embeddings model of openai is excellent and designed for the masses. Your scenarios must work.
Try these tips and if you fail, let us know.
God bless