9 DeepSeek V4 + Omni - Pidgin • Gates Foundation • Gooey.AI

💪 Capabilities

🦻 Speech Recognition & Translation

Choose a language to translate incoming text & audio messages to English and responses back to your selected language. Useful for low-resource languages.

Filter to

Speech-to-Text Provider

Spoken Language

🔠 Translate to & from English

🗣️ Text to Speech & Lipsync

Filter to

Text-to-Speech Provider

MMS TTS Language

🫦 Add Lipsync Video

🩻 Photo & Document Intelligence

📊 Analytics & Evaluation

📄 Knowledge Base

👩‍🏫 Search Instructions

Citation Style

🔗 Shorten citation links

Cache

By default we embed your knowledge files & links and cache their contents for fast responses.

Always Check for Updates

Create Synthetic Data

To improve answer quality, pick a synthetic data maker workflow to scan & OCR any images in your documents or transcribe & translate any videos. It also can synthesize a helpful FAQ. Adds ~2 minutes of one-time processing per file.

Advanced Settings

In general, you should not need to adjust these.

👁‍🗨 Conversation Summarization

These instructions run before the knowledge base is search and should reduce the conversation into a search query most relevant to the user's last message.

🔑 Keyword Extraction

Instructions to create a query for keyword/hybrid BM25 search. Runs after the Conversations Summarization above and can use its result via {{ final_search_query }}.

✏ Embeddings Model

Dense Embeddings Weightage

Weightage for dense vs sparse embeddings. 0 for sparse, 1 for dense, 0.5 for equal weight.
Generally speaking, dense embeddings excel at understanding the context of the query, whereas sparse vectors excel at keyword matches.

Max Citations

The maximum number of document search citations.

Max Snippet Words

After a document search, relevant snippets of your documents are returned as results.
This setting adjusts the maximum number of words in each snippet (tokens = words * 2).
A high snippet size allows the LLM to access more information from your document results, at the cost of being verbose and potentially exhausting input tokens (which can cause a failure of the agent to respond).

Snippet Overlap Ratio

Your knowledge base documents are split into overlapping snippets.
This settings adjusts how much those snippets overlap (overlap tokens = snippet tokens / overlap ratio).
In general you shouldn't need to adjust this.

Model & Knowledge base

DeepSeek V4

1 Knowledge source

Knowledge Base

🛠️ Developer Tools and Functions