Copilot Builder

Gooey.AI's Copilot is the best chatbot builder anywhere, combining your choice of LLMs (GPT4-Turbo/Vision, Gemini or LLaMa2), knowledge docs from any link or doc/PDF (with table support!), speech recognition, text-to-speech and Lipsync, editable synthetic data pipelines, built in 👍🏿 👎🏼 feedback, conversation analysis, WhatsApp, slack, Facebook and API integrations and much more.

In this example, we present Farmer.CHAT. It uses a collection of documents and transcripts of 100s of videos representing best practices to answer common questions from Indian farmers. We load these documents + transcripts into a vector database. With each question, we search the vector DB and then add the results to a GPT script below to create an answer to the farmer's questions. Simply change the Instructions and Knowledge docs & tap Submit to make it your own.

To know more, head over to our COPILOT HELP GUIDE

📝 Instructions

🧠 Language Model

ChatGPT (openai)

📄 Knowledge

Add documents or links to give your copilot a knowledge base. When asked a question, we'll search them to generate an answer with citations.

Submit Links in Bulk

Capabilities

🗣️ Text to Speech & Lipsync

Text-to-Speech Provider

Google Text-to-Speech

Voice name (Google TTS)

hi-IN-Wavenet-A (Female)

Please refer to the list of voice names here

🫦 Add Lipsync Video

🔠 Translation & Speech Recognition

🩻 Photo & Document Intelligence

⚙️ Settings

🗣️ Google Text-to-Speech Settings

Speaking rate

1.0 is the normal native speed of the speaker

Pitch

Increase/Decrease semitones from the original pitch

📄 Knowledge Base

👩‍🏫 Search Instructions

How should the LLM interpret the results from your knowledge base?

Citation Style

Plain Text / WhatsApp Symbols + Footnotes

🔗 Shorten Citation URLs

Create Synthetic Data

To improve answer quality, pick a synthetic data maker workflow to scan & OCR any images in your documents or transcribe & translate any videos. It also can synthesize a helpful FAQ. Adds ~2 minutes of one-time processing per file.

———

Advanced Settings

In general, you should not need to adjust these.

👁‍🗨 Conversation Summarization

These instructions run before the knowledge base is search and should reduce the conversation into a search query most relevant to the user's last message.

⌥ Variables

🔑 Keyword Extraction

Instructions to create a query for keyword/hybrid BM25 search. Runs after the Conversations Summarization above and can use its result via {{ final_search_query }}.

Embeddings Model

Text Embedding 3 Large (OpenAI)

Dense Embeddings Weightage

Weightage for dense vs sparse embeddings. 0 for sparse, 1 for dense, 0.5 for equal weight.
Generally speaking, dense embeddings excel at understanding the context of the query, whereas sparse vectors excel at keyword matches.

Max Citations

The maximum number of document search citations.

Max Snippet Words

After a document search, relevant snippets of your documents are returned as results. This setting adjusts the maximum number of words in each snippet. A high snippet size allows the LLM to access more information from your document results, at the cost of being verbose and potentially exhausting input tokens (which can cause a failure of the copilot to respond). Default: 300

Overlapping Snippet Lines

Your knowledge base documents are split into overlapping snippets. This settings adjusts how much those snippets overlap. In general you shouldn't need to adjust this. Default: 5

🔠 Language Model Settings

Avoid Repetition

Answer Outputs

How many answers should the copilot generate? Additional answer outputs increase the cost of each run.

Max Output Tokens

The maximum number of tokens to generate in the completion. Increase to generate longer responses.

Creativity (aka Sampling Temperature)

Higher values allow the LLM to take more risks. Try values larger than 1 for more creative applications or 0 to ensure that LLM gives the same answer when given the same user input.

🛠️ Tools

Give your copilot superpowers by giving it access to tools. Powered by Function calling.

Save JSON as PDF

Run cost = 4 credits

Breakdown: 1 (ChatGPT (openai)) + 3/run

By submitting, you agree to Gooey.AI's terms & privacy policy.

Show Raw Output

Assistant

Welcome to Farmer.CHAT. I'm an AI 🤖 designed to help farmers and extension agents. Based on the information found in the search results, the chili cultivation season typically begins in September and lasts till the middle of March [†]. It is recommended to plant chili during this period for successful growth and quality production. Additionally, it's important to consider factors such as soil type, climatic conditions, and water availability when deciding the timing for planting chili [‡]. If you have any specific questions about chili cultivation or need further assistance, feel free to ask! 🌶️

†. Approved - Chilli IPM ICRISAT.pdf, page 2 https://gooey.ai/2/3eML
‡. Plantation of Chilli https://gooey.ai/2/P63b

User
When should I plant chili?

💁‍♀️ Sources

1. How to do irrigation in a chilli field?

2. Approved - Chilli IPM ICRISAT.pdf, page 2

Aflatoxin and chemical residues are two major constraints in the export of chilies to Europe, Japan and the US as buyers expect
a high degree of hygiene and sanitation in processing and preparing chilies for export.
In Indonesia, chili-planted area is the highest among other vegetables despite the production of cabbage is highest.
Export of red dried chilies from Pakistan has declined from Rs. 1.127 billion (during 2003-2004) to Rs. 846 million after
European Union food authorities have detected the presence of aflatoxin (PHDEB). Off-season production technology to
extend production season of the crop for about two to three months is evolved.
Disease-free seeds should be used by treating them with suitable fungicide like thiram or captan. During nursery raising,
proper cultural practices should be adopted particularly the maintenance of proper soil moisture to avoid phytophthora root
rot and collar rot. While after transplanting, proper insect pest control measures should be carried out to check the population
of sucking insects, which are the vector for viral diseases affecting the chili crop.
To reduce aflatoxin contamination, some precautionary measures should be adopted. These include: picking and drying of fruit
with pedicel (fruit stalk), avoid direct contact of fruit with soil, proper drying of fruit and storage of powder at low relative
humidity and temperature. Furthermore, agronomic factors that may influence aflatoxin development like stresses, irrigation,
cropping pattern, variety, date of planting, date of harvesting and storage conditions, should be studied in detail.
Chili Cultivation season:
Chili season begins in September and lasts till the middle of March. It is a simpler crop to cultivate. It adjusts itself in various
types of soil and different climatic conditions. It gives quality production when it is cultivated on deep, loamy and fertile soil
with balanced moisture content. It is a short span crop. For successful growth of chili crop, proper watering and harvesting is
essential.

The integrated pest management (IPM) has been evolving over the decades to address the deleterious impacts of synthetic
chemical pesticides on environment ultimately affecting the interests of the farmers. The health of a plant is determined by its
environment which includes physical factors (i.e. soil, rain, sunshine hours, wind etc.) and biological factors (i.e. pests, diseases

3. Plantation of Chilli

Sir Biju Sheetal's condition is 453 p. It comes nearer to the edge, from where I have the style and there is so much variety, now the seeds suit my own.
If you sow seeds according to your area, according to your field and according to your water facility, then you will get profit according to that. Let's do this, you have a rope and a wire with them, put a wire on the lawn, you first and after that, whether you have to keep your two feet or three feet, according to the variety, like the variety
It does not grow like Jwala and there are other varieties which grow a little less, become bushy, some grow less bushy, then according to that you know for yourself that the hybrid will be a very good seed, bring your seed. If this is a plant tree, then it will become almost like a bush, according to that, you have to keep a distance and even after this, if you are planting a thick crop, at least if not two and a half feet, then there should be chillies in it. for which the lane to lane distance is
And there should be a distance of about one foot from plant to plant, what you mean to say is that the distance from one plant to another should be one foot and from here it should be two to four feet, and the distance from the line should be two to right. It should be foot well brother, you will tell us by planting it, why won't you tell us sir, when you have come to us, it is okay brother, now you have brought it from Narsali, now you have to apply it
If you are going to take Babstein, then make a solution of about 2 grams in 1 liter of it, and after that, can you spray and then the root which is for you should be buried in the solution. Later, if you plant, then from the fungal side, it has a protective barrier, which comes inside the plant, and after that, the wire that you have is a straight wire or a wire or a rope.
It is a wire, yes brother, it is a wire, now it is ours, by what name do you keep planting it, this one has been planted by you, the other plant becomes closer to you, while planting it for yourself, where should you plant another plant? One can get an idea of it and one more special care should be taken in it like this is a plant, if it is our own plant then what is its root.

Generated in 7.1s on

...

ℹ️ Details

Have you ever wanted to create a bot that you could talk to about anything? Ever wanted to create your own https://dara.network/RadBots or https://Farmer.CHAT? This is how.

This workflow takes a dialog LLM prompt describing your character, a collection of docs & links and optional an video clip of your bot’s face and voice settings.

We use all these to build a bot that anyone can speak to about anything and you can host directly in your own site or app, or simply connect to your Facebook, WhatsApp or Instagram page.

How It Works:

Appends the user's question to the bottom of your dialog script.
Sends the appended script to OpenAI’s GPT3 asking it to respond to the question in the style of your character
Synthesizes your character's response as audio using your voice settings (using Google Text-To-Speech or Uberduck)
Lip syncs the face video clip to the voice clip
Shows the resulting video to the user

PS. This is the workflow that we used to create RadBots - a collection of Turing-test videobots, authored by leading international writers, singers and playwrights - and really inspired us to create Gooey.AI so that every person and organization could create their own fantastic characters, in any personality of their choosing. It's also the workflow that powers https://Farmer.CHAT and was demo'd at the UN General Assembly in April 2023 as a multi-lingual WhatsApp bot for Indian, Ethiopian and Kenyan farmers.

👣 Steps

Final Search Query

References

[3 Items

{

…

}4 Items

{

…

}4 Items

{

…

}4 Items

]

Final Prompt

[2 Items

{

…

}2 Items

{

…

}2 Items

]

Raw Text Response 1

Final Response 1

Generated Audio 1

How to Use This Recipe

🙋🏽‍♀️ Need more help? Join our Discord

Related Workflows

Lip Sync with TTS

Add your text prompt, pick a voice & upload a sample video to quickly create realistic lipsync videos. Discover the ease of text-to-video AI.

Search any document with GPT4

Add your PDF, Word, HTML or Text docs, train our AI on them with OpenAI embeddings & vector search and then process results with a GPT3 script. This workflow is perfect for anything NOT in ChatGPT: 250-page compliance PDFs, training manuals, your diary, etc.

AI Animation Generator

Create AI-generated Animation without relying on complex CoLab notebooks. Input your prompts + keyframes and bring your ideas to life using the animation capabilities of Gooey & Stable Diffusion's Deforum. For more help on how to use the tool visit https://www.help.gooey.ai/learn-animation

Compare AI Image Generators

Create multiple AI photos from one prompt using Stable Diffusion (1.5 -> 2.1, Open/Midjourney), DallE, and other models. Find out which AI Image generator works best for your text prompt on comparing OpenAI, Stability.AI etc.

Copilot Builder

📝 Instructions

🧠 Language Model

📄 Knowledge

Capabilities

🗣️ Text to Speech & Lipsync

Text-to-Speech Provider

Voice name (Google TTS)

🫦 Add Lipsync Video

🔠 Translation & Speech Recognition

🩻 Photo & Document Intelligence

🗣️ Google Text-to-Speech Settings

Speaking rate

Pitch

📄 Knowledge Base

👩‍🏫 Search Instructions

Citation Style

Create Synthetic Data

Advanced Settings

👁‍🗨 Conversation Summarization

⌥ Variables

🔑 Keyword Extraction

Embeddings Model

Dense Embeddings Weightage

Max Citations

Max Snippet Words

Overlapping Snippet Lines

🔠 Language Model Settings

Answer Outputs

Max Output Tokens

Creativity (aka Sampling Temperature)

🛠️ Tools

👣 Steps

How to Use This Recipe

Related Workflows

Lip Sync with TTS

Search any document with GPT4

AI Animation Generator

Compare AI Image Generators

GET STARTED

LEARN

DEVELOPERS

SOCIAL

CONNECT

EXTRAS