Farmer.CHAT (with Vision) (Mixtral)

Aimed at Indian farmers and Extension Agents, this bot uses a collection of documents and transcripts of 100s of videos representing best practices from the Indian Ministry of Agriculture and Digital Green's video transcripts & FAQs to answer common questions from Indian farmers. We load these documents + transcripts into a vector database. With each question, we search the vector DB and then add the results to a GPT script below to create an answer to the farmer's questions. Chat with Farmer.CHAT on WhatsApp here: http://wa.me/+12602310218. More info and technical walkthroughs can be found here too: https://www.help.gooey.ai/farmerchat

📝 Instructions

🧠 Language Model

Mixtral 8x7b Instruct v0.1 (Mistral)

📄 Knowledge

Add documents or links to give your copilot a knowledge base. When asked a question, we'll search them to generate an answer with citations.

Submit Links in Bulk

Capabilities

🗣️ Text to Speech & Lipsync

Text-to-Speech Provider

Google Text-to-Speech

Voice name (Google TTS)

hi-IN-Wavenet-A (Female)

Please refer to the list of voice names here

🫦 Add Lipsync Video

🔠 Translation & Speech Recognition

🩻 Photo & Document Intelligence

⚙️ Settings

🗣️ Google Text-to-Speech Settings

Speaking rate

1.0 is the normal native speed of the speaker

Pitch

Increase/Decrease semitones from the original pitch

📄 Knowledge Base

👩‍🏫 Search Instructions

How should the LLM interpret the results from your knowledge base?

Citation Style

Plain Text / WhatsApp Numbers + Footnotes

🔗 Shorten Citation URLs

Create Synthetic Data

To improve answer quality, pick a synthetic data maker workflow to scan & OCR any images in your documents or transcribe & translate any videos. It also can synthesize a helpful FAQ. Adds ~2 minutes of one-time processing per file.

———

Advanced Settings

In general, you should not need to adjust these.

👁‍🗨 Conversation Summarization

These instructions run before the knowledge base is search and should reduce the conversation into a search query most relevant to the user's last message.

⌥ Variables

🔑 Keyword Extraction

Instructions to create a query for keyword/hybrid BM25 search. Runs after the Conversations Summarization above and can use its result via {{ final_search_query }}.

Embeddings Model

Text Embedding 3 Large (OpenAI)

Dense Embeddings Weightage

Weightage for dense vs sparse embeddings. 0 for sparse, 1 for dense, 0.5 for equal weight.
Generally speaking, dense embeddings excel at understanding the context of the query, whereas sparse vectors excel at keyword matches.

Max Citations

The maximum number of document search citations.

Max Snippet Words

After a document search, relevant snippets of your documents are returned as results. This setting adjusts the maximum number of words in each snippet. A high snippet size allows the LLM to access more information from your document results, at the cost of being verbose and potentially exhausting input tokens (which can cause a failure of the copilot to respond). Default: 300

Overlapping Snippet Lines

Your knowledge base documents are split into overlapping snippets. This settings adjusts how much those snippets overlap. In general you shouldn't need to adjust this. Default: 5

🔠 Language Model Settings

Avoid Repetition

Answer Outputs

How many answers should the copilot generate? Additional answer outputs increase the cost of each run.

Max Output Tokens

The maximum number of tokens to generate in the completion. Increase to generate longer responses.

Creativity (aka Sampling Temperature)

Higher values allow the LLM to take more risks. Try values larger than 1 for more creative applications or 0 to ensure that LLM gives the same answer when given the same user input.

🛠️ Tools

Give your copilot superpowers by giving it access to tools. Powered by Function calling.

Save JSON as PDF

Run cost = 4 credits

Breakdown: 1 (Mixtral 8x7b Instruct v0.1 (Mistral)) + 3/run

By submitting, you agree to Gooey.AI's terms & privacy policy.

Show Raw Output

Assistant

Welcome to Farmer.CHAT. I'm an AI 🤖 designed to help farmers and extension agents. You've mentioned a potential whitefly infestation in your chili crop. I found some useful information for you!

To prevent and stop the chili leaf curl virus from spreading due to whiteflies [1]:

Eliminate whitefly infestations.
Be aware that whitefly populations quickly develop resistance to conventional chemical treatments.
Consider using the following insecticides (ensure they are allowed in your region): cypermethrin, deltamethrin, bifenthrin, diafenthiuron, thiamethoxam, imidacloprid, acetamiprid, spiromesifen, buprofezin, cyantraniliprole, spirotetramat, and synthetic terpenes extract of chenopodium.

For whiteflies and other pests, consider these best practices [2] [3]:

Monitor your crops regularly for signs of pests.
Prune and discard infested leaves, stems, and other infected plant parts.
Use organic knockdown sprays like Neem Oil, Pyrethrins, Azadirachtin, and Horticultural Oil to kill pests on contact.
Apply

User
I think my chili crop has whiteflies. What can I do?

💁‍♀️ Sources

1. How to control leaf curl in chilli?

2. Approved-Chilli PoP- Spice Board of India.docx.pdf, page 4

The infested leaves curling upward, crumbling and sheddingInfested buds turning brittle with petiole
becoming brown and dropping downAffected fruits showing light brown scars. Pest infestation is
severe in dry weather. The damage ranges between 30-50%. One life cycle is completed on an
average in 2- 2.5 weeks. There are about 25 generations in a year. Reproduction in thrips is generally
sexual, parthenogenesis is also present.

Management

Seed treatment with imidacloprid @ 3 -5 g/kg of seed.

2. Chilli Mites (Polyphagotarsonemus latus) Causes: Downward Curling of leaves
A minor pest emerged as a major pest in recent past. The infestation starts in the nursery after 40
days of germination. Severe infestation is seen in transplanted crop of 2-3 months old. The tiny white
transparent mites are found in large numbers on the undersurface of leaves under fine webs. Both
nymphs and adults suck sap and devitalize the plant causing ‘Murda’ disease of chillies. Infestation
results in

Downward curling of leaves.The affected leaves becoming inverted boat shaped.The leaves rolling
down along the margin with elongation of petioles.Affected leaves turning dark green in certain
cases.Younger leaves at the tip of branch clustering.

Management

Foliar spraying of dicofol 5ml/l or wettable sulphur 3g/l.Synthetic pyrethroids not to be used.If both
thrips and mites are noticed, spraying phosalone 3ml/l or diafenthiuron 1.5 g /l or chlorfenapyr 2
ml/l.

3. Chilli Aphids (Aphis gossypii, Myzus persicae)
They are polyphagous pests. Cloudy weather is very favourable for multiplication of aphids. Heavy
rains cause reduction in their population. Adults are found in large numbers on the under surface of
leaves and growing shoots of plants. Both nymphs and adults suck sap and also excrete honeydew on
which black sooty mould develops affecting photosynthetic activity thus it causing

Retardation in growth and fruiting capacity of the plant.•Sooty mould

3. Approved - Chilli IPM ICRISAT.pdf, page 8

∙ Elongated petiole
∙ Buds become brittle and drop down.

∙ Early stage, infestation leads to stunted growth and flower production, fruit set are arrested

Management:

∙ Chemical pesticide use actually encourages the spread of spider mites by killing the beneficial insects that prey on them.
Mites are also known to develop quick resistance to various pesticides. For these reasons, it’s important to control mites
with effective natural and organic methods.
∙ Prune leaves, stems and other infested parts of plants well past any webbing and discard in trash (and not in compost
piles). Don’t be hesitant to pull entire plants to prevent the mites spreading to its neighbors.
∙ Existing spider mite populations should be treated with organic knockdown sprays if allowed. Naturally derived insecticide
sprays like Neem Oil, Pyrethrins, Azadirachtin and Horticultural Oil can be sprayed directly onto adult mites, larvae, nymphs
and eggs to kill on contact. Apply to active spider mite infestations at 3-day intervals until control is achieved.

4. Thrips(Scirtothrips dorsalis):
It is a pest of economic significance with a broad host range, with prominent pest reports on crops including pepper, mango,
citrus, strawberry, grapes etc. Chili thrips appear to feed preferentially on new growth and infested plants usually develop
characteristic wrinkled leaves, with distinctive brown scarring along the veins of leaves.

Biology:
Egg: Hyaline, globular laid in mass.
Nymphs: Nymphs tiny, slender, fragile and straw yellow in color.
Adult: Adults with heavily fringed wings

Life Cycle:

Damage Symptoms:
∙ The infested leaves curl upward, crumble and shed
∙ Infested buds become brittle and drop down.
∙ Affected fruits show light brown scars
∙ Early stage, infestation leads to stunted growth and flower production, fruit set are arrested

Host-range and favourable conditions:
∙ S. dorsalis is found in almost all chilly growing areas. It is a polyphagus pest. Besides chilli, it also infests brinjal, cotton,
groundnut, castor, bottlegourd, guava, tea and grapevine. It is more common on un-irrigated chilli crop than irrigated one.

Generated in 7.6s on

...

ℹ️ Details

Have you ever wanted to create a bot that you could talk to about anything? Ever wanted to create your own https://dara.network/RadBots or https://Farmer.CHAT? This is how.

This workflow takes a dialog LLM prompt describing your character, a collection of docs & links and optional an video clip of your bot’s face and voice settings.

We use all these to build a bot that anyone can speak to about anything and you can host directly in your own site or app, or simply connect to your Facebook, WhatsApp or Instagram page.

How It Works:

Appends the user's question to the bottom of your dialog script.
Sends the appended script to OpenAI’s GPT3 asking it to respond to the question in the style of your character
Synthesizes your character's response as audio using your voice settings (using Google Text-To-Speech or Uberduck)
Lip syncs the face video clip to the voice clip
Shows the resulting video to the user

PS. This is the workflow that we used to create RadBots - a collection of Turing-test videobots, authored by leading international writers, singers and playwrights - and really inspired us to create Gooey.AI so that every person and organization could create their own fantastic characters, in any personality of their choosing. It's also the workflow that powers https://Farmer.CHAT and was demo'd at the UN General Assembly in April 2023 as a multi-lingual WhatsApp bot for Indian, Ethiopian and Kenyan farmers.

👣 Steps

Final Search Query

References

[3 Items

{

…

}4 Items

{

…

}4 Items

{

…

}4 Items

]

Final Prompt

[2 Items

{

…

}2 Items

{

…

}2 Items

]

Raw Text Response 1

Welcome to Farmer.CHAT. I'm an AI 🤖 designed to help farmers and extension agents. You've mentioned a potential whitefly infestation in your chili crop. I found some useful information for you!

To prevent and stop the chili leaf curl virus from spreading due to whiteflies:
1. Eliminate whitefly infestations.
2. Be aware that whitefly populations quickly develop resistance to conventional chemical treatments.
3. Consider using the following insecticides (ensure they are allowed in your region): cypermethrin, deltamethrin, bifenthrin, diafenthiuron, thiamethoxam, imidacloprid, acetamiprid, spiromesifen, buprofezin, cyantraniliprole, spirotetramat, and synthetic terpenes extract of chenopodium.

For whiteflies and other pests, consider these best practices:
1. Monitor your crops regularly for signs of pests.
2. Prune and discard infested leaves, stems, and other infected plant parts.
3. Use organic knockdown sprays like Neem Oil, Pyrethrins, Azadirachtin, and Horticultural Oil to kill pests on contact.
4. Apply

Final Response 1

Welcome to Farmer.CHAT. I'm an AI 🤖 designed to help farmers and extension agents. You've mentioned a potential whitefly infestation in your chili crop. I found some useful information for you!

To prevent and stop the chili leaf curl virus from spreading due to whiteflies [1]:
1. Eliminate whitefly infestations.
2. Be aware that whitefly populations quickly develop resistance to conventional chemical treatments.
3. Consider using the following insecticides (ensure they are allowed in your region): cypermethrin, deltamethrin, bifenthrin, diafenthiuron, thiamethoxam, imidacloprid, acetamiprid, spiromesifen, buprofezin, cyantraniliprole, spirotetramat, and synthetic terpenes extract of chenopodium.

For whiteflies and other pests, consider these best practices [2] [3]:
1. Monitor your crops regularly for signs of pests.
2. Prune and discard infested leaves, stems, and other infected plant parts.
3. Use organic knockdown sprays like Neem Oil, Pyrethrins, Azadirachtin, and Horticultural Oil to kill pests on contact.
4. Apply

Generated Audio 1

How to Use This Recipe

🙋🏽‍♀️ Need more help? Join our Discord

Related Workflows

Lip Sync with TTS

Add your text prompt, pick a voice & upload a sample video to quickly create realistic lipsync videos. Discover the ease of text-to-video AI.

Search any document with GPT4

Add your PDF, Word, HTML or Text docs, train our AI on them with OpenAI embeddings & vector search and then process results with a GPT3 script. This workflow is perfect for anything NOT in ChatGPT: 250-page compliance PDFs, training manuals, your diary, etc.

AI Animation Generator

Create AI-generated Animation without relying on complex CoLab notebooks. Input your prompts + keyframes and bring your ideas to life using the animation capabilities of Gooey & Stable Diffusion's Deforum. For more help on how to use the tool visit https://www.help.gooey.ai/learn-animation

Compare AI Image Generators

Create multiple AI photos from one prompt using Stable Diffusion (1.5 -> 2.1, Open/Midjourney), DallE, and other models. Find out which AI Image generator works best for your text prompt on comparing OpenAI, Stability.AI etc.

Farmer.CHAT (with Vision) (Mixtral)

📝 Instructions

🧠 Language Model

📄 Knowledge

Capabilities

🗣️ Text to Speech & Lipsync

Text-to-Speech Provider

Voice name (Google TTS)

🫦 Add Lipsync Video

🔠 Translation & Speech Recognition

🩻 Photo & Document Intelligence

🗣️ Google Text-to-Speech Settings

Speaking rate

Pitch

📄 Knowledge Base

👩‍🏫 Search Instructions

Citation Style

Create Synthetic Data

Advanced Settings

👁‍🗨 Conversation Summarization

⌥ Variables

🔑 Keyword Extraction

Embeddings Model

Dense Embeddings Weightage

Max Citations

Max Snippet Words

Overlapping Snippet Lines

🔠 Language Model Settings

Answer Outputs

Max Output Tokens

Creativity (aka Sampling Temperature)

🛠️ Tools

👣 Steps

How to Use This Recipe

Related Workflows

Lip Sync with TTS

Search any document with GPT4

AI Animation Generator

Compare AI Image Generators

GET STARTED

LEARN

DEVELOPERS

SOCIAL

CONNECT

EXTRAS