Ulangizi AI Analysis Script with Audio Detection

Our https://gooey.ai/copilot workflow let's anyone build WhatsApp/FB or their own GPT4 powered chat bots, by just swapping our their own documents and GPT prompts. Additionally, we also enable you to analyze the user's message and bot's answer to create structured data from the raw conversational messages.

Each Gooey.AI copilot will have their own conversational analysis script like this one to help analyze the user's questions and the bot's ability to answer them well.

In this case, we wantw to analyze the user's messages and categorize them based on their own logic. Hence, this LLM prompt takes a message and response and then determines whether:

We should update the user's profile object (because they mentioned their location, crop or gender)
The user's question was answered
The topic of the user's question.
Whether it includes audio to demonstrate that analysis scripts have access to all the api fields found here: https://api.gooey.ai/docs#tag/Copilot-for-your-Enterprise/operation/video-bots

👩‍💻 Prompt

Your job is to analyze incoming chat messages from farmers and the responses from a farming ai chatbot and determine how to categorize them.

The answer is only missing if the assistant:
---
1. Can not give any additional information
2. Apologizes
3. Tells the user to check a website
---
If it does not say all three things, the answer has been found.

For the user's subject answer, choose from the following list as category:

Subject Answers
*********************
Salutation
Plant Death (Infestation and Infection)
Farming Practice
Irrigation
Video
Supplements (Fertilizers and Pesticides)
Unknown Category
*********************
Assistant Answers
*********************
Found
Missing
*********************
Gender
*********************
unknown
male
female
unspecified
*********************

Conversation: """
   user: Hi
   user_audio: None
   assistant: Hello! How can I assist you with farming today?
"""
Analysis: {"user": {"crop": null, "subject": ”Salutation”, "location": null, "gender": "unspecified"}, "assistant": {"answer": "Found"}, "audio": false}
///
Conversation: """
   user: My rice crop has yellow stem borer infestation. Please suggest
   user_audio: https://storage.googleapis.com/dara-c1b52.appspot.com/daras_ai/media/0e7b333a-2818-11ef-8034-02420a000167/openai_tts_short.wav.wav
   assistant: Yellow stem borer is a major pest of rice crops. Here are some management practices that can help control the infestation of yellow stem borer in rice crops:

1. Use resistant varieties of rice such as Ratna, Sasyasree, Vikas, HKR 46, NDGR 21, Pantdhan 6, VLK 39, Prahlad, Birsadhan 201, Bhudeb Ainesh, Matangini, Radha, Sudha, Amulya, Bhagirathi, Jogan, Mandira, Nalini, Sabita, VL16 and VL 206. [2][3]

2. Cultural practices such as seed treatment with approved biopesticides or chemical pesticides before sowing, removing and destroying the grass weed hosts in the field bunds, channel or nearby areas of rice fields as these serve as alternative hosts for the pest, avoiding close spacing as it often increases the easy movement of pest, handpicking and destroying egg masses in the seedbed (nursery) before transplanting the field, cutting the leaf-top before transplanting to reduce carry-over of eggs from the seedbed to the field, raising the level of irrigation water periodically to submerge any eggs deposited on the lower parts of the plant, cutting out the stems with dead hearts and removing them from the field and destroying the larvae or burning the stem, and splitting applications of nitrogen fertilizer. High nitrogen application favors build-up of stem
"""
Analysis: {"user": {"crop": ”rice”, "subject": ”Plant Death (Infestation and Infection)”, "location": null, "gender": "unspecified"}, "assistant": {"answer": "Found"}, "audio": true}
///
Conversation: """
   user: A drug can be used to increase the height of chillies in the chilli garden
   user_audio: None
   assistant: I'm sorry, but I couldn't find any information in the search results about a drug that can increase the height of chillies in a garden. It is important to note that using untested or unverified drugs on crops can be harmful and may not be effective. It is best to consult with a local agriculture expert for specific recommendations for your district and type of plant.
"""
Analysis: {"user": {"crop": ”chili”, "subject": ”Supplements (Fertilizers and Pesticides)”, "location": null, "gender": "unspecified"}, "assistant": {"answer": "Missing"}, "audio": false}
///
Conversation: """
   user: Tell me about organic farming
   user_audio: https://storage.googleapis.com/dara-c1b52.appspot.com/daras_ai/media/71e633b4-2e23-11ef-9876-02420a000107/elevenlabs_gen%201.mp3.wav
   assistant: Organic farming is a method of farming that avoids the use of synthetic fertilizers, pesticides, and genetically modified organisms (GMOs). Instead, it relies on natural methods like crop rotation, composting, and biological pest control to maintain soil fertility and control pests. Organic farming also emphasizes the use of renewable resources and conservation of water and soil. [1]
"""
Analysis: {"user": {"crop": null, "subject": "Farming Practice", "location": null, "gender": "unspecified"}, "assistant": {"answer": "Found"}, "audio": true}
///
Conversation: """
   user: How many days should be watered after making the pepper garden?
   user_audio: https://storage.googleapis.com/dara-c1b52.appspot.com/daras_ai/media/86956d86-4a33-11ee-b1ab-02420a000152/Untitled%20video%20-%20Made%20with%20Clipchamp%203.mp3.wav
   assistant: According to [1], immediately after transplanting chilli seedlings to the field, the field should be irrigated. The second irrigation is given 10 days after transplanting. Afterward, irrigation is given as per the requirement. Generally, 8 to 9 irrigations are given depending on rainfall, soil type, humidity, and temperature. The method of irrigation adopted is ridges and furrow. For more specific information on irrigation practices for your particular crop and district, please consult with your local agriculture extension office or watch relevant videos on https://www.digitalgreen.org/videos. 💦
"""
Analysis: {"user": {"crop": "pepper", "subject": "Irrigation", "location": null, "gender": "unspecified"}, "assistant": {"answer": "Found"}, "audio": true}
///
Conversation: """
   user: Reasons why chillies fall apart
   user_audio:
   assistant: Chillies can fall apart due to several reasons, including environmental conditions, pests, and diseases. Inadequate pollination due to low bee activity or high temperatures can lead to poor fruit development and cause the chillies to fall apart [2]. Nutrient deficiencies, particularly a lack of phosphorus, can also affect fruit development and cause the chillies to fall apart [1]. Additionally, pests such as the chilli blossom midge can cause poor development of fruits, leading to the chillies falling apart [3]. It is important to consult with a local agriculture expert to identify the specific cause and recommend appropriate management practices for your district and type of plant. For more information on farming in India, you can visit https://www.digitalgreen.org/videos. 🌶️🌱
"""
Analysis: {"user": {"crop": ”chili”, "subject": ”Plant Death (Infestation and Infection)”, "location": null, "gender": "unspecified"}, "assistant": {"answer": "Found"}, "audio": false}
///
Conversation: """
   user: How to prepare dukki for planting chili garden
   user_audio:      
   assistant: I'm sorry, I couldn't find any relevant information on preparing "dukki" for planting chili garden in the search results. Could you please provide more context or try rephrasing your question?
"""
Analysis: {"user": {"crop": "chili", "subject": "Farming Practice", "location": null, "gender": "unspecified"}, "assistant": {"answer": "Missing"}, "audio": false}
///
Conversation: """
   user: Is there a video for this?
   user_audio: - 
   assistant: I'm sorry, I don't have enough information to answer your question. However, you can visit https://www.digitalgreen.org/videos to find helpful videos on various farming practices in India.
"""
Analysis: {"user": {"crop": null, "subject": "Video", "location": null, "gender": "unspecified"}, "assistant": {"answer": "Missing"}, "audio": false}
///
Conversation: """
   user: Which crop can be planted in Anantapur?
   user_audio: https://storage.googleapis.com/dara-c1b52.appspot.com/daras_ai/media/8d3f18d4-5f66-11ed-a8a9-02420a0000aa/al-hitchcock-arpa-Merry_Christmas__Jon%203.wav
   assistant: Anantapur district in Andhra Pradesh is suitable for growing crops like groundnut, maize, jowar, sunflower, cotton, and chilli. However, the choice of crop depends on various factors such as soil type, climate, and water availability. It is recommended to consult with local agricultural experts or extension officers to determine the best crop for a particular area. [1]
"""
Analysis: {"user": {"crop": null, "subject": "Farming Practice", "location": "Anantapur", "gender": "unspecified"}, "assistant": {"answer": "Found"}, "audio": true}
///
Conversation: """
   user: {{ user_msg }}
   user_audio: {{ input_audio }}
   assistant:  {{ assistant_msg }}
"""
Analysis:

🧠 Language Models

ChatGPT (openai)

💪 Capabilities

🧩 Developer Tools and Functions

⌥ Variables

input_audio

string

Template variable

user_msg

string

Template variable

assistant_msg

string

Template variable

⚙️ Settings

Run cost = 2 credits

Breakdown: 1Cr for ChatGPT (openai) + 1Cr/run

By submitting, you agree to Gooey.AI's terms & privacy policy.

ChatGPT (openai)

Generated in 1.5s on

...

ℹ️ Details

How to Use This Recipe

🙋🏽‍♀️ Need more help? Join our Discord

Ulangizi AI Analysis Script with Audio Detection

👩‍💻 Prompt

🧠 Language Models

💪 Capabilities

🧩 Developer Tools and Functions

⌥ Variables

Response Format

Max Output Tokens

Creativity (aka Sampling Temperature)

Answer Outputs

How to Use This Recipe

Related Workflows

Create a perfect SEO-optimized Title & Paragraph

Profile Lookup + GPT4 for AI-Personalized Emails

Copilot Builder

Lipsync with Text-to-Speech

GET STARTED

LEARN

DEVELOPERS

SOCIAL

CONNECT

EXTRAS