Skip to content

Commit

Permalink
updated images
Browse files Browse the repository at this point in the history
  • Loading branch information
shreyas-makes committed Mar 12, 2024
1 parent 3a5c51d commit f251cd7
Show file tree
Hide file tree
Showing 13 changed files with 61 additions and 129 deletions.
2 changes: 1 addition & 1 deletion docs/Intent Recognition System/Engineering.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,4 +9,4 @@
Intent Recognition: Turn stacks/Journey to trigger custom webhook
hosting the LLM Chat Bot Application that does classification.

![Untitled](/img/logo.svg)
![Untitled](/img/Untitled.png)
2 changes: 0 additions & 2 deletions docs/Intent Recognition System/Overview/Current State.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,5 @@
# Current State

### Current State

### Chat Assignment

- Trigger: A new chat is initiated by a user in a specific
Expand Down
4 changes: 4 additions & 0 deletions docs/Intent Recognition System/Overview/Objective.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,8 @@
Intent Recognition: Turn stacks/Journey to trigger custom webhook
hosting the LLM Chat Bot Application that does classification.

![Untitled](img/Untitled.png)

<!-- ![Untitled](../Engineering%20f06030dea04e40cf84573246d73d39f9/Untitled.png) -->

### System Components
Expand Down Expand Up @@ -64,6 +66,8 @@ Medical Questions
Semantic based gpt4 retrieval to provide user with suggested FAQ and
its answers while the users wait for a medical response.

![Whatsapp response](img/whatsapp.png)

<!-- ![Untitled](Objective%2087c497e68c234d699d6825e2549b06ce/Untitled.png) -->

### Technical Stack and Tools
Expand Down
Binary file modified docs/Intent Recognition System/Overview/img/Untitled.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/Intent Recognition System/Untitled.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
56 changes: 18 additions & 38 deletions docs/MSE Assist/Engineering/Development.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,78 +7,58 @@

Webapp with a backend on the LLM Chat Bot Application

![Untitled](/img/Untitled.png)

<!-- ![Untitled](Development%20fb8a0e36b4084bab8b4e85a7bbbe48c2/Untitled.png) -->

### System Components:

### User Interface

A UI for Inputing Medical messages for response generation or
translation. This interface should be accessible via web or mobile
platforms, offering a seamless experience for users seeking medical
information or assistance. Also have a component to input feedback for
each query.
A UI for Inputing Medical messages for response generation or translation. This interface should be accessible via web or mobile platforms, offering a seamless experience for users seeking medical information or assistance. Also have a component to input feedback for each query.

Advanced Capabilities: Using the Intent recognition + Assignment
stack route the medical message to the right mse in the mse assistant.
Pre-load the medical tickets and the MSEs can get responses back with
just a click.
Advanced Capabilities: Using the Intent recognition + Assignment stack route the medical message to the right mse in the mse assistant. Pre-load the medical tickets and the MSEs can get responses back with just a click.

### LLMs for Translation and Medical Queries (Two Ways):

Retrieval Augmented Generation: Utilize GPT-4 in conjunction with a
curated FAQ bank specifically tailored for medical inquiries. This
approach will enable the system to provide accurate and relevant
responses by leveraging both the generative capabilities of GPT-4 and
Retrieval Augmented Generation: Utilize GPT-4 in conjunction with a curated FAQ bank specifically tailored for medical inquiries. This approach will enable the system to provide accurate and relevant responses by leveraging both the generative capabilities of GPT-4 and
the specific, reliable information contained within the FAQ bank.

Medpalm 2 for Medical Query Generation: Employ Medpalm 2, a
specialized LLM for medical queries, to generate responses to medical
questions. Enhance its effectiveness through few-shot prompting,
incorporating 5-8 ideal medical responses as templates for generating
Medpalm 2 for Medical Query Generation: Employ Medpalm 2, a specialized LLM for medical queries, to generate responses to medical
questions. Enhance its effectiveness through few-shot prompting, incorporating 5-8 ideal medical responses as templates for generating
accurate and contextually relevant medical advice.

Translation Layer with GPT-4: Before processing queries with Medpalm
2 or the retrieval-augmented generation system, implement a translation
layer using GPT-4 to ensure that messages in any language can be
accurately translated and understood, broadening the system’s
Translation Layer with GPT-4: Before processing queries with Medpalm 2 or the retrieval-augmented generation system, implement a translation
layer using GPT-4 to ensure that messages in any language can be accurately translated and understood, broadening the system’s
accessibility to non-English speakers.

### Technical Stack and Tools:

Frontend:  React / Next JS

Backend: Python with FastAPI for creating efficient and scalable
server-side applications, facilitating the integration with LLMs and
Backend: Python with FastAPI for creating efficient and scalable server-side applications, facilitating the integration with LLMs and
managing the system’s logic.

LLMs Integration: GPT-4 for translation and retrieval-augmented
generation, along with Medpalm 2 for specialized medical query
LLMs Integration: GPT-4 for translation and retrieval-augmented generation, along with Medpalm 2 for specialized medical query
handling.

Database: SQL database systems for storing user queries, and system
responses, ensuring data persistence and retrieval efficiency.
Database: SQL database systems for storing user queries, and system responses, ensuring data persistence and retrieval efficiency.

APIs: RESTful APIs to connect the frontend with the backend logic,
LLMs processing, and database operations, ensuring smooth data flow and
APIs: RESTful APIs to connect the frontend with the backend logic, LLMs processing, and database operations, ensuring smooth data flow and
system functionality.

### Caveats

Language Nuances: The translation layer must accurately capture
medical terminology and nuances across languages. Regular updates and
quality checks are necessary to ensure the translation accuracy for
medical contexts.
Language Nuances: The translation layer must accurately capture medical terminology and nuances across languages. Regular updates and
quality checks are necessary to ensure the translation accuracy for medical contexts.

Dependence on High-Quality Data: The effectiveness of the system
heavily relies on the quality of the FAQ bank. Regular updates and
expert review are crucial to keep the information accurate and
up-to-date.
Dependence on High-Quality Data: The effectiveness of the system heavily relies on the quality of the FAQ bank. Regular updates and expert review are crucial to keep the information accurate and up-to-date.

Example UI for response Generation:

![Example](/img/Untitled 1.png)
<!-- ![Untitled](Development%20fb8a0e36b4084bab8b4e85a7bbbe48c2/Untitled%201.png) -->

Example Ui for Feedback collection:
![Example](/img/Untitled 2.png)

<!-- ![Untitled](Development%20fb8a0e36b4084bab8b4e85a7bbbe48c2/Untitled%202.png) -->
4 changes: 3 additions & 1 deletion docs/MSE Assist/Engineering/Evaluation.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,4 +5,6 @@ Testing Procedure:
- Testing protocols
- Feedback mechanisms
- Iterative improvement process
- **Quality Assurance (Evals)**
- Quality Assurance (Evals)
- User Acceptance Testing

3 changes: 3 additions & 0 deletions docs/MSE Assist/Operational Procedures.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,6 +25,9 @@ Reporting guidelines:

<!-- ![Operational%20Procedures%20c712dcf4719b468a825938a54d1284c8/image1.png](Operational%20Procedures%20c712dcf4719b468a825938a54d1284c8/image1.png) -->

![Data version controlling](image1.png)


MLOps softwares we could use:

- MLflow
Expand Down
7 changes: 0 additions & 7 deletions docs/MSE Assist/Overview.md

This file was deleted.

2 changes: 2 additions & 0 deletions docs/MSE Assist/Overview/Current State.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,8 @@

# Current State



<!-- ![Untitled](Current%20State%206ef0ee94a99243d3b2fdfd263ba474a1/Untitled.png) -->

### Current User Journey
Expand Down
4 changes: 4 additions & 0 deletions docs/MSE Assist/Overview/Objective.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,10 @@ If the input and output languages are specified:

- **Feedback:** Record user feedback (rating and comments) alongside the related query and response.

![Untitled](/img/image2.png)
![Untitled](/img/image1.png)
![Untitled](/img/image3.png)

**API Endpoints**

- **Medical Query API Endpoint:**
Expand Down
106 changes: 26 additions & 80 deletions docs/MSE Assist/References/Frequently asked questions.md
Original file line number Diff line number Diff line change
@@ -1,87 +1,33 @@
# Frequently asked questions

| Category | Antenatal Care
(ANC) | When to Ask |
| Category | Antenatal Care (ANC) | When to Ask |
| --- | --- | --- |
| General Information | How many months pregnant are
you? | Asked every time for Initial assessment and follow-ups |
| | What was your Last Menstrual Period
(LMP)? | If EDD is requested / needed for
response or during initial assessment/ also when user says not felt
labour pain |
| | What is your Estimated Date of
Delivery (EDD)? | Initial assessment or for labor
predictions |
| Medical History | Have you had any complications
during this pregnancy? | Initial assessment and
follow-ups |
| | Please send us your medical reports
or prescriptions you have. | When discussing medical conditions
or treatments |
| Diet/Nutrition | Are you currently taking any
vitamins or supplements? | Dietary assessment
sessions |
| Symptoms and
Complaints | Site and character of any pain
you're experiencing? | When pain is
mentioned |
| Medications | What medications have you been
prescribed, if any? Can you share your prescription with us to help you
better? | When discussing medical history or
current symptoms |
| Follow-up and
Clarification | Can you explain your question with
more details, please? | When queries are
unclear |
| Other Queries | Have there been any changes to your
regular activities due to pregnancy? | During initial assessment and
follow-ups |
| General Information | How many months pregnant are you? | Asked every time for Initial assessment and follow-ups |
| | What was your Last Menstrual Period (LMP)? | If EDD is requested / needed for response or during initial assessment/ also when user says not felt labour pain |
| | What is your Estimated Date of Delivery (EDD)? | Initial assessment or for labor predictions |
| Medical History | Have you had any complications during this pregnancy? | Initial assessment and follow-ups |
| | Please send us your medical reports or prescriptions you have. | When discussing medical conditions or treatments |
| Diet/Nutrition | Are you currently taking any vitamins or supplements? | Dietary assessment sessions |
| Symptoms and Complaints | Site and character of any pain you're experiencing? | When pain is mentioned |
| Medications | What medications have you been prescribed, if any? Can you share your prescription with us to help you better? | When discussing medical history or current symptoms |
| Follow-up and Clarification | Can you explain your question with more details, please? | When queries are unclear |
| Other Queries | Have there been any changes to your regular activities due to pregnancy? | During initial assessment and follow-ups |

| Category | Postnatal Care
(ANC) | When to Ask |
| Category | Postnatal Care (ANC) | When to Ask |
| --- | --- | --- |
| General Information | How many days post-delivery are
you? | Initial assessment and follow-ups,
when questions about bleeding, diet, size of tummy etc asked |
| | Baby's current age? | Every interaction
post-delivery |
| | Type of delivery? | Initial assessment and follow-ups,
when questions about bleeding, diet, size of tummy etc
asked |
| General Information | How many days post-delivery are you? | Initial assessment and follow-ups, when questions about bleeding, diet, size of tummy etc asked |
| | Baby's current age? | Every interaction post-delivery |
| | Type of delivery? | Initial assessment and follow-ups, when questions about bleeding, diet, size of tummy etc asked |
| Medical History | Date of delivery? | First postnatal check |
| | Please share your
prescription. | When discussing mother's
post-delivery medications |
| Diet/Nutrition | Has the baby started on weaning
foods? | 6-month check-up or dietary
assessment |
| Symptoms and
Complaints | Duration and character of any
post-delivery bleeding? | Post-delivery assessments or when
bleeding is mentioned |
| Medications | Who prescribed these postnatal
medicines? | When postnatal medications are
discussed |
| Baby Information | Please share a photo of the baby for
any skin-related queries. | When assessing skin conditions or
physical complaints |
| | Baby's weight at birth and current
weight? | During check-ups or if there are
concerns about baby's growth |
| Hospitalization | Are you still in the
hospital? | Immediate post-delivery
period |
| Follow-up and
Clarification | Can you clarify if you're asking
about the baby or mother? | When queries are
unclear |
| Feeding | Are you breastfeeding, or is the baby
on formula milk? | Every pediatric
interaction |
| Family Planning | Are you interested in discussing
contraception? | During postpartum checks or when
family planning is mentioned |
| Other Queries | How is your menstrual cycle now
post-delivery? | Post-delivery check-ups or when
menstrual concerns arise
| | Please share your prescription. | When discussing mother's post-delivery medications |
| Diet/Nutrition | Has the baby started on weaning foods? | 6-month check-up or dietary assessment |
| Symptoms and Complaints | Duration and character of any post-delivery bleeding? | Post-delivery assessments or when bleeding is mentioned |
| Medications | Who prescribed these postnatal medicines? | When postnatal medications are discussed |
| Baby Information | Please share a photo of the baby for any skin-related queries. | When assessing skin conditions or physical complaints |
| | Baby's weight at birth and current weight? | During check-ups or if there are concerns about baby's growth |
| Hospitalization | Are you still in the hospital? | Immediate post-delivery period |
| Follow-up and Clarification | Can you clarify if you're asking about the baby or mother? | When queries are unclear |
| Feeding | Are you breastfeeding, or is the baby on formula milk? | Every pediatric interaction |
| Family Planning | Are you interested in discussing contraception? | During postpartum checks or when family planning is mentioned |
| Other Queries | How is your menstrual cycle now post-delivery? | Post-delivery check-ups or when menstrual concerns arise
|

0 comments on commit f251cd7

Please sign in to comment.