diff --git a/docs/Intent Recognition System/Engineering.md b/docs/Intent Recognition System/Engineering.md index e968b26..cb41048 100644 --- a/docs/Intent Recognition System/Engineering.md +++ b/docs/Intent Recognition System/Engineering.md @@ -9,4 +9,4 @@ Intent Recognition: Turn stacks/Journey to trigger custom webhook hosting the LLM Chat Bot Application that does classification. -![Untitled](/img/logo.svg) +![Untitled](/img/Untitled.png) diff --git a/docs/Intent Recognition System/Overview/Current State.md b/docs/Intent Recognition System/Overview/Current State.md index 42bc9e0..d760d5c 100644 --- a/docs/Intent Recognition System/Overview/Current State.md +++ b/docs/Intent Recognition System/Overview/Current State.md @@ -1,7 +1,5 @@ # Current State -### Current State - ### Chat Assignment - Trigger: A new chat is initiated by a user in a specific diff --git a/docs/Intent Recognition System/Overview/Objective.md b/docs/Intent Recognition System/Overview/Objective.md index b530ba8..80d2290 100644 --- a/docs/Intent Recognition System/Overview/Objective.md +++ b/docs/Intent Recognition System/Overview/Objective.md @@ -3,6 +3,8 @@ Intent Recognition: Turn stacks/Journey to trigger custom webhook hosting the LLM Chat Bot Application that does classification. +![Untitled](img/Untitled.png) + ### System Components @@ -64,6 +66,8 @@ Medical Questions Semantic based gpt4 retrieval to provide user with suggested FAQ and its answers while the users wait for a medical response. +![Whatsapp response](img/whatsapp.png) + ### Technical Stack and Tools diff --git a/docs/Intent Recognition System/Overview/img/Untitled.png b/docs/Intent Recognition System/Overview/img/Untitled.png index 7ad0ece..adcbc30 100644 Binary files a/docs/Intent Recognition System/Overview/img/Untitled.png and b/docs/Intent Recognition System/Overview/img/Untitled.png differ diff --git a/docs/Intent Recognition System/Overview/img/whatsapp.png b/docs/Intent Recognition System/Overview/img/whatsapp.png new file mode 100644 index 0000000..7ad0ece Binary files /dev/null and b/docs/Intent Recognition System/Overview/img/whatsapp.png differ diff --git a/docs/Intent Recognition System/Untitled.png b/docs/Intent Recognition System/Untitled.png new file mode 100644 index 0000000..adcbc30 Binary files /dev/null and b/docs/Intent Recognition System/Untitled.png differ diff --git a/docs/MSE Assist/Engineering/Development.md b/docs/MSE Assist/Engineering/Development.md index 23c2637..f9595dc 100644 --- a/docs/MSE Assist/Engineering/Development.md +++ b/docs/MSE Assist/Engineering/Development.md @@ -7,78 +7,58 @@ Webapp with a backend on the LLM Chat Bot Application +![Untitled](/img/Untitled.png) + ### System Components: ### User Interface -A UI for Inputing Medical messages for response generation or -translation. This interface should be accessible via web or mobile -platforms, offering a seamless experience for users seeking medical -information or assistance. Also have a component to input feedback for -each query. +A UI for Inputing Medical messages for response generation or translation. This interface should be accessible via web or mobile platforms, offering a seamless experience for users seeking medical information or assistance. Also have a component to input feedback for each query. -Advanced Capabilities: Using the Intent recognition + Assignment -stack route the medical message to the right mse in the mse assistant. -Pre-load the medical tickets and the MSEs can get responses back with -just a click. +Advanced Capabilities: Using the Intent recognition + Assignment stack route the medical message to the right mse in the mse assistant. Pre-load the medical tickets and the MSEs can get responses back with just a click. ### LLMs for Translation and Medical Queries (Two Ways): -Retrieval Augmented Generation: Utilize GPT-4 in conjunction with a -curated FAQ bank specifically tailored for medical inquiries. This -approach will enable the system to provide accurate and relevant -responses by leveraging both the generative capabilities of GPT-4 and +Retrieval Augmented Generation: Utilize GPT-4 in conjunction with a curated FAQ bank specifically tailored for medical inquiries. This approach will enable the system to provide accurate and relevant responses by leveraging both the generative capabilities of GPT-4 and the specific, reliable information contained within the FAQ bank. -Medpalm 2 for Medical Query Generation: Employ Medpalm 2, a -specialized LLM for medical queries, to generate responses to medical -questions. Enhance its effectiveness through few-shot prompting, -incorporating 5-8 ideal medical responses as templates for generating +Medpalm 2 for Medical Query Generation: Employ Medpalm 2, a specialized LLM for medical queries, to generate responses to medical +questions. Enhance its effectiveness through few-shot prompting, incorporating 5-8 ideal medical responses as templates for generating accurate and contextually relevant medical advice. -Translation Layer with GPT-4: Before processing queries with Medpalm -2 or the retrieval-augmented generation system, implement a translation -layer using GPT-4 to ensure that messages in any language can be -accurately translated and understood, broadening the system’s +Translation Layer with GPT-4: Before processing queries with Medpalm 2 or the retrieval-augmented generation system, implement a translation +layer using GPT-4 to ensure that messages in any language can be accurately translated and understood, broadening the system’s accessibility to non-English speakers. ### Technical Stack and Tools: Frontend:  React / Next JS -Backend: Python with FastAPI for creating efficient and scalable -server-side applications, facilitating the integration with LLMs and +Backend: Python with FastAPI for creating efficient and scalable server-side applications, facilitating the integration with LLMs and managing the system’s logic. -LLMs Integration: GPT-4 for translation and retrieval-augmented -generation, along with Medpalm 2 for specialized medical query +LLMs Integration: GPT-4 for translation and retrieval-augmented generation, along with Medpalm 2 for specialized medical query handling. -Database: SQL database systems for storing user queries, and system -responses, ensuring data persistence and retrieval efficiency. +Database: SQL database systems for storing user queries, and system responses, ensuring data persistence and retrieval efficiency. -APIs: RESTful APIs to connect the frontend with the backend logic, -LLMs processing, and database operations, ensuring smooth data flow and +APIs: RESTful APIs to connect the frontend with the backend logic, LLMs processing, and database operations, ensuring smooth data flow and system functionality. ### Caveats -Language Nuances: The translation layer must accurately capture -medical terminology and nuances across languages. Regular updates and -quality checks are necessary to ensure the translation accuracy for -medical contexts. +Language Nuances: The translation layer must accurately capture medical terminology and nuances across languages. Regular updates and +quality checks are necessary to ensure the translation accuracy for medical contexts. -Dependence on High-Quality Data: The effectiveness of the system -heavily relies on the quality of the FAQ bank. Regular updates and -expert review are crucial to keep the information accurate and -up-to-date. +Dependence on High-Quality Data: The effectiveness of the system heavily relies on the quality of the FAQ bank. Regular updates and expert review are crucial to keep the information accurate and up-to-date. Example UI for response Generation: - +![Example](/img/Untitled 1.png) Example Ui for Feedback collection: +![Example](/img/Untitled 2.png) diff --git a/docs/MSE Assist/Engineering/Evaluation.md b/docs/MSE Assist/Engineering/Evaluation.md index 89685a6..a10c894 100644 --- a/docs/MSE Assist/Engineering/Evaluation.md +++ b/docs/MSE Assist/Engineering/Evaluation.md @@ -5,4 +5,6 @@ Testing Procedure: - Testing protocols - Feedback mechanisms - Iterative improvement process -- **Quality Assurance (Evals)** \ No newline at end of file +- Quality Assurance (Evals) +- User Acceptance Testing + diff --git a/docs/MSE Assist/Operational Procedures.md b/docs/MSE Assist/Operational Procedures.md index f78bf8c..b2672f8 100644 --- a/docs/MSE Assist/Operational Procedures.md +++ b/docs/MSE Assist/Operational Procedures.md @@ -25,6 +25,9 @@ Reporting guidelines: +![Data version controlling](image1.png) + + MLOps softwares we could use: - MLflow diff --git a/docs/MSE Assist/Overview.md b/docs/MSE Assist/Overview.md deleted file mode 100644 index 456437c..0000000 --- a/docs/MSE Assist/Overview.md +++ /dev/null @@ -1,7 +0,0 @@ -# Overview - -[Objective](/docs/MSE%20Assist/Overview/Objective.md) - -[Current State](/docs/MSE%20Assist/Overview/Current%20State.md) - -[Desired State](/docs/MSE%20Assist/Overview/Desired%20State.md) diff --git a/docs/MSE Assist/Overview/Current State.md b/docs/MSE Assist/Overview/Current State.md index 00313ec..8ff55fc 100644 --- a/docs/MSE Assist/Overview/Current State.md +++ b/docs/MSE Assist/Overview/Current State.md @@ -2,6 +2,8 @@ # Current State + + ### Current User Journey diff --git a/docs/MSE Assist/Overview/Objective.md b/docs/MSE Assist/Overview/Objective.md index 3d9dcc8..2f50972 100644 --- a/docs/MSE Assist/Overview/Objective.md +++ b/docs/MSE Assist/Overview/Objective.md @@ -36,6 +36,10 @@ If the input and output languages are specified: - **Feedback:** Record user feedback (rating and comments) alongside the related query and response. +![Untitled](/img/image2.png) +![Untitled](/img/image1.png) +![Untitled](/img/image3.png) + **API Endpoints** - **Medical Query API Endpoint:** diff --git a/docs/MSE Assist/References/Frequently asked questions.md b/docs/MSE Assist/References/Frequently asked questions.md index fb789de..50ecb18 100644 --- a/docs/MSE Assist/References/Frequently asked questions.md +++ b/docs/MSE Assist/References/Frequently asked questions.md @@ -1,87 +1,33 @@ # Frequently asked questions -| Category | Antenatal Care -(ANC) | When to Ask | +| Category | Antenatal Care (ANC) | When to Ask | | --- | --- | --- | -| General Information | How many months pregnant are -you? | Asked every time for Initial assessment and follow-ups | -| | What was your Last Menstrual Period -(LMP)? | If EDD is requested / needed for -response or during initial assessment/ also when user says not felt -labour pain | -| | What is your Estimated Date of -Delivery (EDD)? | Initial assessment or for labor -predictions | -| Medical History | Have you had any complications -during this pregnancy? | Initial assessment and -follow-ups | -| | Please send us your medical reports -or prescriptions you have. | When discussing medical conditions -or treatments | -| Diet/Nutrition | Are you currently taking any -vitamins or supplements? | Dietary assessment -sessions | -| Symptoms and -Complaints | Site and character of any pain -you're experiencing? | When pain is -mentioned | -| Medications | What medications have you been -prescribed, if any? Can you share your prescription with us to help you -better? | When discussing medical history or -current symptoms | -| Follow-up and -Clarification | Can you explain your question with -more details, please? | When queries are -unclear | -| Other Queries | Have there been any changes to your -regular activities due to pregnancy? | During initial assessment and -follow-ups | +| General Information | How many months pregnant are you? | Asked every time for Initial assessment and follow-ups | +| | What was your Last Menstrual Period (LMP)? | If EDD is requested / needed for response or during initial assessment/ also when user says not felt labour pain | +| | What is your Estimated Date of Delivery (EDD)? | Initial assessment or for labor predictions | +| Medical History | Have you had any complications during this pregnancy? | Initial assessment and follow-ups | +| | Please send us your medical reports or prescriptions you have. | When discussing medical conditions or treatments | +| Diet/Nutrition | Are you currently taking any vitamins or supplements? | Dietary assessment sessions | +| Symptoms and Complaints | Site and character of any pain you're experiencing? | When pain is mentioned | +| Medications | What medications have you been prescribed, if any? Can you share your prescription with us to help you better? | When discussing medical history or current symptoms | +| Follow-up and Clarification | Can you explain your question with more details, please? | When queries are unclear | +| Other Queries | Have there been any changes to your regular activities due to pregnancy? | During initial assessment and follow-ups | -| Category | Postnatal Care -(ANC) | When to Ask | +| Category | Postnatal Care (ANC) | When to Ask | | --- | --- | --- | -| General Information | How many days post-delivery are -you? | Initial assessment and follow-ups, -when questions about bleeding, diet, size of tummy etc asked | -| | Baby's current age? | Every interaction -post-delivery | -| | Type of delivery? | Initial assessment and follow-ups, -when questions about bleeding, diet, size of tummy etc -asked | +| General Information | How many days post-delivery are you? | Initial assessment and follow-ups, when questions about bleeding, diet, size of tummy etc asked | +| | Baby's current age? | Every interaction post-delivery | +| | Type of delivery? | Initial assessment and follow-ups, when questions about bleeding, diet, size of tummy etc asked | | Medical History | Date of delivery? | First postnatal check | -| | Please share your -prescription. | When discussing mother's -post-delivery medications | -| Diet/Nutrition | Has the baby started on weaning -foods? | 6-month check-up or dietary -assessment | -| Symptoms and -Complaints | Duration and character of any -post-delivery bleeding? | Post-delivery assessments or when -bleeding is mentioned | -| Medications | Who prescribed these postnatal -medicines? | When postnatal medications are -discussed | -| Baby Information | Please share a photo of the baby for -any skin-related queries. | When assessing skin conditions or -physical complaints | -| | Baby's weight at birth and current -weight? | During check-ups or if there are -concerns about baby's growth | -| Hospitalization | Are you still in the -hospital? | Immediate post-delivery -period | -| Follow-up and -Clarification | Can you clarify if you're asking -about the baby or mother? | When queries are -unclear | -| Feeding | Are you breastfeeding, or is the baby -on formula milk? | Every pediatric -interaction | -| Family Planning | Are you interested in discussing -contraception? | During postpartum checks or when -family planning is mentioned | -| Other Queries | How is your menstrual cycle now -post-delivery? | Post-delivery check-ups or when -menstrual concerns arise +| | Please share your prescription. | When discussing mother's post-delivery medications | +| Diet/Nutrition | Has the baby started on weaning foods? | 6-month check-up or dietary assessment | +| Symptoms and Complaints | Duration and character of any post-delivery bleeding? | Post-delivery assessments or when bleeding is mentioned | +| Medications | Who prescribed these postnatal medicines? | When postnatal medications are discussed | +| Baby Information | Please share a photo of the baby for any skin-related queries. | When assessing skin conditions or physical complaints | +| | Baby's weight at birth and current weight? | During check-ups or if there are concerns about baby's growth | +| Hospitalization | Are you still in the hospital? | Immediate post-delivery period | +| Follow-up and Clarification | Can you clarify if you're asking about the baby or mother? | When queries are unclear | +| Feeding | Are you breastfeeding, or is the baby on formula milk? | Every pediatric interaction | +| Family Planning | Are you interested in discussing contraception? | During postpartum checks or when family planning is mentioned | +| Other Queries | How is your menstrual cycle now post-delivery? | Post-delivery check-ups or when menstrual concerns arise | \ No newline at end of file