Multiple Updates LLM 2 (#890)

Code4GovTech · Sep 8, 2023 · c067789 · c067789
1 parent e4f150b
commit c067789
Show file tree

Hide file tree

Showing 21 changed files with 26 additions and 19 deletions.
diff --git a/...3/Karmayogi/LLMs for Question Answering 2/Assets/Accuracy_visualization (3).png b/...3/Karmayogi/LLMs for Question Answering 2/Assets/Accuracy_visualization (3).png
diff --git a/...Karmayogi/LLMs for Question Answering 2/Assets/Avg BLEU Score_visualization.png b/...Karmayogi/LLMs for Question Answering 2/Assets/Avg BLEU Score_visualization.png
diff --git a/...rmayogi/LLMs for Question Answering 2/Assets/Avg F1 Score_visualization (2).png b/...rmayogi/LLMs for Question Answering 2/Assets/Avg F1 Score_visualization (2).png
diff --git a/...gi/LLMs for Question Answering 2/Assets/Avg ROUGE-1 Score_visualization (1).png b/...gi/LLMs for Question Answering 2/Assets/Avg ROUGE-1 Score_visualization (1).png
diff --git a/...mayogi/LLMs for Question Answering 2/Assets/Avg ROUGE-L Score_visualization.png b/...mayogi/LLMs for Question Answering 2/Assets/Avg ROUGE-L Score_visualization.png
diff --git a/docs/2023/Karmayogi/LLMs for Question Answering 2/Assets/Document_QA.jpg b/docs/2023/Karmayogi/LLMs for Question Answering 2/Assets/Document_QA.jpg
diff --git a/docs/2023/Karmayogi/LLMs for Question Answering 2/Assets/Evaluation_Result.png b/docs/2023/Karmayogi/LLMs for Question Answering 2/Assets/Evaluation_Result.png
diff --git a/docs/2023/Karmayogi/LLMs for Question Answering 2/Assets/Milvus_Retrieval.png b/docs/2023/Karmayogi/LLMs for Question Answering 2/Assets/Milvus_Retrieval.png
diff --git a/docs/2023/Karmayogi/LLMs for Question Answering 2/Assets/No_context.png b/docs/2023/Karmayogi/LLMs for Question Answering 2/Assets/No_context.png
diff --git a/docs/2023/Karmayogi/LLMs for Question Answering 2/Assets/Query_with_context.png b/docs/2023/Karmayogi/LLMs for Question Answering 2/Assets/Query_with_context.png
diff --git a/.../2023/Karmayogi/LLMs for Question Answering 2/Assets/Time (s)_visualization.png b/.../2023/Karmayogi/LLMs for Question Answering 2/Assets/Time (s)_visualization.png
diff --git a/docs/2023/Karmayogi/LLMs for Question Answering 2/Assets/image.png b/docs/2023/Karmayogi/LLMs for Question Answering 2/Assets/image.png
diff --git a/docs/2023/Karmayogi/LLMs for Question Answering 2/updates/2023-07-07.md b/docs/2023/Karmayogi/LLMs for Question Answering 2/updates/2023-07-07.md
@@ -10,7 +10,7 @@ author: Vanshika Mishra
 - [x] Make project design documentation. 
 
 ## Screenshots / Videos 
-- ![Project Design](https://github.com/vanshika230/C4GT/blob/main/Images/Document_QA.jpg)
+- ![Project Design](../Assets/Document_QA.jpg)
 
 ## Contributions
 - [List of Supported Models](https://github.com/vanshika230/C4GT/blob/main/Data/supported_models%20(1).xlsx)

diff --git a/docs/2023/Karmayogi/LLMs for Question Answering 2/updates/2023-07-14.md b/docs/2023/Karmayogi/LLMs for Question Answering 2/updates/2023-07-14.md
@@ -8,7 +8,7 @@ author: Vanshika Mishra
 - [x] Tested 60 LLM models using Tranformers and Hugging face.
 
 ## Screenshots / Videos
-- ![Sample Evaluation Result](https://github.com/vanshika230/C4GT/blob/main/Images/Evaluation_Result.png) 
+- ![Sample Evaluation Result](../Assets/Evaluation_Result.png) 
 
 ## Contributions
 - [Evaluation Script and Evaluation Results](https://github.com/sunbird-cb/llm-question-answering/pull/2)

diff --git a/docs/2023/Karmayogi/LLMs for Question Answering 2/updates/2023-07-21.md b/docs/2023/Karmayogi/LLMs for Question Answering 2/updates/2023-07-21.md
@@ -9,7 +9,7 @@ author: Vanshika Mishra
 
 
 ## Screenshots / Videos 
-- ![Visualization](https://github.com/vanshika230/C4GT/blob/main/Images/Visualizations/Time%20(s)_visualization.png)
+- ![Visualization](../Assets/Time%20(s)_visualization.png)
 
 ## Contributions
 - [Visualization script and Images](https://github.com/sunbird-cb/llm-question-answering/pull/2)

diff --git a/docs/2023/Karmayogi/LLMs for Question Answering 2/updates/2023-07-28.md b/docs/2023/Karmayogi/LLMs for Question Answering 2/updates/2023-07-28.md
@@ -9,7 +9,7 @@ author: Vanshika Mishra
 - [x] Collected data from langchain LLM results.
 
 ## Screenshots / Videos 
-- ![LLM Pipeline Results](https://github.com/vanshika230/C4GT/blob/main/Images/image.png)
+- ![LLM Pipeline Results](../Assets/image.png)
 
 ## Contributions
 - [LLM Pipeline Results on Sample Document](https://github.com/vanshika230/C4GT/blob/main/Data/India_rcvdans.xlsx)

diff --git a/docs/2023/Karmayogi/LLMs for Question Answering 2/updates/2023-08-04.md b/docs/2023/Karmayogi/LLMs for Question Answering 2/updates/2023-08-04.md
@@ -10,6 +10,7 @@ author: Vanshika Mishra
 
 
 ## Screenshots / Videos 
+- ![Seach Kwargs](../Assets/Milvus_Retrieval.png)
 
 ## Contributions
 

diff --git a/docs/2023/Karmayogi/LLMs for Question Answering 2/updates/2023-08-11.md b/docs/2023/Karmayogi/LLMs for Question Answering 2/updates/2023-08-11.md
@@ -9,6 +9,7 @@ author: Vanshika Mishra
 - [x] Implemented pipeline in langchain for a complete demo.
 
 ## Screenshots / Videos 
+- ![Query_with_context](../Assets/Query_with_context.png)
 
 ## Contributions
 

diff --git a/docs/2023/Karmayogi/LLMs for Question Answering 2/updates/2023-08-18.md b/docs/2023/Karmayogi/LLMs for Question Answering 2/updates/2023-08-18.md
@@ -4,13 +4,16 @@ author: Vanshika Mishra
 ---
 
 ## Milestones
-- [ ] Give the description about Milestone 1
-- [ ] Give the description about Milestone 2
-- [ ] Give the description about Milestone 3
-- [ ] Give the description about Milestone 4
+- [x] Worked on making query embeddings better
+- [x] Tested various QA chains in Langchain
+- [x] Tested various milvus retrieval methods.
+
 
 ## Screenshots / Videos 
+- ![Query_with_no_context](../Assets/No_context.png)
 
 ## Contributions
 
-## Learnings
+## Learnings
+- Explore Retrieval QA Chain in depth in Langchain 
+- Studied milvus langchain documentation in depth. 
diff --git a/docs/2023/Karmayogi/LLMs for Question Answering 2/updates/2023-08-25.md b/docs/2023/Karmayogi/LLMs for Question Answering 2/updates/2023-08-25.md
@@ -4,13 +4,14 @@ author: Vanshika Mishra
 ---
 
 ## Milestones
-- [ ] Give the description about Milestone 1
-- [ ] Give the description about Milestone 2
-- [ ] Give the description about Milestone 3
-- [ ] Give the description about Milestone 4
+- [x] Worked on smooth running of milvus retrieval pipeline.
+- [x] Cleaned up the code for better understanding. 
+- [x] Cleaned up LLM Testing code and updated the visualizations.
 
 ## Screenshots / Videos 
 
 ## Contributions
 
-## Learnings
+## Learnings
+- Writing clean code. 
+- Solving dependency conflicts. 
diff --git a/docs/2023/Karmayogi/LLMs for Question Answering 2/updates/2023-09-01.md b/docs/2023/Karmayogi/LLMs for Question Answering 2/updates/2023-09-01.md
@@ -4,13 +4,14 @@ author: Vanshika Mishra
 ---
 
 ## Milestones
-- [ ] Give the description about Milestone 1
-- [ ] Give the description about Milestone 2
-- [ ] Give the description about Milestone 3
-- [ ] Give the description about Milestone 4
+- [x] Final Testing of Pipeline
+- [x] Complete documentation of project.
+- [x] Final clean-up of code 
 
 ## Screenshots / Videos 
 
 ## Contributions
 
-## Learnings
+## Learnings
+- Importance of documentation. 
+- Pipeline testing and solving dependency conflicts.