Merge pull request #374 from smilingprogrammer/week-11/12-docs

chore(docs): Data pipeline for safaa week 11 and week 12 blog

Reviewed-by: [email protected]

Author: shaheemazmalmmd

docs/2025/data-pipeline/updates/2025-07-30.md

@@ -11,7 +11,7 @@ SPDX-FileCopyrightText: 2025 Abdulsobur Oyewale <[email protected]>
 -->
 
 # WEEK 9
-*(July 23, 2025)*
+*(July 30, 2025)*
 
 ## Attendees:
 - [Ayush Kumar Bhardwaj](https://github.com/hastagAB)

docs/2025/data-pipeline/updates/2025-08-06.md

@@ -11,7 +11,7 @@ SPDX-FileCopyrightText: 2025 Abdulsobur Oyewale <[email protected]>
 -->
 
 # WEEK 10
-*(July 23, 2025)*
+*(August 06, 2025)*
 
 ## Attendees:
 - [Ayush Kumar Bhardwaj](https://github.com/hastagAB)
@@ -27,7 +27,7 @@ SPDX-FileCopyrightText: 2025 Abdulsobur Oyewale <[email protected]>
 
 * To successfully integrate the testing process in the pipeline, i introduced the entity_recognizer folder and declutter_model folder into the directory we saved our model during training.
 * This adjustment will allow us to test the model we saved in the new path from training
-* With this we will be able to test and visualized our testing metrics anything the pipeline runs. This will enable us to make decision in the future on the next steps of any newly trained model coming from the pipeline with respect to the metrics
+* With this, we will be able to test and visualized our testing metrics anything the pipeline runs. This will enable us to make decision in the future on the next steps of any newly trained model coming from the pipeline with respect to the metrics
 ![image](/img/data-pipeline/test.png)
 
 

docs/2025/data-pipeline/updates/2025-08-13.md

@@ -0,0 +1,42 @@
+---
+title: Week 11
+author: Abdulsobur Oyewale
+tags: [gsoc25, Data Pipeline for Safaa]
+---
+
+<!--
+SPDX-License-Identifier: CC-BY-SA-4.0
+
+SPDX-FileCopyrightText: 2025 Abdulsobur Oyewale <[email protected]>
+-->
+
+# WEEK 11
+*(August 13, 2025)*
+
+## Attendees:
+- [Ayush Kumar Bhardwaj](https://github.com/hastagAB)
+- [Kaushlendra Pratap](https://github.com/Kaushl2208)
+
+
+## Engagements
+
+This week we integrated automation of raising a PR from the retraining pipeline. In this feature, we implemented the PR functionality into the pipeline with;
+- Extraction of retraining model metrics from workflow
+- Creating a new branch for each retraining triggered, and saved with timestamp
+- Automated PR raising using GitHub bot
+- Integrated metrics as PR description
+
+I also fix the existing preprocessing and decluttering process to maintain DataFrame alignment while pipeline is running;
+
+- Updated preprocess_data and declutter_data to return Series with original index
+- Ensured copyright column is updated in-place without breaking row alignment
+- Resolved the length mismatch errors during pipeline execution
+
+## Meeting Discussion:
+* This week, I discussed with my mentors on what i have done so far regarding creation of a new PR through a different branch.
+* I was able to present and show them the PR that were raised from what when we tested the functionalities
+
+![image](/img/data-pipeline/pipetest.png)
+
+## Subsequent Steps
+I will be continuing with solving some errors like the precision that wasn't showing in the metrics of the PR raised, among others.

docs/2025/data-pipeline/updates/2025.07.09.md

@@ -11,7 +11,7 @@ SPDX-FileCopyrightText: 2025 Abdulsobur Oyewale <[email protected]>
 -->
 
 # WEEK 5
-*(July 02, 2025)*
+*(July 09, 2025)*
 
 ## Attendees:
 - [Kaushlendra Pratap](https://github.com/Kaushl2208)

docs/2025/data-pipeline/updates/2025.08.20.md

@@ -0,0 +1,33 @@
+---
+title: Week 12
+author: Abdulsobur Oyewale
+tags: [gsoc25, Data Pipeline for Safaa]
+---
+
+<!--
+SPDX-License-Identifier: CC-BY-SA-4.0
+
+SPDX-FileCopyrightText: 2025 Abdulsobur Oyewale <[email protected]>
+-->
+
+# WEEK 12
+*(August 20, 2025)*
+
+## Attendees:
+- [Kaushlendra Pratap](https://github.com/Kaushl2208)
+- Sushant Kumar
+
+## Engagements
+This week i majorly focused of documentation. I wrote documentation for;
+- My GSoC final evaluation submission.
+- The documentation for the project, what we have accomplished so far, and what still need to be included.
+
+I also took my time make some modification to the current `pipeline.yml` like the precision metric that wasn't properly being exported and displayed in PRs previously created
+
+![image](/img/data-pipeline/pipetest.png)
+
+## Meeting Discussion:
+
+Had a meeting with my mentor, and we majorly discuss the things that needed to be included in my evaluation documentation and requirements needed in the project documentation too.
+
+I was also given a link to two repositories which i can use as a guide for my evaluation documentation.