feat: implement sequential chunk-based file analysis with agent memory aggregation #3145
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
feat: implement sequential chunk-based file analysis with agent memory aggregation
Summary
Implements a new
ChunkBasedTask
class that extends CrewAI'sTask
to enable processing of large files by breaking them into chunks, analyzing each chunk sequentially, and aggregating results using agent memory. This addresses issue #3144 for sequential chunk-based analysis capabilities.Key Features:
Files Changed:
ChunkBasedTask
class insrc/crewai/tasks/chunk_based_task.py
src/crewai/__init__.py
tests/test_chunk_based_task.py
tests/test_chunk_based_task_integration.py
examples/chunk_based_analysis_example.py
Review & Testing Checklist for Human
Diagram
Notes
Implementation Details:
crew._short_term_memory
) to store intermediate results_execute_core
calls for processingTesting Coverage:
Session Info: