Integrate ProjectContainerTool in FunctionAnalyzer #1107

AmPaschal · 2025-06-11T21:36:39Z

This pull request makes the following contributions:

Creates an ADKBaseAgent containing adk-specific initializations and interactions
Integrates the ProjectContainerTool to the FunctionAnalyzer
Log interactions between the FunctionAnalyzer and the LLM

This commit includes the following tasks: - implements a function analyzer agent using the ADK library. - implements a function that gets a function's source using the FuzzIntrospector API. - Provides this function as a tool to the function analyzer agent. - Adds basic prompt templates for the agent. - Creates a test file that can be used to access the agent independently.

…nction-analyzer-main

…s-fuzz-gen into introspector-tool

…s not need to perform any operation while waiting for results from the agent.

This commit refactors the agentic workflow so that the function's source is retrieved deterministically and included in the agemt. The prompts are also more specific on what requirements should be extracted.

…s-fuzz-gen into introspector-tool

First, the context retriever agent retrieves the source code of the function and its children for analysis. Then, the requirements extractor agent

…raw result and the list of requirements. The commit also updates function_analyzer_test to process multiple benchmarks in a provided file and write the results to a results file.

…trospector-tool

…alysis result to google cloud storage.

…nalyzer to get the model name dynamically.

…z-gen into fa-alt-arch

…tion and its context are first retrieved, and passed to the agent in the prompt.

…-alt-arch

…lyzer to other agents. Modified the prototyper to consume requirements from function analyzer.

It's a bit confusing we use CHAT for both chat and ask utility functions. This changes so it's clear from the logging when each of them is used. Signed-off-by: David Korczynski <[email protected]>

This PR mainly implements a crash analyzer that can interact with LLDB in the multi-agent framework, and supports GPT. In addition, this PR attempts to fix the problem of not replacing the fuzz target and build script. This PR is under testing. The main logic is no longer changing, and minor bugs are being fixed. TODO: Optimize the process of agent interaction with LLDB. Solve the problem of missing debugging information for some projects. Try to add LLM-based static methods to enhance the crash analyzer. --------- Co-authored-by: Dongge Liu <[email protected]>

Fixing broken OSS-Fuzz projects is a common task and something we could leverage OFG to do. This adds an initial agent-based approach for doing this and it has already been used to fix google/oss-fuzz#13389 and other projects locally. ``` oss-fuzz-generator fix-build --project PROJECT_NAME --model ${MODEL} ``` --------- Signed-off-by: David Korczynski <[email protected]>

- Works better with C/CXX - Improve prompt writings - Improve OSS-Fuzz build_fuzzers/check_build validation - Improves code quality --------- Signed-off-by: David Korczynski <[email protected]>

Signed-off-by: David Korczynski <[email protected]>

…1086) Signed-off-by: David Korczynski <[email protected]>

AmPaschal · 2025-06-12T15:21:36Z

/gcbrun exp -n pamusuo -m vertex_ai_gemini-2-5-pro-chat -ag -b quick-test

AmPaschal · 2025-06-12T15:55:51Z

/gcbrun exp -n pamusuo -m vertex_ai_gemini-2-5-pro-chat -ag -b quick-test

…tegrate-pct-in-fa

AmPaschal · 2025-06-13T17:18:14Z

/gcbrun exp -n pamusuo -m vertex_ai_gemini-2-5-pro-chat -ag -b quick-test

…tegrate-pct-in-fa

AmPaschal · 2025-06-17T20:04:23Z

/gcbrun exp -n pamusuo -m vertex_ai_gemini-2-5-pro-chat -ag -b quick-test

AmPaschal · 2025-06-17T20:09:13Z

agent/base_agent.py

+      raise ValueError(f'{self.name} only supports Vertex AI models.')
+
+    # Create the agent using the ADK library
+    adk_agent = agents.LlmAgent(


@DonggeLiu I tried to make ADKBaseAgent extend both BaseAgent and LlmAgent but this did not work because both super classes had same argument name (tools) with conflicting types.

If a simple integration is not possible, we can leave this for now.
I presume function_analyzer is the only child class of ADKBaseAgent and will only communicate with other agents via Result?

Later we can think of a better way factor other agents to be based on LlmAgent, which will replace existing base agent, and make tools to be compatible with LlmAgent.

@DavidKorczynski Do you have any insight on how to better support agents using GPT?
Thanks!

I suggest landing this in its current form and then I'll follow-up with GPT implementation. Can we, however, disable this when GPT models for now? i.e. we don't want to break any workflows

…d even when function wasnt found.

AmPaschal · 2025-06-18T15:58:45Z

/gcbrun exp -n pamusuo -m vertex_ai_gemini-2-5-pro-chat -ag

…-fuzz-gen into integrate-pct-in-fa

AmPaschal · 2025-06-18T20:51:36Z

/gcbrun exp -n pamusuo -m vertex_ai_gemini-2-5-pro-chat -ag

DonggeLiu · 2025-06-19T09:50:45Z

agent/base_agent.py

+
+    self.benchmark = benchmark
+
+    # For now, ADKBaseAgents only support the Vertex AI Models.


Do you have any thoughts about how to support other AI models later?
This is important to OFG because we do want to allow users to use different LLMs transparently.

Yeah, the ADK library supports Gemini by default but has an extension that allows you to support other LLMs. I can work on adding this support.

DonggeLiu · 2025-06-19T10:44:55Z

agent/base_agent.py

+      raise ValueError(f'{self.name} only supports Vertex AI models.')
+
+    # Create the agent using the ADK library
+    adk_agent = agents.LlmAgent(


If a simple integration is not possible, we can leave this for now.
I presume function_analyzer is the only child class of ADKBaseAgent and will only communicate with other agents via Result?

Later we can think of a better way factor other agents to be based on LlmAgent, which will replace existing base agent, and make tools to be compatible with LlmAgent.

DonggeLiu · 2025-06-19T10:53:50Z

agent/function_analyzer.py

+    You are a security engineer tasked with analyzing a function
+    and extracting its input requirements,
+    necessary for it to execute correctly.
+    """


put these into a text file like other prompts, please.

FWIW I have put text prompts elsewhere in the python scripts explicitly. I find it a lot easier to work with, both when reading and writing the code. Cross-referencing becomes so much easier when you can use the IDE as opposed to tracing files around.

Hi @DonggeLiu, I have updated the code.

…tegrate-pct-in-fa

AmPaschal · 2025-06-22T19:31:20Z

/gcbrun exp -n pamusuo -m vertex_ai_gemini-2-5-pro-chat -ag

AmPaschal and others added 30 commits May 21, 2025 13:59

Resolved review comments.

16a687c

Merge branch 'main' of https://github.com/google/oss-fuzz-gen into fu…

0316104

…nction-analyzer-main

Implemented a FuzzIntrospector tool and provided to the agent.

554e5d3

Merge branch 'function-analyzer-main' of https://github.com/google/os…

fb4754c

…s-fuzz-gen into introspector-tool

Formatted code using presubmit.

fb8607d

Made the agent call synchronous. This is because the main program doe…

52a5c12

…s not need to perform any operation while waiting for results from the agent.

This commit includes the function's source in the agent's prompt.

b69f506

This commit refactors the agentic workflow so that the function's source is retrieved deterministically and included in the agemt. The prompts are also more specific on what requirements should be extracted.

Merge branch 'function-analyzer-main' of https://github.com/google/os…

381868e

…s-fuzz-gen into introspector-tool

Impleemnted the function analyzer agent as a sequential agent.

4e632c0

First, the context retriever agent retrieves the source code of the function and its children for analysis. Then, the requirements extractor agent

This commits modifies the function analyzer agent to return both the …

e82309e

…raw result and the list of requirements. The commit also updates function_analyzer_test to process multiple benchmarks in a provided file and write the results to a results file.

Merge branch 'main' of https://github.com/google/oss-fuzz-gen into in…

eadd827

…trospector-tool

Ran presubmit and fixed reported issues.

a242059

Refactored imports

47010af

Parallelize analysis of a benchmark and created a script to upload an…

4314b30

…alysis result to google cloud storage.

Upgraded function analyzer test to use 2.5 pro and updated function a…

1266603

…nalyzer to get the model name dynamically.

Merge branch 'introspector-tool' of https://github.com/google/oss-fuz…

a80b52a

…z-gen into fa-alt-arch

Implemented an alternative agentic architecture where the target func…

44e7325

…tion and its context are first retrieved, and passed to the agent in the prompt.

Merge branch 'main' of https://github.com/google/oss-fuzz-gen into fa…

97984a0

…-alt-arch

function-analyzer: Implemented flow of requirements from function ana…

69c03a3

…lyzer to other agents. Modified the prototyper to consume requirements from function analyzer.

base-agent: adjust logging (#1075)

40cbdb4

It's a bit confusing we use CHAT for both chat and ask utility functions. This changes so it's clear from the logging when each of them is used. Signed-off-by: David Korczynski <[email protected]>

build_generator: llm_agent: fix typo (#1078)

d40bfa2

build-fixer: improve capabilities (#1080)

149d47e

- Works better with C/CXX - Improve prompt writings - Improve OSS-Fuzz build_fuzzers/check_build validation - Improves code quality --------- Signed-off-by: David Korczynski <[email protected]>

build-fixer: add simple build output truncation (#1082)

98a7a02

Signed-off-by: David Korczynski <[email protected]>

build-fixer: fix template creation (#1083)

9695911

Signed-off-by: David Korczynski <[email protected]>

build-fixer: add function tool based flow (#1084)

893edc5

Signed-off-by: David Korczynski <[email protected]>

models: add gpt-4.1 and minor build-fixer fix (#1085)

f852534

Signed-off-by: David Korczynski <[email protected]>

build-fixer: add tool for building both Dockerfile and build script (#…

b4934ab

…1086) Signed-off-by: David Korczynski <[email protected]>

Fix error in FunctionAnalyzer

671b8c6

AmPaschal added 4 commits June 13, 2025 15:41

Updated the way tool interactions, using the ADKBaseAgent, are logged.

dd35173

Presubmit fixes

ba1cb93

Merge branch 'main' of https://github.com/google/oss-fuzz-gen into in…

2c34ef4

…tegrate-pct-in-fa

Fix error from pulling main

c65ccad

AmPaschal and others added 2 commits June 17, 2025 20:02

Merge branch 'main' of https://github.com/google/oss-fuzz-gen into in…

be7701f

…tegrate-pct-in-fa

Merge branch 'main' into integrate-pct-in-fa

e635f59

AmPaschal marked this pull request as ready for review June 17, 2025 20:03

AmPaschal requested review from DonggeLiu and DavidKorczynski and removed request for DonggeLiu June 17, 2025 20:04

AmPaschal commented Jun 17, 2025

View reviewed changes

AmPaschal added 2 commits June 17, 2025 21:27

Refactored get_function_implementation tool so tool response is logge…

df628f5

…d even when function wasnt found.

Presubmit fixes

b7f4914

AmPaschal added 3 commits June 18, 2025 20:40

Use ephemeral temporary storage when downloading temporary files.

ee2438c

Presubmit fixes

c027061

Merge branch 'fix-excessive-storage' of https://github.com/google/oss…

41b841a

…-fuzz-gen into integrate-pct-in-fa

Merge branch 'main' into integrate-pct-in-fa

faebc3c

DonggeLiu reviewed Jun 19, 2025

View reviewed changes

AmPaschal added 3 commits June 22, 2025 19:08

Merge branch 'main' of https://github.com/google/oss-fuzz-gen into in…

4729411

…tegrate-pct-in-fa

Extracted description and instruction to separate files.

7b10f6b

Presubmit fixes

f831530


		self.benchmark = benchmark

		# For now, ADKBaseAgents only support the Vertex AI Models.

Integrate ProjectContainerTool in FunctionAnalyzer #1107

Are you sure you want to change the base?

Integrate ProjectContainerTool in FunctionAnalyzer #1107

Uh oh!

Conversation

AmPaschal commented Jun 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

AmPaschal commented Jun 12, 2025

Uh oh!

AmPaschal commented Jun 12, 2025

Uh oh!

AmPaschal commented Jun 13, 2025

Uh oh!

AmPaschal commented Jun 17, 2025

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

AmPaschal commented Jun 18, 2025

Uh oh!

AmPaschal commented Jun 18, 2025

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

AmPaschal commented Jun 22, 2025

Uh oh!

Uh oh!

AmPaschal commented Jun 11, 2025 •

edited

Loading