From 4964e822d7d4265d3509a2f2bb9979912f3f4539 Mon Sep 17 00:00:00 2001 From: Sangith Ravichandran <119392848+sangithravichandran@users.noreply.github.com> Date: Wed, 7 Aug 2024 07:34:35 +0530 Subject: [PATCH] Updated Custom PDF Report Generation and Debugging Mobile Applications Docs (#478) --- .../debugging/results-on-local-devices.md | 12 +- .../docs/reports/runs/custom-pdf-report.md | 321 +++++++++++++++++- 2 files changed, 319 insertions(+), 14 deletions(-) diff --git a/src/pages/docs/debugging/results-on-local-devices.md b/src/pages/docs/debugging/results-on-local-devices.md index 0984055a..c1d5aec3 100644 --- a/src/pages/docs/debugging/results-on-local-devices.md +++ b/src/pages/docs/debugging/results-on-local-devices.md @@ -58,7 +58,7 @@ Before starting the debugging process, ensure the following: - Enable the **Run till Failed** step toggle to execute the test steps until a specific step fails. If this toggle is disabled, the test case will execute from start to end. - Set a debug point by selecting a test step from the dropdown menu. - Select **External Path** and provide the application's publicly accessible URL or **Uploaded Apps** and select the application from uploaded apps in Testsigma. -4. Click **Debug Now** to start the debugging process. The debugger screen will open, showing the test steps, related information, and the device screen. +4. Click **Debug Now** to start the debugging process. The debugger screen will open, showing the test steps, related information, and the device screen. ![launch debug mode on android or ios devices](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/applications/running_debugging_on-android_or_ios_device.gif) --- @@ -78,14 +78,14 @@ Debug points are specific locations in your test steps where you want the execut When the execution pauses at a debug point, you can perform the following actions: - **Resume Execution**: Continue the test execution from the paused point. - **Run This Step**: Execute the current step immediately. -- **Step Over:** Skip the current step and move to the next one. +- **Step Over:** Skip the current step and move to the next one. ![interacting with debug points during mobile debugging](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/applications/interacting_with_debug_points_during_mobile_debugging.png) --- -## *Inspecting Test Execution Details on Mobile** +## **Inspecting Test Execution Details on Mobile** - **Add Source**: When you reach a debug point, the **Add Source** section provides information about the test step's source code, allowing you to understand the context and behavior of the code being executed. -- **Selected Element**: In the **Selected Element** section, view details about the UI elements involved in the test step. This includes properties and attributes that are crucial for debugging element-related issues. +- **Selected Element Details**: In the **Selected Element** section, view details about the UI elements involved in the test step. This includes properties and attributes that are crucial for debugging element-related issues. - **Step Result**: The **Step Result** section shows the outcome of the test step, including pass/fail status and any associated error messages. This information helps diagnose issues and verify whether the test step has behaved as expected. --- @@ -94,7 +94,7 @@ When the execution pauses at a debug point, you can perform the following action During test case execution, you can visually follow each step. If an error occurs or a debug point is reached: - Testsigma will highlight the problematic step. -- Use the provided resources, including Add Source, Selected Element, and Step Result, to analyze the issue and determine the necessary fixes. +- Use the provided resources, including Add Source, Selected Element, and Step Result, to analyze the issue and determine the necessary fixes. ![identifying errors during mobile test case execution](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/applications/identifying_mobile_test_case_execution.gif) --- @@ -103,7 +103,7 @@ During test case execution, you can visually follow each step. If an error occur A common issue is the **Element Not Found** error, where an element visible on the device is reported as not found. To address this: 1. View the message for the test step. If the element is not found, click **Element** to view its properties. -2. Analyze the issue, update the element properties if needed, then click **Options** and select **Resume Execution** from the previously paused step. +2. Analyze the issue, update the element properties if needed, then click **Options** and select **Resume Execution** from the previously paused step. ![troubleshooting element not found error on mobile devices](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/applications/troubleshooting_element_not_found_error_on_mobile_devices.gif) --- diff --git a/src/pages/docs/reports/runs/custom-pdf-report.md b/src/pages/docs/reports/runs/custom-pdf-report.md index ce6755eb..acf68345 100644 --- a/src/pages/docs/reports/runs/custom-pdf-report.md +++ b/src/pages/docs/reports/runs/custom-pdf-report.md @@ -17,8 +17,11 @@ contextual_links: name: "Retrieving Result IDs" url: "#retrieving-result-ids" - type: link - name: "Executing the JAR File" - url: "#executing-the-jar-file" + name: "Executing Custom PDF Report for Test Plans" + url: "#executing-the-jar-file-for-test-plans" +- type: link + name: "Executing Custom PDF Report for Test Case, Test Suite, or Test Machine Level" + url: "#executing-custom-pdf-report-for-test-case-test-suite-or-test-machine-level" - type: link name: "Using Preferences to Generate Custom PDF Report" url: "#using-preferences-to-generate-custom-pdf-report" @@ -38,18 +41,296 @@ Custom PDF Report Generator in Testsigma allows you to create detailed and custo Before you begin, ensure you have the following: - An [API Key ](https://testsigma.com/docs/reports/runs/filter-custom-reports/) from your Testsigma account. -- An HTML template for the PDF report. -- Java 17 or a newer version installed on your system. -- The JAR file from Testsigma Customer Support. +- **Java 17** or a newer version installed on your system. +- You can request the **JAR file** from the Customer Support team and download it before executing a Custom PDF Report Generation. +- An **HTML template** for the PDF report. + +
+ + ℹ️Example HTML Template + +
+ + + + + + + + + + Company Logo +
+ Full Size Image +
+

EXECUTIVE

+

REPORT

+
+
+ +
+ +

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Name
Executed By
Environment
Test Plan
Test Device
Test Suite
Result
Build No
Run ID + + +
Screenshot captured for
Screenshot mode
+
+
+ +
+

OVERALL SUMMARY

+ Chart Image +
+ +
+ +
+ +

TEST CASES LIST

+ + + + + + + + + + + + + + + + + +
ResultTest CaseTest SuiteTest MachineAssigneeReviewer
+ Result + + + +
+ +
+ +
+

SUPPORT

+ + + + + +
For any assistance, contact: + support@example.com
+ Phone: 123-456-7890 +
+
+ + + +
+
--- ## **Retrieving Result IDs** -To retrieve the Run ID from a run result: +To generate reports, you need specific IDs depending on the level of detail you want: 1. Navigate to the **Run Result** from which you want to retrieve the Run ID. -2. For **test plan** level reports, use the **Run ID** from the RunResult page or **URL endpoint**. ![retrieving runid for test plan level](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/applications/testplan_run_id.cpr.gif) +2. For **test plan** level reports, Use the Run ID directly from the Run Result page. You can find this in the Execution ID or the URL endpoint. Copy the Run ID from the Run Result page. ![retrieving runid for test plan level](https://s3.amazonaws.com/static-docs.testsigma.com/new_images/projects/applications/testplan_run_id.cpr.gif) 3. For Test Machine, Test Suite, or Test Case level reports: - Right-click on the page and select **Inspect** to open Developer Tools. - Go to the **Network** tab. @@ -59,13 +340,37 @@ To retrieve the Run ID from a run result: --- -## **Executing the JAR File** +## **Executing the JAR File for Test Plans** Run the Custom Report Generator with the required inputs to create a PDF report. This step converts your HTML template into a PDF based on your preferences. To execute the JAR file, follow these steps: 1. Open Terminal or Command Prompt and navigate to the folder containing the JAR file. 2. Run the following command, replacing the placeholders with your actual values: ```bash +java -jar custom_pdf_generator-0.0.1-SNAPSHOT.jar \ + --config.apiKey=YOUR-API-KEY \ + --config.plan.runId=YOUR-PLAN-RUN-ID \ + --config.template.location=/path/to/your/template.html \ + --config.pdf.directory=/path/to/save/report.pdf +``` + +
+Replace the placeholders with your actual values: + +- **YOUR-API-KEY**: Your API key for authentication with Testsigma. +- **YOUR-PLAN-RUN-ID**: The run ID of your test plan. +- **/path/to/your/template.html**: Path to your HTML template file. +- **/path/to/save/report.pdf**: Location where the generated PDF report will be saved. + +--- + +## **Executing Custom PDF Report for Test Case, Test Suite, or Test Machine Level** + +Generate reports at the Test Case, Test Suite, or Test Machine level by following these steps:: + +1. Get the Run ID as explained in the [Retrieving Result IDs](https://testsigma.com/docs/reports/runs/custom-pdf-report/#retrieving-result-ids) section. +2. Use the following command, including your specific preferences: +```bash java -jar custom_pdf_generator-0.0.1-SNAPSHOT.jar \ --config.apiKey=YOUR-API-KEY \ --config.plan.runId=YOUR-PLAN-RUN-ID \