Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hardcoded "-Jjmeter.save.saveservice.assertion_results_failure_message=false" setting #15

Open
psongit opened this issue Sep 7, 2021 · 0 comments

Comments

@psongit
Copy link

psongit commented Sep 7, 2021

We are trying to override the setting jmeter.save.saveservice.assertion_results_failure_message=True, from jmeter-bzt.properties file, but we feel this setting is hardcoded in the command line

jmeterTool.arg(["-Jjmeter.save.saveservice.assertion_results_failure_message=false"]);

So, the value in the jmeter-bzt.properties is not respected?

Is there any reason this is hard coded as part of the arguments?

We want this to be set to True so that the report output kpi.jtl is compatible in one of our report processing tools. To make it compatible we want these columns in the CSV file

elapsed
label
responseCode
responseMessage
threadName
dataType
success
failureMessage
bytes
sentBytes
grpThreads
allThreads
URL
Latency
IdleTime
Connect
Hostname

Currently we are getting this error when the report is getting generated.

/opt/hostedtoolcache/jmeter-2e0f0d9b2a6ddba2b87ef4b69c1d7255f50b3840/5.4.0/x64/apache-jmeter-5.4/bin/jmeter -Jjmeter.save.saveservice.assertion_results_failure_message=false -g taurus-output/kpi.jtl -o taurus-output/report -q taurus-output/jmeter-bzt.properties
An error occurred: Error while processing samples: Consumer failed with message :Consumer failed with message :Consumer failed with message :Consumer failed with message :Consumer failed with message :No column <failureMessage> found in sample metadata <timeStamp,elapsed,label,responseCode,responseMessage,threadName,success,bytes,grpThreads,allThreads,Latency,Hostname,Connect>, check #jmeter.save.saveservice.* properties to add the missing column
##[warning]JMeter report generation failed.

We also tried setting all the properties through the Task "TaurusRunner@0" argument as follows

taurusArguments: '-o jmeter.save.saveservice.output_format=csv -o jmeter.save.saveservice.assertion_results_failure_message=true -o jmeter.save.saveservice.assertion_results=none -o jmeter.save.saveservice.data_type=true -o jmeter.save.saveservice.label=true -o jmeter.save.saveservice.response_code=true -o jmeter.save.saveservice.response_data=false -o jmeter.save.saveservice.response_data.on_error=true -o jmeter.save.saveservice.response_message=false -o jmeter.save.saveservice.successful=true -o jmeter.save.saveservice.thread_name=true -o jmeter.save.saveservice.time=true -o jmeter.save.saveservice.subresults=true -o jmeter.save.saveservice.assertions=true -o jmeter.save.saveservice.latency=true -o jmeter.save.saveservice.samplerData=true -o jmeter.save.saveservice.responseHeaders=true -o jmeter.save.saveservice.requestHeaders=true -o jmeter.save.saveservice.encoding=true -o jmeter.save.saveservice.bytes=true -o jmeter.save.saveservice.sent_bytes=true -o jmeter.save.saveservice.url=true -o jmeter.save.saveservice.hostname=true -o jmeter.save.saveservice.thread_counts=true -o jmeter.save.saveservice.sample_count=true -o jmeter.save.saveservice.idle_time=true -o jmeter.save.saveservice.timestamp_format=ms'

now it fails with the following error

Starting: Run performance tests
==============================================================================
Task         : Taurus tool runner
Description  : Run Taurus (JMeter)
Version      : 0.1.1622402523
Author       : Alexandre Gattiker
Help         : [Learn more about this task](https://aka.ms/custom-jmeter-tasks)
==============================================================================
/usr/local/bin/bzt -o settings.artifacts-dir=taurus-output -o modules.jmeter.path=/opt/hostedtoolcache/jmeter-2e0f0d9b2a6ddba2b87ef4b69c1d7255f50b3840/5.4.0/x64/apache-jmeter-5.4 -o modules.jmeter.version=5.4 -o jmeter.save.saveservice.output_format=csv -o jmeter.save.saveservice.assertion_results_failure_message=true -o jmeter.save.saveservice.assertion_results=none -o jmeter.save.saveservice.data_type=true -o jmeter.save.saveservice.label=true -o jmeter.save.saveservice.response_code=true -o jmeter.save.saveservice.response_data=false -o jmeter.save.saveservice.response_data.on_error=true -o jmeter.save.saveservice.response_message=false -o jmeter.save.saveservice.successful=true -o jmeter.save.saveservice.thread_name=true -o jmeter.save.saveservice.time=true -o jmeter.save.saveservice.subresults=true -o jmeter.save.saveservice.assertions=true -o jmeter.save.saveservice.latency=true -o jmeter.save.saveservice.samplerData=true -o jmeter.save.saveservice.responseHeaders=true -o jmeter.save.saveservice.requestHeaders=true -o jmeter.save.saveservice.encoding=true -o jmeter.save.saveservice.bytes=true -o jmeter.save.saveservice.sent_bytes=true -o jmeter.save.saveservice.url=true -o jmeter.save.saveservice.hostname=true -o jmeter.save.saveservice.thread_counts=true -o jmeter.save.saveservice.sample_count=true -o jmeter.save.saveservice.idle_time=true -o jmeter.save.saveservice.timestamp_format=ms /home/vsts/work/_temp/d743681c-3136-4dfb-8815-74b0ef5f1cec/task.yml
08:28:50 INFO: Taurus CLI Tool v1.15.4
08:28:50 INFO: No personal config found, creating one at /home/vsts/.bzt-rc
08:28:50 INFO: Starting with configs: ['/home/vsts/work/_temp/d743681c-3136-4dfb-8815-74b0ef5f1cec/task.yml', '/home/vsts/.bzt-rc']
08:28:50 INFO: Configuring...
08:28:51 ERROR: Failed to apply override jmeter.save.saveservice.response_data.on_error=true
08:28:51 ERROR: TypeError: 'bool' object does not support item assignment
  File "/usr/local/lib/python3.8/dist-packages/bzt/cli.py", line 270, in perform
    self.__configure(configs)
  File "/usr/local/lib/python3.8/dist-packages/bzt/cli.py", line 194, in __configure
    overrider.apply_overrides(self.options.option, self.engine.config)
  File "/usr/local/lib/python3.8/dist-packages/bzt/cli.py", line 504, in apply_overrides
    self.__apply_single_override(dest, name, value)
  File "/usr/local/lib/python3.8/dist-packages/bzt/cli.py", line 581, in __apply_single_override
    pointer[parts[-1]] = parsed_value
08:28:51 INFO: Post-processing...
08:28:51 INFO: Artifacts dir: None
08:28:51 INFO: Log file: /tmp/bzt_djk1jhfq.log
08:28:51 WARNING: Done performing with code: 1
##[error]Error: Taurus run failed.
Finishing: Run performance tests
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant