namespace problem in the SoapParser of Core #210

epicureanism · 2017-02-28T08:02:50Z

We have a simple SOS 2.0 test via SOAP, the testing endpoints and request body were saved as the POSTMAN collection which can be imported to see the req/res body:
https://www.getpostman.com/collections/e72b39d08ff37f1e4e0b

This problem was originally produced from
SOS 2.0 Test Suite GetObservation-Test fail for SOAP.
After some detail investigations, this problem might be redirected to the SoapParser which can't handle the inline namespace declaration.

The response body can be validated using other tools without any problem.
But the teamegine reports there is an error for the unrecognized namespace which was defined inline in the soap body, the response is like the following image:
https://github.com/opengeospatial/ets-sos20/blob/master/src/site/resources/img/soap-response-error-desc.png
the xml as well:
https://raw.githubusercontent.com/opengeospatial/ets-sos20/master/src/main/resources/sos-soap-response-demo.xml

The gml namespace was declared in line 6 and again in the om:result (line 26), but in line 28, the namespace was ignored by the SoapParser which causes the error.
In the other hand, the XmlValidatingParser works well without the same problem if there is no Soap wrapper for the response body. So we think it might be the problem from the SoapParser.

keshavnangare · 2017-03-03T15:09:46Z

@epicureanism

Thanks for reporting this issue.

Can you please provide us capability URL to reproduce this issue.

I have tried with the following URL:

http://sensorweb.demo.52north.org/52n-sos-webapp/service/kvp

But it failing immediately with soap request. It would be great if you provide us steps to reproduce this issue.

I have a query with the following screenshots:

Thank you.

keshavnangare · 2017-03-07T12:36:27Z

@epicureanism

I have executed the sos20 test with the following capability URL:

http://sensorweb.demo.52north.org/52n-sos-webapp/service?service=SOS&request=GetCapabilities&AcceptVersions=2.0.0

The SOS test failing with the two tests. TestResult

1. sos:GRTRequestValidRequest_resultRetrieval

Cause: The prefix (soap12) is not able to resolve from the XPath and not able to get the expected value.
If you observed the below request and response, it has the different prefix, prefix in XPath is soap12 and in response "soap" that's why the XPath is not able to get that value.

XPath:

<xsl:variable name="responseRoot" select="local-name-from-QName(node-name($GetResultTemplateResponse/*[1]))" />
<xsl:variable name="responseRoot2" select="local-name-from-QName(node-name($GetResultTemplateResponse/soap12:Envelope/soap12:Body/*[1]))" />

SOAP request: 
<soap-env:Envelope xmlns:soap-env="http://www.w3.org/2003/05/soap-envelope">
  <soap-env:Body>
  <sos:GetResultTemplate xmlns:sos="http://www.opengis.net/sos/2.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" service="SOS" version="2.0.0" xsi:schemaLocation="http://www.opengis.net/sos/2.0 http://schemas.opengis.net/sos/2.0.0/sos.xsd">
  <sos:offering>http://www.52north.org/test/offering/1</sos:offering>
  <sos:observedProperty>http://www.52north.org/test/observableProperty/1</sos:observedProperty>
  </sos:GetResultTemplate>
  </soap-env:Body>
</soap-env:Envelope>

Response:

<soap:Envelope xmlns:soap="http://www.w3.org/2003/05/soap-envelope" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:ows="http://www.opengis.net/ows/1.1" xsi:schemaLocation="http://www.opengis.net/ows/1.1 http://schemas.opengis.net/ows/1.1.0/owsExceptionReport.xsd http://www.w3.org/2003/05/soap-envelope http://www.w3.org/2003/05/soap-envelope">
  <soap:Header/>
  <soap:Body>
  <soap:Fault>
  <soap:Code>
  <soap:Value>soap:Sender</soap:Value>
  <soap:Subcode>
  <soap:Value xmlns:ns="http://www.opengis.net/ows/1.1">ns:InvalidPropertyOfferingCombination</soap:Value>
  </soap:Subcode>
  </soap:Code>
  <soap:Reason>
  <soap:Text xml:lang="en">Observations for the requested combination of observedProperty and offering do not use SWE Common encoded results.</soap:Text>
  </soap:Reason>
  <soap:Detail>
  <ows:Exception exceptionCode="InvalidPropertyOfferingCombination">
  <ows:ExceptionText>For the requested combination offering (http://www.52north.org/test/offering/1) and observedProperty (http://www.52north.org/test/observableProperty/1) no SWE Common 2.0 encoded result values are available!</ows:ExceptionText>
  </ows:Exception>
  </soap:Detail>
  </soap:Fault>
  </soap:Body>
</soap:Envelope>

sos:GOBIRequestValidRequest_obsByIdRetrieval

Cause: This test failed due to the ows:parameter[name="Observation"] did not have the expected child nodes "ows:AllowedValues/ows:Value[1]"

XPath: "$getCapabilitiesResponse//ows:OperationsMetadata/ows:Operation[@name='GetObservationById']/ows:Parameter[@name='observation']/ows:AllowedValues/ows:Value[1]"

Request:

<sos:GetCapabilities service="SOS" xmlns:sos="http://www.opengis.net/sos/2.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
	xsi:schemaLocation="http://www.w3.org/2003/05/soap-envelope http://www.w3.org/2003/05/soap-envelope/soap-envelope.xsd 
	http://www.opengis.net/sos/2.0 http://schemas.opengis.net/sos/2.0/sos.xsd"
	xmlns:soap12="http://www.w3.org/2003/05/soap-envelope" >
</sos:GetCapabilities>

Response with highlighted part:

Only two tests are failing but I am not able to reproduce the same issue that you have reported. It will be great if you provide steps to reproduce this issue, so we can figure out the exact issue

let me know your thought on above test failures.

Thank you!!!

epicureanism · 2017-03-08T09:12:40Z

@keshav-nangare
Thanks for your help. Here are some details about this test.

Endpoint:
http://sensorweb.demo.52north.org/52n-sos-webapp/sos/soap
Request Body:

<?xml version="1.0" encoding="UTF-8"?>
<env:Envelope
	xmlns:ns="http://www.opengis.net/gml/3.2"
    xmlns:env="http://www.w3.org/2003/05/soap-envelope"
    xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    xsi:schemaLocation="http://www.w3.org/2003/05/soap-envelope http://www.w3.org/2003/05/soap-envelope/soap-envelope.xsd">
    <env:Body>
<sos:GetObservation service="SOS" version="2.0.0" xmlns:sos="http://www.opengis.net/sos/2.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
    xsi:schemaLocation="http://www.w3.org/2003/05/soap-envelope http://www.w3.org/2003/05/soap-envelope/soap-envelope.xsd 
    http://www.opengis.net/sos/2.0 http://schemas.opengis.net/sos/2.0/sos.xsd"
    xmlns:soap12="http://www.w3.org/2003/05/soap-envelope" ></sos:GetObservation>      
</env:Body>
</env:Envelope>

Response Body:

<?xml version="1.0" encoding="UTF-8"?>
<sos:GetObservationResponse 
    xmlns:sos="http://www.opengis.net/sos/2.0" 
    xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" 
    xmlns:om="http://www.opengis.net/om/2.0" 
    xmlns:gml="http://www.opengis.net/gml/3.2" 
    xmlns:xlink="http://www.w3.org/1999/xlink" xsi:schemaLocation="http://www.opengis.net/sos/2.0 http://schemas.opengis.net/sos/2.0/sosGetObservation.xsd http://www.opengis.net/gml/3.2 http://schemas.opengis.net/gml/3.2.1/gml.xsd http://www.opengis.net/om/2.0 http://schemas.opengis.net/om/2.0/observation.xsd">
    <sos:observationData>
        <om:OM_Observation gml:id="o_119F914A8F8F1E1F6025756E9F3D63BBBA50AA9E">
            <om:type xlink:href="http://www.opengis.net/def/observationType/OGC-OM/2.0/OM_CountObservation"/>
            <om:phenomenonTime>
                <gml:TimeInstant gml:id="phenomenonTime_442">
                    <gml:timePosition>2016-11-19T17:45:15.000Z</gml:timePosition>
                </gml:TimeInstant>
            </om:phenomenonTime>
            <om:resultTime xlink:href="#phenomenonTime_442"/>
            <om:procedure xlink:href="http://www.52north.org/test/procedure/9"/>
            <om:observedProperty xlink:href="http://www.52north.org/test/observableProperty/9_2"/>
            <om:featureOfInterest xlink:href="http://www.52north.org/test/featureOfInterest/9"/>
            <om:result 
                xmlns:xs="http://www.w3.org/2001/XMLSchema" xsi:type="xs:integer">3
            </om:result>
        </om:OM_Observation>
    </sos:observationData>
    <sos:observationData>
        <om:OM_Observation gml:id="o_4BB6C4F47B7985BE4144BA98AECB84014AF92826">
            <om:phenomenonTime>
                <gml:TimeInstant gml:id="phenomenonTime_441">
                    <gml:timePosition>2012-11-19T17:45:15.000Z</gml:timePosition>
                </gml:TimeInstant>
            </om:phenomenonTime>
            <om:resultTime xlink:href="#phenomenonTime_441"/>
            <om:procedure xlink:href="http://www.52north.org/test/procedure/9"/>
            <om:observedProperty xlink:href="http://www.52north.org/test/observableProperty/9_2"/>
            <om:featureOfInterest xlink:href="http://www.52north.org/test/featureOfInterest/9"/>
            <om:result 
                xmlns:xs="http://www.w3.org/2001/XMLSchema" xsi:type="xs:integer">3
            </om:result>
        </om:OM_Observation>
    </sos:observationData>
    <sos:observationData>
        <om:OM_Observation gml:id="o_5C2D4B29FDA1639D63152D9B91F5AB1120BFB739">
            <gml:description>test description for this observation</gml:description>
            <gml:identifier codeSpace="http://www.opengis.net/def/nil/OGC/0/unknown">http:/www.tsuruoka-nct.ac.jp/test/observation/0</gml:identifier>
            <om:type xlink:href="http://www.opengis.net/def/observationType/OGC-OM/2.0/OM_Measurement"/>
            <om:phenomenonTime>
                <gml:TimeInstant gml:id="phenomenonTime_430">
                    <gml:timePosition>2012-11-19T17:45:15.000Z</gml:timePosition>
                </gml:TimeInstant>
            </om:phenomenonTime>
            <om:resultTime xlink:href="#phenomenonTime_430"/>
            <om:procedure xlink:href="http://www.tsuruoka-nct.ac.jp/test/procedure/0"/>
            <om:observedProperty xlink:href="http://www.tsuruoka-nct.ac.jp/test/observableProperty/Temperature"/>
            <om:featureOfInterest xlink:href="http://www.52north.org/test/featureOfInterest/9"/>
            <om:result 
                xmlns:ns="http://www.opengis.net/gml/3.2" uom="test_unit_9_3" xsi:type="ns:MeasureType">0.28
            </om:result>
        </om:OM_Observation>
    </sos:observationData>
</sos:GetObservationResponse>

Other Ref:
screenshots using TestNG:

keshavnangare · 2017-03-08T12:04:44Z

@epicureanism Thanks for the details.

I will try to reproduce this issue.

bermud · 2017-03-09T12:58:40Z

@keshav-nangare, The response body is valid. We might need to find where in TE the validation is occurring for further debugging. Is the ns:MeasureType that is causing the problem.

<om:result xmlns:ns="http://www.opengis.net/gml/3.2" uom="test_unit_9_3" xsi:type="ns:MeasureType">0.28 </om:result>

dstenger · 2018-04-04T08:32:32Z

@keshav-nangare Can you please do further investigation?

keshavnangare · 2018-04-24T12:35:00Z

@dstenger

I did some workaround and found the root cause. This issue is occurring due to the schema document of the SoapParser.
The SoapParser is using the schema documentation i.e. teamengine-resources/schema/soap12.xsd.

The response is validated with the soap12.xsd and we get the following error:

Validation error:&#xD;
  cvc-elt.4.2: Cannot resolve 'ns:MeasureType' to a type definition for element 'om:result'.&#xD;

dstenger · 2018-04-24T15:05:59Z

@keshav-nangare
Did you validate the response documented in #210 (comment)?
Actually, the error cannot derive from SOAP schema and the response of the comment is valid.

As epicureanism already describes in the first comment, the error probably derives from SoapParser not being able to handle the inline namespace declaration.

In this case, the ns prefix is not recognized as GML namespace.

keshavnangare · 2018-04-24T15:53:48Z

Yes. I have validated the response and succeded but if we try to validate with the SoapParser schema then the ns prefix error is getting.

Here is the SoapParserSchema

ghobona · 2021-01-20T11:11:22Z

MeasureType is defined in basicTypes.xsd.

The SOAP Envelope example imports gml.xsd. However, gml.xsd does not include basicTypes.xsd. That is what is causing the error.

The solution is to import gmlBase.xsd because it includes both basicTypes.xsd and gml.xsd.

dstenger · 2021-01-27T09:51:00Z

@keshav-nangare Please replace http://schemas.opengis.net/gml/3.2.1/gml.xsd with http://schemas.opengis.net/gml/3.2.1/basicTypes.xsd in the test file (https://raw.githubusercontent.com/opengeospatial/ets-sos20/master/src/main/resources/sos-soap-response-demo.xml) and check if it passes the test suite, then.

keshavnangare · 2021-02-04T11:39:08Z

I implemented the JUnit test for SoapParser and tried with the above comment variations but it is still failing with the same validation error mentioned in the comment.

keshavnangare · 2021-04-07T11:51:26Z

I have added the JUnit test for SoapParser. Please find the changes in #467 PR.

bermud assigned keshavnangare Mar 1, 2017

bermud added the in-investigation label Mar 2, 2017

bermud added waiting and removed in-investigation labels Mar 7, 2017

dstenger added status:waiting and removed waiting labels Oct 17, 2017

dstenger added status:in-progress and removed status:waiting labels Apr 4, 2018

dstenger assigned dstenger and lgoltz Apr 25, 2018

keshavnangare removed their assignment Apr 26, 2018

dstenger removed the status:in-progress label Jun 6, 2019

dstenger assigned keshavnangare and unassigned dstenger and lgoltz Mar 18, 2020

dstenger assigned dstenger and ghobona Apr 29, 2020

dstenger unassigned dstenger and ghobona Oct 7, 2020

dstenger mentioned this issue Oct 14, 2020

SOS 2.0 Test Suite GetObservation-Test fail for SOAP opengeospatial/ets-sos20#2

Closed

keshavnangare linked a pull request Apr 7, 2021 that will close this issue

Added JUnit test for SoapParser. #467

Draft

keshavnangare mentioned this issue Apr 7, 2021

@keshav-nangare transition plan opengeospatial/cite#58

Closed

3 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

namespace problem in the SoapParser of Core #210

namespace problem in the SoapParser of Core #210

epicureanism commented Feb 28, 2017 •

edited by bermud

Loading

keshavnangare commented Mar 3, 2017

keshavnangare commented Mar 7, 2017

epicureanism commented Mar 8, 2017

keshavnangare commented Mar 8, 2017

bermud commented Mar 9, 2017

dstenger commented Apr 4, 2018

keshavnangare commented Apr 24, 2018

dstenger commented Apr 24, 2018

keshavnangare commented Apr 24, 2018

ghobona commented Jan 20, 2021

dstenger commented Jan 27, 2021 •

edited

Loading

keshavnangare commented Feb 4, 2021

keshavnangare commented Apr 7, 2021

namespace problem in the SoapParser of Core #210

namespace problem in the SoapParser of Core #210

Comments

epicureanism commented Feb 28, 2017 • edited by bermud Loading

keshavnangare commented Mar 3, 2017

keshavnangare commented Mar 7, 2017

epicureanism commented Mar 8, 2017

keshavnangare commented Mar 8, 2017

bermud commented Mar 9, 2017

dstenger commented Apr 4, 2018

keshavnangare commented Apr 24, 2018

dstenger commented Apr 24, 2018

keshavnangare commented Apr 24, 2018

ghobona commented Jan 20, 2021

dstenger commented Jan 27, 2021 • edited Loading

keshavnangare commented Feb 4, 2021

keshavnangare commented Apr 7, 2021

epicureanism commented Feb 28, 2017 •

edited by bermud

Loading

dstenger commented Jan 27, 2021 •

edited

Loading