BESDUI Results for ...

This document reports the results for the BESDUI benchmark for the LINK tool.

Summary

TOOLNAME	Capability	K (0.2s)	P (1.1s)	H (0.4s)	Operator Count	Time
Task 1	0%-100%	x	y	z	n	0.0
Task 2	0%-100%	x	y	z	n	0.0
Task 3	0%-100%	x	y	z	n	0.0
Task 4	0%-100%	x	y	z	n	0.0
Task 5	0%-100%	x	y	z	n	0.0
Task 6	0%-100%	x	y	z	n	0.0
Task 7	0%-100%	x	y	z	n	0.0
Task 8	0%-100%	x	y	z	n	0.0
Task 9	0%-100%	x	y	z	n	0.0
Task 10	0%-100%	x	y	z	n	0.0
Task 11	0%-100%	x	y	z	n	0.0
Task 12	0%-100%	x	y	z	n	0.0
SUM		X	Y	Z	N	0.0
AVERAGE	50%	0.0	0.0	0.0	0.0	0.0

Results per Task

Task 1. Find products for a given set of features combined

"Look for products of type sheeny with product features stroboscopes and gadgeteers, and a productPropertyNumeric1 greater than 450".

Not capable of completing the task (Why?)

OR

Interaction Steps	K	P	H
1. ...	x	y	z
2. ...	x	y	z
3. ...	x	y	z
4. ...	x	y	z
Total Operators	X	Y	Z
Time	T

Task 2. Find products for a given set of alternative features

"List products of type sheeny with product features stroboscopes OR gadgeteers, and a productPropertyNumeric1 greater than 450".

Not capable of completing the task (Why?)

OR

Interaction Steps	K	P	H
1. ...	x	y	z
2. ...	x	y	z
3. ...	x	y	z
4. ...	x	y	z
Total Operators	X	Y	Z
Time	T

Task 3. Retrieve basic information about a specific product for display purposes

"Get details about product boozed".

Not capable of completing the task (Why?)

OR

Interaction Steps	K	P	H
1. ...	x	y	z
2. ...	x	y	z
3. ...	x	y	z
4. ...	x	y	z
Total Operators	X	Y	Z
Time	T

Task 4. Find products having some specific features and not having one feature

"Look for products of type sheeny with product features stroboscopes but NOT gadgeteers, and productPropertyNumeric1 value greater than 300 and productPropertyNumeric3 smaller than 400".

Not capable of completing the task (Why?)

OR

Interaction Steps	K	P	H
1. ...	x	y	z
2. ...	x	y	z
3. ...	x	y	z
4. ...	x	y	z
Total Operators	X	Y	Z
Time	Y

Task 5. Find products matching two different sets of features

"Look for products of type sheeny with product features stroboscopes and gadgeteers and a productPropertyNumeric1 value greater than 300 plus those of the same product type with product features stroboscopes and rotifers and a productPropertyNumeric2 greater than 400".

Not capable of completing the task (Why?)

OR

Interaction Steps	K	P	H
1. ...	x	y	z
2. ...	x	y	z
3. ...	x	y	z
4. ...	x	y	z
Total Operators	X	Y	Z
Time	T

Task 6. Find products that are similar to a given product

"Look for products similar to boozed, with at least one shared feature, and a productPropertyNumeric1 value between 427 and 627 (100 more or less than its value for boozed, 527) and a productPropertyNumeric2 value between 545 and 945 (200 more or less than its value for boozed, 745)".

Not capable of completing the task (Why?)

OR

Interaction Steps	K	P	H
1. ...	x	y	z
2. ...	x	y	z
3. ...	x	y	z
4. ...	x	y	z
Total Operators	X	Y	Z
Time	T

Task 7. Find products having a name that contains some text

"Search products whose name contains ales".

Not capable of completing the task (Why?)

OR

Interaction Steps	K	P	H
1. ...	x	y	z
2. ...	x	y	z
3. ...	x	y	z
4. ...	x	y	z
Total Operators	X	Y	Z
Time	T

Task 8. Retrieve in-depth information about a specific product including offers and reviews

"For the product waterskiing sharpness horseshoes list details for all its offers by Chinese vendors and still valid by 2008-05-28 plus details for all reviews for this product having either rating1 or rating2".

Not capable of completing the task (Why?)

OR

Interaction Steps	K	P	H
1. ...	x	y	z
2. ...	x	y	z
3. ...	x	y	z
4. ...	x	y	z
Total Operators	X	Y	Z
Time	T

Task 9. Give me recent reviews in English for a specific product

"For the product waterskiing sharpness horseshoes list the 20 more recent reviews in English".

Not capable of completing the task (Why?)

OR

Interaction Steps	K	P	H
1. ...	x	y	z
2. ...	x	y	z
3. ...	x	y	z
4. ...	x	y	z
Total Operators	X	Y	Z
Time	T

Task 10. Get information about a reviewer

"Get all available information about the author of Review5481".

Not capable of completing the task (Why?)

OR

Interaction Steps	K	P	H
1. ...	x	y	z
2. ...	x	y	z
3. ...	x	y	z
4. ...	x	y	z
Total Operators	X	Y	Z
Time	T

Task 11. Get offers for a given product which fulfill specific requirements

"Look for the cheapest and still valid by 2008-06-15 offer for the product waterskiing sharpness horseshoes by a US vendor that is able to deliver within 3 days".

Not capable of completing the task (Why?)

OR

Interaction Steps	K	P	H
1. ...	x	y	z
2. ...	x	y	z
3. ...	x	y	z
4. ...	x	y	z
Total Operators	X	Y	Z
Time	T

Task 12. Export the chosen offer into another information system which uses a different schema

"Save in the local computer the information about the vendor for Offer3499, this is half the task. To complete it, restrict the output to just label, homepage and country and map them to schema.org terms name, url and nationality".

Not capable of completing the task (Why?)

OR

Interaction Steps	K	P	H
1. ...	x	y	z
2. ...	x	y	z
3. ...	x	y	z
4. ...	x	y	z
Total Operators	X	Y	Z
Time	T