-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathfacet_rank_by_score_0.7_Mingzhi_relevance.txt
6288 lines (5520 loc) · 405 KB
/
facet_rank_by_score_0.7_Mingzhi_relevance.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
-------- Documents Indexed --------
Qid: 5.3.4 How much money did Goldman Sachs make in the last 20 years ?
Original Ranking nDCG@10 = 0.21894537
Processed query: Y:(money) AND Y:(Goldman Sachs) AND X:(the last 20 years) AND IMCategory:(Trend)
................. Analyzing Facet field facet_X..................
Field facet_X: 20 years
Average number of facet_X values in each document is 4.393617
Average number of documents tagged with each facet value in the facet_X field is : 3.6875
Facet: year: 0.20835142 nDCG@10 = 0.25219 nDCG@10 nDCG gain = 0.033244625 **
facet gain @10 = 0.03324462, facet loss @10 = 0.0
Facet: month: 0.16024579 nDCG@10 = 0.15517072 nDCG@10 nDCG gain = -0.063774645
facet gain @10 = 0.15517072, facet loss @10 = 0.21894537
Facet: time: 0.09369529 nDCG@10 = 0.21894537 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: quarter: 0.06277433 nDCG@10 = 0.3050097 nDCG@10 nDCG gain = 0.086064324 **
facet gain @10 = 0.3050097, facet loss @10 = 0.21894537
Facet: september: 0.012498696 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.21894537
facet gain @10 = 0.0, facet loss @10 = 0.21894537
Facet: population: 0.008870569 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.21894537
facet gain @10 = 0.0, facet loss @10 = 0.21894537
Facet: citigroup: 0.007776209 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.21894537
facet gain @10 = 0.0, facet loss @10 = 0.21894537
Facet: history: 0.007523741 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.21894537
facet gain @10 = 0.0, facet loss @10 = 0.21894537
Facet: established: 0.00744008 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.21894537
facet gain @10 = 0.0, facet loss @10 = 0.21894537
Facet: gdp: 0.00574246 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.21894537
facet gain @10 = 0.0, facet loss @10 = 0.21894537
Facet: investment: 0.0057294993 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.21894537
facet gain @10 = 0.0, facet loss @10 = 0.21894537
facet_X, discounted nDCG Gain @5 = -0.054626442, alpha = 1 (this measures difference between nDCG).
facet_X, discounted cumulative facet Gain @5 = 0.26250696, alpha = 0 (only considering documents covered by each facet value).
facet_X, discounted non-negative nDCG Gain @5 = 0.07031051, alpha = 1 (assume users know the correct facet values to choose.)
................. Analyzing Facet field facet_Y..................
Field facet_Y: money goldman sachs
Average number of facet_Y values in each document is 2.1914895
Average number of documents tagged with each facet value in the facet_Y field is : 2.0295568
Facet: revenue: 0.025471756 nDCG@10 = 0.16871503 nDCG@10 nDCG gain = -0.05023034
facet gain @10 = 0.16871503, facet loss @10 = 0.21894537
Facet: employment: 0.02040276 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.21894537
facet gain @10 = 0.0, facet loss @10 = 0.21894537
Facet: profit accounting: 0.019967157 nDCG@10 = 0.2204386 nDCG@10 nDCG gain = 0.0014932305 **
facet gain @10 = 0.29274505, facet loss @10 = 0.18780467
Facet: net income: 0.016439259 nDCG@10 = 0.37560934 nDCG@10 nDCG gain = 0.15666397 **
facet gain @10 = 0.2204386, facet loss @10 = 0.06377464
Facet: goldman: 0.0138900345 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.21894537
facet gain @10 = 0.0, facet loss @10 = 0.21894537
Facet: price sales: 0.013183316 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.21894537
facet gain @10 = 0.0, facet loss @10 = 0.21894537
Facet: underwriting: 0.012683063 nDCG@10 = 0.10344715 nDCG@10 nDCG gain = -0.11549822
facet gain @10 = 0.10344715, facet loss @10 = 0.21894537
Facet: price: 0.012512794 nDCG@10 = 0.06526788 nDCG@10 nDCG gain = -0.1536775
facet gain @10 = 0.06526788, facet loss @10 = 0.21894537
Facet: debt: 0.011511289 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.21894537
facet gain @10 = 0.10344715, facet loss @10 = 0.21894537
Facet: insurance: 0.008574511 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.21894537
facet gain @10 = 0.0, facet loss @10 = 0.21894537
Facet: credit finance: 0.0084263235 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.21894537
facet gain @10 = 0.0, facet loss @10 = 0.21894537
facet_Y, discounted nDCG Gain @5 = -0.15312743, alpha = 1 (this measures difference between nDCG).
facet_Y, discounted cumulative facet Gain @5 = 0.4100253, alpha = 0 (only considering documents covered by each facet value).
facet_Y, discounted non-negative nDCG Gain @5 = 0.11994169, alpha = 1 (assume users know the correct facet values to choose.)
For query 5.3.4, on either X or Y field, the maximum nDCG Gain @5 = -0.054626442, alpha = 1 (assume user know which axis to choose).
For query 5.3.4, on either X or Y field, the maximum Discounted Cumulative Facet Gain @5 = 0.4100253, alpha = 0 (only consider documents covered by facets).
For query 5.3.4, on either X or Y field, the maximum non-negative nDCG Gain @5 = 0.11994169, alpha = 1 (assume user know which axis to choose, only consider non-negative nDCG.).
Qid: 5.7.1 How does the revenue of Goldman Sachs compare over the past 15 years ?
Original Ranking nDCG@10 = 0.51540804
Processed query: Y:(the revenue) AND Y:(Goldman Sachs) AND X:(the past 15 years) AND IMCategory:(Relative-Difference) AND focusX:(the past 15 years)
................. Analyzing Facet field facet_X..................
Field facet_X: 15 years
Average number of facet_X values in each document is 4.1614585
Average number of documents tagged with each facet value in the facet_X field is : 3.6651375
Facet: year: 0.23671491 nDCG@10 = 0.5253157 nDCG@10 nDCG gain = 0.009907663 **
facet gain @10 = 0.009907647, facet loss @10 = 0.0
Facet: time: 0.13643289 nDCG@10 = 0.5253157 nDCG@10 nDCG gain = 0.009907663 **
facet gain @10 = 0.009907647, facet loss @10 = 0.0
Facet: month: 0.10549806 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.51540804
facet gain @10 = 0.0, facet loss @10 = 0.51540804
Facet: quarter: 0.05801557 nDCG@10 = 0.34080437 nDCG@10 nDCG gain = -0.17460367
facet gain @10 = 0.07235207, facet loss @10 = 0.24695577
Facet: september: 0.012461567 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.51540804
facet gain @10 = 0.0, facet loss @10 = 0.51540804
Facet: investment banking: 0.009800033 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.51540804
facet gain @10 = 0.0, facet loss @10 = 0.51540804
Facet: investing lending: 0.009215718 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.51540804
facet gain @10 = 0.0, facet loss @10 = 0.51540804
Facet: overall company revenue: 0.0077569876 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.51540804
facet gain @10 = 0.0, facet loss @10 = 0.51540804
Facet: history: 0.0077330917 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.51540804
facet gain @10 = 0.0, facet loss @10 = 0.51540804
Facet: population: 0.007653525 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.51540804
facet gain @10 = 0.0, facet loss @10 = 0.51540804
Facet: citigroup: 0.0070853326 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.51540804
facet gain @10 = 0.0, facet loss @10 = 0.51540804
facet_X, discounted nDCG Gain @5 = -0.5161301, alpha = 1 (this measures difference between nDCG).
facet_X, discounted cumulative facet Gain @5 = 0.047319017, alpha = 0 (only considering documents covered by each facet value).
facet_X, discounted non-negative nDCG Gain @5 = 0.016158676, alpha = 1 (assume users know the correct facet values to choose.)
................. Analyzing Facet field facet_Y..................
Field facet_Y: revenue goldman sachs
Average number of facet_Y values in each document is 2.2135417
Average number of documents tagged with each facet value in the facet_Y field is : 2.125
Facet: revenue: 0.19242261 nDCG@10 = 0.21698414 nDCG@10 nDCG gain = -0.2984239
facet gain @10 = 0.032472786, facet loss @10 = 0.33089668
Facet: goldman sachs: 0.072865486 nDCG@10 = 0.4680171 nDCG@10 nDCG gain = -0.047390938
facet gain @10 = 0.0040771905, facet loss @10 = 0.05146814
Facet: net income: 0.052293777 nDCG@10 = 0.384866 nDCG@10 nDCG gain = -0.13054204
facet gain @10 = 0.10136024, facet loss @10 = 0.2319023
Facet: income: 0.02681231 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.51540804
facet gain @10 = 0.0, facet loss @10 = 0.51540804
Facet: corporation: 0.022726053 nDCG@10 = 0.13304321 nDCG@10 nDCG gain = -0.3823648
facet gain @10 = 0.04910229, facet loss @10 = 0.43146712
Facet: investment banking: 0.020305665 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.51540804
facet gain @10 = 0.08157507, facet loss @10 = 0.4639399
Facet: profit accounting: 0.020065403 nDCG@10 = 0.21698414 nDCG@10 nDCG gain = -0.2984239
facet gain @10 = 0.2613319, facet loss @10 = 0.51540804
Facet: price: 0.01946879 nDCG@10 = 0.13304321 nDCG@10 nDCG gain = -0.3823648
facet gain @10 = 0.08565227, facet loss @10 = 0.4680171
Facet: net profit: 0.017467206 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.51540804
facet gain @10 = 0.08565227, facet loss @10 = 0.4680171
Facet: debt: 0.016841492 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.51540804
facet gain @10 = 0.0, facet loss @10 = 0.51540804
Facet: underwriting: 0.014802683 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.51540804
facet gain @10 = 0.0, facet loss @10 = 0.51540804
facet_Y, discounted nDCG Gain @5 = -0.76348835, alpha = 1 (this measures difference between nDCG).
facet_Y, discounted cumulative facet Gain @5 = 0.10472068, alpha = 0 (only considering documents covered by each facet value).
facet_Y, discounted non-negative nDCG Gain @5 = 0.0, alpha = 1 (assume users know the correct facet values to choose.)
For query 5.7.1, on either X or Y field, the maximum nDCG Gain @5 = -0.5161301, alpha = 1 (assume user know which axis to choose).
For query 5.7.1, on either X or Y field, the maximum Discounted Cumulative Facet Gain @5 = 0.10472068, alpha = 0 (only consider documents covered by facets).
For query 5.7.1, on either X or Y field, the maximum non-negative nDCG Gain @5 = 0.016158676, alpha = 1 (assume user know which axis to choose, only consider non-negative nDCG.).
Qid: 5.7.2 What was the revenue of Goldman Sachs in 1990 compared to future revenues ?
Original Ranking nDCG@10 = 0.397322
Processed query: Y:(the revenue) AND Y:(Goldman Sachs) AND X:(1990) AND X:(future revenues) AND IMCategory:(Relative-Difference) AND focusX:(1990,future revenues)
................. Analyzing Facet field facet_X..................
Field facet_X: 1990 future revenues
Average number of facet_X values in each document is 5.1320753
Average number of documents tagged with each facet value in the facet_X field is : 2.989011
Facet: year: 0.5661494 nDCG@10 = 0.55850756 nDCG@10 nDCG gain = 0.16118556 **
facet gain @10 = 0.16118558, facet loss @10 = 0.0
Facet: time: 0.22491755 nDCG@10 = 0.55850756 nDCG@10 nDCG gain = 0.16118556 **
facet gain @10 = 0.16118558, facet loss @10 = 0.0
Facet: quarter: 0.14288343 nDCG@10 = 0.7536976 nDCG@10 nDCG gain = 0.35637558 **
facet gain @10 = 0.3563756, facet loss @10 = 0.0
Facet: month: 0.11280356 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.397322
facet gain @10 = 0.0, facet loss @10 = 0.397322
Facet: company: 0.02523266 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.397322
facet gain @10 = 0.0, facet loss @10 = 0.397322
Facet: september: 0.02287469 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.397322
facet gain @10 = 0.0, facet loss @10 = 0.397322
Facet: united: 0.017557956 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.397322
facet gain @10 = 0.0, facet loss @10 = 0.397322
Facet: bank america: 0.010636444 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.397322
facet gain @10 = 0.0, facet loss @10 = 0.397322
Facet: business: 0.0097985435 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.397322
facet gain @10 = 0.0, facet loss @10 = 0.397322
Facet: citigroup: 0.009596904 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.397322
facet gain @10 = 0.0, facet loss @10 = 0.397322
Facet: investment: 0.007030338 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.397322
facet gain @10 = 0.0, facet loss @10 = 0.397322
facet_X, discounted nDCG Gain @5 = 0.11624774, alpha = 1 (this measures difference between nDCG).
facet_X, discounted cumulative facet Gain @5 = 0.44107014, alpha = 0 (only considering documents covered by each facet value).
facet_X, discounted non-negative nDCG Gain @5 = 0.44107014, alpha = 1 (assume users know the correct facet values to choose.)
................. Analyzing Facet field facet_Y..................
Field facet_Y: revenue goldman sachs
Average number of facet_Y values in each document is 2.1320755
Average number of documents tagged with each facet value in the facet_Y field is : 2.1730769
Facet: revenue: 0.23114763 nDCG@10 = 0.24630238 nDCG@10 nDCG gain = -0.15101962
facet gain @10 = 0.09528278, facet loss @10 = 0.24630238
Facet: goldman sachs: 0.07305238 nDCG@10 = 0.24630238 nDCG@10 nDCG gain = -0.15101962
facet gain @10 = 0.0, facet loss @10 = 0.1510196
Facet: net income: 0.051687192 nDCG@10 = 0.39038002 nDCG@10 nDCG gain = -0.006941974
facet gain @10 = 0.14407764, facet loss @10 = 0.1510196
Facet: corporation: 0.0217849 nDCG@10 = 0.39038002 nDCG@10 nDCG gain = -0.006941974
facet gain @10 = 0.14407764, facet loss @10 = 0.1510196
Facet: investment banking: 0.020357745 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.397322
facet gain @10 = 0.23936042, facet loss @10 = 0.24630238
Facet: debt: 0.018902969 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.397322
facet gain @10 = 0.0, facet loss @10 = 0.397322
Facet: price: 0.01839598 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.397322
facet gain @10 = 0.0, facet loss @10 = 0.397322
Facet: underwriting: 0.016231 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.397322
facet gain @10 = 0.0, facet loss @10 = 0.397322
Facet: saint petersburg: 0.015081788 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.397322
facet gain @10 = 0.0, facet loss @10 = 0.397322
Facet: profit accounting: 0.01420127 nDCG@10 = 0.6366824 nDCG@10 nDCG gain = 0.23936039 **
facet gain @10 = 0.6366824, facet loss @10 = 0.397322
Facet: net profit: 0.012452982 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.397322
facet gain @10 = 0.0, facet loss @10 = 0.397322
facet_Y, discounted nDCG Gain @5 = -0.2554486, alpha = 1 (this measures difference between nDCG).
facet_Y, discounted cumulative facet Gain @5 = 0.3219697, alpha = 0 (only considering documents covered by each facet value).
facet_Y, discounted non-negative nDCG Gain @5 = 0.0, alpha = 1 (assume users know the correct facet values to choose.)
For query 5.7.2, on either X or Y field, the maximum nDCG Gain @5 = 0.11624774, alpha = 1 (assume user know which axis to choose).
For query 5.7.2, on either X or Y field, the maximum Discounted Cumulative Facet Gain @5 = 0.44107014, alpha = 0 (only consider documents covered by facets).
For query 5.7.2, on either X or Y field, the maximum non-negative nDCG Gain @5 = 0.44107014, alpha = 1 (assume user know which axis to choose, only consider non-negative nDCG.).
Qid: 5.7.3 What was the revenue of Goldman Sachs in 2005 compared to previous years ?
Original Ranking nDCG@10 = 0.2371977
Processed query: Y:(the revenue) AND Y:(Goldman Sachs) AND X:(to previous years) AND X:(in 2005) AND IMCategory:(Relative-Difference) AND focusX:(to previous years,in 2005)
................. Analyzing Facet field facet_X..................
Field facet_X: years 2005
Average number of facet_X values in each document is 4.1614585
Average number of documents tagged with each facet value in the facet_X field is : 3.6651375
Facet: year: 0.28830972 nDCG@10 = 0.2371977 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: month: 0.16731922 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.2371977
facet gain @10 = 0.0, facet loss @10 = 0.2371977
Facet: quarter: 0.14613709 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.2371977
facet gain @10 = 0.0, facet loss @10 = 0.2371977
Facet: time: 0.108890265 nDCG@10 = 0.2371977 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: company: 0.023563353 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.2371977
facet gain @10 = 0.0, facet loss @10 = 0.2371977
Facet: september: 0.019627031 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.2371977
facet gain @10 = 0.0, facet loss @10 = 0.2371977
Facet: united: 0.016708996 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.2371977
facet gain @10 = 0.0, facet loss @10 = 0.2371977
Facet: business: 0.013120751 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.2371977
facet gain @10 = 0.0, facet loss @10 = 0.2371977
Facet: overall company revenue: 0.011832766 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.2371977
facet gain @10 = 0.0, facet loss @10 = 0.2371977
Facet: bank america: 0.011310603 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.2371977
facet gain @10 = 0.0, facet loss @10 = 0.2371977
Facet: citigroup: 0.009038674 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.2371977
facet gain @10 = 0.0, facet loss @10 = 0.2371977
facet_X, discounted nDCG Gain @5 = -0.3600145, alpha = 1 (this measures difference between nDCG).
facet_X, discounted cumulative facet Gain @5 = 0.0, alpha = 0 (only considering documents covered by each facet value).
facet_X, discounted non-negative nDCG Gain @5 = 0.0, alpha = 1 (assume users know the correct facet values to choose.)
................. Analyzing Facet field facet_Y..................
Field facet_Y: revenue goldman sachs
Average number of facet_Y values in each document is 2.2135417
Average number of documents tagged with each facet value in the facet_Y field is : 2.125
Facet: revenue: 0.22141685 nDCG@10 = 0.1934264 nDCG@10 nDCG gain = -0.043771297
facet gain @10 = 0.1934264, facet loss @10 = 0.2371977
Facet: net income: 0.044484276 nDCG@10 = 0.3868528 nDCG@10 nDCG gain = 0.1496551 **
facet gain @10 = 0.1496551, facet loss @10 = 0.0
Facet: goldman sachs: 0.041815575 nDCG@10 = 0.2371977 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: employment: 0.029599188 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.2371977
facet gain @10 = 0.0, facet loss @10 = 0.2371977
Facet: wage: 0.029430898 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.2371977
facet gain @10 = 0.0, facet loss @10 = 0.2371977
Facet: profit accounting: 0.019887066 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.2371977
facet gain @10 = 0.0, facet loss @10 = 0.2371977
Facet: income: 0.018099856 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.2371977
facet gain @10 = 0.0, facet loss @10 = 0.2371977
Facet: corporation: 0.0180643 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.2371977
facet gain @10 = 0.0, facet loss @10 = 0.2371977
Facet: workforce: 0.017470611 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.2371977
facet gain @10 = 0.0, facet loss @10 = 0.2371977
Facet: goldman: 0.015541872 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.2371977
facet gain @10 = 0.0, facet loss @10 = 0.2371977
Facet: price: 0.015502612 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.2371977
facet gain @10 = 0.0, facet loss @10 = 0.2371977
facet_Y, discounted nDCG Gain @5 = -0.14326552, alpha = 1 (this measures difference between nDCG).
facet_Y, discounted cumulative facet Gain @5 = 0.28784826, alpha = 0 (only considering documents covered by each facet value).
facet_Y, discounted non-negative nDCG Gain @5 = 0.094421856, alpha = 1 (assume users know the correct facet values to choose.)
For query 5.7.3, on either X or Y field, the maximum nDCG Gain @5 = -0.14326552, alpha = 1 (assume user know which axis to choose).
For query 5.7.3, on either X or Y field, the maximum Discounted Cumulative Facet Gain @5 = 0.28784826, alpha = 0 (only consider documents covered by facets).
For query 5.7.3, on either X or Y field, the maximum non-negative nDCG Gain @5 = 0.094421856, alpha = 1 (assume user know which axis to choose, only consider non-negative nDCG.).
Qid: 4.11.3 What is the revenue of Apple ?
Original Ranking nDCG@10 = 0.6901935
Processed query: Y:(the revenue) AND Y:(Apple) AND IMCategory:(Trend)
................. Analyzing Facet field facet_X..................
Field facet_X:
Average number of facet_X values in each document is 5.0416665
Average number of documents tagged with each facet value in the facet_X field is : 2.9876542
Facet: quarter: 0.50026536 nDCG@10 = 0.753304 nDCG@10 nDCG gain = 0.06311053 **
facet gain @10 = 0.45090026, facet loss @10 = 0.38778964
Facet: company: 0.25703835 nDCG@10 = 0.15430084 nDCG@10 nDCG gain = -0.5358926
facet gain @10 = 0.15430084, facet loss @10 = 0.6901935
Facet: month: 0.22219959 nDCG@10 = 0.10786623 nDCG@10 nDCG gain = -0.58232725
facet gain @10 = 0.06724265, facet loss @10 = 0.64956987
Facet: year: 0.17492121 nDCG@10 = 0.7538142 nDCG@10 nDCG gain = 0.063620746 **
facet gain @10 = 0.06362078, facet loss @10 = 0.0
Facet: time: 0.16567264 nDCG@10 = 0.7538142 nDCG@10 nDCG gain = 0.063620746 **
facet gain @10 = 0.06362078, facet loss @10 = 0.0
Facet: united: 0.15889354 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6901935
facet gain @10 = 0.0, facet loss @10 = 0.6901935
Facet: companies: 0.14308648 nDCG@10 = 0.22009176 nDCG@10 nDCG gain = -0.4701017
facet gain @10 = 0.22009176, facet loss @10 = 0.6901935
Facet: business: 0.13892753 nDCG@10 = 0.22009176 nDCG@10 nDCG gain = -0.4701017
facet gain @10 = 0.22009176, facet loss @10 = 0.6901935
Facet: apple: 0.13870122 nDCG@10 = 0.15430084 nDCG@10 nDCG gain = -0.5358926
facet gain @10 = 0.15430084, facet loss @10 = 0.6901935
Facet: financial: 0.11588107 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6901935
facet gain @10 = 0.0, facet loss @10 = 0.6901935
Facet: mediatek: 0.08293637 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6901935
facet gain @10 = 0.0, facet loss @10 = 0.6901935
facet_X, discounted nDCG Gain @5 = -0.51415175, alpha = 1 (this measures difference between nDCG).
facet_X, discounted cumulative facet Gain @5 = 0.6338864, alpha = 0 (only considering documents covered by each facet value).
facet_X, discounted non-negative nDCG Gain @5 = 0.115122475, alpha = 1 (assume users know the correct facet values to choose.)
................. Analyzing Facet field facet_Y..................
Field facet_Y: revenue apple
Average number of facet_Y values in each document is 2.21875
Average number of documents tagged with each facet value in the facet_Y field is : 2.13
Facet: revenue: 0.17395408 nDCG@10 = 0.6901935 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: apple inc: 0.11538351 nDCG@10 = 0.7547764 nDCG@10 nDCG gain = 0.064582944 **
facet gain @10 = 0.18360487, facet loss @10 = 0.11902185
Facet: sales: 0.059559666 nDCG@10 = 0.2615171 nDCG@10 nDCG gain = -0.42867637
facet gain @10 = 0.27271685, facet loss @10 = 0.6901935
Facet: earnings share: 0.03596283 nDCG@10 = 0.09432504 nDCG@10 nDCG gain = -0.5958684
facet gain @10 = 0.15383752, facet loss @10 = 0.6901935
Facet: share finance: 0.033114724 nDCG@10 = 0.059512474 nDCG@10 nDCG gain = -0.630681
facet gain @10 = 0.059512474, facet loss @10 = 0.6901935
Facet: price: 0.02899078 nDCG@10 = 0.05127917 nDCG@10 nDCG gain = -0.6389143
facet gain @10 = 0.05127917, facet loss @10 = 0.6901935
Facet: income: 0.01962851 nDCG@10 = 0.09432504 nDCG@10 nDCG gain = -0.5958684
facet gain @10 = 0.09432504, facet loss @10 = 0.6901935
Facet: macintosh: 0.018522397 nDCG@10 = 0.03144168 nDCG@10 nDCG gain = -0.6587518
facet gain @10 = 0.05127917, facet loss @10 = 0.6901935
Facet: market share: 0.014048514 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6901935
facet gain @10 = 0.09432504, facet loss @10 = 0.6901935
Facet: earnings taxes: 0.013425912 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6901935
facet gain @10 = 0.0, facet loss @10 = 0.6901935
Facet: net income: 0.013279462 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6901935
facet gain @10 = 0.0, facet loss @10 = 0.6901935
facet_Y, discounted nDCG Gain @5 = -0.64296764, alpha = 1 (this measures difference between nDCG).
facet_Y, discounted cumulative facet Gain @5 = 0.34147695, alpha = 0 (only considering documents covered by each facet value).
facet_Y, discounted non-negative nDCG Gain @5 = 0.04074735, alpha = 1 (assume users know the correct facet values to choose.)
For query 4.11.3, on either X or Y field, the maximum nDCG Gain @5 = -0.51415175, alpha = 1 (assume user know which axis to choose).
For query 4.11.3, on either X or Y field, the maximum Discounted Cumulative Facet Gain @5 = 0.6338864, alpha = 0 (only consider documents covered by facets).
For query 4.11.3, on either X or Y field, the maximum non-negative nDCG Gain @5 = 0.115122475, alpha = 1 (assume user know which axis to choose, only consider non-negative nDCG.).
Qid: 5.7.4 How has there been a change in Goldman Sachs revenue since 1990 ?
Original Ranking nDCG@10 = 0.6983929
Processed query: Y:(Goldman Sachs) AND Y:(revenue) AND X:(1990) AND IMCategory:(Trend)
................. Analyzing Facet field facet_X..................
Field facet_X: 1990
Average number of facet_X values in each document is 5.23
Average number of documents tagged with each facet value in the facet_X field is : 3.0231214
Facet: year: 0.2493093 nDCG@10 = 0.70683634 nDCG@10 nDCG gain = 0.008443415 **
facet gain @10 = 0.008443455, facet loss @10 = 0.0
Facet: quarter: 0.13916823 nDCG@10 = 0.37125486 nDCG@10 nDCG gain = -0.32713807
facet gain @10 = 0.16372022, facet loss @10 = 0.49085823
Facet: month: 0.11961843 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6983929
facet gain @10 = 0.0, facet loss @10 = 0.6983929
Facet: time: 0.09530834 nDCG@10 = 0.70683634 nDCG@10 nDCG gain = 0.008443415 **
facet gain @10 = 0.008443455, facet loss @10 = 0.0
Facet: company: 0.0227611 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6983929
facet gain @10 = 0.0, facet loss @10 = 0.6983929
Facet: september: 0.022106444 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6983929
facet gain @10 = 0.0, facet loss @10 = 0.6983929
Facet: overall company revenue: 0.018171623 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6983929
facet gain @10 = 0.0, facet loss @10 = 0.6983929
Facet: united: 0.016850313 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6983929
facet gain @10 = 0.0, facet loss @10 = 0.6983929
Facet: business: 0.015281567 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6983929
facet gain @10 = 0.0, facet loss @10 = 0.6983929
Facet: bank america: 0.011497567 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6983929
facet gain @10 = 0.0, facet loss @10 = 0.6983929
Facet: citigroup: 0.0099688945 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6983929
facet gain @10 = 0.0, facet loss @10 = 0.6983929
facet_X, discounted nDCG Gain @5 = -0.8136929, alpha = 1 (this measures difference between nDCG).
facet_X, discounted cumulative facet Gain @5 = 0.11537581, alpha = 0 (only considering documents covered by each facet value).
facet_X, discounted non-negative nDCG Gain @5 = 0.012079854, alpha = 1 (assume users know the correct facet values to choose.)
................. Analyzing Facet field facet_Y..................
Field facet_Y: goldman sachs revenue
Average number of facet_Y values in each document is 2.15
Average number of documents tagged with each facet value in the facet_Y field is : 2.15
Facet: revenue: 0.23721832 nDCG@10 = 0.23637144 nDCG@10 nDCG gain = -0.46202147
facet gain @10 = 0.10130206, facet loss @10 = 0.56332344
Facet: goldman sachs: 0.034319375 nDCG@10 = 0.6547645 nDCG@10 nDCG gain = -0.043628454
facet gain @10 = 0.0, facet loss @10 = 0.043628428
Facet: income: 0.0263687 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6983929
facet gain @10 = 0.0, facet loss @10 = 0.6983929
Facet: price: 0.02083551 nDCG@10 = 0.14493048 nDCG@10 nDCG gain = -0.55346245
facet gain @10 = 0.08886372, facet loss @10 = 0.6423261
Facet: net profit: 0.020180749 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6983929
facet gain @10 = 0.08886372, facet loss @10 = 0.6423261
Facet: saint petersburg: 0.020115947 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6983929
facet gain @10 = 0.05348953, facet loss @10 = 0.6069519
Facet: corporation: 0.019989563 nDCG@10 = 0.14493048 nDCG@10 nDCG gain = -0.55346245
facet gain @10 = 0.07246524, facet loss @10 = 0.6259277
Facet: net income: 0.01975581 nDCG@10 = 0.5262324 nDCG@10 nDCG gain = -0.1721605
facet gain @10 = 0.018975716, facet loss @10 = 0.19113615
Facet: debt: 0.01890945 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6983929
facet gain @10 = 0.0, facet loss @10 = 0.6983929
Facet: underwriting: 0.016236564 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6983929
facet gain @10 = 0.0, facet loss @10 = 0.6983929
Facet: profit accounting: 0.015129039 nDCG@10 = 0.14493048 nDCG@10 nDCG gain = -0.55346245
facet gain @10 = 0.14493048, facet loss @10 = 0.6983929
facet_Y, discounted nDCG Gain @5 = -1.291216, alpha = 1 (this measures difference between nDCG).
facet_Y, discounted cumulative facet Gain @5 = 0.17395076, alpha = 0 (only considering documents covered by each facet value).
facet_Y, discounted non-negative nDCG Gain @5 = 0.0, alpha = 1 (assume users know the correct facet values to choose.)
For query 5.7.4, on either X or Y field, the maximum nDCG Gain @5 = -0.8136929, alpha = 1 (assume user know which axis to choose).
For query 5.7.4, on either X or Y field, the maximum Discounted Cumulative Facet Gain @5 = 0.17395076, alpha = 0 (only consider documents covered by facets).
For query 5.7.4, on either X or Y field, the maximum non-negative nDCG Gain @5 = 0.012079854, alpha = 1 (assume user know which axis to choose, only consider non-negative nDCG.).
Qid: 4.11.2 What is the total mobile revenue since the 90s ?
Qid: 1.8.3 What is the revenue trend of the company Ford since 2000 ?
Qid: 1.8.4 What company has the highest revenue : Ford , BMW , Toyota , or Honda ?
Qid: 4.1.2 How has Total Mobile revenue changed over the past twenty years ?
Qid: 4.5.1 How does Nokia , Apple , and Blackberry compare in terms of revenue ?
Qid: 4.5.2 What is the trend of the total mobile revenue over the past 20 years ?
Qid: 4.1.3 How has Apple revenue changed over the past twenty years ?
Original Ranking nDCG@10 = 0.6653821
Processed query: Y:(Apple revenue) AND X:(the past twenty years) AND IMCategory:(Trend)
................. Analyzing Facet field facet_X..................
Field facet_X: twenty years
Average number of facet_X values in each document is 4.068421
Average number of documents tagged with each facet value in the facet_X field is : 3.5296803
Facet: quarter: 0.15645076 nDCG@10 = 0.63702273 nDCG@10 nDCG gain = -0.028359354
facet gain @10 = 0.3988492, facet loss @10 = 0.42720854
Facet: year: 0.1419245 nDCG@10 = 0.67842984 nDCG@10 nDCG gain = 0.013047755 **
facet gain @10 = 0.013047741, facet loss @10 = 0.0
Facet: month: 0.13887443 nDCG@10 = 0.15485308 nDCG@10 nDCG gain = -0.51052904
facet gain @10 = 0.096533746, facet loss @10 = 0.60706276
Facet: time: 0.08308423 nDCG@10 = 0.67842984 nDCG@10 nDCG gain = 0.013047755 **
facet gain @10 = 0.013047741, facet loss @10 = 0.0
Facet: hours: 0.010189936 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6653821
facet gain @10 = 0.0, facet loss @10 = 0.6653821
Facet: period: 0.008898485 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6653821
facet gain @10 = 0.0, facet loss @10 = 0.6653821
Facet: day: 0.005942335 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6653821
facet gain @10 = 0.0, facet loss @10 = 0.6653821
Facet: population: 0.005190137 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6653821
facet gain @10 = 0.0, facet loss @10 = 0.6653821
Facet: september: 0.0043706014 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6653821
facet gain @10 = 0.0, facet loss @10 = 0.6653821
Facet: history: 0.004072296 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6653821
facet gain @10 = 0.0, facet loss @10 = 0.6653821
Facet: increased: 0.0030387142 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6653821
facet gain @10 = 0.0, facet loss @10 = 0.6653821
facet_X, discounted nDCG Gain @5 = -0.5271772, alpha = 1 (this measures difference between nDCG).
facet_X, discounted cumulative facet Gain @5 = 0.4609676, alpha = 0 (only considering documents covered by each facet value).
facet_X, discounted non-negative nDCG Gain @5 = 0.013851564, alpha = 1 (assume users know the correct facet values to choose.)
................. Analyzing Facet field facet_Y..................
Field facet_Y: apple revenue
Average number of facet_Y values in each document is 2.194737
Average number of documents tagged with each facet value in the facet_Y field is : 2.074627
Facet: revenue: 0.18868175 nDCG@10 = 0.6653821 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: apple inc: 0.11864079 nDCG@10 = 0.81505525 nDCG@10 nDCG gain = 0.14967316 **
facet gain @10 = 0.2562276, facet loss @10 = 0.10655453
Facet: sales: 0.09420263 nDCG@10 = 0.22197914 nDCG@10 nDCG gain = -0.44340295
facet gain @10 = 0.22197914, facet loss @10 = 0.6653821
Facet: earnings share: 0.037298255 nDCG@10 = 0.22084959 nDCG@10 nDCG gain = -0.4445325
facet gain @10 = 0.22084959, facet loss @10 = 0.6653821
Facet: share finance: 0.030979106 nDCG@10 = 0.028478762 nDCG@10 nDCG gain = -0.63690335
facet gain @10 = 0.028478762, facet loss @10 = 0.6653821
Facet: price: 0.028127156 nDCG@10 = 0.045137767 nDCG@10 nDCG gain = -0.6202443
facet gain @10 = 0.045137767, facet loss @10 = 0.6653821
Facet: macintosh: 0.021868754 nDCG@10 = 0.045137767 nDCG@10 nDCG gain = -0.6202443
facet gain @10 = 0.07361653, facet loss @10 = 0.6653821
Facet: income: 0.019514585 nDCG@10 = 0.1354133 nDCG@10 nDCG gain = -0.5299688
facet gain @10 = 0.1354133, facet loss @10 = 0.6653821
Facet: market share: 0.014004705 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6653821
facet gain @10 = 0.1354133, facet loss @10 = 0.6653821
Facet: flash memory: 0.013952817 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6653821
facet gain @10 = 0.0, facet loss @10 = 0.6653821
Facet: internet service provider: 0.013578833 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6653821
facet gain @10 = 0.0, facet loss @10 = 0.6653821
facet_Y, discounted nDCG Gain @5 = -0.56510586, alpha = 1 (this measures difference between nDCG).
facet_Y, discounted cumulative facet Gain @5 = 0.37878302, alpha = 0 (only considering documents covered by each facet value).
facet_Y, discounted non-negative nDCG Gain @5 = 0.094433196, alpha = 1 (assume users know the correct facet values to choose.)
For query 4.1.3, on either X or Y field, the maximum nDCG Gain @5 = -0.5271772, alpha = 1 (assume user know which axis to choose).
For query 4.1.3, on either X or Y field, the maximum Discounted Cumulative Facet Gain @5 = 0.4609676, alpha = 0 (only consider documents covered by facets).
For query 4.1.3, on either X or Y field, the maximum non-negative nDCG Gain @5 = 0.094433196, alpha = 1 (assume user know which axis to choose, only consider non-negative nDCG.).
Qid: 2.12.2 How does the revenue for Visa and Discover compare to Mastercard and American Express ?
Qid: 5.15.1 Has Goldman Sachs been increasing in revenue over the last 15 years ?
Original Ranking nDCG@10 = 0.26828194
Processed query: Y:(Has Goldman Sachs) AND Y:(revenue) AND X:(the last 15 years) AND IMCategory:(Trend)
................. Analyzing Facet field facet_X..................
Field facet_X: 15 years
Average number of facet_X values in each document is 4.1614585
Average number of documents tagged with each facet value in the facet_X field is : 3.6651375
Facet: year: 0.20364232 nDCG@10 = 0.26906252 nDCG@10 nDCG gain = 7.805824E-4 **
facet gain @10 = 7.805518E-4, facet loss @10 = 0.0
Facet: time: 0.11469932 nDCG@10 = 0.26906252 nDCG@10 nDCG gain = 7.805824E-4 **
facet gain @10 = 7.805518E-4, facet loss @10 = 0.0
Facet: month: 0.11126743 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.26828194
facet gain @10 = 0.0, facet loss @10 = 0.26828194
Facet: quarter: 0.07405309 nDCG@10 = 0.16710702 nDCG@10 nDCG gain = -0.10117492
facet gain @10 = 0.050396934, facet loss @10 = 0.15157187
Facet: september: 0.012341082 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.26828194
facet gain @10 = 0.0, facet loss @10 = 0.26828194
Facet: investment banking: 0.008362695 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.26828194
facet gain @10 = 0.0, facet loss @10 = 0.26828194
Facet: investing lending: 0.0078640785 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.26828194
facet gain @10 = 0.0, facet loss @10 = 0.26828194
Facet: citigroup: 0.0070054852 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.26828194
facet gain @10 = 0.0, facet loss @10 = 0.26828194
Facet: population: 0.006839149 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.26828194
facet gain @10 = 0.0, facet loss @10 = 0.26828194
Facet: overall company revenue: 0.0066192956 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.26828194
facet gain @10 = 0.0, facet loss @10 = 0.26828194
Facet: history: 0.0065562637 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.26828194
facet gain @10 = 0.0, facet loss @10 = 0.26828194
facet_X, discounted nDCG Gain @5 = -0.28022724, alpha = 1 (this measures difference between nDCG).
facet_X, discounted cumulative facet Gain @5 = 0.022977803, alpha = 0 (only considering documents covered by each facet value).
facet_X, discounted non-negative nDCG Gain @5 = 0.0012730252, alpha = 1 (assume users know the correct facet values to choose.)
................. Analyzing Facet field facet_Y..................
Field facet_Y: goldman sachs revenue
Average number of facet_Y values in each document is 2.2135417
Average number of documents tagged with each facet value in the facet_Y field is : 2.125
Facet: revenue: 0.18348952 nDCG@10 = 0.1063941 nDCG@10 nDCG gain = -0.16188784
facet gain @10 = 0.022301644, facet loss @10 = 0.18418948
Facet: net income: 0.05253168 nDCG@10 = 0.2368646 nDCG@10 nDCG gain = -0.03141734
facet gain @10 = 0.0807704, facet loss @10 = 0.11218775
Facet: goldman sachs: 0.029145347 nDCG@10 = 0.24942473 nDCG@10 nDCG gain = -0.01885721
facet gain @10 = 0.0, facet loss @10 = 0.018857215
Facet: price: 0.024226766 nDCG@10 = 0.06523524 nDCG@10 nDCG gain = -0.2030467
facet gain @10 = 0.037139952, facet loss @10 = 0.24018666
Facet: net profit: 0.02358073 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.26828194
facet gain @10 = 0.037139952, facet loss @10 = 0.24018666
Facet: income: 0.023517169 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.26828194
facet gain @10 = 0.0, facet loss @10 = 0.26828194
Facet: corporation: 0.020654162 nDCG@10 = 0.06523524 nDCG@10 nDCG gain = -0.2030467
facet gain @10 = 0.03261762, facet loss @10 = 0.23566432
Facet: profit accounting: 0.02026803 nDCG@10 = 0.1063941 nDCG@10 nDCG gain = -0.16188784
facet gain @10 = 0.12813918, facet loss @10 = 0.26828194
Facet: debt: 0.018854614 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.26828194
facet gain @10 = 0.0, facet loss @10 = 0.26828194
Facet: underwriting: 0.016096132 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.26828194
facet gain @10 = 0.0, facet loss @10 = 0.26828194
Facet: sales: 0.013382708 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.26828194
facet gain @10 = 0.0, facet loss @10 = 0.26828194
facet_Y, discounted nDCG Gain @5 = -0.3571352, alpha = 1 (this measures difference between nDCG).
facet_Y, discounted cumulative facet Gain @5 = 0.1036251, alpha = 0 (only considering documents covered by each facet value).
facet_Y, discounted non-negative nDCG Gain @5 = 0.0, alpha = 1 (assume users know the correct facet values to choose.)
For query 5.15.1, on either X or Y field, the maximum nDCG Gain @5 = -0.28022724, alpha = 1 (assume user know which axis to choose).
For query 5.15.1, on either X or Y field, the maximum Discounted Cumulative Facet Gain @5 = 0.1036251, alpha = 0 (only consider documents covered by facets).
For query 5.15.1, on either X or Y field, the maximum non-negative nDCG Gain @5 = 0.0012730252, alpha = 1 (assume user know which axis to choose, only consider non-negative nDCG.).
Qid: 2.12.1 How has the revenue for credit card companies changed from 2007 to 2009 ?
Original Ranking nDCG@10 = 0.0
Processed query: Y:(the revenue) AND Y:(credit card companies) AND X:(from 2007 to 2009) AND IMCategory:(Trend)
................. Analyzing Facet field facet_X..................
Field facet_X: 2007 2009
Average number of facet_X values in each document is 6.174107
Average number of documents tagged with each facet value in the facet_X field is : 2.9177215
Facet: year: 0.57383376 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: time: 0.23393367 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: month: 0.093766674 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: quarter: 0.088943176 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: company: 0.0686989 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: united: 0.045441717 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: bank america: 0.044966396 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: bank: 0.03687719 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: business: 0.027117178 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: citibank: 0.025257144 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: ge capital retail bank: 0.022418244 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
facet_X, discounted nDCG Gain @5 = 0.0, alpha = 1 (this measures difference between nDCG).
facet_X, discounted cumulative facet Gain @5 = 0.0, alpha = 0 (only considering documents covered by each facet value).
facet_X, discounted non-negative nDCG Gain @5 = 0.0, alpha = 1 (assume users know the correct facet values to choose.)
................. Analyzing Facet field facet_Y..................
Field facet_Y: revenue credit card companies
Average number of facet_Y values in each document is 2.1517856
Average number of documents tagged with each facet value in the facet_Y field is : 2.1909091
Facet: revenue: 0.42780194 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: credit card: 0.2376551 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: company: 0.10068042 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: share finance: 0.04792953 nDCG@10 = 0.21398626 nDCG@10 nDCG gain = 0.21398626 **
facet gain @10 = 0.21398626, facet loss @10 = 0.0
Facet: payment card: 0.046587445 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: mobile phone: 0.044008233 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: apple inc: 0.038500745 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: sales: 0.036820102 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: internet service provider: 0.034765165 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: market share: 0.034660846 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: credit finance: 0.02684813 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
facet_Y, discounted nDCG Gain @5 = 0.09215887, alpha = 1 (this measures difference between nDCG).
facet_Y, discounted cumulative facet Gain @5 = 0.09215887, alpha = 0 (only considering documents covered by each facet value).
facet_Y, discounted non-negative nDCG Gain @5 = 0.09215887, alpha = 1 (assume users know the correct facet values to choose.)
For query 2.12.1, on either X or Y field, the maximum nDCG Gain @5 = 0.09215887, alpha = 1 (assume user know which axis to choose).
For query 2.12.1, on either X or Y field, the maximum Discounted Cumulative Facet Gain @5 = 0.09215887, alpha = 0 (only consider documents covered by facets).
For query 2.12.1, on either X or Y field, the maximum non-negative nDCG Gain @5 = 0.09215887, alpha = 1 (assume user know which axis to choose, only consider non-negative nDCG.).
Qid: 5.15.2 Has Goldman Sachs been increasing in revenue over the last 20 years ?
Original Ranking nDCG@10 = 0.6291821
Processed query: Y:(Has Goldman Sachs) AND Y:(revenue) AND X:(the last 20 years) AND IMCategory:(Trend)
................. Analyzing Facet field facet_X..................
Field facet_X: 20 years
Average number of facet_X values in each document is 4.1614585
Average number of documents tagged with each facet value in the facet_X field is : 3.6651375
Facet: year: 0.20238376 nDCG@10 = 0.636619 nDCG@10 nDCG gain = 0.0074368715 **
facet gain @10 = 0.007436857, facet loss @10 = 0.0
Facet: time: 0.113854215 nDCG@10 = 0.636619 nDCG@10 nDCG gain = 0.0074368715 **
facet gain @10 = 0.007436857, facet loss @10 = 0.0
Facet: quarter: 0.11337886 nDCG@10 = 0.2909125 nDCG@10 nDCG gain = -0.3382696
facet gain @10 = 0.12964877, facet loss @10 = 0.4679183
Facet: month: 0.110946916 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6291821
facet gain @10 = 0.0, facet loss @10 = 0.6291821
Facet: september: 0.011980528 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6291821
facet gain @10 = 0.0, facet loss @10 = 0.6291821
Facet: investment banking: 0.008362695 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6291821
facet gain @10 = 0.0, facet loss @10 = 0.6291821
Facet: investing lending: 0.0078640785 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6291821
facet gain @10 = 0.0, facet loss @10 = 0.6291821
Facet: population: 0.006839149 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6291821
facet gain @10 = 0.0, facet loss @10 = 0.6291821
Facet: citigroup: 0.006812557 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6291821
facet gain @10 = 0.0, facet loss @10 = 0.6291821
Facet: overall company revenue: 0.0066192956 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6291821
facet gain @10 = 0.0, facet loss @10 = 0.6291821
Facet: history: 0.0064966185 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6291821
facet gain @10 = 0.0, facet loss @10 = 0.6291821
facet_X, discounted nDCG Gain @5 = -0.67138064, alpha = 1 (this measures difference between nDCG).
facet_X, discounted cumulative facet Gain @5 = 0.07695338, alpha = 0 (only considering documents covered by each facet value).
facet_X, discounted non-negative nDCG Gain @5 = 0.012128992, alpha = 1 (assume users know the correct facet values to choose.)
................. Analyzing Facet field facet_Y..................
Field facet_Y: goldman sachs revenue
Average number of facet_Y values in each document is 2.2135417
Average number of documents tagged with each facet value in the facet_Y field is : 2.125
Facet: revenue: 0.24783987 nDCG@10 = 0.18521887 nDCG@10 nDCG gain = -0.44396323
facet gain @10 = 0.08073837, facet loss @10 = 0.5247016
Facet: goldman sachs: 0.029145347 nDCG@10 = 0.59635407 nDCG@10 nDCG gain = -0.032828033
facet gain @10 = 0.0, facet loss @10 = 0.03282806
Facet: price: 0.024226766 nDCG@10 = 0.11356643 nDCG@10 nDCG gain = -0.5156157
facet gain @10 = 0.06465603, facet loss @10 = 0.5802717
Facet: net profit: 0.02358073 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6291821
facet gain @10 = 0.06465603, facet loss @10 = 0.5802717
Facet: income: 0.023517169 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6291821
facet gain @10 = 0.0, facet loss @10 = 0.6291821
Facet: corporation: 0.020654162 nDCG@10 = 0.11356643 nDCG@10 nDCG gain = -0.5156157
facet gain @10 = 0.056783214, facet loss @10 = 0.5723989
Facet: profit accounting: 0.02026803 nDCG@10 = 0.18521887 nDCG@10 nDCG gain = -0.44396323
facet gain @10 = 0.22307435, facet loss @10 = 0.6291821
Facet: saint petersburg: 0.02005761 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6291821
facet gain @10 = 0.04191399, facet loss @10 = 0.5575296
Facet: net income: 0.01962465 nDCG@10 = 0.41235173 nDCG@10 nDCG gain = -0.21683037
facet gain @10 = 0.014869226, facet loss @10 = 0.23169956
Facet: debt: 0.018854614 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6291821
facet gain @10 = 0.07571095, facet loss @10 = 0.5913266
Facet: underwriting: 0.01600805 nDCG@10 = 0.11356643 nDCG@10 nDCG gain = -0.5156157
facet gain @10 = 0.07571095, facet loss @10 = 0.5913266
facet_Y, discounted nDCG Gain @5 = -1.1879478, alpha = 1 (this measures difference between nDCG).
facet_Y, discounted cumulative facet Gain @5 = 0.14091222, alpha = 0 (only considering documents covered by each facet value).
facet_Y, discounted non-negative nDCG Gain @5 = 0.0, alpha = 1 (assume users know the correct facet values to choose.)
For query 5.15.2, on either X or Y field, the maximum nDCG Gain @5 = -0.67138064, alpha = 1 (assume user know which axis to choose).
For query 5.15.2, on either X or Y field, the maximum Discounted Cumulative Facet Gain @5 = 0.14091222, alpha = 0 (only consider documents covered by facets).
For query 5.15.2, on either X or Y field, the maximum non-negative nDCG Gain @5 = 0.012128992, alpha = 1 (assume user know which axis to choose, only consider non-negative nDCG.).
Qid: 5.15.3 What is the revenue for Goldman Sachs ?
Original Ranking nDCG@10 = 0.6791244
Processed query: Y:(the revenue) AND Y:(Goldman Sachs) AND IMCategory:(Trend)
................. Analyzing Facet field facet_X..................
Field facet_X:
Average number of facet_X values in each document is 5.2959185
Average number of documents tagged with each facet value in the facet_X field is : 3.0
Facet: quarter: 0.38249326 nDCG@10 = 0.68748206 nDCG@10 nDCG gain = 0.008357644 **
facet gain @10 = 0.30317372, facet loss @10 = 0.2948162
Facet: business: 0.2830768 nDCG@10 = 0.13418964 nDCG@10 nDCG gain = -0.54493475
facet gain @10 = 0.13418964, facet loss @10 = 0.6791244
Facet: financial: 0.2688599 nDCG@10 = 0.13418964 nDCG@10 nDCG gain = -0.54493475
facet gain @10 = 0.13418964, facet loss @10 = 0.6791244
Facet: year: 0.24870162 nDCG@10 = 0.6850505 nDCG@10 nDCG gain = 0.0059260726 **
facet gain @10 = 0.005925954, facet loss @10 = 0.0
Facet: time: 0.23638512 nDCG@10 = 0.6850505 nDCG@10 nDCG gain = 0.0059260726 **
facet gain @10 = 0.005925954, facet loss @10 = 0.0
Facet: company: 0.21154849 nDCG@10 = 0.16932847 nDCG@10 nDCG gain = -0.50979596
facet gain @10 = 0.16932847, facet loss @10 = 0.6791244
Facet: united: 0.20787483 nDCG@10 = 0.16932847 nDCG@10 nDCG gain = -0.50979596
facet gain @10 = 0.16932847, facet loss @10 = 0.6791244
Facet: month: 0.17867501 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6791244
facet gain @10 = 0.0, facet loss @10 = 0.6791244
Facet: companies: 0.17337924 nDCG@10 = 0.16932847 nDCG@10 nDCG gain = -0.50979596
facet gain @10 = 0.16932847, facet loss @10 = 0.6791244
Facet: finance: 0.16039468 nDCG@10 = 0.16932847 nDCG@10 nDCG gain = -0.50979596
facet gain @10 = 0.16932847, facet loss @10 = 0.6791244
Facet: equities trading: 0.11469419 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6791244
facet gain @10 = 0.0, facet loss @10 = 0.6791244
facet_X, discounted nDCG Gain @5 = -0.6030808, alpha = 1 (this measures difference between nDCG).
facet_X, discounted cumulative facet Gain @5 = 0.4597774, alpha = 0 (only considering documents covered by each facet value).
facet_X, discounted non-negative nDCG Gain @5 = 0.013202166, alpha = 1 (assume users know the correct facet values to choose.)
................. Analyzing Facet field facet_Y..................
Field facet_Y: revenue goldman sachs
Average number of facet_Y values in each document is 2.1632652
Average number of documents tagged with each facet value in the facet_Y field is : 2.12
Facet: revenue: 0.23871893 nDCG@10 = 0.541531 nDCG@10 nDCG gain = -0.13759339
facet gain @10 = 0.29141232, facet loss @10 = 0.4290058
Facet: goldman sachs: 0.034323614 nDCG@10 = 0.59833425 nDCG@10 nDCG gain = -0.08079016
facet gain @10 = 0.0, facet loss @10 = 0.08079021
Facet: income: 0.02641312 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6791244
facet gain @10 = 0.0, facet loss @10 = 0.6791244
Facet: price: 0.020931471 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6791244
facet gain @10 = 0.0, facet loss @10 = 0.6791244
Facet: net profit: 0.020183241 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6791244
facet gain @10 = 0.0, facet loss @10 = 0.6791244
Facet: saint petersburg: 0.020118432 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6791244
facet gain @10 = 0.099050805, facet loss @10 = 0.509796
Facet: corporation: 0.019992031 nDCG@10 = 0.26837927 nDCG@10 nDCG gain = -0.41074514
facet gain @10 = 0.13418964, facet loss @10 = 0.5449348
Facet: net income: 0.01989436 nDCG@10 = 0.43770772 nDCG@10 nDCG gain = -0.2414167
facet gain @10 = 0.03513883, facet loss @10 = 0.2765556
Facet: debt: 0.018911788 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.6791244
facet gain @10 = 0.02555993, facet loss @10 = 0.6663445
Facet: underwriting: 0.016238572 nDCG@10 = 0.038339898 nDCG@10 nDCG gain = -0.6407845
facet gain @10 = 0.02555993, facet loss @10 = 0.6663445
Facet: profit accounting: 0.015130909 nDCG@10 = 0.26837927 nDCG@10 nDCG gain = -0.41074514
facet gain @10 = 0.26837927, facet loss @10 = 0.6791244
facet_Y, discounted nDCG Gain @5 = -1.0833328, alpha = 1 (this measures difference between nDCG).
facet_Y, discounted cumulative facet Gain @5 = 0.29141232, alpha = 0 (only considering documents covered by each facet value).
facet_Y, discounted non-negative nDCG Gain @5 = 0.0, alpha = 1 (assume users know the correct facet values to choose.)
For query 5.15.3, on either X or Y field, the maximum nDCG Gain @5 = -0.6030808, alpha = 1 (assume user know which axis to choose).
For query 5.15.3, on either X or Y field, the maximum Discounted Cumulative Facet Gain @5 = 0.4597774, alpha = 0 (only consider documents covered by facets).
For query 5.15.3, on either X or Y field, the maximum non-negative nDCG Gain @5 = 0.013202166, alpha = 1 (assume user know which axis to choose, only consider non-negative nDCG.).
Qid: 2.16.2 How does Visa compare to other credit card companies ?
Original Ranking nDCG@10 = 0.55895287
Processed query: X:(Visa) AND X:(other credit card companies) AND IMCategory:(Relative-Difference) AND focusX:(Visa,other credit card companies)
................. Analyzing Facet field facet_X..................
Field facet_X: visa credit card companies
Average number of facet_X values in each document is 6.7958117
Average number of documents tagged with each facet value in the facet_X field is : 2.761702
Facet: companies: 0.22327308 nDCG@10 = 0.725533 nDCG@10 nDCG gain = 0.16658014 **
facet gain @10 = 0.16658011, facet loss @10 = 0.0
Facet: business: 0.19745995 nDCG@10 = 0.68251485 nDCG@10 nDCG gain = 0.12356198 **
facet gain @10 = 0.18344398, facet loss @10 = 0.059881993
Facet: visa inc: 0.1892512 nDCG@10 = 0.71091205 nDCG@10 nDCG gain = 0.15195918 **
facet gain @10 = 0.16740827, facet loss @10 = 0.0
Facet: mastercard: 0.16512248 nDCG@10 = 0.26553157 nDCG@10 nDCG gain = -0.2934213
facet gain @10 = 0.22109866, facet loss @10 = 0.49907088
Facet: mastercard inc: 0.15938476 nDCG@10 = 0.66706574 nDCG@10 nDCG gain = 0.10811287 **
facet gain @10 = 0.18139225, facet loss @10 = 0.07327934
Facet: visa: 0.15275964 nDCG@10 = 0.1429125 nDCG@10 nDCG gain = -0.41604036
facet gain @10 = 0.15836157, facet loss @10 = 0.55895287
Facet: financial: 0.14999136 nDCG@10 = 0.7382613 nDCG@10 nDCG gain = 0.17930841 **
facet gain @10 = 0.17930846, facet loss @10 = 0.0
Facet: card: 0.14858696 nDCG@10 = 0.23780431 nDCG@10 nDCG gain = -0.32114857
facet gain @10 = 0.2739346, facet loss @10 = 0.54555553
Facet: discover financial services: 0.13178499 nDCG@10 = 0.71091205 nDCG@10 nDCG gain = 0.15195918 **
facet gain @10 = 0.16658011, facet loss @10 = 0.0
Facet: credit: 0.1307663 nDCG@10 = 0.29227597 nDCG@10 nDCG gain = -0.2666769
facet gain @10 = 0.27887863, facet loss @10 = 0.54555553
Facet: services: 0.1129487 nDCG@10 = 0.029241843 nDCG@10 nDCG gain = -0.529711
facet gain @10 = 0.01584449, facet loss @10 = 0.54555553
facet_X, discounted nDCG Gain @5 = 0.25035086, alpha = 1 (this measures difference between nDCG).
facet_X, discounted cumulative facet Gain @5 = 0.5314187, alpha = 0 (only considering documents covered by each facet value).
facet_X, discounted non-negative nDCG Gain @5 = 0.37006697, alpha = 1 (assume users know the correct facet values to choose.)
................. Analyzing Facet field facet_Y..................
Field facet_Y:
Average number of facet_Y values in each document is 2.1675394
Average number of documents tagged with each facet value in the facet_Y field is : 2.2021277
Facet: revenue: 0.6049761 nDCG@10 = 0.7389303 nDCG@10 nDCG gain = 0.17997742 **
facet gain @10 = 0.17997748, facet loss @10 = 0.0
Facet: share finance: 0.16471064 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.55895287
facet gain @10 = 0.0, facet loss @10 = 0.55895287
Facet: goldman sachs: 0.11474511 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.55895287
facet gain @10 = 0.0, facet loss @10 = 0.55895287
Facet: sales: 0.11070689 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.55895287
facet gain @10 = 0.0, facet loss @10 = 0.55895287
Facet: credit card: 0.10329981 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.55895287
facet gain @10 = 0.0, facet loss @10 = 0.55895287
Facet: mobile phone: 0.09808628 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.55895287
facet gain @10 = 0.0, facet loss @10 = 0.55895287
Facet: interchange fee: 0.092048705 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.55895287
facet gain @10 = 0.0, facet loss @10 = 0.55895287
Facet: electronic funds transfer: 0.090097144 nDCG@10 = 0.046347223 nDCG@10 nDCG gain = -0.51260567
facet gain @10 = 0.13407275, facet loss @10 = 0.55895287
Facet: automobile: 0.08175761 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.55895287
facet gain @10 = 0.0, facet loss @10 = 0.55895287
Facet: apple inc: 0.07292766 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.55895287
facet gain @10 = 0.0, facet loss @10 = 0.55895287
Facet: stock market: 0.07290566 nDCG@10 = 0.0 nDCG@10 nDCG gain = -0.55895287
facet gain @10 = 0.0, facet loss @10 = 0.55895287
facet_Y, discounted nDCG Gain @5 = -0.9091193, alpha = 1 (this measures difference between nDCG).
facet_Y, discounted cumulative facet Gain @5 = 0.17997748, alpha = 0 (only considering documents covered by each facet value).
facet_Y, discounted non-negative nDCG Gain @5 = 0.17997748, alpha = 1 (assume users know the correct facet values to choose.)
For query 2.16.2, on either X or Y field, the maximum nDCG Gain @5 = 0.25035086, alpha = 1 (assume user know which axis to choose).
For query 2.16.2, on either X or Y field, the maximum Discounted Cumulative Facet Gain @5 = 0.5314187, alpha = 0 (only consider documents covered by facets).
For query 2.16.2, on either X or Y field, the maximum non-negative nDCG Gain @5 = 0.37006697, alpha = 1 (assume user know which axis to choose, only consider non-negative nDCG.).
Qid: 2.16.1 How has the credit card industry changed over the last 5 years ?
Original Ranking nDCG@10 = 0.0
Processed query: Y:(the credit card industry) AND X:(the last 5 years) AND IMCategory:(Trend)
................. Analyzing Facet field facet_X..................
Field facet_X: 5 years
Average number of facet_X values in each document is 4.882353
Average number of documents tagged with each facet value in the facet_X field is : 3.2442997
Facet: year: 0.5033673 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: time: 0.30540565 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: month: 0.14969386 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: quarter: 0.05229702 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: century: 0.04027091 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: population: 0.032055598 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: established: 0.026713464 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: gdp: 0.025104927 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: country: 0.020830536 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: italy: 0.019922225 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: countries: 0.01658007 nDCG@10 = 0.24630238 nDCG@10 nDCG gain = 0.24630238 **
facet gain @10 = 0.24630238, facet loss @10 = 0.0
facet_X, discounted nDCG Gain @5 = 0.0, alpha = 1 (this measures difference between nDCG).
facet_X, discounted cumulative facet Gain @5 = 0.0, alpha = 0 (only considering documents covered by each facet value).
facet_X, discounted non-negative nDCG Gain @5 = 0.0, alpha = 1 (assume users know the correct facet values to choose.)
................. Analyzing Facet field facet_Y..................
Field facet_Y: credit card industry
Average number of facet_Y values in each document is 2.1421568
Average number of documents tagged with each facet value in the facet_Y field is : 2.0325582
Facet: revenue: 0.14625397 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: interchange fee: 0.09406761 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: credit finance: 0.059860032 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: payment card: 0.059250683 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: sales: 0.054363124 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: share finance: 0.037703738 nDCG@10 = 0.5143372 nDCG@10 nDCG gain = 0.5143372 **
facet gain @10 = 0.5143372, facet loss @10 = 0.0
Facet: automobile: 0.035451196 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: mobile phone: 0.034273624 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: credit card: 0.032452803 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: market share: 0.029630266 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
Facet: automotive industry: 0.029484415 nDCG@10 = 0.0 nDCG@10 nDCG gain = 0.0
facet gain @10 = 0.0, facet loss @10 = 0.0
facet_Y, discounted nDCG Gain @5 = 0.0, alpha = 1 (this measures difference between nDCG).
facet_Y, discounted cumulative facet Gain @5 = 0.0, alpha = 0 (only considering documents covered by each facet value).
facet_Y, discounted non-negative nDCG Gain @5 = 0.0, alpha = 1 (assume users know the correct facet values to choose.)
For query 2.16.1, on either X or Y field, the maximum nDCG Gain @5 = 0.0, alpha = 1 (assume user know which axis to choose).
For query 2.16.1, on either X or Y field, the maximum Discounted Cumulative Facet Gain @5 = 0.0, alpha = 0 (only consider documents covered by facets).
For query 2.16.1, on either X or Y field, the maximum non-negative nDCG Gain @5 = 0.0, alpha = 1 (assume user know which axis to choose, only consider non-negative nDCG.).
Qid: 2.16.4 Does Visa or Mastercard make more money ?
Original Ranking nDCG@10 = 0.6358004
Processed query: X:(Visa) AND X:(Mastercard) AND Y:(more money) AND IMCategory:(Relative-Difference) AND focusX:(Visa,Mastercard)
................. Analyzing Facet field facet_X..................
Field facet_X: visa mastercard
Average number of facet_X values in each document is 6.965909
Average number of documents tagged with each facet value in the facet_X field is : 3.209424
Facet: visa inc: 0.25605443 nDCG@10 = 0.44749582 nDCG@10 nDCG gain = -0.1883046
facet gain @10 = 0.14645995, facet loss @10 = 0.33476463
Facet: mastercard inc: 0.22291529 nDCG@10 = 0.3992606 nDCG@10 nDCG gain = -0.23653981
facet gain @10 = 0.15060976, facet loss @10 = 0.38714963
Facet: mastercard: 0.13391271 nDCG@10 = 0.5030915 nDCG@10 nDCG gain = -0.1327089
facet gain @10 = 0.22126329, facet loss @10 = 0.24865085
Facet: visa: 0.13132352 nDCG@10 = 0.5580178 nDCG@10 nDCG gain = -0.07778263
facet gain @10 = 0.22325313, facet loss @10 = 0.30103585
Facet: credit: 0.115678236 nDCG@10 = 0.61002505 nDCG@10 nDCG gain = -0.025775373
facet gain @10 = 0.41067368, facet loss @10 = 0.4364491
Facet: companies: 0.111742 nDCG@10 = 0.44749582 nDCG@10 nDCG gain = -0.1883046
facet gain @10 = 0.14645995, facet loss @10 = 0.33476463
Facet: business: 0.104163185 nDCG@10 = 0.3797891 nDCG@10 nDCG gain = -0.2560113
facet gain @10 = 0.13113831, facet loss @10 = 0.38714963
Facet: discover financial services: 0.081986554 nDCG@10 = 0.44749582 nDCG@10 nDCG gain = -0.1883046
facet gain @10 = 0.14645995, facet loss @10 = 0.33476463
Facet: ind: 0.056584504 nDCG@10 = 0.44749582 nDCG@10 nDCG gain = -0.1883046
facet gain @10 = 0.14645995, facet loss @10 = 0.33476463
Facet: american express company: 0.054658793 nDCG@10 = 0.44749582 nDCG@10 nDCG gain = -0.1883046
facet gain @10 = 0.14645995, facet loss @10 = 0.33476463
Facet: issued: 0.054348957 nDCG@10 = 0.5153157 nDCG@10 nDCG gain = -0.12048471
facet gain @10 = 0.47394657, facet loss @10 = 0.4364491
facet_X, discounted nDCG Gain @5 = -0.39470902, alpha = 1 (this measures difference between nDCG).
facet_X, discounted cumulative facet Gain @5 = 0.60713595, alpha = 0 (only considering documents covered by each facet value).
facet_X, discounted non-negative nDCG Gain @5 = 0.0, alpha = 1 (assume users know the correct facet values to choose.)
................. Analyzing Facet field facet_Y..................
Field facet_Y: money
Average number of facet_Y values in each document is 1.9431819
Average number of documents tagged with each facet value in the facet_Y field is : 1.9655173
Facet: revenue: 0.20746902 nDCG@10 = 0.46054354 nDCG@10 nDCG gain = -0.17525688