* irrelevant element returned by evaluated system, not considered as false positive
| Sentence | Gold | FRED | PIKES |
|---|---|---|---|
| :united_states_1_States owl:sameAs :united_states_1_countries | |||
| S2 | :group owl:sameAs :front | ||
| S3 | :fighters owl:sameAs :minority | ||
| :boldness_1_boldness owl:sameAs :boldness_1_skill | |||
| :storm_1_positions owl:sameAs :storm_1_storm | |||
| S4 | :their owl:sameAs :they | :thing_1 owl:sameAs :thing_2 | :they owl:sameAs :they_2 |
| * :More_more_1 owl:sameAs :More_more_2 | |||
| S5 | :group owl:sameAs :offshoot | ||
| :qaeda owl:sameAs :which | |||
| :fighter_1_fighters owl:sameAs :fighter_1_weapons | |||
| * :Iraqi_Iraqi_1 owl:sameAs :Iraqi_Iraqi_2 | |||
| S6 | :iraq_1 owl:sameAs :iraq_2 | :Iraq_Iraq_1 owl:sameAs :Iraq_Iraq_2 | :Iraq owl:sameAs :Iraq_2 |
| :our owl:sameAs :us | :person_1 owl:sameAs :person_2 | :we owl:sameAs :we_2 | |
| :this owl:sameAs :way | |||
| :veteran owl:sameAs :he | |||
| :veteran owl:sameAs :who | |||
| :Al_qaeda_in_iraq_Qaeda owl:sameAs :Al_qaeda_in_iraq_he | |||
| * :Syria_Syria owl:sameAs :Syria_Syrian | |||
| :way_1 owl:sameAs :thing_1 | |||
| S7 | :al-assad owl:sameAs :president | :Bashar_al-assad_al-Assad owl:sameAs :Bashar_al-assad_president | |
| :it owl:sameAs :group | |||
| :syria_1 owl:sameAs :syria_2 | :Syria_Syria_1 owl:sameAs :Syria_Syria_2 | :Syria owl:sameAs :Syria_2 | |
| :time_1_it owl:sameAs :time_1_time | |||
| :Syria_Syria_1 owl:sameAs :Syria_president | |||
| :Syria_Syria_2 owl:sameAs :Syria_president | |||
| :it owl:sameAs :United_States | |||
| :president owl:sameAs :Bashar_al-Assad | |||
| S8 | :group owl:sameAs :front | ||
| :it_1 owl:sameAs :states | :it owl:sameAs :United_States | ||
| * :it owl:sameAs :it_2 | |||
| * :it_2 owl:sameAs :United_States | |||
| Results w.r.t. gold standard | f1=0.345 p=0.357 r=0.333 tp=5 fp=9 fn=10 | f1=0.455 p=0.714 r=0.333 tp=5 fp=2 fn=10 | |
| Results w.r.t. union of correct answers | f1=0.500 p=0.357 r=0.833 tp=5 fp=9 fn=1 | f1=0.769 p=0.714 r=0.833 tp=5 fp=2 fn=1 | |