Separate evaluation - Roles (NB)

* irrelevant element returned by evaluated system, not considered as false positive

SentenceGoldPIKES
S1:approval nb:a0 :qaeda:approval nb:a0 :Al_Qaeda
:approval nb:a1 :group
:approval nb:am-mnr :explicit
:challenge nb:a0 :group:challenge nb:a0 :group
:challenge nb:a1 :countries:challenge nb:a1 :country
:challenge nb:a1 :states:challenge nb:a1 :United_States
:challenge nb:am-mnr :stark:challenge nb:am-mnr <attr:blunt-4a>
:countries nb:mod :other
:forces nb:a1 :fighting:force nb:a1 :fighting
:forces nb:a3 :uprising
:group nb:a1 :rebel:group nb:a1 :rebel
:group nb:a1 :syrian
:group nb:a3 :lone
:approval nb:a0 :group
* :approval nb:a1 :stamp
:force nb:a1 :uprising
* :group nb:a2 :stamp
* :stamp nb:a1 :approval
* :stamp nb:am-mnr <attr:explicit-1a>
S2:donors_v nb:a0 :donors
:donors_v nb:a1 :money
:donors_v nb:a2 :group
:donor_2 nb:a0 :donor
:donor_2 nb:am-loc <attr:abroad-1r>
:group nb:a2 :donor
S3:bases nb:a1 :military:basis nb:a1 :military
:fields nb:a1 :oil:field nb:a1 :oil
:fighters_v nb:a0 :fighters:fighter_2 nb:a0 :fighter
:minority nb:a1 :rebels:minority nb:a1 :rebel
S4:fighters_v nb:a0 :fighters:fighter_2 nb:a0 :fighter
:successes nb:a0 :their:success nb:a0 :they
:weapons_v nb:a2 :weapons:weapon_2 nb:a2 :weapon
S5:fighters_v nb:a0 :fighters:fighter_2 nb:a0 :fighter
:insurgents_v nb:a0 :insurgents:insurgent_2 nb:a0 :insurgent
:insurgents_v nb:a1 :iraqi_2
:insurgents_v nb:am-tmp :former
:officials_v nb:a0 :officials:official_2 nb:a0 :official
:officials_v nb:a2 :iraqi_1:official_2 nb:a2 :Iraqi
:offshoot_v nb:a0 :offshoot:offshoot_2 nb:a0 :offshoot
:offshoot_v nb:a1 :qaeda:offshoot_2 nb:a1 :Al_Qaeda
:offshoot_v nb:am-mnr :direct:offshoot_2 nb:am-mnr <attr:direct-3a>
:weapons_v nb:a2 :weapons:weapon_2 nb:a2 :weapon
:fighter_2 nb:a0 :weapon
:insurgent_2 nb:tmp <attr:former(a)-1a>
:official_2 nb:a0 :insurgent
:offshoot_2 nb:a0 :group
S6:brothers_v nb:a0 :brothers:brother_2 nb:a0 :brother
:brothers_v nb:a1 :our:brother_2 nb:a1 :we
:brothers_v nb:am-loc :syrian
:efforts nb:a0 :front:effort nb:a0 :Nusra_Front
:efforts nb:am-loc :syria:effort nb:am-loc :Syria
:favor_v nb:a1 :favor
:favor_v nb:a2 :brothers
:lands nb:a1 :iraq_1:land nb:a1 :Iraq
:veteran_v nb:a0 :veteran:veteran_2 nb:a0 :veteran
:veteran_v nb:a2 :qaeda
:way nb:a1 :returning:way nb:a1 :return
:way nb:a2 :simple
:brother_2 nb:a1 :Syrian
:favor nb:a1 :brother
:veteran_2 nb:a1 :Al_Qaeda
S7:president_v nb:a0 :president:president_2 nb:a0 :president
:president_v nb:a2 :syria_1:president_2 nb:a2 :Syria
S8:dealings nb:a0 :americans
:dealings nb:a1 :group
:dealings nb:am-mnr :financial
:government_v nb:a0 :government
:opposition_v nb:a0 :opposition
:organization nb:a1 :terrorist
:sanctions_v nb:a0 :europe
:sanctions_v nb:a1 :sanctions:sanction_2 nb:a1 :sanction
:government_2 nb:a0 :government
:government_2 nb:a2 :alternative
:government_2 nb:a2 <attr:feasible-1a>
:opposition nb:a0 :United_States
:opposition nb:a1 :organize
:opposition nb:am-mnr <entity:syrian>
:sanction_2 nb:a2 :Europe
Results w.r.t. gold standardf1=0.604 p=0.627 r=0.582 tp=32 fp=19 fn=23