Separate evaluation - Instances

* irrelevant element returned by evaluated system, not considered as false positive

SentenceGoldPIKES
S1:approval:approval
:become:become
:challenge:challenge
:countries:country_2, :country
:explicit:explicit
:extremists:extremist
:fighting:fighting
:forces:force
:group:group
:lone:lone
:not<attr:not-1r>
:other:other
:posing:pose
:qaeda:Al_Qaeda
:rebel:rebel
:rebels:rebel_2
:stamp:stamp
:stark<attr:blunt-4a>
:states:United_States
:support:support
:support_1
:syrian:Syrian
:uprising:uprising
:want:want
<attr:about-7r>
<entity:islamic>
:effective
:one
S2:abroad<attr:abroad-1r>
:donors:donor_2
:donors_v:donor
:flows:flow
:front:Nusra_Front
:group:group
:like-minded:like-mind
:money<entity:money>
S3:bases:basis
:battalions:battalion
:boldness:boldness
:capture:capture
:fields:field
:fighters:fighter
:fighters_v:fighter_2
:fortified:fortify
:have:have
:its:its
:lead:lead
:military:military
:minority:minority
:oil:oil_2, :oil
:other:other
:positions:position
:rebels:rebel
:skill:skill
:small:small
:storm:storm
S4:attract:attract
:fighters:fighter
:fighters_v:fighter_2
:gather:gather
:mount:mount
:successes:success
:their:they
:they:they_2
:weapons:weapon
:weapons_v:weapon_2
:more
:more_2
S5:contributed:contribute
:direct:direct
:fighters:fighter
:fighters_v:fighter_2
:former:former
:group:group_2, :group
:insurgents:insurgent
:insurgents_v:insurgent_2
:iraqi_1:Iraqi
:iraqi_2<entity:iraqi>
:is:be
:officials:official
:officials_v:official_2
:offshoot:offshoot
:offshoot_v:offshoot_2
:qaeda:Al_Qaeda
:say:say
:veteran:veteran
:weapons:weapon
:weapons_v:weapon_2
:which
:Iraq
:have
S6:brothers:brother
:brothers_v:brother_2
:efforts:effort
:favor:favor
:favor_v
:fought:fight
:front:Nusra_Front
:he:he
:helped:help
:iraq_1:Iraq
:iraq_2:Iraq_2
:is
:lands:land
:lead:lead
:our:we
:qaeda:Al_Qaeda
:returning:return
:said_1:say_2
:said_2:say
:simple<attr:simple-1a>
:syria:Syria
:syrian:Syrian
:this
:us:we_2
:veteran:veteran
:veteran_v:veteran_2
:way:way
:who:who
<attr:merely-1r>
S7:al-assad:Bashar_al-Assad
:group:group
:hopes:hope
:inheriting:inherit
:isolate:isolate
:it:it
:president:president
:president_v:president_2
:prevent:prevent
:running:run
:sensing:sense
:states:United_States
:syria_1:Syria
:syria_2:Syria_2
:time:time, :time_2
:may
:out
S8:alternative:alternative
:americans:Americans
:blacklist:blacklist
:dealings:dealings
:europe:Europe
:financial<attr:fiscal-1a>
:front:Nusra_Front
:government:government
:government_v:government_2
:group:group_2, :group
:have:have
:illegal:illegal
:it_1:it
:making:make
:opposition:opposition
:opposition_v
:organization:organization_2, :organization
:organize:organize
:plans:plan
:prompting:prompt
:pushes:push
:sanctions:sanction
:sanctions_v:sanction_2
:states:United_States
:syrian<entity:syrian>
:terrorist:terrorist_2, :terrorist
:viable<attr:feasible-1a>
:it_2
:similar
Results w.r.t. gold standardf1=0.939 p=0.919 r=0.961 tp=147 fp=13 fn=6