Separate evaluation - Roles (FN)

* irrelevant element returned by evaluated system, not considered as false positive

SentenceGoldPIKES
S1:approval fn:grantee :group
:approval fn:grantor :qaeda
:approval fn:manner :explicit
:become fn:entity :group:become fn:entity :group
:become fn:final_category :forces
:challenge fn:Participant_1 :group
:challenge fn:Participant_2 :countries
:challenge fn:Participant_2 :states
:countries fn:descriptor :other
:forces fn:descriptor :uprising
:forces fn:domain :fighting
:group fn:descriptor :lone
:group fn:descriptor :rebel
:group fn:place :syrian
:other fn:added_set :countries
:other fn:class :countries:other fn:class :country
:support fn:cognizer :countries
:support fn:cognizer :states
:support fn:side :rebels
:support_1 fn:cognizer :countries
:support_1 fn:cognizer :states
:support_1 fn:side :extremists
:want fn:event :support:want fn:event :support
:want fn:event :support_1
:want fn:experiencer :countries:want fn:experiencer :country
:want fn:experiencer :states:want fn:experiencer :United_States
:approval fn:action :Al_Qaeda
* :approval fn:action :stamp
:approval fn:grantor :group
* :become fn:final_state :one
:challenge fn:activity :country
:challenge fn:activity :United_States
* :effective fn:degree <attr:about-7r>
* :effective fn:entity :group
:explicit fn:speaker :group
:pose fn:state_of_affairs :challenge
:support fn:supported :extremist
:support fn:supported :rebel_2
:support fn:supporter :country
:support fn:supporter :United_States
S2:donors_v fn:donor :donors
:donors_v fn:recipient :group
:donors_v fn:theme :money
:flows fn:fluid :money:flow fn:fluid <entity:money>
:flows fn:goal :group:flow fn:goal :group
:flows fn:source :donors
:donor_2 fn:donor :like-mind
S3:bases fn:use :military
:capture fn:conqueror :battalions:capture fn:conqueror :battalion
:capture fn:theme :bases:capture fn:theme :basis
:capture fn:theme :fields:capture fn:theme :field
:fields fn:use :oil:field fn:use :oil
:have fn:owner :fighters:have fn:owner :fighter
:have fn:possession :boldness:have fn:possession :boldness
:have fn:possession :skill:have fn:possession :skill
:lead fn:affected :battalions
:lead fn:cause :fighters:lead fn:cause :fighter
:lead fn:effect :capture:lead fn:effect :capture
:other fn:added_set :battalions
:positions fn:inherent_purpose :fortified
:storm fn:assailant :fighters
:storm fn:victim :positions
:fortify fn:patient :position
:other fn:class :battalion
* :skill fn:skill :storm
* :small fn:object :minority
S4:attract fn:agent :they
:attract fn:theme :fighters:attract fn:theme :fighter
:gather fn:agent :they
:gather fn:individuals :weapons
:successes fn:agent :their:success fn:agent :they
:weapons_v fn:weapon :weapons:weapon_2 fn:weapon :weapon
* :more fn:class :weapon
* :more_2 fn:class :fighter
S5:contributed fn:donor :which
:contributed fn:theme :fighters
:contributed fn:theme :weapons
:officials_v fn:governed :iraqi_1:official_2 fn:governed :Iraqi
:officials_v fn:leader :officials:official_2 fn:leader :official
:say fn:message :contributed
:say fn:message :is:say fn:message :be
:say fn:speaker :insurgents:say fn:speaker :insurgent
:say fn:speaker :officials:say fn:speaker :official
:weapons_v fn:weapon :weapons:weapon_2 fn:weapon :weapon
:contribute fn:recipient :fighter
:contribute fn:recipient :weapon
:former fn:event :be
* :have fn:owner :Al_Qaeda
* :have fn:possession :fighter
* :have fn:possession :weapon
:official_2 fn:leader :insurgent
S6:brothers_v fn:alter :brothers:brother_2 fn:alter :brother
:brothers_v fn:descriptor :syrian
:brothers_v fn:ego :our:brother_2 fn:ego :we
:efforts fn:agent :front
:efforts fn:place :syria
:fought fn:place :lands
:fought fn:side_1 :brothers:fight fn:side_1 :brother
:fought fn:side_1 :us
:helped fn:goal :lead:help fn:goal :lead
:helped fn:helper :he:help fn:helper :he
:lands fn:container_possessor :iraq_1:land fn:container_possessor :Iraq
:lead fn:activity :efforts
:lead fn:leader :he:lead fn:leader :he
:said_1 fn:message :is
:said_1 fn:speaker :veteran:say_2 fn:speaker :veteran
:said_2 fn:message :helped:say fn:message :help
:said_2 fn:speaker :who
:way fn:descriptor :simple
:way fn:purpose :returning:way fn:purpose :return
:effort fn:agent :he
:effort fn:goal :Nusra_Front
:fight fn:side_2 :we_2
:lead fn:cotheme :effort
:lead fn:governed :return
:return fn:goal :brother
:say fn:speaker :Iraq_2
S7:hopes fn:event :isolate:hope fn:event :isolate
:hopes fn:experiencer :states:hope fn:experiencer :United_States
:president_v fn:governed :syria_1
:president_v fn:leader :president:president_2 fn:leader :president
:prevent fn:action :inheriting
:prevent fn:preventing_cause :states
:prevent fn:protagonist :it
:sensing fn:perceiver_passive :states:sense fn:perceiver_passive :United_States
:sensing fn:phenomenon :running:sense fn:phenomenon :run
* :may fn:reason :Bashar_al-Assad
* :out fn:figure :Bashar_al-Assad
:prevent fn:event :it
* :sense fn:phenomenon :may
S8:government_v fn:leader :government:government_2 fn:leader :government
:have fn:owner :americans:have fn:owner :Americans
:have fn:possession :dealings:have fn:possession :dealings
:making fn:actor :it_1
:making fn:effect :have
:making fn:effect :illegal:make fn:effect :illegal
:opposition_v fn:cognizer :opposition
:organization fn:purpose :terrorist
:plans fn:agent :it_1:plan fn:agent :it
:plans fn:goal :blacklist
:prompting fn:cause :it_1
:prompting fn:effect :sanctions:prompt fn:effect :sanction
:pushes fn:action :organize
:pushes fn:agent :states:push fn:agent :United_States
:pushes fn:cognizer :opposition
:sanctions_v fn:avenger :europe
:sanctions_v fn:punishment :sanctions
:dealings fn:agent :Americans
:dealings fn:problem <attr:fiscal-1a>
:dealings fn:problem :group
* :have fn:owner :it_2
* :illegal fn:object :it_2
:make fn:affected :have
* :make fn:affected :it_2
:make fn:cause :it
:opposition fn:cognizer :United_States
:opposition fn:issue :organize
* :sanction_2 fn:avenger :similar
Results w.r.t. gold standardf1=0.503 p=0.595 r=0.435 tp=47 fp=32 fn=61