Separate evaluation - Roles (FN)

* irrelevant element returned by evaluated system, not considered as false positive

SentenceGoldPIKES
S1:approval fn:grantee :group
:approval fn:grantor :qaeda:approval fn:grantor :Al_Qaeda
:approval fn:manner :explicit
:become fn:entity :group
:become fn:final_category :forces
:challenge fn:Participant_1 :group
:challenge fn:Participant_2 :countries
:challenge fn:Participant_2 :states
:countries fn:descriptor :other
:forces fn:descriptor :uprising
:forces fn:domain :fighting
:group fn:descriptor :lone
:group fn:descriptor :rebel
:group fn:place :syrian
:other fn:added_set :countries
:other fn:class :countries
:support fn:cognizer :countries:support fn:cognizer :country
:support fn:cognizer :states
:support fn:side :rebels
:support_1 fn:cognizer :countries
:support_1 fn:cognizer :states
:support_1 fn:side :extremists
:want fn:event :support:want fn:event :support
:want fn:event :support_1
:want fn:experiencer :countries
:want fn:experiencer :states
* :approval fn:action :stamp
* :approval fn:grantee :stamp
:approval fn:grantor :group
:want fn:cause :country
S2:donors_v fn:donor :donors
:donors_v fn:recipient :group
:donors_v fn:theme :money
:flows fn:fluid :money:flow fn:fluid <entity:money>
:flows fn:goal :group
:flows fn:source :donors
S3:bases fn:use :military
:capture fn:conqueror :battalions
:capture fn:theme :bases
:capture fn:theme :fields
:fields fn:use :oil
:have fn:owner :fighters:have fn:owner :fighter
:have fn:possession :boldness:have fn:possession :boldness
:have fn:possession :skill:have fn:possession :skill
:lead fn:affected :battalions
:lead fn:cause :fighters
:lead fn:effect :capture
:other fn:added_set :battalions
:positions fn:inherent_purpose :fortified
:storm fn:assailant :fighters
:storm fn:victim :positions
:field fn:created_entity :oil
:lead fn:cause :capture
:lead fn:effect :battalion
S4:attract fn:agent :they
:attract fn:theme :fighters
:gather fn:agent :they:gather fn:agent :they_2
:gather fn:individuals :weapons:gather fn:individuals :weapon
:successes fn:agent :their:success fn:agent :they
:weapons_v fn:weapon :weapons
:gather fn:agent :weapon
S5:contributed fn:donor :which
:contributed fn:theme :fighters
:contributed fn:theme :weapons
:officials_v fn:governed :iraqi_1
:officials_v fn:leader :officials
:say fn:message :contributed
:say fn:message :is:say fn:message :be
:say fn:speaker :insurgents:say fn:speaker :insurgent
:say fn:speaker :officials:say fn:speaker :official
:weapons_v fn:weapon :weapons
* :have fn:owner :Al_Qaeda
* :have fn:possession :fighter
* :have fn:possession :weapon
:say fn:topic :be
S6:brothers_v fn:alter :brothers
:brothers_v fn:descriptor :syrian
:brothers_v fn:ego :our
:efforts fn:agent :front:effort fn:agent :Nusra_Front
:efforts fn:place :syria
:fought fn:place :lands
:fought fn:side_1 :brothers:fight fn:side_1 :brother
:fought fn:side_1 :us
:helped fn:goal :lead:help fn:goal :lead
:helped fn:helper :he:help fn:helper :he
:lands fn:container_possessor :iraq_1
:lead fn:activity :efforts
:lead fn:leader :he
:said_1 fn:message :is
:said_1 fn:speaker :veteran
:said_2 fn:message :helped:say_2 fn:message :help
:said_2 fn:speaker :who
:way fn:descriptor :simple
:way fn:purpose :returning
:favor fn:dispute :brother
:favor fn:side_1 :brother
:favor fn:sides :brother
:fight fn:side_2 :we_2
:help fn:focal_entity :lead
:lead fn:cotheme :effort
:lead fn:theme :he
:return fn:theme :favor
:say_2 fn:speaker :Al_Qaeda
:say_2 fn:topic :help
S7:hopes fn:event :isolate:hope fn:event :isolate
:hopes fn:experiencer :states:hope fn:experiencer :United_States
:president_v fn:governed :syria_1
:president_v fn:leader :president
:prevent fn:action :inheriting
:prevent fn:preventing_cause :states:prevent fn:preventing_cause :United_States
:prevent fn:protagonist :it
:sensing fn:perceiver_passive :states:sense fn:perceiver_passive :United_States
:sensing fn:phenomenon :running:sense fn:phenomenon :run
:prevent fn:event :inherit
:prevent fn:event :it
S8:government_v fn:leader :government
:have fn:owner :americans:have fn:owner :Americans
:have fn:possession :dealings:have fn:possession :dealings
:making fn:actor :it_1
:making fn:effect :have
:making fn:effect :illegal
:opposition_v fn:cognizer :opposition
:organization fn:purpose :terrorist
:plans fn:agent :it_1:plan fn:agent :it
:plans fn:goal :blacklist:plan fn:goal :blacklist
:prompting fn:cause :it_1
:prompting fn:effect :sanctions
:pushes fn:action :organize
:pushes fn:agent :states:push fn:agent :United_States
:pushes fn:cognizer :opposition
:sanctions_v fn:avenger :europe
:sanctions_v fn:punishment :sanctions
:dealings fn:agent :Americans
:dealings fn:agent <attr:fiscal-1a>
:dealings fn:agent :group
:make fn:cause :have
:make fn:cause :it
* :make fn:cause :it_2
:plan fn:attribute :blacklist
:plan fn:value :blacklist
:push fn:difference :opposition
:push fn:item :opposition
Results w.r.t. gold standardf1=0.341 p=0.500 r=0.259 tp=28 fp=28 fn=80