Separate evaluation - Roles (VN)

* irrelevant element returned by evaluated system, not considered as false positive

SentenceGoldPIKES
S1:approval vn:agent :qaeda:approval vn:agent :Al_Qaeda
:approval vn:theme :group
:posing vn:agent :group:pose vn:agent :group
:posing vn:recipient :countries
:posing vn:recipient :states
:posing vn:topic :challenge:pose vn:topic :challenge
:support vn:agent :countries
:support vn:agent :states
:support vn:beneficiary :rebels
:support_1 vn:agent :countries
:support_1 vn:agent :states
:support_1 vn:beneficiary :extremists
:want vn:pivot :countries
:want vn:pivot :states
:want vn:theme :support
:want vn:theme :support_1
:approval vn:agent :group
* :approval vn:theme :stamp
:support vn:experiencer :country
:support vn:stimulus :extremist
:support vn:stimulus :rebel_2
:want vn:agent :country
:want vn:result :support
S2:donors_v vn:agent :donors
:donors_v vn:recipient :group
:donors_v vn:theme :money
:flows vn:theme :money:flow vn:theme <entity:money>
S3:capture vn:agent :battalions:capture vn:agent :battalion
:capture vn:theme :bases:capture vn:theme :basis
:capture vn:theme :fields:capture vn:theme :field
:fighters_v vn:agent :fighters
:have vn:pivot :fighters:have vn:pivot :fighter
:have vn:theme :boldness:have vn:theme :boldness
:have vn:theme :skill:have vn:theme :skill
:lead vn:agent :fighters
:lead vn:patient :battalions:lead vn:patient :battalion
:lead vn:result :capture:lead vn:result :capture
:field vn:result :oil
S4:fighters_v vn:agent :fighters
:gather vn:agent :they:gather vn:agent :they_2
:gather vn:theme :weapons:gather vn:theme :weapon
:mount vn:theme :successes:mount vn:theme :success
:successes vn:agent :their:success vn:agent :they
S5:contributed vn:agent :which
:contributed vn:theme :fighters
:contributed vn:theme :weapons
:fighters_v vn:agent :fighters
:insurgents_v vn:agent :insurgents:insurgent_2 vn:agent :insurgent
:is vn:attribute :offshoot
:is vn:theme :group
:say vn:agent :insurgents:say vn:agent :insurgent
:say vn:agent :officials:say vn:agent :official
:say vn:topic :contributed
:say vn:topic :is
* :have vn:pivot :Al_Qaeda
* :have vn:theme :fighter
* :have vn:theme :weapon
:say vn:theme :be
S6:efforts vn:agent :front:effort vn:agent :Nusra_Front
:favor_v vn:recipient :brothers
:favor_v vn:theme :favor
:fought vn:agent :brothers:fight vn:agent :brother
:fought vn:agent :us
:helped vn:agent :he:help vn:agent :he
:helped vn:theme :lead:help vn:theme :lead
:is vn:attribute :way
:is vn:theme :this
:lead vn:agent :he:lead vn:agent :he
:lead vn:theme :efforts:lead vn:theme :effort
:returning vn:recipient :brothers
:returning vn:theme :favor:return vn:theme :favor
:said_1 vn:agent :veteran
:said_1 vn:topic :is
:said_2 vn:agent :who
:said_2 vn:topic :helped
:favor vn:stimulus :brother
:fight vn:topic :we_2
:say_2 vn:agent :Al_Qaeda
:say_2 vn:theme :help
S7:hopes vn:experiencer :states:hope vn:experiencer :United_States
:hopes vn:theme :isolate:hope vn:theme :isolate
:inheriting vn:agent :it:inherit vn:agent :it
:inheriting vn:theme :syria_2:inherit vn:theme :Syria_2
:isolate vn:agent :states
:isolate vn:patient :group:isolate vn:patient :group
:prevent vn:agent :states:prevent vn:agent :United_States
:prevent vn:theme :inheriting:prevent vn:theme :inherit
:prevent vn:theme :it:prevent vn:theme :it
:sensing vn:experiencer :states:sense vn:experiencer :United_States
:sensing vn:stimulus :running:sense vn:stimulus :run
S8:dealings vn:agent :americans:dealings vn:agent :Americans
:dealings vn:theme :group:dealings vn:theme :group
:have vn:pivot :americans:have vn:pivot :Americans
:have vn:theme :dealings:have vn:theme :dealings
:making vn:agent :it_1:make vn:agent :it
:making vn:result :illegal
:making vn:theme :have
:opposition_v vn:agent :opposition
:organize vn:agent :opposition
:organize vn:theme :government
:plans vn:experiencer :it_1:plan vn:experiencer :it
:plans vn:theme :blacklist:plan vn:theme :blacklist
:prompting vn:agent :it_1
:prompting vn:patient :europe
:prompting vn:result :sanctions
:pushes vn:agent :states:push vn:agent :United_States
:pushes vn:patient :opposition:push vn:patient :opposition
:pushes vn:result :organize
:sanctions_v vn:agent :europe
:sanctions_v vn:theme :sanctions:sanction_2 vn:theme :sanction
:dealings vn:theme <attr:fiscal-1a>
:make vn:result :have
* :make vn:result :it_2
:organize vn:result :government
:push vn:result :opposition
Results w.r.t. gold standardf1=0.590 p=0.742 r=0.489 tp=46 fp=16 fn=48