* irrelevant element returned by evaluated system, not considered as false positive
| Sentence | Gold | FRED | PIKES |
|---|---|---|---|
| S1 | :posing rdf:type vn:37.1.1 | :pose rdf:type vn:37.1.1 | |
| :support rdf:type vn:72 | |||
| :support_1 rdf:type vn:72 | :support_1 rdf:type vn:72 | ||
| :want rdf:type vn:32.1-1-1 | :want_1 rdf:type vn:32.1-1-1 | ||
| :pose_1 rdf:type vn:48.1.2 | |||
| :support rdf:type vn:31.2 | |||
| :want rdf:type vn:29.1 | |||
| S2 | :flows rdf:type vn:47.2 | :flow_1 rdf:type vn:47.2 | :flow rdf:type vn:47.2 |
| S3 | :capture rdf:type vn:10.5-1 | :capture rdf:type vn:10.5-1 | |
| :have rdf:type vn:100 | :have rdf:type vn:100 | ||
| :lead rdf:type vn:59 | :lead rdf:type vn:59 | ||
| :capture_1 rdf:type vn:10.5 | |||
| :have_1 rdf:type vn:39.4-1 | |||
| S4 | :gather rdf:type vn:47.5.2 | :gather_1 rdf:type vn:47.5.2 | |
| :mount rdf:type vn:47.7 | :mount rdf:type vn:47.7 | ||
| :mount_1 rdf:type vn:55.5-1 | |||
| :gather rdf:type vn:13.5.1 | |||
| S5 | :contributed rdf:type vn:13.2-1-1 | ||
| :is rdf:type vn:109-1-1 | |||
| :say rdf:type vn:37.7-1 | :say_1 rdf:type vn:37.7-1 | ||
| :contribute_1 rdf:type vn:13.2-1-1-1 | |||
| * :have rdf:type vn:100 | |||
| :say rdf:type vn:13.5.1 | |||
| S6 | :fought rdf:type vn:36.4-1 | :fight rdf:type vn:36.4-1 | |
| :helped rdf:type vn:72-1 | :help rdf:type vn:72-1 | ||
| :is rdf:type vn:109-1-1 | |||
| :lead rdf:type vn:51.7 | :lead_1 rdf:type vn:51.7 | :lead rdf:type vn:51.7 | |
| :returning rdf:type vn:13.2-2 | :return_1 rdf:type vn:13.2-2 | ||
| :said_1 rdf:type vn:37.7-1 | :say_1 rdf:type vn:37.7-1 | ||
| :said_2 rdf:type vn:37.7-1 | :say_2 rdf:type vn:37.7-1 | ||
| :fight_1 rdf:type vn:36.3-2 | |||
| :return rdf:type vn:51.1 | |||
| :say rdf:type vn:13.5.1 | |||
| :say_2 rdf:type vn:13.5.1 | |||
| S7 | :hopes rdf:type vn:62 | :hope_1 rdf:type vn:62 | :hope rdf:type vn:62 |
| :inheriting rdf:type vn:13.5.2 | :inherit_1 rdf:type vn:13.5.2 | :inherit rdf:type vn:13.5.2 | |
| :isolate rdf:type vn:16 | :isolate rdf:type vn:16 | ||
| :prevent rdf:type vn:67 | :prevent_1 rdf:type vn:67 | :prevent rdf:type vn:67 | |
| :sensing rdf:type vn:30.1-1 | :sense_1 rdf:type vn:30.1-1 | :sense rdf:type vn:30.1-1 | |
| :isolate_1 rdf:type vn:29.10 | |||
| :run_1 rdf:type vn:47.5.1-1 | |||
| S8 | :have rdf:type vn:100 | :have rdf:type vn:100 | |
| :making rdf:type vn:29.3 | :make rdf:type vn:29.3 | ||
| :organize rdf:type vn:55.5-1 | :organize_1 rdf:type vn:55.5-1 | ||
| :plans rdf:type vn:62 | :plan_1 rdf:type vn:62 | :plan rdf:type vn:62 | |
| :prompting rdf:type vn:59 | :prompt_1 rdf:type vn:59 | ||
| :pushes rdf:type vn:59 | :push rdf:type vn:59 | ||
| :have_1 rdf:type vn:39.4-1 | |||
| :make_1 rdf:type vn:26.1-1 | |||
| :push_1 rdf:type vn:90.30.2-1 | |||
| :dealings rdf:type vn:83 | |||
| :organize rdf:type vn:26.4 | |||
| Results w.r.t. gold standard | f1=0.552 p=0.593 r=0.516 tp=16 fp=11 fn=15 | f1=0.621 p=0.667 r=0.581 tp=18 fp=9 fn=13 | |
| Results w.r.t. union of correct answers | f1=0.593 p=0.593 r=0.593 tp=16 fp=11 fn=11 | f1=0.667 p=0.667 r=0.667 tp=18 fp=9 fn=9 | |