Vulcan/OpenIECoverage

From Knowitall
Revision as of 20:05, 6 September 2013 by Niranjan (talk | contribs)

Jump to: navigation, search

Examples from a representative set of definition sentences. Open IE gets all relevant information about half the time. We need a high recall mode for extraction that handles cases where part of the sentence is not included in the extraction and where the extraction doesn’t analyze internal structure of a complex argument.

Cases where Open IE misses information:

1. Metamorphic rock is a rock changed by heat or pressure, but not completely melted (Metamorphic rock ; is; (a rock; changed ; by heat or pressure) ) SRL finds no subject for “melt”

2. Branch in a parallel circuit is one of the paths that electric current can follow (Branch in a parallel circuit; is; one of the paths) & (electric current; can follow; ) second tuple should be: (electric current; can follow; one of the paths)

3. Pulley is a simple machine made up of a rope or chain and a wheel around which the rope fits (Pulley; is; a simple machine made up of a rope or chain and a wheel) & (a simple machine; made up; ) & (a wheel; fits; the rope) second tuple should be: (simple machine; made up; of a rope or chain and a wheel) third tuple should be: (the rope; fits; around a wheel)

4. Orbit is the path that an object such as a planet makes as it revolves around a second object (Orbit; is; (the path that an object such as a planet; makes; )) & (it; revolves; around a second object) should include: (an object such as a planet; makes; the path) and resolve “it”: (an object such as a planet; revolves; around a second object)

5. Instinct is a behavior that an animal begins life with (Instinct; is; a behavior that an animal begins life with) & (an animal; begins; life; with) should be: (Instinct; is ; a behavior) & (an animal; begins; life; with a behavior)

6. Classification is the grouping of things by using a set of rules (Classification; is; the grouping of things) SRL finds no subject for “use”

7. Competition is the struggle among living things for the same resources (Competition; is; the struggle among living things for the same resources) misses relations: (the struggle, [is]; among living things) & (the struggle, [is]; for the same resources)

Cases where Open IE gets all relevant information: 8. Adaptation is a special trait that helps an organism survive in its environment (Adaptation; is; (a special trait; helps; ( an organism; survive; in its environment))) doubly nested tuple

9. Kidney is a bean-shaped organ that filters water and waste materials out of the blood (Kidney; is; (a bean-shaped organ; filters ;water and waste materials; out of the blood)) n-ary tuple nested within binary tuple

10. Stamen is the part of the plant that holds the male cells for reproduction (Stamen; is; the part of (the plant; holds; the male cells for reproduction)) should be: (Stamen; is; (the part of the plant; holds; the male cells; for reproduction))

11. Fossil is the remains of a living thing from many years ago (Fossil; is; the remains of a living thing from many years ago)

12. Experiment is an organized test designed to support or disprove a hypothesis (Experiment; is; (an organized test; designed; to support or disprove a hypothesis)) & (an organized test; to support; )

13. Carnivore is an animal that eats other animals (Carnivore; is; (an animal; eats; other animals))

14. Forest floor is the ground level of a forest ecosystem (Forest floor; is; the ground level of a forest ecosystem)

15. Magma is the melted rock inside earth (Magma; is; the melted rock inside earth)

16. Normal fault is the crack or line between two plates that are pulling apart (Normal fault; is; the crack or line between two plates) & (two plates; are pulling; apart) </pre>