Difference between revisions of "Vulcan/OpenIECoverage"

Revision as of 20:07, 6 September 2013

Examples from a representative set of definition sentences. Open IE gets all relevant information about half the time. We need a high recall mode for extraction that handles cases where part of the sentence is not included in the extraction and where the extraction doesn’t analyze internal structure of a complex argument.

Cases where Open IE misses information

1. Metamorphic rock is a rock changed by heat or pressure, <strong>but not completely melted</strong>
(Metamorphic rock ; is;  (a rock;   changed ;  by heat or pressure) )
	SRL finds no subject for “melt”

2. Branch in a parallel circuit is one of the paths that electric current can follow
(Branch in a parallel circuit;  is;  one of the paths)  & (electric current;  can follow;  )
	second tuple should be: (electric current;  can follow;  <b>one of the paths</b>)

3. Pulley is a simple machine made up of a rope or chain and a wheel around which the rope fits
(Pulley;  is;  a simple machine made up of a rope or chain and a wheel) & (a simple machine;  made up;  ) 
& (a wheel;  fits;  the rope)
	second tuple should be: (simple machine; made up;  <b>of a rope or chain and a wheel</b>)
	third tuple should be: (<b>the rope;  fits;  around a wheel</b>)

4. Orbit is the path that an object such as a planet makes as it revolves around a second object
(Orbit;  is; (the path that an object such as a planet; makes;  )) & (<b>it</b>;  revolves;  around a second object)
	should include: (an object such as a planet; makes; <b>the path</b>) 
	and resolve “it”: (<b>an object such as a planet</b>;  revolves;  around a second object)
	
5. Instinct is a behavior that an animal begins life with
(Instinct;  is;  a behavior that an animal begins life with) & (an animal; begins;  life;  with)
	should be: (Instinct;  is ; a behavior)  & (an animal; begins;  life;  <b>with a behavior</b>)

6. Classification is the grouping of things <b>by using a set of rules</b>
(Classification;  is; the grouping of things)
	SRL finds no subject for “use”

7. Competition is the struggle among living things for the same resources
(Competition;  is;  the struggle among living things for the same resources)
	misses relations: (the struggle, [is];  among living things) & (the struggle, [is];  for the same resources)

Cases where Open IE gets all relevant information

8. Adaptation is a special trait that helps an organism survive in its environment
(Adaptation;  is;  (a special trait; helps; ( an organism;  survive;  in its environment)))
	doubly nested tuple

9. Kidney is a bean-shaped organ that filters water and waste materials out of the blood
(Kidney;  is;  (a bean-shaped organ; filters ;water and waste materials; out of the blood))
	n-ary tuple nested within binary tuple

10. Stamen is the part of the plant that holds the male cells for reproduction
(Stamen;  is;  the part of (the plant; holds;  the male cells for reproduction))
	should be: (Stamen;  is; (the part of the plant;  holds; the male cells; for reproduction))

11. Fossil is the remains of a living thing from many years ago
(Fossil;  is;  the remains of a living thing from many years ago) 

12. Experiment is an organized test designed to support or disprove a hypothesis
(Experiment;  is;  (an organized test;  designed; to support or disprove a hypothesis)) 
& (an organized test;  to support; )
	
13. Carnivore is an animal that eats other animals
(Carnivore;  is;  (an animal;  eats;  other animals))

14. Forest floor is the ground level of a forest ecosystem
(Forest floor;  is;  the ground level of a forest ecosystem)
 
15. Magma is the melted rock inside earth
(Magma;  is;  the melted rock inside earth)

16. Normal fault is the crack or line between two plates that are pulling apart
(Normal fault;  is;  the crack or line between two plates) & (two plates;  are pulling; apart)