Pattern Learning

From Knowitall
Revision as of 19:56, 20 October 2011 by Schmmd (talk | contribs) (Reducing the lemma grep results)

Jump to: navigation, search

Building the boostrapping data

Determining target relations

  1. Restrict high quality set of ClueWeb extractions to have proper noun arguments
  2. Choose the most frequent relations from this set

Determining target extractions

  1. Measure the occurrence of the arguments
  2. Keep extractions from the target relations that have arguments that occur commonly (100)

Reducing the lemma grep results

  1. Remove patterns that occur less than 5 times.
  2. Remove duplicate sentences.
  3. Remove extractions that have an (extraction, pattern) pairs that occurs anomalously frequently.
    1. There was a single one: (hotel reservation, be make, online) ocurred 32k times, the next one ocurred 8k times