Difference between revisions of "Vulcan/SystemStatus"
From Knowitall
| Line 8: | Line 8: | ||
<ol> | <ol> | ||
<li>Process sentence through Open IE 4.0 and convert it into a tuple. We refer to this query tuple as a proposition.</li> | <li>Process sentence through Open IE 4.0 and convert it into a tuple. We refer to this query tuple as a proposition.</li> | ||
| − | <li>Use the | + | <li>Use the textual evidence finder to find tuples and sentences that support the input sentences. Convert them into Tuffy's axioms and rules format.</li> |
<li>Create Tuffy evidence file to serve as the evidence facts for MLN.</li> | <li>Create Tuffy evidence file to serve as the evidence facts for MLN.</li> | ||
<li>Run Tuffy and output the marginal inference scores.</li> | <li>Run Tuffy and output the marginal inference scores.</li> | ||
| Line 22: | Line 22: | ||
[[File:Sys-arch-online.jpg|frame|center|alt=System Architecture|System Architecture: Online components]] | [[File:Sys-arch-online.jpg|frame|center|alt=System Architecture|System Architecture: Online components]] | ||
| − | === | + | === Textual Evidence Finder === |
Greg is going to be developing this component. | Greg is going to be developing this component. | ||
| − | [[File:weak-evidence-finder.jpg|frame|center|alt= | + | [[File:weak-evidence-finder.jpg|frame|center|alt=Textual Evidence Finder Details|System Architecture: Textual Evidence Finder]] |
| Line 36: | Line 36: | ||
| Proposition Extractor || Extracts propositions to be verified by the system || Input: Sentence asserting the answer choice.<br/> Output: A proposition represented as a open IE tuple. || <b>Stub implemented: </b> Sentence piped into Open IE 4.0. Output tuples that fit a specified pattern are converted into a proposition. || Select the best tuple. Stem, normalize, extract polarity, handle n-ary tuples. | | Proposition Extractor || Extracts propositions to be verified by the system || Input: Sentence asserting the answer choice.<br/> Output: A proposition represented as a open IE tuple. || <b>Stub implemented: </b> Sentence piped into Open IE 4.0. Output tuples that fit a specified pattern are converted into a proposition. || Select the best tuple. Stem, normalize, extract polarity, handle n-ary tuples. | ||
|- | |- | ||
| − | | | + | | Textual Evidence Finder || Provides evidence for the input proposition using <i>weak</i> text-based methods.|| Input: Proposition <br/>Output: Rules/Axioms that derive the proposition (in one-step) weighted according to the confidence provided by each method. || <b>Tuple matcher</b> implementation underway. Uses Open IE solr instance to find matching sentences/tuples.<br/><b>Pattern matcher</b> not implemented.<br/><!--b>Jena</b> evidence finder partly implemented. Produces a single derivation, which needs to be converted to axioms and rules. <span style="background-color:yellow"><b>Note: Not using Jena as a evidence finder anymore. Tuffy is optimized for efficient inference.</b></span--> || Implement pattern matching, improve tuple matching, add scores. |
|- | |- | ||
| MLN Instance Generator || Converts the evidence into MLN input format. || Input:Axioms/Rules from weaker methods.<br/>Output:Translated into Tuffy's input format.<br/> || <b>Stub implemented:</b> Does a faithful translation to MLN syntax. || Fix bug in predicate definitions. | | MLN Instance Generator || Converts the evidence into MLN input format. || Input:Axioms/Rules from weaker methods.<br/>Output:Translated into Tuffy's input format.<br/> || <b>Stub implemented:</b> Does a faithful translation to MLN syntax. || Fix bug in predicate definitions. | ||
Revision as of 17:04, 26 August 2013
Contents
Overview
The input to our inference system is a natural language sentence that corresponds to an answer choice. (e.g., Iron nail is a good conductor of electricity). The output is a score that represents the system's belief regarding the validity of the input sentence.
At a high-level the system performs the following steps:
- Process sentence through Open IE 4.0 and convert it into a tuple. We refer to this query tuple as a proposition.
- Use the textual evidence finder to find tuples and sentences that support the input sentences. Convert them into Tuffy's axioms and rules format.
- Create Tuffy evidence file to serve as the evidence facts for MLN.
- Run Tuffy and output the marginal inference scores.
The system consists of Inference (online) and Axiom and Rule generation (offline) components.
Inference Components
System Architecture: Online components
Textual Evidence Finder
Greg is going to be developing this component.
System Architecture: Textual Evidence Finder
Status
| Component | Description | I/O | Status | To Do |
|---|---|---|---|---|
| Proposition Extractor | Extracts propositions to be verified by the system | Input: Sentence asserting the answer choice. Output: A proposition represented as a open IE tuple. |
Stub implemented: Sentence piped into Open IE 4.0. Output tuples that fit a specified pattern are converted into a proposition. | Select the best tuple. Stem, normalize, extract polarity, handle n-ary tuples. |
| Textual Evidence Finder | Provides evidence for the input proposition using weak text-based methods. | Input: Proposition Output: Rules/Axioms that derive the proposition (in one-step) weighted according to the confidence provided by each method. |
Tuple matcher implementation underway. Uses Open IE solr instance to find matching sentences/tuples. Pattern matcher not implemented. |
Implement pattern matching, improve tuple matching, add scores. |
| MLN Instance Generator | Converts the evidence into MLN input format. | Input:Axioms/Rules from weaker methods. Output:Translated into Tuffy's input format. |
Stub implemented: Does a faithful translation to MLN syntax. | Fix bug in predicate definitions. |
| End-to-End Driver | Command line application. | Input: Sentence asserting an answer choice. Output:Score |
Stub implemented. | Create web interface. |
Axiom and Rule Generation Components
System Architecture: Offline components
| Component | Description | I/O | Status |
|---|---|---|---|
| Axioms Extractor | Generates axioms from multiple knowledge sources. | Input: Output: |
None. |
| Rules Generator | Uses second order rule templates to generate first-order inference rules. | Input: Output: |
None. |
