Difference between revisions of "Vulcan/MeetingNotes/Aug16 2013"
From Knowitall
(→Update) |
(→To Do (Copied over from previous week)) |
||
Line 48: | Line 48: | ||
== To Do (Copied over from previous week) == | == To Do (Copied over from previous week) == | ||
+ | |||
+ | == To Do == | ||
+ | |||
+ | ; System building | ||
+ | |||
+ | : 1. Implement "template matching" using the ClueWeb corpus.<b>Pending</b> | ||
+ | <blockquote> | ||
+ | * URL for Open IE backend is available. | ||
+ | * For an assertion A, find sentences that have high overlap. Generate regex patterns for the proposition. Score sentences by how well they match the regex patterns. | ||
+ | </blockquote> | ||
+ | |||
+ | : 2. Continue system building. | ||
+ | <blockquote> | ||
+ | * Create a derivation scorer stub. This will be replaced with a MLN or a BLP scorer. <b>Done.</b> | ||
+ | * Test with iron nail example. | ||
+ | </blockquote> | ||
+ | |||
+ | : 3. Jena API doesn't readily support multiple derivations. | ||
+ | <blockquote> | ||
+ | * Ask Jena community to find out if this is possible. <b>Done. Not possible.</b> | ||
+ | * OWLIM as replacement. <b>Done. Doesn't look promising. No response from community.</b> | ||
+ | </blockquote> | ||
+ | |||
+ | :4. Try out [http://hazy.cs.wisc.edu/hazy/tuffy/ Tuffy MLN] implemenatation. <b>Done.</b> | ||
+ | <blockquote> | ||
+ | * Use output of iron nail example | ||
+ | * If easy to use write wrappers around Tuffy to hook into our system. | ||
+ | </blockquote> | ||
+ | |||
+ | :5 Write evaluation code. <b>Vulcan has a good interface set up.</b> | ||
+ | <blockquote> | ||
+ | * Check with Peter. | ||
+ | </blockquote> | ||
+ | |||
+ | :6. Create a [[Vulcan/SystemArchitecture| system architecture]] page with a figure and overview of the main components. | ||
+ | <b>Created a [[Vulcan/SystemStatus| System status page]] instead.</b> | ||
+ | <blockquote> | ||
+ | * Created a figure. Added it to system design document. | ||
+ | * Need to create a wiki page for system architecture and overview. | ||
+ | </blockquote> | ||
+ | |||
+ | ; Experiments | ||
+ | |||
+ | : 1. Run template matching approach as a baseline. | ||
+ | |||
+ | : 2. Run inference system as a baseline. |
Revision as of 07:01, 16 August 2013
Update
- Focusing on system development.
- 1. Online components implemented. See System development status for details.
- Proposition generator
- Evidence finder -- Tuple matching over Open IE Clueweb data.
- 2. Components tested using ...
- 3. Evaluation...
- Vulcan has a good evaluation interface setup. We will use this for starters.
- Design questions.
- 1. Why not use MLN directly? Why use a backward chained inferencer (such as Jena) as an intermediate step?
- Looks like a separte backward-chained inferencer won't be necessary.
- Tuffy, an MLN implementation, does KBMC to scale MLN inference. Details [1]
- Analysis
- 1. Selected 10 propositions that are single Open IE tuples as starting targets.
- 2. Wrote down steps involved in verifying these propositions.
Agenda
To Do (Copied over from previous week)
To Do
- System building
- 1. Implement "template matching" using the ClueWeb corpus.Pending
- URL for Open IE backend is available.
- For an assertion A, find sentences that have high overlap. Generate regex patterns for the proposition. Score sentences by how well they match the regex patterns.
- 2. Continue system building.
- Create a derivation scorer stub. This will be replaced with a MLN or a BLP scorer. Done.
- Test with iron nail example.
- 3. Jena API doesn't readily support multiple derivations.
- Ask Jena community to find out if this is possible. Done. Not possible.
- OWLIM as replacement. Done. Doesn't look promising. No response from community.
- 4. Try out Tuffy MLN implemenatation. Done.
- Use output of iron nail example
- If easy to use write wrappers around Tuffy to hook into our system.
- 5 Write evaluation code. Vulcan has a good interface set up.
- Check with Peter.
- 6. Create a system architecture page with a figure and overview of the main components.
Created a System status page instead.
- Created a figure. Added it to system design document.
- Need to create a wiki page for system architecture and overview.
- Experiments
- 1. Run template matching approach as a baseline.
- 2. Run inference system as a baseline.