Twelve people used both tools, one tool per task, with the order counterbalanced3. All twelve finished their WebMemo task; with OttoGrid, one hit the 30-minute limit. They rated WebMemo’s results as more trustworthy: a mean trust rating of 4.42 against 3.33 (p = .027), on a scale the draft does not give.
Mean ratings on the draft’s 5-point scale, where higher is better.
| Statement | WebMemo | OttoGrid | p |
| Collects data without interrupting browsing | 4.92 | 3.33 | .005 |
| Organizes page content into a structure | 4.67 | 4.42 | .54 |
| Less to remember across sources | 4.75 | 4.25 | .22 |
| Saves time over collecting by hand | 4.67 | 3.67 | .039 |
Mean completion times were lower with WebMemo in both tasks: 223 against 315 seconds for the researcher task and 802 against 911 for the shopping task. The draft reports no test for the times. One participant put the trust result this way: “dynamically showing rows makes me understand that WebMemo is reading the website.”
The draft also says what WebMemo does not do yet. It does not flag entries that are probably wrong, and it does not learn from a person’s corrections.