Skip to content

Commit

Permalink
Add Possible Implications slide to Statistical Interpretation of Alge…
Browse files Browse the repository at this point in the history
…braic Terms
  • Loading branch information
rgayler committed Jun 12, 2023
1 parent f974ee3 commit 8cdfaa8
Show file tree
Hide file tree
Showing 2 changed files with 37 additions and 9 deletions.
17 changes: 17 additions & 0 deletions presentation_Gayler_MidnightVSA_2023-06-15.html
Original file line number Diff line number Diff line change
Expand Up @@ -625,6 +625,23 @@ <h2>Terms as rotated features</h2>
</ul></li>
</ul></li>
</ul>
</section>
<section id="possible-implications" class="slide level2">
<h2>Possible implications</h2>
<ul>
<li>Operation of VSA regression/classification systems can be understood/analysed with respect to terms in hypervector
<ul>
<li>E.g. Integer Echo State Network builds standard sequence representation (Interpretable as set of lagged inputs)</li>
</ul></li>
<li>Representations can be designed to achieve objectives
<ul>
<li><p>What features needed for standard regression?</p></li>
<li><p>Create algebraic terms that implement those features</p>
<ul>
<li>E.g. Epileptic Seizure Challenge needed interactions of time-series features with time of day (bindings)</li>
</ul></li>
</ul></li>
</ul>
</section></section>
<section id="understand-everything-at-the-element-level" class="title-slide slide level1 center">
<h1>Understand everything at the element level</h1>
Expand Down
29 changes: 20 additions & 9 deletions presentation_Gayler_MidnightVSA_2023-06-15.qmd
Original file line number Diff line number Diff line change
Expand Up @@ -212,15 +212,26 @@ Interpret hypervector as specifying a set of indistinguishable realities rather

## Terms as rotated features

* In statistical modelling, we could rotate the data space
* Features are spread over columns
* Works if rotated features are orthogonal in the data space
* VSA uses regression to extract predictions from hypervectors
* Hypervectors often expressible as sum of algebraic terms
* Algebraic terms are often orthogonal (rotated features)
* Simple terms represent main effects
* Bindings represent interactions

- In statistical modelling, we could rotate the data space
- Features are spread over columns
- Works if rotated features are orthogonal in the data space
- VSA uses regression to extract predictions from hypervectors
- Hypervectors often expressible as sum of algebraic terms
- Algebraic terms are often orthogonal (rotated features)
- Simple terms represent main effects
- Bindings represent interactions

## Possible implications

- Operation of VSA regression/classification systems can be understood/analysed with respect to terms in hypervector
- E.g. Integer Echo State Network builds standard sequence representation (Interpretable as set of lagged inputs)
- Representations can be designed to achieve objectives
- What features needed for standard regression?

- Create algebraic terms that implement those features

- E.g. Epileptic Seizure Challenge needed interactions of time-series features with time of day (bindings)

# Understand everything at the element level

# Permutation and indices

0 comments on commit 8cdfaa8

Please sign in to comment.