Skip to content

Commit

Permalink
Create hierarchical_graph_clip.md
Browse files Browse the repository at this point in the history
  • Loading branch information
dmarx authored May 7, 2024
1 parent ea02d4f commit 1eb686d
Showing 1 changed file with 7 additions and 0 deletions.
7 changes: 7 additions & 0 deletions hierarchical_graph_clip.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# contrastive learning of graph/manifold hierarchy

parameterize each level of the hierarchy as a code book. Assume the code book entries map directly to meta-nodes. The meta-graph describes inter-community relationships at some depth of the hierarchy.

the assignment of codebook entries to nodes of the knowledge graph (over the data) is one-to-many. Each node maps to a single meta-node, and meta-nodes can map to many nodes.

now, run DeLIP or CLIP or whatever contrastive objective over the pairings. so the node -> meta-node assignments can be parameterized as a classifier that is conditioned on some learnable vector, and we learn that vector through tthe CLIP objective on the pairings.

0 comments on commit 1eb686d

Please sign in to comment.