Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hierarchy browser #53

Merged
merged 90 commits into from
Oct 22, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
90 commits
Select commit Hold shift + click to select a range
c59ed04
Add shape and rocrate columns to samples.csv
will-moore Oct 7, 2024
4cd5994
Update branch name in samples.csv
will-moore Oct 7, 2024
555bdf2
Load all rows from csv but don't fetch data from zarrs
will-moore Oct 7, 2024
9725aa9
rough page layout started
will-moore Oct 7, 2024
4a12d78
Add colums to idr0157_samples.csv
will-moore Oct 7, 2024
eaf575f
Remove duplicate rows from webknossos_samples.csv
will-moore Oct 7, 2024
441997f
Use virtual list. Improve sorting with numbers
will-moore Oct 8, 2024
b340aa2
load_zarr_stats.py loads zarray and rocrate
will-moore Oct 8, 2024
f6748ba
Add idr0054_samples into idr_samples.csv
will-moore Oct 8, 2024
94fa014
Add missing ZarrListItem.svelte
will-moore Oct 8, 2024
b19a21f
Fix sorting by numbers
will-moore Oct 8, 2024
b66c098
Show Thumbnails for list items
will-moore Oct 8, 2024
12e6f30
Filter by nDims
will-moore Oct 8, 2024
d19230e
Temp: use temp JAX csv with extra columns
will-moore Oct 8, 2024
459cc1e
Add dimension_names to webknossos.csv
will-moore Oct 8, 2024
8ea7d08
Add validator and vizarr links, dims in table
will-moore Oct 9, 2024
91ef468
Add missing ome and vizarr logos
will-moore Oct 9, 2024
b38ca2c
Merge remote-tracking branch 'origin/main' into hierarchy_browser
will-moore Oct 9, 2024
be84399
Add columns to uni_muenster_samples.csv
will-moore Oct 9, 2024
256ec29
Point to uni_muenster_samples.csv from this branch
will-moore Oct 9, 2024
d35a74c
Merge remote-tracking branch 'origin/main' into hierarchy_browser
will-moore Oct 9, 2024
cda671b
Basic working filter by source
will-moore Oct 9, 2024
019a62f
Fix ome and vizarr logos
will-moore Oct 9, 2024
21ef679
Show thumbnails for sources
will-moore Oct 9, 2024
e35e91e
Use Thumbloader to try fix source thumbs
will-moore Oct 9, 2024
f872677
Don't show Thumbnail for each source
will-moore Oct 9, 2024
b995aee
Remove Sort-by url and source
will-moore Oct 9, 2024
22aab10
Move University of Muenster under n4bi.csv
will-moore Oct 10, 2024
dde24e5
Improve filtering by source
will-moore Oct 10, 2024
b77c67d
Filter by collections
will-moore Oct 10, 2024
857766b
css tweaks
will-moore Oct 10, 2024
24309a4
nfdi logo, specify v3 zarr for zarrita
will-moore Oct 10, 2024
29d4323
load_zarr_stats.py has one load_json()
will-moore Oct 11, 2024
4c24c3f
Filter by Organism
will-moore Oct 11, 2024
f3b881a
Add filter by imagingModality
will-moore Oct 12, 2024
6b17705
Add jax_samples.csv to link to both JAX csvs
will-moore Oct 13, 2024
bff2c30
Filter by name and description
will-moore Oct 13, 2024
667b674
Move text filter below other controls
will-moore Oct 13, 2024
91a8227
Show zarr name always and description if matches textFilter
will-moore Oct 13, 2024
2542801
Remove vizarr link. Add origin link for each zarr
will-moore Oct 14, 2024
7d2143e
Use row shape data to pick dataset index for thumbnail
will-moore Oct 14, 2024
dd6345b
Thumbnails larger and show spinner while loading
will-moore Oct 14, 2024
8e22edd
Import omeLogo from public. Delete ThumbGallery
will-moore Oct 14, 2024
5c5074d
Merge remote-tracking branch 'origin/main' into hierarchy_browser
will-moore Oct 14, 2024
656067d
Move ImageList component to new svelte file
will-moore Oct 14, 2024
5f115dd
Handle virtual list scroll to also scroll the page
will-moore Oct 14, 2024
c9f1c85
Add sidebar for filters. Use select for collections
will-moore Oct 14, 2024
322a071
Use 'Original data' for link
will-moore Oct 14, 2024
abaaf65
Smaller thumbnails 120px, add cols to other_samples.csv
will-moore Oct 14, 2024
f731e17
Add random sorting to show a mix from each collection
will-moore Oct 14, 2024
c2e36ca
css tweak .imageListContainer border
will-moore Oct 14, 2024
2293fa5
Add a copy of Jülich's fzj.csv, without BigBrain.zarr
will-moore Oct 14, 2024
4e99b70
Add columns to a copy of crick.csv
will-moore Oct 15, 2024
1a2af45
load_zarr_stats.py handles bf2raw series. Add local flamingo.csv with…
will-moore Oct 15, 2024
511c5d0
Add series0 column to flamingo.csv. Used for Thumbnail image path
will-moore Oct 15, 2024
ec50ddb
Each image items links to it's sample.csv
will-moore Oct 15, 2024
9f12224
Remove whitespace from n4bi.csv
will-moore Oct 15, 2024
f9785f6
Whitespace fix in crick.csv
will-moore Oct 15, 2024
d94e589
load_zarr_stats.py removes duplicate. jax_samples.csv links to update…
will-moore Oct 15, 2024
69010ce
Improve select filtering
will-moore Oct 15, 2024
c03dbd2
White background, UI makeover
will-moore Oct 15, 2024
c847454
Use AbortController to try abort chunks onDestroy()
will-moore Oct 15, 2024
6fbc580
Fix auto-scroll back on list scroll
will-moore Oct 16, 2024
1aa2837
Fix thumbnail aspect ratio while loading
will-moore Oct 16, 2024
1d19c89
Don't show '0 sources' when viewing collection
will-moore Oct 16, 2024
c486733
Add idr0066_samples.csv
will-moore Oct 16, 2024
522ed1a
Boost contrast of thumbnails if needed
will-moore Oct 16, 2024
bb8da59
Fix 'undefined' for csv link
will-moore Oct 16, 2024
1dd0fb1
Support sorting by chunk and shard sizes
will-moore Oct 16, 2024
8c3b056
Basic popup to show larger image and rowData
will-moore Oct 17, 2024
f7c6596
Improve formatting of image info in list
will-moore Oct 17, 2024
b0c2278
Move text filter up. New heading
will-moore Oct 18, 2024
ca7b7f1
Fix postion of 'clear' button
will-moore Oct 18, 2024
830c03b
Move all sort options under select
will-moore Oct 20, 2024
c294e8d
Add subheading and home link to collection page
will-moore Oct 21, 2024
233d591
Improve layout for wider screens. Click source X to clear
will-moore Oct 21, 2024
a85937a
Add wells and images columns to various samples.csv files
will-moore Oct 21, 2024
d0cca48
Show total bytes for sources, with plates/images in tooltip
will-moore Oct 21, 2024
8ce0b35
Hide name and other text on small screens
will-moore Oct 21, 2024
462bccd
add_about_page
will-moore Oct 21, 2024
aa5658e
Always show collection csv
will-moore Oct 21, 2024
77695c3
Fix 404
will-moore Oct 22, 2024
bcc2638
use <base> element for relative URLs
will-moore Oct 22, 2024
107c63f
Try fix about/ link
will-moore Oct 22, 2024
3525b85
Fix home link in Nav
will-moore Oct 22, 2024
aad4847
cloneIndexHtmlPlugin() added to vite.config.js
will-moore Oct 22, 2024
48755a7
Add ome favicon
will-moore Oct 22, 2024
4274150
Add text to /about page
will-moore Oct 22, 2024
7621f57
Remove 'In the summer...' when showing a collection
will-moore Oct 22, 2024
21f480f
Text filter includes zarr url
will-moore Oct 22, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions ome2024-ngff-challenge/index.html
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
<!doctype html>
<html lang="en">
<head>
<link rel="icon" href="/favicon-16x16.png" />
<meta charset="UTF-8" />
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
<title>ome2024-ngff-challenge</title>
Expand Down
6 changes: 6 additions & 0 deletions ome2024-ngff-challenge/package-lock.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

1 change: 1 addition & 0 deletions ome2024-ngff-challenge/package.json
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,7 @@
},
"dependencies": {
"papaparse": "^5.4.1",
"svelte-tiny-virtual-list": "^2.1.2",
"zarrita": "^0.4.0-next.15"
}
}
Binary file added ome2024-ngff-challenge/public/favicon-16x16.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
1 change: 1 addition & 0 deletions ome2024-ngff-challenge/public/github-mark-white.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added ome2024-ngff-challenge/public/nfdi4bioimage.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
21 changes: 21 additions & 0 deletions ome2024-ngff-challenge/public/ome-logomark.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
1 change: 1 addition & 0 deletions ome2024-ngff-challenge/public/selectCaret.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added ome2024-ngff-challenge/public/vizarr_logo.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
71 changes: 71 additions & 0 deletions ome2024-ngff-challenge/src/About.svelte
Original file line number Diff line number Diff line change
@@ -0,0 +1,71 @@
<div>
<h2>Introduction</h2>
<p>
The <a href="https://forum.image.sc/t/ome2024-ngff-challenge/97363">2024 OME-NGFF Challenge</a>
was conceived at the
<a href="https://www.openmicroscopy.org/events/ome-community-meeting-2024/">
OME Annual Community Meeting</a>
in Dundee in May 2024. The stated goals of Challenge were:
</p>

<ul>
<li>
Collect examples of OME-Zarr from multiple modalities, use cases, and
institutions, available from a single location.
</li>
<li>
Test the utility (and lack thereof) of existing OME-Zarr metadata and
image viewers.
</li>
<li>
Advance the adoption of the Zarr V3 specification, and also existing
OME-Zarr RFCs.
</li>
</ul>
<p>
The inspiration for the Challenge came from presentations at the OME Meeting
that demonstrated the level of adoption of OME-Zarr, but highlighted the
poor findability of the data.
</p>
<p>
Work on the challenge started in earnest in July 2024. All progress is
tracked in the <a href="https://github.com/ome/ome2024-ngff-challenge">ome2024-ngff-challenge</a>
repo. It was agreed that the results
of the OME-NGFF Challenge would be presented at the
<a href="https://globalbioimaging.org/exchange-of-experience/exchange-of-experience-ix">
2024 Global BioImaging Meeting</a>.
</p>

<h2>Process</h2>
<p>
The Challenge was run via a series of virtual meetings coordinated on the
Image.sc Forums, with all
<a href="https://hackmd.io/3emKqKQsT_2U35vLepzDEQ">notes and lists of participants</a>
available.
</p>

<h2>Results</h2>
<p>
At the outset, we weren’t sure how much OME-Zarr data was available, if it
could be converted to Zarr V3, or how many organisations would participate.
In the end, we have far exceeded our expectations, with more than 0.5 PByte
of OME-Zarr made available, across a wide range of modalities.
</p>
<p>
To make the assembly as accessible as possible, we built the the OME-NGFF
Challenge Viewer [URL?}, which incorporates a CSV with locations of
datasets, and connects datasets to the OME NGFF Validator, for metadata
validation and viewing.
</p>
<p>
Perhaps the most important outcome of the Challenge is the establishment of
a federated bioimage data system based on OME-Zarr. To our knowledge, this
is the largest federated bioimage data collection ever assembled.
</p>
</div>

<style>
div {
margin: 15px;
}
</style>
Loading