Releases: wandb/weave
Releases · wandb/weave
v0.51.25
What's Changed
- style(weave): restyle carousel view by @jwlee64 in #3205
- chore(weave): Add generic iterator for trace server API objects by @andrewtruong in #3177
- feat(weave): Support op configuration for autopatched functions (starting with OpenAI) by @andrewtruong in #3197
- chore(ui): update UUID dependency to v11 (latest) by @jamie-rasmussen in #3208
- chore(ui): remove some unused code by @jamie-rasmussen in #3157
- chore(ui): Create scorer drawer style + small annotation drawer style tweaks by @gtarpenning in #3186
- chore(ui): fix save state in human annotations when null or invalid by @gtarpenning in #3185
- docs(weave): Remove api_key hardcodes in code examples by @J2-D2-3PO in #3214
- feat(ui): Add error details button by @jamie-rasmussen in #3215
- chore(ui): Trace tree: center line to point to the title of the call by @m-rgba in #3219
- chore(ui): Playground: make editor component resizeable by @m-rgba in #3217
- chore(weave): Better error message for scorer signature validation by @andrewtruong in #3115
- fix(weave): fix anthropic chats in playground by @jwlee64 in #3213
- chore(ui): uuid should be in dependencies now by @jamie-rasmussen in #3225
- chore(weave): add spiral icon by @mbarrramsey in #3226
- chore(app): Allow skipping night-aware class for TextField by @connieelee in #3228
- feat(weave): Add 'tracing_sample_rate' param to weave.op by @adrnswanberg in #3195
- chore(weave): add two providers to backend by @jwlee64 in #3242
- style(weave): add icons to trace tree by @jwlee64 in #3227
- chore(weave): set seed in op sampling test by @gtarpenning in #3249
- docs(weave): Update models list in Playground doc by @J2-D2-3PO in #3246
- chore(ui): Playground: add copy button, tooltip on toggles by @m-rgba in #3218
- docs(weave): Upload and document Service API notebook by @J2-D2-3PO in #3170
- docs(weave): Don't use scary warnings if we don't need to by @J2-D2-3PO in #3253
- chore(weave): Add import time benchmarking script by @andrewtruong in #3234
- chore(weave): (python-only) Refactor and rename code to more appropriately handle builtin_object_class not base_object_class by @tssweeney in #3248
- chore(weave): small ui changes by @jwlee64 in #3254
- chore(app): allowing optional regex searching in a dropdown by @jtulk in #3255
- chore(weave): add grok-beta and nova llms to playground by @jwlee64 in #3243
- chore(weave): Update choice carousel tooltip copy by @jwlee64 in #3262
- style(weave): Hide function drawer textarea draggable by @jwlee64 in #3263
- chore(ui): addicon codegen, diff icon by @jamie-rasmussen in #3258
- docs(weave): Update platform doc with dedicated cloud info by @J2-D2-3PO in #3244
- chore(weave): add some links to Release instructions by @jamie-rasmussen in #3210
- chore(weave): Fixes error overflow by @tssweeney in #3266
- feat(weave): Add tracking for openai moderation and embeddings api by @abraham-leal in #3252
- chore(weave): Regen latest docs by @tssweeney in #3265
- chore(weave): Increase import test time by @andrewtruong in #3272
Full Changelog: v0.51.24...v0.51.25
v0.51.24
What's Changed
- chore(ui): unhide scorer, no admin text by @jamie-rasmussen in #3140
- chore(ui): annotations design review cleanup by @gtarpenning in #3122
- feat(weave): Expose simple way to get the captured code for an op by @andrewtruong in #3139
- chore(ui): move Overview back to sidebar top for Models-only projects by @jamie-rasmussen in #3141
- chore(app): Add launch is Active to
useProjectSidebar
by @KyleGoyette in #3005 - chore(ui): right drawer doesn't occlude call metrics charts by @bcsherma in #3149
- chore(weave): add o1-preview back and latest 4o by @jwlee64 in #3151
- chore(ui): add custom styles to column menu items by @bcsherma in #3152
- chore(weave): Temporarily pin wandb version in mypy to unblock CI by @andrewtruong in #3160
- chore(weave): Tidy op.py by @andrewtruong in #3143
- refactor(ui): break an import cycle by @jamie-rasmussen in #3155
- chore(weave): Improve large object viewer renders by @tssweeney in #3102
- chore(weave): capture request id for openai completions by @bcsherma in #3153
- chore(ui): update calls table column menu icons by @bcsherma in #3162
- chore(ui): add filled circle icon by @jamie-rasmussen in #3163
- chore(weave): add DynamicBatchProcessor class for call stream batching by @gtarpenning in #3167
- chore(weave): add with_new_client context for concurrent ch queries by @gtarpenning in #3168
- chore(ui): fix warning about key attr spread by @jamie-rasmussen in #3173
- chore(weave): set default call stream batch size to 100 by @gtarpenning in #3169
- chore(weave): ui op selecter jump back to top fix by @gtarpenning in #3174
- feat(weave): Add option to name weave evals (and give a memorable name if not specified) by @andrewtruong in #3135
- chore(ui): Add TooltipDeprecated by @jamie-rasmussen in #3176
- chore(ui): pluralize calls link by @jamie-rasmussen in #3178
- chore(ui): Playground design tweaks (header, buttons) by @m-rgba in #3172
- chore(ui): Update metadata header styling by @m-rgba in #3049
- chore(ui): disable refresh while refreshing by @gtarpenning in #3179
- style(app): Update tailwind shadow configs by @connieelee in #3180
- feat(weave): Add AzureOpenAI support for Scorers by @tssweeney in #3171
- chore(weave): add sun and moon icons by @jamie-rasmussen in #3182
- chore(ui): fix typo by @jamie-rasmussen in #3183
- chore(ui): split up and page metrics in eval compare summary section by @gtarpenning in #2672
- feat(ui): Support Anthropic calls in Chat View by @jamie-rasmussen in #3187
- feat(ui): Add ExpandingPill component by @connieelee in #3184
- chore(weave): ui_url error gives a hint about the problem by @jamie-rasmussen in #3190
- fix(app): render bounding boxes on media panel without points by @brianlund-wandb in #3158
- fix(ui): feedback header when empty by @gtarpenning in #3191
- chore(ui): make eval section header draggable by @gtarpenning in #2637
- chore(weave): Update ToggleButtonGroup to allow disabling individual options by @ericakdiaz in #3194
- chore(weave): Fix predict detection heuristic for evals by @tssweeney in #3196
- fix(ui): Evaluations -- normalize radar data, show real values for bar charts by @gtarpenning in #3199
- chore(weave): update db to use replicated tables by @raubitsj in #3148
- style(weave): Add choices drawer by @jwlee64 in #3203
- chore(weave): hide admin only scorers tabs by @tssweeney in #3207
- chore(weave): fix choices in weave by @jwlee64 in #3204
- chore(weave): unhide completion iterations by @jwlee64 in #3137
New Contributors
- @brianlund-wandb made their first contribution in #3158
Full Changelog: v0.51.23...v0.51.24
v0.51.23
What's Changed
- chore(weave): Rethrow useExpandedNode error for proper serialization by @domphan-wandb in #3017
- chore(ui): change dataset link by @jamie-rasmussen in #3040
- fix(weave): Elide display names that exceed the char limit by @andrewtruong in #3046
- chore(weave): hide annotations button temporarily by @tssweeney in #3048
- fix(weave_query): Ensure newVars are passed in when expanding a panel op by @domphan-wandb in #3059
- feat(ui): create ToggleButtonGroup component by @molliean in #2995
- chore(weave): add to sidebar, and add open in playground button by @jwlee64 in #3035
- chore(ui): trim trailing zeros in number viewer by @jamie-rasmussen in #3073
- chore(weave): Wrap up loose ends with Annotations by @tssweeney in #3050
- fix(ui): compare cells with boolean values appearing empty by @jamie-rasmussen in #3079
- chore(weave): enable server side object-id validation by @gtarpenning in #3074
- perf(ui): second cost query ignore all expensive columns by @gtarpenning in #3077
- chore(ui): improve cost query perf in trace tree too by @gtarpenning in #3080
- docs(weave): Update Playground docs by @J2-D2-3PO in #3084
- chore(ui): fix error message in console, key prop in jsx by @gtarpenning in #3082
- chore(ui): recyle -> refresh button by @gtarpenning in #3085
- chore(ui): Visual update summary area on call views by @m-rgba in #3041
- chore(ui): Playground style updates by @m-rgba in #3064
- feat(weave): create and view
scorers
, now in the side nav bar by @gtarpenning in #3025 - chore(ui): unhide annotation sidebar edit button by @gtarpenning in #3086
- chore(ui): call tree costs fix by @gtarpenning in #3087
- fix(weave): Fix issue where getting an attribute of a pydantic object would infinitely recurse by @andrewtruong in #3078
- feat(weave): Implement VertexAI integration by @soumik12345 in #2743
- feat(weave): Patch
send_message
in Google GenAI SDK by @soumik12345 in #2746 - fix(weave): Temporarily hide weave server and deploy UI hints by @andrewtruong in #3057
- fix(weave): netrc entry handling in Weave JS SDK login method by @thanos-wandb in #3069
- chore(ui): dont sortby in the costs query by @gtarpenning in #3089
- chore(weave): hide litellm from error messages by @jwlee64 in #3067
- chore(app): Adding a new ghost state for textfield component by @jcrawley in #3062
- fix(ui): improved comparison performance and object handling by @jamie-rasmussen in #3088
- fix(weave_query): prevent table state loss when encountering a new logged column by @domphan-wandb in #3060
- fix(weave_query): add refinement op to get types for artifactVersion-files op by @domphan-wandb in #3058
- chore(ui): add back costs to call summary page by @gtarpenning in #3094
- fix(weave_query): Add artifactVersion-file type refinement to weave-js by @domphan-wandb in #3083
- chore(weave): Allow removing the system message by @jwlee64 in #3095
- chore(weave): system message role by @jwlee64 in #3098
- fix(ui): Fixes z-index issue with Playground and navigation sidebar by @m-rgba in #3100
- chore(weave): add headers to llm dropdown by @jwlee64 in #3097
- chore(ui): hide feedbackSidebar url param if false by @gtarpenning in #3091
- chore(weave): Pin instructor for python3.9 by @andrewtruong in #3105
- fix(ui): Prevent Switch component from shrinking in flex containers by @molliean in #3101
- fix(ui): better defaults for trace/eval trace tree by @gtarpenning in #3106
- style(weave): style try in playground, hide button in peek view in playground by @jwlee64 in #3075
- chore(ui): Add data-test element to PanelComp control wrapper by @KyleGoyette in #3031
- docs(weave): Update new feedback docs by @J2-D2-3PO in #3093
- chore(weave): load model default properly by @jwlee64 in #3096
- chore(ui): night mode text color for More link in nav by @jamie-rasmussen in #3107
- chore(ui): rearrange nav by @jamie-rasmussen in #3103
- fix(weave): dictify for vertexai integration by @soumik12345 in #3110
- feat(weave): add Bedrock llms to playground by @jwlee64 in #3092
- docs(weave): Update Playground docs with Bedrock info by @J2-D2-3PO in #3117
- docs(weave): Include Prompt classes in generated API docs by @jamie-rasmussen in #3099
- fix(ui): emojis looking bad in night mode by @jamie-rasmussen in #3118
- chore(weave): Hide scorer UI from all users by @tssweeney in #3121
- chore(weave): remote trace server client retries http 500 by @bcsherma in #3116
- test(weave_query): remove flaky batching test by @domphan-wandb in #3120
- chore(weave): increase call start/end timestamp resolution to microseconds by @bcsherma in #3119
- chore(weave): Use classmethods for from_* methods by @andrewtruong in #3123
- docs(weave): Update
create_call
python snippet in tracing.mdx by @luisbergua in #3130 - docs(weave): Add Comparison docs by @J2-D2-3PO in #3124
- fix(ui): latency chart with unfinshed calls by @jamie-rasmussen in #3126
- chore(ui): add new automated workspace icon by @connieelee in #3134
- chore(weave_ts): Update packaging by @andrewtruong in #3052
- chore(weave): Tidy image serializer import check by @andrewtruong in #3131
- fix(weave): allow for no inputs on langchain.Run by @bcsherma in #3138
- chore(ui): delete unused SideNav code by @jamie-rasmussen in #3127
- fix(weave): Add explicit object preparation hook for types that need it (e.g.
PIL.Image.Image
) by @andrewtruong in #3129
New Contributors
- @molliean made their first contribution in #2995
- @luisbergua made their first contribution in #3130
Full Changelog: v0.51.22...v0.51.23
v0.51.22
What's Changed
- chore(weave): Wire up completions by @jwlee64 in #3009
- chore(weave): Pin pydantic by @andrewtruong in #3034
- chore(weave): message panel buttons and editor by @jwlee64 in #3010
- chore(ui): fix Category pill column truncation by @jamie-rasmussen in #3033
- chore(ui): simplify CellValue by @jamie-rasmussen in #3024
- chore(ui): lighten trace tree lines by @jamie-rasmussen in #3037
- feat(ui): object comparison by @jamie-rasmussen in #2942
- feat(weave): simple prompt classes by @jamie-rasmussen in #3032
- fix(weave): Fix issue where Evaluation can raise unexpectedly due to bad scorer by @andrewtruong in #3039
- docs(weave): Remove
#highlight-next-line
to fix indentation issue by @J2-D2-3PO in #3021 - chore(weave): Pull str limit magic numbers into const by @andrewtruong in #3042
- chore(weave): Cleanup save object basic by @andrewtruong in #3015
- chore(weave): Remove signature from Op by @andrewtruong in #2989
- chore(weave): Better names for internal methods by @andrewtruong in #2982
- fix(weave): Bump display name limit to 1024 chars by @andrewtruong in #3043
Full Changelog: v0.51.21...v0.51.22
v0.51.21
What's Changed
- chore(weave): cosmetic tweak to examples obj and test for annotation spec by @gtarpenning in #3026
- chore(weave): Fix deps by @tssweeney in #3029
Full Changelog: v0.51.20...v0.51.21
v0.51.20
What's Changed
- chore(ui): fix react display name by @jamie-rasmussen in #2859
- style(weave): update border color by @jwlee64 in #2860
- chore(weave): 10GB memory limit for stream query by @gtarpenning in #2858
- chore(weave): Fix LiteLLM Tests by @tssweeney in #2867
- chore(ui): Upgrade to React18. Does not include typedef changes. by @nhusher in #2773
- feat(ui): navigate up/down on the calls page from the peek drawer by @gtarpenning in #2798
- chore(ui): add overflow-vertical icon by @jamie-rasmussen in #2866
- chore(weave): updating styles for new dropdowns by @mbarrramsey in #2861
- fix(weave): Make Weave* objects deepcopy-able by @andrewtruong in #2868
- chore(weave): Add delay to Google live test retries by @andrewtruong in #2869
- chore(weave): Add pyright to CI by @andrewtruong in #2870
- chore(weave_ts): Add explicit timeout to publish test by @andrewtruong in #2871
- chore(weave): pyright: enable reportFunctionMemberAccess by @andrewtruong in #2872
- chore(weave): pyright: enable reportOptionalSubscript by @andrewtruong in #2873
- chore(weave): pyright: enable reportTypedDictNotRequiredAccess, reportIndexIssue, reportOperatorIssue, reportGeneralTypeIssues, reportPrivateImportUsage, (and add missing dep) by @andrewtruong in #2874
- chore(weave): pyright: enable reportAssignmentType by @andrewtruong in #2875
- chore(weave): pyright: enable reportInconsistentOverload by @andrewtruong in #2876
- chore(weave): pyright: enable reportIncompatibleMethodOverride by @andrewtruong in #2877
- chore(weave): pyright: enable reportReturnType by @andrewtruong in #2878
- chore(weave): pyright: enable reportRedeclaration by @andrewtruong in #2879
- chore(weave): Adds weave_call_id, and option to not track to llm completions by @jwlee64 in #2829
- chore(ui): fix typo in variable name by @jamie-rasmussen in #2885
- chore(weave): ruff: enable UP006 by @andrewtruong in #2886
- chore(weave): simplify op decorator usage internally by @andrewtruong in #2880
- fix(ui): Sorted aggregated columns no longer crash tables during ungrouping by @nicholaspun-wandb in #2802
- chore(weave): ruff: enable UP007 by @andrewtruong in #2887
- chore(weave): ruff: enable UP028 by @andrewtruong in #2888
- chore(weave): ruff: enable UP031 by @andrewtruong in #2889
- chore(weave): ruff: enable UP036 by @andrewtruong in #2890
- chore(weave): ruff: enable UP032 by @andrewtruong in #2891
- chore(weave): ruff: enable UP034 by @andrewtruong in #2892
- chore(weave): ruff: enable UP035 by @andrewtruong in #2893
- chore(weave): ruff: enable UP015 by @andrewtruong in #2894
- chore(weave): ruff: enable UP037 by @andrewtruong in #2895
- chore(weave): ruff: enable UP024 by @andrewtruong in #2896
- chore(weave): ruff: enable UP022 and cleanup selected lint checks by @andrewtruong in #2897
- chore(weave): Add util to strip EXIF Metadata (and save 30-50% filesize per img) by @andrewtruong in #2863
- chore(weave): Implement enhaced feedback structure and mvp filter/query layer by @tssweeney in #2865
- chore(weave): ruff: enable C409 by @andrewtruong in #2906
- chore(weave): ruff: enable C400 by @andrewtruong in #2907
- chore(weave): ruff: enable C419 by @andrewtruong in #2908
- chore(weave): ruff: enable C408 by @andrewtruong in #2909
- chore(weave): ruff: enable C403 by @andrewtruong in #2910
- chore(weave): ruff: enable C416 by @andrewtruong in #2911
- chore(weave): ruff: enable C417 by @andrewtruong in #2912
- chore(weave): ruff: enable C405 by @andrewtruong in #2913
- chore(weave): ruff: enable C except for C901 and cleanup selected lint checks by @andrewtruong in #2914
- chore(weave): ruff: enable W293 and cleanup selected lint checks by @andrewtruong in #2899
- chore(weave): ruff: enable TRY002 by @andrewtruong in #2901
- chore(weave): ruff: enable TRY004 by @andrewtruong in #2903
- chore(weave): ruff: enable TRY300 by @andrewtruong in #2904
- chore(weave): ruff: enable TRY400 by @andrewtruong in #2905
- chore(weave): Add pytest retry by @andrewtruong in #2919
- chore(weave): Fixes Leaderboard CTA in app by @tssweeney in #2898
- chore(weave): disable markdown in chat view by @jwlee64 in #2917
- chore(weave): add optional step to text field input by @gtarpenning in #2916
- fix(ui): refetch when changing filter state from frozen -> not frozen by @gtarpenning in #2915
- fix(weave): Add deepcopy methods for boxed types by @andrewtruong in #2900
- chore(weave): Fix lint by @tssweeney in #2923
- chore(weave): Class-based scorer runnable ref fix by @tssweeney in #2922
- chore(weave): Add materialized views that will make it easier to do billing calculations by @adrnswanberg in #2636
- chore(weave): Online Evals Part 1: Backend support for on-demand LLM Judges by @tssweeney in #2882
- chore(ui): check Op code for literal credentials by @jamie-rasmussen in #2812
- chore(weave): Move deepcopy methods to Ref by @andrewtruong in #2924
- feat(weave): Make Dataset iterable by @andrewtruong in #2928
- chore(weave): add buzzbot10 icon by @jwlee64 in #2931
- chore(weave): scaffolding for playground page by @jwlee64 in #2918
- fix(weave_query): Remove unused import blocking server startup by @nicholaspun-wandb in #2933
- chore(weave): add feedback replace endpoint that purges -> creates in one step by @gtarpenning in #2799
- chore(weave): add settings drawer with simple toggle by @jwlee64 in #2935
- chore(weave): basic sdk for human feedback spec types by @gtarpenning in #2801
- chore(weave): Add chat top bar by @jwlee64 in #2936
- chore(weave): Rename ActionDefintion to ActionSpec to match naming patterns by @tssweeney in #2938
- chore(weave): fix images damaged by exif stripping by @andrewtruong in #2930
- fix(weave): Use sdk-local deserializer instead of saved deserializer for known types like Images by @andrewtruong in #2696
- chore(weave): Llm dropdown by @jwlee64 in #2939
- chore(weave): add slider settings to setttings drawer by @jwlee64 in #2940
- feat(weave_query): Add string op to parse number with thousands and decimal separators by @nicholaspun-wandb in #2864
- fix(ui): ignore parent when nonexistent in trace tree view by @gtarpenning in #2945
- chore(weave): Remove bytes stored info from UI by @tssweeney in #2944
- chore(weave): Setup hidden Scorers Page by @tssweeney in #2943
- chore(weave): Sort selection columns such that clickhouse analytics group similar queries by @tssweeney in #2947
- chore(weave): Increase query mem limit for calls by @tssweeney in #2948
- chore(weave): stop sequence editor by @jwlee64 in #2951
- chore(weave): function editor by @jwlee64 in #2949
- style(weave): move the show more buttons to the left by @jwlee64 in #2957
- chore(weave): update tooltip depending on if we can expand all by @jwlee64 in #2955
- chore(weave): Response editor by @jwlee64 in #2950
- chore(weave): using chevron icon for runSelector dropdowns b...
v0.51.19
What's Changed
- docs(weave_ts): Add Weave TS docs by @andrewtruong in #2782
- chore(weave_ts): Increase jest timeout for live tests by @andrewtruong in #2820
- docs(weave): Update tutorials from model_output -> output by @andrewtruong in #2840
- chore(weave): update costs by @jwlee64 in #2841
- test(weave): Add
custom
shard for custom testing by @andrewtruong in #2838 - feat(weave_ts): Add option to get a single call back from the client by @andrewtruong in #2836
- chore(weave_ts): Cleanup netrc by @andrewtruong in #2832
- fix(weave_ts): Fix printed URL links by @andrewtruong in #2834
- chore(weave_ts): Bump to v0.7.0 by @andrewtruong in #2843
- docs(weave): Correct model name for gpt-4o by @adrnswanberg in #2842
- fix(docs): Update broken link by @adrnswanberg in #2845
- chore(weave): Add pyright by @andrewtruong in #2846
- chore(weave): Dont report missing imports pyright by @andrewtruong in #2849
- feat(weave): Project level leaderboards by @tssweeney in #2634
- chore(ui): make metrics switch label clickable by @jamie-rasmussen in #2844
- fix(weave): do not automatically apply down migrations by @raubitsj in #2855
- chore(ui): add data-grip icon from design by @jamie-rasmussen in #2848
- chore(weave): revert 2 part calls query by @gtarpenning in #2857
- feat(weave): enable dictify of inputs and outputs by @jamie-rasmussen in #2818
Full Changelog: v0.51.18...v0.51.19
v0.51.18
What's Changed
- chore(weave): minor release note update by @jamie-rasmussen in #2735
- fix(ui): Add numerical type checks to columnFormat by @domphan-wandb in #2726
- fix(weave_query): Handle paths with colons when escaping artifact path by @nicholaspun-wandb in #2638
- fix(ui): improve styles of audio caption for better readability by @thanos-wandb in #2740
- fix(ui): query panel suggestions displays the info of the next row due to an off-by-1 error by @nicholaspun-wandb in #2635
- docs(weave): add media types doc by @gtarpenning in #2739
- chore(weave): ChatCompletion not imported by @gtarpenning in #2741
- chore(weave): Use cost query in calls table by @jwlee64 in #2358
- fix(ui): Bump version of
visit
to resolve import error by @nhusher in #2744 - feat(weave): add byte usage to summary tab and object page by @harukatab in #2747
- chore(weave): media docs copy change by @gtarpenning in #2761
- chore(ui): updating default style for radix tooltip by @jcrawley in #2759
- chore(ui): Adding stable option for Tailwind when display: contents is desired by @jtulk in #2758
- chore(weave): Add Object and Feedback Action Objects - Hackweek 1 by @tssweeney in #2769
- fix(weave): global df in op fails during op saving by @gtarpenning in #2755
- chore(weave): some groundwork for Prompt objects by @jamie-rasmussen in #2729
- chore(ui): don't show focus outline on calls grid by @jamie-rasmussen in #2763
- chore(ui): Creating a wave loader to start migrating app loaders by @jtulk in #2775
- chore(weave): Add back hook to check for weave data by @ericakdiaz in #2774
- chore(weave): remove unnecessary conditional by @jamie-rasmussen in #2777
- chore(ui): Added copy button for exception trace by @m-rgba in #2776
- docs(weave): Audio with weave by @wylerz in #2750
- chore(weave): assume latest version if no digest/alias specified by @jamie-rasmussen in #2783
- chore(ui): Color updates for wave loader by @jtulk in #2787
- docs(weave): Fix for cookbook Audio with weave #2792 by @wylerz in #2793
- docs(weave): Update cost docs by @jwlee64 in #2794
- feat(weave): Add initial suite of scorers, refactor weave/flow by @morganmcg1 in #2662
- docs(weave): fix import error by @wylerz in #2797
- chore(ui): ejecting markdown from tailwind defaulting by @jtulk in #2796
- chore(ui): add 3 new icons by @jwlee64 in #2800
- chore(ui): Flipping loader color by @jtulk in #2805
- chore(ui): add marker and refresh icons by @gtarpenning in #2803
- feat(weave_ts): Add initial JS SDK by @andrewtruong in #2704
- feat(ui): Add simple language detection for code browser by @andrewtruong in #2780
- chore(ui): running format on Base.less - no changes by @jtulk in #2784
- fix(weave_query): handle tagged unions of non-primitive types correctly in arrow converter by @dannygoldstein in #2659
- chore(ui): Marking the wandbloader as deprecated by @jtulk in #2813
- feat(weave): Add completions/create endpoint by @KyleGoyette in #2757
- feat(weave): adding charts to the traces page by @mbarrramsey in #2745
- feat(weave): prompts as first class objects by @jamie-rasmussen in #2811
- style(ui): Fix night colors for Callout by @connieelee in #2815
- chore(weave): Add
weave_ts
,dev
, andapp
scopes by @andrewtruong in #2810 - fix(weave): Allow back-compat for "old-style" scorers and evaluations using
model_output
kwarg by @andrewtruong in #2806 - docs(weave): Add cookbook: structured outputs for multi-agent systems by @olachinkei in #2728
- feat(ui): Add JS SDK options for Use tab by @andrewtruong in #2786
- chore(weave): Fix eval message by @tssweeney in #2817
- chore(ui): prevent formatter from auto-removing React import by @andrewtruong in #2819
- fix(weave): include scores from scorers with illegal characters in name by @gtarpenning in #2731
- fix(weave): openai chat view stutter by @gtarpenning in #2821
- chore(weave): Revert Object/Feedback schema validation from hackweek by @tssweeney in #2824
- chore(weave): smart tab defaults w/ chat in call peek drawer by @gtarpenning in #2823
- perf(weave): split calls query when using a heavy condition by @gtarpenning in #2779
- chore(ui): hide Prompts feature by @jamie-rasmussen in #2822
- chore(ui): add info icon to describe file and media are not in bytes stored by @harukatab in #2764
- fix(weave): Add model to provider info map to source code, add make command for updating by @KyleGoyette in #2825
- chore(weave): Create a system of defining schema-validated objects by @tssweeney in #2826
- feat(weave): Client & Backend support for Leaderboards by @tssweeney in #2831
New Contributors
- @nicholaspun-wandb made their first contribution in #2638
- @nhusher made their first contribution in #2744
- @harukatab made their first contribution in #2747
- @m-rgba made their first contribution in #2776
- @KyleGoyette made their first contribution in #2757
- @olachinkei made their first contribution in #2728
Full Changelog: v0.51.17...v0.51.18
v0.51.17
What's Changed
- chore(weave): Tidy up typing imports by @andrewtruong in #2522
- chore(weave): Cleanup mistral integration tests by @andrewtruong in #2525
- feat: Minimize blocking calls while Tracing by @tssweeney in #2434
- feat: Expose TableQueryStats and Paginated Table Queries by @tssweeney in #2534
- chore(weave): Update .git* files by @andrewtruong in #2542
- chore(weave): Move pytest.ini into pyproject by @andrewtruong in #2543
- chore(app): Silencing browser warnings from props falling through to the DOM by @jtulk in #2538
- chore(weave): Move old examples by @andrewtruong in #2545
- chore(weave): Remove .vscode by @andrewtruong in #2546
- chore(weave): Move trace tests into 1 dir by @andrewtruong in #2523
- chore(weave): Move to nox (speed up unit tests by ~17%) by @andrewtruong in #2519
- chore(weave): Fix api key check by @andrewtruong in #2548
- chore(weave): Remove semver dep by @andrewtruong in #2527
- chore(weave): Make lint and formatting checks stricter by @andrewtruong in #2549
- chore(weave): Fix cli escape sequence by @andrewtruong in #2552
- chore(weave): Fix typos by @andrewtruong in #2554
- fix:
include_feedback
breaks when > 10 results AND no expand fields listed by @tssweeney in #2541 - chore(weave): Update pyproject by @andrewtruong in #2550
- perf: Improve Table Query Performance by @tssweeney in #2558
- perf: split metadata/val in objects query by @gtarpenning in #2512
- chore: Make update doc runnable by @scottire in #2531
- fix(registries): handle loading state for 2 queries separately in PanelHistogramInner by @ibindlish in #2540
- feat: Paginated table queries by @tssweeney in #2535
- chore: Ensure all failed futures have exceptions logged by @tssweeney in #2559
- chore: Fix Langchain flake by @tssweeney in #2561
- chore: Reduce Table page size to 100 by @tssweeney in #2332
- chore(weave): Move tests to top level by @andrewtruong in #2555
- chore(weave): Move old build files by @andrewtruong in #2551
- chore(weave): Remove unused utils by @andrewtruong in #2556
- chore(weave): Add conditional ci by @andrewtruong in #2547
- chore: Fix log flake by @tssweeney in #2577
- fix: tool call text overflow by @jamie-rasmussen in #2579
- chore(dev): static fingerprint for error with useNodeValue by @bcsherma in #2528
- chore(weave): Move weave_query scripts by @andrewtruong in #2524
- chore(weave): Add new
CONTRIBUTING.md
by @andrewtruong in #2568 - chore(weave): Project sidebar takes in models access param by @ethanho154 in #2565
- chore(weave): Make CI detect all file changes since fork point, not just the last commit by @andrewtruong in #2584
- fix: Better filtering by ref values by @tssweeney in #2563
- docs: update PII cookbook to use the new Weave Ops postprocessing by @wylerz in #2562
- docs(integrations): Add cookbook images to intro, summarization, prompt optimization by @ash0ts in #2553
- chore(weave): add show more button on arrays longer than 50 items by @jwlee64 in #2498
- chore(weave): Trim deps by @andrewtruong in #2593
- chore(weave): Cleanup conftest by @andrewtruong in #2580
- chore(weave): Update FE build by @andrewtruong in #2595
- fix: select columns for child call table preview by @jamie-rasmussen in #2507
- chore(weave): add outline button by @jwlee64 in #2586
- style(weave): Add pagination component and move calls table pagination controls by @jwlee64 in #2589
- fix(weave): align tables column header cell text based on panel type by @domphan-wandb in #2486
- chore(weave): Dont use relative imports by @andrewtruong in #2598
- chore(weave): Organize rich by @andrewtruong in #2601
- fix: Use explicit type for component style by @domphan-wandb in #2602
- feat(ui): Create Callout component by @connieelee in #2605
- chore(query): Add back ops imports by @andrewtruong in #2604
- chore(weave): fix vite warning about ?? operator by @wandbjake in #2607
- fix: ref alignment in grid cell by @jamie-rasmussen in #2603
- chore(weave): Move to hatch build by @andrewtruong in #2610
- chore(query): Update .gitignore by @andrewtruong in #2609
- chore(weave): Remove old decorator overloads by @andrewtruong in #2599
- chore: make op and obj links teal in grid first col by @jamie-rasmussen in #2611
- chore(weave): Fix litellm tests by @andrewtruong in #2613
- fix: table read query deduplicates identical rows by @gtarpenning in #2608
- chore: Add back image tests to test suite by @tssweeney in #2616
- chore(weave): Speed up tests by 14% by @andrewtruong in #2618
- fix: broken obj grid links by @jamie-rasmussen in #2612
- chore(weave): move refresh button, minor style to op filter, and filter by @jwlee64 in #2629
- style(weave): hide delete if no calls are selected by @jwlee64 in #2631
- chore: Add basic analytics tracking for panel configuration settings by @domphan-wandb in #2626
- chore(weave): Move docker dir to weave_query by @andrewtruong in #2621
- feat: add finish handler for ops by @jamie-rasmussen in #2633
- chore(dev): add sentry helpers for the core app to common/util by @bcsherma in #2630
- chore: update license key for MUI data grid by @jamie-rasmussen in #2640
- chore(weave): Update release action by @andrewtruong in #2642
- chore: Doc Gen Oct 9 by @tssweeney in #2649
- chore(weave): Add note on providing reproducible examples by @andrewtruong in #2647
- chore: fix vscode test config by @dannygoldstein in #2651
- chore(weave): Seed cost table by @jwlee64 in #2625
- chore: Fix flakey image test by @tssweeney in #2658
- chore: Cleanup and remove frontend build processes by @tssweeney in #2644
- fix: Python-side duplicate dataset rows by @tssweeney in #2643
- chore(weave): Add py313 to tests by @andrewtruong in #2614
- feat: Add display_name to ops by @tssweeney in #2655
- feat(weave): Add NotDiamond integration by @andrewtruong in #2606
- fix: don't autoselect markdown renderer by @jamie-rasmussen in #2663
- chore: move Usage table in Call summary by @jamie-rasmussen in #2641
- chore: eval selection bar UI tweaks by @gtarpenning in #2592
- fix: Improve TableQuery performance by adding a streaming interface by @tssweeney in #2619
- chore: skip notdiamond in py313 by @gtarpenning in #2667
- chore: added/removed evals reflected in URL state by @gtarpenning in #2665
- chore(dev): fix sentry dedupe of useNodevalue error by @bcsherma in #2645
- chore: add column selection in eval comparison page by @gtarpenning in #2632
- chore(weave): update expand to 200 ids by @jwlee64 in #2627
- chore(weave): Stop parallelization to reduce flake by @andrewtruong in #2668
- chore(weave): Reorganize context by @andrewtruong in #2661
- chore: Cleanup some docs by @tssweeney in https://github.com/wan...
v0.51.16 (yanked)
What's Changed
- chore(weave): Tidy up typing imports by @andrewtruong in #2522
- chore(weave): Cleanup mistral integration tests by @andrewtruong in #2525
- feat: Minimize blocking calls while Tracing by @tssweeney in #2434
- feat: Expose TableQueryStats and Paginated Table Queries by @tssweeney in #2534
- chore(weave): Update .git* files by @andrewtruong in #2542
- chore(weave): Move pytest.ini into pyproject by @andrewtruong in #2543
- chore(app): Silencing browser warnings from props falling through to the DOM by @jtulk in #2538
- chore(weave): Move old examples by @andrewtruong in #2545
- chore(weave): Remove .vscode by @andrewtruong in #2546
- chore(weave): Move trace tests into 1 dir by @andrewtruong in #2523
- chore(weave): Move to nox (speed up unit tests by ~17%) by @andrewtruong in #2519
- chore(weave): Fix api key check by @andrewtruong in #2548
- chore(weave): Remove semver dep by @andrewtruong in #2527
- chore(weave): Make lint and formatting checks stricter by @andrewtruong in #2549
- chore(weave): Fix cli escape sequence by @andrewtruong in #2552
- chore(weave): Fix typos by @andrewtruong in #2554
- fix:
include_feedback
breaks when > 10 results AND no expand fields listed by @tssweeney in #2541 - chore(weave): Update pyproject by @andrewtruong in #2550
- perf: Improve Table Query Performance by @tssweeney in #2558
- perf: split metadata/val in objects query by @gtarpenning in #2512
- chore: Make update doc runnable by @scottire in #2531
- fix(registries): handle loading state for 2 queries separately in PanelHistogramInner by @ibindlish in #2540
- feat: Paginated table queries by @tssweeney in #2535
- chore: Ensure all failed futures have exceptions logged by @tssweeney in #2559
- chore: Fix Langchain flake by @tssweeney in #2561
- chore: Reduce Table page size to 100 by @tssweeney in #2332
- chore(weave): Move tests to top level by @andrewtruong in #2555
- chore(weave): Move old build files by @andrewtruong in #2551
- chore(weave): Remove unused utils by @andrewtruong in #2556
- chore(weave): Add conditional ci by @andrewtruong in #2547
- chore: Fix log flake by @tssweeney in #2577
- fix: tool call text overflow by @jamie-rasmussen in #2579
- chore(dev): static fingerprint for error with useNodeValue by @bcsherma in #2528
- chore(weave): Move weave_query scripts by @andrewtruong in #2524
- chore(weave): Add new
CONTRIBUTING.md
by @andrewtruong in #2568 - chore(weave): Project sidebar takes in models access param by @ethanho154 in #2565
- chore(weave): Make CI detect all file changes since fork point, not just the last commit by @andrewtruong in #2584
- fix: Better filtering by ref values by @tssweeney in #2563
- docs: update PII cookbook to use the new Weave Ops postprocessing by @wylerz in #2562
- docs(integrations): Add cookbook images to intro, summarization, prompt optimization by @ash0ts in #2553
- chore(weave): add show more button on arrays longer than 50 items by @jwlee64 in #2498
- chore(weave): Trim deps by @andrewtruong in #2593
- chore(weave): Cleanup conftest by @andrewtruong in #2580
- chore(weave): Update FE build by @andrewtruong in #2595
- fix: select columns for child call table preview by @jamie-rasmussen in #2507
- chore(weave): add outline button by @jwlee64 in #2586
- style(weave): Add pagination component and move calls table pagination controls by @jwlee64 in #2589
- fix(weave): align tables column header cell text based on panel type by @domphan-wandb in #2486
- chore(weave): Dont use relative imports by @andrewtruong in #2598
- chore(weave): Organize rich by @andrewtruong in #2601
- fix: Use explicit type for component style by @domphan-wandb in #2602
- feat(ui): Create Callout component by @connieelee in #2605
- chore(query): Add back ops imports by @andrewtruong in #2604
- chore(weave): fix vite warning about ?? operator by @wandbjake in #2607
- fix: ref alignment in grid cell by @jamie-rasmussen in #2603
- chore(weave): Move to hatch build by @andrewtruong in #2610
- chore(query): Update .gitignore by @andrewtruong in #2609
- chore(weave): Remove old decorator overloads by @andrewtruong in #2599
- chore: make op and obj links teal in grid first col by @jamie-rasmussen in #2611
- chore(weave): Fix litellm tests by @andrewtruong in #2613
- fix: table read query deduplicates identical rows by @gtarpenning in #2608
- chore: Add back image tests to test suite by @tssweeney in #2616
- chore(weave): Speed up tests by 14% by @andrewtruong in #2618
- fix: broken obj grid links by @jamie-rasmussen in #2612
- chore(weave): move refresh button, minor style to op filter, and filter by @jwlee64 in #2629
- style(weave): hide delete if no calls are selected by @jwlee64 in #2631
- chore: Add basic analytics tracking for panel configuration settings by @domphan-wandb in #2626
- chore(weave): Move docker dir to weave_query by @andrewtruong in #2621
- feat: add finish handler for ops by @jamie-rasmussen in #2633
- chore(dev): add sentry helpers for the core app to common/util by @bcsherma in #2630
- chore: update license key for MUI data grid by @jamie-rasmussen in #2640
- chore(weave): Update release action by @andrewtruong in #2642
- chore: Doc Gen Oct 9 by @tssweeney in #2649
- chore(weave): Add note on providing reproducible examples by @andrewtruong in #2647
- chore: fix vscode test config by @dannygoldstein in #2651
- chore(weave): Seed cost table by @jwlee64 in #2625
- chore: Fix flakey image test by @tssweeney in #2658
- chore: Cleanup and remove frontend build processes by @tssweeney in #2644
- fix: Python-side duplicate dataset rows by @tssweeney in #2643
- chore(weave): Add py313 to tests by @andrewtruong in #2614
- feat: Add display_name to ops by @tssweeney in #2655
- feat(weave): Add NotDiamond integration by @andrewtruong in #2606
- fix: don't autoselect markdown renderer by @jamie-rasmussen in #2663
- chore: move Usage table in Call summary by @jamie-rasmussen in #2641
- chore: eval selection bar UI tweaks by @gtarpenning in #2592
- fix: Improve TableQuery performance by adding a streaming interface by @tssweeney in #2619
- chore: skip notdiamond in py313 by @gtarpenning in #2667
- chore: added/removed evals reflected in URL state by @gtarpenning in #2665
- chore(dev): fix sentry dedupe of useNodevalue error by @bcsherma in #2645
- chore: add column selection in eval comparison page by @gtarpenning in #2632
- chore(weave): update expand to 200 ids by @jwlee64 in #2627
- chore(weave): Stop parallelization to reduce flake by @andrewtruong in #2668
- chore(weave): Reorganize context by @andrewtruong in #2661
- chore: Cleanup some docs by @tssweeney in https://github.com/wan...