Skip to content

Conversation

@KyleAMathews
Copy link
Collaborator

For live queries using on-demand sync mode, the collection was being marked as ready immediately when source collections were ready, even though the initial loadSubset hadn't completed yet. This meant isLoading was false while data was still being fetched.

This fix ensures that:

  1. Live queries with on-demand sources track the initial loadSubset promise and show isLoading: true until it completes
  2. The collection status remains loading until the first data load finishes
  3. Subsequent loadSubset calls (pagination/windowing) do NOT affect the ready status - only the first load matters

Changes:

  • Add hasMarkedReady and hasSetupLoadingListener flags to track initial ready state in CollectionConfigBuilder
  • Modify updateLiveQueryStatus() to wait for first loadSubset to complete before calling markReady()
  • Update subscribeToMatchingChanges() in CollectionSubscriber to track the initial loadSubset promise for on-demand sources
  • Add comprehensive tests for the new behavior

🎯 Changes

✅ Checklist

  • I have followed the steps in the Contributing guide.
  • I have tested this code locally with pnpm test:pr.

🚀 Release Impact

  • This change affects published code, and I have generated a changeset.
  • This change is docs/CI/dev-only (no release).

…sync

For live queries using on-demand sync mode, the collection was being
marked as ready immediately when source collections were ready, even
though the initial loadSubset hadn't completed yet. This meant
`isLoading` was false while data was still being fetched.

This fix ensures that:
1. Live queries with on-demand sources track the initial loadSubset
   promise and show `isLoading: true` until it completes
2. The collection status remains `loading` until the first data load
   finishes
3. Subsequent loadSubset calls (pagination/windowing) do NOT affect
   the ready status - only the first load matters

Changes:
- Add `hasMarkedReady` and `hasSetupLoadingListener` flags to track
  initial ready state in CollectionConfigBuilder
- Modify `updateLiveQueryStatus()` to wait for first loadSubset to
  complete before calling `markReady()`
- Update `subscribeToMatchingChanges()` in CollectionSubscriber to
  track the initial loadSubset promise for on-demand sources
- Add comprehensive tests for the new behavior
@changeset-bot
Copy link

changeset-bot bot commented Dec 3, 2025

🦋 Changeset detected

Latest commit: 957d826

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 12 packages
Name Type
@tanstack/db Patch
@tanstack/angular-db Patch
@tanstack/electric-db-collection Patch
@tanstack/offline-transactions Patch
@tanstack/powersync-db-collection Patch
@tanstack/query-db-collection Patch
@tanstack/react-db Patch
@tanstack/rxdb-db-collection Patch
@tanstack/solid-db Patch
@tanstack/svelte-db Patch
@tanstack/trailbase-db-collection Patch
@tanstack/vue-db Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@pkg-pr-new
Copy link

pkg-pr-new bot commented Dec 3, 2025

More templates

@tanstack/angular-db

npm i https://pkg.pr.new/@tanstack/angular-db@962

@tanstack/db

npm i https://pkg.pr.new/@tanstack/db@962

@tanstack/db-ivm

npm i https://pkg.pr.new/@tanstack/db-ivm@962

@tanstack/electric-db-collection

npm i https://pkg.pr.new/@tanstack/electric-db-collection@962

@tanstack/offline-transactions

npm i https://pkg.pr.new/@tanstack/offline-transactions@962

@tanstack/powersync-db-collection

npm i https://pkg.pr.new/@tanstack/powersync-db-collection@962

@tanstack/query-db-collection

npm i https://pkg.pr.new/@tanstack/query-db-collection@962

@tanstack/react-db

npm i https://pkg.pr.new/@tanstack/react-db@962

@tanstack/rxdb-db-collection

npm i https://pkg.pr.new/@tanstack/rxdb-db-collection@962

@tanstack/solid-db

npm i https://pkg.pr.new/@tanstack/solid-db@962

@tanstack/svelte-db

npm i https://pkg.pr.new/@tanstack/svelte-db@962

@tanstack/trailbase-db-collection

npm i https://pkg.pr.new/@tanstack/trailbase-db-collection@962

@tanstack/vue-db

npm i https://pkg.pr.new/@tanstack/vue-db@962

commit: 957d826

@github-actions
Copy link
Contributor

github-actions bot commented Dec 3, 2025

Size Change: +182 B (+0.21%)

Total Size: 88.7 kB

Filename Size Change
./packages/db/dist/esm/query/live/collection-config-builder.js 5.45 kB +121 B (+2.27%)
./packages/db/dist/esm/query/live/collection-subscriber.js 1.85 kB +61 B (+3.4%)
ℹ️ View Unchanged
Filename Size
./packages/db/dist/esm/collection/change-events.js 1.39 kB
./packages/db/dist/esm/collection/changes.js 977 B
./packages/db/dist/esm/collection/events.js 388 B
./packages/db/dist/esm/collection/index.js 3.24 kB
./packages/db/dist/esm/collection/indexes.js 1.1 kB
./packages/db/dist/esm/collection/lifecycle.js 1.67 kB
./packages/db/dist/esm/collection/mutations.js 2.34 kB
./packages/db/dist/esm/collection/state.js 3.46 kB
./packages/db/dist/esm/collection/subscription.js 2.78 kB
./packages/db/dist/esm/collection/sync.js 2.38 kB
./packages/db/dist/esm/deferred.js 207 B
./packages/db/dist/esm/errors.js 4.27 kB
./packages/db/dist/esm/event-emitter.js 748 B
./packages/db/dist/esm/index.js 2.68 kB
./packages/db/dist/esm/indexes/auto-index.js 742 B
./packages/db/dist/esm/indexes/base-index.js 766 B
./packages/db/dist/esm/indexes/btree-index.js 1.93 kB
./packages/db/dist/esm/indexes/lazy-index.js 1.1 kB
./packages/db/dist/esm/indexes/reverse-index.js 513 B
./packages/db/dist/esm/local-only.js 837 B
./packages/db/dist/esm/local-storage.js 2.1 kB
./packages/db/dist/esm/optimistic-action.js 359 B
./packages/db/dist/esm/paced-mutations.js 496 B
./packages/db/dist/esm/proxy.js 3.75 kB
./packages/db/dist/esm/query/builder/functions.js 733 B
./packages/db/dist/esm/query/builder/index.js 3.96 kB
./packages/db/dist/esm/query/builder/ref-proxy.js 917 B
./packages/db/dist/esm/query/compiler/evaluators.js 1.35 kB
./packages/db/dist/esm/query/compiler/expressions.js 430 B
./packages/db/dist/esm/query/compiler/group-by.js 1.8 kB
./packages/db/dist/esm/query/compiler/index.js 1.96 kB
./packages/db/dist/esm/query/compiler/joins.js 2 kB
./packages/db/dist/esm/query/compiler/order-by.js 1.46 kB
./packages/db/dist/esm/query/compiler/select.js 1.07 kB
./packages/db/dist/esm/query/expression-helpers.js 1.43 kB
./packages/db/dist/esm/query/ir.js 673 B
./packages/db/dist/esm/query/live-query-collection.js 360 B
./packages/db/dist/esm/query/live/collection-registry.js 264 B
./packages/db/dist/esm/query/live/internal.js 130 B
./packages/db/dist/esm/query/optimizer.js 2.56 kB
./packages/db/dist/esm/query/predicate-utils.js 2.97 kB
./packages/db/dist/esm/query/subset-dedupe.js 921 B
./packages/db/dist/esm/scheduler.js 1.3 kB
./packages/db/dist/esm/SortedMap.js 1.3 kB
./packages/db/dist/esm/strategies/debounceStrategy.js 247 B
./packages/db/dist/esm/strategies/queueStrategy.js 428 B
./packages/db/dist/esm/strategies/throttleStrategy.js 246 B
./packages/db/dist/esm/transactions.js 2.9 kB
./packages/db/dist/esm/utils.js 881 B
./packages/db/dist/esm/utils/browser-polyfills.js 304 B
./packages/db/dist/esm/utils/btree.js 5.61 kB
./packages/db/dist/esm/utils/comparison.js 852 B
./packages/db/dist/esm/utils/cursor.js 457 B
./packages/db/dist/esm/utils/index-optimization.js 1.51 kB
./packages/db/dist/esm/utils/type-guards.js 157 B

compressed-size-action::db-package-size

@github-actions
Copy link
Contributor

github-actions bot commented Dec 3, 2025

Size Change: 0 B

Total Size: 3.35 kB

ℹ️ View Unchanged
Filename Size
./packages/react-db/dist/esm/index.js 225 B
./packages/react-db/dist/esm/useLiveInfiniteQuery.js 1.17 kB
./packages/react-db/dist/esm/useLiveQuery.js 1.12 kB
./packages/react-db/dist/esm/useLiveSuspenseQuery.js 431 B
./packages/react-db/dist/esm/usePacedMutations.js 401 B

compressed-size-action::react-db-package-size

Update test to wait for the initial loadSubset promise to resolve
before checking the live query status. This is needed after the fix
that makes live queries show loading status during initial on-demand
data fetch.
@samwillis samwillis mentioned this pull request Dec 3, 2025
claude and others added 3 commits December 3, 2025 17:02
…romise: true

For on-demand sync mode, the default includeInitialState path calls
requestSnapshot with trackLoadSubsetPromise: false, which doesn't track
the loading state. This change manually calls requestSnapshot with
trackLoadSubsetPromise: true for on-demand sources to ensure the
subscription status changes from 'loadingSubset' to 'ready' when data
arrives.

Also updates query-db-collection tests to use eager mode since they test
TanStack Query cache behavior, not on-demand loading status.
Copy link
Collaborator

@samwillis samwillis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, just a couple of things to tweak I think.

// Set up a one-time listener if we haven't already
if (!this.hasSetupLoadingListener) {
this.hasSetupLoadingListener = true
const unsubscribe = this.liveQueryCollection.on(
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should lift up the saved unsubscribe to save it at the top of the collection config builder level, then call it (if it exists) in the collection cleanup function. This is what we do with unsubscribeFromSchedulerClears - we should do the same as that.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could we add a test that checks this behaviour for an on-demand collection with a join to another on-demand collection. Check that it only modes to ready when both are not loading subsets.

claude and others added 16 commits December 16, 2025 20:49
…DRAzK' of http://127.0.0.1:54067/git/TanStack/db into claude/fix-livequery-loading-status-01TNsEPERmfs3ub3e9iDRAzK
…eanup

- Move loadingSubset listener unsubscribe to class property `unsubscribeFromLoadingListener`
- Add cleanup call in sync cleanup function to prevent memory leaks
- Add test verifying live query loading state tracks on-demand source loadSubset
Update react/todo and solid/todo examples to use ^1.0.8 to match
other examples and pass sherif workspace version consistency check.
…DRAzK' of http://127.0.0.1:25666/git/TanStack/db into claude/fix-livequery-loading-status-01TNsEPERmfs3ub3e9iDRAzK
Verifies that when a live query joins two on-demand collections,
the live query only becomes ready when BOTH sources have completed
their loadSubset operations. Uses leftJoin to ensure predictable
active/lazy source determination.
…ns in e2e tests

On-demand collections mark ready immediately when sync starts, so calling
preload() is unnecessary and triggers a warning. Use startSyncImmediate()
instead, which starts sync without the no-op preload warning.
…DRAzK' of http://127.0.0.1:42743/git/TanStack/db into claude/fix-livequery-loading-status-01TNsEPERmfs3ub3e9iDRAzK
…Each in e2e tests

Cleaning up source collections in afterEach while live queries may still
be pending (e.g., if a test times out before cleanup) causes "Source
collection was manually cleaned up" warnings. Since on-demand collections
don't need to be reset between tests (each test creates its own live
queries with specific predicates), we remove the cleanup/restart cycle
from afterEach. Final cleanup still happens in teardown (afterAll).
Cancel TanStack Query observers between tests to prevent
"operation was canceled" errors from accumulating observers.
Change afterEach cleanup from `await queryClient.cancelQueries()` to
`queryClient.removeQueries()` with a predicate that only removes queries
with no active observers. This fixes test hanging while preserving
live query functionality.

The previous approach with cancelQueries() caused tests to hang
indefinitely because it waited for queries that never completed.
The new approach only removes inactive queries, allowing active
subscriptions to continue working.

Test results: 109/110 tests passing (1 test has pre-existing timeout issue)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Sonnet 4.5 <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants