Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Changed typings of updateQuery's previousQueryResult to be potentially undefined #12276

Open
wants to merge 8 commits into
base: release-3.13
Choose a base branch
from

Conversation

Cellule
Copy link

@Cellule Cellule commented Jan 15, 2025

Related to #12228

There's an outstanding issue where previousQueryResult sometimes, flakily, ends up undefined
This change aims to have the typings reflect the actual runtime behavior allowing devs to write safe code that can handle the missing previousQueryResult
An alternative could be to simply not call mapFn if previousQueryResult is missing. While neither is ideal nor fixes the underlying issue of "why" previousQueryResult is undefined. At least it would avoid bad crashes.

I've been rolling with this patch for years now and I haven't seen any bad side-effects so far. As far as I can tell, the case where previousQueryResult can be safely ignored and is likely going to be called again with actual data when it matters

Typings Update for updateQuery:

  • Changed typings of updateQuery's previousQueryResult to be potentially undefined in @apollo/client.
  • Updated updateQuery method in src/core/ObservableQuery.ts to reflect the new typings.
  • Modified UpdateQueryFn type in src/core/watchQueryOptions.ts to allow previousQueryResult to be undefined.
  • Updated ObservableQueryFields interface in src/react/types/types.ts to reflect the new typings.

VSCode Configuration:

  • Added editor.codeActionsOnSave setting to disable organizing imports on save in .vscode/settings.json.

Copy link

netlify bot commented Jan 15, 2025

👷 Deploy request for apollo-client-docs pending review.

Visit the deploys page to approve it

Name Link
🔨 Latest commit 0c11195

@svc-apollo-docs
Copy link

svc-apollo-docs commented Jan 15, 2025

⚠️ Docs preview not attached to branch

The preview was not built because the PR's base branch release-3.13 is not in the list of sources.

An Apollo team member can comment one of the following commands to dictate which branch to attach the preview to:

  • !docs set-base-branch version-2.6
  • !docs set-base-branch main

Build ID: f4750b9a5ca3e31372ccbe7a

Copy link

changeset-bot bot commented Jan 15, 2025

🦋 Changeset detected

Latest commit: 0c11195

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 1 package
Name Type
@apollo/client Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@Cellule Cellule force-pushed the update-query-typings branch from 3a4c44f to d9cfe5d Compare January 15, 2025 17:28
Copy link
Member

@jerelmiller jerelmiller left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm generally ok with this change, but would you be willing to add a test that demonstrates the case where previousData is undefined? I'd like to make sure its "documented" in some form through runtime behavior, not just the types. That should help us prevent regressions in the future. That would also help determine whether this is an actual bug, or if this behavior was intentional. I'd like to avoid a band-aid to the types just in case previousData was never intended to be undefined.

Thanks for the contribution!

@@ -241,6 +241,9 @@ describe("subscribeToMore", () => {
}
`,
updateQuery: (prev, { subscriptionData }) => {
if (!prev) {
Copy link
Member

@jerelmiller jerelmiller Jan 17, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I definitely understand why you did this for this test, but unfortunately this makes it more difficult to know if we introduced regressions by accidentally making prev undefined when it should have a value. The assertion below isn't run in that case, so it would appear that the test would still pass (or at the very least, the source of where the test would fail would be further away from the actual problem).

Instead, I'd recommend updating the prev to prev!, that way this test will crash if this ever switches to undefined.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Make sense, I wasn't 100% sure how to handle it, but you're right the expectation is that prev should be provided here

Copy link
Author

@Cellule Cellule left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

would you be willing to add a test that demonstrates the case where previousData is undefined

If you read the issue, the problem is that we can't figure out the repro steps to have undefined at runtime.
It is likely a race condition that might be hard to reproduce in a testing environment.
I admit I haven't tried recently, this is an issue we've faced years ago and kept the patch.
I can try to get a repro, but I can't make any guarantee

@@ -241,6 +241,9 @@ describe("subscribeToMore", () => {
}
`,
updateQuery: (prev, { subscriptionData }) => {
if (!prev) {
Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Make sense, I wasn't 100% sure how to handle it, but you're right the expectation is that prev should be provided here

@jerelmiller
Copy link
Member

If you read the issue, the problem is that we can't figure out the repro steps to have undefined at runtime.

Ah shoot. I read that and it went right over my head. Let me play around with this a bit more and see if I can think of any way this could happen. I'll push a test if I can, or respond back and let you know that I couldn't come up with something.

@jerelmiller
Copy link
Member

@Cellule the closest I can get to reproducing this is updateQuery passing an empty object {} as previous. Just to double check, the value you're seeing on the crashes is undefined and not access on a nested property when previous is {} correct?

updateQuery calls cache.diff with returnPartialData: true:

const { result } = queryManager.cache.diff<TData>({
query: this.options.query,
variables: this.variables,
returnPartialData: true,
optimistic: false,
});

That returnPartialData: true returns an empty object if there is absolutely no cache data available for the given query. I've never actually seen result return undefined and have been unable to reproduce a situation where it returns undefined instead of {}. I've traced much of the code and am not seeing anything stick out either.

Is there anything else you can tell me about the queries where you see this happen, such as directives used, type policies, etc? Perhaps the combination of one of those things hits this case.

@Cellule
Copy link
Author

Cellule commented Jan 22, 2025

I admit it's been a long time since I've seen the issue because we've mitigated it by always checking if(!prev) return prev!
I am fairly certain prev === undefined
I'll try to get in a bad state on my side

@jerelmiller
Copy link
Member

That would be super helpful if you can. I fear this change is more of a band-aid to the real underlying issue and would love to figure that out if we can. Otherwise this could be a fairly disruptive change to a lot of existing users who could now potentially see a lot of TypeScript errors after upgrading.

@Cellule
Copy link
Author

Cellule commented Jan 22, 2025

Well maybe I was wrong, it seems it might be {} after all (so my patch wouldn't fix anything really)
image

In my case I'm using updateQuery in query.subscribeToMore
In order to repro I'm doing some operations that will cause the subscription to send more data then navigate to another page "quickly-ish"
The other page is still on the same entity, so it will effectively

  • change variables in useQuery
  • Through useEffect it will resubscribe the subscription `
  • updateQuery seems to be called with data from the previous variables for a new query with no data (hence empty object)
{
    "subscriptionData": {
        "data": {
            "messageUpserted": {
                "message": {
                    "id": 9627,
                    "content": {
                        "text": "removed the work order from being on hold.",
                        "tokens": [
                            {
                                "value": "removed the work order from being on hold.",
                                "__typename": "TextToken"
                            }
                        ],
                        "__typename": "TokenizedText"
                    },
                    "author": {
                        "id": 1338,
                        "img": "https://img.maintainx-dev.com/mx-dev-cac1-uploads/static/user_placeholders/RandomPicture4.png",
                        "firstName": "Michael",
                        "lastName": "Ferris",
                        "displayName": "Michael Ferris",
                        "__typename": "User",
                        "alternateImg": null,
                        "availabilityStatus": null
                    },
                    "createdAt": "2025-01-22T19:50:41.676Z",
                    "reactions": [],
                    "__typename": "SystemWorkOrderStatusChangedMessage",
                    "extraData": {
                        "oldStatus": "ON_HOLD",
                        "newStatus": "OPEN",
                        "newStatusVariant": null,
                        "failures": null,
                        "escalatedUsers": [],
                        "escalatedTeams": [],
                        "__typename": "SystemWorkOrderStatusChangedExtraData"
                    }
                },
                "parent": {
                    "id": 876, // Note the id of the parent that the subscription subscribes to
                    "isUnreadForMe": false,
                    "comments": {
                        "totalCount": 0,
                        "unreadCount": 0,
                        "__typename": "MessageThread"
                    },
                    "__typename": "WorkOrder"
                },
                "transcription": null,
                "__typename": "MessageUpsertedSubscription"
            }
        }
    },
    "variables": {
        "noRedirect": false,
        "id": 4, // Note the id in the variables do not match with the data from the subscription.
        "pagination": {
            "cursor": "",
            "limit": 25
        },
        "shouldFetchAutomationInformation": false
    }
}

@jerelmiller
Copy link
Member

jerelmiller commented Jan 22, 2025

it seems it might be {} after all

Ok great! I was hoping that would be the case and this one actually makes a lot more sense to me. I could reproduce this fairly easily in a test by starting a query, subscribing to the subscription, then having the subscription emit an event before the query finished on the network. In this case, no data had been written to the cache from the query, so previous would be that empty object.

I think the right change here might be to wrap TData in DeepPartial since its possible that at any given time, you may only get back partial data. It still may ruffle a few feathers, but it would be a more accurate type. Let me converse with @phryneas to make sure we're in alignment, but I'm fairly confident this is the right TypeScript fix. Assuming so, I think it makes most sense to target this change with 3.13 so we can better call it out in the changelog.

As for the other behavior you're seeing, it looks like updateQuery is called with this.variables on ObservableQuery, which is just a getter for this.options.variables. Perhaps this is a race condition between when the options actually change in ObservableQuery and when you call subscribeToMore again? Perhaps you could log observable.options.variables to see if that value is updated with the new variables.

@Cellule
Copy link
Author

Cellule commented Jan 22, 2025

There's still something that bugs me with the variables
From what I can test, it's possible the variables passed to subscribeToMore.updateQuery do not match at all the variables passed to the subscription.
It seems entirely possible for the ObservableQuery to have receive new variables, but the subscription is still on the old variables

The scenario seems to be as follows

  • Variables are changed (navigation or whatever)
  • useQuery receives new variables and updates the underlying ObservableQuery
  • useEffect(() => query.subscribeToMore(...), [query.variables]) causes the subscription to be slated to be disconnected
  • Data arrives in the subscription, the updateQuery is called for the previous variables, but the cache looks for query data using the new variables (leading to {})
  • useEffect unsubscribes the subscription then resubscribes correctly
    It looks like a race condition, but so far it hasn't been hard to reproduce on my side

Real quick it sounds like it would be "safe" to simply not call mapFn in updateQuery if results === {} || results === undefined.
So far I haven't been able to reproduce the variables mismatch when there's a cache hit, but it sounds possible in theory

Another thing to mention, the SubscribeToMoreOptions.updateQuery implies the variables will have type TSubscriptionVariables but in reality, the variables returned are TVariables (not currently passed in the generics).
This type is simply wrong, while it's unlikely to be used, if the variables of the query and the variable of the subscription differ enough, it can cause bugs. I had to cast it just to confirm the bad state

makeSubscription<
            IWorkOrderDetailsQueryData,
            IWoMessageUpsertedSubscriptionSubscription,
            IWoMessageUpsertedSubscriptionSubscriptionVariables
          >("messageUpsertedSubscription", query.subscribeToMore, {
            document: messageUpsertedSubscription,
            variables: {
              parent: { id: workOrderId, type: IUserMessageParentType.WorkOrder },
            },
            updateQuery(prev, { subscriptionData, variables }) {
              const newMessage = subscriptionData?.data?.messageUpserted?.message;
              const workOrderUpdates = subscriptionData?.data?.messageUpserted?.parent;
              const transcription = subscriptionData.data.messageUpserted?.transcription;
              if (
                (variables as any as IWorkOrderDetailsQueryVariables).id !==
                (workOrderUpdates as any).id
              ) {
                debugger;
                return prev;
              }
              if (!newMessage || workOrderUpdates?.__typename !== "WorkOrder" || !prev?.workOrder) {
                return prev!;
              }

@Cellule
Copy link
Author

Cellule commented Jan 27, 2025

One issue I see with using DeepPartial is that it will then become a typings nightmare to properly return the correct object

image

I wonder if a better alternative is to actually only update the query if it is complete
I had that idea in the beginning because in my opinion, if for whatever reason the previous data is missing or incomplete, I will want to no-op the update.
It does make a difference in the runtime and could potentially affect some legit use case (although I can't think of one) I feel it might be the better/safer approach.
Likely, if you have a good reason to want to write in the cache of an incomplete query, you're more likely to call cache.writeQuery manually than rely on updateQuery

public updateQuery<TVars extends OperationVariables = TVariables>(
    mapFn: (
      previousQueryResult: Unmasked<TData>,
      options: Pick<WatchQueryOptions<TVars, TData>, "variables">
    ) => Unmasked<TData> | undefined
  ): void {
    const { queryManager } = this;
    const { result, complete } = queryManager.cache.diff<Unmasked<TData>>({
      query: this.options.query,
      variables: this.variables,
      returnPartialData: true,
      optimistic: false,
    });

    if (complete && result) {
      const newResult = mapFn(result, {
        variables: (this as any).variables,
      });
      if (newResult) {
        queryManager.cache.writeQuery({
          query: this.options.query,
          data: newResult,
          variables: this.variables,
        });

        queryManager.broadcastQueries();
      }
    }
  }

@jerelmiller
Copy link
Member

I go back and forth on this. This sounds like a reasonable change, but I fear its too much of a breaking change for a patch/minor release. Since we don't provide any additional information in the callback (i.e. whether the previous result is complete), there could be cases where suddenly your callback is no longer called and its difficult to tell why.

That said, the callback does take an options argument as the 2nd argument. Perhaps we can provide the complete flag here and let the user decide whether to use the partial data to return a full result or to ignore the update (i.e. return undefined). At least this gives the best of both worlds and puts it into the user's hands on how to handle it.

Looking at the return type of updateQuery, currently its set to Unmasked<TData>, but it does appear the implementation is ok returning a falsey value and will do nothing if thats the case. We should probably reflect this in the types as well by updating the return type to Unmasked<TData> | undefined so that TypeScript allows this.

The tricky part would be updating the TypeScript type here. It would be ideal if it were something like this:

updateQuery(previous, { complete }) {
  if (complete) {
    previous;
  // ^? TData
  }

  previous;
  // ^? DeepPartial<TData>
}

Thoughts on this?

@Cellule
Copy link
Author

Cellule commented Jan 27, 2025

I go back and forth on this. This sounds like a reasonable change, but I fear its too much of a breaking change for a patch/minor release. Since we don't provide any additional information in the callback (i.e. whether the previous result is complete), there could be cases where suddenly your callback is no longer called and its difficult to tell why.

Yeah this is exactly why I'm on the fence with the change as well

That said, the callback does take an options argument as the 2nd argument. Perhaps we can provide the complete flag here and let the user decide whether to use the partial data to return a full result or to ignore the update (i.e. return undefined). At least this gives the best of both worlds and puts it into the user's hands on how to handle it.

Humm yeah that could work, but indeed the typings would be the tricky part

Looking at the return type of updateQuery, currently its set to Unmasked<TData>, but it does appear the implementation is ok returning a falsey value and will do nothing if thats the case. We should probably reflect this in the types as well by updating the return type to Unmasked<TData> | undefined so that TypeScript allows this.

Right, I did want to update at least the return type which is more accurate and backward compatible.
This is why I have to do this in my code currently updateQuery(prev) { if (!prev) return prev!; ... }

The tricky part would be updating the TypeScript type here. It would be ideal if it were something like this:

updateQuery(previous, { complete }) {
  if (complete) {
    previous;
  // ^? TData
  }

  previous;
  // ^? DeepPartial<TData>
}

Thoughts on this?

Keeping backward compatibility and typescript relation between the 2 variables sounds like a challenge!
I'll try to give it some thoughts, but whatever solution it is likely to cause friction after the update, which I think is unavoidable

@jerelmiller
Copy link
Member

whatever solution it is likely to cause friction after the update, which I think is unavoidable

Definitely unfortunate, but I'd wager its more preferable than a crash in production!

@Cellule Cellule force-pushed the update-query-typings branch from 3188a44 to 179608a Compare January 27, 2025 20:57
@Cellule Cellule changed the base branch from main to release-3.13 January 27, 2025 20:57
Copy link

pkg-pr-new bot commented Jan 27, 2025

npm i https://pkg.pr.new/@apollo/client@12276

commit: 0c11195

@Cellule
Copy link
Author

Cellule commented Jan 27, 2025

Alright here's my attempt

This shows my reasoning best I think

const updateQuery: Parameters<typeof observable.updateQuery>[0] = jest.fn(
      (previousResult) => {
        expect(previousResult.complete).toBe(true);
        // Type guard
        if (!previousResult.complete) {
          return undefined;
        }
        return { user: { ...previousResult.user, name: "User (updated)" } };
      }
    );

There's no way I can think of to bind the type of a parameter with a type guard on another parameter.
The details can be tweaked, but my idea is to attach a complete property straight on the result. Obviously this doesn't work as-is since the result could have a complete property.
In the callback, if you don't check for prev.complete the type will be Partial<Unmasked<TData>> (I gave up on DeepPartial because it was giving me typescript errors due to type being too complex)

I cleaned up a bunch of types that we're not shared where it should
I fixed the typings for variables in the options to be TVariables and added a new subscriptionVariables: TSubscriptionVariables in the subscribeToMore case

Let me know what you think

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants