Pivot not loading all data on initial display

[Bruce.Wilson]

Hello,
I created a pivot grid that has a date filter between 10-01-2024 and the current date. The first time I display the pivot grid in my dashboard app, it doesn't always display all the data. If I click on the Apply button beside the date filter, it loads the remaining records and my pivot totals look correct. If I close the app and re-open it, the totals are correct without having to re-apply the filter. I used a different browser and got the same result, first time launching, totals are wrong. Close app, re-open and totals are correct. The pivot table is being built over a file with several hundred thousand records. Is there a way to make it load all the records without having to click the Apply button or close and re-open the app. I don't want users to look at the totals if they are wrong.
Thanks,
Bruce

[sean.lanktree]

Are you seeing a loading mask against your pivot table when you start the app? What about when you hit "Apply". Since you have an apply button I assume you have user filters, are you setting filters before hitting apply?

[Bruce.Wilson]

The app is inside a tab container that has 8 widgits. It is a dashboard that shows different shipment pivots. So yes, it does look like there is a pause while it is loading data for all 8 tabs. The widgit in question is based on a shipment history file that has detail for all shipments. For example, in column 202508, it might initially show 100, 200, 300. I don't get an error, so the user thinks that the amounts are correct. But if I click the apply button it reloads the pivot and show the correct amounts. As shown below, you can see the filter setup, and the fact that the inital values are set. The shipment history file has several hundred thousand records going back a number of years. I do have a where statement in the data source that only pulls records from the last 7 years. I'm estimating that the pivot is probably summing up over 50,000 records for what is being displayed.

.

[sean.lanktree]

You mentioned that your pivot grid could have hundreds of thousands of records. Are you seeing a load mask against your pivot grid (not the entire app) when it is loading? I would expect that this amount of records may take minutes to load. Or does it appear that all of those records are being loaded very quickly? Have you started the NAB Dev Console and looked at the network traffic and viewed the SQL statement running? This may give a clue.

[Bruce.Wilson]

Ok, it was impossible to check for the mask in the Dashboard app, so I created a new app with just one widgit, the pivot grid of shipments. I can see the mask as it is loading and it goes to 100%, but I am missing data. I put the developer console and watched it run. Could this be the problem?
image.png

[sean.lanktree]

Since it cannot load all records at once you should see a series of network calls. So if your data has 50,000 records you should see 10 calls (each for 5,000). How many of these calls do you see being made?

[Bruce.Wilson]

Hi Sean,
I see a total of 6 network calls. I expanded each one and can see the 5000 entries, with the last one being 2,913, that totals up to 27,913 records. When I look at the resulting pivot table, entries are missing. I just cleared the network calls, clicked the Apply button and the pivot table is complete. I checked the network calls again and 6 calls were made, returning a total of 27,913 records. So, it looks like I'm getting the same number of records, but they aren't being shown on the pivot table. I'm using Edge as my browser. I also tried the Duck-Duck-Go browser and am missing records there as well.
Thanks,
Bruce

[Bruce.Wilson]

Hello,
Still trying to correct this problem. I called up the app and clicked on the ship tab, my pivot grid is incomplete. When I click on the Apply button I am getting an error. I attached below. Is there a way that I can force recalculation. When I look at the network calls it appears as if all records are being loaded, when my pivot is complete or not.
Thanks,
Bruce Error ID 3.pdf

[sean.lanktree]

Just want to confirm, are you expecting to see all 27,913 individual rows in your pivot grid?

[Bruce.Wilson]

Hi Sean,
In the pivot grid that I'm creating there should be 12 columns with three rows. The columns sum up all of the shipments by month and the rows are for each customer type. So, the 27,913 records should be in the pivot in sum.
Thanks,
Bruce