Optimizing admin dashboard add_user_stats

[JGreenlee]

Optimizing admin dashboard add_user_stats

op-admin-dashboard/utils/db_utils.py

Line 433 in 5e1b235

def add_user_stats(user_data, batch_size=5):

_get_and_store_range on the server already stores pipeline_range to the user profile, which has start_ts and end_ts.
We can extend _get_and_store_range to also store total_trips and labeled_trips.

For last_call, we can look at stats/server_api_time and look at the last GET and last PUT calls

@TeachMeTW

[shankari]

start by moving the _get_and_store_range to a real pipeline stage with its own timer. We can deploy that right now (today). Then when the real changes are done we can see the tradeoff in increased time on the server with decreased time on the admin dashboard.

[shankari]

@TeachMeTW by tonight

1. add a timer to the "ad-hoc" pipeline step
2. add timers to parts of the trip segmentation, with suffixes
3. keep it clean and small so we can get a quick review