Skip to content

Implement 1-hour rolling window approach to min-binning#192

Closed
Nate-Wessel wants to merge 66 commits intodeployfrom
min-bins-rolling
Closed

Implement 1-hour rolling window approach to min-binning#192
Nate-Wessel wants to merge 66 commits intodeployfrom
min-bins-rolling

Conversation

@Nate-Wessel
Copy link
Member

@Nate-Wessel Nate-Wessel commented Feb 26, 2025

Working toward an approach where the binning window rolls along, discarding observations >= one hour older than its leading edge.

This would serve to prevent data from being aggregated together over long spans because of

  • discontinuities caused by the query parameters themselves
  • gaps just because the data is sparse

It's just a grouping var anyway and this makes the intermediate python output easier to read
no need to do calculations for data we'll throw out in the next step
does this actually save any bandwidth or space? I don't know but it feels like it could
incidentaly, I did satisfy my curiousity and verified that hmean of the speed is the same as average of the travel time
@Nate-Wessel
Copy link
Member Author

Still need to adjust the join of the bins back onto the data, as that's still a rolling join based on the bin ends.

@Nate-Wessel Nate-Wessel marked this pull request as ready for review February 27, 2025 16:35
@Nate-Wessel Nate-Wessel self-assigned this Feb 27, 2025
@Nate-Wessel
Copy link
Member Author

There's some inefficient code in here, but I'm pretty sure the logic per se is now sound.

@Nate-Wessel Nate-Wessel linked an issue Sep 29, 2025 that may be closed by this pull request
@Nate-Wessel Nate-Wessel changed the base branch from min-bins to deploy October 1, 2025 15:01
@Nate-Wessel Nate-Wessel mentioned this pull request Oct 3, 2025
@Nate-Wessel
Copy link
Member Author

Closing this in favour of #228

@Nate-Wessel Nate-Wessel closed this Oct 7, 2025
@Nate-Wessel Nate-Wessel deleted the min-bins-rolling branch October 7, 2025 13:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Set 30 minute limit to bin length

2 participants