Skip to content

Retain final benchmark observations at simulated completion - #5315

Closed
ltiao wants to merge 1 commit into
meta:mainfrom
ltiao:export-D130806064
Closed

ltiao wants to merge 1 commit into
meta:mainfrom
ltiao:export-D130806064

Conversation

@ltiao

@ltiao ltiao commented Nov 10, 2026

Copy link
Copy Markdown
Contributor

Summary:

Why

Subtracting a nonzero start time from a simulated completion timestamp can round the elapsed duration down. The benchmark metric then excludes the final observation even though the simulator has completed the trial.

Changes

  • Compare observation timestamps with the simulator clock or recorded completion timestamp on the same absolute-time basis.
  • Preserve running and early-stopped cutoffs and the existing rejection of future completion timestamps, without adding a numerical tolerance.
  • Cover the cancellation case, the representable instant immediately before completion, early stopping, and later fetches for map and time-varying metrics.

Examples

For start time 192.0 and runtime 320.10965660870767, subtracting the start from the completion timestamp yields 320.1096566087076. Previously the final row was excluded; it is now retained at completion. Stopping at the preceding representable timestamp still excludes it.

Differential Revision: D130806064

Summary:
# Why
Subtracting a nonzero start time from a simulated completion timestamp can round the elapsed duration down. The benchmark metric then excludes the final observation even though the simulator has completed the trial.

# Changes
- Compare observation timestamps with the simulator clock or recorded completion timestamp on the same absolute-time basis.
- Preserve running and early-stopped cutoffs and the existing rejection of future completion timestamps, without adding a numerical tolerance.
- Cover the cancellation case, the representable instant immediately before completion, early stopping, and later fetches for map and time-varying metrics.

# Examples
For start time `192.0` and runtime `320.10965660870767`, subtracting the start from the completion timestamp yields `320.1096566087076`. Previously the final row was excluded; it is now retained at completion. Stopping at the preceding representable timestamp still excludes it.

Differential Revision: D130806064
@meta-cla meta-cla Bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Nov 10, 2026
@meta-codesync

meta-codesync Bot commented Nov 10, 2026

Copy link
Copy Markdown

@ltiao has exported this pull request. If you are a Meta employee, you can view the originating Diff in D130806064.

@meta-codesync

meta-codesync Bot commented Nov 10, 2026

Copy link
Copy Markdown

This pull request has been merged in 45a6584.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed Do not delete this pull request or issue due to inactivity. Merged meta-exported

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant