Skip to content

Faster tar-ro through indexing at initialization#698

Merged
jaybosamiya-ms merged 1 commit intomainfrom
jayb/tarro-cached-data
Mar 3, 2026
Merged

Faster tar-ro through indexing at initialization#698
jaybosamiya-ms merged 1 commit intomainfrom
jayb/tarro-cached-data

Conversation

@jaybosamiya-ms
Copy link
Member

This PR optimizes our tar_ro file-system by switching O(n) to O(1) lookups through an initialization+indexing pass.

This corresponds to a ~146x speedup on some tar-file heavy situations (such as loading Python), changing it (on some systems) from taking minutes to load to fraction of a second.

@jaybosamiya-ms jaybosamiya-ms marked this pull request as ready for review March 3, 2026 01:31
@github-actions
Copy link

github-actions bot commented Mar 3, 2026

🤖 SemverChecks 🤖 No breaking API changes detected

Note: this does not mean API is unchanged, or even that there are no breaking changes; simply, none of the detections triggered.

Copy link
Member

@wdcui wdcui left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thank you for the performance improvement!

@jaybosamiya-ms jaybosamiya-ms added this pull request to the merge queue Mar 3, 2026
Merged via the queue into main with commit 94c2f98 Mar 3, 2026
14 checks passed
@jaybosamiya-ms jaybosamiya-ms deleted the jayb/tarro-cached-data branch March 3, 2026 21:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants