_get_checkpoint_shard_files offline mode fix #12132
Closed
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Teriks
added a commit
to Teriks/dgenerate
that referenced
this pull request
Aug 12, 2025
Create vendored configs and other generated assets in refactored assetgen build system which handles generated assets for the project. Redirect to dgenerate.pipelinewrapper.hub_configs when possible in --offline-mode This allows loading single file checkpoints for SD1.5, SD2, SD3, and Flux without ever connecting to the hub even once. You must download and specify a VAE on disk manually for Flux and SD3 for single file loads. This behavior is patched into huggingface_hub and diffusers dynamically and active when --offline-mode is enabled. Patch in fix for diffusers not honoring offline mode for sharded checkpoints: huggingface/diffusers#12132
|
Hmm, I should have went looking |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What does this PR do?
_get_checkpoint_shard_filesmakes a network call withhf_api.model_infowhenlocal_files_onlyisTrueor when offline mode envvars are present.This call is used to pre-validate shard files exist before downloading additional files.
This can be delayed until after
snapshot_downloadwhen in offline mode, in the case thatsnapshot_downloadis going to pull from the hub cache.This fixes issues with using SD3 / Flux checkpoints in offline mode, as they rely on models that are sharded and hit this code path.
Before submitting
documentation guidelines, and
here are tips on formatting docstrings.
Who can review?
@sayakpaul @yiyixuxu @DN6