runtime error
Exit code: 1. Reason: [A model-00007-of-00008.safetensors: 37%|ββββ | 1.48G/4.03G [00:11<00:13, 195MB/s][A model-00007-of-00008.safetensors: 57%|ββββββ | 2.29G/4.03G [00:12<00:05, 308MB/s][A model-00007-of-00008.safetensors: 100%|ββββββββββ| 4.03G/4.03G [00:13<00:00, 307MB/s] model-00008-of-00008.safetensors: 0%| | 0.00/2.49G [00:00<?, ?B/s][A model-00008-of-00008.safetensors: 3%|β | 74.6M/2.49G [00:04<02:26, 16.5MB/s][A model-00008-of-00008.safetensors: 6%|β | 142M/2.49G [00:05<01:22, 28.3MB/s] [A model-00008-of-00008.safetensors: 41%|ββββ | 1.01G/2.49G [00:06<00:06, 241MB/s][A model-00008-of-00008.safetensors: 68%|βββββββ | 1.68G/2.49G [00:07<00:02, 354MB/s][A model-00008-of-00008.safetensors: 100%|ββββββββββ| 2.49G/2.49G [00:08<00:00, 306MB/s] Loading checkpoint shards: 0%| | 0/8 [00:00<?, ?it/s][A Loading checkpoint shards: 100%|ββββββββββ| 8/8 [00:00<00:00, 82646.38it/s] generation_config.json: 0%| | 0.00/117 [00:00<?, ?B/s][A generation_config.json: 100%|ββββββββββ| 117/117 [00:00<00:00, 802kB/s] Traceback (most recent call last): File "/app/app.py", line 94, in <module> model = AutoModelForImageTextToText.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 597, in from_pretrained return model_class.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 277, in _wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 5140, in from_pretrained dispatch_model(model, **device_map_kwargs) File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 504, in dispatch_model raise ValueError( ValueError: You are trying to offload the whole model to the disk. Please use the `disk_offload` function instead.
Container logs:
Fetching error logs...