Skip to content

Convert HF to ggml error. #33

Description

@phamkhactu

Thanks for great repo!!

I have HF model(llama) like that

image

But when I using script: python convert_hf_to_ggml.py ../7b/ ../7b/. I get error:

  File "convert_hf_to_ggml.py", line 81, in <module>
    config = AutoConfig.from_pretrained(model_name,   local_files_only=True)
  File "/home/tupk/anaconda3/envs/nlp/lib/python3.8/site-packages/transformers/models/auto/configuration_auto.py", line 955, in from_pretrained
    config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
  File "/home/tupk/anaconda3/envs/nlp/lib/python3.8/site-packages/transformers/configuration_utils.py", line 617, in get_config_dict
    config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
  File "/home/tupk/anaconda3/envs/nlp/lib/python3.8/site-packages/transformers/configuration_utils.py", line 672, in _get_config_dict
    resolved_config_file = cached_file(
  File "/home/tupk/anaconda3/envs/nlp/lib/python3.8/site-packages/transformers/utils/hub.py", line 388, in cached_file
    raise EnvironmentError(
OSError: ../7b-vi/ does not appear to have a file named config.json. Checkout 'https://huggingface.co/../7b-vi//None' for available files.

How can I fix it?
Thank you

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions