U
dia @ s d dl Z d dlZd dlZd dlZd dlmZ d dlmZmZm Z m
Z
m Z m Z d dl
Zd dlZddlmZ ddlmZ ddlmZmZmZmZmZmZm Z m Z m Z m Z m Z e rd dl!m"Z" e #e$Z%G d d
d
eZG d d d eZ&ee&j'e&_'e&j'j(dk re&j'j(j)d
ddde&j'_(dS ) N)BytesIO)AnyDictListOptionalTupleUnion )custom_object_save) BatchFeature) IMAGE_PROCESSOR_NAMEPushToHubMixinadd_model_info_to_auto_map"add_model_info_to_custom_pipelines cached_file copy_func download_urlis_offline_mode
is_remote_urlis_vision_availablelogging)Imagec @ s e Zd ZdZdS )r a
Holds the output of the image processor specific `__call__` methods.
This class is derived from a python dictionary and can be used as a dictionary.
Args:
data (`dict`):
Dictionary of lists/arrays/tensors returned by the __call__ method ('pixel_values', etc.).
tensor_type (`Union[None, str, TensorType]`, *optional*):
You can give a tensor_type here to convert the lists of integers in PyTorch/TensorFlow/Numpy Tensors at
initialization.
N)__name__
__module__ __qualname____doc__ r r F/tmp/pip-unpacked-wheel-bm_b0l5e/transformers/image_processing_base.pyr 5 s r c
@ s` e Zd ZdZdZdd ZedddZed)e ee
j f e e ee
j f e
e
e e ee
f ed
d d Zd*e ee
j f e
d
ddZee ee
j f eeeef eeef f dddZeeeef dddZeeef dddZee ee
j f dddZedd d Ze ee
j f d d d Zd!d" Zed+d$d%Ze eee f d&d'd(Z dS ),ImageProcessingMixinz
This is an image processor mixin used to provide saving/loading functionality for sequential and image feature
extractors.
Nc K s | dd | dd| _| D ]\\}}zt| || W q" tk
r| } z$td| d| d| |W 5 d}~X Y q"X q"dS )z'Set elements of `kwargs` as attributes.Zfeature_extractor_typeNprocessor_classz
Can't set z with value z for )pop_processor_classitemssetattrAttributeErrorloggererror)selfkwargskeyvalueerrr r r __init__M s z ImageProcessingMixin.__init__)r c C s
|| _ dS )z%Sets processor class as an attribute.N)r! )r' r r r r _set_processor_class\ s z)ImageProcessingMixin._set_processor_classFmain) pretrained_model_name_or_path cache_dirforce_downloadlocal_files_onlytokenrevisionc
K s ||d< ||d< ||d< ||d< | dd}|dk rTtdt |dk rPtd|}|dk rd||d < | j|f|\} }| j| f|S )
a
Instantiate a type of [`~image_processing_utils.ImageProcessingMixin`] from an image processor.
Args:
pretrained_model_name_or_path (`str` or `os.PathLike`):
This can be either:
- a string, the *model id* of a pretrained image_processor hosted inside a model repo on
huggingface.co.
- a path to a *directory* containing a image processor file saved using the
[`~image_processing_utils.ImageProcessingMixin.save_pretrained`] method, e.g.,
`./my_model_directory/`.
- a path or url to a saved image processor JSON *file*, e.g.,
`./my_model_directory/preprocessor_config.json`.
cache_dir (`str` or `os.PathLike`, *optional*):
Path to a directory in which a downloaded pretrained model image processor should be cached if the
standard cache should not be used.
force_download (`bool`, *optional*, defaults to `False`):
Whether or not to force to (re-)download the image processor files and override the cached versions if
they exist.
resume_download:
Deprecated and ignored. All downloads are now resumed by default when possible.
Will be removed in v5 of Transformers.
proxies (`Dict[str, str]`, *optional*):
A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128',
'http://hostname': 'foo.bar:4012'}.` The proxies are used on each request.
token (`str` or `bool`, *optional*):
The token to use as HTTP bearer authorization for remote files. If `True`, or not specified, will use
the token generated when running `huggingface-cli login` (stored in `~/.huggingface`).
revision (`str`, *optional*, defaults to `"main"`):
The specific model version to use. It can be a branch name, a tag name, or a commit id, since we use a
git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any
identifier allowed by git.
To test a pull request you made on the Hub, you can pass `revision="refs/pr/"`.
return_unused_kwargs (`bool`, *optional*, defaults to `False`):
If `False`, then this function returns just the final image processor object. If `True`, then this
functions returns a `Tuple(image_processor, unused_kwargs)` where *unused_kwargs* is a dictionary
consisting of the key/value pairs whose keys are not image processor attributes: i.e., the part of
`kwargs` which has not been used to update `image_processor` and is otherwise ignored.
subfolder (`str`, *optional*, defaults to `""`):
In case the relevant files are located inside a subfolder of the model repo on huggingface.co, you can
specify the folder name here.
kwargs (`Dict[str, Any]`, *optional*):
The values in kwargs of any keys which are image processor attributes will be used to override the
loaded values. Behavior concerning key/value pairs whose keys are *not* image processor attributes is
controlled by the `return_unused_kwargs` keyword parameter.
Returns:
A image processor of type [`~image_processing_utils.ImageProcessingMixin`].
Examples:
```python
# We can't instantiate directly the base class *ImageProcessingMixin* so let's show the examples on a
# derived class: *CLIPImageProcessor*
image_processor = CLIPImageProcessor.from_pretrained(
"openai/clip-vit-base-patch32"
) # Download image_processing_config from huggingface.co and cache.
image_processor = CLIPImageProcessor.from_pretrained(
"./test/saved_model/"
) # E.g. image processor (or model) was saved using *save_pretrained('./test/saved_model/')*
image_processor = CLIPImageProcessor.from_pretrained("./test/saved_model/preprocessor_config.json")
image_processor = CLIPImageProcessor.from_pretrained(
"openai/clip-vit-base-patch32", do_normalize=False, foo=False
)
assert image_processor.do_normalize is False
image_processor, unused_kwargs = CLIPImageProcessor.from_pretrained(
"openai/clip-vit-base-patch32", do_normalize=False, foo=False, return_unused_kwargs=True
)
assert image_processor.do_normalize is False
assert unused_kwargs == {"foo": False}
```r0 r1 r2 r4 use_auth_tokenNrThe `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.V`token` and `use_auth_token` are both specified. Please set only the argument `token`.r3 )r warningswarn
FutureWarning
ValueErrorget_image_processor_dict from_dict)
clsr/ r0 r1 r2 r3 r4 r( r5 image_processor_dictr r r from_pretrained` s& Z z$ImageProcessingMixin.from_pretrained)save_directory push_to_hubc K s | dd}|dk r@tdt |dddk r8td||d< tj|r\t d| dtj
|dd |r| d
d}| d | tjj d }| j
|f|}| |}| jdk rt| || d
tj|t}| | td| |r | j|||||dd |gS )as
Save an image processor object to the directory `save_directory`, so that it can be re-loaded using the
[`~image_processing_utils.ImageProcessingMixin.from_pretrained`] class method.
Args:
save_directory (`str` or `os.PathLike`):
Directory where the image processor JSON file will be saved (will be created if it does not exist).
push_to_hub (`bool`, *optional*, defaults to `False`):
Whether or not to push your model to the Hugging Face model hub after saving it. You can specify the
repository you want to push to with `repo_id` (will default to the name of `save_directory` in your
namespace).
kwargs (`Dict[str, Any]`, *optional*):
Additional key word arguments passed along to the [`~utils.PushToHubMixin.push_to_hub`] method.
r5 Nr6 r3 r7 zProvided path (z#) should be a directory, not a fileT)exist_okcommit_messagerepo_id)configzImage processor saved in )rD r3 )r r8 r9 r: getr; ospathisfileAssertionErrormakedirssplitsepZ _create_repoZ_get_files_timestamps _auto_classr
joinr to_json_filer% infoZ_upload_modified_files) r' rA rB r( r5 rD rE Zfiles_timestampsZoutput_image_processor_filer r r save_pretrained sB
z$ImageProcessingMixin.save_pretrained)r/ returnc
K s| | dd}| dd}| dd}| dd}| dd}| dd}| d d} | d
d}
| d d } | d
d} | dd}
|dk rtdt |dk rtd|}d|
d}| dk r| |d< t r| std d} t|}t j
|}t j
|rt j
|t
}t j
|r&|}d}nt|r>|}t|}npt
}z"t||||||| |||
| d }W nH tk
r| Y n2 tk
r td| d| dt
dY nX z0t|dd d }| }W 5 Q R X t|}W n( tjk
r td | d Y nX |r td | ntd | d!| |std"|krXt|d" ||d"< d#|krtt|d# ||d#< ||fS )$a
From a `pretrained_model_name_or_path`, resolve to a dictionary of parameters, to be used for instantiating a
image processor of type [`~image_processor_utils.ImageProcessingMixin`] using `from_dict`.
Parameters:
pretrained_model_name_or_path (`str` or `os.PathLike`):
The identifier of the pre-trained checkpoint from which we want the dictionary of parameters.
subfolder (`str`, *optional*, defaults to `""`):
In case the relevant files are located inside a subfolder of the model repo on huggingface.co, you can
specify the folder name here.
Returns:
`Tuple[Dict, Dict]`: The dictionary(ies) that will be used to instantiate the image processor object.
r0 Nr1 Fresume_downloadproxiesr3 r5 r2 r4 subfolder Z_from_pipelineZ
_from_autor6 r7 image processor) file_typefrom_auto_classZusing_pipelinez+Offline mode: forcing local_files_only=TrueT) r0 r1 rW rV r2 r3
user_agentr4 rX z Can't load image processor for 'z'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'z2' is the correct path to a directory containing a z filerutf-8encodingz"It looks like the config file at 'z' is not a valid JSON file.zloading configuration file z from cache at Zauto_mapZcustom_pipelines)r r8 r9 r: r; r r% rS strrI rJ isdirrQ r rK r r r EnvironmentError ExceptionopenreadjsonloadsJSONDecodeErrorr r )r> r/ r( r0 r1 rV rW r3 r5 r2 r4 rX Z
from_pipeliner\ r] is_localZimage_processor_fileZ resolved_image_processor_filereadertextr? r r r r< s
z-ImageProcessingMixin.get_image_processor_dict)r? c K s | }|dd}d|kr2d|kr2|d|d< d|krPd|krP|d|d< | f |}g }| D ](\}}t||rft||| || qf|D ]}||d qtd| |r||fS |S dS )a
Instantiates a type of [`~image_processing_utils.ImageProcessingMixin`] from a Python dictionary of parameters.
Args:
image_processor_dict (`Dict[str, Any]`):
Dictionary that will be used to instantiate the image processor object. Such a dictionary can be
retrieved from a pretrained checkpoint by leveraging the
[`~image_processing_utils.ImageProcessingMixin.to_dict`] method.
kwargs (`Dict[str, Any]`):
Additional parameters from which to initialize the image processor object.
Returns:
[`~image_processing_utils.ImageProcessingMixin`]: The image processor object instantiated from those
parameters.
return_unused_kwargsFsizeZ crop_sizeNzImage processor )copyr r" hasattrr# appendr% rS )r> r? r( rn Zimage_processorZ to_remover) r* r r r r= s$
z ImageProcessingMixin.from_dict)rU c C s t | j}| jj|d< |S )z
Serializes this instance to a Python dictionary.
Returns:
`Dict[str, Any]`: Dictionary of all the attributes that make up this image processor instance.
Zimage_processor_type)rp deepcopy__dict__ __class__r )r' outputr r r to_dict s z ImageProcessingMixin.to_dict) json_filec C s6 t |ddd}| }W 5 Q R X t|}| f |S )a
Instantiates a image processor of type [`~image_processing_utils.ImageProcessingMixin`] from the path to a JSON
file of parameters.
Args:
json_file (`str` or `os.PathLike`):
Path to the JSON file containing the parameters.
Returns:
A image processor of type [`~image_processing_utils.ImageProcessingMixin`]: The image_processor object
instantiated from that JSON file.
r^ r_ r` )rf rg rh ri )r> rx rl rm r? r r r from_json_file s
z#ImageProcessingMixin.from_json_filec C sb | }| D ] \}}t|tjr| ||< q|dd}|dk rN||d< tj|dddd S )z
Serializes this instance to a JSON string.
Returns:
`str`: String containing all the attributes that make up this feature_extractor instance in JSON format.
r! Nr T)indent sort_keys
) rw r"
isinstancenpZndarraytolistr rh dumps)r'
dictionaryr) r* r! r r r to_json_string s z#ImageProcessingMixin.to_json_string)json_file_pathc C s, t |ddd}|| W 5 Q R X dS )z
Save this instance to a JSON file.
Args:
json_file_path (`str` or `os.PathLike`):
Path to the JSON file in which this image_processor instance's parameters will be saved.
wr_ r` N)rf writer )r' r writerr r r rR s z!ImageProcessingMixin.to_json_filec C s | j j d| S )N )ru r r r' r r r __repr__ s z ImageProcessingMixin.__repr__AutoImageProcessorc C sD t |ts|j}ddlm m} t||s:t| d|| _dS )a
Register this class with a given auto class. This should only be used for custom image processors as the ones
in the library are already mapped with `AutoImageProcessor `.
This API is experimental and may have some slight breaking changes in the next releases.
Args:
auto_class (`str` or `type`, *optional*, defaults to `"AutoImageProcessor "`):
The auto class to register this new image processor with.
r Nz is not a valid auto class.) r~ rb r Ztransformers.models.automodelsautorq r; rP )r> Z
auto_classZ auto_moduler r r register_for_auto_class s
z,ImageProcessingMixin.register_for_auto_class)image_url_or_urlsc sl ddi}t |tr$ fdd|D S t |trVtj|d|d}| tt|j S t
dt | dS ) z
Convert a single or a list of urls into the corresponding `PIL.Image` objects.
If a single url is passed, the return value will be a single object. If a list is passed a list of objects is
returned.
z
User-AgentzuMozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/114.0.0.0 Safari/537.36c s g | ]} |qS r ) fetch_images).0xr r r
s z5ImageProcessingMixin.fetch_images..T)streamheadersz=only a single or a list of entries is supported but got type=N) r~ listrb requestsrH raise_for_statusr rf r content TypeErrortype)r' r r responser r r r s
z!ImageProcessingMixin.fetch_images)NFFNr. )F)r ) r r r r rP r, rb r- classmethodr rI PathLiker boolr@ rT r r r r< r= rw ry r rR r r r r r r r r r E sD q = v, r rZ r zimage processor file)objectZ object_classZ object_files)*rp rh rI r8 ior typingr r r r r r Znumpyr r Zdynamic_module_utilsr
Zfeature_extraction_utilsr ZBaseBatchFeatureutilsr r
r r r r r r r r r ZPILr Z
get_loggerr r% r rB r formatr r r r s2 4
d