U di=@sfUdZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z m Z m Z mZmZmZmZmZmZmZmZmZddlmZddlmZmZmZmZmZmZdd l m!Z!m"Z"m#Z#m$Z$d d l%m&Z&m'Z'e rdd l(m)Z)m*Z*dd l+m,Z,e-Z.ee-e fZ/ee0ee/e.de1e2fZ3ddhZ4e5e6Z7eGdddZ8Gddde0Z9ddZ:ddZ;ddZe3e-e-d"d#d$Z?e-dd%d&d'Z@e0edd(d)ZAe0edd*d+ZBe0ddd,d-ZCee0efed.d/d0ZDee0eEeee-ee'fd1d2d3ZFe e0eEee e-e e'fd1d4d5ZGe0eEeee-e'fd6d7d8ZHee0ee&d9d:d;ZIe e0e e&d9dd?d@ZKdAdBe e0dCdDdEZLiZMeee-ee-feNdF<ee-ee-ddGdHdIZOee-ee-dJdKdLZPeedMdNdOZQee-ee-edPdQdRZRdS)SzEContains utilities used by both the sync and async inference clients.N) dataclass)Path) TYPE_CHECKINGAny AsyncIterableBinaryIODictIterableListLiteralNoReturnOptionalUnionoverload) HTTPError)GenerationErrorIncompleteGenerationErrorOverloadedErrorTextGenerationError UnknownErrorValidationError) get_sessionis_aiohttp_availableis_numpy_availableis_pillow_available)ChatCompletionStreamOutputTextGenerationStreamOutput)ClientResponse ClientSessionImager"z text-to-imagezimage-to-imagec@s\eZdZUeed<eed<eeed<eeeeefed<ee ed<eee fed<dS)RequestParametersurlZtaskmodeljsondataheadersN) __name__ __module__ __qualname__str__annotations__r rrr bytesrr/r/E/tmp/pip-unpacked-wheel-ohruig0i/huggingface_hub/inference/_common.pyr#Es   r#cs<eZdZUdZeeed<deeedfdd ZZ S) MimeBytesa& A bytes object with a mime type. To be returned by `_prepare_payload_open_as_mime_bytes` in subclasses. Example: ```python >>> b = MimeBytes(b"hello", "text/plain") >>> isinstance(b, bytes) True >>> b.mime_type 'text/plain' ``` mime_typeN)r'r2cs2t||}||_t|tr.|dkr.|j|_|SN)super__new__r2 isinstancer1)clsr'r2obj __class__r/r0r5`s zMimeBytes.__new__)N) r)r*r+__doc__r r,r-r.r5 __classcell__r/r/r9r0r1Os  r1cCststdddl}|S)NzMPlease install aiohttp to use `AsyncInferenceClient` (`pip install aiohttp`).r)r ImportErroraiohttp)r>r/r/r0_import_aiohttpksr?cCststdddl}|S)z.Make sure `numpy` is installed on the machine.zGPlease install numpy to use deal with embeddings (`pip install numpy`).rN)rr=numpy)r@r/r/r0 _import_numpytsrAcCststdddlm}|S)z,Make sure `PIL` is installed on the machine.zPlease install Pillow to use deal with images (`pip install Pillow`). If you don't want the image to be post-processed, use `client.post(...)` and get the raw response from the server.rr!)rr=PILr"r!r/r/r0_import_pil_image}s  rC)contentreturncCsdSr3r/rDr/r/r0_open_as_mime_bytessrGcCsdSr3r/rFr/r/r0rGscCs|dkr dSt|trt|St|ttfr8tt|St|drtd|}t|drnt |j dnd}t|t rt dt||dSt|t r|ds|d rtd |t|}|jd }|dkrt |d}t|j|dSt|}|std |d t|trTtd|t|t |ddStrddlm}t||jrtdt}|jpd}|j||dt|d|dSt dt |ddS)zOpen `content` as a binary file, either from a URL, a local path, raw bytes, or a PIL Image. Do nothing if `content` is None. NreadzReading content from BinaryIOnamerz3Expected binary stream (bytes), but got text stream)r2https://http://zDownloading content from z Content-TypezFile not found at z. If `data` is a string, it must either be a URL or a path to a local file. To pass raw content, please encode it as bytes first.zOpening content from r!zConverting PIL Image to bytesZPNG)formatzimage/zUnsupported content type: zl. Expected one of: bytes, bytearray, BinaryIO, memoryview, Path, str (URL or file path), or PIL.Image.Image.)!r6r.r1 bytearray memoryviewhasattrloggerdebugrH mimetypes guess_typerIr, TypeError startswithrgetr(rDrexistsFileNotFoundError read_bytesrrBr"ioBytesIOrLsavegetvaluelowertype)rDr'r2responser"bufferrLr/r/r0rGsP               cCst|}t|S)z\Encode a raw file (image, audio) into base64. Can be bytes, an opened file, a path or a URL.)rGbase64 b64encodedecode)rD raw_bytesr/r/r0 _b64_encodesrf)rDdefault_mime_typerEcCsHt|tr|dr|St|}|jp(|}t|}d|d|S)N)rKrJdata:rhz;base64,)r6r,rUrGr2rbrcrd)rDrgrer2Z encoded_datar/r/r0_as_urls  ri) encoded_imagerEcCst}|tt|S)z/Parse a base64-encoded string into a PIL Image.)rCopenrZr[rb b64decode)rjr"r/r/r0 _b64_to_imagesrmcCst|S)acParse bytes from a Response object into a Python list. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_dict` and will not complain if the returned data is a dictionary. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. r&loadsrdrFr/r/r0_bytes_to_listsrpcCst|S)acParse bytes from a Response object into a Python dictionary. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_list` and will not complain if the returned data is a list. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. rnrFr/r/r0_bytes_to_dictsrqcCst}|t|S)zParse bytes from a Response object into a PIL Image. Expects the response body to be raw bytes. To deal with b64 encoded images, use `_b64_to_image` instead. )rCrkrZr[)rDr"r/r/r0_bytes_to_image srr)r`rEcCst|trt|S|Sr3)r6r.r&ro)r`r/r/r0_as_dictsrs)bytes_output_as_linesdetailsrEc csF|D]<}zt||}Wntk r0YqBYnX|dk r|VqdS)z*Used in `InferenceClient.text_generation`.N%_format_text_generation_stream_output StopIterationrtru byte_payloadoutputr/r/r0 _stream_text_generation_responses r|c CsP|2zD3dHW}zt||}Wntk r8YqLYnX|dk r|Vq6dS)z/Used in `AsyncInferenceClient.text_generation`.Nrvryr/r/r0&_async_stream_text_generation_response's r})rzrurEcCs~|dsdS|dkr"td|d}t|dd}|ddk rdt |d|dt |}|sz|j j S|S Nsdata:s data: [DONE]z[DONE] signal received.zutf-8rhz/nerror error_type)rUstriprxrdr&rolstriprstriprV_parse_text_generation_errorrparse_obj_as_instancetokentext)rzrupayload json_payloadr{r/r/r0rw5s    rw) bytes_linesrEc csD|D]:}z t|}Wntk r.Yq@YnX|dk r|VqdS)zFUsed in `InferenceClient.chat_completion` if model is served with TGI.N%_format_chat_completion_stream_outputrxritemr{r/r/r0 _stream_chat_completion_responseKs  rc CsN|2zB3dHW}z t|}Wntk r6YqJYnX|dk r|Vq6dS)z/Used in `AsyncInferenceClient.chat_completion`.Nrrr/r/r0&_async_stream_chat_completion_responseXs  r)rzrEcCsn|dsdS|dkr"td|d}t|dd}|ddk rdt |d|dt |Sr~) rUrrxrdr&rorrrVrrr)rzrrr/r/r0res   rr r)clientr`rEcCs:z$|j2z3dHW}|Vq6W5|IdHXdSr3)closerDr)rr`rzr/r/r0_async_yield_fromzsr#_UNSUPPORTED_TEXT_GENERATION_KWARGS)r%unsupported_kwargsrEcCst|g|dSr3)r setdefaultextend)r%rr/r/r0'_set_unsupported_text_generation_kwargssr)r%rEcCs t|gSr3)rrV)r%r/r/r0'_get_unsupported_text_generation_kwargssr) http_errorrEcCshz.t|ddp|j}|d}|d}Wntk rF|YnX|dk r`t||}|||dS)z Try to parse text-generation-inference error message and raise HTTPError in any case. Args: error (`HTTPError`): The HTTPError that have been raised. Zresponse_error_payloadNrr)getattrr`r&rV Exceptionr)rrrr exceptionr/r/r0raise_text_generation_errors    r)rrrEcCsH|dkrt|S|dkr t|S|dkr0t|S|dkr@t|St|S)NZ generationZincomplete_generationZ overloadedZ validation)rrrrr)rrr/r/r0rsr)Sr;rbrZr&loggingrRZ dataclassesrpathlibrtypingrrrrrr r r r r rrrequestsrZhuggingface_hub.errorsrrrrrrutilsrrrrZ_generated.typesrrr>rr Z PIL.Imager"r,ZUrlTZPathTr.rMrNZContentTZTASKS_EXPECTING_IMAGES getLoggerr)rPr#r1r?rArCrGrfrirmrprqrrrsboolr|r}rwrrrrrr-rrrrr/r/r/r0s  8        B