U #FZhv@sdZddlZddlZddlmZddlmZddlmZddlm Z dZ dZ d Z Gd d d e j ejZGd d d e jejZGddde j ejZGddde jejZddZGdddejjZeejdrGdddZndZdS)z/Support for downloading media from Google APIs.N) _download)common)_helpers)_request_helperszChecksum mismatch while downloading: {} The X-Goog-Hash header indicated an {checksum_type} checksum of: {} but the actual {checksum_type} checksum of the downloaded contents was: {} zIncomplete download for: {} Error writing to stream while handling a gzip-compressed file download. Please restart the download. z The X-Goog-Stored-Content-Length is {}. The X-Goog-Stored-Content-Encoding is {}. The download request read {} bytes of data. If the download was incomplete, please check the network connection and restart the download. c@s,eZdZdZddZejejffddZdS)DownloadaHelper to manage downloading a resource from a Google API. "Slices" of the resource can be retrieved by specifying a range with ``start`` and / or ``end``. However, in typical usage, neither ``start`` nor ``end`` is expected to be provided. Args: media_url (str): The URL containing the media to be downloaded. stream (IO[bytes]): A write-able stream (i.e. file-like object) that the downloaded resource can be written to. start (int): The first byte in a range to be downloaded. If not provided, but ``end`` is provided, will download from the beginning to ``end`` of the media. end (int): The last byte in a range to be downloaded. If not provided, but ``start`` is provided, will download from the ``start`` to the end of the media. headers (Optional[Mapping[str, str]]): Extra headers that should be sent with the request, e.g. headers for encrypted data. checksum Optional([str]): The type of checksum to compute to verify the integrity of the object. The response headers must contain a checksum of the requested type. If the headers lack an appropriate checksum (for instance in the case of transcoded or ranged downloads where the remote service does not know the correct checksum) an INFO-level log will be emitted. Supported values are "md5", "crc32c" and None. The default is "md5". Attributes: media_url (str): The URL containing the media to be downloaded. start (Optional[int]): The first byte in a range to be downloaded. end (Optional[int]): The last byte in a range to be downloaded. c Csd|jdkr>|jdkr>tj||j|j|jd\}}||_||_n |j}|j}|Tt|j|}|j t j dd}|D],}|j ||jt|7_||qpW5QRX|dk r`|jtjjkr`t|}||kr`||}|d} |d} t| | |j} | r2|jt| kr2| dkr2t| n.tj|j|||jd} | | 7} t|| dS)Write response body to a write-able stream. .. note: This method assumes that the ``_stream`` attribute is set on the current download. Args: response (~requests.Response): The HTTP response object. Raises: ~google.resumable_media.common.DataCorruption: If the download's checksum doesn't agree with server-computed checksum. NZ checksum_typeF) chunk_sizedecode_unicodex-goog-stored-content-encodingx-goog-stored-content-lengthgzip) _expected_checksum_checksum_objectr_get_expected_checksum _get_headers media_urlchecksum _add_decoderraw iter_contentr_SINGLE_GET_CHUNK_SIZE_streamwrite_bytes_downloadedlenupdate status_codehttpclientPARTIAL_CONTENTprepare_checksum_digestdigestget_RESPONSE_HEADERS_INFOformatintConnectionError_CHECKSUM_MISMATCHupperrDataCorruption) selfresponseexpected_checksumchecksum_objectZlocal_checksum_object body_iterchunkactual_checksumheadersx_goog_encoding x_goog_lengthcontent_length_msgmsgr7o/home/aprabhat/apps/x.techxrdev.in/venv/lib/python3.8/site-packages/google/resumable_media/requests/download.py_write_to_streamYsd          zDownload._write_to_streamcsj\}}}|||djdk r.dd<jdkrFtj_fdd}t|jj S)HConsume the resource to be downloaded. If a ``stream`` is attached to this download, then the downloaded resource will be written to the stream. Args: transport (~requests.Session): A ``requests`` object which can make authenticated requests. timeout (Optional[Union[float, Tuple[float, float]]]): The number of seconds to wait for the server response. Depending on the retry strategy, a request may be repeated several times using the same timeout each time. Can also be passed as a tuple (connect_timeout, read_timeout). See :meth:`requests.Session.request` documentation for details. Returns: ~requests.Response: The HTTP response returned by ``transport``. Raises: ~google.resumable_media.common.DataCorruption: If the download's checksum doesn't agree with server-computed checksum. ValueError: If the current :class:`Download` has already finished. datar2timeoutNTstreamc sj}jdkrjtjpdjjjjd<jdk rjt jdkrjdji}t j|}j |f}jdkrt |j _|jdk rt|j r zjdWn8tk r}zt|}t||W5d}~XYnXd_||SNrr2Z generationrrrZadd_bytes_rangestartend_headers_object_generationr_get_generation_from_urlZadd_query_parametersrequestZ_parse_generation_headerr_process_responserZ_is_decompressive_transcodingseek Exception_STREAM_SEEK_ERRORr%r9urlZ query_paramresultexcr6methodZrequest_kwargsr+ transportr7r8retriable_requests>        z+Download.consume..retriable_request) _prepare_requestrrDrrErrwait_and_retry_get_status_code_retry_strategyr+rQr=_payloadr2rRr7rOr8consumes!  .zDownload.consumeN __name__ __module__ __qualname____doc__r9r_DEFAULT_CONNECT_TIMEOUT_DEFAULT_READ_TIMEOUTrZr7r7r7r8r8s  Trc@s,eZdZdZddZejejffddZdS) RawDownloadaHelper to manage downloading a raw resource from a Google API. "Slices" of the resource can be retrieved by specifying a range with ``start`` and / or ``end``. However, in typical usage, neither ``start`` nor ``end`` is expected to be provided. Args: media_url (str): The URL containing the media to be downloaded. stream (IO[bytes]): A write-able stream (i.e. file-like object) that the downloaded resource can be written to. start (int): The first byte in a range to be downloaded. If not provided, but ``end`` is provided, will download from the beginning to ``end`` of the media. end (int): The last byte in a range to be downloaded. If not provided, but ``start`` is provided, will download from the ``start`` to the end of the media. headers (Optional[Mapping[str, str]]): Extra headers that should be sent with the request, e.g. headers for encrypted data. checksum Optional([str]): The type of checksum to compute to verify the integrity of the object. The response headers must contain a checksum of the requested type. If the headers lack an appropriate checksum (for instance in the case of transcoded or ranged downloads where the remote service does not know the correct checksum) an INFO-level log will be emitted. Supported values are "md5", "crc32c" and None. The default is "md5". Attributes: media_url (str): The URL containing the media to be downloaded. start (Optional[int]): The first byte in a range to be downloaded. end (Optional[int]): The last byte in a range to be downloaded. c Cs`|jdkr>|jdkr>tj||j|j|jd\}}||_||_n |j}|j}|P|jjt j dd}|D],}|j ||j t|7_ ||qfd|_W5QRX|dk r\|jtjjkr\t|}||kr\||}|d}|d} t| ||j } | r.|j t| kr.|dkr.t| n.tj|j|||jd} | | 7} t|| dS) rNrF)decode_contentTr r r ) rrrrrrrrr>rrrrrrr_content_consumedrrrr r!r"r#r$r%r&r'r(r)rr*) r+r,r-r.r/r0r1r2r3r4r5r6r7r7r8r9,sd          zRawDownload._write_to_streamcsZ\}}}|||ddjdkr6tj_fdd}t|jjS)r:T)r<r2r=r>Nc sj}jdkrjtjpdjjjjd<jdk rjt jdkrjdji}t j|}j |f}jdkrt |j _|jdk rt|j r zjdWn8tk r}zt|}t||W5d}~XYnXd_||Sr?r@rKrOr7r8rRs>        z.RawDownload.consume..retriable_request) rSrDrrErrrTrUrVrWr7rOr8rZws! .zRawDownload.consumeNr[r7r7r7r8rb s Orbc@s$eZdZdZejejffddZdS)ChunkedDownloadaDownload a resource in chunks from a Google API. Args: media_url (str): The URL containing the media to be downloaded. chunk_size (int): The number of bytes to be retrieved in each request. stream (IO[bytes]): A write-able stream (i.e. file-like object) that will be used to concatenate chunks of the resource as they are downloaded. start (int): The first byte in a range to be downloaded. If not provided, defaults to ``0``. end (int): The last byte in a range to be downloaded. If not provided, will download to the end of the media. headers (Optional[Mapping[str, str]]): Extra headers that should be sent with each request, e.g. headers for data encryption key headers. Attributes: media_url (str): The URL containing the media to be downloaded. start (Optional[int]): The first byte in a range to be downloaded. end (Optional[int]): The last byte in a range to be downloaded. chunk_size (int): The number of bytes to be retrieved in each request. Raises: ValueError: If ``start`` is negative. cs:\fdd}t|jjS)+Consume the next chunk of the resource to be downloaded. Args: transport (~requests.Session): A ``requests`` object which can make authenticated requests. timeout (Optional[Union[float, Tuple[float, float]]]): The number of seconds to wait for the server response. Depending on the retry strategy, a request may be repeated several times using the same timeout each time. Can also be passed as a tuple (connect_timeout, read_timeout). See :meth:`requests.Session.request` documentation for details. Returns: ~requests.Response: The HTTP response returned by ``transport``. Raises: ValueError: If the current download has finished. cs"jd}||S)Nr;rFrGrMr2rPrYr+r=rQrLr7r8rRs z=ChunkedDownload.consume_next_chunk..retriable_requestrSrrTrUrVr+rQr=rRr7rir8consume_next_chunks z"ChunkedDownload.consume_next_chunkNr\r]r^r_rr`rarlr7r7r7r8res rec@s$eZdZdZejejffddZdS)RawChunkedDownloadaDownload a raw resource in chunks from a Google API. Args: media_url (str): The URL containing the media to be downloaded. chunk_size (int): The number of bytes to be retrieved in each request. stream (IO[bytes]): A write-able stream (i.e. file-like object) that will be used to concatenate chunks of the resource as they are downloaded. start (int): The first byte in a range to be downloaded. If not provided, defaults to ``0``. end (int): The last byte in a range to be downloaded. If not provided, will download to the end of the media. headers (Optional[Mapping[str, str]]): Extra headers that should be sent with each request, e.g. headers for data encryption key headers. Attributes: media_url (str): The URL containing the media to be downloaded. start (Optional[int]): The first byte in a range to be downloaded. end (Optional[int]): The last byte in a range to be downloaded. chunk_size (int): The number of bytes to be retrieved in each request. Raises: ValueError: If ``start`` is negative. cs:\fdd}t|jjS)rfcs$jdd}||S)NT)r<r2r>r=rgrhrir7r8rR^s z@RawChunkedDownload.consume_next_chunk..retriable_requestrjrkr7rir8rl@s z%RawChunkedDownload.consume_next_chunkNrmr7r7r7r8rn$s rncCsR|jdd}|dkr,t||_tS|dkrJtrJt||_tS|SdS)aPatch the ``_decoder`` on a ``urllib3`` response. This is so that we can intercept the compressed bytes before they are decoded. Only patches if the content encoding is ``gzip`` or ``br``. Args: response_raw (urllib3.response.HTTPResponse): The raw response for an HTTP request. checksum (object): A checksum which will be updated with compressed bytes. Returns: object: Either the original ``checksum`` if ``_decoder`` is not patched, or a ``_DoNothingHash`` if the decoder is patched, since the caller will no longer need to hash to decoded bytes. zcontent-encodingr brN)r2r#lower _GzipDecoder_decoderrZ_DoNothingHash_BrotliDecoder)Z response_rawrencodingr7r7r8rps   rcs,eZdZdZfddZfddZZS)rraDCustom subclass of ``urllib3`` decoder for ``gzip``-ed bytes. Allows a checksum function to see the compressed bytes before they are decoded. This way the checksum of the compressed value can be computed. Args: checksum (object): A checksum which will be updated with compressed bytes. cst||_dSN)super__init__ _checksumr+r __class__r7r8rxs z_GzipDecoder.__init__cs|j|t|S)zDecompress the bytes. Args: data (bytes): The compressed bytes to be decompressed. Returns: bytes: The decompressed bytes from ``data``. )ryrrw decompressr+r<r{r7r8r}s z_GzipDecoder.decompress)r\r]r^r_rxr} __classcell__r7r7r{r8rrs rr BrotliDecoderc@s(eZdZdZddZddZddZdS) rta*Handler for ``brotli`` encoded bytes. Allows a checksum function to see the compressed bytes before they are decoded. This way the checksum of the compressed value can be computed. Because BrotliDecoder's decompress method is dynamically created in urllib3, a subclass is not practical. Instead, this class creates a captive urllib3.requests.BrotliDecoder instance and acts as a proxy. Args: checksum (object): A checksum which will be updated with compressed bytes. cCstj|_||_dSrv)urllib3r,rrsryrzr7r7r8rxs z_BrotliDecoder.__init__cCs|j||j|S)zDecompress the bytes. Args: data (bytes): The compressed bytes to be decompressed. Returns: bytes: The decompressed bytes from ``data``. )ryrrsr}r~r7r7r8r}s z_BrotliDecoder.decompresscCs |jSrv)rsflush)r+r7r7r8rsz_BrotliDecoder.flushN)r\r]r^r_rxr}rr7r7r7r8rts rt)r_Zurllib3.responserrZgoogle.resumable_mediarrrZgoogle.resumable_media.requestsrr(rJr$Z RequestsMixinrZRawRequestsMixinrbrernrr, GzipDecoderrrhasattrrtr7r7r7r8s(     UNKL #