Файловый менеджер - Редактировать - /home/digitalm/venv/lib/python3.7/site-packages/pandas/io/__pycache__/common.cpython-37.pyc
Назад
B �5�g�z � @ s� d Z ddlmZ ddlZddlZddlmZ ddlZddlZddl m Z m Z m Z m Z mZ ddlZddlZddlZddlmZmZmZmZmZ ddlmZmZm Z m Z m Z ddl Z ddl Z ddl!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z' dd l(m)Z)m*Z* dd l+m,Z, dd l-m.Z. e*� Z/e0e e e �Z1e1�2d � ej3G d d� d��Z4ej3G dd� d��Z5dd�dd�Z6ddd�dd�Z7dd�dd�Z8dQd ddd �d d �Z9d!d"� Z:d#dd$�d%d&�Z;dRd#d)d*d)d+dd,�d-d.�Z<d)d)d/�d0d1�Z=d2d3d4d5d6�Z>d*d7d8�d9d:�Z?d#d;d;d<�d=d>�Z@dSd#d)d;d*ddd;d+dd@� dAdB�ZAG dCdD� dDe jBe �ZCG dEdF� dFejD�ZEdGdd)d)d;ddHdI�dJdK�ZFd#dd�dLdM�ZGd#d)ddN�dOdP�ZHdS )TzCommon IO api utilities� )� annotationsN)�abc)�BufferedIOBase�BytesIO� RawIOBase�StringIO� TextIOWrapper)�IO�Any�AnyStr�Mapping�cast)�urljoin�urlparse� uses_netloc� uses_params� uses_relative)�Buffer�CompressionDict�CompressionOptions� FileOrBuffer�FilePathOrBuffer�StorageOptions)� get_lzma_file� import_lzma)�import_optional_dependency)� is_file_like� c @ s> e Zd ZU dZded< ded< ded< ded< d Zd ed < d S ) �IOArgsa) Return value of io/common.py:_get_filepath_or_buffer. Note (copy&past from io/parsers): filepath_or_buffer can be Union[FilePathOrBuffer, s3fs.S3File, gcsfs.GCSFile] though mypy handling of conditional imports is difficult. See https://github.com/python/mypy/issues/1297 r �filepath_or_buffer�str�encoding�moder � compressionF�bool� should_closeN)�__name__� __module__� __qualname__�__doc__�__annotations__r% � r+ r+ �F/home/digitalm-up/venv/lib/python3.7/site-packages/pandas/io/common.pyr ; s r c @ sz e Zd ZU dZded< ded< ejed�Zded< d Z d ed < d Z d ed < d d�dd�Z d d�dd�Z dd d�dd�Z dS )� IOHandlesau Return value of io/common.py:get_handle Can be used as a context manager. This is used to easily close created buffers and to handle corner cases when TextIOWrapper is inserted. handle: The file handle to be used. created_handles: All file handles that are created by get_handle is_wrapped: Whether a TextIOWrapper needs to be detached. r �handler r# )�default_factoryz list[Buffer]�created_handlesFr$ � is_wrapped�is_mmap�None)�returnc C s~ | j r8t| jt�st�| j�� | j�� | j�| j� y x| jD ] }|� � qBW W n t t fk rl Y nX g | _d| _ dS )z� Close all created buffers. Note: If a TextIOWrapper was inserted, it is flushed and detached to avoid closing the potentially user-created buffer. FN) r1 � isinstancer. r �AssertionError�flush�detachr0 �remove�close�OSError� ValueError)�selfr. r+ r+ r, r: b s zIOHandles.closec C s | S )Nr+ )r= r+ r+ r, � __enter__v s zIOHandles.__enter__r )�argsr4 c G s | � � d S )N)r: )r= r? r+ r+ r, �__exit__y s zIOHandles.__exit__N)r& r' r( r) r* � dataclasses�field�listr0 r1 r2 r: r> r@ r+ r+ r+ r, r- M s r- r$ )r4 c C s t | t�sdS t| �jtkS )z� Check to see if a URL has a valid protocol. Parameters ---------- url : str or unicode Returns ------- isurl : bool If `url` has a valid protocol return True otherwise False. F)r5 r � parse_url�scheme� _VALID_URLS)�urlr+ r+ r, �is_url} s rH zFileOrBuffer[AnyStr])r r4 c C s t | t�rtj�| �S | S )a] Return the argument with an initial component of ~ or ~user replaced by that user's home directory. Parameters ---------- filepath_or_buffer : object to be converted if possible Returns ------- expanded_filepath_or_buffer : an expanded filepath or the input if not expandable )r5 r �os�path� expanduser)r r+ r+ r, � _expand_user� s rL r3 c C s t | t�rtd��d S )Nz�Passing a bool to header is invalid. Use header=None for no header or header=int or list-like of ints to specify the row(s) making up the column names)r5 r$ � TypeError)�headerr+ r+ r, �validate_header_arg� s rO FzFilePathOrBuffer[AnyStr])r �convert_file_liker4 c C s6 |st | �rttt | �S t| tj�r.| �� } t| �S )a� Attempt to convert a path-like object to a string. Parameters ---------- filepath_or_buffer : object to be converted Returns ------- str_filepath_or_buffer : maybe a string version of the object Notes ----- Objects supporting the fspath protocol (python 3.6+) are coerced according to its __fspath__ method. Any other object is passed through unchanged, which includes bytes, strings, buffers, or anything else that's not even path-like. ) r r r r r5 rI �PathLike� __fspath__rL )r rP r+ r+ r, �stringify_path� s rS c O s ddl }|jj| |�S )z` Lazy-import wrapper for stdlib urlopen, as that imports a big chunk of the stdlib. r N)�urllib.request�request�urlopen)r? �kwargs�urllibr+ r+ r, rV � s rV r )rG r4 c C s t | t�o d| ko | �d� S )zR Returns true if the given URL looks like something fsspec can handle z://)zhttp://zhttps://)r5 r � startswith)rG r+ r+ r, � is_fsspec_url� s rZ �utf-8�rr r r )r r! r# r" �storage_optionsr4 c C s� t | �} t|�\}}t| |�}|rHt| d�rHd|krHtjdtdd� d}t||d�}|dk rl|�dd �� � }d |kr�|d kr�|d kr�t�|� d |� �t � |}d|kr�d|kr�|d7 }t | t ��r>t | ��r>|p�i }ddl}|jj| |d�}t|��2} | j�dd�} | dk�rddi}t| �� �} W dQ R X t| ||d|d�S t| ��rht | t ��sXt�| �d��rp| �dd�} | �d��r�| �dd�} td�} g } y&td� ddlm }m } ||t g} W n t k �r� Y nX y$| j | fd |i|�p�i ��� � }W n^ t!| �k �rT |dk�r d di}nt|�}d|d < | j | fd |i|�pFi ��� � }Y nX t|||d|d�S |�rvt"d ��t | t t#t$j$f��r�tt%| �||d |d�S t&| ��s�d t'| �� �}t"|��t| ||d |d�S )!a� If the filepath_or_buffer is a url, translate and return the buffer. Otherwise passthrough. Parameters ---------- filepath_or_buffer : a url, filepath (str, py.path.local or pathlib.Path), or buffer compression : {{'gzip', 'bz2', 'zip', 'xz', None}}, optional encoding : the encoding to use to decode bytes, default is 'utf-8' mode : str, optional storage_options : dict, optional Extra options that make sense for a particular storage connection, e.g. host, port, username, password, etc., if using a URL that will be parsed by ``fsspec``, e.g., starting "s3://", "gcs://". An error will be raised if providing this argument with a local path or a file-like buffer. See the fsspec and backend storage implementation docs for the set of allowed keys and values .. versionadded:: 1.2.0 ..versionchange:: 1.2.0 Returns the dataclass IOArgs. �write�bzDcompression has no effect when passing a non-binary object as input.� )� stacklevelN)�method�_�-�w)�bz2�xz)zutf-16zutf-32z( will not write the byte order mark for �tr )�headerszContent-Encoding�gziprb T)r r! r# r% r" zs3a://zs3://zs3n://�fsspecZbotocore)� ClientError�NoCredentialsErrorr" Zanonz?storage_options passed with file object or non-fsspec file pathFz)Invalid file path or buffer object type: )(rS �get_compression_method�infer_compression�hasattr�warnings�warn�RuntimeWarning�dict�replace�lower�UnicodeWarningr5 r rH rT rU �RequestrV ri �getr �readr rZ r6 rY r Zbotocore.exceptionsrl rm �PermissionError� ImportError�open�tupler< �bytes�mmaprL r �type)r r! r# r" r] �compression_methodZ fsspec_moderX �req_info�req�content_encoding�readerrk Z err_types_to_retry_with_anonrl rm Zfile_obj�msgr+ r+ r, �_get_filepath_or_buffer� s� ! " r� )rJ r4 c C s ddl m} td|| ��S )z� converts an absolute native path to a FILE URL. Parameters ---------- path : a path in native format Returns ------- a valid FILE URL r )� pathname2urlzfile:)rT r� r )rJ r� r+ r+ r, �file_path_to_url� s r� z.gzz.bz2z.zipz.xz)rj rf �ziprg z"tuple[str | None, CompressionDict])r# r4 c C s` t | t�rPt| �}y|�d�}W qX tk rL } ztd�|�W dd}~X Y qXX ni }| }||fS )a Simplifies a compression argument to a compression method string and a mapping containing additional arguments. Parameters ---------- compression : str or mapping If string, specifies the compression method. If mapping, value at key 'method' specifies compression method. Returns ------- tuple of ({compression method}, Optional[str] {compression arguments}, Dict[str, Any]) Raises ------ ValueError on mapping missing 'method' key rb z.If mapping, compression must have key 'method'N)r5 r rt �pop�KeyErrorr< )r# �compression_argsr� �errr+ r+ r, rn � s rn z str | None)r r# r4 c C s� |dkr dS |dkrZt | dd�} t| t�s.dS x&t�� D ]\}}| �� �|�r8|S q8W dS |tkrf|S ddgtt� }d|� d|� �}t|��dS )a� Get the compression method for filepath_or_buffer. If compression='infer', the inferred compression method is returned. Otherwise, the input compression method is returned unchanged, unless it's invalid, in which case an error is raised. Parameters ---------- filepath_or_buffer : str or file handle File path or object. compression : {'infer', 'gzip', 'bz2', 'zip', 'xz', None} If 'infer' and `filepath_or_buffer` is path-like, then detect compression from the following extensions: '.gz', '.bz2', '.zip', or '.xz' (otherwise no compression). Returns ------- string or None Raises ------ ValueError on invalid compression specified. NZinferT)rP z Unrecognized compression type: z Valid compression types are ) rS r5 r �_compression_to_extension�itemsrv �endswith�sortedr< )r r# � extension�validr� r+ r+ r, ro � s ro T) � path_or_bufr" r! r# � memory_map�is_text�errorsr] r4 c C s� |pd}t | |�r"d|kr"|d7 }t|t�r4|�� }|dkrTtd|� d�d d ��t| ||||d�}|j} t| ||j|j ||j d t k�\} }} t| t�} t |j �} | � d �}|�r|j �d d �|_ |d k�r| r�t| t�s�t�tjf | |j d �| ��} ntjf | |j d�| ��} n�|dk�r:tj| fd|j i| ��} n�|dk�r�t| |j f| �} | j dk�r�| �| � | �� } t| �dk�r�| �| � � �} n,t| �dk�r�td| � ���ntd| � ���n.|dk�r�tt�| |j �} nd|� �}t|��t| t��r�t�| �| � nNt| t��rV|j�r@d|j k�r@t| |j |j|d d�} n t| |j �} | �| � d}|�r�|�stt | |j ��r�t| |j|d d�} | �| � t|jt��p�|j }| � � |j �r�t|jt��r�t�| �|j� t| t��r�t�t | | |||j d�S ) a� Get file handle for given path/buffer and mode. Parameters ---------- path_or_buf : str or file handle File path or object. mode : str Mode to open path_or_buf with. encoding : str or None Encoding to use. compression : str or dict, default None If string, specifies compression mode. If dict, value at key 'method' specifies compression mode. Compression mode must be one of {'infer', 'gzip', 'bz2', 'zip', 'xz', None}. If compression mode is 'infer' and `filepath_or_buffer` is path-like, then detect compression from the following extensions: '.gz', '.bz2', '.zip', or '.xz' (otherwise no compression). If dict and compression mode is one of {'zip', 'gzip', 'bz2'}, or inferred as one of the above, other entries passed as additional compression options. .. versionchanged:: 1.0.0 May now be a dict with key 'method' as compression mode and other keys as compression options if compression mode is 'zip'. .. versionchanged:: 1.1.0 Passing compression options as keys in dict is now supported for compression modes 'gzip' and 'bz2' as well as 'zip'. memory_map : bool, default False See parsers._parser_params for more information. is_text : bool, default True Whether the type of the content passed to the file/buffer is string or bytes. This is not the same as `"b" not in mode`. If a string content is passed to a binary file/buffer, a wrapper is inserted. errors : str, default 'strict' Specifies how encoding and decoding errors are to be handled. See the errors argument for :func:`open` for a full list of options. storage_options: StorageOptions = None Passed to _get_filepath_or_buffer .. versionchanged:: 1.2.0 Returns the dataclass IOHandles zutf-8r_ ) N�strict�ignoreru �xmlcharrefreplace�backslashreplace� namereplace�surrogateescape� surrogatepassz%Invalid value for `encoding_errors` (z). Please see z=https://docs.python.org/3/library/codecs.html#error-handlers zfor valid values.)r! r# r" r] rb rh r rj )�filenamer" )�fileobjr" rf r" r� r\ � r z Zero files found in ZIP file z9Multiple files found in ZIP file. Only one file per ZIP: rg z Unrecognized compression type: )r! r� �newlineF)r. r0 r1 r2 r# ) �_is_binary_moder5 r rv r< r� r �_maybe_memory_mapr! r" r# r� rt r� ru r6 rj �GzipFilerf �BZ2File� _BytesZipFile�append�namelist�lenr} r �lzmar r% �reverser- )r� r" r! r# r� r� r� r] Zioargsr. �handlesZis_pathr� Z zip_namesr� r1 r+ r+ r, � get_handle s� < r� c s^ e Zd ZdZddddd�� fdd� Zd d � Zd d �� fd d� Z� fdd�Zedd� �Z � Z S )r� a Wrapper for standard library class ZipFile and allow the returned file-like handle to accept byte strings via `write` method. BytesIO provides attributes of file-like object and ZipFile.writestr writes bytes strings into a member of the archive. Nr r z str | None)�filer" � archive_namec sB |� dd�}|| _d | _dtji}|�|� t� j||f|� d S )Nr_ r r# )ru r� �multiple_write_buffer�zipfile� ZIP_DEFLATED�update�super�__init__)r= r� r" r� rW Z kwargs_zip)� __class__r+ r, r� s z_BytesZipFile.__init__c C s2 | j d kr"t|t�rt� nt� | _ | j �|� d S )N)r� r5 r r r r^ )r= �datar+ r+ r, r^ s z_BytesZipFile.writer3 )r4 c sP | j d ks| j jrd S | jp$| jp$d}| j � t� �|| j �� � W d Q R X d S )Nr� )r� �closedr� r� r� �writestr�getvalue)r= r� )r� r+ r, r7 s z_BytesZipFile.flushc s | � � t� �� d S )N)r7 r� r: )r= )r� r+ r, r: ' s z_BytesZipFile.closec C s | j d kS )N)�fp)r= r+ r+ r, r� + s z_BytesZipFile.closed)N) r& r' r( r) r� r^ r7 r: �propertyr� � __classcell__r+ r+ )r� r, r� � s r� c @ sb e Zd ZdZdddddd�d d �Zdd �d d �Zd d�dd�Zdddd�dd�Zdd�dd�ZdS ) � _MMapWrappera Wrapper for the Python's mmap class so that it can be properly read in by Python's csv.reader class. Parameters ---------- f : file object File object to be mapped onto memory. Must support the 'fileno' method or have an equivalent attribute �utf-8r� Tr r r$ )�fr! r� �decodec C sr || _ || _t�|�|d�| _|| _i | _x*dD ]"}t||�s@q0t||�� | j|< q0W t j |� � dt j d�| _ d S )N)r� )�seekable�readableZ writeabler )�access) r! r� �codecs�getincrementaldecoder�decoderr� � attributesrp �getattrr� �fileno� ACCESS_READ)r= r� r! r� r� � attributer+ r+ r, r� = s z_MMapWrapper.__init__)�namec s$ � �j kr� �fdd�S t�j� �S )Nc s �j � S )N)r� r+ )r� r= r+ r, �<lambda>R � z*_MMapWrapper.__getattr__.<locals>.<lambda>)r� r� r� )r= r� r+ )r� r= r, � __getattr__P s z_MMapWrapper.__getattr__)r4 c C s | S )Nr+ )r= r+ r+ r, �__iter__U s z_MMapWrapper.__iter__����intz str | bytes)�sizer4 c C s: | j �|�}| jr6|dkp$t|�|k }| jj||d�S |S )Nr� )�final)r� rz r� r� r� )r= r� �contentr� r+ r+ r, rz X s z_MMapWrapper.readc C s, | j �� }| j�|�}|dkr"t�|�d�S )Nr � )r� �readliner� r� � StopIteration�lstrip)r= Znewbytesr� r+ r+ r, �__next__b s z_MMapWrapper.__next__N)r� r� T)r� ) r& r' r( r) r� r� r� rz r� r+ r+ r+ r, r� 0 s r� r z'tuple[FileOrBuffer, bool, list[Buffer]])r. r� r! r" r� r� r4 c C s� g }|t | d�pt| t�M }|s*| ||fS t| t�rh|rTd|krTt| |||dd�} n t| |�} |�| � y:ttjt| |||��}| �� |� | � |�|� |} W n t k r� d}Y nX | ||fS )z Try to memory map file/buffer.r� r_ r )r! r� r� F) rp r5 r r} r� r r� r� r: r9 � Exception)r. r� r! r" r� r� r� �wrappedr+ r+ r, r� s s( r� c C sH d}t | �} t| t�s|S ytj�| �}W n ttfk rB Y nX |S )zTest whether file exists.F)rS r5 r rI rJ �existsrM r< )r r� r+ r+ r, � file_exists� s r� )r. r" r4 c C s` d|ksd|krd|kS t jt jt jtjf}tt| �|�r>dS tt f}t | |�p^dt | d|�kS )z+Whether the handle is opened in binary moderh r_ Fr" ) r� � StreamWriter� StreamReader�StreamReaderWriter�tempfile�SpooledTemporaryFile� issubclassr� r r r5 r� )r. r" Z text_classesZbinary_classesr+ r+ r, r� � s r� )F)r[ Nr\ N)NNFTNN)Ir) � __future__r rf r� � collectionsr rA rj �ior r r r r r� rI r� �typingr r r r r � urllib.parser r rD r r r rq r� Zpandas._typingr r r r r r Z pandas.compatr r Zpandas.compat._optionalr Zpandas.core.dtypes.commonr r� �setrF �discard� dataclassr r- rH rL rO rS rV rZ r� r� r� rn ro r� �ZipFiler� �Iteratorr� r� r� r� r+ r+ r+ r, �<module> sd 0 0#> f9C-
| ver. 1.4 |
Github
|
.
| PHP 8.3.23 | Генерация страницы: 0.05 |
proxy
|
phpinfo
|
Настройка