Файловый менеджер - Редактировать - /home/digitalm/venv/lib/python3.7/site-packages/pandas/core/computation/__pycache__/expr.cpython-37.pyc
Назад
B �5�g�_ � @ s� d Z ddlmZ ddlZddlmZmZ ddlmZ ddl Z ddl m Z m Z ddl ZddlmZ ddlm mZ ddlmZmZmZmZmZmZm Z m Z m Z m Z m Z m!Z!m"Z"m#Z#m$Z$m%Z% dd l&m'Z'm(Z( dd l)m*Z* ddl+m, m- m.Z. d d d �d d�Z/d d d �dd�Z0d d d �dd�Z1dd� Z2dd� Z3e3e1e0e/e'�fddd�dd�Z4dd � Z5e5e6�Z7e5e8�Z9e:d d � d d � e;e�D �D ��Z<e<fd d!�Z=e:e>d"d#� e<��Z?e=ej@�ZAe=ejB�ZCe=ejD�ZEe=ejF�ZGe=ejH�ZIe=ejJ�ZKe=ejL�ZMe=ejN�ZOe=ejP�ZQe=ejR�ZSe=ejT�ZUe=ej�ZVe=ejW�ZXe�s4e=ejY�ZZe:d$d%d&g�Z[e:d'd(d)d*d+d,d-d.d/d0d1g �Z\eCeAB eSB eUB eVB eXB eGB e\B e[ Z]e?e] e[B Z^e]e^@ Z_d2e_� �Z`e_�r�tae`��dd3d4�d5d6�Zbe d7d8d9�Zcd:d;d<�d=d>�Zdd?d@� Zee e#dA�ZfdBdC� Zgede]�egef�G dDd8� d8ejh���Zie:dEdFdGdHg�Zje:ee �Zkede]ejB eIe:dFdIdGdHdJg�B �G dKdL� dLei��Zlede]ejB e:dMg�B �G dNdO� dOei��ZmG dPd&� d&�ZnemeldQ�ZodS )Rz :func:`~pandas.eval` parsers. � )� annotationsN)�partial�reduce)� iskeyword)�Callable�TypeVar)�PY39)�ARITH_OPS_SYMS� BOOL_OPS_SYMS� CMP_OPS_SYMS� LOCAL_TAG�MATHOPS� REDUCTIONS�UNARY_OPS_SYMS�BinOp�Constant�Div�FuncNode�Op�Term�UnaryOp�UndefinedVariableError�is_term)�clean_backtick_quoted_toks�tokenize_string)�Scopeztuple[int, str])�tok�returnc C s | \}}||dkrdn|fS )a` Rewrite the assignment operator for PyTables expressions that use ``=`` as a substitute for ``==``. Parameters ---------- tok : tuple of int, str ints correspond to the all caps constants in the tokenize module Returns ------- tuple of int, str Either the input or token or the replacement values �=z==� )r �toknum�tokvalr r �R/home/digitalm-up/venv/lib/python3.7/site-packages/pandas/core/computation/expr.py�_rewrite_assign2 s r# c C sF | \}}|t jkr>|dkr$t jdfS |dkr6t jdfS ||fS ||fS )aj Replace ``&`` with ``and`` and ``|`` with ``or`` so that bitwise precedence is changed to boolean precedence. Parameters ---------- tok : tuple of int, str ints correspond to the all caps constants in the tokenize module Returns ------- tuple of int, str Either the input or token or the replacement values �&�and�|�or)�tokenize�OP�NAME)r r r! r r r" �_replace_booleansE s r+ c C s, | \}}|t jkr$|dkr$t jtfS ||fS )a( Replace local variables with a syntactically valid name. Parameters ---------- tok : tuple of int, str ints correspond to the all caps constants in the tokenize module Returns ------- tuple of int, str Either the input or token or the replacement values Notes ----- This is somewhat of a hack in that we rewrite a string such as ``'@a'`` as ``'__pd_eval_local_a'`` by telling the tokenizer that ``__pd_eval_local_`` is a ``tokenize.OP`` and to replace the ``'@'`` symbol with it. �@)r( r) r )r r r! r r r" �_replace_locals^ s r- c s � �fdd�S )z Compose 2 callables. c s � �| |��S )Nr )�args�kwargs)�f�gr r" �<lambda>| � z_compose2.<locals>.<lambda>r )r0 r1 r )r0 r1 r" � _compose2x s r4 c G s t | �dkstd��tt| �S )z& Compose 2 or more callables. � z.At least 2 callables must be passed to compose)�len�AssertionErrorr r4 )�funcsr r r" �_compose s r9 �str)�sourcer c s, t � �std��t�� fdd�t| �D ��S )a� Compose a collection of tokenization functions. Parameters ---------- source : str A Python source code string f : callable This takes a tuple of (toknum, tokval) as its argument and returns a tuple with the same structure but possibly different elements. Defaults to the composition of ``_rewrite_assign``, ``_replace_booleans``, and ``_replace_locals``. Returns ------- str Valid Python source code Notes ----- The `f` parameter can be any callable that takes *and* returns input of the form ``(toknum, tokval)``, where ``toknum`` is one of the constants from the ``tokenize`` module and ``tokval`` is a string. zf must be callablec 3 s | ]}� |�V qd S )Nr )�.0�x)r0 r r" � <genexpr>� s z _preparse.<locals>.<genexpr>)�callabler7 r( � untokenizer )r; r0 r )r0 r" � _preparse� s rA c s � fdd�S )zO Factory for a type checking function of type ``t`` or tuple of types. c s t | j� �S )N)� isinstance�value)r= )�tr r" r2 � r3 z_is_type.<locals>.<lambda>r )rD r )rD r" �_is_type� s rE c c s( | ] }t |t�rt|tj�r|V qd S )N)rB �type� issubclass�ast�AST)r< �noder r r" r> � s r> c c s | ]}t t|�V qd S )N)�getattrrH )r< �namer r r" r> � s c s � fdd�|D �}t |�S )zE Filter out AST nodes that are subclasses of ``superclass``. c 3 s | ]}t |� �r|jV qd S )N)rG �__name__)r< rJ )� superclassr r" r> � s z _filter_nodes.<locals>.<genexpr>)� frozenset)rN Z all_nodesZ node_namesr )rN r" � _filter_nodes� s rP c C s | j S )N)rM )r= r r r" r2 � r3 r2 �Assign�Module�Expr�Yield� GeneratorExp�IfExp�DictComp�SetComp�Repr�Lambda�SetrI �Is�IsNotz$cannot both support and not support zCallable[(Ellipsis, None)])� node_namer c s � fdd�}|S )zV Return a function that raises a NotImplementedError with a passed node name. c s t d� � d���d S )N�'z' nodes are not implemented)�NotImplementedError)�selfr. r/ )r^ r r" r0 s z _node_not_implemented.<locals>.fr )r^ r0 r )r^ r" �_node_not_implemented s rb �_T�BaseExprVisitor)�boundzset[str]z Callable[[type[_T]], type[_T]])�nodesr c s ddd�� fdd� }|S )z� Decorator to disallow certain nodes from parsing. Raises a NotImplementedError instead. Returns ------- callable ztype[_T])�clsr c sF d| _ x:� D ]2}t|�}d|� �}| j |f7 _ t| ||� q W | S )Nr �visit_)�unsupported_nodesrb �setattr)rg rJ Z new_methodrL )rf r r" � disallowed s z disallow.<locals>.disallowedr )rf rk r )rf r" �disallow s rl c s � �fdd�}|S )zw Return a function to create an op class with its symbol already passed. Returns ------- callable c s t � �f|�|�S )z� Return a partial function with an Op subclass with an operator already passed. Returns ------- callable )r )ra rJ r. r/ )�op_class� op_symbolr r" r0 . s z_op_maker.<locals>.fr )rm rn r0 r )rm rn r" � _op_maker% s ro )�binaryZunaryc s � fdd�}|S )z9 Decorator to add default implementation of ops. c st xn� � � D ]b\}}t| |� d��}t| |� d��}x8|D ]0}|| }|d k r8t||�}t| d|� �|� q8W q W | S )NZ_opsZ _op_nodes_maprh )�itemsrK ro rj )rg Z op_attr_namerm �opsZops_map�opZop_nodeZmade_op)� op_classesr r" r0 C s zadd_ops.<locals>.fr )rt r0 r )rt r" �add_ops> s ru c @ sv e Zd ZU dZeZded< eZe e e Z dZ eee e ��ZeZdZdd� eee�D �ZejejejejejejejejiZded < efd d �Z d d � Z dd� Z dd� Z dd� Z dEdd�Z!dd� Z"dd� Z#dFd d �Z$d d � Z%d!d"� Z&d#d$� Z'd%d&� Z(d'd(� Z)d)d*� Z*d+d,� Z+d-d.� Z,d/d0� Z-e-Z.d1d2� Z/d3d4� Z0d5d6� Z1d7d8� Z2d9d:� Z3dGd;d<�Z4d=d>� Z5d?d@� Z6dAdB� Z7dCdD� Z8dS )Hrd z� Custom ast walker. Parsers of other engines should subclass this class if necessary. Parameters ---------- env : Scope engine : str parser : str preparser : callable z type[Term]� const_type)�Gt�Lt�GtE�LtE�Eq�NotEq�In�NotIn�BitAnd�BitOr�And�Or�Add�Sub�MultN�Pow�FloorDiv�Mod)�UAdd�USub�Invert�Notc C s i | ]\}}||�qS r r )r< �k�vr r r" � <dictcomp>} s zBaseExprVisitor.<dictcomp>ztuple[str, ...]ri c C s" || _ || _|| _|| _d | _d S )N)�env�engine�parser� preparser�assigner)ra r� r� r� r� r r r" �__init__� s zBaseExprVisitor.__init__c K s� t |t�rl| �|�}yt�t�|��}W nB tk rj } z$tdd� |�� D ��rVd|_ |�W d d }~X Y nX dt |�j }t | |�}||f|�S )Nc s s | ]}t |�V qd S )N)r )r< r= r r r" r> � s z(BaseExprVisitor.visit.<locals>.<genexpr>z4Python keyword not valid identifier in numexpr queryrh ) rB r: r� rH �fix_missing_locations�parse� SyntaxError�any�split�msgrF rM rK )ra rJ r/ �clean�e�method�visitorr r r" �visit� s zBaseExprVisitor.visitc K s. t |j�dkrtd��|jd }| j|f|�S )Nr5 z#only a single expression is allowedr )r6 �bodyr� r� )ra rJ r/ �exprr r r" � visit_Module� s z BaseExprVisitor.visit_Modulec K s | j |jf|�S )N)r� rC )ra rJ r/ r r r" � visit_Expr� s zBaseExprVisitor.visit_Exprc C s� |j }t|�}t|�r�t|�r�|| jkr�tt||f�\}}tt||f�\}} |s\|s\|s\| rh| j| � }| r�| j�|j g�} | � | | j�}|r�| j�|j g�} | � | | j�}| � |�} | |||fS )N) rs rF r � rewrite_map�map�_is_list�_is_strr� �add_tmprC � term_typer� ) ra rJ �left�rightZ op_instanceZop_typeZ left_listZ right_listZleft_strZ right_strrL rs r r r" �_rewrite_membership_op� s z&BaseExprVisitor._rewrite_membership_opNc C sR |d kr| j |jdd�}|d kr0| j |jdd�}| �|||�\}}}}||||fS )Nr� )�sider� )r� r� r� r� )ra rJ r� r� rs rm r r r" �_maybe_transform_eq_ne� s z&BaseExprVisitor._maybe_transform_eq_nec C s� t �t j�}|jrNt|d�rN|jsN|j|krN| j�t �|j��}| � || j�}|jr�t|d�r�|js�|j|kr�| j�t �|j��}| � || j�}||fS )NrC ) �npZdtypeZfloat32Z is_scalar�hasattr� return_typer� r� rC r� )ra r� r� Zf32rL r r r" �_maybe_downcast_constants� s z)BaseExprVisitor._maybe_downcast_constantsc C s |� | j| j| j| j|�S )N)�evaluater� r� r� r� )ra �binop�eval_in_pythonr r r" � _maybe_eval� s zBaseExprVisitor._maybe_eval��inznot in�z==z!=�<�>z<=z>=c C s� |||�}|j r2td|j� d|j� d|j� d���| jdkrl|jtkrRt|dd�s^t|dd�rl| �|| j�S |j|kr�| �||�S | jdkr�t|dd �t ks�t|dd �t kr�| �||| �S |S ) Nz unsupported operand type(s) for z: 'z' and 'r_ ZpytablesZ is_datetimeFr� ) Zhas_invalid_return_type� TypeErrorrs rF r� r rK r� � binary_ops�object)ra rs rm �lhs�rhsr� Zmaybe_eval_in_python�resr r r" �_maybe_evaluate_binop� s z%BaseExprVisitor._maybe_evaluate_binopc K s2 | � |�\}}}}| �||�\}}| �||||�S )N)r� r� r� )ra rJ r/ rs rm r� r� r r r" � visit_BinOp s zBaseExprVisitor.visit_BinOpc K s dd� S )Nc S s t | |�S )N)r )r� r� r r r" r2 r3 z+BaseExprVisitor.visit_Div.<locals>.<lambda>r )ra rJ r/ r r r" � visit_Div s zBaseExprVisitor.visit_Divc K s | � |j�}| � |j�}||�S )N)r� rs �operand)ra rJ r/ rs r� r r r" � visit_UnaryOp s z BaseExprVisitor.visit_UnaryOpc K s | j |j| jf|�S )N)r� �idr� )ra rJ r/ r r r" � visit_Name s zBaseExprVisitor.visit_Namec K s | � |j| j�S )N)rv rC r� )ra rJ r/ r r r" �visit_NameConstant# s z"BaseExprVisitor.visit_NameConstantc K s | � |j| j�S )N)rv �nr� )ra rJ r/ r r r" � visit_Num& s zBaseExprVisitor.visit_Numc K s | � |j| j�S )N)rv r� r� )ra rJ r/ r r r" �visit_Constant) s z BaseExprVisitor.visit_Constantc K s | j �|j�}| �|| j �S )N)r� r� �sr� )ra rJ r/ rL r r r" � visit_Str, s zBaseExprVisitor.visit_Strc s* � j �� fdd�|jD ��}� �|� j �S )Nc s g | ]}� � |�� j��qS r )r� r� )r< r� )ra r r" � <listcomp>1 s z.BaseExprVisitor.visit_List.<locals>.<listcomp>)r� r� �eltsr� )ra rJ r/ rL r )ra r" � visit_List0 s zBaseExprVisitor.visit_Listc K s | � |j�S )z df.index[4])r� rC )ra rJ r/ r r r" � visit_Index6 s zBaseExprVisitor.visit_Indexc K s� ddl m} | �|j�}| �|j�}||| j| j| jd�}y|j| }W n2 tk rz ||| j| j| jd�}|| }Y nX | j� |�} | j | | jd�S )Nr )�eval)Z local_dictr� r� )r� ) �pandasr� r� rC �slicer� r� r� �AttributeErrorr� r� ) ra rJ r/ Zpd_evalrC Zslobj�resultr� r� rL r r r" �visit_Subscript: s z BaseExprVisitor.visit_Subscriptc K sZ |j }|dk r| �|�j}|j}|dk r4| �|�j}|j}|dk rN| �|�j}t|||�S )zdf.index[slice(4,6)]N)�lowerr� rC �upper�stepr� )ra rJ r/ r� r� r� r r r" � visit_SliceN s zBaseExprVisitor.visit_Slicec K s� t |j�dkrtd��t|jd tj�s0td��| jjdkrDtd��y| j |jd f|�}W n t k r| |jd j }Y nX t |d|�| _ | j dkr�td��| j |jf|�S ) z� support a single assignment node, like c = a + b set the assigner at the top level, must be a Name node which might or might not exist in the resolvers r5 z#can only assign a single expressionr z5left hand side of an assignment must be a single nameNz%cannot assign without a target objectrL z@left hand side of an assignment must be a single resolvable name)r6 �targetsr� rB rH �Namer� �target� ValueErrorr� r r� rK r� rC )ra rJ r/ r� r r r" � visit_Assign\ s z BaseExprVisitor.visit_Assignc K s� |j }|j}|j}t|tj�r�| �|�j}y$t||�}| j� |�}| � || j�S t k r~ t|tj �rx|j |krx|S � Y nX tdt|�j� ���d S )NzInvalid Attribute context )�attrrC �ctxrB rH �Loadr� rK r� r� r� r� r� r� r� rF rM ) ra rJ r/ r� rC r� �resolvedr� rL r r r" �visit_Attributez s z BaseExprVisitor.visit_Attributec sr t |jtj�r(|jjdkr(� �|j�}nft |jtj�s@td��nNy� �|j�}W n< t k r� yt |jj �}W n t k r� � Y nX Y nX |d kr�t d|jj � ���t |d�r�|j}t |t �r�� fdd�|jD �}|jr�td|j� d���||� S � fd d�|jD �}xN|jD ]D}t |tj��s8t d |jj � d ���|j�r� �|j�j||j< �qW � �|||�� j�S d S ) N�__call__z"Only named functions are supportedzInvalid function call rC c s g | ]}� � |��qS r )r� )r< �arg)ra r r" r� � s z.BaseExprVisitor.visit_Call.<locals>.<listcomp>z Function "z$" does not support keyword argumentsc s g | ]}� � |�j�qS r )r� rC )r< r� )ra r r" r� � s z keyword error in function call 'r_ )rB �funcrH � Attributer� r� r� r� r� r r r� r� r� rC r. �keywordsrL �keywordr� rv r� )ra rJ r� r/ r� �new_args�keyr )ra r" � visit_Call� s< zBaseExprVisitor.visit_Callc C s |S )Nr )ra rs r r r" � translate_In� s z BaseExprVisitor.translate_Inc K s� |j }|j}t|�dkrF| �|d �}tj||j|d d�}| �|�S |j}g }xDt||�D ]6\}} | �tj | g|| �|�gd��} | }|� | � q\W | �tj t� � |d��S )Nr5 r )rs r� r� )� comparatorsr� rr )rs �values) rr r� r6 r� rH r r� r� �zip�Compare�append�BoolOpr� ) ra rJ r/ rr �compsrs r� r� r� �comp�new_noder r r" � visit_Compare� s z BaseExprVisitor.visit_Comparec C s t |ttf�r|S | �|�S )N)rB r r r� )ra Zbopr r r" �_try_visit_binop� s z BaseExprVisitor._try_visit_binopc s � �fdd�}� j }t||�S )Nc s< �� | �}�� |�}��� ||�\}}}}��|� j||�S )N)r� r� r� rs )r= �yr� r� rs rm )rJ ra r r" r� � s z-BaseExprVisitor.visit_BoolOp.<locals>.visitor)r� r )ra rJ r/ r� Zoperandsr )rJ ra r" � visit_BoolOp� s z BaseExprVisitor.visit_BoolOp)NN)r� r� )N)9rM � __module__� __qualname__�__doc__r rv �__annotations__r r� r r r r� Zbinary_op_nodes�dictr� Zbinary_op_nodes_mapr Z unary_opsZunary_op_nodesZunary_op_nodes_maprH r{ r} r| r~ r� rA r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� Z visit_Tupler� r� r� r� r� r� r� r� r� r� r r r r" rd Q sX 5�Dictr� r} r~ r� �Tuplec s0 e Zd Zeeeeee�d�f� fdd� Z � Z S )�PandasExprVisitor)r0 c s t � �||||� d S )N)�superr� )ra r� r� r� r� )� __class__r r" r� � s zPandasExprVisitor.__init__) rM r� r r rA r9 r- r+ r r� � __classcell__r r )r r" r � s r r� c s$ e Zd Zdd� f� fdd� Z� ZS )�PythonExprVisitorc C s | S )Nr )r= r r r" r2 r3 zPythonExprVisitor.<lambda>c s t � j||||d� d S )N)r� )r r� )ra r� r� r� r� )r r r" r� s zPythonExprVisitor.__init__)rM r� r r� r r r )r r" r s r c @ s� e Zd ZU dZded< ded< ded< d ddd d d �dd�Zedd� �Zdd� Zdd�dd�Z d d�dd�Z dd� Z edd � �Z d S ) rS a Object encapsulating an expression. Parameters ---------- expr : str engine : str, optional, default 'numexpr' parser : str, optional, default 'pandas' env : Scope, optional, default None level : int, optional, default 2 r r� r: r� r� �numexprr� Nr z Scope | None�int)r� r� r� �levelc C sL || _ |pt|d d�| _|| _|| _t| | j| j| j�| _| �� | _d S )Nr5 )r ) r� r r� r� r� �PARSERS�_visitorr� �terms)ra r� r� r� r� r r r r" r� s z Expr.__init__c C s t | jdd �S )Nr� )rK r )ra r r r" r� ( s z Expr.assignerc C s | � | j�S )N)r r� )ra r r r" r� , s z Expr.__call__)r c C s t �| j�S )N)�printingZ pprint_thingr )ra r r r" �__repr__/ s z Expr.__repr__c C s t | j�S )N)r6 r� )ra r r r" �__len__2 s z Expr.__len__c C s | j �| j�S )z& Parse an expression. )r r� r� )ra r r r" r� 5 s z Expr.parsec C s2 t | j�rt| jjg�S tdd� t�| j�D ��S )z1 Get the names in an expression. c s s | ] }|j V qd S )N)rL )r< �termr r r" r> B s z Expr.names.<locals>.<genexpr>)r r rO rL �com�flatten)ra r r r" �names; s z Expr.names)r r� Nr ) rM r� r r r r� �propertyr� r� r r r� r r r r r" rS s )�pythonr� )pr � __future__r rH � functoolsr r r� r r( �typingr r �numpyr� Z pandas.compatr Zpandas.core.common�core�commonr Zpandas.core.computation.opsr r r r r r r r r r r r r r r r Z pandas.core.computation.parsingr r Z pandas.core.computation.scoper Zpandas.io.formats.printing�io�formatsr r# r+ r- r4 r9 rA rE �listr� r: r� rO �dirZ _all_nodesrP r� Z_all_node_names�modZ _mod_nodes�stmtZ _stmt_nodesr� Z _expr_nodes� expr_contextZ_expr_context_nodes�boolopZ _boolop_nodes�operatorZ_operator_nodes�unaryopZ_unary_op_nodes�cmpopZ _cmp_op_nodes� comprehensionZ_comprehension_nodes� excepthandlerZ_handler_nodes� argumentsZ_arguments_nodesZ_keyword_nodes�aliasZ _alias_nodesr� Z _slice_nodesZ _hacked_nodesZ_unsupported_expr_nodesZ_unsupported_nodesZ_base_supported_nodes� intersectionZ_msgr7 rb rc rl ro Z _op_classesru � NodeVisitorrd Z_python_not_supportedZ_numexpr_supported_callsr r rS r r r r r" �<module> s� H " =
| ver. 1.4 |
Github
|
.
| PHP 8.3.23 | Генерация страницы: 0.03 |
proxy
|
phpinfo
|
Настройка