Файловый менеджер - Редактировать - /home/digitalm/venv/lib/python3.7/site-packages/openpyxl/formula/__pycache__/tokenizer.cpython-37.pyc
Назад
B �5�g ; � @ s@ d Z ddlZG dd� de�ZG dd� de�ZG dd� de�ZdS ) z� This module contains a tokenizer for Excel formulae. The tokenizer is based on the Javascript tokenizer found at http://ewbi.blogs.com/develops/2004/12/excel_formula_p.html written by Eric Bachtal � Nc @ s e Zd ZdZdS )�TokenizerErrorz$Base class for all Tokenizer errors.N)�__name__� __module__� __qualname__�__doc__� r r �P/home/digitalm-up/venv/lib/python3.7/site-packages/openpyxl/formula/tokenizer.pyr s r c @ s� e Zd ZdZe�d�Ze�d�Ze�d�e�d�d�ZdZ dZ d d � Z d d � Z d d� Z dd� Zdd� Zdd� Zdd� Zdd� Zdd� Zdd � Zd d � Zd'd d!�Zd"d#� Zd$d%� Zd&S )(� Tokenizera^ A tokenizer for Excel worksheet formulae. Converts a str string representing an Excel formula (in A1 notation) into a sequence of `Token` objects. `formula`: The str string to tokenize Tokenizer defines a method `._parse()` to parse the formula into tokens, which can then be accessed through the `.items` attribute. z^[1-9](\.[0-9]+)?[Ee]$z[ \n]+z"(?:[^"]*"")*[^"]*"(?!")z'(?:[^']*'')*[^']*'(?!'))�"�')z#NULL!z#DIV/0!z#VALUE!z#REF!z#NAME?z#NUM!z#N/Az #GETTING_DATAz,;}) +-*/^&=><%c C s* || _ g | _g | _d| _g | _| �� d S )Nr )�formula�items� token_stack�offset�token�_parse)�selfr r r r �__init__. s zTokenizer.__init__c C sF | j r dS | jsdS | jd dkr2| j d7 _ n| j�t| jtj�� dS d| jfd| jfd| jfd| j fd | j fd | j fd | j fd | j fd | j ff }i }x"|D ]\}}|�t�||�� q�W xx| j t| j�k �r8| �� r�q�| j| j }|| jkr�| �� ||k�r | j || � 7 _ q�| j�|� | j d7 _ q�W | �� dS )z5Populate self.items with the tokens from the formula.Nr �=� z"'�[�#� � z +-*/^&=><%z{(z)}z;,)r r r �append�Token�LITERAL� _parse_string�_parse_brackets� _parse_error�_parse_whitespace�_parse_operator� _parse_opener� _parse_closer�_parse_separator�update�dict�fromkeys�len�check_scientific_notation� TOKEN_ENDERS� save_tokenr )r Z consumersZ dispatcher�charsZconsumer� curr_charr r r r 7 s> zTokenizer._parsec C s� | j dd� | j| j }|dks$t�| j| }|�| j| jd� �}|dkrr|dkrXdnd}td|� d | j� ���|�d �}|dkr�| j� t � |�� n | j � |� t |�S ) a� Parse a "-delimited string or '-delimited link. The offset must be pointing to either a single quote ("'") or double quote ('"') character. The strings are parsed according to Excel rules where to escape the delimiter you just double it up. E.g., "abc""def" in Excel is parsed as 'abc"def' in Python. Returns the number of characters matched. (Does not update self.offset) �:)� can_follow)r r Nr �string�linkz%Reached end of formula while parsing z in r )�assert_empty_tokenr r �AssertionError�STRING_REGEXES�matchr �groupr r r � make_operandr r( )r �delim�regexr5 �subtyper r r r _ s zTokenizer._parse_stringc C s� | j | j dkst�dd� t�d| j | jd� �D �}dd� t�d| j | jd� �D �}d}xRt|| �D ]B\}}||7 }|dkrj|d }| j�| j | j| j| � � |S qjW td | j � ���dS ) z� Consume all the text between square brackets []. Returns the number of characters matched. (Does not update self.offset) r c S s g | ]}|� � d f�qS )r )�start)�.0�tr r r � <listcomp>� s z-Tokenizer._parse_brackets.<locals>.<listcomp>z\[Nc S s g | ]}|� � d f�qS )���)r; )r< r= r r r r> � s z\]r r z Encountered unmatched '[' in ) r r r3 �re�finditer�sortedr r r )r ZleftsZrightsZ open_count�idxZ open_closeZ outer_rightr r r r { s zTokenizer._parse_bracketsc C s� | j dd� | j| j dks t�| j| jd� }xJ| jD ]@}|�|�r8| j�t� d� | j �| �� | j dd�= t |�S q8W t d| j� d| j� d���dS ) z� Consume the text following a '#' as an error. Looks for a match in self.ERROR_CODES and returns the number of characters matched. (Does not update self.offset) �!)r/ r N� z Invalid error code at position z in 'r )r2 r r r3 � ERROR_CODES� startswithr r r r7 �joinr r( r )r Z subformula�errr r r r � s zTokenizer._parse_errorc C sL | j | j dkst�| j�t| j | j tj�� | j�| j | jd� �� � S )z� Consume a string of consecutive spaces. Returns the number of spaces found. (Does not update self.offset). )r r N) r r r3 r r r �WSPACE� WSPACE_REr5 �end)r r r r r � s zTokenizer._parse_whitespacec C s | j | j| jd � dkrD| j�t| j | j| jd � tj�� dS | j | j }|dks\t�|dkrrtdtj�}n�|dkr�t|tj�}nt| js�t|tj�}n`t dd� t | j�D �d�}|o�|j tj kp�|j tjkp�|j tjk}|r�t|tj�}n t|tj�}| j�|� d S ) z� Consume the characters constituting an operator. Returns the number of characters consumed. (Does not update self.offset) � )z>=z<=z<>z %*/^&=><+-�%z*/^&=><c s s | ]}|j tjkr|V qd S )N)�typer rJ )r< �ir r r � <genexpr>� s z,Tokenizer._parse_operator.<locals>.<genexpr>Nr )r r r r r �OP_INr3 �OP_POST�OP_PRE�next�reversedr: �CLOSErO �OPERAND)r r- r �prevZis_infixr r r r! � s0 zTokenizer._parse_operatorc C s� | j | j dkst�| j | j dkr8| �� t�d�}n8| jrfd�| j�d }| jdd�= t�|�}n t�d�}| j� |� | j � |� dS )z� Consumes a ( or { character. Returns the number of characters consumed. (Does not update self.offset) )�(�{r[ rE rZ Nr ) r r r3 r2 r � make_subexpr rH r r r )r r Z token_valuer r r r" � s zTokenizer._parse_openerc C sR | j | j dkst�| j�� �� }|j| j | j krBtd| j ��| j� |� dS )z� Consumes a } or ) character. Returns the number of characters consumed. (Does not update self.offset) )�)�}z Mismatched ( and { pair in '%s'r ) r r r3 r �pop� get_closer�valuer r r )r r r r r r# � s zTokenizer._parse_closerc C s� | j | j }|dkst�|dkr,t�d�}nTy| jd j}W n tk r\ tdtj�}Y n$X |tj krvtdtj�}n t�d�}| j � |� dS )z� Consumes a ; or , character. Returns the number of characters consumed. (Does not update self.offset) )�;�,rb r? rc r ) r r r3 r �make_separatorr rO � IndexErrorrR �PARENr r )r r- r Ztop_typer r r r$ � s zTokenizer._parse_separatorc C sX | j | j }|dkrTt| j�dkrT| j�d�| j��rT| j�|� | jd7 _dS dS )z� Consumes a + or - character if part of a number in sci. notation. Returns True if the character was consumed and self.offset was updated, False otherwise. z+-r rE TF)r r r( r �SN_REr5 rH r )r r- r r r r) s z#Tokenizer.check_scientific_notationr c C s2 | j r.| j d |kr.td| j� d| j� d���dS )a: Ensure that there's no token currently being parsed. Or if there is a token being parsed, it must end with a character in can_follow. If there are unconsumed token contents, it means we hit an unexpected token transition. In this case, we raise a TokenizerError r? z!Unexpected character at position z in 'r N)r r r r )r r/ r r r r2 ' s z Tokenizer.assert_empty_tokenc C s0 | j r,| j�t�d�| j ��� | j dd�= dS )z9If there's a token being parsed, add it to the item list.rE N)r r r r r7 rH )r r r r r+ 5 s zTokenizer.save_tokenc C sB | j s dS | j d jtjkr(| j d jS dd�dd� | j D �� S )z+Convert the parsed tokens back to a string.rE r r c s s | ] }|j V qd S )N)ra )r< r r r r rQ A s z#Tokenizer.render.<locals>.<genexpr>)r rO r r ra rH )r r r r �render; s zTokenizer.renderN)r )r r r r r@ �compilerg rK r4 rF r* r r r r r r r! r" r# r$ r) r2 r+ rh r r r r r s* ( & r c @ s� e Zd ZdZdddgZdZdZdZdZd Z d Z d Z d Z d Z dZd'dd�ZdZdZdZdZdZdd� Zedd� �ZdZd Zed(d d ��Zd d!� Zd"Z d#Z ed$d%� �Z d&S ))r a) A token in an Excel formula. Tokens have three attributes: * `value`: The string value parsed that led to this token * `type`: A string identifying the type of token * `subtype`: A string identifying subtype of the token (optional, and defaults to "") ra rO r: r rX �FUNC�ARRAYrf �SEPzOPERATOR-PREFIXzOPERATOR-INFIXzOPERATOR-POSTFIXz WHITE-SPACErE c C s || _ || _|| _d S )N)ra rO r: )r ra �type_r: r r r r _ s zToken.__init__�TEXT�NUMBER�LOGICAL�ERROR�RANGEc C s d� | j| j| j�S )Nz {0} {1} {2}:)�formatrO r: ra )r r r r �__repr__q s zToken.__repr__c C sp |� d�r| j}nP|� d�r$| j}n>|dkr4| j}n.yt|� | j}W n tk r` | j}Y nX | || j|�S )zCreate an operand token.r r )�TRUE�FALSE) rG rn rq rp �floatro � ValueErrorrr rX )�clsra r: r r r r7 t s zToken.make_operand�OPENrW Fc C sr |d dkst �|r,t�d|�s$t �tj}n&|dkr<tj}n|dkrLtj}ntj}|dkr`| jn| j}| |||�S )z� Create a subexpression token. `value`: The value of the token `func`: If True, force the token to be of type FUNC r? )r[ r^ rZ r] z.+\(|\)z{}z()z)}) r3 r@ r5 r rj rk rf rW rz )ry ra �funcrm r: r r r r\ � s zToken.make_subexpc C sT | j | j| j| jfkst�| j| jks*t�| j | jkr:dnd}| j|| j | jkd�S )z6Return a closing token that matches this token's type.r^ r] )r{ )rO rj rk rf r3 r: rz r\ )r ra r r r r` � s zToken.get_closer�ARG�ROWc C s. |dks t �|dkr| jn| j}| || j|�S )zCreate a separator token)rc rb rc )r3 r| r} rl )ry ra r: r r r rd � s zToken.make_separatorN)rE )F) r r r r � __slots__r rX rj rk rf rl rT rR rS rJ r rn ro rp rq rr rt � classmethodr7 rz rW r\ r` r| r} rd r r r r r D s8 r )r r@ � Exceptionr �objectr r r r r r �<module> s 6
| ver. 1.4 |
Github
|
.
| PHP 8.3.23 | Генерация страницы: 0.05 |
proxy
|
phpinfo
|
Настройка